2024-05-09T06:08:36.900 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T06:08:36.900 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439 --name pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi --owner scheduled_pdonnell@teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439/orig.config.yaml 2024-05-09T06:08:36.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T06:08:37.038 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439 branch: main description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7699439' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e owner: scheduled_pdonnell@teuthology priority: 95 repo: https://github.com/ceph/ceph roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5189 sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC20L3OrP/+rBDUOFmaqmCjVXER91QhSDLO9LO8KQ6lK7d+i+VNE5T07vgj9h2MYUSQJgGuETrtLLs4hOrE15z0= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDQnHsP9146oucvxq429ZKxO6+tVDSUtbYUuwcbyTBEllXWit0uT/JDIJ9KP1fG2XNRi84lH3kjaZffjnqjP0w4= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-09_00:24:17 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-05-09T06:08:37.038 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/qa; will attempt to use it 2024-05-09T06:08:37.039 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/qa/tasks 2024-05-09T06:08:37.039 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T06:08:37.041 INFO:teuthology.task.internal:Checking packages... 2024-05-09T06:08:37.064 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e' 2024-05-09T06:08:37.064 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:08:37.064 INFO:teuthology.packaging:ref: None 2024-05-09T06:08:37.064 INFO:teuthology.packaging:tag: None 2024-05-09T06:08:37.065 INFO:teuthology.packaging:branch: main 2024-05-09T06:08:37.065 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:08:37.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-05-09T06:08:37.418 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3575.g720f8e95 2024-05-09T06:08:37.420 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T06:08:37.426 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T06:08:37.426 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T06:08:37.432 INFO:teuthology.task.internal:Saving configuration 2024-05-09T06:08:37.452 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T06:08:37.458 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T06:08:37.483 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 06:03:44.026372', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC20L3OrP/+rBDUOFmaqmCjVXER91QhSDLO9LO8KQ6lK7d+i+VNE5T07vgj9h2MYUSQJgGuETrtLLs4hOrE15z0='} 2024-05-09T06:08:37.504 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 06:03:44.028296', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDQnHsP9146oucvxq429ZKxO6+tVDSUtbYUuwcbyTBEllXWit0uT/JDIJ9KP1fG2XNRi84lH3kjaZffjnqjP0w4='} 2024-05-09T06:08:37.504 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T06:08:37.510 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-05-09T06:08:37.510 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-05-09T06:08:37.510 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T06:08:37.580 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1db352a160>, signals=[15]) 2024-05-09T06:08:37.581 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T06:08:37.587 INFO:teuthology.task.internal:Opening connections... 2024-05-09T06:08:37.587 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:08:37.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:08:37.665 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-05-09T06:08:37.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:08:37.738 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T06:08:37.745 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-05-09T06:08:37.764 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-05-09T06:08:37.764 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-05-09T06:08:37.821 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-05-09T06:08:37.821 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-05-09T06:08:37.821 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-05-09T06:08:37.821 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-05-09T06:08:37.821 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T06:08:37.822 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T06:08:37.823 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-05-09T06:08:37.841 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-05-09T06:08:37.858 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-05-09T06:08:37.859 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-05-09T06:08:37.915 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-05-09T06:08:37.915 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-05-09T06:08:37.915 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T06:08:37.916 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T06:08:37.916 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-05-09T06:08:37.941 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T06:08:37.950 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T06:08:37.955 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T06:08:37.955 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-05-09T06:08:37.958 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-05-09T06:08:37.974 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T06:08:37.980 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T06:08:37.980 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-05-09T06:08:38.015 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-05-09T06:08:38.134 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T06:08:38.187 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T06:08:38.201 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-09T06:08:38.201 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-09T06:08:38.201 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T06:08:38.202 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T06:08:38.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:08:38.219 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-05-09T06:08:38.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:08:38.220 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-05-09T06:08:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-437.el9.x86_64 2024-05-09T06:08:38.276 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.14.0-437.el9.x86_64 2024-05-09T06:08:38.277 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2024-05-09T06:08:38.278 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-437.el9.x86_64 2024-05-09T06:08:38.278 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-437.el9.x86_64 2024-05-09T06:08:38.278 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-05-09T06:08:40.474 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-09T06:08:41.802 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.1 MB 00:01 2024-05-09T06:08:42.425 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-05-09T06:08:45.161 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 19 MB 00:02 2024-05-09T06:08:48.533 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.2 MB 00:02 2024-05-09T06:08:50.158 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-09T06:08:51.278 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-05-09T06:08:51.443 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-09T06:08:52.954 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-09T06:08:54.780 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-09T06:08:56.651 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-05-09T06:08:58.690 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T06:08:58.690 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T06:08:58.785 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T06:08:58.795 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T06:08:58.796 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:08:58.796 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:08:58.796 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:08:58.796 INFO:teuthology.orchestra.run.smithi079.stdout:Install 4 Packages 2024-05-09T06:08:58.796 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:08:58.796 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 78 M 2024-05-09T06:08:58.797 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 123 M 2024-05-09T06:08:58.797 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:08:58.935 INFO:teuthology.orchestra.run.smithi079.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 4.9 MB/s | 484 kB 00:00 2024-05-09T06:08:59.461 INFO:teuthology.orchestra.run.smithi079.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 25 MB/s | 15 MB 00:00 2024-05-09T06:08:59.969 INFO:teuthology.orchestra.run.smithi079.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 30 MB/s | 34 MB 00:01 2024-05-09T06:09:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-09T06:09:00.378 INFO:teuthology.orchestra.run.smithi079.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 19 MB/s | 28 MB 00:01 2024-05-09T06:09:00.378 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:09:00.378 INFO:teuthology.orchestra.run.smithi079.stdout:Total 49 MB/s | 78 MB 00:01 2024-05-09T06:09:01.063 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:09:01.394 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:09:01.394 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:09:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T06:09:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T06:09:02.310 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:09:02.311 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:09:02.325 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:09:02.334 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:09:02.334 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-05-09T06:09:02.334 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:09:02.334 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:09:02.334 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T06:09:02.334 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:09:02.334 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T06:09:02.334 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T06:09:02.335 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T06:09:02.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:09:02.335 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:09:02.335 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:09:02.335 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-05-09T06:09:02.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:09:02.335 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 78 M 2024-05-09T06:09:02.336 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 123 M 2024-05-09T06:09:02.336 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:09:03.064 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 1.1 MB/s | 484 kB 00:00 2024-05-09T06:09:04.726 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:09:05.342 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T06:09:05.428 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:09:06.689 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 3.8 MB/s | 15 MB 00:04 2024-05-09T06:09:07.298 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 6.6 MB/s | 28 MB 00:04 2024-05-09T06:09:08.101 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:09:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:09:08.756 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 5.6 MB/s | 34 MB 00:06 2024-05-09T06:09:08.757 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:09:08.757 INFO:teuthology.orchestra.run.smithi062.stdout:Total 12 MB/s | 78 MB 00:06 2024-05-09T06:09:09.467 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:09:09.893 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:09:09.893 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:09:10.846 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:09:10.847 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:09:12.966 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:09:13.014 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:13.445 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:09:14.081 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T06:09:14.189 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:09:17.164 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:09:17.765 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:22.242 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:09:22.284 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:27.373 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:47.207 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:47.245 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T06:09:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:09:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:09:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:09:48.334 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:09:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T06:09:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T06:09:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T06:09:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T06:09:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:09:48.334 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:09:48.683 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T06:09:48.774 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T06:09:48.774 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T06:09:48.775 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T06:09:48.775 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T06:09:48.775 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T06:09:48.775 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-05-09T06:09:48.775 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T06:09:48.775 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T06:09:48.823 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T06:09:48.824 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T06:09:48.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2-tools 2024-05-09T06:09:48.854 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2-tools 2024-05-09T06:09:48.854 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2024-05-09T06:09:48.854 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.06 2024-05-09T06:09:48.854 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 68.el9 2024-05-09T06:09:48.854 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2024-05-09T06:09:48.854 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T06:09:48.854 INFO:teuthology.orchestra.run.smithi079.stdout:Group : Unspecified 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 8264254 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : builder@centos.org 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : CentOS 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Support tools for GRUB. 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T06:09:48.855 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T06:09:48.856 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T06:09:48.856 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2024-05-09T06:09:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:09:48.856 INFO:teuthology.orchestra.run.smithi079.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T06:09:48.857 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T06:09:48.857 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 5.14.0-444.el9.x86_64 2024-05-09T06:09:48.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T06:09:49.475 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-05-09T06:09:50.872 INFO:teuthology.orchestra.run.smithi079.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T06:09:50.907 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-05-09T06:09:50.909 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-05-09T06:09:50.925 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.UPQUjimw1P 2024-05-09T06:09:50.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UPQUjimw1P 2024-05-09T06:09:50.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.UPQUjimw1P 2024-05-09T06:09:51.144 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.UPQUjimw1P is 6KB 2024-05-09T06:09:51.192 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.UPQUjimw1P 2024-05-09T06:09:51.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T06:09:51.268 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T06:09:51.268 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T06:09:51.268 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T06:09:51.268 INFO:teuthology.orchestra.run.smithi079.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T06:09:51.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T06:09:51.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-05-09T06:09:58.485 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:58.525 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:58.870 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:58.870 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T06:09:58.870 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:09:58.870 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:09:59.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:59.689 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:09:59.689 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:09:59.689 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T06:09:59.689 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T06:09:59.689 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T06:09:59.689 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T06:09:59.689 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:09:59.689 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:10:00.010 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T06:10:00.123 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T06:10:00.123 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T06:10:00.123 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T06:10:00.124 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T06:10:00.124 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T06:10:00.124 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-05-09T06:10:00.124 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T06:10:00.124 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T06:10:00.176 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T06:10:00.176 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T06:10:00.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 68.el9 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8264254 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T06:10:00.211 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:10:00.212 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T06:10:00.213 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T06:10:00.213 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 5.14.0-444.el9.x86_64 2024-05-09T06:10:00.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T06:10:00.859 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-05-09T06:10:02.289 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T06:10:02.308 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-05-09T06:10:02.310 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-05-09T06:10:02.366 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.R4fcRP5YR8 2024-05-09T06:10:02.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.R4fcRP5YR8 2024-05-09T06:10:02.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.R4fcRP5YR8 2024-05-09T06:10:02.574 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.R4fcRP5YR8 is 6KB 2024-05-09T06:10:02.623 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.R4fcRP5YR8 2024-05-09T06:10:02.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T06:10:02.700 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T06:10:02.701 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T06:10:02.701 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T06:10:02.701 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T06:10:02.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T06:10:02.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-05-09T06:10:21.432 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-05-09T06:10:21.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-05-09T06:10:21.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:10:32.850 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-05-09T06:10:32.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-09T06:10:32.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:11:21.482 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T06:11:30.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-05-09T06:11:30.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:11:32.854 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T06:11:33.873 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-05-09T06:11:34.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-05-09T06:11:34.290 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-444.el9.x86_64"... 2024-05-09T06:11:34.290 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-05-09T06:11:34.305 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-444.el9.x86_64 2024-05-09T06:11:34.305 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T06:11:34.305 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T06:11:34.305 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T06:11:35.306 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-05-09T06:11:35.306 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T06:11:35.395 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-05-09T06:11:35.430 DEBUG:teuthology.parallel:result is None 2024-05-09T06:11:41.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-09T06:11:41.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:11:42.289 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-05-09T06:11:42.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-09T06:11:42.726 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-444.el9.x86_64"... 2024-05-09T06:11:42.727 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-05-09T06:11:42.743 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-444.el9.x86_64 2024-05-09T06:11:42.743 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T06:11:42.743 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T06:11:42.743 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T06:11:43.744 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-05-09T06:11:43.744 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T06:11:43.807 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-05-09T06:11:43.840 DEBUG:teuthology.parallel:result is None 2024-05-09T06:11:43.841 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T06:11:43.848 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T06:11:43.848 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T06:11:43.850 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T06:11:43.871 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T06:11:43.878 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T06:11:43.885 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T06:11:43.885 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T06:11:43.903 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T06:11:44.028 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T06:11:44.035 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T06:11:44.036 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T06:11:44.038 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T06:11:44.069 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T06:11:44.070 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T06:11:44.081 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T06:11:44.081 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T06:11:44.083 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T06:11:44.090 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T06:11:44.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T06:11:44.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T06:11:44.151 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T06:11:44.160 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T06:11:44.161 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T06:11:44.186 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T06:11:44.207 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T06:11:44.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T06:11:44.330 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T06:11:44.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T06:11:44.449 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:11:44.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T06:11:44.517 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T06:11:44.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T06:11:44.614 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T06:11:44.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T06:11:44.738 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:11:44.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T06:11:44.804 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-05-09T06:11:44.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-05-09T06:11:44.844 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:11:44.889 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:11:45.398 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T06:11:45.406 INFO:teuthology.task.internal:Starting timer... 2024-05-09T06:11:45.406 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T06:11:45.416 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T06:11:45.424 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-09T06:11:45.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-05-09T06:11:45.486 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-05-09T06:11:45.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-05-09T06:11:45.573 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-05-09T06:11:45.576 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T06:11:45.576 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-05-09T06:11:45.609 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-05-09T06:11:45.609 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-05-09T06:11:45.630 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-05-09T06:11:45.630 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi079.front.sepia.ceph.com': 'permissive'} 2024-05-09T06:11:45.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:11:45.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:11:45.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:11:45.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:11:45.698 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T06:11:45.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-05-09T06:11:45.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-05-09T06:11:45.831 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T06:11:45.841 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T06:11:45.859 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T06:11:45.860 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi079.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T06:15:51.556 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com')] 2024-05-09T06:15:51.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-09T06:15:51.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:15:51.637 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-05-09T06:15:51.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-09T06:15:51.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-05-09T06:15:51.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:15:51.793 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-05-09T06:15:51.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-05-09T06:15:51.873 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T06:15:51.883 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T06:15:51.884 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T06:15:51.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:15:51.886 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T06:15:51.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:15:51.916 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T06:15:51.931 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T06:15:51.941 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T06:15:51.955 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T06:15:51.956 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-05-09T06:15:51.968 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-05-09T06:15:51.979 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-05-09T06:15:51.982 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T06:15:51.990 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-05-09T06:15:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T06:15:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T06:15:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T06:15:52.052 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:15:52.055 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:15:52.055 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-05-09T06:15:52.056 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:15:52.056 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:15:52.056 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:15:52.056 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:15:52.070 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:15:52.074 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:15:52.074 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-05-09T06:15:52.074 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:15:52.074 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:15:52.074 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:15:52.074 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:15:52.075 INFO:teuthology.run_tasks:Running task install... 2024-05-09T06:15:52.084 DEBUG:teuthology.task.install:project ceph 2024-05-09T06:15:52.085 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'}} 2024-05-09T06:15:52.085 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'} 2024-05-09T06:15:52.085 INFO:teuthology.task.install:Using flavor: default 2024-05-09T06:15:52.090 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T06:15:52.091 INFO:teuthology.task.install:extra packages: [] 2024-05-09T06:15:52.091 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'tag': None, 'wait_for_package': False} 2024-05-09T06:15:52.091 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:15:52.091 INFO:teuthology.packaging:ref: None 2024-05-09T06:15:52.091 INFO:teuthology.packaging:tag: None 2024-05-09T06:15:52.091 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:15:52.092 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:15:52.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-05-09T06:15:52.094 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'tag': None, 'wait_for_package': False} 2024-05-09T06:15:52.094 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:15:52.094 INFO:teuthology.packaging:ref: None 2024-05-09T06:15:52.094 INFO:teuthology.packaging:tag: None 2024-05-09T06:15:52.094 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:15:52.094 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:15:52.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-05-09T06:15:52.336 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/ 2024-05-09T06:15:52.337 INFO:teuthology.task.install.rpm:Package version is 17.2.7-933.g4ba5a836 2024-05-09T06:15:52.343 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/ 2024-05-09T06:15:52.343 INFO:teuthology.task.install.rpm:Package version is 17.2.7-933.g4ba5a836 2024-05-09T06:15:52.460 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T06:15:52.460 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:15:52.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T06:15:52.488 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-09T06:15:52.488 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:15:52.488 INFO:teuthology.packaging:ref: None 2024-05-09T06:15:52.488 INFO:teuthology.packaging:tag: None 2024-05-09T06:15:52.488 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:15:52.488 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:15:52.488 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T06:15:52.521 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T06:15:52.521 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:15:52.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T06:15:52.549 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-09T06:15:52.549 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:15:52.549 INFO:teuthology.packaging:ref: None 2024-05-09T06:15:52.549 INFO:teuthology.packaging:tag: None 2024-05-09T06:15:52.549 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:15:52.549 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:15:52.550 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T06:15:52.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T06:15:52.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T06:15:52.628 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T06:15:52.693 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-05-09T06:15:52.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-05-09T06:15:52.695 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T06:15:52.761 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-05-09T06:15:52.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-05-09T06:15:52.931 INFO:teuthology.orchestra.run.smithi079.stdout:54 files removed 2024-05-09T06:15:52.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw 2024-05-09T06:15:53.006 INFO:teuthology.orchestra.run.smithi062.stdout:54 files removed 2024-05-09T06:15:53.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw 2024-05-09T06:15:53.548 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 244 kB/s | 77 kB 00:00 2024-05-09T06:15:53.802 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 162 kB/s | 77 kB 00:00 2024-05-09T06:15:53.881 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-05-09T06:15:54.352 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 21 kB/s | 11 kB 00:00 2024-05-09T06:15:54.357 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 4.1 kB/s | 1.8 kB 00:00 2024-05-09T06:15:54.761 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 4.9 kB/s | 1.8 kB 00:00 2024-05-09T06:15:55.369 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-09T06:15:56.057 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.1 MB 00:01 2024-05-09T06:15:57.869 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-05-09T06:16:09.225 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 821 kB/s | 6.2 MB 00:07 2024-05-09T06:16:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-05-09T06:16:12.271 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-09T06:16:17.460 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-05-09T06:16:19.866 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:16:19.869 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:16:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:16:19.869 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:16:19.869 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:16:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 14 M 2024-05-09T06:16:19.869 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-05-09T06:16:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 3.1 M 2024-05-09T06:16:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.9 M 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 5.0 M 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 22 M 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 25 k 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 638 k 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 457 k 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 4.9 M 2024-05-09T06:16:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 45 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 118 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 156 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 320 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 293 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 99 k 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout:Install 22 Packages 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 2 Packages 2024-05-09T06:16:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:19.872 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 58 M 2024-05-09T06:16:19.872 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:16:19.909 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 834 kB/s | 19 MB 00:23 2024-05-09T06:16:24.160 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-09T06:16:25.252 INFO:teuthology.orchestra.run.smithi079.stdout:(1/24): ceph-base-17.2.7-933.g4ba5a836.el9.x86_ 5.7 MB/s | 5.0 MB 00:00 2024-05-09T06:16:25.318 INFO:teuthology.orchestra.run.smithi079.stdout:(2/24): ceph-selinux-17.2.7-933.g4ba5a836.el9.x 378 kB/s | 25 kB 00:00 2024-05-09T06:16:25.444 INFO:teuthology.orchestra.run.smithi079.stdout:(3/24): libcephfs2-17.2.7-933.g4ba5a836.el9.x86 5.0 MB/s | 638 kB 00:00 2024-05-09T06:16:25.577 INFO:teuthology.orchestra.run.smithi079.stdout:(4/24): libradosstriper1-17.2.7-933.g4ba5a836.e 3.4 MB/s | 457 kB 00:00 2024-05-09T06:16:26.111 INFO:teuthology.orchestra.run.smithi079.stdout:(5/24): ceph-radosgw-17.2.7-933.g4ba5a836.el9.x 8.1 MB/s | 14 MB 00:01 2024-05-09T06:16:26.178 INFO:teuthology.orchestra.run.smithi079.stdout:(6/24): python3-ceph-argparse-17.2.7-933.g4ba5a 679 kB/s | 45 kB 00:00 2024-05-09T06:16:26.270 INFO:teuthology.orchestra.run.smithi079.stdout:(7/24): python3-ceph-common-17.2.7-933.g4ba5a83 1.3 MB/s | 118 kB 00:00 2024-05-09T06:16:26.345 INFO:teuthology.orchestra.run.smithi079.stdout:(8/24): librgw2-17.2.7-933.g4ba5a836.el9.x86_64 6.4 MB/s | 4.9 MB 00:00 2024-05-09T06:16:26.370 INFO:teuthology.orchestra.run.smithi079.stdout:(9/24): python3-cephfs-17.2.7-933.g4ba5a836.el9 1.5 MB/s | 156 kB 00:00 2024-05-09T06:16:26.404 INFO:teuthology.orchestra.run.smithi079.stdout:(10/24): python3-rados-17.2.7-933.g4ba5a836.el9 5.3 MB/s | 320 kB 00:00 2024-05-09T06:16:26.430 INFO:teuthology.orchestra.run.smithi079.stdout:(11/24): python3-rbd-17.2.7-933.g4ba5a836.el9.x 4.9 MB/s | 293 kB 00:00 2024-05-09T06:16:26.463 INFO:teuthology.orchestra.run.smithi079.stdout:(12/24): python3-rgw-17.2.7-933.g4ba5a836.el9.x 1.7 MB/s | 99 kB 00:00 2024-05-09T06:16:26.663 INFO:teuthology.orchestra.run.smithi079.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 226 kB/s | 45 kB 00:00 2024-05-09T06:16:26.755 INFO:teuthology.orchestra.run.smithi079.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 492 kB/s | 160 kB 00:00 2024-05-09T06:16:26.886 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-05-09T06:16:27.030 INFO:teuthology.orchestra.run.smithi079.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-05-09T06:16:27.106 INFO:teuthology.orchestra.run.smithi079.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.5 MB/s | 662 kB 00:00 2024-05-09T06:16:27.156 INFO:teuthology.orchestra.run.smithi079.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 337 kB/s | 42 kB 00:00 2024-05-09T06:16:27.356 INFO:teuthology.orchestra.run.smithi079.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 243 kB/s | 49 kB 00:00 2024-05-09T06:16:27.423 INFO:teuthology.orchestra.run.smithi079.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 974 kB/s | 309 kB 00:00 2024-05-09T06:16:27.473 INFO:teuthology.orchestra.run.smithi079.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-05-09T06:16:27.749 INFO:teuthology.orchestra.run.smithi079.stdout:(21/24): librados2-17.2.7-933.g4ba5a836.el9.x86 11 MB/s | 3.1 MB 00:00 2024-05-09T06:16:27.791 INFO:teuthology.orchestra.run.smithi079.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-05-09T06:16:27.983 INFO:teuthology.orchestra.run.smithi079.stdout:(23/24): librbd1-17.2.7-933.g4ba5a836.el9.x86_6 13 MB/s | 2.9 MB 00:00 2024-05-09T06:16:28.307 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-05-09T06:16:28.716 INFO:teuthology.orchestra.run.smithi079.stdout:(24/24): ceph-common-17.2.7-933.g4ba5a836.el9.x 5.2 MB/s | 22 MB 00:04 2024-05-09T06:16:28.719 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:16:28.719 INFO:teuthology.orchestra.run.smithi079.stdout:Total 6.5 MB/s | 58 MB 00:08 2024-05-09T06:16:28.784 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:16:28.817 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:16:28.817 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:16:29.405 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:16:29.405 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:16:30.571 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:16:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-05-09T06:16:31.043 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:16:31.118 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:16:31.198 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 3/26 2024-05-09T06:16:31.220 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:16:31.292 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:16:31.337 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-05-09T06:16:31.366 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-05-09T06:16:31.802 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-05-09T06:16:31.831 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 8/26 2024-05-09T06:16:31.877 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 8/26 2024-05-09T06:16:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-05-09T06:16:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x 10/26 2024-05-09T06:16:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 11/26 2024-05-09T06:16:32.056 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 12/26 2024-05-09T06:16:32.084 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:16:32.149 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:16:32.198 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-05-09T06:16:32.242 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-05-09T06:16:32.275 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-05-09T06:16:32.572 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-05-09T06:16:32.613 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 18/26 2024-05-09T06:16:32.685 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 18/26 2024-05-09T06:16:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 19/26 2024-05-09T06:16:32.790 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86 20/26 2024-05-09T06:16:33.713 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-09T06:16:35.220 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:16:35.254 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:16:35.769 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:16:35.807 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 22/26 2024-05-09T06:16:35.901 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 22/26 2024-05-09T06:16:35.901 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T06:16:35.901 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T06:16:35.901 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:35.933 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:16:36.190 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 14 M 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 3.1 M 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.9 M 2024-05-09T06:16:36.193 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 5.0 M 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 22 M 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 25 k 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 638 k 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 457 k 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T06:16:36.194 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 4.9 M 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 45 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 118 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 156 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 320 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 293 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 99 k 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:16:36.195 INFO:teuthology.orchestra.run.smithi062.stdout:Install 22 Packages 2024-05-09T06:16:36.196 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 2 Packages 2024-05-09T06:16:36.196 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:16:36.196 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 58 M 2024-05-09T06:16:36.196 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:16:37.489 INFO:teuthology.orchestra.run.smithi062.stdout:(1/24): ceph-base-17.2.7-933.g4ba5a836.el9.x86_ 4.6 MB/s | 5.0 MB 00:01 2024-05-09T06:16:37.540 INFO:teuthology.orchestra.run.smithi062.stdout:(2/24): ceph-selinux-17.2.7-933.g4ba5a836.el9.x 504 kB/s | 25 kB 00:00 2024-05-09T06:16:37.681 INFO:teuthology.orchestra.run.smithi062.stdout:(3/24): libcephfs2-17.2.7-933.g4ba5a836.el9.x86 4.4 MB/s | 638 kB 00:00 2024-05-09T06:16:37.798 INFO:teuthology.orchestra.run.smithi062.stdout:(4/24): libradosstriper1-17.2.7-933.g4ba5a836.e 3.8 MB/s | 457 kB 00:00 2024-05-09T06:16:38.424 INFO:teuthology.orchestra.run.smithi062.stdout:(5/24): ceph-radosgw-17.2.7-933.g4ba5a836.el9.x 7.0 MB/s | 14 MB 00:02 2024-05-09T06:16:38.499 INFO:teuthology.orchestra.run.smithi062.stdout:(6/24): python3-ceph-argparse-17.2.7-933.g4ba5a 603 kB/s | 45 kB 00:00 2024-05-09T06:16:38.566 INFO:teuthology.orchestra.run.smithi062.stdout:(7/24): librgw2-17.2.7-933.g4ba5a836.el9.x86_64 6.4 MB/s | 4.9 MB 00:00 2024-05-09T06:16:38.582 INFO:teuthology.orchestra.run.smithi062.stdout:(8/24): python3-ceph-common-17.2.7-933.g4ba5a83 1.4 MB/s | 118 kB 00:00 2024-05-09T06:16:38.808 INFO:teuthology.orchestra.run.smithi062.stdout:(9/24): ceph-common-17.2.7-933.g4ba5a836.el9.x8 9.4 MB/s | 22 MB 00:02 2024-05-09T06:16:38.833 INFO:teuthology.orchestra.run.smithi062.stdout:(10/24): python3-cephfs-17.2.7-933.g4ba5a836.el 583 kB/s | 156 kB 00:00 2024-05-09T06:16:38.858 INFO:teuthology.orchestra.run.smithi062.stdout:(11/24): python3-rados-17.2.7-933.g4ba5a836.el9 1.1 MB/s | 320 kB 00:00 2024-05-09T06:16:38.912 INFO:teuthology.orchestra.run.smithi062.stdout:(12/24): python3-rgw-17.2.7-933.g4ba5a836.el9.x 1.2 MB/s | 99 kB 00:00 2024-05-09T06:16:38.984 INFO:teuthology.orchestra.run.smithi062.stdout:(13/24): python3-rbd-17.2.7-933.g4ba5a836.el9.x 1.6 MB/s | 293 kB 00:00 2024-05-09T06:16:39.109 INFO:teuthology.orchestra.run.smithi062.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 229 kB/s | 45 kB 00:00 2024-05-09T06:16:39.135 INFO:teuthology.orchestra.run.smithi062.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 580 kB/s | 160 kB 00:00 2024-05-09T06:16:39.202 INFO:teuthology.orchestra.run.smithi062.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 633 kB/s | 42 kB 00:00 2024-05-09T06:16:39.327 INFO:teuthology.orchestra.run.smithi062.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2024-05-09T06:16:39.386 INFO:teuthology.orchestra.run.smithi062.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.6 MB/s | 309 kB 00:00 2024-05-09T06:16:39.436 INFO:teuthology.orchestra.run.smithi062.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-09T06:16:39.461 INFO:teuthology.orchestra.run.smithi062.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 363 kB/s | 49 kB 00:00 2024-05-09T06:16:39.486 INFO:teuthology.orchestra.run.smithi062.stdout:(21/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-05-09T06:16:39.570 INFO:teuthology.orchestra.run.smithi062.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-09T06:16:39.787 INFO:teuthology.orchestra.run.smithi062.stdout:(23/24): librbd1-17.2.7-933.g4ba5a836.el9.x86_6 9.8 MB/s | 2.9 MB 00:00 2024-05-09T06:16:39.854 INFO:teuthology.orchestra.run.smithi062.stdout:(24/24): librados2-17.2.7-933.g4ba5a836.el9.x86 7.8 MB/s | 3.1 MB 00:00 2024-05-09T06:16:39.856 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:16:39.856 INFO:teuthology.orchestra.run.smithi062.stdout:Total 16 MB/s | 58 MB 00:03 2024-05-09T06:16:39.921 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:16:39.959 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:16:39.959 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:16:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:16:40.587 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:16:41.779 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:16:42.158 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-05-09T06:16:42.223 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:16:42.322 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:16:42.405 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 3/26 2024-05-09T06:16:42.432 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:16:42.527 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:16:42.567 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-05-09T06:16:42.596 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-05-09T06:16:43.062 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-05-09T06:16:43.094 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 8/26 2024-05-09T06:16:43.165 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 8/26 2024-05-09T06:16:43.202 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-05-09T06:16:43.252 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x 10/26 2024-05-09T06:16:43.290 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 11/26 2024-05-09T06:16:43.354 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 12/26 2024-05-09T06:16:43.379 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:16:43.445 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:16:43.495 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-05-09T06:16:43.538 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-05-09T06:16:43.570 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-05-09T06:16:43.886 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-05-09T06:16:43.925 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 18/26 2024-05-09T06:16:43.999 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 18/26 2024-05-09T06:16:44.074 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 19/26 2024-05-09T06:16:44.119 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86 20/26 2024-05-09T06:16:45.266 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:16:45.266 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-05-09T06:16:45.266 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-05-09T06:16:45.266 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-05-09T06:16:45.266 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-05-09T06:16:45.266 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-05-09T06:16:45.266 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-05-09T06:16:45.266 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-05-09T06:16:45.267 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:46.524 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 24/26 2024-05-09T06:16:46.603 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 24/26 2024-05-09T06:16:46.603 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:16:46.603 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T06:16:46.603 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T06:16:46.603 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T06:16:46.603 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:46.605 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-05-09T06:16:46.616 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:16:46.649 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:16:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-05-09T06:16:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:16:47.200 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:16:47.244 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 22/26 2024-05-09T06:16:47.355 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 22/26 2024-05-09T06:16:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T06:16:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T06:16:47.355 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:16:47.378 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 1/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 3/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 5/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 6/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 7/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x 8/26 2024-05-09T06:16:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86 9/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 10/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 11/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 12/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-05-09T06:16:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-05-09T06:16:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:16:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-05-09T06:16:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 25/26 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.624 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T06:16:48.625 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:16:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T06:16:48.626 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:48.626 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:16:48.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-test 2024-05-09T06:16:49.534 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:32 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:16:49.654 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:16:49.654 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:16:49.655 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:16:49.655 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:16:49.655 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:16:49.655 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 48 M 2024-05-09T06:16:49.655 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:16:49.655 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 163 k 2024-05-09T06:16:49.655 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T06:16:49.655 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T06:16:49.656 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:49.656 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:16:49.656 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:16:49.656 INFO:teuthology.orchestra.run.smithi079.stdout:Install 4 Packages 2024-05-09T06:16:49.656 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:16:49.656 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 48 M 2024-05-09T06:16:49.657 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 192 M 2024-05-09T06:16:49.657 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:16:50.207 INFO:teuthology.orchestra.run.smithi079.stdout:(1/4): libcephsqlite-17.2.7-933.g4ba5a836.el9.x 388 kB/s | 163 kB 00:00 2024-05-09T06:16:50.432 INFO:teuthology.orchestra.run.smithi079.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 473 kB/s | 305 kB 00:00 2024-05-09T06:16:50.582 INFO:teuthology.orchestra.run.smithi079.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 170 kB/s | 64 kB 00:00 2024-05-09T06:16:57.364 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:16:57.364 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-05-09T06:16:57.364 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-05-09T06:16:57.364 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-05-09T06:16:57.364 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-05-09T06:16:57.364 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-05-09T06:16:57.364 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-05-09T06:16:57.364 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-05-09T06:16:57.365 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:16:58.705 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 24/26 2024-05-09T06:16:58.785 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 24/26 2024-05-09T06:16:58.785 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:16:58.785 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T06:16:58.785 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T06:16:58.785 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T06:16:58.785 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:16:58.786 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-05-09T06:16:58.874 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-05-09T06:16:58.874 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:00.083 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 1/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 3/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 5/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 6/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 7/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x 8/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86 9/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 10/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 11/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 12/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:17:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-05-09T06:17:00.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 25/26 2024-05-09T06:17:00.456 INFO:teuthology.orchestra.run.smithi079.stdout:(4/4): ceph-test-17.2.7-933.g4ba5a836.el9.x86_6 4.5 MB/s | 48 MB 00:10 2024-05-09T06:17:00.458 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:00.458 INFO:teuthology.orchestra.run.smithi079.stdout:Total 4.5 MB/s | 48 MB 00:10 2024-05-09T06:17:00.485 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:00.504 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:00.504 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:00.870 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:00.870 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:00.983 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:00.983 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.984 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T06:17:00.985 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.986 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.986 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:00.986 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T06:17:00.986 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:00.986 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:17:01.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-test 2024-05-09T06:17:01.388 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-09T06:17:01.505 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-09T06:17:01.533 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 3/4 2024-05-09T06:17:01.964 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:28 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:17:02.091 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:17:02.091 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 48 M 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 163 k 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:02.092 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-05-09T06:17:02.093 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 48 M 2024-05-09T06:17:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 192 M 2024-05-09T06:17:02.093 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:17:02.428 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-05-09T06:17:02.470 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-05-09T06:17:02.495 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): libcephsqlite-17.2.7-933.g4ba5a836.el9.x 509 kB/s | 163 kB 00:00 2024-05-09T06:17:05.370 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): ceph-test-17.2.7-933.g4ba5a836.el9.x86_6 15 MB/s | 48 MB 00:03 2024-05-09T06:17:05.373 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:05.373 INFO:teuthology.orchestra.run.smithi062.stdout:Total 15 MB/s | 48 MB 00:03 2024-05-09T06:17:05.402 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:17:05.424 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:17:05.424 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:17:05.810 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:17:05.811 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:17:06.018 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 3/4 2024-05-09T06:17:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 4/4 2024-05-09T06:17:06.351 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:17:06.431 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-09T06:17:06.470 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-09T06:17:06.497 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 3/4 2024-05-09T06:17:08.440 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 4/4 2024-05-09T06:17:08.440 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 1/4 2024-05-09T06:17:08.440 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 2/4 2024-05-09T06:17:08.440 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-09T06:17:08.720 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-09T06:17:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:08.721 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T06:17:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T06:17:08.721 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:08.721 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:09.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph 2024-05-09T06:17:09.597 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:52 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:09.721 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 6.5 k 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.1 M 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 1.4 M 2024-05-09T06:17:09.724 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 240 k 2024-05-09T06:17:09.725 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 3.9 M 2024-05-09T06:17:09.725 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 15 M 2024-05-09T06:17:09.725 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T06:17:09.725 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T06:17:09.725 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T06:17:09.725 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T06:17:09.725 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T06:17:09.725 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T06:17:09.726 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:09.727 INFO:teuthology.orchestra.run.smithi079.stdout:Install 33 Packages 2024-05-09T06:17:09.728 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:09.728 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 27 M 2024-05-09T06:17:09.728 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 96 M 2024-05-09T06:17:09.728 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:10.094 INFO:teuthology.orchestra.run.smithi079.stdout:(1/33): ceph-17.2.7-933.g4ba5a836.el9.x86_64.rp 29 kB/s | 6.5 kB 00:00 2024-05-09T06:17:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:(2/33): ceph-mds-17.2.7-933.g4ba5a836.el9.x86_6 3.7 MB/s | 2.1 MB 00:00 2024-05-09T06:17:10.719 INFO:teuthology.orchestra.run.smithi079.stdout:(3/33): ceph-mgr-17.2.7-933.g4ba5a836.el9.x86_6 1.7 MB/s | 1.4 MB 00:00 2024-05-09T06:17:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:(4/33): ceph-mgr-modules-core-17.2.7-933.g4ba5a 2.0 MB/s | 240 kB 00:00 2024-05-09T06:17:10.978 INFO:teuthology.orchestra.run.smithi079.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-05-09T06:17:11.078 INFO:teuthology.orchestra.run.smithi079.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 12 MB/s | 1.2 MB 00:00 2024-05-09T06:17:11.129 INFO:teuthology.orchestra.run.smithi079.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-09T06:17:11.179 INFO:teuthology.orchestra.run.smithi079.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-05-09T06:17:11.203 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 3/4 2024-05-09T06:17:11.229 INFO:teuthology.orchestra.run.smithi079.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-05-09T06:17:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-05-09T06:17:11.298 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 4/4 2024-05-09T06:17:11.513 INFO:teuthology.orchestra.run.smithi079.stdout:(11/33): ceph-osd-17.2.7-933.g4ba5a836.el9.x86_ 14 MB/s | 15 MB 00:01 2024-05-09T06:17:11.572 INFO:teuthology.orchestra.run.smithi079.stdout:(12/33): ceph-mon-17.2.7-933.g4ba5a836.el9.x86_ 2.7 MB/s | 3.9 MB 00:01 2024-05-09T06:17:11.739 INFO:teuthology.orchestra.run.smithi079.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 154 kB/s | 35 kB 00:00 2024-05-09T06:17:11.822 INFO:teuthology.orchestra.run.smithi079.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 204 kB/s | 51 kB 00:00 2024-05-09T06:17:11.931 INFO:teuthology.orchestra.run.smithi079.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 217 kB/s | 42 kB 00:00 2024-05-09T06:17:12.039 INFO:teuthology.orchestra.run.smithi079.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 200 kB/s | 43 kB 00:00 2024-05-09T06:17:12.165 INFO:teuthology.orchestra.run.smithi079.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 2.8 MB/s | 358 kB 00:00 2024-05-09T06:17:12.190 INFO:teuthology.orchestra.run.smithi079.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 663 kB/s | 172 kB 00:00 2024-05-09T06:17:12.224 INFO:teuthology.orchestra.run.smithi079.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 182 kB/s | 11 kB 00:00 2024-05-09T06:17:12.249 INFO:teuthology.orchestra.run.smithi079.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 301 kB/s | 18 kB 00:00 2024-05-09T06:17:12.282 INFO:teuthology.orchestra.run.smithi079.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 395 kB/s | 23 kB 00:00 2024-05-09T06:17:12.316 INFO:teuthology.orchestra.run.smithi079.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 290 kB/s | 19 kB 00:00 2024-05-09T06:17:12.350 INFO:teuthology.orchestra.run.smithi079.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 293 kB/s | 20 kB 00:00 2024-05-09T06:17:12.383 INFO:teuthology.orchestra.run.smithi079.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 695 kB/s | 46 kB 00:00 2024-05-09T06:17:12.417 INFO:teuthology.orchestra.run.smithi079.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2024-05-09T06:17:12.442 INFO:teuthology.orchestra.run.smithi079.stdout:(26/33): python3-mako-1.1.4-6.el9.noarch.rpm 149 kB/s | 172 kB 00:01 2024-05-09T06:17:12.476 INFO:teuthology.orchestra.run.smithi079.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2024-05-09T06:17:12.534 INFO:teuthology.orchestra.run.smithi079.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 613 kB/s | 36 kB 00:00 2024-05-09T06:17:12.560 INFO:teuthology.orchestra.run.smithi079.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-05-09T06:17:12.652 INFO:teuthology.orchestra.run.smithi079.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-05-09T06:17:12.710 INFO:teuthology.orchestra.run.smithi079.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 343 kB/s | 20 kB 00:00 2024-05-09T06:17:12.752 INFO:teuthology.orchestra.run.smithi079.stdout:(32/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 291 kB/s | 90 kB 00:00 2024-05-09T06:17:12.786 INFO:teuthology.orchestra.run.smithi079.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2024-05-09T06:17:12.790 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:12.791 INFO:teuthology.orchestra.run.smithi079.stdout:Total 8.9 MB/s | 27 MB 00:03 2024-05-09T06:17:12.909 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:12.945 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:12.945 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:13.305 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:13.305 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 4/4 2024-05-09T06:17:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 1/4 2024-05-09T06:17:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 2/4 2024-05-09T06:17:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-09T06:17:13.787 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-09T06:17:13.787 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:13.788 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:17:13.788 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:13.788 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:13.788 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T06:17:13.788 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T06:17:13.788 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:13.788 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:17:14.081 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph 2024-05-09T06:17:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-05-09T06:17:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-05-09T06:17:14.578 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-05-09T06:17:14.666 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:41 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:17:14.669 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-05-09T06:17:14.748 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-05-09T06:17:14.798 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-05-09T06:17:14.798 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:17:14.800 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 6.5 k 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.1 M 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 1.4 M 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 240 k 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 3.9 M 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 15 M 2024-05-09T06:17:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T06:17:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T06:17:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T06:17:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T06:17:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:14.804 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:17:14.804 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:14.804 INFO:teuthology.orchestra.run.smithi062.stdout:Install 33 Packages 2024-05-09T06:17:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:14.805 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 27 M 2024-05-09T06:17:14.805 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 96 M 2024-05-09T06:17:14.805 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:17:14.833 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-05-09T06:17:14.871 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-05-09T06:17:14.905 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-05-09T06:17:14.939 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-05-09T06:17:14.979 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-05-09T06:17:15.014 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-05-09T06:17:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-05-09T06:17:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-05-09T06:17:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-05-09T06:17:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-05-09T06:17:15.386 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-05-09T06:17:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-05-09T06:17:15.486 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-05-09T06:17:15.535 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-05-09T06:17:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-05-09T06:17:15.777 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-05-09T06:17:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-05-09T06:17:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-05-09T06:17:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-05-09T06:17:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-05-09T06:17:16.158 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-05-09T06:17:16.321 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.n 28/33 2024-05-09T06:17:16.359 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 29/33 2024-05-09T06:17:16.386 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 29/33 2024-05-09T06:17:16.386 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:16.386 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T06:17:16.386 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T06:17:16.386 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T06:17:16.387 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:17.726 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 30/33 2024-05-09T06:17:17.753 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 30/33 2024-05-09T06:17:17.754 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:17.754 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T06:17:17.754 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T06:17:17.754 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T06:17:17.754 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:18.126 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 31/33 2024-05-09T06:17:18.150 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 31/33 2024-05-09T06:17:18.150 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:18.150 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T06:17:18.151 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T06:17:18.151 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T06:17:18.151 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:18.352 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 32/33 2024-05-09T06:17:18.376 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 32/33 2024-05-09T06:17:18.376 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:18.376 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T06:17:18.376 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T06:17:18.376 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T06:17:18.376 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 33/33 2024-05-09T06:17:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 33/33 2024-05-09T06:17:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 1/33 2024-05-09T06:17:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 2/33 2024-05-09T06:17:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 3/33 2024-05-09T06:17:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 4/33 2024-05-09T06:17:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 5/33 2024-05-09T06:17:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.n 6/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-05-09T06:17:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-05-09T06:17:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-05-09T06:17:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-05-09T06:17:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-05-09T06:17:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-05-09T06:17:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-05-09T06:17:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-05-09T06:17:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-05-09T06:17:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-05-09T06:17:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-05-09T06:17:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-05-09T06:17:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-05-09T06:17:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-05-09T06:17:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-05-09T06:17:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-05-09T06:17:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-05-09T06:17:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:21.179 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:21.179 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T06:17:21.180 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T06:17:21.181 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T06:17:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T06:17:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T06:17:21.182 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:21.182 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:21.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-base 2024-05-09T06:17:22.104 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:05 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:22.185 INFO:teuthology.orchestra.run.smithi079.stdout:Package ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:17:22.226 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:22.227 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:17:22.227 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:22.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install cephadm 2024-05-09T06:17:22.858 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:05 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:22.980 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 82 k 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 82 k 2024-05-09T06:17:22.982 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 372 k 2024-05-09T06:17:22.982 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:23.403 INFO:teuthology.orchestra.run.smithi079.stdout:cephadm-17.2.7-933.g4ba5a836.el9.noarch.rpm 195 kB/s | 82 kB 00:00 2024-05-09T06:17:23.403 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:23.403 INFO:teuthology.orchestra.run.smithi079.stdout:Total 194 kB/s | 82 kB 00:00 2024-05-09T06:17:23.404 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:23.409 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:23.409 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:23.411 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:23.411 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:23.483 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:23.679 INFO:teuthology.orchestra.run.smithi062.stdout:(1/33): ceph-17.2.7-933.g4ba5a836.el9.x86_64.rp 40 kB/s | 6.5 kB 00:00 2024-05-09T06:17:23.852 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:24.396 INFO:teuthology.orchestra.run.smithi062.stdout:(2/33): ceph-mgr-17.2.7-933.g4ba5a836.el9.x86_6 1.6 MB/s | 1.4 MB 00:00 2024-05-09T06:17:24.537 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:24.537 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:24.537 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:24.537 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:24.537 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:24.537 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:24.757 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-immutable-object-cache 2024-05-09T06:17:24.913 INFO:teuthology.orchestra.run.smithi062.stdout:(3/33): ceph-mon-17.2.7-933.g4ba5a836.el9.x86_6 3.2 MB/s | 3.9 MB 00:01 2024-05-09T06:17:24.980 INFO:teuthology.orchestra.run.smithi062.stdout:(4/33): ceph-mgr-modules-core-17.2.7-933.g4ba5a 3.5 MB/s | 240 kB 00:00 2024-05-09T06:17:25.189 INFO:teuthology.orchestra.run.smithi062.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-05-09T06:17:25.333 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:08 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:25.439 INFO:teuthology.orchestra.run.smithi062.stdout:(6/33): ceph-mds-17.2.7-933.g4ba5a836.el9.x86_6 1.1 MB/s | 2.1 MB 00:01 2024-05-09T06:17:25.459 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:25.459 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repo Size 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 137 k 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-05-09T06:17:25.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:25.461 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 137 k 2024-05-09T06:17:25.461 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 379 k 2024-05-09T06:17:25.461 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:25.472 INFO:teuthology.orchestra.run.smithi062.stdout:(7/33): python3-cryptography-36.0.1-4.el9.x86_6 4.3 MB/s | 1.2 MB 00:00 2024-05-09T06:17:25.548 INFO:teuthology.orchestra.run.smithi062.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-05-09T06:17:25.631 INFO:teuthology.orchestra.run.smithi062.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.5 MB/s | 125 kB 00:00 2024-05-09T06:17:25.665 INFO:teuthology.orchestra.run.smithi062.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 471 kB/s | 106 kB 00:00 2024-05-09T06:17:25.699 INFO:teuthology.orchestra.run.smithi062.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-05-09T06:17:25.757 INFO:teuthology.orchestra.run.smithi062.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 598 kB/s | 35 kB 00:00 2024-05-09T06:17:25.782 INFO:teuthology.orchestra.run.smithi062.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-05-09T06:17:25.833 INFO:teuthology.orchestra.run.smithi062.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 680 kB/s | 51 kB 00:00 2024-05-09T06:17:25.834 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-immutable-object-cache-17.2.7-933.g4ba5a83 369 kB/s | 137 kB 00:00 2024-05-09T06:17:25.834 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:25.835 INFO:teuthology.orchestra.run.smithi079.stdout:Total 367 kB/s | 137 kB 00:00 2024-05-09T06:17:25.835 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:25.842 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:25.843 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:25.849 INFO:teuthology.orchestra.run.smithi062.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-05-09T06:17:25.898 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:25.898 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:26.091 INFO:teuthology.orchestra.run.smithi062.stdout:(16/33): ceph-osd-17.2.7-933.g4ba5a836.el9.x86_ 9.0 MB/s | 15 MB 00:01 2024-05-09T06:17:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:26.143 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:26.143 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T06:17:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:26.333 INFO:teuthology.orchestra.run.smithi062.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 87 kB/s | 43 kB 00:00 2024-05-09T06:17:26.434 INFO:teuthology.orchestra.run.smithi062.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 107 kB/s | 11 kB 00:00 2024-05-09T06:17:26.517 INFO:teuthology.orchestra.run.smithi062.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 257 kB/s | 172 kB 00:00 2024-05-09T06:17:26.534 INFO:teuthology.orchestra.run.smithi062.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-05-09T06:17:26.618 INFO:teuthology.orchestra.run.smithi062.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2024-05-09T06:17:26.651 INFO:teuthology.orchestra.run.smithi062.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 166 kB/s | 19 kB 00:00 2024-05-09T06:17:26.676 INFO:teuthology.orchestra.run.smithi062.stdout:(23/33): python3-cherrypy-18.6.1-2.el9.noarch.r 613 kB/s | 358 kB 00:00 2024-05-09T06:17:26.722 INFO:teuthology.orchestra.run.smithi062.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2024-05-09T06:17:26.786 INFO:teuthology.orchestra.run.smithi062.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 725 kB/s | 79 kB 00:00 2024-05-09T06:17:26.810 INFO:teuthology.orchestra.run.smithi062.stdout:(26/33): python3-logutils-0.3.5-21.el9.noarch.r 291 kB/s | 46 kB 00:00 2024-05-09T06:17:26.894 INFO:teuthology.orchestra.run.smithi062.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2024-05-09T06:17:26.919 INFO:teuthology.orchestra.run.smithi062.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-05-09T06:17:26.945 INFO:teuthology.orchestra.run.smithi062.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 672 kB/s | 90 kB 00:00 2024-05-09T06:17:27.020 INFO:teuthology.orchestra.run.smithi062.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 285 kB/s | 36 kB 00:00 2024-05-09T06:17:27.036 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:27.036 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:27.036 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:27.036 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:27.036 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:27.036 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:27.045 INFO:teuthology.orchestra.run.smithi062.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-05-09T06:17:27.104 INFO:teuthology.orchestra.run.smithi062.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.6 MB/s | 427 kB 00:00 2024-05-09T06:17:27.137 INFO:teuthology.orchestra.run.smithi062.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 171 kB/s | 20 kB 00:00 2024-05-09T06:17:27.140 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:27.140 INFO:teuthology.orchestra.run.smithi062.stdout:Total 2.2 MB/s | 27 MB 00:12 2024-05-09T06:17:27.266 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:17:27.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr 2024-05-09T06:17:27.307 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:17:27.308 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:17:27.722 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:17:27.723 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:17:27.857 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:10 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:27.937 INFO:teuthology.orchestra.run.smithi079.stdout:Package ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:17:27.978 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:27.979 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:17:27.979 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:28.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-dashboard 2024-05-09T06:17:28.611 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:11 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:28.738 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 3.4 M 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 24 k 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 15 k 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-05-09T06:17:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-05-09T06:17:28.740 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:28.740 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:28.740 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:28.740 INFO:teuthology.orchestra.run.smithi079.stdout:Install 7 Packages 2024-05-09T06:17:28.740 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:28.740 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 3.7 M 2024-05-09T06:17:28.740 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 80 M 2024-05-09T06:17:28.740 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:29.015 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:17:29.073 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-05-09T06:17:29.097 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-05-09T06:17:29.113 INFO:teuthology.orchestra.run.smithi079.stdout:(1/7): ceph-prometheus-alerts-17.2.7-933.g4ba5a 45 kB/s | 15 kB 00:00 2024-05-09T06:17:29.130 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-05-09T06:17:29.221 INFO:teuthology.orchestra.run.smithi079.stdout:(2/7): ceph-grafana-dashboards-17.2.7-933.g4ba5 57 kB/s | 24 kB 00:00 2024-05-09T06:17:29.226 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-05-09T06:17:29.288 INFO:teuthology.orchestra.run.smithi079.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 52 kB/s | 9.0 kB 00:00 2024-05-09T06:17:29.356 INFO:teuthology.orchestra.run.smithi079.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 459 kB/s | 31 kB 00:00 2024-05-09T06:17:29.423 INFO:teuthology.orchestra.run.smithi079.stdout:(5/7): ceph-mgr-dashboard-17.2.7-933.g4ba5a836. 5.3 MB/s | 3.4 MB 00:00 2024-05-09T06:17:29.428 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-05-09T06:17:29.439 INFO:teuthology.orchestra.run.smithi079.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 188 kB/s | 41 kB 00:00 2024-05-09T06:17:29.475 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-05-09T06:17:29.510 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-05-09T06:17:29.539 INFO:teuthology.orchestra.run.smithi079.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-05-09T06:17:29.540 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-05-09T06:17:29.543 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:29.543 INFO:teuthology.orchestra.run.smithi079.stdout:Total 4.5 MB/s | 3.7 MB 00:00 2024-05-09T06:17:29.543 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:29.551 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:29.552 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:29.574 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-05-09T06:17:29.612 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:29.613 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:29.616 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-05-09T06:17:29.656 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-05-09T06:17:29.700 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-05-09T06:17:29.734 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-05-09T06:17:29.781 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-05-09T06:17:29.865 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-05-09T06:17:29.907 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:29.974 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-05-09T06:17:30.008 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-05-09T06:17:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-05-09T06:17:30.054 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-05-09T06:17:30.090 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-05-09T06:17:30.095 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-05-09T06:17:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.no 5/7 2024-05-09T06:17:30.150 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-05-09T06:17:30.188 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-05-09T06:17:30.246 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-05-09T06:17:30.310 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-05-09T06:17:30.505 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-05-09T06:17:30.567 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-05-09T06:17:30.648 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-05-09T06:17:30.737 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-05-09T06:17:30.783 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-05-09T06:17:30.903 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-05-09T06:17:31.061 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.n 28/33 2024-05-09T06:17:31.084 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 29/33 2024-05-09T06:17:31.111 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 29/33 2024-05-09T06:17:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T06:17:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T06:17:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T06:17:31.112 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:31.118 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.n 6/7 2024-05-09T06:17:31.160 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 7/7 2024-05-09T06:17:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 7/7 2024-05-09T06:17:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.n 1/7 2024-05-09T06:17:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 2/7 2024-05-09T06:17:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.no 3/7 2024-05-09T06:17:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-05-09T06:17:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-05-09T06:17:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:32.501 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:32.510 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 30/33 2024-05-09T06:17:32.539 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 30/33 2024-05-09T06:17:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T06:17:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T06:17:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T06:17:32.539 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:32.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-09T06:17:32.927 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 31/33 2024-05-09T06:17:32.952 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 31/33 2024-05-09T06:17:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T06:17:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T06:17:32.953 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T06:17:32.953 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:33.161 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 32/33 2024-05-09T06:17:33.187 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 32/33 2024-05-09T06:17:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T06:17:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T06:17:33.187 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T06:17:33.187 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:33.253 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 33/33 2024-05-09T06:17:33.319 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:16 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:33.443 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:33.444 INFO:teuthology.orchestra.run.smithi079.stdout:====================================================================================== 2024-05-09T06:17:33.444 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:17:33.444 INFO:teuthology.orchestra.run.smithi079.stdout:====================================================================================== 2024-05-09T06:17:33.444 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:33.444 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 7.4 M 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:33.445 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:33.446 INFO:teuthology.orchestra.run.smithi079.stdout:====================================================================================== 2024-05-09T06:17:33.446 INFO:teuthology.orchestra.run.smithi079.stdout:Install 12 Packages 2024-05-09T06:17:33.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:33.446 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 38 M 2024-05-09T06:17:33.446 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 209 M 2024-05-09T06:17:33.446 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:33.906 INFO:teuthology.orchestra.run.smithi079.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-05-09T06:17:33.948 INFO:teuthology.orchestra.run.smithi079.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 783 kB/s | 33 kB 00:00 2024-05-09T06:17:33.973 INFO:teuthology.orchestra.run.smithi079.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-05-09T06:17:34.015 INFO:teuthology.orchestra.run.smithi079.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 436 kB/s | 18 kB 00:00 2024-05-09T06:17:34.082 INFO:teuthology.orchestra.run.smithi079.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-05-09T06:17:34.107 INFO:teuthology.orchestra.run.smithi079.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 383 kB/s | 35 kB 00:00 2024-05-09T06:17:34.157 INFO:teuthology.orchestra.run.smithi079.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-05-09T06:17:34.224 INFO:teuthology.orchestra.run.smithi079.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2024-05-09T06:17:34.275 INFO:teuthology.orchestra.run.smithi079.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-05-09T06:17:34.375 INFO:teuthology.orchestra.run.smithi079.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-05-09T06:17:34.667 INFO:teuthology.orchestra.run.smithi079.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-05-09T06:17:34.856 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 33/33 2024-05-09T06:17:34.856 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 1/33 2024-05-09T06:17:34.856 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 2/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 3/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 4/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 5/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.n 6/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-05-09T06:17:34.857 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-05-09T06:17:34.858 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-05-09T06:17:34.859 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-05-09T06:17:35.117 INFO:teuthology.orchestra.run.smithi079.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-9 5.5 MB/s | 7.4 MB 00:01 2024-05-09T06:17:35.118 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:35.118 INFO:teuthology.orchestra.run.smithi079.stdout:Total 23 MB/s | 38 MB 00:01 2024-05-09T06:17:35.475 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:35.502 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:35.502 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:35.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-05-09T06:17:35.821 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:35.821 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:17:35.821 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:35.821 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:35.821 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:35.821 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T06:17:35.822 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T06:17:35.823 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T06:17:35.824 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:17:36.008 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:36.008 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:36.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-base 2024-05-09T06:17:36.776 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:03 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:17:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:36.864 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:17:36.907 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:17:36.908 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:17:36.908 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:17:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-09T06:17:36.958 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-09T06:17:36.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install cephadm 2024-05-09T06:17:37.066 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-09T06:17:37.101 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-09T06:17:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-09T06:17:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-09T06:17:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-09T06:17:37.568 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:04 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:17:37.697 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 82 k 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-05-09T06:17:37.698 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:37.699 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 82 k 2024-05-09T06:17:37.699 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 372 k 2024-05-09T06:17:37.699 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:17:37.919 INFO:teuthology.orchestra.run.smithi062.stdout:cephadm-17.2.7-933.g4ba5a836.el9.noarch.rpm 374 kB/s | 82 kB 00:00 2024-05-09T06:17:37.919 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:37.920 INFO:teuthology.orchestra.run.smithi062.stdout:Total 371 kB/s | 82 kB 00:00 2024-05-09T06:17:37.920 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:17:37.925 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:17:37.925 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:17:37.927 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:17:37.927 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:17:38.000 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:17:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-09T06:17:38.145 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-09T06:17:38.352 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:38.484 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:38.797 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:39.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:39.053 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:39.053 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:17:39.053 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:39.053 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:39.053 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:17:39.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-immutable-object-cache 2024-05-09T06:17:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T06:17:39.864 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:06 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:17:39.992 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 137 k 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 137 k 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 379 k 2024-05-09T06:17:39.993 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:17:40.300 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-immutable-object-cache-17.2.7-933.g4ba5a83 449 kB/s | 137 kB 00:00 2024-05-09T06:17:40.300 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:40.301 INFO:teuthology.orchestra.run.smithi062.stdout:Total 447 kB/s | 137 kB 00:00 2024-05-09T06:17:40.301 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:17:40.309 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:17:40.309 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:17:40.368 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:17:40.368 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:17:40.436 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-09T06:17:40.465 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 12/12 2024-05-09T06:17:40.525 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:17:40.592 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:40.619 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:40.620 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:40.620 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T06:17:40.620 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:41.512 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:41.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:41.512 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:17:41.512 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:41.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:41.512 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:17:41.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr 2024-05-09T06:17:42.314 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:09 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:17:42.399 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:17:42.443 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:17:42.445 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:17:42.445 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:17:42.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-dashboard 2024-05-09T06:17:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 12/12 2024-05-09T06:17:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 1/12 2024-05-09T06:17:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-09T06:17:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-09T06:17:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-09T06:17:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-09T06:17:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-09T06:17:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-09T06:17:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-09T06:17:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-09T06:17:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T06:17:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-09T06:17:43.101 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:10 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:17:43.233 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:17:43.234 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:43.234 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:17:43.234 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:43.234 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:17:43.234 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 3.4 M 2024-05-09T06:17:43.234 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 24 k 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 15 k 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout:Install 7 Packages 2024-05-09T06:17:43.235 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:43.236 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 3.7 M 2024-05-09T06:17:43.236 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 80 M 2024-05-09T06:17:43.236 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:17:43.495 INFO:teuthology.orchestra.run.smithi062.stdout:(1/7): ceph-grafana-dashboards-17.2.7-933.g4ba5 140 kB/s | 24 kB 00:00 2024-05-09T06:17:43.512 INFO:teuthology.orchestra.run.smithi062.stdout:(2/7): ceph-prometheus-alerts-17.2.7-933.g4ba5a 76 kB/s | 15 kB 00:00 2024-05-09T06:17:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-09T06:17:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:43.529 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T06:17:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T06:17:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:43.530 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:43.737 INFO:teuthology.orchestra.run.smithi062.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 38 kB/s | 9.0 kB 00:00 2024-05-09T06:17:43.787 INFO:teuthology.orchestra.run.smithi062.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 149 kB/s | 41 kB 00:00 2024-05-09T06:17:43.854 INFO:teuthology.orchestra.run.smithi062.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 263 kB/s | 31 kB 00:00 2024-05-09T06:17:43.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-rook 2024-05-09T06:17:43.979 INFO:teuthology.orchestra.run.smithi062.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 983 kB/s | 188 kB 00:00 2024-05-09T06:17:44.154 INFO:teuthology.orchestra.run.smithi062.stdout:(7/7): ceph-mgr-dashboard-17.2.7-933.g4ba5a836. 4.0 MB/s | 3.4 MB 00:00 2024-05-09T06:17:44.158 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:44.159 INFO:teuthology.orchestra.run.smithi062.stdout:Total 4.0 MB/s | 3.7 MB 00:00 2024-05-09T06:17:44.159 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:17:44.167 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:17:44.168 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:17:44.234 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:17:44.236 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:17:44.466 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:27 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:44.548 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:17:44.585 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 47 k 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T06:17:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout:Install 13 Packages 2024-05-09T06:17:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:44.589 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 2.2 M 2024-05-09T06:17:44.589 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 26 M 2024-05-09T06:17:44.589 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:44.606 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-05-09T06:17:44.641 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-05-09T06:17:44.689 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-05-09T06:17:44.718 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-05-09T06:17:44.747 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.no 5/7 2024-05-09T06:17:45.000 INFO:teuthology.orchestra.run.smithi079.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 209 kB/s | 26 kB 00:00 2024-05-09T06:17:45.024 INFO:teuthology.orchestra.run.smithi079.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 130 kB/s | 19 kB 00:00 2024-05-09T06:17:45.192 INFO:teuthology.orchestra.run.smithi079.stdout:(3/13): ceph-mgr-rook-17.2.7-933.g4ba5a836.el9. 151 kB/s | 47 kB 00:00 2024-05-09T06:17:45.208 INFO:teuthology.orchestra.run.smithi079.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 868 kB/s | 159 kB 00:00 2024-05-09T06:17:45.284 INFO:teuthology.orchestra.run.smithi079.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.0 MB/s | 279 kB 00:00 2024-05-09T06:17:45.384 INFO:teuthology.orchestra.run.smithi079.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 306 kB/s | 54 kB 00:00 2024-05-09T06:17:45.542 INFO:teuthology.orchestra.run.smithi079.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 124 kB/s | 32 kB 00:00 2024-05-09T06:17:45.618 INFO:teuthology.orchestra.run.smithi079.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 64 kB/s | 15 kB 00:00 2024-05-09T06:17:45.760 INFO:teuthology.orchestra.run.smithi079.stdout:(9/13): python3-google-auth-2.29.0-1.el9.noarch 947 kB/s | 206 kB 00:00 2024-05-09T06:17:45.798 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.n 6/7 2024-05-09T06:17:45.826 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 7/7 2024-05-09T06:17:45.843 INFO:teuthology.orchestra.run.smithi079.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 708 kB/s | 59 kB 00:00 2024-05-09T06:17:45.935 INFO:teuthology.orchestra.run.smithi079.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 3.2 MB/s | 1.0 MB 00:00 2024-05-09T06:17:45.952 INFO:teuthology.orchestra.run.smithi079.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 828 kB/s | 90 kB 00:00 2024-05-09T06:17:46.244 INFO:teuthology.orchestra.run.smithi079.stdout:(13/13): python3-oauthlib-3.1.1-5.el9.noarch.rp 182 kB/s | 222 kB 00:01 2024-05-09T06:17:46.246 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:46.246 INFO:teuthology.orchestra.run.smithi079.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-05-09T06:17:46.308 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:46.322 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:46.323 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:46.407 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:46.409 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:47.024 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 7/7 2024-05-09T06:17:47.024 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.n 1/7 2024-05-09T06:17:47.024 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 2/7 2024-05-09T06:17:47.024 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.no 3/7 2024-05-09T06:17:47.024 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-05-09T06:17:47.024 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-05-09T06:17:47.024 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-05-09T06:17:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-09T06:17:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-09T06:17:47.184 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-09T06:17:47.221 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-09T06:17:47.262 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-09T06:17:47.304 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-05-09T06:17:47.304 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:47.304 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:17:47.304 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:47.304 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:47.304 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:47.305 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-05-09T06:17:47.305 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-05-09T06:17:47.305 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T06:17:47.305 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T06:17:47.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:47.305 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:17:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-09T06:17:47.457 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-09T06:17:47.505 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-09T06:17:47.529 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-09T06:17:48.118 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:15 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:17:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-09T06:17:48.246 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 7.4 M 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T06:17:48.248 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout:Install 12 Packages 2024-05-09T06:17:48.249 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:17:48.250 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 38 M 2024-05-09T06:17:48.250 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 209 M 2024-05-09T06:17:48.250 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:17:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-09T06:17:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-09T06:17:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-09T06:17:48.373 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 13/13 2024-05-09T06:17:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-05-09T06:17:48.705 INFO:teuthology.orchestra.run.smithi062.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.5 MB/s | 803 kB 00:00 2024-05-09T06:17:49.251 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 13/13 2024-05-09T06:17:49.251 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 1/13 2024-05-09T06:17:49.251 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-09T06:17:49.252 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-09T06:17:49.263 INFO:teuthology.orchestra.run.smithi062.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-05-09T06:17:49.405 INFO:teuthology.orchestra.run.smithi062.stdout:(4/12): ceph-mgr-diskprediction-local-17.2.7-93 8.8 MB/s | 7.4 MB 00:00 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T06:17:49.564 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T06:17:49.565 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T06:17:49.565 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T06:17:49.565 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T06:17:49.565 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T06:17:49.565 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T06:17:49.565 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T06:17:49.565 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:49.565 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:49.823 INFO:teuthology.orchestra.run.smithi062.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-05-09T06:17:49.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-cephadm 2024-05-09T06:17:49.848 INFO:teuthology.orchestra.run.smithi062.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 31 kB/s | 18 kB 00:00 2024-05-09T06:17:50.023 INFO:teuthology.orchestra.run.smithi062.stdout:(7/12): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-05-09T06:17:50.384 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:33 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:50.504 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:50.504 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 123 k 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:50.505 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:50.506 INFO:teuthology.orchestra.run.smithi079.stdout:Install 6 Packages 2024-05-09T06:17:50.506 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:50.506 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 7.0 M 2024-05-09T06:17:50.506 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 33 M 2024-05-09T06:17:50.506 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:50.648 INFO:teuthology.orchestra.run.smithi062.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 305 kB/s | 244 kB 00:00 2024-05-09T06:17:50.965 INFO:teuthology.orchestra.run.smithi062.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 4.1 MB/s | 4.7 MB 00:01 2024-05-09T06:17:51.063 INFO:teuthology.orchestra.run.smithi079.stdout:(1/6): ceph-mgr-cephadm-17.2.7-933.g4ba5a836.el 363 kB/s | 123 kB 00:00 2024-05-09T06:17:51.249 INFO:teuthology.orchestra.run.smithi062.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-05-09T06:17:51.271 INFO:teuthology.orchestra.run.smithi079.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.6 MB/s | 548 kB 00:00 2024-05-09T06:17:51.321 INFO:teuthology.orchestra.run.smithi079.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-05-09T06:17:51.372 INFO:teuthology.orchestra.run.smithi079.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 1.0 MB/s | 51 kB 00:00 2024-05-09T06:17:51.482 INFO:teuthology.orchestra.run.smithi062.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 300 kB/s | 250 kB 00:00 2024-05-09T06:17:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:(5/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 301 kB/s | 248 kB 00:00 2024-05-09T06:17:51.972 INFO:teuthology.orchestra.run.smithi079.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-05-09T06:17:51.973 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:51.973 INFO:teuthology.orchestra.run.smithi079.stdout:Total 4.7 MB/s | 7.0 MB 00:01 2024-05-09T06:17:52.044 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:52.056 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:52.056 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:52.154 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:52.155 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:52.516 INFO:teuthology.orchestra.run.smithi062.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-09T06:17:52.517 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:52.517 INFO:teuthology.orchestra.run.smithi062.stdout:Total 8.9 MB/s | 38 MB 00:04 2024-05-09T06:17:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-09T06:17:52.665 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-09T06:17:52.885 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:17:52.913 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:17:52.913 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:17:53.190 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-09T06:17:53.269 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-09T06:17:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-09T06:17:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 6/6 2024-05-09T06:17:53.444 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:17:53.444 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:17:54.094 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 6/6 2024-05-09T06:17:54.094 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/6 2024-05-09T06:17:54.094 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-09T06:17:54.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-09T06:17:54.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-09T06:17:54.095 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-09T06:17:54.295 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:17:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-09T06:17:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:54.354 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:54.372 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-09T06:17:54.414 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-09T06:17:54.520 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-09T06:17:54.557 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-09T06:17:54.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-fuse 2024-05-09T06:17:54.741 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-09T06:17:54.781 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-09T06:17:54.866 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-09T06:17:55.181 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:38 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:55.303 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:55.304 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 813 k 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout:Install 2 Packages 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 893 k 2024-05-09T06:17:55.305 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 2.6 M 2024-05-09T06:17:55.306 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:55.575 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-09T06:17:55.708 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-09T06:17:56.007 INFO:teuthology.orchestra.run.smithi079.stdout:(1/2): ceph-fuse-17.2.7-933.g4ba5a836.el9.x86_6 1.9 MB/s | 813 kB 00:00 2024-05-09T06:17:56.290 INFO:teuthology.orchestra.run.smithi079.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 114 kB/s | 80 kB 00:00 2024-05-09T06:17:56.291 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:56.292 INFO:teuthology.orchestra.run.smithi079.stdout:Total 905 kB/s | 893 kB 00:00 2024-05-09T06:17:56.305 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:56.327 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:56.328 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:56.407 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:56.407 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:56.589 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-09T06:17:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2/2 2024-05-09T06:17:57.056 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T06:17:57.449 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2/2 2024-05-09T06:17:57.449 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/2 2024-05-09T06:17:57.678 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T06:17:57.678 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:57.679 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:57.679 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T06:17:57.679 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:57.679 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:17:57.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install librados-devel 2024-05-09T06:17:58.147 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-09T06:17:58.173 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 12/12 2024-05-09T06:17:58.543 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:41 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:17:58.664 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repo Size 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 126 k 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:58.665 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 126 k 2024-05-09T06:17:58.666 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 448 k 2024-05-09T06:17:58.666 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:17:58.904 INFO:teuthology.orchestra.run.smithi079.stdout:librados-devel-17.2.7-933.g4ba5a836.el9.x86_64. 529 kB/s | 126 kB 00:00 2024-05-09T06:17:58.904 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:58.905 INFO:teuthology.orchestra.run.smithi079.stdout:Total 526 kB/s | 126 kB 00:00 2024-05-09T06:17:58.905 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:17:58.910 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:17:58.910 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:17:58.972 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:17:58.972 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:17:59.123 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:17:59.252 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:17:59.655 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:17:59.894 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:17:59.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:59.895 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:17:59.895 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:59.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:17:59.895 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:00.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install libcephfs2 2024-05-09T06:18:00.558 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 12/12 2024-05-09T06:18:00.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 1/12 2024-05-09T06:18:00.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-09T06:18:00.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-09T06:18:00.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-09T06:18:00.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-09T06:18:00.558 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-09T06:18:00.559 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-09T06:18:00.559 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-09T06:18:00.559 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-09T06:18:00.559 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T06:18:00.559 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-09T06:18:00.690 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:43 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:00.771 INFO:teuthology.orchestra.run.smithi079.stdout:Package libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:00.813 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:00.814 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:18:00.814 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:00.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install libcephfs-devel 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T06:18:00.953 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T06:18:00.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T06:18:00.954 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T06:18:00.954 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:00.954 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:01.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-rook 2024-05-09T06:18:01.453 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:44 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:01.576 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:01.576 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repo Size 2024-05-09T06:18:01.576 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:01.577 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:18:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 25 k 2024-05-09T06:18:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:01.577 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:18:01.577 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:01.577 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-05-09T06:18:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:01.578 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 25 k 2024-05-09T06:18:01.578 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 110 k 2024-05-09T06:18:01.578 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:18:01.833 INFO:teuthology.orchestra.run.smithi079.stdout:libcephfs-devel-17.2.7-933.g4ba5a836.el9.x86_64 98 kB/s | 25 kB 00:00 2024-05-09T06:18:01.834 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:01.834 INFO:teuthology.orchestra.run.smithi079.stdout:Total 97 kB/s | 25 kB 00:00 2024-05-09T06:18:01.834 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:18:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:18:01.837 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:18:01.839 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:18:01.839 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:18:01.920 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:18:01.923 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:28 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:02.048 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 47 k 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T06:18:02.050 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout:Install 13 Packages 2024-05-09T06:18:02.051 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 2.2 M 2024-05-09T06:18:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 26 M 2024-05-09T06:18:02.052 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:18:02.341 INFO:teuthology.orchestra.run.smithi062.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 221 kB/s | 19 kB 00:00 2024-05-09T06:18:02.358 INFO:teuthology.orchestra.run.smithi062.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 247 kB/s | 26 kB 00:00 2024-05-09T06:18:02.394 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:02.434 INFO:teuthology.orchestra.run.smithi062.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-05-09T06:18:02.451 INFO:teuthology.orchestra.run.smithi062.stdout:(4/13): ceph-mgr-rook-17.2.7-933.g4ba5a836.el9. 242 kB/s | 47 kB 00:00 2024-05-09T06:18:02.476 INFO:teuthology.orchestra.run.smithi062.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-05-09T06:18:02.501 INFO:teuthology.orchestra.run.smithi062.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.0 MB/s | 279 kB 00:00 2024-05-09T06:18:02.585 INFO:teuthology.orchestra.run.smithi062.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 400 kB/s | 54 kB 00:00 2024-05-09T06:18:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:02.619 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:18:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:02.619 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:02.685 INFO:teuthology.orchestra.run.smithi062.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 154 kB/s | 32 kB 00:00 2024-05-09T06:18:02.711 INFO:teuthology.orchestra.run.smithi062.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 72 kB/s | 15 kB 00:00 2024-05-09T06:18:02.803 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install librados2 2024-05-09T06:18:02.861 INFO:teuthology.orchestra.run.smithi062.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 394 kB/s | 59 kB 00:00 2024-05-09T06:18:03.194 INFO:teuthology.orchestra.run.smithi062.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 338 kB/s | 206 kB 00:00 2024-05-09T06:18:03.278 INFO:teuthology.orchestra.run.smithi062.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 1.7 MB/s | 1.0 MB 00:00 2024-05-09T06:18:03.303 INFO:teuthology.orchestra.run.smithi062.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 203 kB/s | 90 kB 00:00 2024-05-09T06:18:03.305 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:03.305 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-05-09T06:18:03.363 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:46 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:03.374 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:18:03.391 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:18:03.391 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:18:03.443 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:03.484 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:18:03.484 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:03.485 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:18:03.485 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:03.485 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:18:03.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install librbd1 2024-05-09T06:18:04.018 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:18:04.113 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:47 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:04.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-09T06:18:04.193 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:04.234 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:04.235 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:18:04.235 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:04.247 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-09T06:18:04.303 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-09T06:18:04.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install python3-rados 2024-05-09T06:18:04.339 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-09T06:18:04.384 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-09T06:18:04.480 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-09T06:18:04.598 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-09T06:18:04.659 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-09T06:18:04.876 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:47 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:04.956 INFO:teuthology.orchestra.run.smithi079.stdout:Package python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:04.996 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:04.998 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:18:04.998 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:05.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install python3-rgw 2024-05-09T06:18:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-09T06:18:05.472 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-09T06:18:05.506 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-09T06:18:05.552 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-09T06:18:05.575 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 13/13 2024-05-09T06:18:05.635 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:48 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:05.715 INFO:teuthology.orchestra.run.smithi079.stdout:Package python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:05.756 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:05.757 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:18:05.757 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:05.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install python3-cephfs 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 13/13 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 1/13 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-09T06:18:06.290 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-09T06:18:06.291 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-09T06:18:06.291 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-09T06:18:06.291 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-09T06:18:06.291 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-09T06:18:06.378 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:49 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:06.457 INFO:teuthology.orchestra.run.smithi079.stdout:Package python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:06.498 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:06.499 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:18:06.499 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:06.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install python3-rbd 2024-05-09T06:18:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-09T06:18:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:06.618 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:06.618 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:06.619 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:06.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-cephadm 2024-05-09T06:18:07.122 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:50 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:07.202 INFO:teuthology.orchestra.run.smithi079.stdout:Package python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:07.243 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:07.244 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-05-09T06:18:07.244 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:07.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install rbd-fuse 2024-05-09T06:18:07.420 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:34 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:07.546 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:07.547 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:07.547 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:18:07.547 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:07.547 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:18:07.547 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 123 k 2024-05-09T06:18:07.547 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:18:07.547 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T06:18:07.547 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T06:18:07.548 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T06:18:07.548 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T06:18:07.548 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T06:18:07.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:07.548 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:18:07.548 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:07.548 INFO:teuthology.orchestra.run.smithi062.stdout:Install 6 Packages 2024-05-09T06:18:07.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:07.549 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 7.0 M 2024-05-09T06:18:07.549 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 33 M 2024-05-09T06:18:07.549 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:18:07.876 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:50 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:07.998 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 82 k 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 82 k 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 222 k 2024-05-09T06:18:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:18:08.212 INFO:teuthology.orchestra.run.smithi079.stdout:rbd-fuse-17.2.7-933.g4ba5a836.el9.x86_64.rpm 387 kB/s | 82 kB 00:00 2024-05-09T06:18:08.212 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:08.213 INFO:teuthology.orchestra.run.smithi079.stdout:Total 385 kB/s | 82 kB 00:00 2024-05-09T06:18:08.213 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:18:08.219 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:18:08.219 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:18:08.286 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:18:08.286 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:18:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:18:08.558 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:08.963 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:09.202 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:09.202 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:09.202 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:18:09.202 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:09.202 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:09.202 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:09.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install rbd-mirror 2024-05-09T06:18:09.977 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:52 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:10.098 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:10.099 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repo Size 2024-05-09T06:18:10.099 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:10.099 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:18:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.9 M 2024-05-09T06:18:10.099 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:10.100 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:18:10.100 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:10.100 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-05-09T06:18:10.100 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:10.100 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 2.9 M 2024-05-09T06:18:10.100 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 12 M 2024-05-09T06:18:10.100 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:18:10.490 INFO:teuthology.orchestra.run.smithi079.stdout:rbd-mirror-17.2.7-933.g4ba5a836.el9.x86_64.rpm 7.5 MB/s | 2.9 MB 00:00 2024-05-09T06:18:10.490 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:10.491 INFO:teuthology.orchestra.run.smithi079.stdout:Total 7.5 MB/s | 2.9 MB 00:00 2024-05-09T06:18:10.491 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:18:10.500 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:18:10.500 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:18:10.583 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:18:10.583 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:18:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:18:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:11.100 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:18:11.100 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T06:18:11.100 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T06:18:11.100 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T06:18:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:12.022 INFO:teuthology.orchestra.run.smithi062.stdout:(1/6): ceph-mgr-cephadm-17.2.7-933.g4ba5a836.el 605 kB/s | 123 kB 00:00 2024-05-09T06:18:12.201 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:12.202 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:12.202 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:18:12.202 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:12.202 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:12.202 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:12.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install rbd-nbd 2024-05-09T06:18:12.422 INFO:teuthology.orchestra.run.smithi062.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.3 MB/s | 548 kB 00:00 2024-05-09T06:18:12.498 INFO:teuthology.orchestra.run.smithi062.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 770 kB/s | 58 kB 00:00 2024-05-09T06:18:12.581 INFO:teuthology.orchestra.run.smithi062.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 612 kB/s | 51 kB 00:00 2024-05-09T06:18:12.681 INFO:teuthology.orchestra.run.smithi062.stdout:(5/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 287 kB/s | 248 kB 00:00 2024-05-09T06:18:12.984 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:56 ago on Thu 09 May 2024 06:16:17 AM UTC. 2024-05-09T06:18:13.049 INFO:teuthology.orchestra.run.smithi062.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-05-09T06:18:13.051 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:13.051 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.3 MB/s | 7.0 MB 00:05 2024-05-09T06:18:13.107 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-05-09T06:18:13.108 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:13.108 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-05-09T06:18:13.108 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:13.108 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-05-09T06:18:13.108 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 165 k 2024-05-09T06:18:13.108 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:13.108 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-05-09T06:18:13.109 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-05-09T06:18:13.109 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-05-09T06:18:13.109 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:13.109 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 165 k 2024-05-09T06:18:13.109 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 477 k 2024-05-09T06:18:13.109 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-05-09T06:18:13.128 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:18:13.142 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:18:13.142 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:18:13.245 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:18:13.245 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:18:13.336 INFO:teuthology.orchestra.run.smithi079.stdout:rbd-nbd-17.2.7-933.g4ba5a836.el9.x86_64.rpm 733 kB/s | 165 kB 00:00 2024-05-09T06:18:13.337 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:13.337 INFO:teuthology.orchestra.run.smithi079.stdout:Total 728 kB/s | 165 kB 00:00 2024-05-09T06:18:13.337 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-05-09T06:18:13.343 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-05-09T06:18:13.344 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-05-09T06:18:13.406 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-05-09T06:18:13.407 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-05-09T06:18:13.559 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:18:13.566 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-05-09T06:18:13.674 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:13.730 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-09T06:18:13.785 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-09T06:18:14.094 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:14.316 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:14.316 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:14.316 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-05-09T06:18:14.316 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:14.316 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:18:14.316 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-05-09T06:18:14.340 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-09T06:18:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-09T06:18:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-09T06:18:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 6/6 2024-05-09T06:18:14.580 DEBUG:teuthology.parallel:result is None 2024-05-09T06:18:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 6/6 2024-05-09T06:18:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/6 2024-05-09T06:18:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-09T06:18:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-09T06:18:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-09T06:18:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T06:18:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:15.534 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:15.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-fuse 2024-05-09T06:18:16.394 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:43 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:16.523 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 813 k 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-05-09T06:18:16.524 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:16.525 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 893 k 2024-05-09T06:18:16.525 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 2.6 M 2024-05-09T06:18:16.525 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:18:16.718 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 595 kB/s | 80 kB 00:00 2024-05-09T06:18:17.010 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): ceph-fuse-17.2.7-933.g4ba5a836.el9.x86_6 1.9 MB/s | 813 kB 00:00 2024-05-09T06:18:17.010 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.8 MB/s | 893 kB 00:00 2024-05-09T06:18:17.023 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:18:17.045 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:18:17.045 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:18:17.127 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:18:17.127 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:18:17.317 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:18:17.452 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-09T06:18:17.520 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2/2 2024-05-09T06:18:18.173 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2/2 2024-05-09T06:18:18.174 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/2 2024-05-09T06:18:18.448 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T06:18:18.448 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:18.449 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:18.449 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T06:18:18.449 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:18.449 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:18.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados-devel 2024-05-09T06:18:19.303 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:46 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:19.429 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:19.429 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:19.429 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 126 k 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 126 k 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 448 k 2024-05-09T06:18:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:18:19.658 INFO:teuthology.orchestra.run.smithi062.stdout:librados-devel-17.2.7-933.g4ba5a836.el9.x86_64. 555 kB/s | 126 kB 00:00 2024-05-09T06:18:19.658 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:19.658 INFO:teuthology.orchestra.run.smithi062.stdout:Total 552 kB/s | 126 kB 00:00 2024-05-09T06:18:19.658 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:18:19.664 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:18:19.664 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:18:19.732 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:18:19.732 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:18:19.892 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:18:19.982 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:20.412 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:20.664 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:20.664 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:20.664 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:20.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs2 2024-05-09T06:18:21.479 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:48 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:21.562 INFO:teuthology.orchestra.run.smithi062.stdout:Package libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:21.605 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:21.607 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:18:21.607 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:21.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs-devel 2024-05-09T06:18:22.281 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:49 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:22.408 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:22.408 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:22.408 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-05-09T06:18:22.408 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:22.408 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:18:22.408 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 25 k 2024-05-09T06:18:22.408 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:22.409 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:18:22.409 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:22.409 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-05-09T06:18:22.409 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:22.409 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 25 k 2024-05-09T06:18:22.410 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 110 k 2024-05-09T06:18:22.410 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:18:22.587 INFO:teuthology.orchestra.run.smithi062.stdout:libcephfs-devel-17.2.7-933.g4ba5a836.el9.x86_64 141 kB/s | 25 kB 00:00 2024-05-09T06:18:22.588 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:22.588 INFO:teuthology.orchestra.run.smithi062.stdout:Total 139 kB/s | 25 kB 00:00 2024-05-09T06:18:22.588 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:18:22.591 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:18:22.591 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:18:22.593 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:18:22.593 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:18:22.675 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:18:22.786 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:23.141 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:23.373 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:23.502 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:23.503 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:23.503 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:23.503 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:23.503 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:23.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados2 2024-05-09T06:18:24.139 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:51 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:24.224 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:24.267 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:24.268 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:18:24.268 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:24.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librbd1 2024-05-09T06:18:24.925 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:51 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:25.009 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:25.052 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:25.053 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:18:25.053 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:25.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rados 2024-05-09T06:18:25.703 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:52 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:25.785 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:25.828 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:25.829 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:18:25.829 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:25.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rgw 2024-05-09T06:18:26.489 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:53 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:26.572 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:26.615 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:26.616 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:18:26.616 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:26.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-cephfs 2024-05-09T06:18:27.270 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:54 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:27.352 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:27.395 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:27.396 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:18:27.396 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:27.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rbd 2024-05-09T06:18:28.065 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:55 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:28.148 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:28.191 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:28.192 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-05-09T06:18:28.193 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:28.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-fuse 2024-05-09T06:18:28.846 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:55 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:28.972 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:28.972 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:28.972 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-05-09T06:18:28.972 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:28.973 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:18:28.973 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 82 k 2024-05-09T06:18:28.973 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:28.973 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:18:28.973 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:28.973 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-05-09T06:18:28.973 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:28.973 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 82 k 2024-05-09T06:18:28.974 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 222 k 2024-05-09T06:18:28.974 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:18:29.207 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-fuse-17.2.7-933.g4ba5a836.el9.x86_64.rpm 352 kB/s | 82 kB 00:00 2024-05-09T06:18:29.208 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:29.208 INFO:teuthology.orchestra.run.smithi062.stdout:Total 350 kB/s | 82 kB 00:00 2024-05-09T06:18:29.208 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:18:29.215 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:18:29.215 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:18:29.286 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:18:29.286 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:18:29.561 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:18:29.674 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:30.046 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:30.306 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:30.306 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:30.306 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:30.306 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:30.306 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:30.306 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:30.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-mirror 2024-05-09T06:18:31.145 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:58 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:31.273 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:31.274 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:31.274 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-05-09T06:18:31.274 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:31.274 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:18:31.274 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.9 M 2024-05-09T06:18:31.274 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:31.275 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:18:31.275 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:31.275 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-05-09T06:18:31.275 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:31.275 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 2.9 M 2024-05-09T06:18:31.275 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 12 M 2024-05-09T06:18:31.275 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:18:31.903 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-mirror-17.2.7-933.g4ba5a836.el9.x86_64.rpm 4.7 MB/s | 2.9 MB 00:00 2024-05-09T06:18:31.903 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:31.904 INFO:teuthology.orchestra.run.smithi062.stdout:Total 4.7 MB/s | 2.9 MB 00:00 2024-05-09T06:18:31.904 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:18:31.914 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:18:31.914 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:18:32.002 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:18:32.002 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:18:32.444 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:18:32.512 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:32.539 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:18:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T06:18:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T06:18:32.539 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T06:18:32.539 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:33.647 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:33.647 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:33.647 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:33.647 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:33.647 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:33.647 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:33.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-nbd 2024-05-09T06:18:34.476 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:01 ago on Thu 09 May 2024 06:16:33 AM UTC. 2024-05-09T06:18:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-09T06:18:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:34.603 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-05-09T06:18:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:34.603 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-09T06:18:34.603 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 165 k 2024-05-09T06:18:34.603 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:34.604 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-09T06:18:34.604 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-09T06:18:34.604 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-05-09T06:18:34.604 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:34.604 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 165 k 2024-05-09T06:18:34.604 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 477 k 2024-05-09T06:18:34.604 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-09T06:18:34.830 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-nbd-17.2.7-933.g4ba5a836.el9.x86_64.rpm 733 kB/s | 165 kB 00:00 2024-05-09T06:18:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Total 729 kB/s | 165 kB 00:00 2024-05-09T06:18:34.831 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-09T06:18:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-09T06:18:34.839 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-09T06:18:34.905 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-09T06:18:34.906 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-09T06:18:35.060 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-09T06:18:35.164 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:35.604 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:35.854 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:35.854 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:35.854 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-09T06:18:35.854 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:35.854 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:18:35.854 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-09T06:18:36.069 DEBUG:teuthology.parallel:result is None 2024-05-09T06:18:36.070 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:18:36.070 INFO:teuthology.packaging:ref: None 2024-05-09T06:18:36.070 INFO:teuthology.packaging:tag: None 2024-05-09T06:18:36.070 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:18:36.070 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:18:36.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-05-09T06:18:36.322 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T06:18:36.345 INFO:teuthology.orchestra.run.smithi062.stdout:17.2.7-933.g4ba5a836.el9 2024-05-09T06:18:36.345 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-933.g4ba5a836.el9 2024-05-09T06:18:36.346 INFO:teuthology.task.install:The correct ceph version 17.2.7-933.g4ba5a836 is installed. 2024-05-09T06:18:36.347 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:18:36.347 INFO:teuthology.packaging:ref: None 2024-05-09T06:18:36.348 INFO:teuthology.packaging:tag: None 2024-05-09T06:18:36.348 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:18:36.348 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:18:36.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-05-09T06:18:36.578 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T06:18:36.603 INFO:teuthology.orchestra.run.smithi079.stdout:17.2.7-933.g4ba5a836.el9 2024-05-09T06:18:36.603 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-933.g4ba5a836.el9 2024-05-09T06:18:36.604 INFO:teuthology.task.install:The correct ceph version 17.2.7-933.g4ba5a836 is installed. 2024-05-09T06:18:36.605 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T06:18:36.606 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:18:36.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T06:18:36.634 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:18:36.634 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T06:18:36.673 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T06:18:36.673 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:18:36.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T06:18:36.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T06:18:36.769 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:18:36.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T06:18:36.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T06:18:36.868 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T06:18:36.869 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:18:36.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T06:18:36.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T06:18:36.963 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:18:36.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T06:18:36.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T06:18:37.062 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T06:18:37.062 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:18:37.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T06:18:37.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T06:18:37.156 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:18:37.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T06:18:37.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T06:18:37.252 INFO:teuthology.run_tasks:Running task print... 2024-05-09T06:18:37.262 INFO:teuthology.task.print:**** done install task... 2024-05-09T06:18:37.262 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-09T06:18:37.361 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'} 2024-05-09T06:18:37.361 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-05-09T06:18:37.362 INFO:tasks.cephadm:Cluster fsid is f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:18:37.362 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-09T06:18:37.362 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-05-09T06:18:37.362 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi062': '172.21.15.62', 'mon.smithi079': '172.21.15.79'} 2024-05-09T06:18:37.362 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-09T06:18:37.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname $(hostname -s) 2024-05-09T06:18:37.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname $(hostname -s) 2024-05-09T06:18:37.417 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-05-09T06:18:37.417 DEBUG:teuthology.orchestra.run.smithi062:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T06:18:37.803 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 May 9 06:18 /home/ubuntu/cephtest/cephadm 2024-05-09T06:18:37.803 DEBUG:teuthology.orchestra.run.smithi079:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T06:18:38.231 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 May 9 06:18 /home/ubuntu/cephtest/cephadm 2024-05-09T06:18:38.231 DEBUG:teuthology.orchestra.run.smithi062:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T06:18:38.252 DEBUG:teuthology.orchestra.run.smithi079:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T06:18:38.282 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-05-09T06:18:38.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-05-09T06:18:38.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-05-09T06:18:39.920 INFO:teuthology.orchestra.run.smithi079.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-05-09T06:18:39.973 INFO:teuthology.orchestra.run.smithi062.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-05-09T06:19:26.441 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-05-09T06:19:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)", 2024-05-09T06:19:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "image_id": "b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4", 2024-05-09T06:19:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "repo_digests": [ 2024-05-09T06:19:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228" 2024-05-09T06:19:26.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-05-09T06:19:26.442 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-05-09T06:19:46.203 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:19:46.203 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)", 2024-05-09T06:19:46.203 INFO:teuthology.orchestra.run.smithi062.stdout: "image_id": "b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4", 2024-05-09T06:19:46.203 INFO:teuthology.orchestra.run.smithi062.stdout: "repo_digests": [ 2024-05-09T06:19:46.203 INFO:teuthology.orchestra.run.smithi062.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228" 2024-05-09T06:19:46.204 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-05-09T06:19:46.204 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:19:46.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph 2024-05-09T06:19:46.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph 2024-05-09T06:19:46.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /etc/ceph 2024-05-09T06:19:46.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /etc/ceph 2024-05-09T06:19:46.377 INFO:tasks.cephadm:Writing seed config... 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-09T06:19:46.378 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-09T06:19:46.379 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-09T06:19:46.380 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-09T06:19:46.381 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:19:46.381 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-09T06:19:46.397 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f8b094b6-0dcb-11ef-bc97-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-09T06:19:46.397 DEBUG:teuthology.orchestra.run.smithi062:mon.smithi062> sudo journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062.service 2024-05-09T06:19:46.440 INFO:tasks.cephadm:Bootstrapping... 2024-05-09T06:19:46.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.62 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:19:46.652 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:46.652 INFO:teuthology.orchestra.run.smithi062.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'f8b094b6-0dcb-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.62', '--skip-admin-label'] 2024-05-09T06:19:46.679 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T06:19:46.680 INFO:teuthology.orchestra.run.smithi062.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-09T06:19:46.680 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying podman|docker is present... 2024-05-09T06:19:46.704 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T06:19:46.704 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying lvm2 is present... 2024-05-09T06:19:46.704 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying time synchronization is in place... 2024-05-09T06:19:46.712 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-09T06:19:46.712 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-09T06:19:46.719 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-09T06:19:46.719 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-05-09T06:19:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout enabled 2024-05-09T06:19:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout active 2024-05-09T06:19:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:Unit chronyd.service is enabled and running 2024-05-09T06:19:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:Repeating the final host check... 2024-05-09T06:19:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T06:19:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-09T06:19:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl is present 2024-05-09T06:19:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:lvcreate is present 2024-05-09T06:19:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-09T06:19:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-09T06:19:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-09T06:19:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-05-09T06:19:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout enabled 2024-05-09T06:19:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout active 2024-05-09T06:19:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:Unit chronyd.service is enabled and running 2024-05-09T06:19:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:Host looks OK 2024-05-09T06:19:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:Cluster fsid: f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:19:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:Acquiring lock 139789261128608 on /run/cephadm/f8b094b6-0dcb-11ef-bc97-c7b262605968.lock 2024-05-09T06:19:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:Lock 139789261128608 acquired on /run/cephadm/f8b094b6-0dcb-11ef-bc97-c7b262605968.lock 2024-05-09T06:19:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying IP 172.21.15.62 port 3300 ... 2024-05-09T06:19:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying IP 172.21.15.62 port 6789 ... 2024-05-09T06:19:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:Base mon IP(s) is [172.21.15.62:3300, 172.21.15.62:6789], mon addrv is [v2:172.21.15.62:3300,v1:172.21.15.62:6789] 2024-05-09T06:19:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.62 metric 100 2024-05-09T06:19:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.62 metric 100 2024-05-09T06:19:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-09T06:19:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-09T06:19:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-05-09T06:19:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-09T06:19:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-09T06:19:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-09T06:19:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-09T06:19:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-05-09T06:19:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-09T06:19:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:Mon IP `172.21.15.62` is in CIDR network `172.21.0.0/20` 2024-05-09T06:19:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:Mon IP `172.21.15.62` is in CIDR network `172.21.0.0/20` 2024-05-09T06:19:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-09T06:19:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-09T06:19:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-05-09T06:19:48.271 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stdout b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4 2024-05-09T06:19:48.271 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-05-09T06:19:48.271 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Getting image source signatures 2024-05-09T06:19:48.271 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Copying blob sha256:c42dcfa56d26f8ee4099fe660c3358cf18049e7d8f0dc981922308e1a948d8a3 2024-05-09T06:19:48.271 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-09T06:19:48.271 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Copying config sha256:b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4 2024-05-09T06:19:48.271 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-09T06:19:49.183 INFO:teuthology.orchestra.run.smithi062.stdout:ceph: stdout ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable) 2024-05-09T06:19:49.183 INFO:teuthology.orchestra.run.smithi062.stdout:Ceph version: ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable) 2024-05-09T06:19:49.183 INFO:teuthology.orchestra.run.smithi062.stdout:Extracting ceph user uid/gid from container image... 2024-05-09T06:19:50.197 INFO:teuthology.orchestra.run.smithi062.stdout:stat: stdout 167 167 2024-05-09T06:19:50.197 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial keys... 2024-05-09T06:19:51.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQAGazxm+I0eHhAAaUjTH50DsZpZjDeT6rHbkg== 2024-05-09T06:19:51.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQAHazxmfyf+GBAA1YeCCO69ZAIhZQQDg0aliw== 2024-05-09T06:19:52.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQAIazxm3BN5DxAAVjDUlp+92wD1YwfXbvCzzg== 2024-05-09T06:19:52.864 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial monmap... 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool for smithi062 [v2:172.21.15.62:3300,v1:172.21.15.62:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = octopus 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: set fsid to f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-09T06:19:53.788 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:19:53.789 INFO:teuthology.orchestra.run.smithi062.stdout:Creating mon... 2024-05-09T06:19:54.701 INFO:teuthology.orchestra.run.smithi062.stdout:create mon.smithi062 on 2024-05-09T06:19:54.914 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-09T06:19:55.069 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-09T06:19:55.235 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968.target. 2024-05-09T06:19:55.235 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968.target. 2024-05-09T06:19:55.418 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062 2024-05-09T06:19:55.418 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062.service: Unit ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062.service not loaded. 2024-05-09T06:19:55.599 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968.target.wants/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062.service → /etc/systemd/system/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@.service. 2024-05-09T06:19:55.658 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:55 smithi062 systemd[1]: Starting Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:19:55.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:55 smithi062 podman[26529]: 2024-05-09 06:19:55.866748158 +0000 UTC m=+0.107786970 container create 26f038604a54e784b4f06d880234a31512f1e41a452ae67ea8e1abcda0778093 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, RELEASE=quincy-4ba5a83, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-09T06:19:55.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:55 smithi062 podman[26529]: 2024-05-09 06:19:55.778190126 +0000 UTC m=+0.019228953 image pull b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4 quay.ceph.io/ceph-ci/ceph:quincy 2024-05-09T06:19:56.108 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T06:19:56.108 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout disabled 2024-05-09T06:19:56.116 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T06:19:56.116 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-05-09T06:19:56.116 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld.service is not enabled 2024-05-09T06:19:56.116 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to enable service . firewalld.service is not available 2024-05-09T06:19:56.117 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mon to start... 2024-05-09T06:19:56.117 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mon... 2024-05-09T06:19:56.219 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:56 smithi062 podman[26529]: 2024-05-09 06:19:56.052495148 +0000 UTC m=+0.293533962 container init 26f038604a54e784b4f06d880234a31512f1e41a452ae67ea8e1abcda0778093 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-4ba5a83) 2024-05-09T06:19:56.220 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:56 smithi062 podman[26529]: 2024-05-09 06:19:56.055801411 +0000 UTC m=+0.296840223 container start 26f038604a54e784b4f06d880234a31512f1e41a452ae67ea8e1abcda0778093 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, io.buildah.version=1.33.5, RELEASE=quincy-4ba5a83, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD) 2024-05-09T06:19:56.220 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:56 smithi062 ceph-mon[26549]: mkfs f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:19:56.220 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:56 smithi062 ceph-mon[26549]: mon.smithi062 is new leader, mons smithi062 in quorum (ranks 0) 2024-05-09T06:19:56.220 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:56 smithi062 bash[26529]: 26f038604a54e784b4f06d880234a31512f1e41a452ae67ea8e1abcda0778093 2024-05-09T06:19:56.220 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:56 smithi062 systemd[1]: Started Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:19:57.209 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:57 smithi062 ceph-mon[26549]: mon.smithi062 is new leader, mons smithi062 in quorum (ranks 0) 2024-05-09T06:19:57.209 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:57 smithi062 ceph-mon[26549]: monmap e1: 1 mons at {smithi062=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T06:19:57.209 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:57 smithi062 ceph-mon[26549]: fsmap 2024-05-09T06:19:57.209 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:57 smithi062 ceph-mon[26549]: osdmap e1: 0 total, 0 up, 0 in 2024-05-09T06:19:57.209 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:57 smithi062 ceph-mon[26549]: mgrmap e1: no daemons active 2024-05-09T06:19:57.209 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:57 smithi062 ceph-mon[26549]: from='client.? 172.21.15.62:0/1223744047' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-09T06:19:57.211 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout cluster: 2024-05-09T06:19:57.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout id: f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:19:57.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-09T06:19:57.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:19:57.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout services: 2024-05-09T06:19:57.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi062 (age 0.543565s) 2024-05-09T06:19:57.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-09T06:19:57.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-09T06:19:57.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout data: 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout pgs: 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.555+0000 7f2087076700 1 Processor -- start 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.556+0000 7f2087076700 1 -- start start 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.556+0000 7f2087076700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.556+0000 7f2087076700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20801031d0 con 0x7f2080102880 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.556+0000 7f2084e12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.556+0000 7f2084e12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42334/0 (socket says 172.21.15.62:42334) 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.556+0000 7f2084e12700 1 -- 172.21.15.62:0/1846310743 learned_addr learned my addr 172.21.15.62:0/1846310743 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:19:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f2084e12700 1 -- 172.21.15.62:0/1846310743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2080103310 con 0x7f2080102880 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f2084e12700 1 --2- 172.21.15.62:0/1846310743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f20680098e0 tx=0x7f2068009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a613ebb5b362ba82 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f207f7fe700 1 -- 172.21.15.62:0/1846310743 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f206800b860 con 0x7f2080102880 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f207f7fe700 1 -- 172.21.15.62:0/1846310743 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206800b9c0 con 0x7f2080102880 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f207f7fe700 1 -- 172.21.15.62:0/1846310743 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f206800bc90 con 0x7f2080102880 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f2087076700 1 -- 172.21.15.62:0/1846310743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 msgr2=0x7f2080102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f2087076700 1 --2- 172.21.15.62:0/1846310743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f20680098e0 tx=0x7f2068009250 comp rx=0 tx=0).stop 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f2087076700 1 -- 172.21.15.62:0/1846310743 shutdown_connections 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.557+0000 7f2087076700 1 --2- 172.21.15.62:0/1846310743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080102c90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.558+0000 7f2087076700 1 -- 172.21.15.62:0/1846310743 >> 172.21.15.62:0/1846310743 conn(0x7f20800fe060 msgr2=0x7f2080100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.558+0000 7f2087076700 1 -- 172.21.15.62:0/1846310743 shutdown_connections 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.558+0000 7f2087076700 1 -- 172.21.15.62:0/1846310743 wait complete. 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.558+0000 7f2087076700 1 Processor -- start 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.558+0000 7f2087076700 1 -- start start 2024-05-09T06:19:57.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2087076700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2087076700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20801113a0 con 0x7f2080102880 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2084e12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2084e12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42350/0 (socket says 172.21.15.62:42350) 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2084e12700 1 -- 172.21.15.62:0/1223744047 learned_addr learned my addr 172.21.15.62:0/1223744047 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2084e12700 1 -- 172.21.15.62:0/1223744047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680094f0 con 0x7f2080102880 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2084e12700 1 --2- 172.21.15.62:0/1223744047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080110e60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2068003080 tx=0x7f2068016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f207d7fa700 1 -- 172.21.15.62:0/1223744047 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f206801c5c0 con 0x7f2080102880 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f207d7fa700 1 -- 172.21.15.62:0/1223744047 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206801c720 con 0x7f2080102880 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f207d7fa700 1 -- 172.21.15.62:0/1223744047 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f206801ca30 con 0x7f2080102880 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20801115a0 con 0x7f2080102880 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.559+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2080111fd0 con 0x7f2080102880 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.560+0000 7f207d7fa700 1 -- 172.21.15.62:0/1223744047 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f206801cc60 con 0x7f2080102880 2024-05-09T06:19:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.560+0000 7f207d7fa700 1 -- 172.21.15.62:0/1223744047 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f206801ac80 con 0x7f2080102880 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.560+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208005f5c0 con 0x7f2080102880 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.562+0000 7f207d7fa700 1 -- 172.21.15.62:0/1223744047 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f206801a450 con 0x7f2080102880 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.635+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f2080112a80 con 0x7f2080102880 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.635+0000 7f207d7fa700 1 -- 172.21.15.62:0/1223744047 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f2068025440 con 0x7f2080102880 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.636+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 msgr2=0x7f2080110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.636+0000 7f2087076700 1 --2- 172.21.15.62:0/1223744047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080110e60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2068003080 tx=0x7f2068016000 comp rx=0 tx=0).stop 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.636+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 shutdown_connections 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.636+0000 7f2087076700 1 --2- 172.21.15.62:0/1223744047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2080102880 0x7f2080110e60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.636+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 >> 172.21.15.62:0/1223744047 conn(0x7f20800fe060 msgr2=0x7f2080105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.636+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 shutdown_connections 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:56.636+0000 7f2087076700 1 -- 172.21.15.62:0/1223744047 wait complete. 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:mon is available 2024-05-09T06:19:57.221 INFO:teuthology.orchestra.run.smithi062.stdout:Assimilating anything we can from ceph.conf... 2024-05-09T06:19:58.224 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:19:58.224 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [global] 2024-05-09T06:19:58.224 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout fsid = f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:19:58.224 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.62:3300,v1:172.21.15.62:6789] 2024-05-09T06:19:58.224 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-09T06:19:58.224 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [osd] 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.656+0000 7f9647e3f700 1 Processor -- start 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.656+0000 7f9647e3f700 1 -- start start 2024-05-09T06:19:58.225 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9647e3f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640107890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9647e3f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640103280 con 0x7f9640071290 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9645bdb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640107890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9645bdb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640107890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42360/0 (socket says 172.21.15.62:42360) 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9645bdb700 1 -- 172.21.15.62:0/3562086661 learned_addr learned my addr 172.21.15.62:0/3562086661 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9645bdb700 1 -- 172.21.15.62:0/3562086661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640107dd0 con 0x7f9640071290 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9645bdb700 1 --2- 172.21.15.62:0/3562086661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640107890 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f963c0098e0 tx=0x7f963c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabd75a6cdfbf88c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9644bd9700 1 -- 172.21.15.62:0/3562086661 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f963c00b860 con 0x7f9640071290 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9644bd9700 1 -- 172.21.15.62:0/3562086661 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c00b9c0 con 0x7f9640071290 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.657+0000 7f9644bd9700 1 -- 172.21.15.62:0/3562086661 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f963c00bc90 con 0x7f9640071290 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.658+0000 7f9647e3f700 1 -- 172.21.15.62:0/3562086661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 msgr2=0x7f9640107890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.658+0000 7f9647e3f700 1 --2- 172.21.15.62:0/3562086661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640107890 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f963c0098e0 tx=0x7f963c009250 comp rx=0 tx=0).stop 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.658+0000 7f9647e3f700 1 -- 172.21.15.62:0/3562086661 shutdown_connections 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.658+0000 7f9647e3f700 1 --2- 172.21.15.62:0/3562086661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640107890 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:19:58.226 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.658+0000 7f9647e3f700 1 -- 172.21.15.62:0/3562086661 >> 172.21.15.62:0/3562086661 conn(0x7f96400fcec0 msgr2=0x7f96400ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.658+0000 7f9647e3f700 1 -- 172.21.15.62:0/3562086661 shutdown_connections 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.658+0000 7f9647e3f700 1 -- 172.21.15.62:0/3562086661 wait complete. 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9647e3f700 1 Processor -- start 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9647e3f700 1 -- start start 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9647e3f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9647e3f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640113510 con 0x7f9640071290 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9645bdb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9645bdb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640112fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42368/0 (socket says 172.21.15.62:42368) 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9645bdb700 1 -- 172.21.15.62:0/4042203854 learned_addr learned my addr 172.21.15.62:0/4042203854 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9645bdb700 1 -- 172.21.15.62:0/4042203854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c0094f0 con 0x7f9640071290 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.659+0000 7f9645bdb700 1 --2- 172.21.15.62:0/4042203854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640112fd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f963c009290 tx=0x7f963c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:19:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.660+0000 7f96327fc700 1 -- 172.21.15.62:0/4042203854 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f963c01c5c0 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.660+0000 7f96327fc700 1 -- 172.21.15.62:0/4042203854 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c01c740 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.660+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9640113710 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.660+0000 7f96327fc700 1 -- 172.21.15.62:0/4042203854 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f963c01ca50 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.660+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9640114280 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.660+0000 7f96327fc700 1 -- 172.21.15.62:0/4042203854 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f963c01cbb0 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.660+0000 7f96327fc700 1 -- 172.21.15.62:0/4042203854 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f963c01ac30 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.661+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964005f5c0 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.663+0000 7f96327fc700 1 -- 172.21.15.62:0/4042203854 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f963c02e440 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.732+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f96401080f0 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.736+0000 7f96327fc700 1 -- 172.21.15.62:0/4042203854 <== mon.0 v2:172.21.15.62:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f963c01ae90 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.736+0000 7f96327fc700 1 -- 172.21.15.62:0/4042203854 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f96401080f0 con 0x7f9640071290 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.737+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 msgr2=0x7f9640112fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.737+0000 7f9647e3f700 1 --2- 172.21.15.62:0/4042203854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640112fd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f963c009290 tx=0x7f963c016000 comp rx=0 tx=0).stop 2024-05-09T06:19:58.228 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.737+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 shutdown_connections 2024-05-09T06:19:58.229 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.737+0000 7f9647e3f700 1 --2- 172.21.15.62:0/4042203854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9640071290 0x7f9640112fd0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:19:58.229 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.737+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 >> 172.21.15.62:0/4042203854 conn(0x7f96400fcec0 msgr2=0x7f96400fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:19:58.229 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.737+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 shutdown_connections 2024-05-09T06:19:58.229 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:57.737+0000 7f9647e3f700 1 -- 172.21.15.62:0/4042203854 wait complete. 2024-05-09T06:19:58.229 INFO:teuthology.orchestra.run.smithi062.stdout:Generating new minimal ceph.conf... 2024-05-09T06:19:58.332 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:58 smithi062 ceph-mon[26549]: from='client.? 172.21.15.62:0/4042203854' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-09T06:19:58.332 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:58 smithi062 ceph-mon[26549]: from='client.? 172.21.15.62:0/4042203854' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-09T06:19:59.204 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:59 smithi062 ceph-mon[26549]: from='client.? 172.21.15.62:0/3576270677' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:19:59.216 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.636+0000 7f790df9f700 1 Processor -- start 2024-05-09T06:19:59.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.636+0000 7f790df9f700 1 -- start start 2024-05-09T06:19:59.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.636+0000 7f790df9f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908105340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:19:59.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.636+0000 7f790df9f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7908105880 con 0x7f7908076b70 2024-05-09T06:19:59.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.636+0000 7f790cf9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908105340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:19:59.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.636+0000 7f790cf9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908105340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42372/0 (socket says 172.21.15.62:42372) 2024-05-09T06:19:59.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.636+0000 7f790cf9d700 1 -- 172.21.15.62:0/191599543 learned_addr learned my addr 172.21.15.62:0/191599543 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:19:59.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.637+0000 7f790cf9d700 1 -- 172.21.15.62:0/191599543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79081059c0 con 0x7f7908076b70 2024-05-09T06:19:59.217 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.637+0000 7f790cf9d700 1 --2- 172.21.15.62:0/191599543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908105340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098e0 tx=0x7f78fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7a79979ba165dc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.637+0000 7f79077fe700 1 -- 172.21.15.62:0/191599543 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78fc00b860 con 0x7f7908076b70 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.637+0000 7f79077fe700 1 -- 172.21.15.62:0/191599543 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f78fc00be50 con 0x7f7908076b70 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.637+0000 7f79077fe700 1 -- 172.21.15.62:0/191599543 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78fc010380 con 0x7f7908076b70 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.637+0000 7f790df9f700 1 -- 172.21.15.62:0/191599543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 msgr2=0x7f7908105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.637+0000 7f790df9f700 1 --2- 172.21.15.62:0/191599543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908105340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098e0 tx=0x7f78fc009250 comp rx=0 tx=0).stop 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.638+0000 7f790df9f700 1 -- 172.21.15.62:0/191599543 shutdown_connections 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.638+0000 7f790df9f700 1 --2- 172.21.15.62:0/191599543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908105340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.638+0000 7f790df9f700 1 -- 172.21.15.62:0/191599543 >> 172.21.15.62:0/191599543 conn(0x7f79080fcdb0 msgr2=0x7f79080ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.638+0000 7f790df9f700 1 -- 172.21.15.62:0/191599543 shutdown_connections 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.638+0000 7f790df9f700 1 -- 172.21.15.62:0/191599543 wait complete. 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.638+0000 7f790df9f700 1 Processor -- start 2024-05-09T06:19:59.218 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.638+0000 7f790df9f700 1 -- start start 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790df9f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908111470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790df9f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79081119b0 con 0x7f7908076b70 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790cf9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908111470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790cf9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908111470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42376/0 (socket says 172.21.15.62:42376) 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790cf9d700 1 -- 172.21.15.62:0/3576270677 learned_addr learned my addr 172.21.15.62:0/3576270677 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790cf9d700 1 -- 172.21.15.62:0/3576270677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0094f0 con 0x7f7908076b70 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790cf9d700 1 --2- 172.21.15.62:0/3576270677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908111470 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f78fc003050 tx=0x7f78fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f79057fa700 1 -- 172.21.15.62:0/3576270677 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78fc010760 con 0x7f7908076b70 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7908111bb0 con 0x7f7908076b70 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f79057fa700 1 -- 172.21.15.62:0/3576270677 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f78fc010d50 con 0x7f7908076b70 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f79057fa700 1 -- 172.21.15.62:0/3576270677 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78fc01ae20 con 0x7f7908076b70 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.639+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7908112720 con 0x7f7908076b70 2024-05-09T06:19:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.640+0000 7f79057fa700 1 -- 172.21.15.62:0/3576270677 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f78fc02e440 con 0x7f7908076b70 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.640+0000 7f79057fa700 1 -- 172.21.15.62:0/3576270677 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f78fc024740 con 0x7f7908076b70 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.640+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790805f5c0 con 0x7f7908076b70 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.643+0000 7f79057fa700 1 -- 172.21.15.62:0/3576270677 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f78fc029070 con 0x7f7908076b70 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.712+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f790804bed0 con 0x7f7908076b70 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.712+0000 7f79057fa700 1 -- 172.21.15.62:0/3576270677 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f78fc006d70 con 0x7f7908076b70 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.713+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 msgr2=0x7f7908111470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.713+0000 7f790df9f700 1 --2- 172.21.15.62:0/3576270677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908111470 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f78fc003050 tx=0x7f78fc009250 comp rx=0 tx=0).stop 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.713+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 shutdown_connections 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.713+0000 7f790df9f700 1 --2- 172.21.15.62:0/3576270677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7908076b70 0x7f7908111470 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:19:59.220 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.713+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 >> 172.21.15.62:0/3576270677 conn(0x7f79080fcdb0 msgr2=0x7f79080fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:19:59.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.713+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 shutdown_connections 2024-05-09T06:19:59.221 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:19:58.713+0000 7f790df9f700 1 -- 172.21.15.62:0/3576270677 wait complete. 2024-05-09T06:19:59.221 INFO:teuthology.orchestra.run.smithi062.stdout:Restarting the monitor... 2024-05-09T06:19:59.476 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:59 smithi062 systemd[1]: Stopping Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:19:59.766 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:59 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[26545]: 2024-05-09T06:19:59.491+0000 7f41a71df700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi062 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:19:59.766 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:59 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[26545]: 2024-05-09T06:19:59.491+0000 7f41a71df700 -1 mon.smithi062@0(leader) e1 *** Got Signal Terminated *** 2024-05-09T06:19:59.766 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:59 smithi062 podman[26793]: 2024-05-09 06:19:59.533540114 +0000 UTC m=+0.135296912 container died 26f038604a54e784b4f06d880234a31512f1e41a452ae67ea8e1abcda0778093 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=quincy-4ba5a83, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-09T06:20:00.033 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:59 smithi062 podman[26793]: 2024-05-09 06:19:59.874952821 +0000 UTC m=+0.476709616 container cleanup 26f038604a54e784b4f06d880234a31512f1e41a452ae67ea8e1abcda0778093 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=quincy-4ba5a83) 2024-05-09T06:20:00.033 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:19:59 smithi062 bash[26793]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062 2024-05-09T06:20:00.284 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 podman[26806]: 2024-05-09 06:20:00.050929844 +0000 UTC m=+0.516196598 container remove 26f038604a54e784b4f06d880234a31512f1e41a452ae67ea8e1abcda0778093 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=quincy-4ba5a83, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-09T06:20:00.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062.service: Deactivated successfully. 2024-05-09T06:20:00.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 systemd[1]: Stopped Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:20:00.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 systemd[1]: Starting Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:20:00.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 podman[26901]: 2024-05-09 06:20:00.426772538 +0000 UTC m=+0.018115211 image pull b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4 quay.ceph.io/ceph-ci/ceph:quincy 2024-05-09T06:20:00.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 podman[26901]: 2024-05-09 06:20:00.535152929 +0000 UTC m=+0.126495621 container create 38521dd7b3dd2ad3cb6c6db7f5aff0de4d93eaa01d6a2ceda8989931746be310 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, RELEASE=quincy-4ba5a83, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5) 2024-05-09T06:20:00.782 INFO:teuthology.orchestra.run.smithi062.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-09T06:20:00.982 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 podman[26901]: 2024-05-09 06:20:00.712306037 +0000 UTC m=+0.303648684 container init 38521dd7b3dd2ad3cb6c6db7f5aff0de4d93eaa01d6a2ceda8989931746be310 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-4ba5a83, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-09T06:20:00.982 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 podman[26901]: 2024-05-09 06:20:00.715690879 +0000 UTC m=+0.307033525 container start 38521dd7b3dd2ad3cb6c6db7f5aff0de4d93eaa01d6a2ceda8989931746be310 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=quincy-4ba5a83, GIT_CLEAN=True) 2024-05-09T06:20:00.982 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T06:20:00.982 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable), process ceph-mon, pid 2 2024-05-09T06:20:00.982 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: pidfile_write: ignore empty --pid-file 2024-05-09T06:20:00.982 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: load: jerasure load: lrc 2024-05-09T06:20:00.982 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: RocksDB version: 6.15.5 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Compile date May 7 2024 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: DB SUMMARY 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: DB Session ID: 99ND7EZOQ32ZZD4WW2BZ 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: CURRENT file: CURRENT 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi062/store.db dir, Total Num: 1, files: 000008.sst 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi062/store.db: 000010.log size: 98166 ; 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.error_if_exists: 0 2024-05-09T06:20:00.983 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.create_if_missing: 0 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.paranoid_checks: 1 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.env: 0x55ebecebfb00 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.fs: Posix File System 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.info_log: 0x55ebee8b5620 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.statistics: (nil) 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.use_fsync: 0 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_log_file_size: 0 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.allow_fallocate: 1 2024-05-09T06:20:00.984 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.use_direct_reads: 0 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.db_log_dir: 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi062/store.db 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T06:20:00.985 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.write_buffer_manager: 0x55ebef5a8a20 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.unordered_write: 0 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T06:20:00.986 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T06:20:00.987 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T06:20:00.987 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.row_cache: None 2024-05-09T06:20:00.987 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.wal_filter: None 2024-05-09T06:20:00.987 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T06:20:00.987 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T06:20:00.988 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.preserve_deletes: 0 2024-05-09T06:20:00.988 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.two_write_queues: 0 2024-05-09T06:20:00.988 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T06:20:00.988 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.atomic_flush: 0 2024-05-09T06:20:00.988 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.log_readahead_size: 0 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_background_jobs: 2 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_background_compactions: -1 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_subcompactions: 1 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T06:20:00.989 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_open_files: -1 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_background_flushes: -1 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Compression algorithms supported: 2024-05-09T06:20:00.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: kZSTD supported: 0 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: kXpressCompression supported: 0 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: kZlibCompression supported: 1 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: kSnappyCompression supported: 1 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: kLZ4Compression supported: 1 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: kBZip2Compression supported: 0 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi062/store.db/MANIFEST-000009 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.merge_operator: 2024-05-09T06:20:00.991 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_filter: None 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ebee888f58) 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: cache_index_and_filter_blocks: 1 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: pin_top_level_index_and_filter: 1 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: index_type: 0 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: data_block_index_type: 0 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: index_shortening: 1 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: hash_index_allow_collision: 1 2024-05-09T06:20:00.992 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: checksum: 1 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: no_block_cache: 0 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_cache: 0x55ebee8bb090 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_cache_name: BinnedLRUCache 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_cache_options: 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: capacity : 536870912 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: num_shard_bits : 4 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: strict_capacity_limit : 0 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: high_pri_pool_ratio: 0.000 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_cache_compressed: (nil) 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: persistent_cache: (nil) 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_size: 4096 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_size_deviation: 10 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_restart_interval: 16 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: index_block_restart_interval: 1 2024-05-09T06:20:00.993 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: metadata_block_size: 4096 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: partition_filters: 0 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: use_delta_encoding: 1 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: whole_key_filtering: 1 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: verify_compression: 0 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: read_amp_bytes_per_bit: 0 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: format_version: 4 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: enable_index_compression: 1 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_align: 0 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compression: NoCompression 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T06:20:00.994 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.num_levels: 7 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T06:20:00.995 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T06:20:00.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.arena_block_size: 4194304 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T06:20:00.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.table_properties_collectors: 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.inplace_update_support: 0 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T06:20:00.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.bloom_locality: 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.max_successive_merges: 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.ttl: 2592000 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.enable_blob_files: false 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.min_blob_size: 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi062/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T06:20:00.999 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715235600742721, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715235600743670, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93372, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91484, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84048, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1715235600, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "0ee30597-1af3-45f3-b760-77dc22f49f53", "db_session_id": "99ND7EZOQ32ZZD4WW2BZ"}} 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715235600744057, "job": 1, "event": "recovery_finished"} 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi062/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55ebee84f180 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: DB pointer 0x55ebee924000 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-05-09T06:20:01.000 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** DB Stats ** 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** Compaction Stats [default] ** 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.4 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.4 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.4 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:01.001 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** Compaction Stats [default] ** 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 139.4 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative compaction: 0.00 GB write, 26.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval compaction: 0.00 GB write, 26.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:20:01.002 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** Compaction Stats [default] ** 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.4 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.4 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** Compaction Stats [default] ** 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:20:01.003 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 139.4 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative compaction: 0.00 GB write, 26.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: starting mon.smithi062 rank 0 at public addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] at bind addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi062 fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062@-1(???) e1 preinit fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:20:01.004 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062@-1(???).mds e1 new map 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062@-1(???).mds e1 print_map 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: e1 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: legacy client fscid: -1 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: No filesystems configured 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-09T06:20:01.005 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 bash[26901]: 38521dd7b3dd2ad3cb6c6db7f5aff0de4d93eaa01d6a2ceda8989931746be310 2024-05-09T06:20:01.006 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 systemd[1]: Started Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:20:01.006 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mon.smithi062 is new leader, mons smithi062 in quorum (ranks 0) 2024-05-09T06:20:01.006 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: monmap e1: 1 mons at {smithi062=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T06:20:01.006 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: fsmap 2024-05-09T06:20:01.006 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: osdmap e1: 0 total, 0 up, 0 in 2024-05-09T06:20:01.006 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:00 smithi062 ceph-mon[26920]: mgrmap e1: no daemons active 2024-05-09T06:20:01.817 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.192+0000 7f6cd3382700 1 Processor -- start 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.192+0000 7f6cd3382700 1 -- start start 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.192+0000 7f6cd3382700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.192+0000 7f6cd3382700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc102090 con 0x7f6ccc101740 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.193+0000 7f6cd111e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.193+0000 7f6cd111e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42384/0 (socket says 172.21.15.62:42384) 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.193+0000 7f6cd111e700 1 -- 172.21.15.62:0/3475386752 learned_addr learned my addr 172.21.15.62:0/3475386752 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.193+0000 7f6cd111e700 1 -- 172.21.15.62:0/3475386752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc1021d0 con 0x7f6ccc101740 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.193+0000 7f6cd111e700 1 --2- 172.21.15.62:0/3475386752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc101b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009e50 tx=0x7f6cbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19436c8cce09e353 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.193+0000 7f6ccbfff700 1 -- 172.21.15.62:0/3475386752 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cbc0092e0 con 0x7f6ccc101740 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.193+0000 7f6ccbfff700 1 -- 172.21.15.62:0/3475386752 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6cbc012430 con 0x7f6ccc101740 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.193+0000 7f6ccbfff700 1 -- 172.21.15.62:0/3475386752 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cbc0075c0 con 0x7f6ccc101740 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.194+0000 7f6cd3382700 1 -- 172.21.15.62:0/3475386752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 msgr2=0x7f6ccc101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:01.818 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.194+0000 7f6cd3382700 1 --2- 172.21.15.62:0/3475386752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc101b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009e50 tx=0x7f6cbc009840 comp rx=0 tx=0).stop 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.194+0000 7f6cd3382700 1 -- 172.21.15.62:0/3475386752 shutdown_connections 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.194+0000 7f6cd3382700 1 --2- 172.21.15.62:0/3475386752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc101b50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.194+0000 7f6cd3382700 1 -- 172.21.15.62:0/3475386752 >> 172.21.15.62:0/3475386752 conn(0x7f6ccc0fcec0 msgr2=0x7f6ccc0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.194+0000 7f6cd3382700 1 -- 172.21.15.62:0/3475386752 shutdown_connections 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.194+0000 7f6cd3382700 1 -- 172.21.15.62:0/3475386752 wait complete. 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd3382700 1 Processor -- start 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd3382700 1 -- start start 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd3382700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd3382700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc1142b0 con 0x7f6ccc101740 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd111e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd111e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42398/0 (socket says 172.21.15.62:42398) 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd111e700 1 -- 172.21.15.62:0/2498017853 learned_addr learned my addr 172.21.15.62:0/2498017853 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd111e700 1 -- 172.21.15.62:0/2498017853 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc009ae0 con 0x7f6ccc101740 2024-05-09T06:20:01.819 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.195+0000 7f6cd111e700 1 --2- 172.21.15.62:0/2498017853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc071230 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009fd0 tx=0x7f6cbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.196+0000 7f6cc9ffb700 1 -- 172.21.15.62:0/2498017853 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cbc0092e0 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.196+0000 7f6cc9ffb700 1 -- 172.21.15.62:0/2498017853 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6cbc007cc0 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.196+0000 7f6cc9ffb700 1 -- 172.21.15.62:0/2498017853 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cbc01c9a0 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.196+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc1143f0 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.196+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc1148e0 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.196+0000 7f6cc9ffb700 1 -- 172.21.15.62:0/2498017853 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6cbc019070 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.196+0000 7f6cc9ffb700 1 -- 172.21.15.62:0/2498017853 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6cbc025ac0 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.197+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc05f5c0 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.199+0000 7f6cc9ffb700 1 -- 172.21.15.62:0/2498017853 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f6cbc02a060 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.268+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f6ccc103510 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.273+0000 7f6cc9ffb700 1 -- 172.21.15.62:0/2498017853 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6cbc020070 con 0x7f6ccc101740 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.274+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 msgr2=0x7f6ccc071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.274+0000 7f6cd3382700 1 --2- 172.21.15.62:0/2498017853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc071230 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009fd0 tx=0x7f6cbc009840 comp rx=0 tx=0).stop 2024-05-09T06:20:01.820 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.274+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 shutdown_connections 2024-05-09T06:20:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.274+0000 7f6cd3382700 1 --2- 172.21.15.62:0/2498017853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6ccc101740 0x7f6ccc071230 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.274+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 >> 172.21.15.62:0/2498017853 conn(0x7f6ccc0fcec0 msgr2=0x7f6ccc0fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.274+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 shutdown_connections 2024-05-09T06:20:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:01.274+0000 7f6cd3382700 1 -- 172.21.15.62:0/2498017853 wait complete. 2024-05-09T06:20:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-09T06:20:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:20:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:Creating mgr... 2024-05-09T06:20:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying port 9283 ... 2024-05-09T06:20:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mgr.smithi062.juuasl 2024-05-09T06:20:02.000 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mgr.smithi062.juuasl.service: Unit ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mgr.smithi062.juuasl.service not loaded. 2024-05-09T06:20:02.157 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968.target.wants/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mgr.smithi062.juuasl.service → /etc/systemd/system/ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@.service. 2024-05-09T06:20:02.403 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:02 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2498017853' entity='client.admin' 2024-05-09T06:20:02.728 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T06:20:02.728 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout disabled 2024-05-09T06:20:02.736 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T06:20:02.736 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-05-09T06:20:02.736 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld.service is not enabled 2024-05-09T06:20:02.736 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to enable service . firewalld.service is not available 2024-05-09T06:20:02.745 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T06:20:02.745 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout disabled 2024-05-09T06:20:02.753 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T06:20:02.753 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-05-09T06:20:02.753 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld.service is not enabled 2024-05-09T06:20:02.754 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-05-09T06:20:02.754 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr to start... 2024-05-09T06:20:02.754 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr... 2024-05-09T06:20:03.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:03 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1334077466' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "f8b094b6-0dcb-11ef-bc97-c7b262605968", 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T06:20:03.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "smithi062" 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T06:20:03.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:03.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T06:19:56.094175+0000", 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.194+0000 7fbdd8306700 1 Processor -- start 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.194+0000 7fbdd8306700 1 -- start start 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.195+0000 7fbdd8306700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd01053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.195+0000 7fbdd8306700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0105900 con 0x7fbdd0076ca0 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.195+0000 7fbdd60a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd01053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.195+0000 7fbdd60a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd01053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42428/0 (socket says 172.21.15.62:42428) 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.195+0000 7fbdd60a2700 1 -- 172.21.15.62:0/1202871620 learned_addr learned my addr 172.21.15.62:0/1202871620 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.195+0000 7fbdd60a2700 1 -- 172.21.15.62:0/1202871620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0105a40 con 0x7fbdd0076ca0 2024-05-09T06:20:03.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.195+0000 7fbdd60a2700 1 --2- 172.21.15.62:0/1202871620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd01053c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0098e0 tx=0x7fbdcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d9e980677ca7f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:03.871 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd50a0700 1 -- 172.21.15.62:0/1202871620 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdcc00b860 con 0x7fbdd0076ca0 2024-05-09T06:20:03.871 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd50a0700 1 -- 172.21.15.62:0/1202871620 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbdcc00be50 con 0x7fbdd0076ca0 2024-05-09T06:20:03.871 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd50a0700 1 -- 172.21.15.62:0/1202871620 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdcc010380 con 0x7fbdd0076ca0 2024-05-09T06:20:03.871 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd8306700 1 -- 172.21.15.62:0/1202871620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 msgr2=0x7fbdd01053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd8306700 1 --2- 172.21.15.62:0/1202871620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd01053c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0098e0 tx=0x7fbdcc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd8306700 1 -- 172.21.15.62:0/1202871620 shutdown_connections 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd8306700 1 --2- 172.21.15.62:0/1202871620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd01053c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd8306700 1 -- 172.21.15.62:0/1202871620 >> 172.21.15.62:0/1202871620 conn(0x7fbdd00fced0 msgr2=0x7fbdd00ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.196+0000 7fbdd8306700 1 -- 172.21.15.62:0/1202871620 shutdown_connections 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.197+0000 7fbdd8306700 1 -- 172.21.15.62:0/1202871620 wait complete. 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.197+0000 7fbdd8306700 1 Processor -- start 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.197+0000 7fbdd8306700 1 -- start start 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.197+0000 7fbdd8306700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd0102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:03.872 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.197+0000 7fbdd8306700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0103250 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.197+0000 7fbdd60a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd0102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.197+0000 7fbdd60a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd0102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42430/0 (socket says 172.21.15.62:42430) 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.197+0000 7fbdd60a2700 1 -- 172.21.15.62:0/1334077466 learned_addr learned my addr 172.21.15.62:0/1334077466 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.198+0000 7fbdd60a2700 1 -- 172.21.15.62:0/1334077466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc0094f0 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.198+0000 7fbdd60a2700 1 --2- 172.21.15.62:0/1334077466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd0102d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc006b00 tx=0x7fbdcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.198+0000 7fbdc6ffd700 1 -- 172.21.15.62:0/1334077466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdcc0107c0 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.198+0000 7fbdc6ffd700 1 -- 172.21.15.62:0/1334077466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbdcc010db0 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.198+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd01012c0 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.198+0000 7fbdc6ffd700 1 -- 172.21.15.62:0/1334077466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdcc01acf0 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.198+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd01017b0 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.199+0000 7fbdc6ffd700 1 -- 172.21.15.62:0/1334077466 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbdcc024440 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.199+0000 7fbdc6ffd700 1 -- 172.21.15.62:0/1334077466 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbdcc019710 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.199+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd004bed0 con 0x7fbdd0076ca0 2024-05-09T06:20:03.873 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.201+0000 7fbdc6ffd700 1 -- 172.21.15.62:0/1334077466 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fbdcc042790 con 0x7fbdd0076ca0 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.275+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fbdd01019f0 con 0x7fbdd0076ca0 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.275+0000 7fbdc6ffd700 1 -- 172.21.15.62:0/1334077466 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fbdcc031020 con 0x7fbdd0076ca0 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.276+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 msgr2=0x7fbdd0102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.276+0000 7fbdd8306700 1 --2- 172.21.15.62:0/1334077466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd0102d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc006b00 tx=0x7fbdcc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.276+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 shutdown_connections 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.276+0000 7fbdd8306700 1 --2- 172.21.15.62:0/1334077466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdd0076ca0 0x7fbdd0102d10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.277+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 >> 172.21.15.62:0/1334077466 conn(0x7fbdd00fced0 msgr2=0x7fbdd00fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.277+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 shutdown_connections 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:03.277+0000 7fbdd8306700 1 -- 172.21.15.62:0/1334077466 wait complete. 2024-05-09T06:20:03.874 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (1/15)... 2024-05-09T06:20:06.650 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:06 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2366138192' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "f8b094b6-0dcb-11ef-bc97-c7b262605968", 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-05-09T06:20:06.957 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "smithi062" 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T06:20:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T06:20:06.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T06:20:06.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T06:20:06.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T06:20:06.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:06.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T06:20:06.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T06:19:56.094175+0000", 2024-05-09T06:20:06.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.280+0000 7fcc9a9a0700 1 Processor -- start 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.280+0000 7fcc9a9a0700 1 -- start start 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.280+0000 7fcc9a9a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc94101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.280+0000 7fcc9a9a0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94102090 con 0x7fcc94101740 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.281+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc94101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.281+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc94101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37570/0 (socket says 172.21.15.62:37570) 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.281+0000 7fcc93fff700 1 -- 172.21.15.62:0/1089586432 learned_addr learned my addr 172.21.15.62:0/1089586432 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.281+0000 7fcc93fff700 1 -- 172.21.15.62:0/1089586432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc941021d0 con 0x7fcc94101740 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.281+0000 7fcc93fff700 1 --2- 172.21.15.62:0/1089586432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc94101b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcc840098e0 tx=0x7fcc84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9e4dbdbb8bc884 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.281+0000 7fcc937fe700 1 -- 172.21.15.62:0/1089586432 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc8400b860 con 0x7fcc94101740 2024-05-09T06:20:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.281+0000 7fcc937fe700 1 -- 172.21.15.62:0/1089586432 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fcc8400be50 con 0x7fcc94101740 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.281+0000 7fcc937fe700 1 -- 172.21.15.62:0/1089586432 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc84010380 con 0x7fcc94101740 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.282+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/1089586432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 msgr2=0x7fcc94101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.282+0000 7fcc9a9a0700 1 --2- 172.21.15.62:0/1089586432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc94101b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcc840098e0 tx=0x7fcc84009250 comp rx=0 tx=0).stop 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.282+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/1089586432 shutdown_connections 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.282+0000 7fcc9a9a0700 1 --2- 172.21.15.62:0/1089586432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc94101b50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.282+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/1089586432 >> 172.21.15.62:0/1089586432 conn(0x7fcc940fcec0 msgr2=0x7fcc940ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.282+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/1089586432 shutdown_connections 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.282+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/1089586432 wait complete. 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.283+0000 7fcc9a9a0700 1 Processor -- start 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.283+0000 7fcc9a9a0700 1 -- start start 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.283+0000 7fcc9a9a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc9410f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.283+0000 7fcc9a9a0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9410f8b0 con 0x7fcc94101740 2024-05-09T06:20:06.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.283+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc9410f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.283+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc9410f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37574/0 (socket says 172.21.15.62:37574) 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.283+0000 7fcc93fff700 1 -- 172.21.15.62:0/2366138192 learned_addr learned my addr 172.21.15.62:0/2366138192 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.283+0000 7fcc93fff700 1 -- 172.21.15.62:0/2366138192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc840094f0 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.284+0000 7fcc93fff700 1 --2- 172.21.15.62:0/2366138192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc9410f370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc84000c00 tx=0x7fcc84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.284+0000 7fcc917fa700 1 -- 172.21.15.62:0/2366138192 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc840107c0 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.284+0000 7fcc917fa700 1 -- 172.21.15.62:0/2366138192 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fcc84010db0 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.284+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9410fab0 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.284+0000 7fcc917fa700 1 -- 172.21.15.62:0/2366138192 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc8401ad00 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.284+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc94110620 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.284+0000 7fcc917fa700 1 -- 172.21.15.62:0/2366138192 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fcc84024440 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.284+0000 7fcc917fa700 1 -- 172.21.15.62:0/2366138192 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcc84019710 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.285+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9405f5c0 con 0x7fcc94101740 2024-05-09T06:20:06.971 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.287+0000 7fcc917fa700 1 -- 172.21.15.62:0/2366138192 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fcc8401a530 con 0x7fcc94101740 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.360+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fcc94103510 con 0x7fcc94101740 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.361+0000 7fcc917fa700 1 -- 172.21.15.62:0/2366138192 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fcc84010920 con 0x7fcc94101740 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.362+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 msgr2=0x7fcc9410f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.362+0000 7fcc9a9a0700 1 --2- 172.21.15.62:0/2366138192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc9410f370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc84000c00 tx=0x7fcc84009250 comp rx=0 tx=0).stop 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.362+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 shutdown_connections 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.362+0000 7fcc9a9a0700 1 --2- 172.21.15.62:0/2366138192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc94101740 0x7fcc9410f370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.362+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 >> 172.21.15.62:0/2366138192 conn(0x7fcc940fcec0 msgr2=0x7fcc94105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.363+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 shutdown_connections 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:06.363+0000 7fcc9a9a0700 1 -- 172.21.15.62:0/2366138192 wait complete. 2024-05-09T06:20:06.972 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (2/15)... 2024-05-09T06:20:09.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: Activating manager daemon smithi062.juuasl 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: mgrmap e2: smithi062.juuasl(active, starting, since 0.00309371s) 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: Manager daemon smithi062.juuasl is now available 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/trash_purge_schedule"}]: dispatch 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:09.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:09 smithi062 ceph-mon[26920]: from='mgr.14100 172.21.15.62:0/1892407178' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:10.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:10 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2582057063' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T06:20:10.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:10 smithi062 ceph-mon[26920]: mgrmap e3: smithi062.juuasl(active, since 1.00745s) 2024-05-09T06:20:12.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:12 smithi062 ceph-mon[26920]: mgrmap e4: smithi062.juuasl(active, since 2s) 2024-05-09T06:20:15.772 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:15.772 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:15.772 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "f8b094b6-0dcb-11ef-bc97-c7b262605968", 2024-05-09T06:20:15.772 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T06:20:15.772 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T06:20:15.772 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "smithi062" 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-05-09T06:20:15.773 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T06:20:15.774 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T06:20:15.775 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:15.833 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T06:20:15.833 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T06:20:15.833 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T06:19:56.094175+0000", 2024-05-09T06:20:15.834 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.424+0000 7fe55e767700 1 Processor -- start 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.424+0000 7fe55e767700 1 -- start start 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.424+0000 7fe55e767700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe558101bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.424+0000 7fe55e767700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe558102100 con 0x7fe5581017b0 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.424+0000 7fe557fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe558101bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.424+0000 7fe557fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe558101bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37590/0 (socket says 172.21.15.62:37590) 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.424+0000 7fe557fff700 1 -- 172.21.15.62:0/2566100481 learned_addr learned my addr 172.21.15.62:0/2566100481 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:15.835 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.424+0000 7fe557fff700 1 -- 172.21.15.62:0/2566100481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558102240 con 0x7fe5581017b0 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe557fff700 1 --2- 172.21.15.62:0/2566100481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe558101bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe54800bb80 tx=0x7fe54800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4868917470e11c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe556ffd700 1 -- 172.21.15.62:0/2566100481 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe54800dd00 con 0x7fe5581017b0 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe556ffd700 1 -- 172.21.15.62:0/2566100481 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe54800de60 con 0x7fe5581017b0 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe556ffd700 1 -- 172.21.15.62:0/2566100481 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5480188a0 con 0x7fe5581017b0 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe55e767700 1 -- 172.21.15.62:0/2566100481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 msgr2=0x7fe558101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe55e767700 1 --2- 172.21.15.62:0/2566100481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe558101bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe54800bb80 tx=0x7fe54800b4f0 comp rx=0 tx=0).stop 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe55e767700 1 -- 172.21.15.62:0/2566100481 shutdown_connections 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe55e767700 1 --2- 172.21.15.62:0/2566100481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe558101bc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:15.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe55e767700 1 -- 172.21.15.62:0/2566100481 >> 172.21.15.62:0/2566100481 conn(0x7fe5580fcf50 msgr2=0x7fe5580ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe55e767700 1 -- 172.21.15.62:0/2566100481 shutdown_connections 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.425+0000 7fe55e767700 1 -- 172.21.15.62:0/2566100481 wait complete. 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.426+0000 7fe55e767700 1 Processor -- start 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.426+0000 7fe55e767700 1 -- start start 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.426+0000 7fe55e767700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe55810f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.426+0000 7fe55e767700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55810f8b0 con 0x7fe5581017b0 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.426+0000 7fe557fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe55810f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe557fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe55810f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37606/0 (socket says 172.21.15.62:37606) 2024-05-09T06:20:15.837 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe557fff700 1 -- 172.21.15.62:0/2582057063 learned_addr learned my addr 172.21.15.62:0/2582057063 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe557fff700 1 -- 172.21.15.62:0/2582057063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54800b790 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe557fff700 1 --2- 172.21.15.62:0/2582057063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe55810f370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe54800d650 tx=0x7fe54800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe554ff9700 1 -- 172.21.15.62:0/2582057063 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe548010b50 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe554ff9700 1 -- 172.21.15.62:0/2582057063 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe54801d050 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55810fab0 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe554ff9700 1 -- 172.21.15.62:0/2582057063 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe548022590 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.427+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe558110620 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.428+0000 7fe554ff9700 1 -- 172.21.15.62:0/2582057063 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe548022740 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.428+0000 7fe554ff9700 1 -- 172.21.15.62:0/2582057063 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe548014070 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.428+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55805f5c0 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.429+0000 7fe554ff9700 1 -- 172.21.15.62:0/2582057063 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mgrmap(e 2) v1 ==== 43132+0+0 (secure 0 0 0) 0x7fe548022b80 con 0x7fe5581017b0 2024-05-09T06:20:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.433+0000 7fe554ff9700 1 -- 172.21.15.62:0/2582057063 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fe54802d540 con 0x7fe5581017b0 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.514+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe5581110f0 con 0x7fe5581017b0 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.515+0000 7fe554ff9700 1 -- 172.21.15.62:0/2582057063 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe54802bb50 con 0x7fe5581017b0 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.515+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 msgr2=0x7fe55810f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.515+0000 7fe55e767700 1 --2- 172.21.15.62:0/2582057063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe55810f370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe54800d650 tx=0x7fe54800b4f0 comp rx=0 tx=0).stop 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.515+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 shutdown_connections 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.515+0000 7fe55e767700 1 --2- 172.21.15.62:0/2582057063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5581017b0 0x7fe55810f370 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.515+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 >> 172.21.15.62:0/2582057063 conn(0x7fe5580fcf50 msgr2=0x7fe558105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.516+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 shutdown_connections 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:09.516+0000 7fe55e767700 1 -- 172.21.15.62:0/2582057063 wait complete. 2024-05-09T06:20:15.839 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (3/15)... 2024-05-09T06:20:20.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:20 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2386348908' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T06:20:20.962 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:20.962 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:20.962 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "f8b094b6-0dcb-11ef-bc97-c7b262605968", 2024-05-09T06:20:20.962 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T06:20:20.962 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T06:20:20.962 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T06:20:20.962 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "smithi062" 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 19, 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:20.963 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T06:20:20.964 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T06:20:20.965 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T06:19:56.094175+0000", 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.138+0000 7f769a8fa700 1 Processor -- start 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.138+0000 7f769a8fa700 1 -- start start 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.138+0000 7f769a8fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694102170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.138+0000 7f769a8fa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76941026b0 con 0x7f7694101d60 2024-05-09T06:20:20.966 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.139+0000 7f7693fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.139+0000 7f7693fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694102170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37702/0 (socket says 172.21.15.62:37702) 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.139+0000 7f7693fff700 1 -- 172.21.15.62:0/1446841165 learned_addr learned my addr 172.21.15.62:0/1446841165 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.139+0000 7f7693fff700 1 -- 172.21.15.62:0/1446841165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76941027f0 con 0x7f7694101d60 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.139+0000 7f7693fff700 1 --2- 172.21.15.62:0/1446841165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694102170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f76840098e0 tx=0x7f7684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c030217a316f3b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.139+0000 7f76937fe700 1 -- 172.21.15.62:0/1446841165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f768400b860 con 0x7f7694101d60 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.139+0000 7f76937fe700 1 -- 172.21.15.62:0/1446841165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f768400be50 con 0x7f7694101d60 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.139+0000 7f76937fe700 1 -- 172.21.15.62:0/1446841165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7684010380 con 0x7f7694101d60 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.140+0000 7f769a8fa700 1 -- 172.21.15.62:0/1446841165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 msgr2=0x7f7694102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.140+0000 7f769a8fa700 1 --2- 172.21.15.62:0/1446841165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694102170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f76840098e0 tx=0x7f7684009250 comp rx=0 tx=0).stop 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.140+0000 7f769a8fa700 1 -- 172.21.15.62:0/1446841165 shutdown_connections 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.140+0000 7f769a8fa700 1 --2- 172.21.15.62:0/1446841165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694102170 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.140+0000 7f769a8fa700 1 -- 172.21.15.62:0/1446841165 >> 172.21.15.62:0/1446841165 conn(0x7f76940fc6f0 msgr2=0x7f76940feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.140+0000 7f769a8fa700 1 -- 172.21.15.62:0/1446841165 shutdown_connections 2024-05-09T06:20:20.967 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.140+0000 7f769a8fa700 1 -- 172.21.15.62:0/1446841165 wait complete. 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f769a8fa700 1 Processor -- start 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f769a8fa700 1 -- start start 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f769a8fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f769a8fa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694107fa0 con 0x7f7694101d60 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f7693fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f7693fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37706/0 (socket says 172.21.15.62:37706) 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f7693fff700 1 -- 172.21.15.62:0/2386348908 learned_addr learned my addr 172.21.15.62:0/2386348908 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f7693fff700 1 -- 172.21.15.62:0/2386348908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76840094f0 con 0x7f7694101d60 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.141+0000 7f7693fff700 1 --2- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694107a60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7684000c00 tx=0x7f7684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.142+0000 7f76917fa700 1 -- 172.21.15.62:0/2386348908 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76840107c0 con 0x7f7694101d60 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.142+0000 7f76917fa700 1 -- 172.21.15.62:0/2386348908 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7684010db0 con 0x7f7694101d60 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.142+0000 7f76917fa700 1 -- 172.21.15.62:0/2386348908 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f768401ad00 con 0x7f7694101d60 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.142+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7694106010 con 0x7f7694101d60 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.142+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7694106500 con 0x7f7694101d60 2024-05-09T06:20:20.968 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.143+0000 7f76917fa700 1 -- 172.21.15.62:0/2386348908 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f768401a530 con 0x7f7694101d60 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.143+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769404bed0 con 0x7f7694101d60 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.143+0000 7f76917fa700 1 --2- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f7680036850 0x7f7680038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.143+0000 7f76917fa700 1 -- 172.21.15.62:0/2386348908 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f768404a580 con 0x7f7694101d60 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.143+0000 7f768bfff700 1 --2- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f7680036850 0x7f7680038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.144+0000 7f768bfff700 1 --2- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f7680036850 0x7f7680038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f767c009990 tx=0x7f767c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.148+0000 7f76917fa700 1 -- 172.21.15.62:0/2386348908 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7684010920 con 0x7f7694101d60 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.424+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f769410b670 con 0x7f7694101d60 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.424+0000 7f76917fa700 1 -- 172.21.15.62:0/2386348908 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f76840233a0 con 0x7f7694101d60 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f7680036850 msgr2=0x7f7680038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 --2- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f7680036850 0x7f7680038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f767c009990 tx=0x7f767c006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 msgr2=0x7f7694107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 --2- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694107a60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7684000c00 tx=0x7f7684009250 comp rx=0 tx=0).stop 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 shutdown_connections 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 --2- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f7680036850 0x7f7680038d00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:20.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 --2- 172.21.15.62:0/2386348908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7694101d60 0x7f7694107a60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:20.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 >> 172.21.15.62:0/2386348908 conn(0x7f76940fc6f0 msgr2=0x7f76940fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:20.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 shutdown_connections 2024-05-09T06:20:20.970 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:20.427+0000 7f769a8fa700 1 -- 172.21.15.62:0/2386348908 wait complete. 2024-05-09T06:20:20.970 INFO:teuthology.orchestra.run.smithi062.stdout:mgr is available 2024-05-09T06:20:21.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:21 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/308760096' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [global] 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout fsid = f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:22.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [osd] 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.426+0000 7f927d773700 1 Processor -- start 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.426+0000 7f927d773700 1 -- start start 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.426+0000 7f927d773700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f92781021b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.426+0000 7f927d773700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92781026f0 con 0x7f9278101da0 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.426+0000 7f9276ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f92781021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.426+0000 7f9276ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f92781021b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37718/0 (socket says 172.21.15.62:37718) 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.426+0000 7f9276ffd700 1 -- 172.21.15.62:0/1091398007 learned_addr learned my addr 172.21.15.62:0/1091398007 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.427+0000 7f9276ffd700 1 -- 172.21.15.62:0/1091398007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278102830 con 0x7f9278101da0 2024-05-09T06:20:22.165 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.427+0000 7f9276ffd700 1 --2- 172.21.15.62:0/1091398007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f92781021b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f92680098e0 tx=0x7f9268009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fef0b220dcd487a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.427+0000 7f9275ffb700 1 -- 172.21.15.62:0/1091398007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f926800b860 con 0x7f9278101da0 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.427+0000 7f9275ffb700 1 -- 172.21.15.62:0/1091398007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f926800be50 con 0x7f9278101da0 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.427+0000 7f9275ffb700 1 -- 172.21.15.62:0/1091398007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9268010380 con 0x7f9278101da0 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.428+0000 7f927d773700 1 -- 172.21.15.62:0/1091398007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 msgr2=0x7f92781021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.428+0000 7f927d773700 1 --2- 172.21.15.62:0/1091398007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f92781021b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f92680098e0 tx=0x7f9268009250 comp rx=0 tx=0).stop 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.428+0000 7f927d773700 1 -- 172.21.15.62:0/1091398007 shutdown_connections 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.428+0000 7f927d773700 1 --2- 172.21.15.62:0/1091398007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f92781021b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.428+0000 7f927d773700 1 -- 172.21.15.62:0/1091398007 >> 172.21.15.62:0/1091398007 conn(0x7f92780fc6f0 msgr2=0x7f92780feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.428+0000 7f927d773700 1 -- 172.21.15.62:0/1091398007 shutdown_connections 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.428+0000 7f927d773700 1 -- 172.21.15.62:0/1091398007 wait complete. 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.428+0000 7f927d773700 1 Processor -- start 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f927d773700 1 -- start start 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f927d773700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f9278101600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f927d773700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9278114250 con 0x7f9278101da0 2024-05-09T06:20:22.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f9276ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f9278101600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f9276ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f9278101600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37722/0 (socket says 172.21.15.62:37722) 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f9276ffd700 1 -- 172.21.15.62:0/308760096 learned_addr learned my addr 172.21.15.62:0/308760096 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f9276ffd700 1 -- 172.21.15.62:0/308760096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680094f0 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f9276ffd700 1 --2- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f9278101600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9268000c00 tx=0x7f9268009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f925f7fe700 1 -- 172.21.15.62:0/308760096 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92680107c0 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f925f7fe700 1 -- 172.21.15.62:0/308760096 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9268010db0 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.429+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9278114390 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.430+0000 7f925f7fe700 1 -- 172.21.15.62:0/308760096 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f926801ad00 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.430+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9278114880 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.430+0000 7f925f7fe700 1 -- 172.21.15.62:0/308760096 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f92680193c0 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.431+0000 7f925f7fe700 1 --2- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f9260036850 0x7f9260038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.431+0000 7f925f7fe700 1 -- 172.21.15.62:0/308760096 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f926804a730 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.431+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9278103640 con 0x7f9278101da0 2024-05-09T06:20:22.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.431+0000 7f92767fc700 1 --2- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f9260036850 0x7f9260038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.431+0000 7f92767fc700 1 --2- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f9260036850 0x7f9260038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f926c009990 tx=0x7f926c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.436+0000 7f925f7fe700 1 -- 172.21.15.62:0/308760096 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9268019670 con 0x7f9278101da0 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.630+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f927804bed0 con 0x7f9278101da0 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.631+0000 7f925f7fe700 1 -- 172.21.15.62:0/308760096 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f9268031020 con 0x7f9278101da0 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.633+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f9260036850 msgr2=0x7f9260038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.633+0000 7f927d773700 1 --2- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f9260036850 0x7f9260038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f926c009990 tx=0x7f926c006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.633+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 msgr2=0x7f9278101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.633+0000 7f927d773700 1 --2- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f9278101600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9268000c00 tx=0x7f9268009250 comp rx=0 tx=0).stop 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.633+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 shutdown_connections 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.633+0000 7f927d773700 1 --2- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f9260036850 0x7f9260038d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.633+0000 7f927d773700 1 --2- 172.21.15.62:0/308760096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9278101da0 0x7f9278101600 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.633+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 >> 172.21.15.62:0/308760096 conn(0x7f92780fc6f0 msgr2=0x7f92780fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.634+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 shutdown_connections 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:21.634+0000 7f927d773700 1 -- 172.21.15.62:0/308760096 wait complete. 2024-05-09T06:20:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling cephadm module... 2024-05-09T06:20:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:22 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3685747352' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-09T06:20:23.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.620+0000 7fbbe8efa700 1 Processor -- start 2024-05-09T06:20:23.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.620+0000 7fbbe8efa700 1 -- start start 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.620+0000 7fbbe8efa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.620+0000 7fbbe8efa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41031d0 con 0x7fbbe4102880 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.620+0000 7fbbe259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.620+0000 7fbbe259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37732/0 (socket says 172.21.15.62:37732) 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.620+0000 7fbbe259c700 1 -- 172.21.15.62:0/1617524109 learned_addr learned my addr 172.21.15.62:0/1617524109 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.620+0000 7fbbe259c700 1 -- 172.21.15.62:0/1617524109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4103310 con 0x7fbbe4102880 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe259c700 1 --2- 172.21.15.62:0/1617524109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4102c90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40098e0 tx=0x7fbbd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930ec2a20fdf8b37 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe159a700 1 -- 172.21.15.62:0/1617524109 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbd400b860 con 0x7fbbe4102880 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe159a700 1 -- 172.21.15.62:0/1617524109 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbbd400be50 con 0x7fbbe4102880 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe159a700 1 -- 172.21.15.62:0/1617524109 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbd4010380 con 0x7fbbe4102880 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe8efa700 1 -- 172.21.15.62:0/1617524109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 msgr2=0x7fbbe4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe8efa700 1 --2- 172.21.15.62:0/1617524109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4102c90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40098e0 tx=0x7fbbd4009250 comp rx=0 tx=0).stop 2024-05-09T06:20:23.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe8efa700 1 -- 172.21.15.62:0/1617524109 shutdown_connections 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe8efa700 1 --2- 172.21.15.62:0/1617524109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4102c90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.621+0000 7fbbe8efa700 1 -- 172.21.15.62:0/1617524109 >> 172.21.15.62:0/1617524109 conn(0x7fbbe40fe060 msgr2=0x7fbbe4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe8efa700 1 -- 172.21.15.62:0/1617524109 shutdown_connections 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe8efa700 1 -- 172.21.15.62:0/1617524109 wait complete. 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe8efa700 1 Processor -- start 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe8efa700 1 -- start start 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe8efa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe8efa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4079160 con 0x7fbbe4102880 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37744/0 (socket says 172.21.15.62:37744) 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.622+0000 7fbbe259c700 1 -- 172.21.15.62:0/3685747352 learned_addr learned my addr 172.21.15.62:0/3685747352 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.623+0000 7fbbe259c700 1 -- 172.21.15.62:0/3685747352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd40094f0 con 0x7fbbe4102880 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.623+0000 7fbbe259c700 1 --2- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4078c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4000c00 tx=0x7fbbd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:23.471 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.623+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/3685747352 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbd40107c0 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.623+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/3685747352 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbbd4010db0 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.623+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe40771d0 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.623+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/3685747352 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbd401ad00 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.623+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe40776c0 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.624+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/3685747352 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7fbbd40193c0 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.624+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe404bed0 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.624+0000 7fbbd2ffd700 1 --2- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7fbbcc036850 0x7fbbcc038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.624+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/3685747352 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbbd404a7b0 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.624+0000 7fbbe1d9b700 1 --2- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7fbbcc036850 0x7fbbcc038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.624+0000 7fbbe1d9b700 1 --2- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7fbbcc036850 0x7fbbcc038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009990 tx=0x7fbbd8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.629+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/3685747352 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbbd4019670 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.877+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fbbe4104650 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.930+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/3685747352 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fbbd401a530 con 0x7fbbe4102880 2024-05-09T06:20:23.472 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.931+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/3685747352 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fbbd4022340 con 0x7fbbe4102880 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7fbbcc036850 msgr2=0x7fbbcc038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 --2- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7fbbcc036850 0x7fbbcc038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009990 tx=0x7fbbd8006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 msgr2=0x7fbbe4078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 --2- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4078c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4000c00 tx=0x7fbbd4009250 comp rx=0 tx=0).stop 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 shutdown_connections 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 --2- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7fbbcc036850 0x7fbbcc038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 --2- 172.21.15.62:0/3685747352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbe4102880 0x7fbbe4078c20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 >> 172.21.15.62:0/3685747352 conn(0x7fbbe40fe060 msgr2=0x7fbbe40feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 shutdown_connections 2024-05-09T06:20:23.473 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:22.934+0000 7fbbe8efa700 1 -- 172.21.15.62:0/3685747352 wait complete. 2024-05-09T06:20:24.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:23 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3685747352' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-09T06:20:24.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:23 smithi062 ceph-mon[26920]: mgrmap e5: smithi062.juuasl(active, since 13s) 2024-05-09T06:20:25.222 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:24 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1537806465' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-09T06:20:25.344 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "active_name": "smithi062.juuasl", 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.974+0000 7f4d8b477700 1 Processor -- start 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.974+0000 7f4d8b477700 1 -- start start 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.974+0000 7f4d8b477700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d84107840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.974+0000 7f4d8b477700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84103230 con 0x7f4d84076c20 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.975+0000 7f4d89213700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d84107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.975+0000 7f4d89213700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d84107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59870/0 (socket says 172.21.15.62:59870) 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.975+0000 7f4d89213700 1 -- 172.21.15.62:0/3708245495 learned_addr learned my addr 172.21.15.62:0/3708245495 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:25.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.975+0000 7f4d89213700 1 -- 172.21.15.62:0/3708245495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84107d80 con 0x7f4d84076c20 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.975+0000 7f4d89213700 1 --2- 172.21.15.62:0/3708245495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d84107840 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d800098e0 tx=0x7f4d80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0dd6ef450023fe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.975+0000 7f4d77fff700 1 -- 172.21.15.62:0/3708245495 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d8000b860 con 0x7f4d84076c20 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.975+0000 7f4d77fff700 1 -- 172.21.15.62:0/3708245495 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4d8000be50 con 0x7f4d84076c20 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.975+0000 7f4d77fff700 1 -- 172.21.15.62:0/3708245495 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d80010380 con 0x7f4d84076c20 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.976+0000 7f4d8b477700 1 -- 172.21.15.62:0/3708245495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 msgr2=0x7f4d84107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.976+0000 7f4d8b477700 1 --2- 172.21.15.62:0/3708245495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d84107840 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d800098e0 tx=0x7f4d80009250 comp rx=0 tx=0).stop 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.976+0000 7f4d8b477700 1 -- 172.21.15.62:0/3708245495 shutdown_connections 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.976+0000 7f4d8b477700 1 --2- 172.21.15.62:0/3708245495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d84107840 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.976+0000 7f4d8b477700 1 -- 172.21.15.62:0/3708245495 >> 172.21.15.62:0/3708245495 conn(0x7f4d840fced0 msgr2=0x7f4d840ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.976+0000 7f4d8b477700 1 -- 172.21.15.62:0/3708245495 shutdown_connections 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.976+0000 7f4d8b477700 1 -- 172.21.15.62:0/3708245495 wait complete. 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.977+0000 7f4d8b477700 1 Processor -- start 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.977+0000 7f4d8b477700 1 -- start start 2024-05-09T06:20:25.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.977+0000 7f4d8b477700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d841137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.977+0000 7f4d8b477700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84113d10 con 0x7f4d84076c20 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.977+0000 7f4d89213700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d841137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.977+0000 7f4d89213700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d841137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59882/0 (socket says 172.21.15.62:59882) 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.977+0000 7f4d89213700 1 -- 172.21.15.62:0/1537806465 learned_addr learned my addr 172.21.15.62:0/1537806465 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.977+0000 7f4d89213700 1 -- 172.21.15.62:0/1537806465 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800094f0 con 0x7f4d84076c20 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.978+0000 7f4d89213700 1 --2- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d841137d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4d80003050 tx=0x7f4d80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.978+0000 7f4d75ffb700 1 -- 172.21.15.62:0/1537806465 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d80010760 con 0x7f4d84076c20 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.978+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d84113f10 con 0x7f4d84076c20 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.978+0000 7f4d75ffb700 1 -- 172.21.15.62:0/1537806465 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4d80010d50 con 0x7f4d84076c20 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.978+0000 7f4d75ffb700 1 -- 172.21.15.62:0/1537806465 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d8001ae20 con 0x7f4d84076c20 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.978+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d84114a80 con 0x7f4d84076c20 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.979+0000 7f4d75ffb700 1 -- 172.21.15.62:0/1537806465 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f4d8002e440 con 0x7f4d84076c20 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.979+0000 7f4d75ffb700 1 --2- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f4d700368a0 0x7f4d70038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:25.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.979+0000 7f4d75ffb700 1 -- 172.21.15.62:0/1537806465 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4d8004a4a0 con 0x7f4d84076c20 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.979+0000 7f4d88a12700 1 -- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f4d700368a0 msgr2=0x7f4d70038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/21732303 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.979+0000 7f4d88a12700 1 --2- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f4d700368a0 0x7f4d70038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.979+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8405f5c0 con 0x7f4d84076c20 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:23.984+0000 7f4d75ffb700 1 -- 172.21.15.62:0/1537806465 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4d80018940 con 0x7f4d84076c20 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.180+0000 7f4d88a12700 1 -- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f4d700368a0 msgr2=0x7f4d70038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/21732303 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.180+0000 7f4d88a12700 1 --2- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f4d700368a0 0x7f4d70038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.362+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f4d84114cc0 con 0x7f4d84076c20 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.363+0000 7f4d75ffb700 1 -- 172.21.15.62:0/1537806465 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f4d80048030 con 0x7f4d84076c20 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.365+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f4d700368a0 msgr2=0x7f4d70038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:20:25.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.365+0000 7f4d8b477700 1 --2- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f4d700368a0 0x7f4d70038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.365+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 msgr2=0x7f4d841137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.365+0000 7f4d8b477700 1 --2- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d841137d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4d80003050 tx=0x7f4d80009250 comp rx=0 tx=0).stop 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.366+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 shutdown_connections 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.366+0000 7f4d8b477700 1 --2- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f4d700368a0 0x7f4d70038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.366+0000 7f4d8b477700 1 --2- 172.21.15.62:0/1537806465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d84076c20 0x7f4d841137d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.366+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 >> 172.21.15.62:0/1537806465 conn(0x7f4d840fced0 msgr2=0x7f4d840fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.366+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 shutdown_connections 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:24.366+0000 7f4d8b477700 1 -- 172.21.15.62:0/1537806465 wait complete. 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for the mgr to restart... 2024-05-09T06:20:25.349 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr epoch 5... 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: Active manager daemon smithi062.juuasl restarted 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: Activating manager daemon smithi062.juuasl 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: osdmap e2: 0 total, 0 up, 0 in 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: mgrmap e6: smithi062.juuasl(active, starting, since 0.0033218s) 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: Manager daemon smithi062.juuasl is now available 2024-05-09T06:20:30.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:30.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:30.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:20:30.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:20:30.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:20:30.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:29 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:20:31.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:30 smithi062 ceph-mon[26920]: Found migration_current of "None". Setting to last migration. 2024-05-09T06:20:31.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:30 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/trash_purge_schedule"}]: dispatch 2024-05-09T06:20:31.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:30 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:31.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:30 smithi062 ceph-mon[26920]: mgrmap e7: smithi062.juuasl(active, since 1.00515s) 2024-05-09T06:20:31.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:30 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:20:31.318 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:31.318 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-09T06:20:31.318 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-09T06:20:31.318 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:31.318 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.780+0000 7f53a470a700 1 Processor -- start 2024-05-09T06:20:31.318 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.780+0000 7f53a470a700 1 -- start start 2024-05-09T06:20:31.318 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.780+0000 7f53a470a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c105470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:31.318 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.780+0000 7f53a470a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c1059b0 con 0x7f539c0712d0 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.781+0000 7f53a24a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c105470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.781+0000 7f53a24a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c105470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59886/0 (socket says 172.21.15.62:59886) 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.781+0000 7f53a24a6700 1 -- 172.21.15.62:0/2072258077 learned_addr learned my addr 172.21.15.62:0/2072258077 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.781+0000 7f53a24a6700 1 -- 172.21.15.62:0/2072258077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c105af0 con 0x7f539c0712d0 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.781+0000 7f53a24a6700 1 --2- 172.21.15.62:0/2072258077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c105470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53980098e0 tx=0x7f5398009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cfc61f4871bfbc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.781+0000 7f53a14a4700 1 -- 172.21.15.62:0/2072258077 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f539800b860 con 0x7f539c0712d0 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.781+0000 7f53a14a4700 1 -- 172.21.15.62:0/2072258077 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f539800be50 con 0x7f539c0712d0 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.781+0000 7f53a14a4700 1 -- 172.21.15.62:0/2072258077 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5398010380 con 0x7f539c0712d0 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.782+0000 7f53a470a700 1 -- 172.21.15.62:0/2072258077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 msgr2=0x7f539c105470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.782+0000 7f53a470a700 1 --2- 172.21.15.62:0/2072258077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c105470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53980098e0 tx=0x7f5398009250 comp rx=0 tx=0).stop 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.782+0000 7f53a470a700 1 -- 172.21.15.62:0/2072258077 shutdown_connections 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.782+0000 7f53a470a700 1 --2- 172.21.15.62:0/2072258077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c105470 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:31.319 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.782+0000 7f53a470a700 1 -- 172.21.15.62:0/2072258077 >> 172.21.15.62:0/2072258077 conn(0x7f539c0fcea0 msgr2=0x7f539c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.782+0000 7f53a470a700 1 -- 172.21.15.62:0/2072258077 shutdown_connections 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.782+0000 7f53a470a700 1 -- 172.21.15.62:0/2072258077 wait complete. 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.783+0000 7f53a470a700 1 Processor -- start 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.783+0000 7f53a470a700 1 -- start start 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.783+0000 7f53a470a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.783+0000 7f53a470a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c103300 con 0x7f539c0712d0 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.783+0000 7f53a24a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.783+0000 7f53a24a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c102dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59892/0 (socket says 172.21.15.62:59892) 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.783+0000 7f53a24a6700 1 -- 172.21.15.62:0/1451761246 learned_addr learned my addr 172.21.15.62:0/1451761246 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.783+0000 7f53a24a6700 1 -- 172.21.15.62:0/1451761246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980094f0 con 0x7f539c0712d0 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.784+0000 7f53a24a6700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c102dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5398006b00 tx=0x7f5398009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.784+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53980107c0 con 0x7f539c0712d0 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.784+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c101370 con 0x7f539c0712d0 2024-05-09T06:20:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.784+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5398010db0 con 0x7f539c0712d0 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.784+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f539801acf0 con 0x7f539c0712d0 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.784+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c101860 con 0x7f539c0712d0 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.785+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f5398010920 con 0x7f539c0712d0 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.785+0000 7f5392ffd700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 0x7f5388038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.785+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 --> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f539c04bed0 con 0x7f5388036850 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.785+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f539804a640 con 0x7f539c0712d0 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.785+0000 7f53a1ca5700 1 -- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 msgr2=0x7f5388038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/21732303 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.785+0000 7f53a1ca5700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 0x7f5388038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.986+0000 7f53a1ca5700 1 -- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 msgr2=0x7f5388038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/21732303 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:25.986+0000 7f53a1ca5700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 0x7f5388038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:26.387+0000 7f53a1ca5700 1 -- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 msgr2=0x7f5388038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/21732303 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:26.387+0000 7f53a1ca5700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 0x7f5388038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:27.188+0000 7f53a1ca5700 1 -- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 msgr2=0x7f5388038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/21732303 2024-05-09T06:20:31.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:27.188+0000 7f53a1ca5700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 0x7f5388038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:28.789+0000 7f53a1ca5700 1 -- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 msgr2=0x7f5388038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/21732303 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:28.789+0000 7f53a1ca5700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 0x7f5388038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:29.772+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7f539800ed40 con 0x7f539c0712d0 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:29.772+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 msgr2=0x7f5388038d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:29.772+0000 7f5392ffd700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 0x7f5388038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.773+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f53980233a0 con 0x7f539c0712d0 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.774+0000 7f5392ffd700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f5388039fc0 0x7f538803c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.774+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f539c04bed0 con 0x7f5388039fc0 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.774+0000 7f53a1ca5700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f5388039fc0 0x7f538803c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.775+0000 7f53a1ca5700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f5388039fc0 0x7f538803c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f538c0039d0 tx=0x7f538c009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.775+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f539c04bed0 con 0x7f5388039fc0 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.781+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f539c106870 con 0x7f5388039fc0 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f5392ffd700 1 -- 172.21.15.62:0/1451761246 <== mgr.14120 v2:172.21.15.62:6800/942541084 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f539c106870 con 0x7f5388039fc0 2024-05-09T06:20:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f5388039fc0 msgr2=0x7f538803c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f5388039fc0 0x7f538803c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f538c0039d0 tx=0x7f538c009350 comp rx=0 tx=0).stop 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 msgr2=0x7f539c102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c102dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5398006b00 tx=0x7f5398009250 comp rx=0 tx=0).stop 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 shutdown_connections 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f5388039fc0 0x7f538803c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c0712d0 0x7f539c102dc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 --2- 172.21.15.62:0/1451761246 >> [v2:172.21.15.62:6800/21732303,v1:172.21.15.62:6801/21732303] conn(0x7f5388036850 0x7f5388038d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 >> 172.21.15.62:0/1451761246 conn(0x7f539c0fcea0 msgr2=0x7f539c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 shutdown_connections 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:30.782+0000 7f53a470a700 1 -- 172.21.15.62:0/1451761246 wait complete. 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:mgr epoch 5 is available 2024-05-09T06:20:31.323 INFO:teuthology.orchestra.run.smithi062.stdout:Setting orchestrator backend to cephadm... 2024-05-09T06:20:32.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:31 smithi062 ceph-mon[26920]: [09/May/2024:06:20:30] ENGINE Bus STARTING 2024-05-09T06:20:32.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:31 smithi062 ceph-mon[26920]: [09/May/2024:06:20:30] ENGINE Serving on https://172.21.15.62:7150 2024-05-09T06:20:32.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:31 smithi062 ceph-mon[26920]: [09/May/2024:06:20:30] ENGINE Bus STARTED 2024-05-09T06:20:32.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:31 smithi062 ceph-mon[26920]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-09T06:20:32.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:31 smithi062 ceph-mon[26920]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-09T06:20:32.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.706+0000 7f4af5830700 1 Processor -- start 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.706+0000 7f4af5830700 1 -- start start 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.706+0000 7f4af5830700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af0102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.706+0000 7f4af5830700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01031d0 con 0x7f4af0102880 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.706+0000 7f4aeeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af0102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.706+0000 7f4aeeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af0102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59966/0 (socket says 172.21.15.62:59966) 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.706+0000 7f4aeeffd700 1 -- 172.21.15.62:0/2645578156 learned_addr learned my addr 172.21.15.62:0/2645578156 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.706+0000 7f4aeeffd700 1 -- 172.21.15.62:0/2645578156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0103310 con 0x7f4af0102880 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4aeeffd700 1 --2- 172.21.15.62:0/2645578156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af0102c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00098e0 tx=0x7f4ae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ae09e015603567 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4aedffb700 1 -- 172.21.15.62:0/2645578156 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ae000b860 con 0x7f4af0102880 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4aedffb700 1 -- 172.21.15.62:0/2645578156 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4ae000be50 con 0x7f4af0102880 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4aedffb700 1 -- 172.21.15.62:0/2645578156 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ae0010380 con 0x7f4af0102880 2024-05-09T06:20:32.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4af5830700 1 -- 172.21.15.62:0/2645578156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 msgr2=0x7f4af0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4af5830700 1 --2- 172.21.15.62:0/2645578156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af0102c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00098e0 tx=0x7f4ae0009250 comp rx=0 tx=0).stop 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4af5830700 1 -- 172.21.15.62:0/2645578156 shutdown_connections 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4af5830700 1 --2- 172.21.15.62:0/2645578156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af0102c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4af5830700 1 -- 172.21.15.62:0/2645578156 >> 172.21.15.62:0/2645578156 conn(0x7f4af00fe060 msgr2=0x7f4af0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4af5830700 1 -- 172.21.15.62:0/2645578156 shutdown_connections 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.707+0000 7f4af5830700 1 -- 172.21.15.62:0/2645578156 wait complete. 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.708+0000 7f4af5830700 1 Processor -- start 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.708+0000 7f4af5830700 1 -- start start 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.708+0000 7f4af5830700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af01115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:32.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.708+0000 7f4af5830700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0111b30 con 0x7f4af0102880 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.708+0000 7f4aeeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af01115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.708+0000 7f4aeeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af01115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59968/0 (socket says 172.21.15.62:59968) 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.708+0000 7f4aeeffd700 1 -- 172.21.15.62:0/908149249 learned_addr learned my addr 172.21.15.62:0/908149249 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.709+0000 7f4aeeffd700 1 -- 172.21.15.62:0/908149249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00094f0 con 0x7f4af0102880 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.709+0000 7f4aeeffd700 1 --2- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af01115f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0000c00 tx=0x7f4ae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.709+0000 7f4ad77fe700 1 -- 172.21.15.62:0/908149249 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ae001c760 con 0x7f4af0102880 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.709+0000 7f4ad77fe700 1 -- 172.21.15.62:0/908149249 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4ae001cd50 con 0x7f4af0102880 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.709+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af0111d30 con 0x7f4af0102880 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.709+0000 7f4ad77fe700 1 -- 172.21.15.62:0/908149249 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ae0026420 con 0x7f4af0102880 2024-05-09T06:20:32.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.709+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af0112160 con 0x7f4af0102880 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.710+0000 7f4ad77fe700 1 -- 172.21.15.62:0/908149249 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f4ae0024070 con 0x7f4af0102880 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.710+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af004bed0 con 0x7f4af0102880 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.710+0000 7f4ad77fe700 1 --2- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4ad8036720 0x7f4ad8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.710+0000 7f4ad77fe700 1 -- 172.21.15.62:0/908149249 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4ae004df10 con 0x7f4af0102880 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.710+0000 7f4aee7fc700 1 --2- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4ad8036720 0x7f4ad8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.711+0000 7f4aee7fc700 1 --2- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4ad8036720 0x7f4ad8038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009990 tx=0x7f4ae4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.715+0000 7f4ad77fe700 1 -- 172.21.15.62:0/908149249 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4ae0023870 con 0x7f4af0102880 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.827+0000 7f4ad77fe700 1 -- 172.21.15.62:0/908149249 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f4ae0025380 con 0x7f4af0102880 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.930+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f4af00ff200 con 0x7f4ad8036720 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.938+0000 7f4ad77fe700 1 -- 172.21.15.62:0/908149249 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4af00ff200 con 0x7f4ad8036720 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4ad8036720 msgr2=0x7f4ad8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 --2- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4ad8036720 0x7f4ad8038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009990 tx=0x7f4ae4006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 msgr2=0x7f4af01115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:32.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 --2- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af01115f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0000c00 tx=0x7f4ae0009250 comp rx=0 tx=0).stop 2024-05-09T06:20:32.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 shutdown_connections 2024-05-09T06:20:32.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 --2- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4ad8036720 0x7f4ad8038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:32.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 --2- 172.21.15.62:0/908149249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4af0102880 0x7f4af01115f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:32.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 >> 172.21.15.62:0/908149249 conn(0x7f4af00fe060 msgr2=0x7f4af00feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:32.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 shutdown_connections 2024-05-09T06:20:32.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:31.940+0000 7f4af5830700 1 -- 172.21.15.62:0/908149249 wait complete. 2024-05-09T06:20:32.864 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:32 smithi062 ceph-mon[26920]: mgrmap e8: smithi062.juuasl(active, since 2s) 2024-05-09T06:20:32.865 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:32 smithi062 ceph-mon[26920]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:32.865 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:32 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:32.865 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:32 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:20:33.595 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-09T06:20:33.595 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.881+0000 7f413941a700 1 Processor -- start 2024-05-09T06:20:33.595 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.881+0000 7f413941a700 1 -- start start 2024-05-09T06:20:33.595 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.881+0000 7f413941a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134102c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:33.595 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.881+0000 7f413941a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4134103160 con 0x7f4134102810 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.881+0000 7f4132ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.881+0000 7f4132ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59978/0 (socket says 172.21.15.62:59978) 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.881+0000 7f4132ffd700 1 -- 172.21.15.62:0/2823916716 learned_addr learned my addr 172.21.15.62:0/2823916716 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.881+0000 7f4132ffd700 1 -- 172.21.15.62:0/2823916716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41341032a0 con 0x7f4134102810 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.882+0000 7f4132ffd700 1 --2- 172.21.15.62:0/2823916716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134102c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41240098e0 tx=0x7f4124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebb7b1b9231adbe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.882+0000 7f4131ffb700 1 -- 172.21.15.62:0/2823916716 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f412400b860 con 0x7f4134102810 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.882+0000 7f4131ffb700 1 -- 172.21.15.62:0/2823916716 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f412400be50 con 0x7f4134102810 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.882+0000 7f4131ffb700 1 -- 172.21.15.62:0/2823916716 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4124010380 con 0x7f4134102810 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.882+0000 7f413941a700 1 -- 172.21.15.62:0/2823916716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 msgr2=0x7f4134102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.882+0000 7f413941a700 1 --2- 172.21.15.62:0/2823916716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134102c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41240098e0 tx=0x7f4124009250 comp rx=0 tx=0).stop 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.882+0000 7f413941a700 1 -- 172.21.15.62:0/2823916716 shutdown_connections 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.882+0000 7f413941a700 1 --2- 172.21.15.62:0/2823916716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134102c20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.883+0000 7f413941a700 1 -- 172.21.15.62:0/2823916716 >> 172.21.15.62:0/2823916716 conn(0x7f41340fdfd0 msgr2=0x7f41341003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:33.596 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.883+0000 7f413941a700 1 -- 172.21.15.62:0/2823916716 shutdown_connections 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.883+0000 7f413941a700 1 -- 172.21.15.62:0/2823916716 wait complete. 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.883+0000 7f413941a700 1 Processor -- start 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.883+0000 7f413941a700 1 -- start start 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f413941a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f413941a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4134079160 con 0x7f4134102810 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f4132ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f4132ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59982/0 (socket says 172.21.15.62:59982) 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f4132ffd700 1 -- 172.21.15.62:0/3770729789 learned_addr learned my addr 172.21.15.62:0/3770729789 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f4132ffd700 1 -- 172.21.15.62:0/3770729789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41240094f0 con 0x7f4134102810 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f4132ffd700 1 --2- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134078c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f412400ba90 tx=0x7f4124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f411b7fe700 1 -- 172.21.15.62:0/3770729789 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41240107c0 con 0x7f4134102810 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41340771d0 con 0x7f4134102810 2024-05-09T06:20:33.597 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f411b7fe700 1 -- 172.21.15.62:0/3770729789 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4124010db0 con 0x7f4134102810 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f411b7fe700 1 -- 172.21.15.62:0/3770729789 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f412401add0 con 0x7f4134102810 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.884+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41340776c0 con 0x7f4134102810 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.885+0000 7f411b7fe700 1 -- 172.21.15.62:0/3770729789 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f412402e440 con 0x7f4134102810 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.885+0000 7f411b7fe700 1 --2- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f411c036850 0x7f411c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.885+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413404bed0 con 0x7f4134102810 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.885+0000 7f411b7fe700 1 -- 172.21.15.62:0/3770729789 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f412404a600 con 0x7f4134102810 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.886+0000 7f41327fc700 1 --2- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f411c036850 0x7f411c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.886+0000 7f41327fc700 1 --2- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f411c036850 0x7f411c038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4128009990 tx=0x7f4128006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:33.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:32.890+0000 7f411b7fe700 1 -- 172.21.15.62:0/3770729789 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4124018940 con 0x7f4134102810 2024-05-09T06:20:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.087+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f4134077dd0 con 0x7f411c036850 2024-05-09T06:20:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.088+0000 7f411b7fe700 1 -- 172.21.15.62:0/3770729789 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f4134077dd0 con 0x7f411c036850 2024-05-09T06:20:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f411c036850 msgr2=0x7f411c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 --2- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f411c036850 0x7f411c038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4128009990 tx=0x7f4128006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 msgr2=0x7f4134078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 --2- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134078c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f412400ba90 tx=0x7f4124009250 comp rx=0 tx=0).stop 2024-05-09T06:20:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 shutdown_connections 2024-05-09T06:20:33.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 --2- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f411c036850 0x7f411c038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 --2- 172.21.15.62:0/3770729789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4134102810 0x7f4134078c20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 >> 172.21.15.62:0/3770729789 conn(0x7f41340fdfd0 msgr2=0x7f41340feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 shutdown_connections 2024-05-09T06:20:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:33.090+0000 7f413941a700 1 -- 172.21.15.62:0/3770729789 wait complete. 2024-05-09T06:20:33.600 INFO:teuthology.orchestra.run.smithi062.stdout:Generating ssh key... 2024-05-09T06:20:34.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:34 smithi062 ceph-mon[26920]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.047+0000 7f6d1b872700 1 Processor -- start 2024-05-09T06:20:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.047+0000 7f6d1b872700 1 -- start start 2024-05-09T06:20:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.047+0000 7f6d1b872700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d141078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.047+0000 7f6d1b872700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14103290 con 0x7f6d14076bb0 2024-05-09T06:20:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.047+0000 7f6d1960e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d141078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.047+0000 7f6d1960e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d141078a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48088/0 (socket says 172.21.15.62:48088) 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.047+0000 7f6d1960e700 1 -- 172.21.15.62:0/1049972057 learned_addr learned my addr 172.21.15.62:0/1049972057 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.047+0000 7f6d1960e700 1 -- 172.21.15.62:0/1049972057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d14107de0 con 0x7f6d14076bb0 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d1960e700 1 --2- 172.21.15.62:0/1049972057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d141078a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d100098e0 tx=0x7f6d10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122ca7169a69244c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d0bfff700 1 -- 172.21.15.62:0/1049972057 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d1000b860 con 0x7f6d14076bb0 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d0bfff700 1 -- 172.21.15.62:0/1049972057 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6d1000be50 con 0x7f6d14076bb0 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d0bfff700 1 -- 172.21.15.62:0/1049972057 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d10010380 con 0x7f6d14076bb0 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d1b872700 1 -- 172.21.15.62:0/1049972057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 msgr2=0x7f6d141078a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d1b872700 1 --2- 172.21.15.62:0/1049972057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d141078a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d100098e0 tx=0x7f6d10009250 comp rx=0 tx=0).stop 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d1b872700 1 -- 172.21.15.62:0/1049972057 shutdown_connections 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d1b872700 1 --2- 172.21.15.62:0/1049972057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d141078a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.048+0000 7f6d1b872700 1 -- 172.21.15.62:0/1049972057 >> 172.21.15.62:0/1049972057 conn(0x7f6d140fcef0 msgr2=0x7f6d140ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1b872700 1 -- 172.21.15.62:0/1049972057 shutdown_connections 2024-05-09T06:20:35.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1b872700 1 -- 172.21.15.62:0/1049972057 wait complete. 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1b872700 1 Processor -- start 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1b872700 1 -- start start 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1b872700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d14113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1b872700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14113d40 con 0x7f6d14076bb0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1960e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d14113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1960e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d14113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48104/0 (socket says 172.21.15.62:48104) 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.049+0000 7f6d1960e700 1 -- 172.21.15.62:0/2439604868 learned_addr learned my addr 172.21.15.62:0/2439604868 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.050+0000 7f6d1960e700 1 -- 172.21.15.62:0/2439604868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d100094f0 con 0x7f6d14076bb0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.050+0000 7f6d1960e700 1 --2- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d14113800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d10003050 tx=0x7f6d10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.050+0000 7f6d09ffb700 1 -- 172.21.15.62:0/2439604868 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d10010760 con 0x7f6d14076bb0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.050+0000 7f6d09ffb700 1 -- 172.21.15.62:0/2439604868 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6d10010d50 con 0x7f6d14076bb0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.050+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d14113f40 con 0x7f6d14076bb0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.050+0000 7f6d09ffb700 1 -- 172.21.15.62:0/2439604868 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d1001ae20 con 0x7f6d14076bb0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.050+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d14114ab0 con 0x7f6d14076bb0 2024-05-09T06:20:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.051+0000 7f6d09ffb700 1 -- 172.21.15.62:0/2439604868 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f6d1002e440 con 0x7f6d14076bb0 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.051+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1405f5c0 con 0x7f6d14076bb0 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.051+0000 7f6d09ffb700 1 --2- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6d000368a0 0x7f6d00038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.051+0000 7f6d09ffb700 1 -- 172.21.15.62:0/2439604868 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6d1004a6d0 con 0x7f6d14076bb0 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.051+0000 7f6d18e0d700 1 --2- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6d000368a0 0x7f6d00038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.052+0000 7f6d18e0d700 1 --2- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6d000368a0 0x7f6d00038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009990 tx=0x7f6d04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.056+0000 7f6d09ffb700 1 -- 172.21.15.62:0/2439604868 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6d10018940 con 0x7f6d14076bb0 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.252+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d140fe150 con 0x7f6d000368a0 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.735+0000 7f6d09ffb700 1 -- 172.21.15.62:0/2439604868 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6d140fe150 con 0x7f6d000368a0 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6d000368a0 msgr2=0x7f6d00038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 --2- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6d000368a0 0x7f6d00038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009990 tx=0x7f6d04006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 msgr2=0x7f6d14113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 --2- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d14113800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d10003050 tx=0x7f6d10009250 comp rx=0 tx=0).stop 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 shutdown_connections 2024-05-09T06:20:35.280 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 --2- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6d000368a0 0x7f6d00038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 --2- 172.21.15.62:0/2439604868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d14076bb0 0x7f6d14113800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 >> 172.21.15.62:0/2439604868 conn(0x7f6d140fcef0 msgr2=0x7f6d140fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 shutdown_connections 2024-05-09T06:20:35.281 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:34.737+0000 7f6d1b872700 1 -- 172.21.15.62:0/2439604868 wait complete. 2024-05-09T06:20:35.888 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:35 smithi062 ceph-mon[26920]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:35.888 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:35 smithi062 ceph-mon[26920]: Generating ssh key... 2024-05-09T06:20:35.888 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:35 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:35.888 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:35 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/AzAMTK0zmrX0pb30fAmwmHPXNhcPzURobtEpLvVpXoaAmym/rQ4JG90+EOVn6F9JnA7FfnuOkcMdpxxxfpq/bygOggjWCgRbTjKBvH4zmX2ZjIIKogC5Fntqh0B0BU0cemXTbZIhdLBSyjMDJTdWL6eQr0HBMjwXm5iNgcB97m8FYfZftEhQkLqllNsfRAYk9Pm+oCNRrahvVczemzSaFXAlx8VfN3ww7JONk33X3vCtIXdYHGwXwL2uJH8XiB8a6fNWGrLw6UyFJpwNrLuakZsSiggrOE9sCai5qjD5ESkSmEVb+YXWWV8XoRy4ekI1/1aAvqMYXL+5g62PbWESLjAKSRyaBwKfAatEepzPUxdi/iUiWzOyZqMNb3zLeVvGt5qFwnYvzv5CMtDDC+2xrNpjo7GWBmcBz3l4Szg0HRehVG+ULZTz52bBQbxiScj10jDpOF3m2p4If8OMsj/f3U+TOtlVQ56q7yYkIbb3V/zyZOW4vJzVpkzAn+koMsM= ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.696+0000 7ffa8b540700 1 Processor -- start 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.697+0000 7ffa8b540700 1 -- start start 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.697+0000 7ffa8b540700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84107860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.697+0000 7ffa8b540700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84103250 con 0x7ffa84076bf0 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.697+0000 7ffa892dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84107860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.697+0000 7ffa892dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84107860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48116/0 (socket says 172.21.15.62:48116) 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.697+0000 7ffa892dc700 1 -- 172.21.15.62:0/1498213157 learned_addr learned my addr 172.21.15.62:0/1498213157 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.697+0000 7ffa892dc700 1 -- 172.21.15.62:0/1498213157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84107da0 con 0x7ffa84076bf0 2024-05-09T06:20:36.437 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.697+0000 7ffa892dc700 1 --2- 172.21.15.62:0/1498213157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84107860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa800098e0 tx=0x7ffa80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e1cd25b3418233 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa7bfff700 1 -- 172.21.15.62:0/1498213157 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa8000b860 con 0x7ffa84076bf0 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa7bfff700 1 -- 172.21.15.62:0/1498213157 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffa8000be50 con 0x7ffa84076bf0 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa7bfff700 1 -- 172.21.15.62:0/1498213157 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa80010380 con 0x7ffa84076bf0 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa8b540700 1 -- 172.21.15.62:0/1498213157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 msgr2=0x7ffa84107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa8b540700 1 --2- 172.21.15.62:0/1498213157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84107860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa800098e0 tx=0x7ffa80009250 comp rx=0 tx=0).stop 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa8b540700 1 -- 172.21.15.62:0/1498213157 shutdown_connections 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa8b540700 1 --2- 172.21.15.62:0/1498213157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84107860 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa8b540700 1 -- 172.21.15.62:0/1498213157 >> 172.21.15.62:0/1498213157 conn(0x7ffa840fcef0 msgr2=0x7ffa840ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa8b540700 1 -- 172.21.15.62:0/1498213157 shutdown_connections 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.698+0000 7ffa8b540700 1 -- 172.21.15.62:0/1498213157 wait complete. 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.699+0000 7ffa8b540700 1 Processor -- start 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.699+0000 7ffa8b540700 1 -- start start 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.699+0000 7ffa8b540700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:36.438 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.699+0000 7ffa8b540700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84113d40 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.699+0000 7ffa892dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.699+0000 7ffa892dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48132/0 (socket says 172.21.15.62:48132) 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.699+0000 7ffa892dc700 1 -- 172.21.15.62:0/979719795 learned_addr learned my addr 172.21.15.62:0/979719795 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.700+0000 7ffa892dc700 1 -- 172.21.15.62:0/979719795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800094f0 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.700+0000 7ffa892dc700 1 --2- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84113800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffa80006b00 tx=0x7ffa80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.700+0000 7ffa79ffb700 1 -- 172.21.15.62:0/979719795 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa800107c0 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.700+0000 7ffa79ffb700 1 -- 172.21.15.62:0/979719795 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffa80010db0 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.700+0000 7ffa79ffb700 1 -- 172.21.15.62:0/979719795 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa8001acf0 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.700+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa84113f40 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.700+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa84114ab0 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.701+0000 7ffa79ffb700 1 -- 172.21.15.62:0/979719795 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ffa80010920 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.701+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8405f5c0 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.701+0000 7ffa79ffb700 1 --2- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ffa70036850 0x7ffa70038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.701+0000 7ffa79ffb700 1 -- 172.21.15.62:0/979719795 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ffa8004a650 con 0x7ffa84076bf0 2024-05-09T06:20:36.439 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.702+0000 7ffa88adb700 1 --2- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ffa70036850 0x7ffa70038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.702+0000 7ffa88adb700 1 --2- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ffa70036850 0x7ffa70038d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009990 tx=0x7ffa74006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.706+0000 7ffa79ffb700 1 -- 172.21.15.62:0/979719795 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffa8001a530 con 0x7ffa84076bf0 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.905+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa840fe0e0 con 0x7ffa70036850 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.905+0000 7ffa79ffb700 1 -- 172.21.15.62:0/979719795 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7ffa840fe0e0 con 0x7ffa70036850 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.907+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ffa70036850 msgr2=0x7ffa70038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.907+0000 7ffa8b540700 1 --2- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ffa70036850 0x7ffa70038d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009990 tx=0x7ffa74006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.907+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 msgr2=0x7ffa84113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.907+0000 7ffa8b540700 1 --2- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84113800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffa80006b00 tx=0x7ffa80009250 comp rx=0 tx=0).stop 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.907+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 shutdown_connections 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.907+0000 7ffa8b540700 1 --2- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ffa70036850 0x7ffa70038d00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.907+0000 7ffa8b540700 1 --2- 172.21.15.62:0/979719795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84076bf0 0x7ffa84113800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.907+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 >> 172.21.15.62:0/979719795 conn(0x7ffa840fcef0 msgr2=0x7ffa840fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.908+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 shutdown_connections 2024-05-09T06:20:36.440 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:35.908+0000 7ffa8b540700 1 -- 172.21.15.62:0/979719795 wait complete. 2024-05-09T06:20:36.441 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:20:36.441 INFO:teuthology.orchestra.run.smithi062.stdout:Adding key to root@localhost authorized_keys... 2024-05-09T06:20:36.441 INFO:teuthology.orchestra.run.smithi062.stdout:Adding host smithi062... 2024-05-09T06:20:36.824 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:36 smithi062 ceph-mon[26920]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:38.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:38 smithi062 ceph-mon[26920]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi062", "addr": "172.21.15.62", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:38.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:38 smithi062 ceph-mon[26920]: Deploying cephadm binary to smithi062 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Added host 'smithi062' with addr '172.21.15.62' 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.840+0000 7f4de2977700 1 Processor -- start 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.840+0000 7f4de2977700 1 -- start start 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.840+0000 7f4de2977700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.840+0000 7f4de2977700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc079070 con 0x7f4ddc078c60 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.841+0000 7f4ddbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.841+0000 7f4ddbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48146/0 (socket says 172.21.15.62:48146) 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.841+0000 7f4ddbfff700 1 -- 172.21.15.62:0/1236409416 learned_addr learned my addr 172.21.15.62:0/1236409416 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.841+0000 7f4ddbfff700 1 -- 172.21.15.62:0/1236409416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc077750 con 0x7f4ddc078c60 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.841+0000 7f4ddbfff700 1 --2- 172.21.15.62:0/1236409416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc077210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0098e0 tx=0x7f4dcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40e79dfd490552b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:39.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.841+0000 7f4ddb7fe700 1 -- 172.21.15.62:0/1236409416 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dcc00b860 con 0x7f4ddc078c60 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.841+0000 7f4ddb7fe700 1 -- 172.21.15.62:0/1236409416 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4dcc00be50 con 0x7f4ddc078c60 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.841+0000 7f4ddb7fe700 1 -- 172.21.15.62:0/1236409416 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dcc010380 con 0x7f4ddc078c60 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.842+0000 7f4de2977700 1 -- 172.21.15.62:0/1236409416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 msgr2=0x7f4ddc077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.842+0000 7f4de2977700 1 --2- 172.21.15.62:0/1236409416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc077210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0098e0 tx=0x7f4dcc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.842+0000 7f4de2977700 1 -- 172.21.15.62:0/1236409416 shutdown_connections 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.842+0000 7f4de2977700 1 --2- 172.21.15.62:0/1236409416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc077210 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.842+0000 7f4de2977700 1 -- 172.21.15.62:0/1236409416 >> 172.21.15.62:0/1236409416 conn(0x7f4ddc0fe060 msgr2=0x7f4ddc100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.842+0000 7f4de2977700 1 -- 172.21.15.62:0/1236409416 shutdown_connections 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.842+0000 7f4de2977700 1 -- 172.21.15.62:0/1236409416 wait complete. 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.843+0000 7f4de2977700 1 Processor -- start 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.843+0000 7f4de2977700 1 -- start start 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.843+0000 7f4de2977700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:39.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.843+0000 7f4de2977700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc113d80 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.843+0000 7f4ddbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.843+0000 7f4ddbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48160/0 (socket says 172.21.15.62:48160) 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.843+0000 7f4ddbfff700 1 -- 172.21.15.62:0/3317950556 learned_addr learned my addr 172.21.15.62:0/3317950556 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.844+0000 7f4ddbfff700 1 -- 172.21.15.62:0/3317950556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0094f0 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.844+0000 7f4ddbfff700 1 --2- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc113840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc006fd0 tx=0x7f4dcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.844+0000 7f4dd97fa700 1 -- 172.21.15.62:0/3317950556 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dcc0107c0 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.844+0000 7f4dd97fa700 1 -- 172.21.15.62:0/3317950556 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4dcc010db0 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.844+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc113f80 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.844+0000 7f4dd97fa700 1 -- 172.21.15.62:0/3317950556 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dcc01ada0 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.844+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc114af0 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.845+0000 7f4dd97fa700 1 -- 172.21.15.62:0/3317950556 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f4dcc019410 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.845+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc05f5c0 con 0x7f4ddc078c60 2024-05-09T06:20:39.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.845+0000 7f4dd97fa700 1 --2- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4dc80368a0 0x7f4dc8038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.845+0000 7f4dd97fa700 1 -- 172.21.15.62:0/3317950556 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4dcc049de0 con 0x7f4ddc078c60 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.845+0000 7f4dd3fff700 1 --2- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4dc80368a0 0x7f4dc8038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.846+0000 7f4dd3fff700 1 --2- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4dc80368a0 0x7f4dc8038d50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009990 tx=0x7f4dc4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:36.850+0000 7f4dd97fa700 1 -- 172.21.15.62:0/3317950556 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4dcc0239b0 con 0x7f4ddc078c60 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:37.049+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi062", "addr": "172.21.15.62", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ddc0ff2f0 con 0x7f4dc80368a0 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.984+0000 7f4dd97fa700 1 -- 172.21.15.62:0/3317950556 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f4ddc0ff2f0 con 0x7f4dc80368a0 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4dc80368a0 msgr2=0x7f4dc8038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 --2- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4dc80368a0 0x7f4dc8038d50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009990 tx=0x7f4dc4006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 msgr2=0x7f4ddc113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 --2- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc113840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc006fd0 tx=0x7f4dcc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 shutdown_connections 2024-05-09T06:20:39.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 --2- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4dc80368a0 0x7f4dc8038d50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:39.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 --2- 172.21.15.62:0/3317950556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ddc078c60 0x7f4ddc113840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:39.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 >> 172.21.15.62:0/3317950556 conn(0x7f4ddc0fe060 msgr2=0x7f4ddc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:39.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 shutdown_connections 2024-05-09T06:20:39.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.987+0000 7f4de2977700 1 -- 172.21.15.62:0/3317950556 wait complete. 2024-05-09T06:20:39.541 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying mon service with default placement... 2024-05-09T06:20:40.176 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:39 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:40.176 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:39 smithi062 ceph-mon[26920]: Added host smithi062 2024-05-09T06:20:40.176 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:39 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff402622700 1 Processor -- start 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff402622700 1 -- start start 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff402622700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc101b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff402622700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc1020a0 con 0x7ff3fc101750 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff3fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff3fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc101b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48166/0 (socket says 172.21.15.62:48166) 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff3fbfff700 1 -- 172.21.15.62:0/445738306 learned_addr learned my addr 172.21.15.62:0/445738306 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff3fbfff700 1 -- 172.21.15.62:0/445738306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc1021e0 con 0x7ff3fc101750 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.042+0000 7ff3fbfff700 1 --2- 172.21.15.62:0/445738306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc101b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0098e0 tx=0x7ff3ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134285541b74dbb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff3faffd700 1 -- 172.21.15.62:0/445738306 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3ec00b860 con 0x7ff3fc101750 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff3faffd700 1 -- 172.21.15.62:0/445738306 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff3ec00be50 con 0x7ff3fc101750 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff3faffd700 1 -- 172.21.15.62:0/445738306 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3ec010380 con 0x7ff3fc101750 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff402622700 1 -- 172.21.15.62:0/445738306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 msgr2=0x7ff3fc101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff402622700 1 --2- 172.21.15.62:0/445738306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc101b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0098e0 tx=0x7ff3ec009250 comp rx=0 tx=0).stop 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff402622700 1 -- 172.21.15.62:0/445738306 shutdown_connections 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff402622700 1 --2- 172.21.15.62:0/445738306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc101b60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff402622700 1 -- 172.21.15.62:0/445738306 >> 172.21.15.62:0/445738306 conn(0x7ff3fc0fcef0 msgr2=0x7ff3fc0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff402622700 1 -- 172.21.15.62:0/445738306 shutdown_connections 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.043+0000 7ff402622700 1 -- 172.21.15.62:0/445738306 wait complete. 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.044+0000 7ff402622700 1 Processor -- start 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.044+0000 7ff402622700 1 -- start start 2024-05-09T06:20:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.044+0000 7ff402622700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc076b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.044+0000 7ff402622700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc1142d0 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.044+0000 7ff3fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc076b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.044+0000 7ff3fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc076b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48180/0 (socket says 172.21.15.62:48180) 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.044+0000 7ff3fbfff700 1 -- 172.21.15.62:0/2083974078 learned_addr learned my addr 172.21.15.62:0/2083974078 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.045+0000 7ff3fbfff700 1 -- 172.21.15.62:0/2083974078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec0094f0 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.045+0000 7ff3fbfff700 1 --2- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc076b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00b440 tx=0x7ff3ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.045+0000 7ff3f8ff9700 1 -- 172.21.15.62:0/2083974078 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3ec010760 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.045+0000 7ff3f8ff9700 1 -- 172.21.15.62:0/2083974078 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff3ec010d50 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.045+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc114410 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.045+0000 7ff3f8ff9700 1 -- 172.21.15.62:0/2083974078 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3ec01ae20 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.045+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc1148a0 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.046+0000 7ff3f8ff9700 1 -- 172.21.15.62:0/2083974078 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ff3ec02e440 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.046+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc04bed0 con 0x7ff3fc101750 2024-05-09T06:20:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.046+0000 7ff3f8ff9700 1 --2- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ff3e40368a0 0x7ff3e4038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.046+0000 7ff3f8ff9700 1 -- 172.21.15.62:0/2083974078 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff3ec04a6c0 con 0x7ff3fc101750 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.046+0000 7ff3fb7fe700 1 --2- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ff3e40368a0 0x7ff3e4038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.047+0000 7ff3fb7fe700 1 --2- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ff3e40368a0 0x7ff3e4038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009990 tx=0x7ff3f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.051+0000 7ff3f8ff9700 1 -- 172.21.15.62:0/2083974078 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff3ec023d20 con 0x7ff3fc101750 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.259+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3fc0fe090 con 0x7ff3e40368a0 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.267+0000 7ff3f8ff9700 1 -- 172.21.15.62:0/2083974078 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff3fc0fe090 con 0x7ff3e40368a0 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ff3e40368a0 msgr2=0x7ff3e4038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 --2- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ff3e40368a0 0x7ff3e4038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009990 tx=0x7ff3f0006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 msgr2=0x7ff3fc076b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 --2- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc076b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00b440 tx=0x7ff3ec009250 comp rx=0 tx=0).stop 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 shutdown_connections 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 --2- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7ff3e40368a0 0x7ff3e4038d50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 --2- 172.21.15.62:0/2083974078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3fc101750 0x7ff3fc076b20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 >> 172.21.15.62:0/2083974078 conn(0x7ff3fc0fcef0 msgr2=0x7ff3fc0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 shutdown_connections 2024-05-09T06:20:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.269+0000 7ff402622700 1 -- 172.21.15.62:0/2083974078 wait complete. 2024-05-09T06:20:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying mgr service with default placement... 2024-05-09T06:20:41.435 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:41 smithi062 ceph-mon[26920]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:41.435 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:41 smithi062 ceph-mon[26920]: Saving service mon spec with placement count:5 2024-05-09T06:20:41.435 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:41 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:42.608 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.361+0000 7f703224f700 1 Processor -- start 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.361+0000 7f703224f700 1 -- start start 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.361+0000 7f703224f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.361+0000 7f703224f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c105960 con 0x7f702c076c50 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.361+0000 7f702b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.361+0000 7f702b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48188/0 (socket says 172.21.15.62:48188) 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.361+0000 7f702b7fe700 1 -- 172.21.15.62:0/896302610 learned_addr learned my addr 172.21.15.62:0/896302610 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.362+0000 7f702b7fe700 1 -- 172.21.15.62:0/896302610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c105aa0 con 0x7f702c076c50 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.362+0000 7f702b7fe700 1 --2- 172.21.15.62:0/896302610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c105420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f701c009e50 tx=0x7f701c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661c003fd83a41d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.362+0000 7f702a7fc700 1 -- 172.21.15.62:0/896302610 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f701c0092e0 con 0x7f702c076c50 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.362+0000 7f702a7fc700 1 -- 172.21.15.62:0/896302610 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f701c012430 con 0x7f702c076c50 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.362+0000 7f702a7fc700 1 -- 172.21.15.62:0/896302610 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f701c0075c0 con 0x7f702c076c50 2024-05-09T06:20:42.609 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 -- 172.21.15.62:0/896302610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 msgr2=0x7f702c105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 --2- 172.21.15.62:0/896302610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c105420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f701c009e50 tx=0x7f701c009840 comp rx=0 tx=0).stop 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 -- 172.21.15.62:0/896302610 shutdown_connections 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 --2- 172.21.15.62:0/896302610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c105420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 -- 172.21.15.62:0/896302610 >> 172.21.15.62:0/896302610 conn(0x7f702c0fcef0 msgr2=0x7f702c0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 -- 172.21.15.62:0/896302610 shutdown_connections 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 -- 172.21.15.62:0/896302610 wait complete. 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 Processor -- start 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.363+0000 7f703224f700 1 -- start start 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f703224f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c102d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f703224f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c1032b0 con 0x7f702c076c50 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f702b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c102d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f702b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c102d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48204/0 (socket says 172.21.15.62:48204) 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f702b7fe700 1 -- 172.21.15.62:0/1840921745 learned_addr learned my addr 172.21.15.62:0/1840921745 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:42.610 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f702b7fe700 1 -- 172.21.15.62:0/1840921745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c009ae0 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f702b7fe700 1 --2- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c102d70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f701c009fd0 tx=0x7f701c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f7023fff700 1 -- 172.21.15.62:0/1840921745 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f701c0092e0 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f7023fff700 1 -- 172.21.15.62:0/1840921745 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f701c007d10 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c101380 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f7023fff700 1 -- 172.21.15.62:0/1840921745 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f701c01c880 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.364+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c101870 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.365+0000 7f7023fff700 1 -- 172.21.15.62:0/1840921745 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f701c019070 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.365+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c04bed0 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.365+0000 7f7023fff700 1 --2- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f70180368a0 0x7f7018038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.366+0000 7f7023fff700 1 -- 172.21.15.62:0/1840921745 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f701c049f20 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.366+0000 7f702affd700 1 --2- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f70180368a0 0x7f7018038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.366+0000 7f702affd700 1 --2- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f70180368a0 0x7f7018038d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7014009990 tx=0x7f7014006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.370+0000 7f7023fff700 1 -- 172.21.15.62:0/1840921745 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f701c019500 con 0x7f702c076c50 2024-05-09T06:20:42.611 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.581+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f702c102030 con 0x7f70180368a0 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.588+0000 7f7023fff700 1 -- 172.21.15.62:0/1840921745 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f702c102030 con 0x7f70180368a0 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f70180368a0 msgr2=0x7f7018038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 --2- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f70180368a0 0x7f7018038d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7014009990 tx=0x7f7014006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 msgr2=0x7f702c102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 --2- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c102d70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f701c009fd0 tx=0x7f701c009840 comp rx=0 tx=0).stop 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 shutdown_connections 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 --2- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f70180368a0 0x7f7018038d50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 --2- 172.21.15.62:0/1840921745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f702c076c50 0x7f702c102d70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 >> 172.21.15.62:0/1840921745 conn(0x7f702c0fcef0 msgr2=0x7f702c0fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 shutdown_connections 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:41.590+0000 7f703224f700 1 -- 172.21.15.62:0/1840921745 wait complete. 2024-05-09T06:20:42.612 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying crash service with default placement... 2024-05-09T06:20:42.872 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:42 smithi062 ceph-mon[26920]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:42.872 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:42 smithi062 ceph-mon[26920]: Saving service mgr spec with placement count:2 2024-05-09T06:20:42.872 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:42 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:42.872 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:42 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:44.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:43 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:44.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:43 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:44.427 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.089+0000 7f2d746a6700 1 Processor -- start 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.089+0000 7f2d746a6700 1 -- start start 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.090+0000 7f2d746a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c103080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.090+0000 7f2d746a6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c103650 con 0x7f2d6c102c70 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.090+0000 7f2d72442700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.090+0000 7f2d72442700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c103080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48210/0 (socket says 172.21.15.62:48210) 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.090+0000 7f2d72442700 1 -- 172.21.15.62:0/3879634961 learned_addr learned my addr 172.21.15.62:0/3879634961 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.090+0000 7f2d72442700 1 -- 172.21.15.62:0/3879634961 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c103790 con 0x7f2d6c102c70 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.090+0000 7f2d72442700 1 --2- 172.21.15.62:0/3879634961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c103080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d680098e0 tx=0x7f2d68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d84e06c8741cb63 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.091+0000 7f2d71440700 1 -- 172.21.15.62:0/3879634961 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d6800b860 con 0x7f2d6c102c70 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.091+0000 7f2d71440700 1 -- 172.21.15.62:0/3879634961 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d6800be90 con 0x7f2d6c102c70 2024-05-09T06:20:44.428 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.091+0000 7f2d71440700 1 -- 172.21.15.62:0/3879634961 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d680103c0 con 0x7f2d6c102c70 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.091+0000 7f2d746a6700 1 -- 172.21.15.62:0/3879634961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 msgr2=0x7f2d6c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.091+0000 7f2d746a6700 1 --2- 172.21.15.62:0/3879634961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c103080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d680098e0 tx=0x7f2d68009250 comp rx=0 tx=0).stop 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 -- 172.21.15.62:0/3879634961 shutdown_connections 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 --2- 172.21.15.62:0/3879634961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c103080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 -- 172.21.15.62:0/3879634961 >> 172.21.15.62:0/3879634961 conn(0x7f2d6c0fc690 msgr2=0x7f2d6c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 -- 172.21.15.62:0/3879634961 shutdown_connections 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 -- 172.21.15.62:0/3879634961 wait complete. 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 Processor -- start 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 -- start start 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.092+0000 7f2d746a6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c113d80 con 0x7f2d6c102c70 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d72442700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d72442700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48224/0 (socket says 172.21.15.62:48224) 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d72442700 1 -- 172.21.15.62:0/1029072592 learned_addr learned my addr 172.21.15.62:0/1029072592 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:44.429 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d72442700 1 -- 172.21.15.62:0/1029072592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680094f0 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d72442700 1 --2- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c113840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d680090b0 tx=0x7f2d68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d62ffd700 1 -- 172.21.15.62:0/1029072592 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d68010840 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d62ffd700 1 -- 172.21.15.62:0/1029072592 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d68010e70 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d62ffd700 1 -- 172.21.15.62:0/1029072592 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d68024e40 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c113f80 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c114af0 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.094+0000 7f2d62ffd700 1 -- 172.21.15.62:0/1029072592 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f2d6801a4e0 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.094+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c05f5c0 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7f2d62ffd700 1 --2- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f2d58036850 0x7f2d58038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7f2d62ffd700 1 -- 172.21.15.62:0/1029072592 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2d6804a9b0 con 0x7f2d6c102c70 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7f2d71c41700 1 --2- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f2d58036850 0x7f2d58038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7f2d71c41700 1 --2- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f2d58036850 0x7f2d58038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009990 tx=0x7f2d5c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:44.430 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.100+0000 7f2d62ffd700 1 -- 172.21.15.62:0/1029072592 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2d68018940 con 0x7f2d6c102c70 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.318+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d6c0fd880 con 0x7f2d58036850 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.322+0000 7f2d62ffd700 1 -- 172.21.15.62:0/1029072592 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f2d6c0fd880 con 0x7f2d58036850 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f2d58036850 msgr2=0x7f2d58038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 --2- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f2d58036850 0x7f2d58038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009990 tx=0x7f2d5c006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 msgr2=0x7f2d6c113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 --2- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c113840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d680090b0 tx=0x7f2d68009250 comp rx=0 tx=0).stop 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 shutdown_connections 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 --2- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f2d58036850 0x7f2d58038d00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 --2- 172.21.15.62:0/1029072592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d6c102c70 0x7f2d6c113840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 >> 172.21.15.62:0/1029072592 conn(0x7f2d6c0fc690 msgr2=0x7f2d6c0fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 shutdown_connections 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.324+0000 7f2d746a6700 1 -- 172.21.15.62:0/1029072592 wait complete. 2024-05-09T06:20:44.431 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying prometheus service with default placement... 2024-05-09T06:20:45.103 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:44 smithi062 ceph-mon[26920]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:45.103 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:44 smithi062 ceph-mon[26920]: Saving service crash spec with placement * 2024-05-09T06:20:45.103 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:44 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:45.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-05-09T06:20:45.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.887+0000 7f4884d2c700 1 Processor -- start 2024-05-09T06:20:45.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.887+0000 7f4884d2c700 1 -- start start 2024-05-09T06:20:45.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.887+0000 7f4884d2c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880105430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:45.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.888+0000 7f4884d2c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4880105970 con 0x7f4880071310 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.888+0000 7f487e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880105430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.888+0000 7f487e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880105430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53236/0 (socket says 172.21.15.62:53236) 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.888+0000 7f487e59c700 1 -- 172.21.15.62:0/2698413013 learned_addr learned my addr 172.21.15.62:0/2698413013 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.888+0000 7f487e59c700 1 -- 172.21.15.62:0/2698413013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880105ab0 con 0x7f4880071310 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.888+0000 7f487e59c700 1 --2- 172.21.15.62:0/2698413013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880105430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48700098e0 tx=0x7f4870009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec96712b5f74832 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.888+0000 7f487d59a700 1 -- 172.21.15.62:0/2698413013 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f487000b860 con 0x7f4880071310 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.888+0000 7f487d59a700 1 -- 172.21.15.62:0/2698413013 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f487000be90 con 0x7f4880071310 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.889+0000 7f487d59a700 1 -- 172.21.15.62:0/2698413013 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48700103c0 con 0x7f4880071310 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.889+0000 7f4884d2c700 1 -- 172.21.15.62:0/2698413013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 msgr2=0x7f4880105430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.889+0000 7f4884d2c700 1 --2- 172.21.15.62:0/2698413013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880105430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48700098e0 tx=0x7f4870009250 comp rx=0 tx=0).stop 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.889+0000 7f4884d2c700 1 -- 172.21.15.62:0/2698413013 shutdown_connections 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.889+0000 7f4884d2c700 1 --2- 172.21.15.62:0/2698413013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880105430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.889+0000 7f4884d2c700 1 -- 172.21.15.62:0/2698413013 >> 172.21.15.62:0/2698413013 conn(0x7f48800fcea0 msgr2=0x7f48800ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.889+0000 7f4884d2c700 1 -- 172.21.15.62:0/2698413013 shutdown_connections 2024-05-09T06:20:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.889+0000 7f4884d2c700 1 -- 172.21.15.62:0/2698413013 wait complete. 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.890+0000 7f4884d2c700 1 Processor -- start 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.890+0000 7f4884d2c700 1 -- start start 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.890+0000 7f4884d2c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.890+0000 7f4884d2c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4880111b80 con 0x7f4880071310 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.890+0000 7f487e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880111640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.890+0000 7f487e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880111640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53248/0 (socket says 172.21.15.62:53248) 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.890+0000 7f487e59c700 1 -- 172.21.15.62:0/1651534230 learned_addr learned my addr 172.21.15.62:0/1651534230 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.891+0000 7f487e59c700 1 -- 172.21.15.62:0/1651534230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700094f0 con 0x7f4880071310 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.891+0000 7f487e59c700 1 --2- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880111640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f48700094c0 tx=0x7f4870009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.891+0000 7f486effd700 1 -- 172.21.15.62:0/1651534230 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4870010890 con 0x7f4880071310 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.891+0000 7f486effd700 1 -- 172.21.15.62:0/1651534230 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4870010ec0 con 0x7f4880071310 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.891+0000 7f486effd700 1 -- 172.21.15.62:0/1651534230 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48700243f0 con 0x7f4880071310 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.891+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4880111d80 con 0x7f4880071310 2024-05-09T06:20:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.891+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48801128f0 con 0x7f4880071310 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.892+0000 7f486effd700 1 -- 172.21.15.62:0/1651534230 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f487002d3f0 con 0x7f4880071310 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.892+0000 7f486effd700 1 --2- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4868036850 0x7f4868038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.892+0000 7f486effd700 1 -- 172.21.15.62:0/1651534230 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f487004a2a0 con 0x7f4880071310 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.892+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488005f5c0 con 0x7f4880071310 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.892+0000 7f487dd9b700 1 --2- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4868036850 0x7f4868038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.893+0000 7f487dd9b700 1 --2- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4868036850 0x7f4868038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4874009990 tx=0x7f4874006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:44.901+0000 7f486effd700 1 -- 172.21.15.62:0/1651534230 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f487002b8e0 con 0x7f4880071310 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.120+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f48800fe140 con 0x7f4868036850 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.124+0000 7f486effd700 1 -- 172.21.15.62:0/1651534230 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f48800fe140 con 0x7f4868036850 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4868036850 msgr2=0x7f4868038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 --2- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4868036850 0x7f4868038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4874009990 tx=0x7f4874006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 msgr2=0x7f4880111640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 --2- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880111640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f48700094c0 tx=0x7f4870009250 comp rx=0 tx=0).stop 2024-05-09T06:20:45.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 shutdown_connections 2024-05-09T06:20:45.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 --2- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f4868036850 0x7f4868038d00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:45.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 --2- 172.21.15.62:0/1651534230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4880071310 0x7f4880111640 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:45.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 >> 172.21.15.62:0/1651534230 conn(0x7f48800fcea0 msgr2=0x7f48800fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:45.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 shutdown_connections 2024-05-09T06:20:45.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.127+0000 7f4884d2c700 1 -- 172.21.15.62:0/1651534230 wait complete. 2024-05-09T06:20:45.851 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying grafana service with default placement... 2024-05-09T06:20:46.146 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:45 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:46.146 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:45 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:47.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:46 smithi062 ceph-mon[26920]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:47.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:46 smithi062 ceph-mon[26920]: Saving service prometheus spec with placement count:1 2024-05-09T06:20:47.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:46 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.275+0000 7f9c647a9700 1 Processor -- start 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.275+0000 7f9c647a9700 1 -- start start 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.275+0000 7f9c647a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c102c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.275+0000 7f9c647a9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c103160 con 0x7f9c5c102810 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.275+0000 7f9c62545700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.275+0000 7f9c62545700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53250/0 (socket says 172.21.15.62:53250) 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.275+0000 7f9c62545700 1 -- 172.21.15.62:0/88071313 learned_addr learned my addr 172.21.15.62:0/88071313 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.275+0000 7f9c62545700 1 -- 172.21.15.62:0/88071313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c1032a0 con 0x7f9c5c102810 2024-05-09T06:20:47.354 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.276+0000 7f9c62545700 1 --2- 172.21.15.62:0/88071313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c102c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c500098e0 tx=0x7f9c50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8920892b4a85a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.276+0000 7f9c61543700 1 -- 172.21.15.62:0/88071313 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c5000b860 con 0x7f9c5c102810 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.276+0000 7f9c61543700 1 -- 172.21.15.62:0/88071313 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c5000be90 con 0x7f9c5c102810 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.276+0000 7f9c61543700 1 -- 172.21.15.62:0/88071313 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c500103c0 con 0x7f9c5c102810 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.276+0000 7f9c647a9700 1 -- 172.21.15.62:0/88071313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 msgr2=0x7f9c5c102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.276+0000 7f9c647a9700 1 --2- 172.21.15.62:0/88071313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c102c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c500098e0 tx=0x7f9c50009250 comp rx=0 tx=0).stop 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 -- 172.21.15.62:0/88071313 shutdown_connections 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 --2- 172.21.15.62:0/88071313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c102c20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 -- 172.21.15.62:0/88071313 >> 172.21.15.62:0/88071313 conn(0x7f9c5c0fdfd0 msgr2=0x7f9c5c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 -- 172.21.15.62:0/88071313 shutdown_connections 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 -- 172.21.15.62:0/88071313 wait complete. 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 Processor -- start 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 -- start start 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c1116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:47.355 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c647a9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c111c00 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c62545700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c1116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c62545700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c1116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53258/0 (socket says 172.21.15.62:53258) 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.277+0000 7f9c62545700 1 -- 172.21.15.62:0/3320583883 learned_addr learned my addr 172.21.15.62:0/3320583883 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.278+0000 7f9c62545700 1 -- 172.21.15.62:0/3320583883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500094f0 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.278+0000 7f9c62545700 1 --2- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c1116c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c50011c10 tx=0x7f9c50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.278+0000 7f9c4effd700 1 -- 172.21.15.62:0/3320583883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c50010890 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.278+0000 7f9c4effd700 1 -- 172.21.15.62:0/3320583883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c50010ec0 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.278+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c111e00 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.278+0000 7f9c4effd700 1 -- 172.21.15.62:0/3320583883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c500243f0 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.278+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c112970 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.279+0000 7f9c4effd700 1 -- 172.21.15.62:0/3320583883 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f9c5002d3f0 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.279+0000 7f9c4effd700 1 --2- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f9c480368a0 0x7f9c48038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.279+0000 7f9c4effd700 1 -- 172.21.15.62:0/3320583883 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9c5004a250 con 0x7f9c5c102810 2024-05-09T06:20:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.279+0000 7f9c61d44700 1 --2- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f9c480368a0 0x7f9c48038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.279+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c05f5c0 con 0x7f9c5c102810 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.280+0000 7f9c61d44700 1 --2- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f9c480368a0 0x7f9c48038d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009990 tx=0x7f9c58006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.284+0000 7f9c4effd700 1 -- 172.21.15.62:0/3320583883 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9c5002b8e0 con 0x7f9c5c102810 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.500+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c5c0ff230 con 0x7f9c480368a0 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.505+0000 7f9c4effd700 1 -- 172.21.15.62:0/3320583883 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f9c5c0ff230 con 0x7f9c480368a0 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f9c480368a0 msgr2=0x7f9c48038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 --2- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f9c480368a0 0x7f9c48038d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009990 tx=0x7f9c58006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 msgr2=0x7f9c5c1116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 --2- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c1116c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c50011c10 tx=0x7f9c50009250 comp rx=0 tx=0).stop 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 shutdown_connections 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 --2- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f9c480368a0 0x7f9c48038d50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 --2- 172.21.15.62:0/3320583883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c5c102810 0x7f9c5c1116c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 >> 172.21.15.62:0/3320583883 conn(0x7f9c5c0fdfd0 msgr2=0x7f9c5c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 shutdown_connections 2024-05-09T06:20:47.357 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:46.507+0000 7f9c647a9700 1 -- 172.21.15.62:0/3320583883 wait complete. 2024-05-09T06:20:47.358 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying node-exporter service with default placement... 2024-05-09T06:20:48.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:47 smithi062 ceph-mon[26920]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:48.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:47 smithi062 ceph-mon[26920]: Saving service grafana spec with placement count:1 2024-05-09T06:20:48.666 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.767+0000 7f030c0f1700 1 Processor -- start 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.768+0000 7f030c0f1700 1 -- start start 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.768+0000 7f030c0f1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304105490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.768+0000 7f030c0f1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03041059d0 con 0x7f03040712b0 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.768+0000 7f0309e8d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304105490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.768+0000 7f0309e8d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304105490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53266/0 (socket says 172.21.15.62:53266) 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.768+0000 7f0309e8d700 1 -- 172.21.15.62:0/3283164672 learned_addr learned my addr 172.21.15.62:0/3283164672 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.768+0000 7f0309e8d700 1 -- 172.21.15.62:0/3283164672 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304105b10 con 0x7f03040712b0 2024-05-09T06:20:48.672 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f0309e8d700 1 --2- 172.21.15.62:0/3283164672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304105490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03000098e0 tx=0x7f0300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799d67e6b3ad02c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f0308e8b700 1 -- 172.21.15.62:0/3283164672 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f030000b860 con 0x7f03040712b0 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f0308e8b700 1 -- 172.21.15.62:0/3283164672 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f030000be90 con 0x7f03040712b0 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f0308e8b700 1 -- 172.21.15.62:0/3283164672 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03000103c0 con 0x7f03040712b0 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f030c0f1700 1 -- 172.21.15.62:0/3283164672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 msgr2=0x7f0304105490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f030c0f1700 1 --2- 172.21.15.62:0/3283164672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304105490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03000098e0 tx=0x7f0300009250 comp rx=0 tx=0).stop 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f030c0f1700 1 -- 172.21.15.62:0/3283164672 shutdown_connections 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f030c0f1700 1 --2- 172.21.15.62:0/3283164672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304105490 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.769+0000 7f030c0f1700 1 -- 172.21.15.62:0/3283164672 >> 172.21.15.62:0/3283164672 conn(0x7f03040fcea0 msgr2=0x7f03040ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.770+0000 7f030c0f1700 1 -- 172.21.15.62:0/3283164672 shutdown_connections 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.770+0000 7f030c0f1700 1 -- 172.21.15.62:0/3283164672 wait complete. 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.770+0000 7f030c0f1700 1 Processor -- start 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.770+0000 7f030c0f1700 1 -- start start 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f030c0f1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:48.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f030c0f1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0304111b80 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f0309e8d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304111640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f0309e8d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304111640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53272/0 (socket says 172.21.15.62:53272) 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f0309e8d700 1 -- 172.21.15.62:0/2780346962 learned_addr learned my addr 172.21.15.62:0/2780346962 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f0309e8d700 1 -- 172.21.15.62:0/2780346962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000094f0 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f0309e8d700 1 --2- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304111640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03000094c0 tx=0x7f0300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f02fa7fc700 1 -- 172.21.15.62:0/2780346962 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0300010890 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f02fa7fc700 1 -- 172.21.15.62:0/2780346962 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0300010ec0 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f02fa7fc700 1 -- 172.21.15.62:0/2780346962 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03000243f0 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.771+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0304111d80 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.772+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03041128f0 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.772+0000 7f02fa7fc700 1 -- 172.21.15.62:0/2780346962 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f03000109f0 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.773+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030405f5c0 con 0x7f03040712b0 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.773+0000 7f02fa7fc700 1 --2- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f02f00368a0 0x7f02f0038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:48.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.773+0000 7f02fa7fc700 1 -- 172.21.15.62:0/2780346962 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f030004a230 con 0x7f03040712b0 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.773+0000 7f030968c700 1 --2- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f02f00368a0 0x7f02f0038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.773+0000 7f030968c700 1 --2- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f02f00368a0 0x7f02f0038d50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009990 tx=0x7f02f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.778+0000 7f02fa7fc700 1 -- 172.21.15.62:0/2780346962 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f030002b4d0 con 0x7f03040712b0 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.987+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f03040fe120 con 0x7f02f00368a0 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.992+0000 7f02fa7fc700 1 -- 172.21.15.62:0/2780346962 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f03040fe120 con 0x7f02f00368a0 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f02f00368a0 msgr2=0x7f02f0038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 --2- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f02f00368a0 0x7f02f0038d50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009990 tx=0x7f02f4006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 msgr2=0x7f0304111640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 --2- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304111640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03000094c0 tx=0x7f0300009250 comp rx=0 tx=0).stop 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 shutdown_connections 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 --2- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f02f00368a0 0x7f02f0038d50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 --2- 172.21.15.62:0/2780346962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03040712b0 0x7f0304111640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 >> 172.21.15.62:0/2780346962 conn(0x7f03040fcea0 msgr2=0x7f03040fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.994+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 shutdown_connections 2024-05-09T06:20:48.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:47.995+0000 7f030c0f1700 1 -- 172.21.15.62:0/2780346962 wait complete. 2024-05-09T06:20:48.676 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying alertmanager service with default placement... 2024-05-09T06:20:49.092 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:48 smithi062 ceph-mon[26920]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:49.092 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:48 smithi062 ceph-mon[26920]: Saving service node-exporter spec with placement * 2024-05-09T06:20:49.093 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:48 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:49.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-05-09T06:20:49.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.126+0000 7f6131b01700 1 Processor -- start 2024-05-09T06:20:49.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.126+0000 7f6131b01700 1 -- start start 2024-05-09T06:20:49.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.126+0000 7f6131b01700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c101b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:49.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.126+0000 7f6131b01700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1020a0 con 0x7f612c101750 2024-05-09T06:20:49.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.126+0000 7f612b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:49.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.126+0000 7f612b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c101b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53282/0 (socket says 172.21.15.62:53282) 2024-05-09T06:20:49.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.126+0000 7f612b7fe700 1 -- 172.21.15.62:0/969552907 learned_addr learned my addr 172.21.15.62:0/969552907 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.127+0000 7f612b7fe700 1 -- 172.21.15.62:0/969552907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c1021e0 con 0x7f612c101750 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.127+0000 7f612b7fe700 1 --2- 172.21.15.62:0/969552907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c101b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61140098e0 tx=0x7f6114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468f8bd9da100858 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.127+0000 7f612a7fc700 1 -- 172.21.15.62:0/969552907 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f611400b860 con 0x7f612c101750 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.127+0000 7f612a7fc700 1 -- 172.21.15.62:0/969552907 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f611400be90 con 0x7f612c101750 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.127+0000 7f612a7fc700 1 -- 172.21.15.62:0/969552907 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61140103c0 con 0x7f612c101750 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.127+0000 7f6131b01700 1 -- 172.21.15.62:0/969552907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 msgr2=0x7f612c101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.127+0000 7f6131b01700 1 --2- 172.21.15.62:0/969552907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c101b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61140098e0 tx=0x7f6114009250 comp rx=0 tx=0).stop 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.128+0000 7f6131b01700 1 -- 172.21.15.62:0/969552907 shutdown_connections 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.128+0000 7f6131b01700 1 --2- 172.21.15.62:0/969552907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c101b60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.128+0000 7f6131b01700 1 -- 172.21.15.62:0/969552907 >> 172.21.15.62:0/969552907 conn(0x7f612c0fcef0 msgr2=0x7f612c0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.128+0000 7f6131b01700 1 -- 172.21.15.62:0/969552907 shutdown_connections 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.128+0000 7f6131b01700 1 -- 172.21.15.62:0/969552907 wait complete. 2024-05-09T06:20:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.128+0000 7f6131b01700 1 Processor -- start 2024-05-09T06:20:49.907 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.128+0000 7f6131b01700 1 -- start start 2024-05-09T06:20:49.907 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.128+0000 7f6131b01700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c107a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:49.907 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f6131b01700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c107f50 con 0x7f612c101750 2024-05-09T06:20:49.907 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f612b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c107a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:49.907 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f612b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c107a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53292/0 (socket says 172.21.15.62:53292) 2024-05-09T06:20:49.907 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f612b7fe700 1 -- 172.21.15.62:0/836721549 learned_addr learned my addr 172.21.15.62:0/836721549 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:49.907 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f612b7fe700 1 -- 172.21.15.62:0/836721549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140094f0 con 0x7f612c101750 2024-05-09T06:20:49.907 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f612b7fe700 1 --2- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c107a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6114011680 tx=0x7f6114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f6123fff700 1 -- 172.21.15.62:0/836721549 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6114010890 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c105fc0 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f6123fff700 1 -- 172.21.15.62:0/836721549 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6114010ec0 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f6123fff700 1 -- 172.21.15.62:0/836721549 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61140243f0 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.129+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c1064b0 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.130+0000 7f6123fff700 1 -- 172.21.15.62:0/836721549 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f611402d3f0 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.130+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c04bed0 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.130+0000 7f6123fff700 1 --2- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6118036850 0x7f6118038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.130+0000 7f6123fff700 1 -- 172.21.15.62:0/836721549 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f611404a450 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.130+0000 7f612affd700 1 --2- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6118036850 0x7f6118038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.131+0000 7f612affd700 1 --2- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6118036850 0x7f6118038d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f611c009990 tx=0x7f611c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.135+0000 7f6123fff700 1 -- 172.21.15.62:0/836721549 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f611402b8e0 con 0x7f612c101750 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.344+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f612c106c70 con 0x7f6118036850 2024-05-09T06:20:49.908 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.351+0000 7f6123fff700 1 -- 172.21.15.62:0/836721549 <== mgr.14120 v2:172.21.15.62:6800/942541084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f612c106c70 con 0x7f6118036850 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6118036850 msgr2=0x7f6118038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 --2- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6118036850 0x7f6118038d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f611c009990 tx=0x7f611c006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 msgr2=0x7f612c107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 --2- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c107a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6114011680 tx=0x7f6114009250 comp rx=0 tx=0).stop 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 shutdown_connections 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 --2- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f6118036850 0x7f6118038d00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 --2- 172.21.15.62:0/836721549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f612c101750 0x7f612c107a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 >> 172.21.15.62:0/836721549 conn(0x7f612c0fcef0 msgr2=0x7f612c0fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 shutdown_connections 2024-05-09T06:20:49.909 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:49.353+0000 7f6131b01700 1 -- 172.21.15.62:0/836721549 wait complete. 2024-05-09T06:20:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:50 smithi062 ceph-mon[26920]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:20:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:50 smithi062 ceph-mon[26920]: Saving service alertmanager spec with placement count:1 2024-05-09T06:20:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:50 smithi062 ceph-mon[26920]: from='mgr.14120 172.21.15.62:0/1366453683' entity='mgr.smithi062.juuasl' 2024-05-09T06:20:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:50 smithi062 ceph-mon[26920]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.362+0000 7fadac702700 1 Processor -- start 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.362+0000 7fadac702700 1 -- start start 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.362+0000 7fadac702700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.362+0000 7fadac702700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada4079090 con 0x7fada4078c80 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.362+0000 7fadaa49e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.362+0000 7fadaa49e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53296/0 (socket says 172.21.15.62:53296) 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.362+0000 7fadaa49e700 1 -- 172.21.15.62:0/153038876 learned_addr learned my addr 172.21.15.62:0/153038876 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.363+0000 7fadaa49e700 1 -- 172.21.15.62:0/153038876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada4077770 con 0x7fada4078c80 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.363+0000 7fadaa49e700 1 --2- 172.21.15.62:0/153038876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4077230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fada00098e0 tx=0x7fada0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884287936e9e0273 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:51.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.363+0000 7fada949c700 1 -- 172.21.15.62:0/153038876 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fada000b860 con 0x7fada4078c80 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.363+0000 7fada949c700 1 -- 172.21.15.62:0/153038876 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fada000be90 con 0x7fada4078c80 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.363+0000 7fada949c700 1 -- 172.21.15.62:0/153038876 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fada00103c0 con 0x7fada4078c80 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.363+0000 7fadac702700 1 -- 172.21.15.62:0/153038876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 msgr2=0x7fada4077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.363+0000 7fadac702700 1 --2- 172.21.15.62:0/153038876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4077230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fada00098e0 tx=0x7fada0009250 comp rx=0 tx=0).stop 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 -- 172.21.15.62:0/153038876 shutdown_connections 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 --2- 172.21.15.62:0/153038876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4077230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 -- 172.21.15.62:0/153038876 >> 172.21.15.62:0/153038876 conn(0x7fada40fe060 msgr2=0x7fada4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 -- 172.21.15.62:0/153038876 shutdown_connections 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 -- 172.21.15.62:0/153038876 wait complete. 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 Processor -- start 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 -- start start 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:51.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadac702700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada4113d90 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadaa49e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadaa49e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53304/0 (socket says 172.21.15.62:53304) 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.364+0000 7fadaa49e700 1 -- 172.21.15.62:0/1943577153 learned_addr learned my addr 172.21.15.62:0/1943577153 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.365+0000 7fadaa49e700 1 -- 172.21.15.62:0/1943577153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada00094f0 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.365+0000 7fadaa49e700 1 --2- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4113850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fada0006d40 tx=0x7fada0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.365+0000 7fad9affd700 1 -- 172.21.15.62:0/1943577153 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fada0010840 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.365+0000 7fad9affd700 1 -- 172.21.15.62:0/1943577153 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fada0010e70 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.365+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada4113f90 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.365+0000 7fad9affd700 1 -- 172.21.15.62:0/1943577153 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fada0024ea0 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.365+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada4114b00 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.366+0000 7fad9affd700 1 -- 172.21.15.62:0/1943577153 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fada0024780 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.366+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada405f5c0 con 0x7fada4078c80 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.366+0000 7fad9affd700 1 --2- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7fad90036850 0x7fad90038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.366+0000 7fad9affd700 1 -- 172.21.15.62:0/1943577153 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fada004a740 con 0x7fada4078c80 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.366+0000 7fada9c9d700 1 --2- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7fad90036850 0x7fad90038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.367+0000 7fada9c9d700 1 --2- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7fad90036850 0x7fad90038d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fad94009990 tx=0x7fad94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.371+0000 7fad9affd700 1 -- 172.21.15.62:0/1943577153 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fada002c910 con 0x7fada4078c80 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.564+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fada404bed0 con 0x7fada4078c80 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.569+0000 7fad9affd700 1 -- 172.21.15.62:0/1943577153 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fada002c340 con 0x7fada4078c80 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7fad90036850 msgr2=0x7fad90038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 --2- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7fad90036850 0x7fad90038d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fad94009990 tx=0x7fad94006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 msgr2=0x7fada4113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 --2- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4113850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fada0006d40 tx=0x7fada0009250 comp rx=0 tx=0).stop 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 shutdown_connections 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 --2- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7fad90036850 0x7fad90038d00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 --2- 172.21.15.62:0/1943577153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fada4078c80 0x7fada4113850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 >> 172.21.15.62:0/1943577153 conn(0x7fada40fe060 msgr2=0x7fada40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:51.098 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 shutdown_connections 2024-05-09T06:20:51.098 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:50.572+0000 7fadac702700 1 -- 172.21.15.62:0/1943577153 wait complete. 2024-05-09T06:20:51.778 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:51 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1943577153' entity='client.admin' 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.566+0000 7f7bf0b8b700 1 Processor -- start 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.566+0000 7f7bf0b8b700 1 -- start start 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.566+0000 7f7bf0b8b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec107860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.566+0000 7f7bf0b8b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec103250 con 0x7f7bec076bd0 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.567+0000 7f7bea59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec107860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.567+0000 7f7bea59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec107860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53316/0 (socket says 172.21.15.62:53316) 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.567+0000 7f7bea59c700 1 -- 172.21.15.62:0/3097371002 learned_addr learned my addr 172.21.15.62:0/3097371002 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.567+0000 7f7bea59c700 1 -- 172.21.15.62:0/3097371002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec107da0 con 0x7f7bec076bd0 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.567+0000 7f7bea59c700 1 --2- 172.21.15.62:0/3097371002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec107860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7be40098e0 tx=0x7f7be4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f18bcbba5bb23e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.567+0000 7f7be959a700 1 -- 172.21.15.62:0/3097371002 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7be400b860 con 0x7f7bec076bd0 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.567+0000 7f7be959a700 1 -- 172.21.15.62:0/3097371002 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7be400be90 con 0x7f7bec076bd0 2024-05-09T06:20:52.284 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.567+0000 7f7be959a700 1 -- 172.21.15.62:0/3097371002 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7be40103c0 con 0x7f7bec076bd0 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.568+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/3097371002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 msgr2=0x7f7bec107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.568+0000 7f7bf0b8b700 1 --2- 172.21.15.62:0/3097371002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec107860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7be40098e0 tx=0x7f7be4009250 comp rx=0 tx=0).stop 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.568+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/3097371002 shutdown_connections 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.568+0000 7f7bf0b8b700 1 --2- 172.21.15.62:0/3097371002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec107860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.568+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/3097371002 >> 172.21.15.62:0/3097371002 conn(0x7f7bec0fce90 msgr2=0x7f7bec0ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.568+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/3097371002 shutdown_connections 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.568+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/3097371002 wait complete. 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.569+0000 7f7bf0b8b700 1 Processor -- start 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.569+0000 7f7bf0b8b700 1 -- start start 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.569+0000 7f7bf0b8b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.569+0000 7f7bf0b8b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec113d60 con 0x7f7bec076bd0 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.569+0000 7f7bea59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.569+0000 7f7bea59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53326/0 (socket says 172.21.15.62:53326) 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.569+0000 7f7bea59c700 1 -- 172.21.15.62:0/1410782824 learned_addr learned my addr 172.21.15.62:0/1410782824 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:52.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.570+0000 7f7bea59c700 1 -- 172.21.15.62:0/1410782824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40094f0 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.570+0000 7f7bea59c700 1 --2- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec113820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7be40094c0 tx=0x7f7be4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.570+0000 7f7be2ffd700 1 -- 172.21.15.62:0/1410782824 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7be4010890 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.570+0000 7f7be2ffd700 1 -- 172.21.15.62:0/1410782824 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7be4010ec0 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.570+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec113f60 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.570+0000 7f7be2ffd700 1 -- 172.21.15.62:0/1410782824 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7be40243f0 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.570+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec114ad0 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.571+0000 7f7be2ffd700 1 -- 172.21.15.62:0/1410782824 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f7be402d3f0 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.571+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec05f5c0 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.571+0000 7f7be2ffd700 1 --2- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f7bd80368a0 0x7f7bd8038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.571+0000 7f7be2ffd700 1 -- 172.21.15.62:0/1410782824 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7be404a3c0 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.571+0000 7f7be9d9b700 1 --2- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f7bd80368a0 0x7f7bd8038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.572+0000 7f7be9d9b700 1 --2- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f7bd80368a0 0x7f7bd8038d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009990 tx=0x7f7bd4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.577+0000 7f7be2ffd700 1 -- 172.21.15.62:0/1410782824 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7be4018ce0 con 0x7f7bec076bd0 2024-05-09T06:20:52.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.775+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f7bec04bed0 con 0x7f7bec076bd0 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.781+0000 7f7be2ffd700 1 -- 172.21.15.62:0/1410782824 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f7be4018b00 con 0x7f7bec076bd0 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f7bd80368a0 msgr2=0x7f7bd8038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 --2- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f7bd80368a0 0x7f7bd8038d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009990 tx=0x7f7bd4006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 msgr2=0x7f7bec113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 --2- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec113820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7be40094c0 tx=0x7f7be4009250 comp rx=0 tx=0).stop 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 shutdown_connections 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 --2- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f7bd80368a0 0x7f7bd8038d50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 --2- 172.21.15.62:0/1410782824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bec076bd0 0x7f7bec113820 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 >> 172.21.15.62:0/1410782824 conn(0x7f7bec0fce90 msgr2=0x7f7bec0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 shutdown_connections 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.784+0000 7f7bf0b8b700 1 -- 172.21.15.62:0/1410782824 wait complete. 2024-05-09T06:20:52.287 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling the dashboard module... 2024-05-09T06:20:52.958 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:52 smithi062 ceph-mon[26920]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:20:52.958 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:52 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1410782824' entity='client.admin' 2024-05-09T06:20:54.107 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:53 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/487394982' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-09T06:20:54.406 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.716+0000 7f1810d3a700 1 Processor -- start 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.717+0000 7f1810d3a700 1 -- start start 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.717+0000 7f1810d3a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.717+0000 7f1810d3a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c079090 con 0x7f180c078c80 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.717+0000 7f180a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.717+0000 7f180a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53340/0 (socket says 172.21.15.62:53340) 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.717+0000 7f180a59c700 1 -- 172.21.15.62:0/2579511678 learned_addr learned my addr 172.21.15.62:0/2579511678 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.717+0000 7f180a59c700 1 -- 172.21.15.62:0/2579511678 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c077770 con 0x7f180c078c80 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f180a59c700 1 --2- 172.21.15.62:0/2579511678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c077230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0098e0 tx=0x7f17fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f10c9967229531 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f180959a700 1 -- 172.21.15.62:0/2579511678 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17fc00b860 con 0x7f180c078c80 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f180959a700 1 -- 172.21.15.62:0/2579511678 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17fc00be90 con 0x7f180c078c80 2024-05-09T06:20:54.407 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f180959a700 1 -- 172.21.15.62:0/2579511678 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17fc0103c0 con 0x7f180c078c80 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f1810d3a700 1 -- 172.21.15.62:0/2579511678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 msgr2=0x7f180c077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f1810d3a700 1 --2- 172.21.15.62:0/2579511678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c077230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0098e0 tx=0x7f17fc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f1810d3a700 1 -- 172.21.15.62:0/2579511678 shutdown_connections 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f1810d3a700 1 --2- 172.21.15.62:0/2579511678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c077230 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f1810d3a700 1 -- 172.21.15.62:0/2579511678 >> 172.21.15.62:0/2579511678 conn(0x7f180c0fe060 msgr2=0x7f180c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f1810d3a700 1 -- 172.21.15.62:0/2579511678 shutdown_connections 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.718+0000 7f1810d3a700 1 -- 172.21.15.62:0/2579511678 wait complete. 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.719+0000 7f1810d3a700 1 Processor -- start 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.719+0000 7f1810d3a700 1 -- start start 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.719+0000 7f1810d3a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.719+0000 7f1810d3a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c113d90 con 0x7f180c078c80 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.719+0000 7f180a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.719+0000 7f180a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53342/0 (socket says 172.21.15.62:53342) 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.719+0000 7f180a59c700 1 -- 172.21.15.62:0/487394982 learned_addr learned my addr 172.21.15.62:0/487394982 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:54.408 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.720+0000 7f180a59c700 1 -- 172.21.15.62:0/487394982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc0094f0 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.720+0000 7f180a59c700 1 --2- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c113850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17fc006d40 tx=0x7f17fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.720+0000 7f17faffd700 1 -- 172.21.15.62:0/487394982 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17fc010840 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.720+0000 7f17faffd700 1 -- 172.21.15.62:0/487394982 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17fc010e70 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.720+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c113f90 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.720+0000 7f17faffd700 1 -- 172.21.15.62:0/487394982 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17fc024ea0 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.720+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c114b00 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.721+0000 7f17faffd700 1 -- 172.21.15.62:0/487394982 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f17fc01a4c0 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.721+0000 7f17faffd700 1 --2- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f17f4036850 0x7f17f4038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.721+0000 7f17faffd700 1 -- 172.21.15.62:0/487394982 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f17fc04a6a0 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.721+0000 7f1809d9b700 1 --2- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f17f4036850 0x7f17f4038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.721+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c05f5c0 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.722+0000 7f1809d9b700 1 --2- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f17f4036850 0x7f17f4038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1800009990 tx=0x7f1800006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.726+0000 7f17faffd700 1 -- 172.21.15.62:0/487394982 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f17fc018940 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:52.976+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f180c114d40 con 0x7f180c078c80 2024-05-09T06:20:54.409 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.788+0000 7f17faffd700 1 -- 172.21.15.62:0/487394982 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f17fc024780 con 0x7f180c078c80 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.790+0000 7f17faffd700 1 -- 172.21.15.62:0/487394982 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f17fc00f6a0 con 0x7f180c078c80 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f17f4036850 msgr2=0x7f17f4038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 --2- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f17f4036850 0x7f17f4038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1800009990 tx=0x7f1800006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 msgr2=0x7f180c113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 --2- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c113850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17fc006d40 tx=0x7f17fc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 shutdown_connections 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 --2- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f17f4036850 0x7f17f4038d00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 --2- 172.21.15.62:0/487394982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f180c078c80 0x7f180c113850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 >> 172.21.15.62:0/487394982 conn(0x7f180c0fe060 msgr2=0x7f180c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 shutdown_connections 2024-05-09T06:20:54.410 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:53.793+0000 7f1810d3a700 1 -- 172.21.15.62:0/487394982 wait complete. 2024-05-09T06:20:55.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:54 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/487394982' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-09T06:20:55.079 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:54 smithi062 ceph-mon[26920]: mgrmap e9: smithi062.juuasl(active, since 24s) 2024-05-09T06:20:55.739 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:55.739 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-09T06:20:55.739 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T06:20:55.739 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "active_name": "smithi062.juuasl", 2024-05-09T06:20:55.739 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-09T06:20:55.739 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:55.739 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.888+0000 7f261d9e4700 1 Processor -- start 2024-05-09T06:20:55.739 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.889+0000 7f261d9e4700 1 -- start start 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.889+0000 7f261d9e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618105460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.889+0000 7f261d9e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26181059a0 con 0x7f2618076bf0 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.889+0000 7f2616ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618105460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.889+0000 7f2616ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618105460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51884/0 (socket says 172.21.15.62:51884) 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.889+0000 7f2616ffd700 1 -- 172.21.15.62:0/375382103 learned_addr learned my addr 172.21.15.62:0/375382103 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.889+0000 7f2616ffd700 1 -- 172.21.15.62:0/375382103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618105ae0 con 0x7f2618076bf0 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f2616ffd700 1 --2- 172.21.15.62:0/375382103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618105460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26080098e0 tx=0x7f2608009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c6027a7683c7fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f2615ffb700 1 -- 172.21.15.62:0/375382103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f260800b860 con 0x7f2618076bf0 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f2615ffb700 1 -- 172.21.15.62:0/375382103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f260800be90 con 0x7f2618076bf0 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f2615ffb700 1 -- 172.21.15.62:0/375382103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26080103c0 con 0x7f2618076bf0 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f261d9e4700 1 -- 172.21.15.62:0/375382103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 msgr2=0x7f2618105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f261d9e4700 1 --2- 172.21.15.62:0/375382103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618105460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26080098e0 tx=0x7f2608009250 comp rx=0 tx=0).stop 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f261d9e4700 1 -- 172.21.15.62:0/375382103 shutdown_connections 2024-05-09T06:20:55.740 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f261d9e4700 1 --2- 172.21.15.62:0/375382103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618105460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f261d9e4700 1 -- 172.21.15.62:0/375382103 >> 172.21.15.62:0/375382103 conn(0x7f26180fcef0 msgr2=0x7f26180ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.890+0000 7f261d9e4700 1 -- 172.21.15.62:0/375382103 shutdown_connections 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.891+0000 7f261d9e4700 1 -- 172.21.15.62:0/375382103 wait complete. 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.891+0000 7f261d9e4700 1 Processor -- start 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.891+0000 7f261d9e4700 1 -- start start 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.892+0000 7f261d9e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.892+0000 7f261d9e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2618111b80 con 0x7f2618076bf0 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.892+0000 7f2616ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618111640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.892+0000 7f2616ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618111640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51896/0 (socket says 172.21.15.62:51896) 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.892+0000 7f2616ffd700 1 -- 172.21.15.62:0/2422273141 learned_addr learned my addr 172.21.15.62:0/2422273141 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.892+0000 7f2616ffd700 1 -- 172.21.15.62:0/2422273141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080094f0 con 0x7f2618076bf0 2024-05-09T06:20:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.892+0000 7f2616ffd700 1 --2- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618111640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26080094c0 tx=0x7f2608009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.892+0000 7f25ff7fe700 1 -- 172.21.15.62:0/2422273141 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2608010890 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.893+0000 7f25ff7fe700 1 -- 172.21.15.62:0/2422273141 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2608010ec0 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.893+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2618111d80 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.893+0000 7f25ff7fe700 1 -- 172.21.15.62:0/2422273141 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26080243f0 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.893+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26181128f0 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.893+0000 7f25ff7fe700 1 -- 172.21.15.62:0/2422273141 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f260802d3f0 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.893+0000 7f25ff7fe700 1 --2- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f26000368a0 0x7f2600038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.893+0000 7f25ff7fe700 1 -- 172.21.15.62:0/2422273141 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f260804b330 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.894+0000 7f26167fc700 1 -- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f26000368a0 msgr2=0x7f2600038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/942541084 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.894+0000 7f26167fc700 1 --2- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f26000368a0 0x7f2600038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.894+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261805f5c0 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.898+0000 7f25ff7fe700 1 -- 172.21.15.62:0/2422273141 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f260802b8e0 con 0x7f2618076bf0 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.095+0000 7f26167fc700 1 -- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f26000368a0 msgr2=0x7f2600038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/942541084 2024-05-09T06:20:55.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.095+0000 7f26167fc700 1 --2- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f26000368a0 0x7f2600038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.195+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f2618112b30 con 0x7f2618076bf0 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.195+0000 7f25ff7fe700 1 -- 172.21.15.62:0/2422273141 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f260802b2f0 con 0x7f2618076bf0 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f26000368a0 msgr2=0x7f2600038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 --2- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f26000368a0 0x7f2600038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 msgr2=0x7f2618111640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 --2- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618111640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26080094c0 tx=0x7f2608009250 comp rx=0 tx=0).stop 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 shutdown_connections 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 --2- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f26000368a0 0x7f2600038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 --2- 172.21.15.62:0/2422273141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2618076bf0 0x7f2618111640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 >> 172.21.15.62:0/2422273141 conn(0x7f26180fcef0 msgr2=0x7f26180fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 shutdown_connections 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.198+0000 7f261d9e4700 1 -- 172.21.15.62:0/2422273141 wait complete. 2024-05-09T06:20:55.743 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for the mgr to restart... 2024-05-09T06:20:55.744 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr epoch 9... 2024-05-09T06:20:56.024 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:20:55 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2422273141' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-09T06:21:00.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: Active manager daemon smithi062.juuasl restarted 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: Activating manager daemon smithi062.juuasl 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: osdmap e3: 0 total, 0 up, 0 in 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: mgrmap e10: smithi062.juuasl(active, starting, since 0.00311856s) 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: Manager daemon smithi062.juuasl is now available 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:21:00.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:00 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/trash_purge_schedule"}]: dispatch 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac963b700 1 Processor -- start 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac963b700 1 -- start start 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac963b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4104300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac963b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4070d90 con 0x7f3ac4103ef0 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4104300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:02.263 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4104300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51912/0 (socket says 172.21.15.62:51912) 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac2ffd700 1 -- 172.21.15.62:0/1331623076 learned_addr learned my addr 172.21.15.62:0/1331623076 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac2ffd700 1 -- 172.21.15.62:0/1331623076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac4104840 con 0x7f3ac4103ef0 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.222+0000 7f3ac2ffd700 1 --2- 172.21.15.62:0/1331623076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4104300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40098e0 tx=0x7f3ab4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd5aeb34c2c25c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac1ffb700 1 -- 172.21.15.62:0/1331623076 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ab400b860 con 0x7f3ac4103ef0 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac1ffb700 1 -- 172.21.15.62:0/1331623076 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ab400be90 con 0x7f3ac4103ef0 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac1ffb700 1 -- 172.21.15.62:0/1331623076 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ab40103c0 con 0x7f3ac4103ef0 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac963b700 1 -- 172.21.15.62:0/1331623076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 msgr2=0x7f3ac4104300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac963b700 1 --2- 172.21.15.62:0/1331623076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4104300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40098e0 tx=0x7f3ab4009250 comp rx=0 tx=0).stop 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac963b700 1 -- 172.21.15.62:0/1331623076 shutdown_connections 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac963b700 1 --2- 172.21.15.62:0/1331623076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4104300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac963b700 1 -- 172.21.15.62:0/1331623076 >> 172.21.15.62:0/1331623076 conn(0x7f3ac40fc6f0 msgr2=0x7f3ac40feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac963b700 1 -- 172.21.15.62:0/1331623076 shutdown_connections 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.223+0000 7f3ac963b700 1 -- 172.21.15.62:0/1331623076 wait complete. 2024-05-09T06:21:02.264 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.224+0000 7f3ac963b700 1 Processor -- start 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.224+0000 7f3ac963b700 1 -- start start 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.224+0000 7f3ac963b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4103600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.224+0000 7f3ac963b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4103b40 con 0x7f3ac4103ef0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3ac2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4103600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3ac2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4103600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51914/0 (socket says 172.21.15.62:51914) 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3ac2ffd700 1 -- 172.21.15.62:0/1872843198 learned_addr learned my addr 172.21.15.62:0/1872843198 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3ac2ffd700 1 -- 172.21.15.62:0/1872843198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab40094f0 con 0x7f3ac4103ef0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3ac2ffd700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4103600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4011680 tx=0x7f3ab4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ab4010890 con 0x7f3ac4103ef0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ab4010ec0 con 0x7f3ac4103ef0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac4101bb0 con 0x7f3ac4103ef0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ab40243f0 con 0x7f3ac4103ef0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.225+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac41020a0 con 0x7f3ac4103ef0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.226+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f3ab402d3f0 con 0x7f3ac4103ef0 2024-05-09T06:21:02.265 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.227+0000 7f3aab7fe700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 0x7f3aac038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.227+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 --> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3aac039460 con 0x7f3aac0368a0 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.227+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3ab404a500 con 0x7f3ac4103ef0 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.227+0000 7f3ac27fc700 1 -- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 msgr2=0x7f3aac038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/942541084 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.227+0000 7f3ac27fc700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 0x7f3aac038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.428+0000 7f3ac27fc700 1 -- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 msgr2=0x7f3aac038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/942541084 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.428+0000 7f3ac27fc700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 0x7f3aac038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.829+0000 7f3ac27fc700 1 -- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 msgr2=0x7f3aac038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/942541084 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.829+0000 7f3ac27fc700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 0x7f3aac038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.630+0000 7f3ac27fc700 1 -- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 msgr2=0x7f3aac038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/942541084 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.630+0000 7f3ac27fc700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 0x7f3aac038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.231+0000 7f3ac27fc700 1 -- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 msgr2=0x7f3aac038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/942541084 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.231+0000 7f3ac27fc700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 0x7f3aac038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:00.611+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7f3ab402d740 con 0x7f3ac4103ef0 2024-05-09T06:21:02.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:00.611+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 msgr2=0x7f3aac038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:00.611+0000 7f3aab7fe700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 0x7f3aac038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.613+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7f3ab401a8c0 con 0x7f3ac4103ef0 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.613+0000 7f3aab7fe700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3aac03a090 0x7f3aac03c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.613+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 --> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3aac039460 con 0x7f3aac03a090 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.614+0000 7f3ac27fc700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3aac03a090 0x7f3aac03c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.614+0000 7f3ac27fc700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3aac03a090 0x7f3aac03c470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80039d0 tx=0x7f3ab80092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.615+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mgr.14162 v2:172.21.15.62:6800/2116890721 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f3aac039460 con 0x7f3aac03a090 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 --> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3ac404bed0 con 0x7f3aac03a090 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3aab7fe700 1 -- 172.21.15.62:0/1872843198 <== mgr.14162 v2:172.21.15.62:6800/2116890721 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f3ac404bed0 con 0x7f3aac03a090 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3aac03a090 msgr2=0x7f3aac03c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3aac03a090 0x7f3aac03c470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80039d0 tx=0x7f3ab80092f0 comp rx=0 tx=0).stop 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 msgr2=0x7f3ac4103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4103600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4011680 tx=0x7f3ab4009250 comp rx=0 tx=0).stop 2024-05-09T06:21:02.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 shutdown_connections 2024-05-09T06:21:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3aac03a090 0x7f3aac03c470 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ac4103ef0 0x7f3ac4103600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 --2- 172.21.15.62:0/1872843198 >> [v2:172.21.15.62:6800/942541084,v1:172.21.15.62:6801/942541084] conn(0x7f3aac0368a0 0x7f3aac038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.621+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 >> 172.21.15.62:0/1872843198 conn(0x7f3ac40fc6f0 msgr2=0x7f3ac40fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.622+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 shutdown_connections 2024-05-09T06:21:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:01.622+0000 7f3ac963b700 1 -- 172.21.15.62:0/1872843198 wait complete. 2024-05-09T06:21:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:mgr epoch 9 is available 2024-05-09T06:21:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:Generating a dashboard self-signed certificate... 2024-05-09T06:21:02.646 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:02 smithi062 ceph-mon[26920]: [09/May/2024:06:21:01] ENGINE Bus STARTING 2024-05-09T06:21:02.646 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:02 smithi062 ceph-mon[26920]: [09/May/2024:06:21:01] ENGINE Serving on https://172.21.15.62:7150 2024-05-09T06:21:02.646 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:02 smithi062 ceph-mon[26920]: [09/May/2024:06:21:01] ENGINE Bus STARTED 2024-05-09T06:21:02.646 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:02 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:02.646 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:02 smithi062 ceph-mon[26920]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-09T06:21:02.646 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:02 smithi062 ceph-mon[26920]: mgrmap e11: smithi062.juuasl(active, since 1.00639s) 2024-05-09T06:21:02.646 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:02 smithi062 ceph-mon[26920]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-09T06:21:02.646 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:02 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:03.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-09T06:21:03.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc26d271700 1 Processor -- start 2024-05-09T06:21:03.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc26d271700 1 -- start start 2024-05-09T06:21:03.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc26d271700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:03.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc26d271700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2681031d0 con 0x7fc268102880 2024-05-09T06:21:03.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51976/0 (socket says 172.21.15.62:51976) 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc266ffd700 1 -- 172.21.15.62:0/1332834798 learned_addr learned my addr 172.21.15.62:0/1332834798 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc266ffd700 1 -- 172.21.15.62:0/1332834798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268103310 con 0x7fc268102880 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.766+0000 7fc266ffd700 1 --2- 172.21.15.62:0/1332834798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268102c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc2580098e0 tx=0x7fc258009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8777d8797c9fdc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc265ffb700 1 -- 172.21.15.62:0/1332834798 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc25800b860 con 0x7fc268102880 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc265ffb700 1 -- 172.21.15.62:0/1332834798 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc25800be90 con 0x7fc268102880 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc265ffb700 1 -- 172.21.15.62:0/1332834798 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2580103c0 con 0x7fc268102880 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc26d271700 1 -- 172.21.15.62:0/1332834798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 msgr2=0x7fc268102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc26d271700 1 --2- 172.21.15.62:0/1332834798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268102c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc2580098e0 tx=0x7fc258009250 comp rx=0 tx=0).stop 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc26d271700 1 -- 172.21.15.62:0/1332834798 shutdown_connections 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc26d271700 1 --2- 172.21.15.62:0/1332834798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268102c90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc26d271700 1 -- 172.21.15.62:0/1332834798 >> 172.21.15.62:0/1332834798 conn(0x7fc2680fe060 msgr2=0x7fc268100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc26d271700 1 -- 172.21.15.62:0/1332834798 shutdown_connections 2024-05-09T06:21:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.767+0000 7fc26d271700 1 -- 172.21.15.62:0/1332834798 wait complete. 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.768+0000 7fc26d271700 1 Processor -- start 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.768+0000 7fc26d271700 1 -- start start 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.768+0000 7fc26d271700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.768+0000 7fc26d271700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc268111b60 con 0x7fc268102880 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.768+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.768+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51982/0 (socket says 172.21.15.62:51982) 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.768+0000 7fc266ffd700 1 -- 172.21.15.62:0/2999663135 learned_addr learned my addr 172.21.15.62:0/2999663135 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.769+0000 7fc266ffd700 1 -- 172.21.15.62:0/2999663135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2580094f0 con 0x7fc268102880 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.769+0000 7fc266ffd700 1 --2- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268111620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc258011680 tx=0x7fc258009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.769+0000 7fc24f7fe700 1 -- 172.21.15.62:0/2999663135 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc258010890 con 0x7fc268102880 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.769+0000 7fc24f7fe700 1 -- 172.21.15.62:0/2999663135 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc258010ec0 con 0x7fc268102880 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.769+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc268111d60 con 0x7fc268102880 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.769+0000 7fc24f7fe700 1 -- 172.21.15.62:0/2999663135 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2580243f0 con 0x7fc268102880 2024-05-09T06:21:03.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.769+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2681128d0 con 0x7fc268102880 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.770+0000 7fc24f7fe700 1 -- 172.21.15.62:0/2999663135 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fc25802d3f0 con 0x7fc268102880 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.770+0000 7fc24f7fe700 1 --2- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc2500367d0 0x7fc250038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.770+0000 7fc24f7fe700 1 -- 172.21.15.62:0/2999663135 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc25804a190 con 0x7fc268102880 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.770+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26805f5c0 con 0x7fc268102880 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.770+0000 7fc2667fc700 1 --2- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc2500367d0 0x7fc250038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.770+0000 7fc2667fc700 1 --2- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc2500367d0 0x7fc250038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009990 tx=0x7fc25c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.775+0000 7fc24f7fe700 1 -- 172.21.15.62:0/2999663135 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc25802b8e0 con 0x7fc268102880 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.009+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 --> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2680ff250 con 0x7fc2500367d0 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.076+0000 7fc24f7fe700 1 -- 172.21.15.62:0/2999663135 <== mgr.14162 v2:172.21.15.62:6800/2116890721 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc2680ff250 con 0x7fc2500367d0 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.078+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc2500367d0 msgr2=0x7fc250038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.078+0000 7fc26d271700 1 --2- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc2500367d0 0x7fc250038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009990 tx=0x7fc25c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.078+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 msgr2=0x7fc268111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.078+0000 7fc26d271700 1 --2- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268111620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc258011680 tx=0x7fc258009250 comp rx=0 tx=0).stop 2024-05-09T06:21:03.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.078+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 shutdown_connections 2024-05-09T06:21:03.636 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.078+0000 7fc26d271700 1 --2- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc2500367d0 0x7fc250038c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:03.636 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.078+0000 7fc26d271700 1 --2- 172.21.15.62:0/2999663135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc268102880 0x7fc268111620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:03.636 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.078+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 >> 172.21.15.62:0/2999663135 conn(0x7fc2680fe060 msgr2=0x7fc2680feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:03.636 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.079+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 shutdown_connections 2024-05-09T06:21:03.636 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:03.079+0000 7fc26d271700 1 -- 172.21.15.62:0/2999663135 wait complete. 2024-05-09T06:21:03.636 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial admin user... 2024-05-09T06:21:04.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:03 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:04.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:03 smithi062 ceph-mon[26920]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:04.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:03 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:04.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:03 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:04.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:03 smithi062 ceph-mon[26920]: mgrmap e12: smithi062.juuasl(active, since 2s) 2024-05-09T06:21:05.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$g/GUpMwPaxnR.jDlwpk3Fuyl0Q3JGe22vhxvWj4a7p6pEM2.X6q9a", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715235664, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-09T06:21:05.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.115+0000 7fe3ecf0c700 1 Processor -- start 2024-05-09T06:21:05.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.115+0000 7fe3ecf0c700 1 -- start start 2024-05-09T06:21:05.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.115+0000 7fe3ecf0c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:05.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.115+0000 7fe3ecf0c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8102090 con 0x7fe3e8101740 2024-05-09T06:21:05.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.116+0000 7fe3e659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.116+0000 7fe3e659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48936/0 (socket says 172.21.15.62:48936) 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.116+0000 7fe3e659c700 1 -- 172.21.15.62:0/3216391717 learned_addr learned my addr 172.21.15.62:0/3216391717 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.116+0000 7fe3e659c700 1 -- 172.21.15.62:0/3216391717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e81021d0 con 0x7fe3e8101740 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.116+0000 7fe3e659c700 1 --2- 172.21.15.62:0/3216391717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8101b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800bb80 tx=0x7fe3d800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41e46016e9574d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.116+0000 7fe3e559a700 1 -- 172.21.15.62:0/3216391717 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3d800dd00 con 0x7fe3e8101740 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.116+0000 7fe3e559a700 1 -- 172.21.15.62:0/3216391717 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3d800de60 con 0x7fe3e8101740 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.116+0000 7fe3e559a700 1 -- 172.21.15.62:0/3216391717 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3d8018920 con 0x7fe3e8101740 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/3216391717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 msgr2=0x7fe3e8101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 --2- 172.21.15.62:0/3216391717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8101b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800bb80 tx=0x7fe3d800b4f0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/3216391717 shutdown_connections 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 --2- 172.21.15.62:0/3216391717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8101b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/3216391717 >> 172.21.15.62:0/3216391717 conn(0x7fe3e80fcec0 msgr2=0x7fe3e80ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:05.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/3216391717 shutdown_connections 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/3216391717 wait complete. 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 Processor -- start 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.117+0000 7fe3ecf0c700 1 -- start start 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3ecf0c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3ecf0c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8113cc0 con 0x7fe3e8101740 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3e659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3e659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48940/0 (socket says 172.21.15.62:48940) 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3e659c700 1 -- 172.21.15.62:0/2877593462 learned_addr learned my addr 172.21.15.62:0/2877593462 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3e659c700 1 -- 172.21.15.62:0/2877593462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d800b790 con 0x7fe3e8101740 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3e659c700 1 --2- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8113780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80106a0 tx=0x7fe3d800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3deffd700 1 -- 172.21.15.62:0/2877593462 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3d8018e90 con 0x7fe3e8101740 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3deffd700 1 -- 172.21.15.62:0/2877593462 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3d8010c30 con 0x7fe3e8101740 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e8113ec0 con 0x7fe3e8101740 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3deffd700 1 -- 172.21.15.62:0/2877593462 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3d8021530 con 0x7fe3e8101740 2024-05-09T06:21:05.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.118+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e8114a30 con 0x7fe3e8101740 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.119+0000 7fe3deffd700 1 -- 172.21.15.62:0/2877593462 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fe3d8021720 con 0x7fe3e8101740 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.119+0000 7fe3deffd700 1 --2- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fe3d40368a0 0x7fe3d4038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.119+0000 7fe3deffd700 1 -- 172.21.15.62:0/2877593462 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe3d8014070 con 0x7fe3e8101740 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.119+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e805f5c0 con 0x7fe3e8101740 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.120+0000 7fe3e5d9b700 1 --2- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fe3d40368a0 0x7fe3d4038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.120+0000 7fe3e5d9b700 1 --2- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fe3d40368a0 0x7fe3d4038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009990 tx=0x7fe3d0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.124+0000 7fe3deffd700 1 -- 172.21.15.62:0/2877593462 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe3d8026030 con 0x7fe3e8101740 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.336+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 --> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe3e805f3b0 con 0x7fe3d40368a0 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.582+0000 7fe3deffd700 1 -- 172.21.15.62:0/2877593462 <== mgr.14162 v2:172.21.15.62:6800/2116890721 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fe3e805f3b0 con 0x7fe3d40368a0 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.584+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fe3d40368a0 msgr2=0x7fe3d4038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.584+0000 7fe3ecf0c700 1 --2- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fe3d40368a0 0x7fe3d4038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009990 tx=0x7fe3d0006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.585+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 msgr2=0x7fe3e8113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:05.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.585+0000 7fe3ecf0c700 1 --2- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8113780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80106a0 tx=0x7fe3d800b4f0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.585+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 shutdown_connections 2024-05-09T06:21:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.585+0000 7fe3ecf0c700 1 --2- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fe3d40368a0 0x7fe3d4038d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.585+0000 7fe3ecf0c700 1 --2- 172.21.15.62:0/2877593462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e8101740 0x7fe3e8113780 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.585+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 >> 172.21.15.62:0/2877593462 conn(0x7fe3e80fcec0 msgr2=0x7fe3e8105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.585+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 shutdown_connections 2024-05-09T06:21:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.585+0000 7fe3ecf0c700 1 -- 172.21.15.62:0/2877593462 wait complete. 2024-05-09T06:21:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:Fetching dashboard port number... 2024-05-09T06:21:05.762 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:05 smithi062 ceph-mon[26920]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:05.762 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:05 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:06.594 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:06 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2257387142' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-09T06:21:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 8443 2024-05-09T06:21:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.635+0000 7f7bd259f700 1 Processor -- start 2024-05-09T06:21:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.635+0000 7f7bd259f700 1 -- start start 2024-05-09T06:21:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.636+0000 7f7bd259f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.636+0000 7f7bd259f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc105960 con 0x7f7bcc076c10 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.636+0000 7f7bcbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.636+0000 7f7bcbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48948/0 (socket says 172.21.15.62:48948) 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.636+0000 7f7bcbfff700 1 -- 172.21.15.62:0/1383614662 learned_addr learned my addr 172.21.15.62:0/1383614662 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.636+0000 7f7bcbfff700 1 -- 172.21.15.62:0/1383614662 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc105aa0 con 0x7f7bcc076c10 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.636+0000 7f7bcbfff700 1 --2- 172.21.15.62:0/1383614662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc105420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0098e0 tx=0x7f7bbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee077d6ea397050 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bcb7fe700 1 -- 172.21.15.62:0/1383614662 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bbc00b860 con 0x7f7bcc076c10 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bcb7fe700 1 -- 172.21.15.62:0/1383614662 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bbc00be90 con 0x7f7bcc076c10 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bcb7fe700 1 -- 172.21.15.62:0/1383614662 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bbc0103c0 con 0x7f7bcc076c10 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bd259f700 1 -- 172.21.15.62:0/1383614662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 msgr2=0x7f7bcc105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bd259f700 1 --2- 172.21.15.62:0/1383614662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc105420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0098e0 tx=0x7f7bbc009250 comp rx=0 tx=0).stop 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bd259f700 1 -- 172.21.15.62:0/1383614662 shutdown_connections 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bd259f700 1 --2- 172.21.15.62:0/1383614662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc105420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:06.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bd259f700 1 -- 172.21.15.62:0/1383614662 >> 172.21.15.62:0/1383614662 conn(0x7f7bcc0fce90 msgr2=0x7f7bcc0ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bd259f700 1 -- 172.21.15.62:0/1383614662 shutdown_connections 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.637+0000 7f7bd259f700 1 -- 172.21.15.62:0/1383614662 wait complete. 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.638+0000 7f7bd259f700 1 Processor -- start 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.638+0000 7f7bd259f700 1 -- start start 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.638+0000 7f7bd259f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc1115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.638+0000 7f7bd259f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc111af0 con 0x7f7bcc076c10 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.638+0000 7f7bcbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc1115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.638+0000 7f7bcbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc1115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48956/0 (socket says 172.21.15.62:48956) 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.638+0000 7f7bcbfff700 1 -- 172.21.15.62:0/2257387142 learned_addr learned my addr 172.21.15.62:0/2257387142 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.639+0000 7f7bcbfff700 1 -- 172.21.15.62:0/2257387142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc0094f0 con 0x7f7bcc076c10 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.639+0000 7f7bcbfff700 1 --2- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc1115b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc006d40 tx=0x7f7bbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.639+0000 7f7bc97fa700 1 -- 172.21.15.62:0/2257387142 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bbc010840 con 0x7f7bcc076c10 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.639+0000 7f7bc97fa700 1 -- 172.21.15.62:0/2257387142 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bbc010e70 con 0x7f7bcc076c10 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.639+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc111d50 con 0x7f7bcc076c10 2024-05-09T06:21:06.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.639+0000 7f7bc97fa700 1 -- 172.21.15.62:0/2257387142 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bbc024ea0 con 0x7f7bcc076c10 2024-05-09T06:21:06.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.639+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc112860 con 0x7f7bcc076c10 2024-05-09T06:21:06.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.640+0000 7f7bc97fa700 1 -- 172.21.15.62:0/2257387142 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f7bbc024780 con 0x7f7bcc076c10 2024-05-09T06:21:06.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.640+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc05f5c0 con 0x7f7bcc076c10 2024-05-09T06:21:06.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.640+0000 7f7bc97fa700 1 --2- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7bb8036830 0x7f7bb8038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:06.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.640+0000 7f7bc97fa700 1 -- 172.21.15.62:0/2257387142 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7bbc04a7e0 con 0x7f7bcc076c10 2024-05-09T06:21:06.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.640+0000 7f7bc3fff700 1 --2- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7bb8036830 0x7f7bb8038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:06.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.641+0000 7f7bc3fff700 1 --2- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7bb8036830 0x7f7bb8038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009990 tx=0x7f7bb4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.645+0000 7f7bc97fa700 1 -- 172.21.15.62:0/2257387142 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7bbc02c930 con 0x7f7bcc076c10 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.895+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f7bcc04bed0 con 0x7f7bcc076c10 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.895+0000 7f7bc97fa700 1 -- 172.21.15.62:0/2257387142 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f7bbc02c340 con 0x7f7bcc076c10 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.897+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7bb8036830 msgr2=0x7f7bb8038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.897+0000 7f7bd259f700 1 --2- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7bb8036830 0x7f7bb8038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009990 tx=0x7f7bb4006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.897+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 msgr2=0x7f7bcc1115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.897+0000 7f7bd259f700 1 --2- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc1115b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc006d40 tx=0x7f7bbc009250 comp rx=0 tx=0).stop 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.898+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 shutdown_connections 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.898+0000 7f7bd259f700 1 --2- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7bb8036830 0x7f7bb8038ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.898+0000 7f7bd259f700 1 --2- 172.21.15.62:0/2257387142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bcc076c10 0x7f7bcc1115b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:06.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.898+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 >> 172.21.15.62:0/2257387142 conn(0x7f7bcc0fce90 msgr2=0x7f7bcc0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:06.607 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.898+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 shutdown_connections 2024-05-09T06:21:06.607 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.898+0000 7f7bd259f700 1 -- 172.21.15.62:0/2257387142 wait complete. 2024-05-09T06:21:06.612 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T06:21:06.612 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout disabled 2024-05-09T06:21:06.620 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T06:21:06.620 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-05-09T06:21:06.620 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld.service is not enabled 2024-05-09T06:21:06.620 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-09T06:21:06.622 INFO:teuthology.orchestra.run.smithi062.stdout:Ceph Dashboard is now available at: 2024-05-09T06:21:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: URL: https://smithi062.front.sepia.ceph.com:8443/ 2024-05-09T06:21:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: User: admin 2024-05-09T06:21:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: Password: nnot6u5pg7 2024-05-09T06:21:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:06.623 INFO:teuthology.orchestra.run.smithi062.stdout:Saving cluster configuration to /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config directory 2024-05-09T06:21:06.623 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling autotune for osd_memory_target 2024-05-09T06:21:07.809 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.048+0000 7f5985726700 1 Processor -- start 2024-05-09T06:21:07.809 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.048+0000 7f5985726700 1 -- start start 2024-05-09T06:21:07.809 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.048+0000 7f5985726700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980102c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:07.809 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.048+0000 7f5985726700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59801031c0 con 0x7f5980102870 2024-05-09T06:21:07.809 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.048+0000 7f597effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:07.809 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.049+0000 7f597effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980102c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48964/0 (socket says 172.21.15.62:48964) 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.049+0000 7f597effd700 1 -- 172.21.15.62:0/2288624051 learned_addr learned my addr 172.21.15.62:0/2288624051 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.049+0000 7f597effd700 1 -- 172.21.15.62:0/2288624051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980103300 con 0x7f5980102870 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.049+0000 7f597effd700 1 --2- 172.21.15.62:0/2288624051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980102c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5970009e50 tx=0x7f5970009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b40cfde0b1d1af7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.049+0000 7f597dffb700 1 -- 172.21.15.62:0/2288624051 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59700092e0 con 0x7f5980102870 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.049+0000 7f597dffb700 1 -- 172.21.15.62:0/2288624051 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5970012430 con 0x7f5980102870 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.049+0000 7f597dffb700 1 -- 172.21.15.62:0/2288624051 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59700075a0 con 0x7f5980102870 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.050+0000 7f5985726700 1 -- 172.21.15.62:0/2288624051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 msgr2=0x7f5980102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.050+0000 7f5985726700 1 --2- 172.21.15.62:0/2288624051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980102c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5970009e50 tx=0x7f5970009840 comp rx=0 tx=0).stop 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.050+0000 7f5985726700 1 -- 172.21.15.62:0/2288624051 shutdown_connections 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.050+0000 7f5985726700 1 --2- 172.21.15.62:0/2288624051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980102c80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.050+0000 7f5985726700 1 -- 172.21.15.62:0/2288624051 >> 172.21.15.62:0/2288624051 conn(0x7f59800fe030 msgr2=0x7f5980100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.050+0000 7f5985726700 1 -- 172.21.15.62:0/2288624051 shutdown_connections 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.050+0000 7f5985726700 1 -- 172.21.15.62:0/2288624051 wait complete. 2024-05-09T06:21:07.810 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f5985726700 1 Processor -- start 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f5985726700 1 -- start start 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f5985726700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f5985726700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980111b40 con 0x7f5980102870 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f597effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f597effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48976/0 (socket says 172.21.15.62:48976) 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f597effd700 1 -- 172.21.15.62:0/2469434197 learned_addr learned my addr 172.21.15.62:0/2469434197 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f597effd700 1 -- 172.21.15.62:0/2469434197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970009ae0 con 0x7f5980102870 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f597effd700 1 --2- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980111600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5970009fd0 tx=0x7f5970009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.051+0000 7f59777fe700 1 -- 172.21.15.62:0/2469434197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59700092e0 con 0x7f5980102870 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.052+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5980111d40 con 0x7f5980102870 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.052+0000 7f59777fe700 1 -- 172.21.15.62:0/2469434197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5970007ce0 con 0x7f5980102870 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.052+0000 7f59777fe700 1 -- 172.21.15.62:0/2469434197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5970025990 con 0x7f5980102870 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.052+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59801128b0 con 0x7f5980102870 2024-05-09T06:21:07.811 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.052+0000 7f59777fe700 1 -- 172.21.15.62:0/2469434197 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f5970019050 con 0x7f5980102870 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.053+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598005f5c0 con 0x7f5980102870 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.053+0000 7f59777fe700 1 --2- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f596c0368a0 0x7f596c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.053+0000 7f59777fe700 1 -- 172.21.15.62:0/2469434197 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f597004a210 con 0x7f5980102870 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.053+0000 7f597e7fc700 1 --2- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f596c0368a0 0x7f596c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.053+0000 7f597e7fc700 1 --2- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f596c0368a0 0x7f596c038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5968009990 tx=0x7f5968006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.057+0000 7f59777fe700 1 -- 172.21.15.62:0/2469434197 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5970011570 con 0x7f5980102870 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.252+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f598004bed0 con 0x7f5980102870 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.253+0000 7f59777fe700 1 -- 172.21.15.62:0/2469434197 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f5970020030 con 0x7f5980102870 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f596c0368a0 msgr2=0x7f596c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 --2- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f596c0368a0 0x7f596c038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5968009990 tx=0x7f5968006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 msgr2=0x7f5980111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 --2- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980111600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5970009fd0 tx=0x7f5970009840 comp rx=0 tx=0).stop 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 shutdown_connections 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 --2- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f596c0368a0 0x7f596c038d50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:07.812 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 --2- 172.21.15.62:0/2469434197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5980102870 0x7f5980111600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:07.813 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 >> 172.21.15.62:0/2469434197 conn(0x7f59800fe030 msgr2=0x7f59800feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:07.813 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 shutdown_connections 2024-05-09T06:21:07.813 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.255+0000 7f5985726700 1 -- 172.21.15.62:0/2469434197 wait complete. 2024-05-09T06:21:08.824 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:08 smithi062 ceph-mon[26920]: mgrmap e13: smithi062.juuasl(active, since 6s) 2024-05-09T06:21:08.824 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:08 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3177850702' entity='client.admin' 2024-05-09T06:21:09.091 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.229+0000 7f6f9b25c700 1 Processor -- start 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.230+0000 7f6f9b25c700 1 -- start start 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.230+0000 7f6f9b25c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94102c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.230+0000 7f6f9b25c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94103180 con 0x7f6f94102830 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.230+0000 7f6f98ff8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.230+0000 7f6f98ff8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48982/0 (socket says 172.21.15.62:48982) 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.230+0000 7f6f98ff8700 1 -- 172.21.15.62:0/2934677925 learned_addr learned my addr 172.21.15.62:0/2934677925 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.230+0000 7f6f98ff8700 1 -- 172.21.15.62:0/2934677925 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f941032c0 con 0x7f6f94102830 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.230+0000 7f6f98ff8700 1 --2- 172.21.15.62:0/2934677925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94102c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f880098e0 tx=0x7f6f88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca568270c1cc15e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f937fe700 1 -- 172.21.15.62:0/2934677925 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f8800b860 con 0x7f6f94102830 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f937fe700 1 -- 172.21.15.62:0/2934677925 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f8800be90 con 0x7f6f94102830 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f937fe700 1 -- 172.21.15.62:0/2934677925 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f880103c0 con 0x7f6f94102830 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f9b25c700 1 -- 172.21.15.62:0/2934677925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 msgr2=0x7f6f94102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f9b25c700 1 --2- 172.21.15.62:0/2934677925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94102c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f880098e0 tx=0x7f6f88009250 comp rx=0 tx=0).stop 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f9b25c700 1 -- 172.21.15.62:0/2934677925 shutdown_connections 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f9b25c700 1 --2- 172.21.15.62:0/2934677925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94102c40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f9b25c700 1 -- 172.21.15.62:0/2934677925 >> 172.21.15.62:0/2934677925 conn(0x7f6f940fe010 msgr2=0x7f6f94100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f9b25c700 1 -- 172.21.15.62:0/2934677925 shutdown_connections 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.231+0000 7f6f9b25c700 1 -- 172.21.15.62:0/2934677925 wait complete. 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.232+0000 7f6f9b25c700 1 Processor -- start 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.232+0000 7f6f9b25c700 1 -- start start 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.232+0000 7f6f9b25c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94111670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.232+0000 7f6f9b25c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94111bb0 con 0x7f6f94102830 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f98ff8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94111670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f98ff8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94111670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48984/0 (socket says 172.21.15.62:48984) 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f98ff8700 1 -- 172.21.15.62:0/3177850702 learned_addr learned my addr 172.21.15.62:0/3177850702 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f98ff8700 1 -- 172.21.15.62:0/3177850702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880094f0 con 0x7f6f94102830 2024-05-09T06:21:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f98ff8700 1 --2- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94111670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f88006b00 tx=0x7f6f88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f917fa700 1 -- 172.21.15.62:0/3177850702 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f88010840 con 0x7f6f94102830 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f917fa700 1 -- 172.21.15.62:0/3177850702 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f88010e70 con 0x7f6f94102830 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f94111db0 con 0x7f6f94102830 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f917fa700 1 -- 172.21.15.62:0/3177850702 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f8801ae70 con 0x7f6f94102830 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.233+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f94112920 con 0x7f6f94102830 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.234+0000 7f6f917fa700 1 -- 172.21.15.62:0/3177850702 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f6f880244a0 con 0x7f6f94102830 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.234+0000 7f6f917fa700 1 --2- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6f84036990 0x7f6f84038e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.234+0000 7f6f917fa700 1 -- 172.21.15.62:0/3177850702 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6f8804ace0 con 0x7f6f94102830 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.234+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9405f5c0 con 0x7f6f94102830 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.234+0000 7f6f93fff700 1 --2- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6f84036990 0x7f6f84038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.235+0000 7f6f93fff700 1 --2- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6f84036990 0x7f6f84038e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009990 tx=0x7f6f80006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.239+0000 7f6f917fa700 1 -- 172.21.15.62:0/3177850702 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6f8802e440 con 0x7f6f94102830 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.540+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f6f9404bed0 con 0x7f6f94102830 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.542+0000 7f6f917fa700 1 -- 172.21.15.62:0/3177850702 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f6f8802cb80 con 0x7f6f94102830 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6f84036990 msgr2=0x7f6f84038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 --2- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6f84036990 0x7f6f84038e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009990 tx=0x7f6f80006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 msgr2=0x7f6f94111670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 --2- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94111670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f88006b00 tx=0x7f6f88009250 comp rx=0 tx=0).stop 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 shutdown_connections 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 --2- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6f84036990 0x7f6f84038e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 --2- 172.21.15.62:0/3177850702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f94102830 0x7f6f94111670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 >> 172.21.15.62:0/3177850702 conn(0x7f6f940fe010 msgr2=0x7f6f940feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.544+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 shutdown_connections 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.545+0000 7f6f9b25c700 1 -- 172.21.15.62:0/3177850702 wait complete. 2024-05-09T06:21:09.095 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout:Or, if you are only running a single cluster on this host: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: ceph telemetry on 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout:For more information see: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:09.096 INFO:teuthology.orchestra.run.smithi062.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-05-09T06:21:09.097 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:09.097 INFO:teuthology.orchestra.run.smithi062.stdout:Bootstrap complete. 2024-05-09T06:21:09.125 INFO:tasks.cephadm:Fetching config... 2024-05-09T06:21:09.126 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:21:09.126 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-09T06:21:09.182 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-09T06:21:09.183 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:21:09.183 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-09T06:21:09.239 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-09T06:21:09.240 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:21:09.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/keyring of=/dev/stdout 2024-05-09T06:21:09.306 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-09T06:21:09.306 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:21:09.306 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-09T06:21:09.364 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-09T06:21:09.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/AzAMTK0zmrX0pb30fAmwmHPXNhcPzURobtEpLvVpXoaAmym/rQ4JG90+EOVn6F9JnA7FfnuOkcMdpxxxfpq/bygOggjWCgRbTjKBvH4zmX2ZjIIKogC5Fntqh0B0BU0cemXTbZIhdLBSyjMDJTdWL6eQr0HBMjwXm5iNgcB97m8FYfZftEhQkLqllNsfRAYk9Pm+oCNRrahvVczemzSaFXAlx8VfN3ww7JONk33X3vCtIXdYHGwXwL2uJH8XiB8a6fNWGrLw6UyFJpwNrLuakZsSiggrOE9sCai5qjD5ESkSmEVb+YXWWV8XoRy4ekI1/1aAvqMYXL+5g62PbWESLjAKSRyaBwKfAatEepzPUxdi/iUiWzOyZqMNb3zLeVvGt5qFwnYvzv5CMtDDC+2xrNpjo7GWBmcBz3l4Szg0HRehVG+ULZTz52bBQbxiScj10jDpOF3m2p4If8OMsj/f3U+TOtlVQ56q7yYkIbb3V/zyZOW4vJzVpkzAn+koMsM= ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T06:21:09.441 INFO:teuthology.orchestra.run.smithi062.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/AzAMTK0zmrX0pb30fAmwmHPXNhcPzURobtEpLvVpXoaAmym/rQ4JG90+EOVn6F9JnA7FfnuOkcMdpxxxfpq/bygOggjWCgRbTjKBvH4zmX2ZjIIKogC5Fntqh0B0BU0cemXTbZIhdLBSyjMDJTdWL6eQr0HBMjwXm5iNgcB97m8FYfZftEhQkLqllNsfRAYk9Pm+oCNRrahvVczemzSaFXAlx8VfN3ww7JONk33X3vCtIXdYHGwXwL2uJH8XiB8a6fNWGrLw6UyFJpwNrLuakZsSiggrOE9sCai5qjD5ESkSmEVb+YXWWV8XoRy4ekI1/1aAvqMYXL+5g62PbWESLjAKSRyaBwKfAatEepzPUxdi/iUiWzOyZqMNb3zLeVvGt5qFwnYvzv5CMtDDC+2xrNpjo7GWBmcBz3l4Szg0HRehVG+ULZTz52bBQbxiScj10jDpOF3m2p4If8OMsj/f3U+TOtlVQ56q7yYkIbb3V/zyZOW4vJzVpkzAn+koMsM= ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:21:09.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/AzAMTK0zmrX0pb30fAmwmHPXNhcPzURobtEpLvVpXoaAmym/rQ4JG90+EOVn6F9JnA7FfnuOkcMdpxxxfpq/bygOggjWCgRbTjKBvH4zmX2ZjIIKogC5Fntqh0B0BU0cemXTbZIhdLBSyjMDJTdWL6eQr0HBMjwXm5iNgcB97m8FYfZftEhQkLqllNsfRAYk9Pm+oCNRrahvVczemzSaFXAlx8VfN3ww7JONk33X3vCtIXdYHGwXwL2uJH8XiB8a6fNWGrLw6UyFJpwNrLuakZsSiggrOE9sCai5qjD5ESkSmEVb+YXWWV8XoRy4ekI1/1aAvqMYXL+5g62PbWESLjAKSRyaBwKfAatEepzPUxdi/iUiWzOyZqMNb3zLeVvGt5qFwnYvzv5CMtDDC+2xrNpjo7GWBmcBz3l4Szg0HRehVG+ULZTz52bBQbxiScj10jDpOF3m2p4If8OMsj/f3U+TOtlVQ56q7yYkIbb3V/zyZOW4vJzVpkzAn+koMsM= ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T06:21:09.496 INFO:teuthology.orchestra.run.smithi079.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/AzAMTK0zmrX0pb30fAmwmHPXNhcPzURobtEpLvVpXoaAmym/rQ4JG90+EOVn6F9JnA7FfnuOkcMdpxxxfpq/bygOggjWCgRbTjKBvH4zmX2ZjIIKogC5Fntqh0B0BU0cemXTbZIhdLBSyjMDJTdWL6eQr0HBMjwXm5iNgcB97m8FYfZftEhQkLqllNsfRAYk9Pm+oCNRrahvVczemzSaFXAlx8VfN3ww7JONk33X3vCtIXdYHGwXwL2uJH8XiB8a6fNWGrLw6UyFJpwNrLuakZsSiggrOE9sCai5qjD5ESkSmEVb+YXWWV8XoRy4ekI1/1aAvqMYXL+5g62PbWESLjAKSRyaBwKfAatEepzPUxdi/iUiWzOyZqMNb3zLeVvGt5qFwnYvzv5CMtDDC+2xrNpjo7GWBmcBz3l4Szg0HRehVG+ULZTz52bBQbxiScj10jDpOF3m2p4If8OMsj/f3U+TOtlVQ56q7yYkIbb3V/zyZOW4vJzVpkzAn+koMsM= ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:21:09.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-09T06:21:09.773 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:21:12.253 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:12 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:12.253 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:12 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:12.253 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:12 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:21:12.253 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:12 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:12.253 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:12 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi062", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:21:12.254 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:12 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi062", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-09T06:21:12.254 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:12 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:21:12.254 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:12 smithi062 ceph-mon[26920]: Deploying daemon crash.smithi062 on smithi062 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.016+0000 7fbbc843b700 1 -- 172.21.15.62:0/2793826066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 msgr2=0x7fbbc00fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.016+0000 7fbbc843b700 1 --2- 172.21.15.62:0/2793826066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 0x7fbbc00fce40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0048c0 tx=0x7fbbbc009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.016+0000 7fbbc843b700 1 -- 172.21.15.62:0/2793826066 shutdown_connections 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.016+0000 7fbbc843b700 1 --2- 172.21.15.62:0/2793826066 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 0x7fbbc00fce40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.016+0000 7fbbc843b700 1 -- 172.21.15.62:0/2793826066 >> 172.21.15.62:0/2793826066 conn(0x7fbbc00f8170 msgr2=0x7fbbc00fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.016+0000 7fbbc843b700 1 -- 172.21.15.62:0/2793826066 shutdown_connections 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.016+0000 7fbbc843b700 1 -- 172.21.15.62:0/2793826066 wait complete. 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.017+0000 7fbbc843b700 1 Processor -- start 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.017+0000 7fbbc843b700 1 -- start start 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.017+0000 7fbbc843b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 0x7fbbc010f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.017+0000 7fbbc843b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc010f800 con 0x7fbbc00fca30 2024-05-09T06:21:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.017+0000 7fbbc61d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 0x7fbbc010f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.017+0000 7fbbc61d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 0x7fbbc010f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49010/0 (socket says 172.21.15.62:49010) 2024-05-09T06:21:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.017+0000 7fbbc61d7700 1 -- 172.21.15.62:0/3055294427 learned_addr learned my addr 172.21.15.62:0/3055294427 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.018+0000 7fbbc61d7700 1 -- 172.21.15.62:0/3055294427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc005040 con 0x7fbbc00fca30 2024-05-09T06:21:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.018+0000 7fbbc61d7700 1 --2- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 0x7fbbc010f2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009680 tx=0x7fbbbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.018+0000 7fbbb6ffd700 1 -- 172.21.15.62:0/3055294427 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbbc00b5c0 con 0x7fbbc00fca30 2024-05-09T06:21:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.018+0000 7fbbb6ffd700 1 -- 172.21.15.62:0/3055294427 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbbc00be70 con 0x7fbbc00fca30 2024-05-09T06:21:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.018+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc010fa00 con 0x7fbbc00fca30 2024-05-09T06:21:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.018+0000 7fbbb6ffd700 1 -- 172.21.15.62:0/3055294427 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbbc0135a0 con 0x7fbbc00fca30 2024-05-09T06:21:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.018+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc0110570 con 0x7fbbc00fca30 2024-05-09T06:21:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.019+0000 7fbbb6ffd700 1 -- 172.21.15.62:0/3055294427 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fbbbc013810 con 0x7fbbc00fca30 2024-05-09T06:21:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.019+0000 7fbbb6ffd700 1 --2- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbbac0368d0 0x7fbbac038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.019+0000 7fbbb6ffd700 1 -- 172.21.15.62:0/3055294427 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbbbc049400 con 0x7fbbc00fca30 2024-05-09T06:21:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.019+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc0102f40 con 0x7fbbc00fca30 2024-05-09T06:21:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.019+0000 7fbbc59d6700 1 --2- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbbac0368d0 0x7fbbac038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.020+0000 7fbbc59d6700 1 --2- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbbac0368d0 0x7fbbac038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009990 tx=0x7fbbb0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:13.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.024+0000 7fbbb6ffd700 1 -- 172.21.15.62:0/3055294427 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbbbc013b60 con 0x7fbbc00fca30 2024-05-09T06:21:13.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.224+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fbbc0102880 con 0x7fbbc00fca30 2024-05-09T06:21:13.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.227+0000 7fbbb6ffd700 1 -- 172.21.15.62:0/3055294427 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbbbc011370 con 0x7fbbc00fca30 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.229+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbbac0368d0 msgr2=0x7fbbac038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.229+0000 7fbbc843b700 1 --2- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbbac0368d0 0x7fbbac038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009990 tx=0x7fbbb0006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.229+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 msgr2=0x7fbbc010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.229+0000 7fbbc843b700 1 --2- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 0x7fbbc010f2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009680 tx=0x7fbbbc009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.230+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 shutdown_connections 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.230+0000 7fbbc843b700 1 --2- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbbac0368d0 0x7fbbac038d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.230+0000 7fbbc843b700 1 --2- 172.21.15.62:0/3055294427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbc00fca30 0x7fbbc010f2c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.230+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 >> 172.21.15.62:0/3055294427 conn(0x7fbbc00f8170 msgr2=0x7fbbc00fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.230+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 shutdown_connections 2024-05-09T06:21:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:13.230+0000 7fbbc843b700 1 -- 172.21.15.62:0/3055294427 wait complete. 2024-05-09T06:21:13.782 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-09T06:21:13.782 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-09T06:21:14.276 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:21:14.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:14 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3055294427' entity='client.admin' 2024-05-09T06:21:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/3882898650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 msgr2=0x7f3a780fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 --2- 172.21.15.62:0/3882898650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 0x7f3a780fbd40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a680048c0 tx=0x7f3a68009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/3882898650 shutdown_connections 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 --2- 172.21.15.62:0/3882898650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 0x7f3a780fbd40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/3882898650 >> 172.21.15.62:0/3882898650 conn(0x7f3a780f7070 msgr2=0x7f3a780f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/3882898650 shutdown_connections 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/3882898650 wait complete. 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 Processor -- start 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.339+0000 7f3a7cdcd700 1 -- start start 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a7cdcd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 0x7f3a78066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a7cdcd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7810fdd0 con 0x7f3a780fb930 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a7659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 0x7f3a78066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a7659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 0x7f3a78066820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37370/0 (socket says 172.21.15.62:37370) 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a7659c700 1 -- 172.21.15.62:0/846590461 learned_addr learned my addr 172.21.15.62:0/846590461 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a7659c700 1 -- 172.21.15.62:0/846590461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68005040 con 0x7f3a780fb930 2024-05-09T06:21:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a7659c700 1 --2- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 0x7f3a78066820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a680096b0 tx=0x7f3a68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a6effd700 1 -- 172.21.15.62:0/846590461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a6800bed0 con 0x7f3a780fb930 2024-05-09T06:21:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a6effd700 1 -- 172.21.15.62:0/846590461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a6800b5c0 con 0x7f3a780fb930 2024-05-09T06:21:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7810ff10 con 0x7f3a780fb930 2024-05-09T06:21:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.340+0000 7f3a6effd700 1 -- 172.21.15.62:0/846590461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a6801c5b0 con 0x7f3a780fb930 2024-05-09T06:21:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.341+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a78110400 con 0x7f3a780fb930 2024-05-09T06:21:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.342+0000 7f3a6effd700 1 -- 172.21.15.62:0/846590461 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f3a6801c820 con 0x7f3a780fb930 2024-05-09T06:21:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.342+0000 7f3a6effd700 1 --2- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3a64036880 0x7f3a64038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.342+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a781058f0 con 0x7f3a780fb930 2024-05-09T06:21:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.342+0000 7f3a6effd700 1 -- 172.21.15.62:0/846590461 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3a68049bf0 con 0x7f3a780fb930 2024-05-09T06:21:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.342+0000 7f3a6ffff700 1 --2- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3a64036880 0x7f3a64038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.342+0000 7f3a6ffff700 1 --2- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3a64036880 0x7f3a64038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009990 tx=0x7f3a60006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.347+0000 7f3a6effd700 1 -- 172.21.15.62:0/846590461 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3a68023300 con 0x7f3a780fb930 2024-05-09T06:21:16.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.554+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 --> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a7805e3a0 con 0x7f3a64036880 2024-05-09T06:21:16.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.557+0000 7f3a6effd700 1 -- 172.21.15.62:0/846590461 <== mgr.14162 v2:172.21.15.62:6800/2116890721 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3a7805e3a0 con 0x7f3a64036880 2024-05-09T06:21:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3a64036880 msgr2=0x7f3a64038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 --2- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3a64036880 0x7f3a64038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009990 tx=0x7f3a60006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 msgr2=0x7f3a78066820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 --2- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 0x7f3a78066820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a680096b0 tx=0x7f3a68009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 shutdown_connections 2024-05-09T06:21:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 --2- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3a64036880 0x7f3a64038d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 --2- 172.21.15.62:0/846590461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a780fb930 0x7f3a78066820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 >> 172.21.15.62:0/846590461 conn(0x7f3a780f7070 msgr2=0x7f3a78102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 shutdown_connections 2024-05-09T06:21:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:16.559+0000 7f3a7cdcd700 1 -- 172.21.15.62:0/846590461 wait complete. 2024-05-09T06:21:17.413 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi079 2024-05-09T06:21:17.413 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:21:17.413 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/etc/ceph/ceph.conf 2024-05-09T06:21:17.432 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:21:17.432 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:21:17.491 INFO:tasks.cephadm:Adding host smithi079 to orchestrator... 2024-05-09T06:21:17.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch host add smithi079 2024-05-09T06:21:17.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:17 smithi062 ceph-mon[26920]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:17.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:17 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:17.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:17 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:17.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:17 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:17.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:17 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:17.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:17 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:17.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:17 smithi062 ceph-mon[26920]: Deploying daemon node-exporter.smithi062 on smithi062 2024-05-09T06:21:17.884 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:21:19.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.335+0000 7f556a724700 1 -- 172.21.15.62:0/3894492984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 msgr2=0x7f55640fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:19.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.335+0000 7f556a724700 1 --2- 172.21.15.62:0/3894492984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 0x7f55640fbd50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f55540048c0 tx=0x7f5554009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.335+0000 7f556a724700 1 -- 172.21.15.62:0/3894492984 shutdown_connections 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.335+0000 7f556a724700 1 --2- 172.21.15.62:0/3894492984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 0x7f55640fbd50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.335+0000 7f556a724700 1 -- 172.21.15.62:0/3894492984 >> 172.21.15.62:0/3894492984 conn(0x7f55640f70a0 msgr2=0x7f55640f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.335+0000 7f556a724700 1 -- 172.21.15.62:0/3894492984 shutdown_connections 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.335+0000 7f556a724700 1 -- 172.21.15.62:0/3894492984 wait complete. 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.336+0000 7f556a724700 1 Processor -- start 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.336+0000 7f556a724700 1 -- start start 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.336+0000 7f556a724700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 0x7f55640f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.336+0000 7f556a724700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55640f9570 con 0x7f55640fb940 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.336+0000 7f5563fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 0x7f55640f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.336+0000 7f5563fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 0x7f55640f9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37406/0 (socket says 172.21.15.62:37406) 2024-05-09T06:21:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.336+0000 7f5563fff700 1 -- 172.21.15.62:0/870940266 learned_addr learned my addr 172.21.15.62:0/870940266 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.337+0000 7f5563fff700 1 -- 172.21.15.62:0/870940266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5554005040 con 0x7f55640fb940 2024-05-09T06:21:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.337+0000 7f5563fff700 1 --2- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 0x7f55640f9030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55540096b0 tx=0x7f5554009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.337+0000 7f55617fa700 1 -- 172.21.15.62:0/870940266 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f555400bed0 con 0x7f55640fb940 2024-05-09T06:21:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.337+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55640f7640 con 0x7f55640fb940 2024-05-09T06:21:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.337+0000 7f55617fa700 1 -- 172.21.15.62:0/870940266 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f555400b5c0 con 0x7f55640fb940 2024-05-09T06:21:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.337+0000 7f55617fa700 1 -- 172.21.15.62:0/870940266 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f555401c5b0 con 0x7f55640fb940 2024-05-09T06:21:19.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.337+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55640f7b30 con 0x7f55640fb940 2024-05-09T06:21:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.338+0000 7f55617fa700 1 -- 172.21.15.62:0/870940266 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f555401c820 con 0x7f55640fb940 2024-05-09T06:21:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.338+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556405f5c0 con 0x7f55640fb940 2024-05-09T06:21:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.338+0000 7f55617fa700 1 --2- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f5550036880 0x7f5550038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.338+0000 7f55617fa700 1 -- 172.21.15.62:0/870940266 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5554049ba0 con 0x7f55640fb940 2024-05-09T06:21:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.338+0000 7f555bfff700 1 --2- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f5550036880 0x7f5550038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:19.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.338+0000 7f555bfff700 1 --2- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f5550036880 0x7f5550038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f554c009990 tx=0x7f554c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:19.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.343+0000 7f55617fa700 1 -- 172.21.15.62:0/870940266 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5554023300 con 0x7f55640fb940 2024-05-09T06:21:19.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:19.546+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 --> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi079", "target": ["mon-mgr", ""]}) v1 -- 0x7f55640f7f40 con 0x7f5550036880 2024-05-09T06:21:20.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:19 smithi062 ceph-mon[26920]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:21.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.480+0000 7f55617fa700 1 -- 172.21.15.62:0/870940266 <== mgr.14162 v2:172.21.15.62:6800/2116890721 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f55640f7f40 con 0x7f5550036880 2024-05-09T06:21:21.463 INFO:teuthology.orchestra.run.smithi062.stdout:Added host 'smithi079' with addr '172.21.15.79' 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.482+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f5550036880 msgr2=0x7f5550038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.482+0000 7f556a724700 1 --2- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f5550036880 0x7f5550038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f554c009990 tx=0x7f554c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.482+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 msgr2=0x7f55640f9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.482+0000 7f556a724700 1 --2- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 0x7f55640f9030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55540096b0 tx=0x7f5554009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.482+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 shutdown_connections 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.482+0000 7f556a724700 1 --2- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f5550036880 0x7f5550038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.482+0000 7f556a724700 1 --2- 172.21.15.62:0/870940266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55640fb940 0x7f55640f9030 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.482+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 >> 172.21.15.62:0/870940266 conn(0x7f55640f70a0 msgr2=0x7f5564065050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.483+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 shutdown_connections 2024-05-09T06:21:21.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:21.483+0000 7f556a724700 1 -- 172.21.15.62:0/870940266 wait complete. 2024-05-09T06:21:21.786 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:21 smithi062 ceph-mon[26920]: Deploying cephadm binary to smithi079 2024-05-09T06:21:21.787 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:21 smithi062 ceph-mon[26920]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:21.787 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:21 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:21.787 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:21 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:22.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-09T06:21:22.742 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:21:22.865 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:22 smithi062 ceph-mon[26920]: Added host smithi079 2024-05-09T06:21:22.865 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:22 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:22.865 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:22 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:22.865 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:22 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:22.865 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:22 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:23.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:23 smithi062 ceph-mon[26920]: Deploying daemon alertmanager.smithi062 on smithi062 2024-05-09T06:21:23.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:23 smithi062 ceph-mon[26920]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.467+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1712989357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 msgr2=0x7f1aa00fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.467+0000 7f1aa62d5700 1 --2- 172.21.15.62:0/1712989357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 0x7f1aa00fce50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a900048c0 tx=0x7f1a90009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.467+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1712989357 shutdown_connections 2024-05-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.467+0000 7f1aa62d5700 1 --2- 172.21.15.62:0/1712989357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 0x7f1aa00fce50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.467+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1712989357 >> 172.21.15.62:0/1712989357 conn(0x7f1aa00f81a0 msgr2=0x7f1aa00fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.467+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1712989357 shutdown_connections 2024-05-09T06:21:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.467+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1712989357 wait complete. 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1aa62d5700 1 Processor -- start 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1aa62d5700 1 -- start start 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1aa62d5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 0x7f1aa010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1aa62d5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa010d5d0 con 0x7f1aa00fca40 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1a9ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 0x7f1aa010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1a9ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 0x7f1aa010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34636/0 (socket says 172.21.15.62:34636) 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1a9ffff700 1 -- 172.21.15.62:0/1537528369 learned_addr learned my addr 172.21.15.62:0/1537528369 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1a9ffff700 1 -- 172.21.15.62:0/1537528369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90005040 con 0x7f1aa00fca40 2024-05-09T06:21:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1a9ffff700 1 --2- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 0x7f1aa010d090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a900096b0 tx=0x7f1a90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1a9d7fa700 1 -- 172.21.15.62:0/1537528369 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a9000bed0 con 0x7f1aa00fca40 2024-05-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1a9d7fa700 1 -- 172.21.15.62:0/1537528369 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a9000b5c0 con 0x7f1aa00fca40 2024-05-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1a9d7fa700 1 -- 172.21.15.62:0/1537528369 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a9001c5b0 con 0x7f1aa00fca40 2024-05-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa010d7d0 con 0x7f1aa00fca40 2024-05-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.468+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa010e340 con 0x7f1aa00fca40 2024-05-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.469+0000 7f1a9d7fa700 1 -- 172.21.15.62:0/1537528369 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f1a9001c820 con 0x7f1aa00fca40 2024-05-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.469+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa0102f50 con 0x7f1aa00fca40 2024-05-09T06:21:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.469+0000 7f1a9d7fa700 1 --2- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f1a8c036880 0x7f1a8c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.470+0000 7f1a9d7fa700 1 -- 172.21.15.62:0/1537528369 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1a90049b30 con 0x7f1aa00fca40 2024-05-09T06:21:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.470+0000 7f1a97fff700 1 --2- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f1a8c036880 0x7f1a8c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.470+0000 7f1a97fff700 1 --2- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f1a8c036880 0x7f1a8c038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009990 tx=0x7f1a88006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.474+0000 7f1a9d7fa700 1 -- 172.21.15.62:0/1537528369 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1a90023300 con 0x7f1aa00fca40 2024-05-09T06:21:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.676+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 --> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1aa005f660 con 0x7f1a8c036880 2024-05-09T06:21:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.678+0000 7f1a9d7fa700 1 -- 172.21.15.62:0/1537528369 <== mgr.14162 v2:172.21.15.62:6800/2116890721 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f1aa005f660 con 0x7f1a8c036880 2024-05-09T06:21:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:21:24.661 INFO:teuthology.orchestra.run.smithi062.stdout:[{"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}, {"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}] 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f1a8c036880 msgr2=0x7f1a8c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 --2- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f1a8c036880 0x7f1a8c038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009990 tx=0x7f1a88006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 msgr2=0x7f1aa010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 --2- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 0x7f1aa010d090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a900096b0 tx=0x7f1a90009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 shutdown_connections 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 --2- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f1a8c036880 0x7f1a8c038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 --2- 172.21.15.62:0/1537528369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aa00fca40 0x7f1aa010d090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 >> 172.21.15.62:0/1537528369 conn(0x7f1aa00f81a0 msgr2=0x7f1aa0103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 shutdown_connections 2024-05-09T06:21:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:24.680+0000 7f1aa62d5700 1 -- 172.21.15.62:0/1537528369 wait complete. 2024-05-09T06:21:25.503 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-09T06:21:25.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-09T06:21:25.771 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:21:25.895 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:25 smithi062 ceph-mon[26920]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:25.895 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:25 smithi062 ceph-mon[26920]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:21:26.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:26 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:27.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:27 smithi062 ceph-mon[26920]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:27.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/2300806391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 msgr2=0x7fcc68070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:27.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 --2- 172.21.15.62:0/2300806391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 0x7fcc68070350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc640048c0 tx=0x7fcc64009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:27.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/2300806391 shutdown_connections 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 --2- 172.21.15.62:0/2300806391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 0x7fcc68070350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/2300806391 >> 172.21.15.62:0/2300806391 conn(0x7fcc680f8170 msgr2=0x7fcc680fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/2300806391 shutdown_connections 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/2300806391 wait complete. 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 Processor -- start 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.994+0000 7fcc6fdb2700 1 -- start start 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6fdb2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 0x7fcc68113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6fdb2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68113c40 con 0x7fcc68071e40 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6db4e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 0x7fcc68113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6db4e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 0x7fcc68113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34656/0 (socket says 172.21.15.62:34656) 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6db4e700 1 -- 172.21.15.62:0/3343051838 learned_addr learned my addr 172.21.15.62:0/3343051838 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6db4e700 1 -- 172.21.15.62:0/3343051838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc64005040 con 0x7fcc68071e40 2024-05-09T06:21:27.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6db4e700 1 --2- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 0x7fcc68113700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400b900 tx=0x7fcc64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc5e7fc700 1 -- 172.21.15.62:0/3343051838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc6400b5c0 con 0x7fcc68071e40 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc5e7fc700 1 -- 172.21.15.62:0/3343051838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc6400be70 con 0x7fcc68071e40 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc5e7fc700 1 -- 172.21.15.62:0/3343051838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc6401c590 con 0x7fcc68071e40 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc68113e40 con 0x7fcc68071e40 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.995+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc681149b0 con 0x7fcc68071e40 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.996+0000 7fcc5e7fc700 1 -- 172.21.15.62:0/3343051838 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fcc64004d30 con 0x7fcc68071e40 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.996+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc68109570 con 0x7fcc68071e40 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.997+0000 7fcc5e7fc700 1 --2- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fcc54036880 0x7fcc54038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.997+0000 7fcc5e7fc700 1 -- 172.21.15.62:0/3343051838 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcc640493c0 con 0x7fcc68071e40 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.997+0000 7fcc6d34d700 1 --2- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fcc54036880 0x7fcc54038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:27.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:27.997+0000 7fcc6d34d700 1 --2- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fcc54036880 0x7fcc54038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009990 tx=0x7fcc58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:27.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.002+0000 7fcc5e7fc700 1 -- 172.21.15.62:0/3343051838 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcc6401b350 con 0x7fcc68071e40 2024-05-09T06:21:28.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.207+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcc681153c0 con 0x7fcc68071e40 2024-05-09T06:21:28.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.667+0000 7fcc5e7fc700 1 -- 172.21.15.62:0/3343051838 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcc64021030 con 0x7fcc68071e40 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fcc54036880 msgr2=0x7fcc54038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 --2- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fcc54036880 0x7fcc54038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009990 tx=0x7fcc58006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 msgr2=0x7fcc68113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 --2- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 0x7fcc68113700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400b900 tx=0x7fcc64009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 shutdown_connections 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 --2- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fcc54036880 0x7fcc54038d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 --2- 172.21.15.62:0/3343051838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc68071e40 0x7fcc68113700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 >> 172.21.15.62:0/3343051838 conn(0x7fcc680f8170 msgr2=0x7fcc6810a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 shutdown_connections 2024-05-09T06:21:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:21:28.670+0000 7fcc6fdb2700 1 -- 172.21.15.62:0/3343051838 wait complete. 2024-05-09T06:21:28.654 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-05-09T06:21:28.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:28 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3343051838' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-09T06:21:29.361 INFO:tasks.cephadm:Adding mon.smithi062 on smithi062 2024-05-09T06:21:29.361 INFO:tasks.cephadm:Adding mon.smithi079 on smithi079 2024-05-09T06:21:29.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch apply mon '2;smithi062:172.21.15.62=smithi062;smithi079:172.21.15.79=smithi079' 2024-05-09T06:21:29.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:29 smithi062 ceph-mon[26920]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:29.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:29 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3343051838' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-09T06:21:29.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:29 smithi062 ceph-mon[26920]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T06:21:29.928 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:29.976 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.462+0000 7f723f9c2700 1 -- 172.21.15.79:0/2082655351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 msgr2=0x7f72380fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.462+0000 7f723f9c2700 1 --2- 172.21.15.79:0/2082655351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 0x7f72380fce40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72340048c0 tx=0x7f7234009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.462+0000 7f723f9c2700 1 -- 172.21.15.79:0/2082655351 shutdown_connections 2024-05-09T06:21:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.462+0000 7f723f9c2700 1 --2- 172.21.15.79:0/2082655351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 0x7f72380fce40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:31.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.462+0000 7f723f9c2700 1 -- 172.21.15.79:0/2082655351 >> 172.21.15.79:0/2082655351 conn(0x7f72380f8170 msgr2=0x7f72380fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.462+0000 7f723f9c2700 1 -- 172.21.15.79:0/2082655351 shutdown_connections 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.462+0000 7f723f9c2700 1 -- 172.21.15.79:0/2082655351 wait complete. 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.463+0000 7f723f9c2700 1 Processor -- start 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.463+0000 7f723f9c2700 1 -- start start 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.463+0000 7f723f9c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 0x7f7238071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.463+0000 7f723f9c2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238072240 con 0x7f72380fca30 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.463+0000 7f723d75e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 0x7f7238071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.463+0000 7f723d75e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 0x7f7238071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:37382/0 (socket says 172.21.15.79:37382) 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.463+0000 7f723d75e700 1 -- 172.21.15.79:0/4203724579 learned_addr learned my addr 172.21.15.79:0/4203724579 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.464+0000 7f723d75e700 1 -- 172.21.15.79:0/4203724579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7234005040 con 0x7f72380fca30 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.464+0000 7f723d75e700 1 --2- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 0x7f7238071d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72340096b0 tx=0x7f7234009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.464+0000 7f722dffb700 1 -- 172.21.15.79:0/4203724579 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f723400bed0 con 0x7f72380fca30 2024-05-09T06:21:31.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.464+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7238070310 con 0x7f72380fca30 2024-05-09T06:21:31.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.464+0000 7f722dffb700 1 -- 172.21.15.79:0/4203724579 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f723400b5c0 con 0x7f72380fca30 2024-05-09T06:21:31.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.464+0000 7f722dffb700 1 -- 172.21.15.79:0/4203724579 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f723401c5b0 con 0x7f72380fca30 2024-05-09T06:21:31.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.464+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7238070800 con 0x7f72380fca30 2024-05-09T06:21:31.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.465+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723805f5c0 con 0x7f72380fca30 2024-05-09T06:21:31.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.465+0000 7f722dffb700 1 -- 172.21.15.79:0/4203724579 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f7234013a80 con 0x7f72380fca30 2024-05-09T06:21:31.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.465+0000 7f722dffb700 1 --2- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7224036880 0x7f7224038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:31.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.465+0000 7f722dffb700 1 -- 172.21.15.79:0/4203724579 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7234049ac0 con 0x7f72380fca30 2024-05-09T06:21:31.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.465+0000 7f723cf5d700 1 --2- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7224036880 0x7f7224038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:31.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.466+0000 7f723cf5d700 1 --2- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7224036880 0x7f7224038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7228009990 tx=0x7f7228006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:31.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.470+0000 7f722dffb700 1 -- 172.21.15.79:0/4203724579 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7234011960 con 0x7f72380fca30 2024-05-09T06:21:31.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.671+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 --> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi062:172.21.15.62=smithi062;smithi079:172.21.15.79=smithi079", "target": ["mon-mgr", ""]}) v1 -- 0x7f7238106530 con 0x7f7224036880 2024-05-09T06:21:31.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.677+0000 7f722dffb700 1 -- 172.21.15.79:0/4203724579 <== mgr.14162 v2:172.21.15.62:6800/2116890721 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7238106530 con 0x7f7224036880 2024-05-09T06:21:31.660 INFO:teuthology.orchestra.run.smithi079.stdout:Scheduled mon update... 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.679+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7224036880 msgr2=0x7f7224038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.679+0000 7f723f9c2700 1 --2- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7224036880 0x7f7224038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7228009990 tx=0x7f7228006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.680+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 msgr2=0x7f7238071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.680+0000 7f723f9c2700 1 --2- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 0x7f7238071d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72340096b0 tx=0x7f7234009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.680+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 shutdown_connections 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.680+0000 7f723f9c2700 1 --2- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f7224036880 0x7f7224038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.680+0000 7f723f9c2700 1 --2- 172.21.15.79:0/4203724579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72380fca30 0x7f7238071d00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.680+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 >> 172.21.15.79:0/4203724579 conn(0x7f72380f8170 msgr2=0x7f7238103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.680+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 shutdown_connections 2024-05-09T06:21:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:31.680+0000 7f723f9c2700 1 -- 172.21.15.79:0/4203724579 wait complete. 2024-05-09T06:21:31.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:31 smithi062 ceph-mon[26920]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:32.207 DEBUG:teuthology.orchestra.run.smithi079:mon.smithi079> sudo journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi079.service 2024-05-09T06:21:32.210 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:21:32.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:21:32.489 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:32.538 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:32.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:32 smithi062 ceph-mon[26920]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi062:172.21.15.62=smithi062;smithi079:172.21.15.79=smithi079", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:32.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:32 smithi062 ceph-mon[26920]: Saving service mon spec with placement smithi062:172.21.15.62=smithi062;smithi079:172.21.15.79=smithi079;count:2 2024-05-09T06:21:32.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:32 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:33.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:33 smithi062 ceph-mon[26920]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:33.917 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 -- 172.21.15.79:0/2455131390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 msgr2=0x7f35e00fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 --2- 172.21.15.79:0/2455131390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 0x7f35e00fce40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f35d80048c0 tx=0x7f35d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 -- 172.21.15.79:0/2455131390 shutdown_connections 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 --2- 172.21.15.79:0/2455131390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 0x7f35e00fce40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 -- 172.21.15.79:0/2455131390 >> 172.21.15.79:0/2455131390 conn(0x7f35e00f8170 msgr2=0x7f35e00fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 -- 172.21.15.79:0/2455131390 shutdown_connections 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 -- 172.21.15.79:0/2455131390 wait complete. 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 Processor -- start 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.934+0000 7f35e4c1b700 1 -- start start 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35e4c1b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 0x7f35e0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35e4c1b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e0072240 con 0x7f35e00fca30 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35de59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 0x7f35e0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35de59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 0x7f35e0071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:59162/0 (socket says 172.21.15.79:59162) 2024-05-09T06:21:33.918 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35de59c700 1 -- 172.21.15.79:0/845282351 learned_addr learned my addr 172.21.15.79:0/845282351 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:33.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35de59c700 1 -- 172.21.15.79:0/845282351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8005040 con 0x7f35e00fca30 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35de59c700 1 --2- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 0x7f35e0071d00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009680 tx=0x7f35d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35d6ffd700 1 -- 172.21.15.79:0/845282351 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35d800b5c0 con 0x7f35e00fca30 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35d6ffd700 1 -- 172.21.15.79:0/845282351 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35d800be70 con 0x7f35e00fca30 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35d6ffd700 1 -- 172.21.15.79:0/845282351 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35d80135a0 con 0x7f35e00fca30 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e0070310 con 0x7f35e00fca30 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.935+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e0070800 con 0x7f35e00fca30 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.936+0000 7f35d6ffd700 1 -- 172.21.15.79:0/845282351 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f35d801c430 con 0x7f35e00fca30 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.936+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e005f5c0 con 0x7f35e00fca30 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.936+0000 7f35d6ffd700 1 --2- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f35cc036880 0x7f35cc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:33.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.936+0000 7f35d6ffd700 1 -- 172.21.15.79:0/845282351 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f35d8049430 con 0x7f35e00fca30 2024-05-09T06:21:33.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.937+0000 7f35ddd9b700 1 --2- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f35cc036880 0x7f35cc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:33.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.937+0000 7f35ddd9b700 1 --2- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f35cc036880 0x7f35cc038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009990 tx=0x7f35c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:33.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:33.941+0000 7f35d6ffd700 1 -- 172.21.15.79:0/845282351 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f35d80117e0 con 0x7f35e00fca30 2024-05-09T06:21:34.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.204+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f35e0106410 con 0x7f35e00fca30 2024-05-09T06:21:34.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.204+0000 7f35d6ffd700 1 -- 172.21.15.79:0/845282351 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f35d8021070 con 0x7f35e00fca30 2024-05-09T06:21:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:21:34.188 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f35cc036880 msgr2=0x7f35cc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 --2- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f35cc036880 0x7f35cc038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009990 tx=0x7f35c8006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 msgr2=0x7f35e0071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 --2- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 0x7f35e0071d00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009680 tx=0x7f35d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 shutdown_connections 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 --2- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f35cc036880 0x7f35cc038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 --2- 172.21.15.79:0/845282351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35e00fca30 0x7f35e0071d00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 >> 172.21.15.79:0/845282351 conn(0x7f35e00f8170 msgr2=0x7f35e0103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:34.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 shutdown_connections 2024-05-09T06:21:34.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:34.207+0000 7f35e4c1b700 1 -- 172.21.15.79:0/845282351 wait complete. 2024-05-09T06:21:34.191 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:21:35.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:34 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/845282351' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:21:35.763 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:21:35.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:21:35.825 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:35 smithi062 ceph-mon[26920]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:36.057 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:37.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.581+0000 7f8ada23a700 1 -- 172.21.15.79:0/3177859185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 msgr2=0x7f8ad40fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:37.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.581+0000 7f8ada23a700 1 --2- 172.21.15.79:0/3177859185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 0x7f8ad40fbd50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40048c0 tx=0x7f8ac4009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:37.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.582+0000 7f8ada23a700 1 -- 172.21.15.79:0/3177859185 shutdown_connections 2024-05-09T06:21:37.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.582+0000 7f8ada23a700 1 --2- 172.21.15.79:0/3177859185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 0x7f8ad40fbd50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:37.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.582+0000 7f8ada23a700 1 -- 172.21.15.79:0/3177859185 >> 172.21.15.79:0/3177859185 conn(0x7f8ad40f70a0 msgr2=0x7f8ad40f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:37.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.582+0000 7f8ada23a700 1 -- 172.21.15.79:0/3177859185 shutdown_connections 2024-05-09T06:21:37.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.582+0000 7f8ada23a700 1 -- 172.21.15.79:0/3177859185 wait complete. 2024-05-09T06:21:37.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.582+0000 7f8ada23a700 1 Processor -- start 2024-05-09T06:21:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.583+0000 7f8ada23a700 1 -- start start 2024-05-09T06:21:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.583+0000 7f8ada23a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 0x7f8ad4065c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.583+0000 7f8ada23a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad410fd50 con 0x7f8ad40fb940 2024-05-09T06:21:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.583+0000 7f8ad37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 0x7f8ad4065c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.583+0000 7f8ad37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 0x7f8ad4065c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:59176/0 (socket says 172.21.15.79:59176) 2024-05-09T06:21:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.583+0000 7f8ad37fe700 1 -- 172.21.15.79:0/2229712678 learned_addr learned my addr 172.21.15.79:0/2229712678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.583+0000 7f8ad37fe700 1 -- 172.21.15.79:0/2229712678 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4005040 con 0x7f8ad40fb940 2024-05-09T06:21:37.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.583+0000 7f8ad37fe700 1 --2- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 0x7f8ad4065c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009680 tx=0x7f8ac4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:37.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.584+0000 7f8ad0ff9700 1 -- 172.21.15.79:0/2229712678 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ac400b5c0 con 0x7f8ad40fb940 2024-05-09T06:21:37.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.584+0000 7f8ad0ff9700 1 -- 172.21.15.79:0/2229712678 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ac400be70 con 0x7f8ad40fb940 2024-05-09T06:21:37.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.584+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad410fef0 con 0x7f8ad40fb940 2024-05-09T06:21:37.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.584+0000 7f8ad0ff9700 1 -- 172.21.15.79:0/2229712678 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ac40135a0 con 0x7f8ad40fb940 2024-05-09T06:21:37.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.584+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad4110380 con 0x7f8ad40fb940 2024-05-09T06:21:37.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.584+0000 7f8ad0ff9700 1 -- 172.21.15.79:0/2229712678 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f8ac4013860 con 0x7f8ad40fb940 2024-05-09T06:21:37.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.585+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad4105900 con 0x7f8ad40fb940 2024-05-09T06:21:37.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.585+0000 7f8ad0ff9700 1 --2- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f8ac0036880 0x7f8ac0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:37.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.585+0000 7f8ad0ff9700 1 -- 172.21.15.79:0/2229712678 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8ac4049420 con 0x7f8ad40fb940 2024-05-09T06:21:37.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.585+0000 7f8acaffd700 1 --2- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f8ac0036880 0x7f8ac0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:37.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.585+0000 7f8acaffd700 1 --2- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f8ac0036880 0x7f8ac0038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009990 tx=0x7f8abc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:37.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.590+0000 7f8ad0ff9700 1 -- 172.21.15.79:0/2229712678 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8ac4011960 con 0x7f8ad40fb940 2024-05-09T06:21:37.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.845+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8ad405f5c0 con 0x7f8ad40fb940 2024-05-09T06:21:37.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.846+0000 7f8ad0ff9700 1 -- 172.21.15.79:0/2229712678 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8ac4021020 con 0x7f8ad40fb940 2024-05-09T06:21:37.830 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:21:37.830 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f8ac0036880 msgr2=0x7f8ac0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 --2- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f8ac0036880 0x7f8ac0038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009990 tx=0x7f8abc006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 msgr2=0x7f8ad4065c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 --2- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 0x7f8ad4065c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009680 tx=0x7f8ac4009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 shutdown_connections 2024-05-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 --2- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f8ac0036880 0x7f8ac0038d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 --2- 172.21.15.79:0/2229712678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ad40fb940 0x7f8ad4065c10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:37.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 >> 172.21.15.79:0/2229712678 conn(0x7f8ad40f70a0 msgr2=0x7f8ad4102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 shutdown_connections 2024-05-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:37.848+0000 7f8ada23a700 1 -- 172.21.15.79:0/2229712678 wait complete. 2024-05-09T06:21:37.833 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:21:37.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:37 smithi062 ceph-mon[26920]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:39.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:39.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:39.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:39.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:39.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2229712678' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:21:39.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:39.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:39.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-09T06:21:39.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:38 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:39.396 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:21:39.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:21:39.663 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:40.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:39 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-09T06:21:40.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:39 smithi062 ceph-mon[26920]: Deploying daemon grafana.smithi062 on smithi062 2024-05-09T06:21:40.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:39 smithi062 ceph-mon[26920]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.099+0000 7ff7c404d700 1 -- 172.21.15.79:0/2942751786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 msgr2=0x7ff7bc0fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.099+0000 7ff7c404d700 1 --2- 172.21.15.79:0/2942751786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 0x7ff7bc0fbd50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00048c0 tx=0x7ff7b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 -- 172.21.15.79:0/2942751786 shutdown_connections 2024-05-09T06:21:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 --2- 172.21.15.79:0/2942751786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 0x7ff7bc0fbd50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 -- 172.21.15.79:0/2942751786 >> 172.21.15.79:0/2942751786 conn(0x7ff7bc0f70a0 msgr2=0x7ff7bc0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 -- 172.21.15.79:0/2942751786 shutdown_connections 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 -- 172.21.15.79:0/2942751786 wait complete. 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 Processor -- start 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 -- start start 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 0x7ff7bc1136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.100+0000 7ff7c404d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc113c20 con 0x7ff7bc0fb940 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7c1de9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 0x7ff7bc1136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7c1de9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 0x7ff7bc1136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:59186/0 (socket says 172.21.15.79:59186) 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7c1de9700 1 -- 172.21.15.79:0/287169046 learned_addr learned my addr 172.21.15.79:0/287169046 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7c1de9700 1 -- 172.21.15.79:0/287169046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0005040 con 0x7ff7bc0fb940 2024-05-09T06:21:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7c1de9700 1 --2- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 0x7ff7bc1136e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00096b0 tx=0x7ff7b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7ae7fc700 1 -- 172.21.15.79:0/287169046 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7b000bed0 con 0x7ff7bc0fb940 2024-05-09T06:21:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc113e20 con 0x7ff7bc0fb940 2024-05-09T06:21:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7ae7fc700 1 -- 172.21.15.79:0/287169046 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7b000b5c0 con 0x7ff7bc0fb940 2024-05-09T06:21:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7ae7fc700 1 -- 172.21.15.79:0/287169046 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7b001c5b0 con 0x7ff7bc0fb940 2024-05-09T06:21:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.101+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc114990 con 0x7ff7bc0fb940 2024-05-09T06:21:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.102+0000 7ff7ae7fc700 1 -- 172.21.15.79:0/287169046 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7ff7b0013a80 con 0x7ff7bc0fb940 2024-05-09T06:21:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.102+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc101e50 con 0x7ff7bc0fb940 2024-05-09T06:21:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.102+0000 7ff7ae7fc700 1 --2- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7ff7a8036880 0x7ff7a8038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.102+0000 7ff7ae7fc700 1 -- 172.21.15.79:0/287169046 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff7b0049ae0 con 0x7ff7bc0fb940 2024-05-09T06:21:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.103+0000 7ff7c15e8700 1 --2- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7ff7a8036880 0x7ff7a8038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.103+0000 7ff7c15e8700 1 --2- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7ff7a8036880 0x7ff7a8038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009990 tx=0x7ff7b8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:41.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.108+0000 7ff7ae7fc700 1 -- 172.21.15.79:0/287169046 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff7b0011960 con 0x7ff7bc0fb940 2024-05-09T06:21:41.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.363+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff7bc114bd0 con 0x7ff7bc0fb940 2024-05-09T06:21:41.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.363+0000 7ff7ae7fc700 1 -- 172.21.15.79:0/287169046 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff7b0011370 con 0x7ff7bc0fb940 2024-05-09T06:21:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:21:41.347 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7ff7a8036880 msgr2=0x7ff7a8038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 --2- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7ff7a8036880 0x7ff7a8038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009990 tx=0x7ff7b8006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 msgr2=0x7ff7bc1136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 --2- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 0x7ff7bc1136e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00096b0 tx=0x7ff7b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 shutdown_connections 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 --2- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7ff7a8036880 0x7ff7a8038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 --2- 172.21.15.79:0/287169046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7bc0fb940 0x7ff7bc1136e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 >> 172.21.15.79:0/287169046 conn(0x7ff7bc0f70a0 msgr2=0x7ff7bc0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 shutdown_connections 2024-05-09T06:21:41.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:41.366+0000 7ff7c404d700 1 -- 172.21.15.79:0/287169046 wait complete. 2024-05-09T06:21:41.350 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:21:41.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:41 smithi062 ceph-mon[26920]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:41.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:41 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:41.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:41 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/287169046' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:21:42.940 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:21:42.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:21:43.190 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:43.238 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:43.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:43 smithi062 ceph-mon[26920]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.730+0000 7fa8ebf69700 1 -- 172.21.15.79:0/2680412613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 msgr2=0x7fa8e40fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.730+0000 7fa8ebf69700 1 --2- 172.21.15.79:0/2680412613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 0x7fa8e40fce30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00048c0 tx=0x7fa8e0009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.730+0000 7fa8ebf69700 1 -- 172.21.15.79:0/2680412613 shutdown_connections 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.730+0000 7fa8ebf69700 1 --2- 172.21.15.79:0/2680412613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 0x7fa8e40fce30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.730+0000 7fa8ebf69700 1 -- 172.21.15.79:0/2680412613 >> 172.21.15.79:0/2680412613 conn(0x7fa8e40f81a0 msgr2=0x7fa8e40fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8ebf69700 1 -- 172.21.15.79:0/2680412613 shutdown_connections 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8ebf69700 1 -- 172.21.15.79:0/2680412613 wait complete. 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8ebf69700 1 Processor -- start 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8ebf69700 1 -- start start 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8ebf69700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 0x7fa8e410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8ebf69700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e410d5c0 con 0x7fa8e40fca20 2024-05-09T06:21:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8e9d05700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 0x7fa8e410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8e9d05700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 0x7fa8e410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:59906/0 (socket says 172.21.15.79:59906) 2024-05-09T06:21:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.731+0000 7fa8e9d05700 1 -- 172.21.15.79:0/3232913558 learned_addr learned my addr 172.21.15.79:0/3232913558 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.732+0000 7fa8e9d05700 1 -- 172.21.15.79:0/3232913558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0005040 con 0x7fa8e40fca20 2024-05-09T06:21:44.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.732+0000 7fa8e9d05700 1 --2- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 0x7fa8e410d080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00096b0 tx=0x7fa8e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:44.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.732+0000 7fa8da7fc700 1 -- 172.21.15.79:0/3232913558 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8e000bed0 con 0x7fa8e40fca20 2024-05-09T06:21:44.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.732+0000 7fa8da7fc700 1 -- 172.21.15.79:0/3232913558 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8e000b5c0 con 0x7fa8e40fca20 2024-05-09T06:21:44.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.732+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e410d7c0 con 0x7fa8e40fca20 2024-05-09T06:21:44.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.732+0000 7fa8da7fc700 1 -- 172.21.15.79:0/3232913558 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8e001c5b0 con 0x7fa8e40fca20 2024-05-09T06:21:44.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.732+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e410e330 con 0x7fa8e40fca20 2024-05-09T06:21:44.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.733+0000 7fa8da7fc700 1 -- 172.21.15.79:0/3232913558 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fa8e0013420 con 0x7fa8e40fca20 2024-05-09T06:21:44.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.733+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e4102f30 con 0x7fa8e40fca20 2024-05-09T06:21:44.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.733+0000 7fa8da7fc700 1 --2- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fa8d0036880 0x7fa8d0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:44.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.733+0000 7fa8da7fc700 1 -- 172.21.15.79:0/3232913558 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa8e0049a60 con 0x7fa8e40fca20 2024-05-09T06:21:44.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.733+0000 7fa8e9504700 1 --2- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fa8d0036880 0x7fa8d0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:44.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.734+0000 7fa8e9504700 1 --2- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fa8d0036880 0x7fa8d0038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009990 tx=0x7fa8d4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.738+0000 7fa8da7fc700 1 -- 172.21.15.79:0/3232913558 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa8e0013a80 con 0x7fa8e40fca20 2024-05-09T06:21:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.996+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa8e410ed40 con 0x7fa8e40fca20 2024-05-09T06:21:44.979 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.996+0000 7fa8da7fc700 1 -- 172.21.15.79:0/3232913558 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa8e0011370 con 0x7fa8e40fca20 2024-05-09T06:21:44.979 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:21:44.979 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:21:44.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fa8d0036880 msgr2=0x7fa8d0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 --2- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fa8d0036880 0x7fa8d0038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009990 tx=0x7fa8d4006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 msgr2=0x7fa8e410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 --2- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 0x7fa8e410d080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00096b0 tx=0x7fa8e0009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 shutdown_connections 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 --2- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fa8d0036880 0x7fa8d0038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 --2- 172.21.15.79:0/3232913558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8e40fca20 0x7fa8e410d080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 >> 172.21.15.79:0/3232913558 conn(0x7fa8e40f81a0 msgr2=0x7fa8e4103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 shutdown_connections 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:44.998+0000 7fa8ebf69700 1 -- 172.21.15.79:0/3232913558 wait complete. 2024-05-09T06:21:44.982 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:21:45.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:45 smithi062 ceph-mon[26920]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:45.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:45 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/3232913558' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:21:46.529 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:21:46.529 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:21:46.777 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:46.837 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:47.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:47 smithi062 ceph-mon[26920]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.311+0000 7f97e3d27700 1 -- 172.21.15.79:0/3136982333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 msgr2=0x7f97dc0fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.311+0000 7f97e3d27700 1 --2- 172.21.15.79:0/3136982333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 0x7f97dc0fbd40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97d80048c0 tx=0x7f97d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.311+0000 7f97e3d27700 1 -- 172.21.15.79:0/3136982333 shutdown_connections 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.311+0000 7f97e3d27700 1 --2- 172.21.15.79:0/3136982333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 0x7f97dc0fbd40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.311+0000 7f97e3d27700 1 -- 172.21.15.79:0/3136982333 >> 172.21.15.79:0/3136982333 conn(0x7f97dc0f7070 msgr2=0x7f97dc0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.311+0000 7f97e3d27700 1 -- 172.21.15.79:0/3136982333 shutdown_connections 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.311+0000 7f97e3d27700 1 -- 172.21.15.79:0/3136982333 wait complete. 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.312+0000 7f97e3d27700 1 Processor -- start 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.312+0000 7f97e3d27700 1 -- start start 2024-05-09T06:21:48.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.312+0000 7f97e3d27700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 0x7f97dc066880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.312+0000 7f97e3d27700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc10fd70 con 0x7f97dc0fb930 2024-05-09T06:21:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.312+0000 7f97e1ac3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 0x7f97dc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.312+0000 7f97e1ac3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 0x7f97dc066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:59930/0 (socket says 172.21.15.79:59930) 2024-05-09T06:21:48.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.312+0000 7f97e1ac3700 1 -- 172.21.15.79:0/289767426 learned_addr learned my addr 172.21.15.79:0/289767426 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.312+0000 7f97e1ac3700 1 -- 172.21.15.79:0/289767426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8005040 con 0x7f97dc0fb930 2024-05-09T06:21:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.313+0000 7f97e1ac3700 1 --2- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 0x7f97dc066880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f97d80096b0 tx=0x7f97d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.313+0000 7f97d27fc700 1 -- 172.21.15.79:0/289767426 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97d800bed0 con 0x7f97dc0fb930 2024-05-09T06:21:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.313+0000 7f97d27fc700 1 -- 172.21.15.79:0/289767426 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97d800b5c0 con 0x7f97dc0fb930 2024-05-09T06:21:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.313+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc10ff10 con 0x7f97dc0fb930 2024-05-09T06:21:48.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.313+0000 7f97d27fc700 1 -- 172.21.15.79:0/289767426 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97d801c5b0 con 0x7f97dc0fb930 2024-05-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.313+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc1103a0 con 0x7f97dc0fb930 2024-05-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.314+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc1058f0 con 0x7f97dc0fb930 2024-05-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.314+0000 7f97d27fc700 1 -- 172.21.15.79:0/289767426 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f97d8013a80 con 0x7f97dc0fb930 2024-05-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.314+0000 7f97d27fc700 1 --2- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f97c8036880 0x7f97c8038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.314+0000 7f97d27fc700 1 -- 172.21.15.79:0/289767426 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f97d80499f0 con 0x7f97dc0fb930 2024-05-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.314+0000 7f97e12c2700 1 --2- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f97c8036880 0x7f97c8038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:48.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.315+0000 7f97e12c2700 1 --2- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f97c8036880 0x7f97c8038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009990 tx=0x7f97cc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:48.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.319+0000 7f97d27fc700 1 -- 172.21.15.79:0/289767426 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f97d8011940 con 0x7f97dc0fb930 2024-05-09T06:21:48.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.577+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f97dc05f5c0 con 0x7f97dc0fb930 2024-05-09T06:21:48.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.578+0000 7f97d27fc700 1 -- 172.21.15.79:0/289767426 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f97d8011370 con 0x7f97dc0fb930 2024-05-09T06:21:48.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:21:48.561 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f97c8036880 msgr2=0x7f97c8038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 --2- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f97c8036880 0x7f97c8038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009990 tx=0x7f97cc006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 msgr2=0x7f97dc066880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 --2- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 0x7f97dc066880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f97d80096b0 tx=0x7f97d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 shutdown_connections 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 --2- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f97c8036880 0x7f97c8038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 --2- 172.21.15.79:0/289767426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97dc0fb930 0x7f97dc066880 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 >> 172.21.15.79:0/289767426 conn(0x7f97dc0f7070 msgr2=0x7f97dc102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 shutdown_connections 2024-05-09T06:21:48.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:48.580+0000 7f97e3d27700 1 -- 172.21.15.79:0/289767426 wait complete. 2024-05-09T06:21:48.564 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:21:48.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:48 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/289767426' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:21:49.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:49 smithi062 ceph-mon[26920]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:50.151 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:21:50.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:21:50.409 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:50.457 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:51.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.867+0000 7f0eeb947700 1 -- 172.21.15.79:0/3155603485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 msgr2=0x7f0ee40fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:51.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.867+0000 7f0eeb947700 1 --2- 172.21.15.79:0/3155603485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 0x7f0ee40fce40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00048c0 tx=0x7f0ee0009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.867+0000 7f0eeb947700 1 -- 172.21.15.79:0/3155603485 shutdown_connections 2024-05-09T06:21:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.867+0000 7f0eeb947700 1 --2- 172.21.15.79:0/3155603485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 0x7f0ee40fce40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.867+0000 7f0eeb947700 1 -- 172.21.15.79:0/3155603485 >> 172.21.15.79:0/3155603485 conn(0x7f0ee40f8170 msgr2=0x7f0ee40fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.867+0000 7f0eeb947700 1 -- 172.21.15.79:0/3155603485 shutdown_connections 2024-05-09T06:21:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.867+0000 7f0eeb947700 1 -- 172.21.15.79:0/3155603485 wait complete. 2024-05-09T06:21:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.868+0000 7f0eeb947700 1 Processor -- start 2024-05-09T06:21:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.868+0000 7f0eeb947700 1 -- start start 2024-05-09T06:21:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.868+0000 7f0eeb947700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 0x7f0ee410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.868+0000 7f0eeb947700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee410d5f0 con 0x7f0ee40fca30 2024-05-09T06:21:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.868+0000 7f0ee96e3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 0x7f0ee410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.868+0000 7f0ee96e3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 0x7f0ee410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:59950/0 (socket says 172.21.15.79:59950) 2024-05-09T06:21:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.868+0000 7f0ee96e3700 1 -- 172.21.15.79:0/1485062599 learned_addr learned my addr 172.21.15.79:0/1485062599 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.868+0000 7f0ee96e3700 1 -- 172.21.15.79:0/1485062599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0005040 con 0x7f0ee40fca30 2024-05-09T06:21:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.869+0000 7f0ee96e3700 1 --2- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 0x7f0ee410d0b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00096b0 tx=0x7f0ee0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.869+0000 7f0ed5ffb700 1 -- 172.21.15.79:0/1485062599 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ee000bed0 con 0x7f0ee40fca30 2024-05-09T06:21:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.869+0000 7f0ed5ffb700 1 -- 172.21.15.79:0/1485062599 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ee000b5c0 con 0x7f0ee40fca30 2024-05-09T06:21:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.869+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee410d7f0 con 0x7f0ee40fca30 2024-05-09T06:21:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.869+0000 7f0ed5ffb700 1 -- 172.21.15.79:0/1485062599 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ee001c5b0 con 0x7f0ee40fca30 2024-05-09T06:21:51.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.869+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee410e360 con 0x7f0ee40fca30 2024-05-09T06:21:51.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.870+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee4102f40 con 0x7f0ee40fca30 2024-05-09T06:21:51.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.870+0000 7f0ed5ffb700 1 -- 172.21.15.79:0/1485062599 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f0ee0013a80 con 0x7f0ee40fca30 2024-05-09T06:21:51.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.870+0000 7f0ed5ffb700 1 --2- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f0ed0036880 0x7f0ed0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:51.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.870+0000 7f0ed5ffb700 1 -- 172.21.15.79:0/1485062599 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0ee0049a80 con 0x7f0ee40fca30 2024-05-09T06:21:51.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.870+0000 7f0ee8ee2700 1 --2- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f0ed0036880 0x7f0ed0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:51.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.871+0000 7f0ee8ee2700 1 --2- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f0ed0036880 0x7f0ed0038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009990 tx=0x7f0ed8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:51.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:51.875+0000 7f0ed5ffb700 1 -- 172.21.15.79:0/1485062599 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0ee0011960 con 0x7f0ee40fca30 2024-05-09T06:21:51.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:51 smithi062 ceph-mon[26920]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.134+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0ee410ed70 con 0x7f0ee40fca30 2024-05-09T06:21:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.135+0000 7f0ed5ffb700 1 -- 172.21.15.79:0/1485062599 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0ee0011370 con 0x7f0ee40fca30 2024-05-09T06:21:52.118 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:21:52.118 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:21:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f0ed0036880 msgr2=0x7f0ed0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 --2- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f0ed0036880 0x7f0ed0038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009990 tx=0x7f0ed8006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 msgr2=0x7f0ee410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 --2- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 0x7f0ee410d0b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00096b0 tx=0x7f0ee0009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 shutdown_connections 2024-05-09T06:21:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 --2- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f0ed0036880 0x7f0ed0038d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 --2- 172.21.15.79:0/1485062599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee40fca30 0x7f0ee410d0b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 >> 172.21.15.79:0/1485062599 conn(0x7f0ee40f8170 msgr2=0x7f0ee4103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 shutdown_connections 2024-05-09T06:21:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:52.137+0000 7f0eeb947700 1 -- 172.21.15.79:0/1485062599 wait complete. 2024-05-09T06:21:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:21:52.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:52 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/1485062599' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:21:53.656 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:21:53.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:21:53.858 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:53 smithi062 ceph-mon[26920]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:53.907 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:53.954 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:55.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.398+0000 7f3d72f89700 1 -- 172.21.15.79:0/4035775493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 msgr2=0x7f3d6c0ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:55.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.398+0000 7f3d72f89700 1 --2- 172.21.15.79:0/4035775493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 0x7f3d6c0ff6b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d600048c0 tx=0x7f3d60009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:55.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.398+0000 7f3d72f89700 1 -- 172.21.15.79:0/4035775493 shutdown_connections 2024-05-09T06:21:55.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.398+0000 7f3d72f89700 1 --2- 172.21.15.79:0/4035775493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 0x7f3d6c0ff6b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:55.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.398+0000 7f3d72f89700 1 -- 172.21.15.79:0/4035775493 >> 172.21.15.79:0/4035775493 conn(0x7f3d6c0f70a0 msgr2=0x7f3d6c0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:55.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.398+0000 7f3d72f89700 1 -- 172.21.15.79:0/4035775493 shutdown_connections 2024-05-09T06:21:55.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.398+0000 7f3d72f89700 1 -- 172.21.15.79:0/4035775493 wait complete. 2024-05-09T06:21:55.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.398+0000 7f3d72f89700 1 Processor -- start 2024-05-09T06:21:55.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.399+0000 7f3d72f89700 1 -- start start 2024-05-09T06:21:55.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.399+0000 7f3d72f89700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 0x7f3d6c10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:55.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.399+0000 7f3d72f89700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c10d610 con 0x7f3d6c066940 2024-05-09T06:21:55.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.399+0000 7f3d70d25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 0x7f3d6c10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:55.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.399+0000 7f3d70d25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 0x7f3d6c10d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:60226/0 (socket says 172.21.15.79:60226) 2024-05-09T06:21:55.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.399+0000 7f3d70d25700 1 -- 172.21.15.79:0/2406239029 learned_addr learned my addr 172.21.15.79:0/2406239029 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:55.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.399+0000 7f3d70d25700 1 -- 172.21.15.79:0/2406239029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60005040 con 0x7f3d6c066940 2024-05-09T06:21:55.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.400+0000 7f3d70d25700 1 --2- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 0x7f3d6c10d0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009680 tx=0x7f3d60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:55.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.400+0000 7f3d697fa700 1 -- 172.21.15.79:0/2406239029 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d6000bed0 con 0x7f3d6c066940 2024-05-09T06:21:55.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.400+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c10d810 con 0x7f3d6c066940 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.400+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c10e380 con 0x7f3d6c066940 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.400+0000 7f3d697fa700 1 -- 172.21.15.79:0/2406239029 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d6000b5c0 con 0x7f3d6c066940 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.400+0000 7f3d697fa700 1 -- 172.21.15.79:0/2406239029 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d600255c0 con 0x7f3d6c066940 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.401+0000 7f3d697fa700 1 -- 172.21.15.79:0/2406239029 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f3d6001c3f0 con 0x7f3d6c066940 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.401+0000 7f3d697fa700 1 --2- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3d5c036880 0x7f3d5c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.401+0000 7f3d697fa700 1 -- 172.21.15.79:0/2406239029 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3d600499e0 con 0x7f3d6c066940 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.401+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c102f40 con 0x7f3d6c066940 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.401+0000 7f3d6bfff700 1 --2- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3d5c036880 0x7f3d5c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:55.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.402+0000 7f3d6bfff700 1 --2- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3d5c036880 0x7f3d5c038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009990 tx=0x7f3d58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:55.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.406+0000 7f3d697fa700 1 -- 172.21.15.79:0/2406239029 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3d6001a8e0 con 0x7f3d6c066940 2024-05-09T06:21:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.665+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3d6c1028b0 con 0x7f3d6c066940 2024-05-09T06:21:55.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.666+0000 7f3d697fa700 1 -- 172.21.15.79:0/2406239029 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3d60034090 con 0x7f3d6c066940 2024-05-09T06:21:55.649 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:21:55.649 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:21:55.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3d5c036880 msgr2=0x7f3d5c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 --2- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3d5c036880 0x7f3d5c038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009990 tx=0x7f3d58006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 msgr2=0x7f3d6c10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 --2- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 0x7f3d6c10d0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009680 tx=0x7f3d60009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 shutdown_connections 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 --2- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f3d5c036880 0x7f3d5c038d30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 --2- 172.21.15.79:0/2406239029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d6c066940 0x7f3d6c10d0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 >> 172.21.15.79:0/2406239029 conn(0x7f3d6c0f70a0 msgr2=0x7f3d6c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 shutdown_connections 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:55.668+0000 7f3d72f89700 1 -- 172.21.15.79:0/2406239029 wait complete. 2024-05-09T06:21:55.652 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:21:55.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:55 smithi062 ceph-mon[26920]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:55.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:55 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2406239029' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:21:57.202 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:21:57.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:21:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:57.497 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:21:57.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:57 smithi062 ceph-mon[26920]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:57.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:57 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:57.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:57 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:57.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:57 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:57.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:57 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:57.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:57 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:57.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:57 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:21:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.893+0000 7fc86d1f3700 1 -- 172.21.15.79:0/3759869924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 msgr2=0x7fc8680fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.893+0000 7fc86d1f3700 1 --2- 172.21.15.79:0/3759869924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 0x7fc8680fce40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8580048c0 tx=0x7fc858009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.893+0000 7fc86d1f3700 1 -- 172.21.15.79:0/3759869924 shutdown_connections 2024-05-09T06:21:58.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.893+0000 7fc86d1f3700 1 --2- 172.21.15.79:0/3759869924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 0x7fc8680fce40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.893+0000 7fc86d1f3700 1 -- 172.21.15.79:0/3759869924 >> 172.21.15.79:0/3759869924 conn(0x7fc8680f8170 msgr2=0x7fc8680fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.894+0000 7fc86d1f3700 1 -- 172.21.15.79:0/3759869924 shutdown_connections 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.894+0000 7fc86d1f3700 1 -- 172.21.15.79:0/3759869924 wait complete. 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.894+0000 7fc86d1f3700 1 Processor -- start 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.894+0000 7fc86d1f3700 1 -- start start 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.894+0000 7fc86d1f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 0x7fc868071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.894+0000 7fc86d1f3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868072240 con 0x7fc8680fca30 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc866d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 0x7fc868071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc866d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 0x7fc868071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:60250/0 (socket says 172.21.15.79:60250) 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc866d9d700 1 -- 172.21.15.79:0/97443779 learned_addr learned my addr 172.21.15.79:0/97443779 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc866d9d700 1 -- 172.21.15.79:0/97443779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858005040 con 0x7fc8680fca30 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc866d9d700 1 --2- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 0x7fc868071d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc858009680 tx=0x7fc858009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc85f7fe700 1 -- 172.21.15.79:0/97443779 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc85800b5c0 con 0x7fc8680fca30 2024-05-09T06:21:58.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc85f7fe700 1 -- 172.21.15.79:0/97443779 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc85800be70 con 0x7fc8680fca30 2024-05-09T06:21:58.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc868070310 con 0x7fc8680fca30 2024-05-09T06:21:58.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc85f7fe700 1 -- 172.21.15.79:0/97443779 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8580135a0 con 0x7fc8680fca30 2024-05-09T06:21:58.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.895+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc868070800 con 0x7fc8680fca30 2024-05-09T06:21:58.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.896+0000 7fc85f7fe700 1 -- 172.21.15.79:0/97443779 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fc85801c430 con 0x7fc8680fca30 2024-05-09T06:21:58.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.896+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86805f5c0 con 0x7fc8680fca30 2024-05-09T06:21:58.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.896+0000 7fc85f7fe700 1 --2- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc854036880 0x7fc854038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:58.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.896+0000 7fc85f7fe700 1 -- 172.21.15.79:0/97443779 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc858049470 con 0x7fc8680fca30 2024-05-09T06:21:58.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.896+0000 7fc86659c700 1 --2- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc854036880 0x7fc854038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:58.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.897+0000 7fc86659c700 1 --2- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc854036880 0x7fc854038d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc850009990 tx=0x7fc850006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:58.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:58.901+0000 7fc85f7fe700 1 -- 172.21.15.79:0/97443779 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc85801c7d0 con 0x7fc8680fca30 2024-05-09T06:21:58.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:58 smithi062 ceph-mon[26920]: Deploying daemon prometheus.smithi062 on smithi062 2024-05-09T06:21:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.164+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc86804bed0 con 0x7fc8680fca30 2024-05-09T06:21:59.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.164+0000 7fc85f7fe700 1 -- 172.21.15.79:0/97443779 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc858021020 con 0x7fc8680fca30 2024-05-09T06:21:59.148 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:21:59.148 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc854036880 msgr2=0x7fc854038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 --2- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc854036880 0x7fc854038d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc850009990 tx=0x7fc850006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 msgr2=0x7fc868071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 --2- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 0x7fc868071d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc858009680 tx=0x7fc858009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 shutdown_connections 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 --2- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc854036880 0x7fc854038d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 --2- 172.21.15.79:0/97443779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8680fca30 0x7fc868071d00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 >> 172.21.15.79:0/97443779 conn(0x7fc8680f8170 msgr2=0x7fc868103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 shutdown_connections 2024-05-09T06:21:59.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:21:59.167+0000 7fc86d1f3700 1 -- 172.21.15.79:0/97443779 wait complete. 2024-05-09T06:21:59.151 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:21:59.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:59 smithi062 ceph-mon[26920]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:59.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:21:59 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/97443779' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:00.691 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:00.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:00.944 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:00.992 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:01.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:01 smithi062 ceph-mon[26920]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:01.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:01 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.437+0000 7fef574e4700 1 -- 172.21.15.79:0/2198619730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 msgr2=0x7fef500fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.437+0000 7fef574e4700 1 --2- 172.21.15.79:0/2198619730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 0x7fef500fce40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fef440048c0 tx=0x7fef44009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.437+0000 7fef574e4700 1 -- 172.21.15.79:0/2198619730 shutdown_connections 2024-05-09T06:22:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.437+0000 7fef574e4700 1 --2- 172.21.15.79:0/2198619730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 0x7fef500fce40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.437+0000 7fef574e4700 1 -- 172.21.15.79:0/2198619730 >> 172.21.15.79:0/2198619730 conn(0x7fef500f8170 msgr2=0x7fef500fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.437+0000 7fef574e4700 1 -- 172.21.15.79:0/2198619730 shutdown_connections 2024-05-09T06:22:02.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.438+0000 7fef574e4700 1 -- 172.21.15.79:0/2198619730 wait complete. 2024-05-09T06:22:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.438+0000 7fef574e4700 1 Processor -- start 2024-05-09T06:22:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.438+0000 7fef574e4700 1 -- start start 2024-05-09T06:22:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.438+0000 7fef574e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 0x7fef5010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.438+0000 7fef574e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5010d5f0 con 0x7fef500fca30 2024-05-09T06:22:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.438+0000 7fef55280700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 0x7fef5010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.438+0000 7fef55280700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 0x7fef5010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:60276/0 (socket says 172.21.15.79:60276) 2024-05-09T06:22:02.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.438+0000 7fef55280700 1 -- 172.21.15.79:0/2061146897 learned_addr learned my addr 172.21.15.79:0/2061146897 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:02.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.439+0000 7fef55280700 1 -- 172.21.15.79:0/2061146897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44005040 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.439+0000 7fef55280700 1 --2- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 0x7fef5010d0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fef440096b0 tx=0x7fef44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.439+0000 7fef41ffb700 1 -- 172.21.15.79:0/2061146897 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef4400bed0 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.439+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5010d7f0 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.439+0000 7fef41ffb700 1 -- 172.21.15.79:0/2061146897 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef4400b5c0 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.439+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5010e360 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.439+0000 7fef41ffb700 1 -- 172.21.15.79:0/2061146897 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef44025560 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.440+0000 7fef41ffb700 1 -- 172.21.15.79:0/2061146897 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fef44013420 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.440+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50102f40 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.440+0000 7fef41ffb700 1 --2- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fef3c036880 0x7fef3c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.440+0000 7fef41ffb700 1 -- 172.21.15.79:0/2061146897 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fef440499f0 con 0x7fef500fca30 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.440+0000 7fef54a7f700 1 --2- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fef3c036880 0x7fef3c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:02.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.441+0000 7fef54a7f700 1 --2- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fef3c036880 0x7fef3c038d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009990 tx=0x7fef4c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:02.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.445+0000 7fef41ffb700 1 -- 172.21.15.79:0/2061146897 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fef440256c0 con 0x7fef500fca30 2024-05-09T06:22:02.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.709+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fef5010ed70 con 0x7fef500fca30 2024-05-09T06:22:02.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.710+0000 7fef41ffb700 1 -- 172.21.15.79:0/2061146897 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fef44004d30 con 0x7fef500fca30 2024-05-09T06:22:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:02.694 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:02.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.712+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fef3c036880 msgr2=0x7fef3c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:02.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.712+0000 7fef574e4700 1 --2- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fef3c036880 0x7fef3c038d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009990 tx=0x7fef4c006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.712+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 msgr2=0x7fef5010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.712+0000 7fef574e4700 1 --2- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 0x7fef5010d0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fef440096b0 tx=0x7fef44009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.713+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 shutdown_connections 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.713+0000 7fef574e4700 1 --2- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fef3c036880 0x7fef3c038d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.713+0000 7fef574e4700 1 --2- 172.21.15.79:0/2061146897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef500fca30 0x7fef5010d0b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.713+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 >> 172.21.15.79:0/2061146897 conn(0x7fef500f8170 msgr2=0x7fef50103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.713+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 shutdown_connections 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:02.713+0000 7fef574e4700 1 -- 172.21.15.79:0/2061146897 wait complete. 2024-05-09T06:22:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:03.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:03 smithi062 ceph-mon[26920]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:03.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:03 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2061146897' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:04.438 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:04.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:04.737 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:05.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:05 smithi062 ceph-mon[26920]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.149+0000 7f278a1e4700 1 -- 172.21.15.79:0/449186174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 msgr2=0x7f27840fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.149+0000 7f278a1e4700 1 --2- 172.21.15.79:0/449186174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 0x7f27840fbd40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f27740048c0 tx=0x7f2774009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.149+0000 7f278a1e4700 1 -- 172.21.15.79:0/449186174 shutdown_connections 2024-05-09T06:22:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.149+0000 7f278a1e4700 1 --2- 172.21.15.79:0/449186174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 0x7f27840fbd40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.149+0000 7f278a1e4700 1 -- 172.21.15.79:0/449186174 >> 172.21.15.79:0/449186174 conn(0x7f27840f7070 msgr2=0x7f27840f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.150+0000 7f278a1e4700 1 -- 172.21.15.79:0/449186174 shutdown_connections 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.150+0000 7f278a1e4700 1 -- 172.21.15.79:0/449186174 wait complete. 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.150+0000 7f278a1e4700 1 Processor -- start 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.150+0000 7f278a1e4700 1 -- start start 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.150+0000 7f278a1e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 0x7f278410d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.150+0000 7f278a1e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278410d600 con 0x7f27840fb930 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f27837fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 0x7f278410d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f27837fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 0x7f278410d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:54968/0 (socket says 172.21.15.79:54968) 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f27837fe700 1 -- 172.21.15.79:0/3603584033 learned_addr learned my addr 172.21.15.79:0/3603584033 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f27837fe700 1 -- 172.21.15.79:0/3603584033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2774005040 con 0x7f27840fb930 2024-05-09T06:22:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f27837fe700 1 --2- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 0x7f278410d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27740096b0 tx=0x7f2774009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f277bfff700 1 -- 172.21.15.79:0/3603584033 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f277400bed0 con 0x7f27840fb930 2024-05-09T06:22:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f277bfff700 1 -- 172.21.15.79:0/3603584033 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f277400b5c0 con 0x7f27840fb930 2024-05-09T06:22:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278410d800 con 0x7f27840fb930 2024-05-09T06:22:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f277bfff700 1 -- 172.21.15.79:0/3603584033 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f277401c5b0 con 0x7f27840fb930 2024-05-09T06:22:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.151+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278410e370 con 0x7f27840fb930 2024-05-09T06:22:06.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.152+0000 7f277bfff700 1 -- 172.21.15.79:0/3603584033 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f277401c820 con 0x7f27840fb930 2024-05-09T06:22:06.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.152+0000 7f277bfff700 1 --2- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f2770036880 0x7f2770038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:06.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.152+0000 7f277bfff700 1 -- 172.21.15.79:0/3603584033 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2774049b40 con 0x7f27840fb930 2024-05-09T06:22:06.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.152+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784101e40 con 0x7f27840fb930 2024-05-09T06:22:06.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.152+0000 7f2782ffd700 1 --2- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f2770036880 0x7f2770038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:06.138 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.153+0000 7f2782ffd700 1 --2- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f2770036880 0x7f2770038d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f276c009990 tx=0x7f276c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:06.140 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.158+0000 7f277bfff700 1 -- 172.21.15.79:0/3603584033 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2774023300 con 0x7f27840fb930 2024-05-09T06:22:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.417+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2784101770 con 0x7f27840fb930 2024-05-09T06:22:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.417+0000 7f277bfff700 1 -- 172.21.15.79:0/3603584033 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2774011b10 con 0x7f27840fb930 2024-05-09T06:22:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:06.400 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f2770036880 msgr2=0x7f2770038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 --2- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f2770036880 0x7f2770038d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f276c009990 tx=0x7f276c006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 msgr2=0x7f278410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 --2- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 0x7f278410d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27740096b0 tx=0x7f2774009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 shutdown_connections 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 --2- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f2770036880 0x7f2770038d30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 --2- 172.21.15.79:0/3603584033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27840fb930 0x7f278410d0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 >> 172.21.15.79:0/3603584033 conn(0x7f27840f7070 msgr2=0x7f2784065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 shutdown_connections 2024-05-09T06:22:06.402 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:06.419+0000 7f278a1e4700 1 -- 172.21.15.79:0/3603584033 wait complete. 2024-05-09T06:22:06.403 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:06.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:06 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/3603584033' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:07.866 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:07.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:07.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:07 smithi062 ceph-mon[26920]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:08.117 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:08.165 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:09.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.622+0000 7f50925a9700 1 -- 172.21.15.79:0/2342246683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 msgr2=0x7f508c0fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.622+0000 7f50925a9700 1 --2- 172.21.15.79:0/2342246683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 0x7f508c0fd410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f507c0048c0 tx=0x7f507c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.622+0000 7f50925a9700 1 -- 172.21.15.79:0/2342246683 shutdown_connections 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.622+0000 7f50925a9700 1 --2- 172.21.15.79:0/2342246683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 0x7f508c0fd410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.622+0000 7f50925a9700 1 -- 172.21.15.79:0/2342246683 >> 172.21.15.79:0/2342246683 conn(0x7f508c0f7070 msgr2=0x7f508c0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.622+0000 7f50925a9700 1 -- 172.21.15.79:0/2342246683 shutdown_connections 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.622+0000 7f50925a9700 1 -- 172.21.15.79:0/2342246683 wait complete. 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.622+0000 7f50925a9700 1 Processor -- start 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f50925a9700 1 -- start start 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f50925a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 0x7f508c113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f50925a9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c113c80 con 0x7f508c0669a0 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f508bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 0x7f508c113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f508bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 0x7f508c113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:54982/0 (socket says 172.21.15.79:54982) 2024-05-09T06:22:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f508bfff700 1 -- 172.21.15.79:0/599632424 learned_addr learned my addr 172.21.15.79:0/599632424 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f508bfff700 1 -- 172.21.15.79:0/599632424 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c005040 con 0x7f508c0669a0 2024-05-09T06:22:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f508bfff700 1 --2- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 0x7f508c113740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f507c009680 tx=0x7f507c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f50897fa700 1 -- 172.21.15.79:0/599632424 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f507c00bed0 con 0x7f508c0669a0 2024-05-09T06:22:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.623+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c113e80 con 0x7f508c0669a0 2024-05-09T06:22:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.624+0000 7f50897fa700 1 -- 172.21.15.79:0/599632424 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f507c00b5c0 con 0x7f508c0669a0 2024-05-09T06:22:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.624+0000 7f50897fa700 1 -- 172.21.15.79:0/599632424 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f507c01c5b0 con 0x7f508c0669a0 2024-05-09T06:22:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.624+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c1149a0 con 0x7f508c0669a0 2024-05-09T06:22:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.624+0000 7f50897fa700 1 -- 172.21.15.79:0/599632424 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f507c01c710 con 0x7f508c0669a0 2024-05-09T06:22:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.625+0000 7f50897fa700 1 --2- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f50780368d0 0x7f5078038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.625+0000 7f50897fa700 1 -- 172.21.15.79:0/599632424 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f507c049a40 con 0x7f508c0669a0 2024-05-09T06:22:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.625+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c100d20 con 0x7f508c0669a0 2024-05-09T06:22:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.625+0000 7f5083fff700 1 --2- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f50780368d0 0x7f5078038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.625+0000 7f5083fff700 1 --2- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f50780368d0 0x7f5078038d80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5074009990 tx=0x7f5074006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:09.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.630+0000 7f50897fa700 1 -- 172.21.15.79:0/599632424 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f507c025400 con 0x7f508c0669a0 2024-05-09T06:22:09.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.887+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f508c1006e0 con 0x7f508c0669a0 2024-05-09T06:22:09.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.888+0000 7f50897fa700 1 -- 172.21.15.79:0/599632424 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f508c1006e0 con 0x7f508c0669a0 2024-05-09T06:22:09.871 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:09.871 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f50780368d0 msgr2=0x7f5078038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 --2- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f50780368d0 0x7f5078038d80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5074009990 tx=0x7f5074006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 msgr2=0x7f508c113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 --2- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 0x7f508c113740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f507c009680 tx=0x7f507c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 shutdown_connections 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 --2- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f50780368d0 0x7f5078038d80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 --2- 172.21.15.79:0/599632424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f508c0669a0 0x7f508c113740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 >> 172.21.15.79:0/599632424 conn(0x7f508c0f7070 msgr2=0x7f508c10a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 shutdown_connections 2024-05-09T06:22:09.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:09.890+0000 7f50925a9700 1 -- 172.21.15.79:0/599632424 wait complete. 2024-05-09T06:22:09.874 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:09.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:09 smithi062 ceph-mon[26920]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:10.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:10 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/599632424' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:11.477 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:11.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:11.729 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:11.778 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:11.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:11 smithi062 ceph-mon[26920]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.164+0000 7fc4d81e4700 1 -- 172.21.15.79:0/3072154569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 msgr2=0x7fc4d00fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.164+0000 7fc4d81e4700 1 --2- 172.21.15.79:0/3072154569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 0x7fc4d00fd430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00048c0 tx=0x7fc4c0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.164+0000 7fc4d81e4700 1 -- 172.21.15.79:0/3072154569 shutdown_connections 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.164+0000 7fc4d81e4700 1 --2- 172.21.15.79:0/3072154569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 0x7fc4d00fd430 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.164+0000 7fc4d81e4700 1 -- 172.21.15.79:0/3072154569 >> 172.21.15.79:0/3072154569 conn(0x7fc4d00f70a0 msgr2=0x7fc4d00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.164+0000 7fc4d81e4700 1 -- 172.21.15.79:0/3072154569 shutdown_connections 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.164+0000 7fc4d81e4700 1 -- 172.21.15.79:0/3072154569 wait complete. 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.165+0000 7fc4d81e4700 1 Processor -- start 2024-05-09T06:22:13.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.165+0000 7fc4d81e4700 1 -- start start 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.165+0000 7fc4d81e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 0x7fc4d010f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.165+0000 7fc4d81e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d010f800 con 0x7fc4d00fd020 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.165+0000 7fc4d5f80700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 0x7fc4d010f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.165+0000 7fc4d5f80700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 0x7fc4d010f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:37052/0 (socket says 172.21.15.79:37052) 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.165+0000 7fc4d5f80700 1 -- 172.21.15.79:0/781069717 learned_addr learned my addr 172.21.15.79:0/781069717 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.166+0000 7fc4d5f80700 1 -- 172.21.15.79:0/781069717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c0005040 con 0x7fc4d00fd020 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.166+0000 7fc4d5f80700 1 --2- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 0x7fc4d010f2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00096b0 tx=0x7fc4c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.166+0000 7fc4c67fc700 1 -- 172.21.15.79:0/781069717 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4c000bed0 con 0x7fc4d00fd020 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.166+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d010fa00 con 0x7fc4d00fd020 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.166+0000 7fc4c67fc700 1 -- 172.21.15.79:0/781069717 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4c000b5c0 con 0x7fc4d00fd020 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.166+0000 7fc4c67fc700 1 -- 172.21.15.79:0/781069717 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4c001c5b0 con 0x7fc4d00fd020 2024-05-09T06:22:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.166+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d0110570 con 0x7fc4d00fd020 2024-05-09T06:22:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.167+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d0101e40 con 0x7fc4d00fd020 2024-05-09T06:22:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.167+0000 7fc4c67fc700 1 -- 172.21.15.79:0/781069717 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fc4c0013a80 con 0x7fc4d00fd020 2024-05-09T06:22:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.167+0000 7fc4c67fc700 1 --2- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc4bc036880 0x7fc4bc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:13.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.167+0000 7fc4c67fc700 1 -- 172.21.15.79:0/781069717 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc4c0049a20 con 0x7fc4d00fd020 2024-05-09T06:22:13.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.167+0000 7fc4d577f700 1 --2- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc4bc036880 0x7fc4bc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:13.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.168+0000 7fc4d577f700 1 --2- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc4bc036880 0x7fc4bc038d30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009990 tx=0x7fc4cc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:13.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.172+0000 7fc4c67fc700 1 -- 172.21.15.79:0/781069717 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc4c0011940 con 0x7fc4d00fd020 2024-05-09T06:22:13.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.430+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc4d01107b0 con 0x7fc4d00fd020 2024-05-09T06:22:13.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.430+0000 7fc4c67fc700 1 -- 172.21.15.79:0/781069717 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc4c0011370 con 0x7fc4d00fd020 2024-05-09T06:22:13.414 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:13.414 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc4bc036880 msgr2=0x7fc4bc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 --2- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc4bc036880 0x7fc4bc038d30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009990 tx=0x7fc4cc006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 msgr2=0x7fc4d010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 --2- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 0x7fc4d010f2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00096b0 tx=0x7fc4c0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 shutdown_connections 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 --2- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fc4bc036880 0x7fc4bc038d30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 --2- 172.21.15.79:0/781069717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d00fd020 0x7fc4d010f2c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 >> 172.21.15.79:0/781069717 conn(0x7fc4d00f70a0 msgr2=0x7fc4d00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:13.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 shutdown_connections 2024-05-09T06:22:13.417 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:13.433+0000 7fc4d81e4700 1 -- 172.21.15.79:0/781069717 wait complete. 2024-05-09T06:22:13.417 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:13.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:13 smithi062 ceph-mon[26920]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:13.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:13 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/781069717' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:14.980 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:14.981 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:15.233 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:15.281 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:15.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:15 smithi062 ceph-mon[26920]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:16.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 -- 172.21.15.79:0/3814747880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 msgr2=0x7fbeb80fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:16.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 --2- 172.21.15.79:0/3814747880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 0x7fbeb80fce40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbea80048c0 tx=0x7fbea8009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:16.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 -- 172.21.15.79:0/3814747880 shutdown_connections 2024-05-09T06:22:16.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 --2- 172.21.15.79:0/3814747880 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 0x7fbeb80fce40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:16.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 -- 172.21.15.79:0/3814747880 >> 172.21.15.79:0/3814747880 conn(0x7fbeb80f8170 msgr2=0x7fbeb80fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:16.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 -- 172.21.15.79:0/3814747880 shutdown_connections 2024-05-09T06:22:16.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 -- 172.21.15.79:0/3814747880 wait complete. 2024-05-09T06:22:16.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 Processor -- start 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.710+0000 7fbebccbd700 1 -- start start 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbebccbd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 0x7fbeb8071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbebccbd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb8072240 con 0x7fbeb80fca30 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbeb659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 0x7fbeb8071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbeb659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 0x7fbeb8071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:37076/0 (socket says 172.21.15.79:37076) 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbeb659c700 1 -- 172.21.15.79:0/2013907291 learned_addr learned my addr 172.21.15.79:0/2013907291 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbeb659c700 1 -- 172.21.15.79:0/2013907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea8005040 con 0x7fbeb80fca30 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbeb659c700 1 --2- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 0x7fbeb8071d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbea80096b0 tx=0x7fbea8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbea6ffd700 1 -- 172.21.15.79:0/2013907291 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbea800bed0 con 0x7fbeb80fca30 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbea6ffd700 1 -- 172.21.15.79:0/2013907291 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbea800b5c0 con 0x7fbeb80fca30 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb8070310 con 0x7fbeb80fca30 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbea6ffd700 1 -- 172.21.15.79:0/2013907291 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbea801c5b0 con 0x7fbeb80fca30 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.711+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb8070800 con 0x7fbeb80fca30 2024-05-09T06:22:16.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.712+0000 7fbea6ffd700 1 -- 172.21.15.79:0/2013907291 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fbea8013420 con 0x7fbeb80fca30 2024-05-09T06:22:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.712+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb805f5c0 con 0x7fbeb80fca30 2024-05-09T06:22:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.712+0000 7fbea6ffd700 1 --2- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbea0036880 0x7fbea0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.712+0000 7fbea6ffd700 1 -- 172.21.15.79:0/2013907291 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbea8049b10 con 0x7fbeb80fca30 2024-05-09T06:22:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.713+0000 7fbeb5d9b700 1 --2- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbea0036880 0x7fbea0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:16.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.713+0000 7fbeb5d9b700 1 --2- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbea0036880 0x7fbea0038d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009990 tx=0x7fbeac006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.717+0000 7fbea6ffd700 1 -- 172.21.15.79:0/2013907291 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbea8025400 con 0x7fbeb80fca30 2024-05-09T06:22:16.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.981+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbeb8106410 con 0x7fbeb80fca30 2024-05-09T06:22:16.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.982+0000 7fbea6ffd700 1 -- 172.21.15.79:0/2013907291 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fbea8004d30 con 0x7fbeb80fca30 2024-05-09T06:22:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:16.965 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbea0036880 msgr2=0x7fbea0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 --2- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbea0036880 0x7fbea0038d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009990 tx=0x7fbeac006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 msgr2=0x7fbeb8071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 --2- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 0x7fbeb8071d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbea80096b0 tx=0x7fbea8009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 shutdown_connections 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 --2- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fbea0036880 0x7fbea0038d30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 --2- 172.21.15.79:0/2013907291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbeb80fca30 0x7fbeb8071d00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 >> 172.21.15.79:0/2013907291 conn(0x7fbeb80f8170 msgr2=0x7fbeb8103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 shutdown_connections 2024-05-09T06:22:16.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:16.984+0000 7fbebccbd700 1 -- 172.21.15.79:0/2013907291 wait complete. 2024-05-09T06:22:16.968 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:17.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:17 smithi062 ceph-mon[26920]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:17.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:17 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2013907291' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:18.575 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:18.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:18.823 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:20.070 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:19 smithi062 ceph-mon[26920]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.232+0000 7f2448189700 1 -- 172.21.15.79:0/568482845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 msgr2=0x7f24400fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.232+0000 7f2448189700 1 --2- 172.21.15.79:0/568482845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 0x7f24400fbd50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f243c0048c0 tx=0x7f243c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.232+0000 7f2448189700 1 -- 172.21.15.79:0/568482845 shutdown_connections 2024-05-09T06:22:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.232+0000 7f2448189700 1 --2- 172.21.15.79:0/568482845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 0x7f24400fbd50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.232+0000 7f2448189700 1 -- 172.21.15.79:0/568482845 >> 172.21.15.79:0/568482845 conn(0x7f24400f70a0 msgr2=0x7f24400f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.232+0000 7f2448189700 1 -- 172.21.15.79:0/568482845 shutdown_connections 2024-05-09T06:22:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.232+0000 7f2448189700 1 -- 172.21.15.79:0/568482845 wait complete. 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.233+0000 7f2448189700 1 Processor -- start 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.233+0000 7f2448189700 1 -- start start 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.233+0000 7f2448189700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 0x7f244010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.233+0000 7f2448189700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244010c4d0 con 0x7f24400fb940 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.233+0000 7f2445f25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 0x7f244010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.233+0000 7f2445f25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 0x7f244010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:37098/0 (socket says 172.21.15.79:37098) 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.233+0000 7f2445f25700 1 -- 172.21.15.79:0/3179451604 learned_addr learned my addr 172.21.15.79:0/3179451604 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.234+0000 7f2445f25700 1 -- 172.21.15.79:0/3179451604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c005040 con 0x7f24400fb940 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.234+0000 7f2445f25700 1 --2- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 0x7f244010bf90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f243c009680 tx=0x7f243c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.234+0000 7f24367fc700 1 -- 172.21.15.79:0/3179451604 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f243c00b5c0 con 0x7f24400fb940 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.234+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244010c6d0 con 0x7f24400fb940 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.234+0000 7f24367fc700 1 -- 172.21.15.79:0/3179451604 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f243c00be70 con 0x7f24400fb940 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.234+0000 7f24367fc700 1 -- 172.21.15.79:0/3179451604 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f243c0135a0 con 0x7f24400fb940 2024-05-09T06:22:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.234+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244010d240 con 0x7f24400fb940 2024-05-09T06:22:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.235+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2440101e50 con 0x7f24400fb940 2024-05-09T06:22:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.235+0000 7f24367fc700 1 -- 172.21.15.79:0/3179451604 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f243c004d30 con 0x7f24400fb940 2024-05-09T06:22:20.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.235+0000 7f24367fc700 1 --2- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f242c036880 0x7f242c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.235+0000 7f24367fc700 1 -- 172.21.15.79:0/3179451604 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f243c049420 con 0x7f24400fb940 2024-05-09T06:22:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.235+0000 7f2445724700 1 --2- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f242c036880 0x7f242c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.236+0000 7f2445724700 1 --2- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f242c036880 0x7f242c038d30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2430009990 tx=0x7f2430006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:20.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.240+0000 7f24367fc700 1 -- 172.21.15.79:0/3179451604 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f243c011960 con 0x7f24400fb940 2024-05-09T06:22:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.500+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f244010dd10 con 0x7f24400fb940 2024-05-09T06:22:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.500+0000 7f24367fc700 1 -- 172.21.15.79:0/3179451604 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f243c021020 con 0x7f24400fb940 2024-05-09T06:22:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:20.484 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f242c036880 msgr2=0x7f242c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 --2- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f242c036880 0x7f242c038d30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2430009990 tx=0x7f2430006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 msgr2=0x7f244010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 --2- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 0x7f244010bf90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f243c009680 tx=0x7f243c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 shutdown_connections 2024-05-09T06:22:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 --2- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f242c036880 0x7f242c038d30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 --2- 172.21.15.79:0/3179451604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24400fb940 0x7f244010bf90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 >> 172.21.15.79:0/3179451604 conn(0x7f24400f70a0 msgr2=0x7f2440102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 shutdown_connections 2024-05-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:20.502+0000 7f2448189700 1 -- 172.21.15.79:0/3179451604 wait complete. 2024-05-09T06:22:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:21.007 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:20 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/3179451604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:21.985 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:21.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:22.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:21 smithi062 ceph-mon[26920]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:22.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:21 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:22.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:21 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:22.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:21 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:22.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:21 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-09T06:22:22.237 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:22.291 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:23.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:23 smithi062 ceph-mon[26920]: from='mgr.14162 172.21.15.62:0/2377905201' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-09T06:22:23.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:23 smithi062 ceph-mon[26920]: mgrmap e14: smithi062.juuasl(active, since 81s) 2024-05-09T06:22:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.816+0000 7f6c22321700 1 -- 172.21.15.79:0/1357858756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 msgr2=0x7f6c1c0fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.816+0000 7f6c22321700 1 --2- 172.21.15.79:0/1357858756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 0x7f6c1c0fbd50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0048c0 tx=0x7f6c0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.816+0000 7f6c22321700 1 -- 172.21.15.79:0/1357858756 shutdown_connections 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.816+0000 7f6c22321700 1 --2- 172.21.15.79:0/1357858756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 0x7f6c1c0fbd50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.817+0000 7f6c22321700 1 -- 172.21.15.79:0/1357858756 >> 172.21.15.79:0/1357858756 conn(0x7f6c1c0f70a0 msgr2=0x7f6c1c0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.817+0000 7f6c22321700 1 -- 172.21.15.79:0/1357858756 shutdown_connections 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.817+0000 7f6c22321700 1 -- 172.21.15.79:0/1357858756 wait complete. 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.817+0000 7f6c22321700 1 Processor -- start 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.817+0000 7f6c22321700 1 -- start start 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.817+0000 7f6c22321700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 0x7f6c1c10f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.817+0000 7f6c22321700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c10f7c0 con 0x7f6c1c0fb940 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c1bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 0x7f6c1c10f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c1bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 0x7f6c1c10f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:50356/0 (socket says 172.21.15.79:50356) 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c1bfff700 1 -- 172.21.15.79:0/620826949 learned_addr learned my addr 172.21.15.79:0/620826949 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c1bfff700 1 -- 172.21.15.79:0/620826949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c005040 con 0x7f6c1c0fb940 2024-05-09T06:22:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c1bfff700 1 --2- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 0x7f6c1c10f280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0096b0 tx=0x7f6c0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c18ff9700 1 -- 172.21.15.79:0/620826949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0c00bed0 con 0x7f6c1c0fb940 2024-05-09T06:22:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c10f9c0 con 0x7f6c1c0fb940 2024-05-09T06:22:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c18ff9700 1 -- 172.21.15.79:0/620826949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c0c00b5c0 con 0x7f6c1c0fb940 2024-05-09T06:22:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c18ff9700 1 -- 172.21.15.79:0/620826949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0c01c5b0 con 0x7f6c1c0fb940 2024-05-09T06:22:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.818+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c110530 con 0x7f6c1c0fb940 2024-05-09T06:22:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.819+0000 7f6c18ff9700 1 -- 172.21.15.79:0/620826949 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f6c0c013420 con 0x7f6c1c0fb940 2024-05-09T06:22:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.819+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c101e50 con 0x7f6c1c0fb940 2024-05-09T06:22:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.819+0000 7f6c18ff9700 1 --2- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6c040368d0 0x7f6c04038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.819+0000 7f6c18ff9700 1 -- 172.21.15.79:0/620826949 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6c0c049b70 con 0x7f6c1c0fb940 2024-05-09T06:22:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.819+0000 7f6c1b7fe700 1 -- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6c040368d0 msgr2=0x7f6c04038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2116890721 2024-05-09T06:22:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.819+0000 7f6c1b7fe700 1 --2- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6c040368d0 0x7f6c04038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:22:23.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:23.824+0000 7f6c18ff9700 1 -- 172.21.15.79:0/620826949 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c0c025400 con 0x7f6c1c0fb940 2024-05-09T06:22:24.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.020+0000 7f6c1b7fe700 1 -- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6c040368d0 msgr2=0x7f6c04038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2116890721 2024-05-09T06:22:24.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.020+0000 7f6c1b7fe700 1 --2- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6c040368d0 0x7f6c04038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:22:24.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.083+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6c1c110770 con 0x7f6c1c0fb940 2024-05-09T06:22:24.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.083+0000 7f6c18ff9700 1 -- 172.21.15.79:0/620826949 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6c0c004d30 con 0x7f6c1c0fb940 2024-05-09T06:22:24.066 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:24.066 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:24.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6c040368d0 msgr2=0x7f6c04038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:22:24.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 --2- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6c040368d0 0x7f6c04038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:24.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 msgr2=0x7f6c1c10f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:24.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 --2- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 0x7f6c1c10f280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0096b0 tx=0x7f6c0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:24.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 shutdown_connections 2024-05-09T06:22:24.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 --2- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7f6c040368d0 0x7f6c04038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:24.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 --2- 172.21.15.79:0/620826949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c1c0fb940 0x7f6c1c10f280 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:24.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 >> 172.21.15.79:0/620826949 conn(0x7f6c1c0f70a0 msgr2=0x7f6c1c0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:24.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 shutdown_connections 2024-05-09T06:22:24.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:24.085+0000 7f6c22321700 1 -- 172.21.15.79:0/620826949 wait complete. 2024-05-09T06:22:24.069 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:24.620 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:24 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/620826949' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:25.638 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:25.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:25.889 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:25.937 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 -- 172.21.15.79:0/3568243762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 msgr2=0x7fad940fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 --2- 172.21.15.79:0/3568243762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 0x7fad940fbd50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad84009c60 tx=0x7fad84004d10 comp rx=0 tx=0).stop 2024-05-09T06:22:27.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 -- 172.21.15.79:0/3568243762 shutdown_connections 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 --2- 172.21.15.79:0/3568243762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 0x7fad940fbd50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 -- 172.21.15.79:0/3568243762 >> 172.21.15.79:0/3568243762 conn(0x7fad940f70a0 msgr2=0x7fad940f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 -- 172.21.15.79:0/3568243762 shutdown_connections 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 -- 172.21.15.79:0/3568243762 wait complete. 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 Processor -- start 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.370+0000 7fad99d18700 1 -- start start 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad99d18700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 0x7fad9410d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad99d18700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9410d600 con 0x7fad940fb940 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad937fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 0x7fad9410d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad937fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 0x7fad9410d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:50386/0 (socket says 172.21.15.79:50386) 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad937fe700 1 -- 172.21.15.79:0/2983206116 learned_addr learned my addr 172.21.15.79:0/2983206116 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad937fe700 1 -- 172.21.15.79:0/2983206116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009940 con 0x7fad940fb940 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad937fe700 1 --2- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 0x7fad9410d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad84009500 tx=0x7fad84004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:27.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad7bfff700 1 -- 172.21.15.79:0/2983206116 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad84007c80 con 0x7fad940fb940 2024-05-09T06:22:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad7bfff700 1 -- 172.21.15.79:0/2983206116 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad8401d910 con 0x7fad940fb940 2024-05-09T06:22:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9410d800 con 0x7fad940fb940 2024-05-09T06:22:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad7bfff700 1 -- 172.21.15.79:0/2983206116 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad840129d0 con 0x7fad940fb940 2024-05-09T06:22:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.371+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9410e370 con 0x7fad940fb940 2024-05-09T06:22:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.372+0000 7fad7bfff700 1 -- 172.21.15.79:0/2983206116 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7fad84019040 con 0x7fad940fb940 2024-05-09T06:22:27.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.372+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad94102f50 con 0x7fad940fb940 2024-05-09T06:22:27.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.372+0000 7fad7bfff700 1 --2- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fad7c0368d0 0x7fad7c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:27.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.372+0000 7fad7bfff700 1 -- 172.21.15.79:0/2983206116 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fad8404a470 con 0x7fad940fb940 2024-05-09T06:22:27.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.372+0000 7fad92ffd700 1 -- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fad7c0368d0 msgr2=0x7fad7c038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2116890721 2024-05-09T06:22:27.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.372+0000 7fad92ffd700 1 --2- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fad7c0368d0 0x7fad7c038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:22:27.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.377+0000 7fad7bfff700 1 -- 172.21.15.79:0/2983206116 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fad8402eb00 con 0x7fad940fb940 2024-05-09T06:22:27.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.573+0000 7fad92ffd700 1 -- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fad7c0368d0 msgr2=0x7fad7c038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2116890721 2024-05-09T06:22:27.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.573+0000 7fad92ffd700 1 --2- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fad7c0368d0 0x7fad7c038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:22:27.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.636+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fad9410ecd0 con 0x7fad940fb940 2024-05-09T06:22:27.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.636+0000 7fad7bfff700 1 -- 172.21.15.79:0/2983206116 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fad84017020 con 0x7fad940fb940 2024-05-09T06:22:27.619 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:27.619 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:27.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fad7c0368d0 msgr2=0x7fad7c038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:22:27.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 --2- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fad7c0368d0 0x7fad7c038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 msgr2=0x7fad9410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 --2- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 0x7fad9410d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad84009500 tx=0x7fad84004d10 comp rx=0 tx=0).stop 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 shutdown_connections 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 --2- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:6800/2116890721,v1:172.21.15.62:6801/2116890721] conn(0x7fad7c0368d0 0x7fad7c038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 --2- 172.21.15.79:0/2983206116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad940fb940 0x7fad9410d0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 >> 172.21.15.79:0/2983206116 conn(0x7fad940f70a0 msgr2=0x7fad94103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 shutdown_connections 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:27.638+0000 7fad99d18700 1 -- 172.21.15.79:0/2983206116 wait complete. 2024-05-09T06:22:27.622 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:27.885 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:27 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2983206116' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:29.183 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:29.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:29.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: Active manager daemon smithi062.juuasl restarted 2024-05-09T06:22:29.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: Activating manager daemon smithi062.juuasl 2024-05-09T06:22:29.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: osdmap e5: 0 total, 0 up, 0 in 2024-05-09T06:22:29.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: mgrmap e15: smithi062.juuasl(active, starting, since 0.00312052s) 2024-05-09T06:22:29.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:22:29.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:22:29.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:22:29.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:22:29.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:22:29.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: Manager daemon smithi062.juuasl is now available 2024-05-09T06:22:29.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:22:29.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:22:29.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:29.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:22:29.447 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:29.506 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:30.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:30 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:22:30.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:30 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/trash_purge_schedule"}]: dispatch 2024-05-09T06:22:30.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:30 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:30.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:30 smithi062 ceph-mon[26920]: mgrmap e16: smithi062.juuasl(active, since 1.00541s) 2024-05-09T06:22:30.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.841+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/611104882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 msgr2=0x7fc2bc0fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:30.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.841+0000 7fc2c0e4b700 1 --2- 172.21.15.79:0/611104882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 0x7fc2bc0fce40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0048c0 tx=0x7fc2ac009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:30.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.841+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/611104882 shutdown_connections 2024-05-09T06:22:30.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.841+0000 7fc2c0e4b700 1 --2- 172.21.15.79:0/611104882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 0x7fc2bc0fce40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:30.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.841+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/611104882 >> 172.21.15.79:0/611104882 conn(0x7fc2bc0f8170 msgr2=0x7fc2bc0fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:30.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.841+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/611104882 shutdown_connections 2024-05-09T06:22:30.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.841+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/611104882 wait complete. 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.842+0000 7fc2c0e4b700 1 Processor -- start 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.842+0000 7fc2c0e4b700 1 -- start start 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.842+0000 7fc2c0e4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 0x7fc2bc071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.842+0000 7fc2c0e4b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2bc072240 con 0x7fc2bc0fca30 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.842+0000 7fc2ba59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 0x7fc2bc071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.842+0000 7fc2ba59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 0x7fc2bc071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:50390/0 (socket says 172.21.15.79:50390) 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.842+0000 7fc2ba59c700 1 -- 172.21.15.79:0/935655566 learned_addr learned my addr 172.21.15.79:0/935655566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.843+0000 7fc2ba59c700 1 -- 172.21.15.79:0/935655566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac005040 con 0x7fc2bc0fca30 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.843+0000 7fc2ba59c700 1 --2- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 0x7fc2bc071d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0096b0 tx=0x7fc2ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.843+0000 7fc2b37fe700 1 -- 172.21.15.79:0/935655566 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2ac00bed0 con 0x7fc2bc0fca30 2024-05-09T06:22:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.843+0000 7fc2b37fe700 1 -- 172.21.15.79:0/935655566 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2ac00b5c0 con 0x7fc2bc0fca30 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.843+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2bc070310 con 0x7fc2bc0fca30 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.843+0000 7fc2b37fe700 1 -- 172.21.15.79:0/935655566 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2ac01c5b0 con 0x7fc2bc0fca30 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.843+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2bc070800 con 0x7fc2bc0fca30 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.844+0000 7fc2b37fe700 1 -- 172.21.15.79:0/935655566 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) v1 ==== 43297+0+0 (secure 0 0 0) 0x7fc2ac01c820 con 0x7fc2bc0fca30 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.844+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2bc05f5c0 con 0x7fc2bc0fca30 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.844+0000 7fc2b37fe700 1 --2- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc2a8036710 0x7fc2a8038bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.844+0000 7fc2b37fe700 1 -- 172.21.15.79:0/935655566 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc2ac0498b0 con 0x7fc2bc0fca30 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.844+0000 7fc2b1d9b700 1 --2- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc2a8036710 0x7fc2a8038bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:30.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.844+0000 7fc2b1d9b700 1 --2- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc2a8036710 0x7fc2a8038bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009990 tx=0x7fc2a4006e40 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:30.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:30.849+0000 7fc2b37fe700 1 -- 172.21.15.79:0/935655566 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc2ac023300 con 0x7fc2bc0fca30 2024-05-09T06:22:31.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.122+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc2bc04bed0 con 0x7fc2bc0fca30 2024-05-09T06:22:31.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.123+0000 7fc2b37fe700 1 -- 172.21.15.79:0/935655566 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc2ac011b60 con 0x7fc2bc0fca30 2024-05-09T06:22:31.106 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:31.106 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:31.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc2a8036710 msgr2=0x7fc2a8038bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:31.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 --2- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc2a8036710 0x7fc2a8038bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009990 tx=0x7fc2a4006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:31.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 msgr2=0x7fc2bc071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:31.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 --2- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 0x7fc2bc071d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0096b0 tx=0x7fc2ac009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:31.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 shutdown_connections 2024-05-09T06:22:31.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 --2- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc2a8036710 0x7fc2a8038bc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:31.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 --2- 172.21.15.79:0/935655566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2bc0fca30 0x7fc2bc071d00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:31.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 >> 172.21.15.79:0/935655566 conn(0x7fc2bc0f8170 msgr2=0x7fc2bc103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:31.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 shutdown_connections 2024-05-09T06:22:31.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:31.125+0000 7fc2c0e4b700 1 -- 172.21.15.79:0/935655566 wait complete. 2024-05-09T06:22:31.109 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:32.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:31 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:32.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:31 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/935655566' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:32.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:31 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:32.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:31 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:32.722 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:32.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:33.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:32 smithi062 ceph-mon[26920]: [09/May/2024:06:22:31] ENGINE Bus STARTING 2024-05-09T06:22:33.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:32 smithi062 ceph-mon[26920]: [09/May/2024:06:22:31] ENGINE Serving on https://172.21.15.62:7150 2024-05-09T06:22:33.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:32 smithi062 ceph-mon[26920]: [09/May/2024:06:22:31] ENGINE Bus STARTED 2024-05-09T06:22:33.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:32 smithi062 ceph-mon[26920]: mgrmap e17: smithi062.juuasl(active, since 2s) 2024-05-09T06:22:33.581 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:34.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:34.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:34.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:34.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:34.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.019+0000 7f3a36cce700 1 -- 172.21.15.79:0/451073039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 msgr2=0x7f3a30101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.019+0000 7f3a36cce700 1 --2- 172.21.15.79:0/451073039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 0x7f3a30101da0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3a240048c0 tx=0x7f3a24009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 -- 172.21.15.79:0/451073039 shutdown_connections 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 --2- 172.21.15.79:0/451073039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 0x7f3a30101da0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 -- 172.21.15.79:0/451073039 >> 172.21.15.79:0/451073039 conn(0x7f3a30071800 msgr2=0x7f3a30071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 -- 172.21.15.79:0/451073039 shutdown_connections 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 -- 172.21.15.79:0/451073039 wait complete. 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 Processor -- start 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 -- start start 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 0x7f3a3010e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.020+0000 7f3a36cce700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3010e610 con 0x7f3a301019d0 2024-05-09T06:22:36.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a34a6a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 0x7f3a3010e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a34a6a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 0x7f3a3010e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:52732/0 (socket says 172.21.15.79:52732) 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a34a6a700 1 -- 172.21.15.79:0/2601638791 learned_addr learned my addr 172.21.15.79:0/2601638791 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a34a6a700 1 -- 172.21.15.79:0/2601638791 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24005040 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a34a6a700 1 --2- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 0x7f3a3010e0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400b820 tx=0x7f3a24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a2d7fa700 1 -- 172.21.15.79:0/2601638791 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a240093c0 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3010e810 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a2d7fa700 1 -- 172.21.15.79:0/2601638791 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a24013420 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a2d7fa700 1 -- 172.21.15.79:0/2601638791 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a2401c5b0 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.021+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3010ed00 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.022+0000 7f3a2d7fa700 1 -- 172.21.15.79:0/2601638791 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f3a24009520 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.022+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3010ef40 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.022+0000 7f3a2d7fa700 1 --2- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a20036970 0x7f3a20038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.022+0000 7f3a2d7fa700 1 -- 172.21.15.79:0/2601638791 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3a24049a60 con 0x7f3a301019d0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.023+0000 7f3a2ffff700 1 --2- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a20036970 0x7f3a20038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.023+0000 7f3a2ffff700 1 --2- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a20036970 0x7f3a20038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009990 tx=0x7f3a1c006e40 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:36.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.027+0000 7f3a2d7fa700 1 -- 172.21.15.79:0/2601638791 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3a3010ef40 con 0x7f3a301019d0 2024-05-09T06:22:36.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.299+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3a3010ef40 con 0x7f3a301019d0 2024-05-09T06:22:36.283 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.300+0000 7f3a2d7fa700 1 -- 172.21.15.79:0/2601638791 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3a3010ef40 con 0x7f3a301019d0 2024-05-09T06:22:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:36.283 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a20036970 msgr2=0x7f3a20038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 --2- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a20036970 0x7f3a20038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009990 tx=0x7f3a1c006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 msgr2=0x7f3a3010e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 --2- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 0x7f3a3010e0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400b820 tx=0x7f3a24009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 shutdown_connections 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 --2- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a20036970 0x7f3a20038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 --2- 172.21.15.79:0/2601638791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a301019d0 0x7f3a3010e0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 >> 172.21.15.79:0/2601638791 conn(0x7f3a30071800 msgr2=0x7f3a30103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 shutdown_connections 2024-05-09T06:22:36.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:36.302+0000 7f3a36cce700 1 -- 172.21.15.79:0/2601638791 wait complete. 2024-05-09T06:22:36.286 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:36.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:36.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:36.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:36.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:36.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:22:36.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:22:36.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:22:36.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:22:36.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:22:36.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:36.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:37.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:22:37.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:22:37.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:22:37.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:22:37.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: Deploying daemon crash.smithi079 on smithi079 2024-05-09T06:22:37.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:37 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2601638791' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:37.885 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:37.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:38.137 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:22:39.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.708+0000 7f1252f39700 1 -- 172.21.15.79:0/2693017689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 msgr2=0x7f124c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.708+0000 7f1252f39700 1 --2- 172.21.15.79:0/2693017689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 0x7f124c102e80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f12400048c0 tx=0x7f1240009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.708+0000 7f1252f39700 1 -- 172.21.15.79:0/2693017689 shutdown_connections 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.708+0000 7f1252f39700 1 --2- 172.21.15.79:0/2693017689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 0x7f124c102e80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.708+0000 7f1252f39700 1 -- 172.21.15.79:0/2693017689 >> 172.21.15.79:0/2693017689 conn(0x7f124c0f85b0 msgr2=0x7f124c0fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.708+0000 7f1252f39700 1 -- 172.21.15.79:0/2693017689 shutdown_connections 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.708+0000 7f1252f39700 1 -- 172.21.15.79:0/2693017689 wait complete. 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.709+0000 7f1252f39700 1 Processor -- start 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.709+0000 7f1252f39700 1 -- start start 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.709+0000 7f1252f39700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 0x7f124c113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.709+0000 7f1252f39700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c113670 con 0x7f124c102ab0 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f1250cd5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 0x7f124c113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f1250cd5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 0x7f124c113130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:52758/0 (socket says 172.21.15.79:52758) 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f1250cd5700 1 -- 172.21.15.79:0/2313757828 learned_addr learned my addr 172.21.15.79:0/2313757828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:39.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f1250cd5700 1 -- 172.21.15.79:0/2313757828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240005040 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f1250cd5700 1 --2- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 0x7f124c113130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f124000b7f0 tx=0x7f1240009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f12497fa700 1 -- 172.21.15.79:0/2313757828 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1240009370 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c113870 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f12497fa700 1 -- 172.21.15.79:0/2313757828 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1240013420 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f12497fa700 1 -- 172.21.15.79:0/2313757828 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f124001c590 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.710+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c113d60 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.711+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c0fe1b0 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.711+0000 7f12497fa700 1 -- 172.21.15.79:0/2313757828 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f1240013a70 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.711+0000 7f12497fa700 1 --2- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f123c036970 0x7f123c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.711+0000 7f12497fa700 1 -- 172.21.15.79:0/2313757828 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1240049400 con 0x7f124c102ab0 2024-05-09T06:22:39.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.712+0000 7f124bfff700 1 --2- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f123c036970 0x7f123c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:39.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.712+0000 7f124bfff700 1 --2- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f123c036970 0x7f123c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1238009990 tx=0x7f1238006e40 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:39.716+0000 7f12497fa700 1 -- 172.21.15.79:0/2313757828 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1240024d30 con 0x7f124c102ab0 2024-05-09T06:22:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.008+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f124c05f5c0 con 0x7f124c102ab0 2024-05-09T06:22:39.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.008+0000 7f12497fa700 1 -- 172.21.15.79:0/2313757828 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1240021070 con 0x7f124c102ab0 2024-05-09T06:22:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:39.992 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:39.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.010+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f123c036970 msgr2=0x7f123c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.010+0000 7f1252f39700 1 --2- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f123c036970 0x7f123c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1238009990 tx=0x7f1238006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.010+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 msgr2=0x7f124c113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.010+0000 7f1252f39700 1 --2- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 0x7f124c113130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f124000b7f0 tx=0x7f1240009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.011+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 shutdown_connections 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.011+0000 7f1252f39700 1 --2- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f123c036970 0x7f123c038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.011+0000 7f1252f39700 1 --2- 172.21.15.79:0/2313757828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f124c102ab0 0x7f124c113130 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.011+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 >> 172.21.15.79:0/2313757828 conn(0x7f124c0f85b0 msgr2=0x7f124c0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.011+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 shutdown_connections 2024-05-09T06:22:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:40.011+0000 7f1252f39700 1 -- 172.21.15.79:0/2313757828 wait complete. 2024-05-09T06:22:39.995 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:40.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:40 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2313757828' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:41.785 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:41.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:41.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:41.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:41.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:41.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:41.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:41 smithi062 ceph-mon[26920]: Deploying daemon node-exporter.smithi079 on smithi079 2024-05-09T06:22:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:22:44.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.286+0000 7fe77b66e700 1 -- 172.21.15.79:0/2364525126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 msgr2=0x7fe774101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:44.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.286+0000 7fe77b66e700 1 --2- 172.21.15.79:0/2364525126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 0x7fe774101d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe7700048c0 tx=0x7fe770009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:44.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.286+0000 7fe77b66e700 1 -- 172.21.15.79:0/2364525126 shutdown_connections 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.286+0000 7fe77b66e700 1 --2- 172.21.15.79:0/2364525126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 0x7fe774101d60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.286+0000 7fe77b66e700 1 -- 172.21.15.79:0/2364525126 >> 172.21.15.79:0/2364525126 conn(0x7fe7740f74f0 msgr2=0x7fe7740f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.286+0000 7fe77b66e700 1 -- 172.21.15.79:0/2364525126 shutdown_connections 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.286+0000 7fe77b66e700 1 -- 172.21.15.79:0/2364525126 wait complete. 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.287+0000 7fe77b66e700 1 Processor -- start 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.287+0000 7fe77b66e700 1 -- start start 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.287+0000 7fe77b66e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 0x7fe774112050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.287+0000 7fe77b66e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe774112590 con 0x7fe774101990 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.287+0000 7fe77940a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 0x7fe774112050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.287+0000 7fe77940a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 0x7fe774112050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:33940/0 (socket says 172.21.15.79:33940) 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.287+0000 7fe77940a700 1 -- 172.21.15.79:0/2342919757 learned_addr learned my addr 172.21.15.79:0/2342919757 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:44.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.288+0000 7fe77940a700 1 -- 172.21.15.79:0/2342919757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe770005040 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.288+0000 7fe77940a700 1 --2- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 0x7fe774112050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe77000b820 tx=0x7fe770009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.288+0000 7fe769ffb700 1 -- 172.21.15.79:0/2342919757 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7700093c0 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.288+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe774112790 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.288+0000 7fe769ffb700 1 -- 172.21.15.79:0/2342919757 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe770013420 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.288+0000 7fe769ffb700 1 -- 172.21.15.79:0/2342919757 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe77001c5b0 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.288+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe774112c00 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.289+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7740fd090 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.289+0000 7fe769ffb700 1 -- 172.21.15.79:0/2342919757 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7fe770013a90 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.290+0000 7fe769ffb700 1 --2- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe7600369c0 0x7fe760038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.290+0000 7fe769ffb700 1 -- 172.21.15.79:0/2342919757 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe770049a30 con 0x7fe774101990 2024-05-09T06:22:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.290+0000 7fe778c09700 1 --2- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe7600369c0 0x7fe760038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:44.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.290+0000 7fe778c09700 1 --2- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe7600369c0 0x7fe760038e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe764009990 tx=0x7fe764006e40 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:44.277 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.295+0000 7fe769ffb700 1 -- 172.21.15.79:0/2342919757 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe7700098a0 con 0x7fe774101990 2024-05-09T06:22:44.555 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.572+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe77404bed0 con 0x7fe774101990 2024-05-09T06:22:44.556 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.573+0000 7fe769ffb700 1 -- 172.21.15.79:0/2342919757 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe770023300 con 0x7fe774101990 2024-05-09T06:22:44.556 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:44.556 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:44.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe7600369c0 msgr2=0x7fe760038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 --2- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe7600369c0 0x7fe760038e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe764009990 tx=0x7fe764006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 msgr2=0x7fe774112050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 --2- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 0x7fe774112050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe77000b820 tx=0x7fe770009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 shutdown_connections 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 --2- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe7600369c0 0x7fe760038e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 --2- 172.21.15.79:0/2342919757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe774101990 0x7fe774112050 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 >> 172.21.15.79:0/2342919757 conn(0x7fe7740f74f0 msgr2=0x7fe7740f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 shutdown_connections 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:44.576+0000 7fe77b66e700 1 -- 172.21.15.79:0/2342919757 wait complete. 2024-05-09T06:22:44.559 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:45.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:45.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:22:45.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:45 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2342919757' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:46.792 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:46.792 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:47.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:47.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:47.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:47.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:47.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:22:47.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T06:22:47.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:22:47.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:22:47.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:47 smithi062 ceph-mon[26920]: Deploying daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:22:47.690 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:22:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.123+0000 7f0a223b7700 1 -- 172.21.15.79:0/621054733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 msgr2=0x7f0a1c101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.123+0000 7f0a223b7700 1 --2- 172.21.15.79:0/621054733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 0x7f0a1c101d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0048c0 tx=0x7f0a0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:49.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.123+0000 7f0a223b7700 1 -- 172.21.15.79:0/621054733 shutdown_connections 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.123+0000 7f0a223b7700 1 --2- 172.21.15.79:0/621054733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 0x7f0a1c101d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.123+0000 7f0a223b7700 1 -- 172.21.15.79:0/621054733 >> 172.21.15.79:0/621054733 conn(0x7f0a1c0f74d0 msgr2=0x7f0a1c0f98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.123+0000 7f0a223b7700 1 -- 172.21.15.79:0/621054733 shutdown_connections 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.123+0000 7f0a223b7700 1 -- 172.21.15.79:0/621054733 wait complete. 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.124+0000 7f0a223b7700 1 Processor -- start 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.124+0000 7f0a223b7700 1 -- start start 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a223b7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 0x7f0a1c10e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a223b7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c10e640 con 0x7f0a1c1019b0 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 0x7f0a1c10e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 0x7f0a1c10e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.79:33960/0 (socket says 172.21.15.79:33960) 2024-05-09T06:22:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a1bfff700 1 -- 172.21.15.79:0/108965104 learned_addr learned my addr 172.21.15.79:0/108965104 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a1bfff700 1 -- 172.21.15.79:0/108965104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c005040 con 0x7f0a1c1019b0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a1bfff700 1 --2- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 0x7f0a1c10e100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00b820 tx=0x7f0a0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a18ff9700 1 -- 172.21.15.79:0/108965104 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a0c0093c0 con 0x7f0a1c1019b0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a18ff9700 1 -- 172.21.15.79:0/108965104 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a0c013420 con 0x7f0a1c1019b0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c10e840 con 0x7f0a1c1019b0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.125+0000 7f0a18ff9700 1 -- 172.21.15.79:0/108965104 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a0c01c5b0 con 0x7f0a1c1019b0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.126+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c10ed30 con 0x7f0a1c1019b0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.126+0000 7f0a18ff9700 1 -- 172.21.15.79:0/108965104 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f0a0c01c7a0 con 0x7f0a1c1019b0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.126+0000 7f0a18ff9700 1 --2- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0a080369c0 0x7f0a08038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.126+0000 7f0a18ff9700 1 -- 172.21.15.79:0/108965104 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0a0c013a90 con 0x7f0a1c1019b0 2024-05-09T06:22:49.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.126+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c10ef70 con 0x7f0a1c1019b0 2024-05-09T06:22:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.127+0000 7f0a1b7fe700 1 --2- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0a080369c0 0x7f0a08038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:49.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.127+0000 7f0a1b7fe700 1 --2- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0a080369c0 0x7f0a08038e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009990 tx=0x7f0a04006e40 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:49.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.132+0000 7f0a18ff9700 1 -- 172.21.15.79:0/108965104 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0a1c10ef70 con 0x7f0a1c1019b0 2024-05-09T06:22:49.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.407+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0a1c10ef70 con 0x7f0a1c1019b0 2024-05-09T06:22:49.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.407+0000 7f0a18ff9700 1 -- 172.21.15.79:0/108965104 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0a1c10ef70 con 0x7f0a1c1019b0 2024-05-09T06:22:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:22:49.391 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:19:53.187818Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:49.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.409+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0a080369c0 msgr2=0x7f0a08038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:49.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.409+0000 7f0a223b7700 1 --2- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0a080369c0 0x7f0a08038e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009990 tx=0x7f0a04006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:49.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.409+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 msgr2=0x7f0a1c10e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:49.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.409+0000 7f0a223b7700 1 --2- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 0x7f0a1c10e100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00b820 tx=0x7f0a0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:49.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.409+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 shutdown_connections 2024-05-09T06:22:49.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.409+0000 7f0a223b7700 1 --2- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0a080369c0 0x7f0a08038e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:49.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.409+0000 7f0a223b7700 1 --2- 172.21.15.79:0/108965104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a1c1019b0 0x7f0a1c10e100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:49.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.409+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 >> 172.21.15.79:0/108965104 conn(0x7f0a1c0f74d0 msgr2=0x7f0a1c0f8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:49.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.410+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 shutdown_connections 2024-05-09T06:22:49.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:22:49.410+0000 7f0a223b7700 1 -- 172.21.15.79:0/108965104 wait complete. 2024-05-09T06:22:49.393 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 1 2024-05-09T06:22:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/108965104' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:50.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:22:50.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:22:51.104 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:51.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:51.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:51 smithi062 ceph-mon[26920]: Deploying daemon mon.smithi079 on smithi079 2024-05-09T06:22:51.696 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:22:52.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:52 smithi062 ceph-mon[26920]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).mds e1 new map 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).mds e1 print_map 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: e1 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: legacy client fscid: -1 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: No filesystems configured 2024-05-09T06:22:53.791 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:22:53.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Deploying daemon crash.smithi079 on smithi079 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/2601638791' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/2313757828' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:53.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.047 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.047 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.047 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.047 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Deploying daemon node-exporter.smithi079 on smithi079 2024-05-09T06:22:54.047 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/2342919757' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Deploying daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/108965104' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:54.048 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: Deploying daemon mon.smithi079 on smithi079 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 ceph-mon[35268]: mon.smithi079@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 bash[35226]: 9b09bacca849e219def7c44ba218d9601f04c64c8a63e5e54fe7140c10d2be79 2024-05-09T06:22:54.049 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:53 smithi079 systemd[1]: Started Ceph mon.smithi079 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:22:59.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:22:59.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: mon.smithi062 calling monitor election 2024-05-09T06:22:59.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: mon.smithi079 calling monitor election 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/1083994023' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: mon.smithi062 is new leader, mons smithi062,smithi079 in quorum (ranks 0,1) 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: monmap e2: 2 mons at {smithi062=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],smithi079=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: fsmap 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: osdmap e5: 0 total, 0 up, 0 in 2024-05-09T06:22:59.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: mgrmap e17: smithi062.juuasl(active, since 29s) 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: overall HEALTH_OK 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: Standby manager daemon smithi079.genyri started 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/1083994023' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/1083994023' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/1083994023' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:22:59.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: mon.smithi062 calling monitor election 2024-05-09T06:22:59.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: mon.smithi079 calling monitor election 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/1083994023' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: mon.smithi062 is new leader, mons smithi062,smithi079 in quorum (ranks 0,1) 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: monmap e2: 2 mons at {smithi062=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],smithi079=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: fsmap 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: osdmap e5: 0 total, 0 up, 0 in 2024-05-09T06:22:59.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: mgrmap e17: smithi062.juuasl(active, since 29s) 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: overall HEALTH_OK 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: Standby manager daemon smithi079.genyri started 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/1083994023' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/1083994023' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/1083994023' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:22:59.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.100+0000 7f795ed8e700 1 -- 172.21.15.79:0/1931395070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 msgr2=0x7f7948008650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.100+0000 7f795ed8e700 1 --2- 172.21.15.79:0/1931395070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 0x7f7948008650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7958065230 tx=0x7f794c002040 comp rx=0 tx=0).stop 2024-05-09T06:23:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.100+0000 7f795ed8e700 1 -- 172.21.15.79:0/1931395070 shutdown_connections 2024-05-09T06:23:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.100+0000 7f795ed8e700 1 --2- 172.21.15.79:0/1931395070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 0x7f7948008650 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.100+0000 7f795ed8e700 1 -- 172.21.15.79:0/1931395070 >> 172.21.15.79:0/1931395070 conn(0x7f7958071800 msgr2=0x7f7958071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.100+0000 7f795ed8e700 1 -- 172.21.15.79:0/1931395070 shutdown_connections 2024-05-09T06:23:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.100+0000 7f795ed8e700 1 -- 172.21.15.79:0/1931395070 wait complete. 2024-05-09T06:23:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f795ed8e700 1 Processor -- start 2024-05-09T06:23:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f795ed8e700 1 -- start start 2024-05-09T06:23:00.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f795ed8e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 0x7f79581131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:00.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f795ed8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 0x7f795810d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f795ed8e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7958113d20 con 0x7f79480061f0 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f795ed8e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7958113e90 con 0x7f7958113710 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f7957fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 0x7f795810d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f7957fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 0x7f795810d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35468/0 (socket says 172.21.15.79:35468) 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.101+0000 7f7957fff700 1 -- 172.21.15.79:0/2007776061 learned_addr learned my addr 172.21.15.79:0/2007776061 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f7957fff700 1 -- 172.21.15.79:0/2007776061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 msgr2=0x7f795810d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f7957fff700 1 -- 172.21.15.79:0/2007776061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 msgr2=0x7f795810d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f7957fff700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 0x7f795810d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f7957fff700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 0x7f795810d170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f795cb2a700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 0x7f79581131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f795cb2a700 1 -- 172.21.15.79:0/2007776061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 msgr2=0x7f795810d170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f795cb2a700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 0x7f795810d170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f795cb2a700 1 -- 172.21.15.79:0/2007776061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c005040 con 0x7f79480061f0 2024-05-09T06:23:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f795cb2a700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 0x7f79581131d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7958065230 tx=0x7f794c002040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f79557fa700 1 -- 172.21.15.79:0/2007776061 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794c004db0 con 0x7f79480061f0 2024-05-09T06:23:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f79557fa700 1 -- 172.21.15.79:0/2007776061 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f794c018e30 con 0x7f79480061f0 2024-05-09T06:23:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795810d770 con 0x7f79480061f0 2024-05-09T06:23:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f79557fa700 1 -- 172.21.15.79:0/2007776061 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794c022be0 con 0x7f79480061f0 2024-05-09T06:23:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.102+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795810dc50 con 0x7f79480061f0 2024-05-09T06:23:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.103+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79581071f0 con 0x7f79480061f0 2024-05-09T06:23:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.104+0000 7f79557fa700 1 -- 172.21.15.79:0/2007776061 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f794c009260 con 0x7f79480061f0 2024-05-09T06:23:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.104+0000 7f79557fa700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f793c069320 0x7f793c06b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.104+0000 7f79557fa700 1 -- 172.21.15.79:0/2007776061 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f794c088b70 con 0x7f79480061f0 2024-05-09T06:23:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.105+0000 7f7957fff700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f793c069320 0x7f793c06b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.105+0000 7f7957fff700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f793c069320 0x7f793c06b7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7944006fd0 tx=0x7f7944008040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:00.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.109+0000 7f79557fa700 1 -- 172.21.15.79:0/2007776061 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f794c055ee0 con 0x7f79480061f0 2024-05-09T06:23:00.150 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:00.150 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:59 smithi079 ceph-mon[35268]: mgrmap e18: smithi062.juuasl(active, since 29s), standbys: smithi079.genyri 2024-05-09T06:23:00.150 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi079.genyri", "id": "smithi079.genyri"}]: dispatch 2024-05-09T06:23:00.150 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:00.150 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:59 smithi079 ceph-mon[35268]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:00.150 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:00.150 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:22:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:23:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:59 smithi062 ceph-mon[26920]: mgrmap e18: smithi062.juuasl(active, since 29s), standbys: smithi079.genyri 2024-05-09T06:23:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi079.genyri", "id": "smithi079.genyri"}]: dispatch 2024-05-09T06:23:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:59 smithi062 ceph-mon[26920]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:22:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:23:00.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.392+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f79580658b0 con 0x7f79480061f0 2024-05-09T06:23:00.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.393+0000 7f79557fa700 1 -- 172.21.15.79:0/2007776061 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7f794c059500 con 0x7f79480061f0 2024-05-09T06:23:00.377 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-05-09T06:23:00.377 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":2,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","modified":"2024-05-09T06:22:53.813597Z","created":"2024-05-09T06:19:53.187818Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi062","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-09T06:23:00.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f793c069320 msgr2=0x7f793c06b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:00.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f793c069320 0x7f793c06b7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7944006fd0 tx=0x7f7944008040 comp rx=0 tx=0).stop 2024-05-09T06:23:00.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 msgr2=0x7f79581131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:00.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 0x7f79581131d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7958065230 tx=0x7f794c002040 comp rx=0 tx=0).stop 2024-05-09T06:23:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 shutdown_connections 2024-05-09T06:23:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f793c069320 0x7f793c06b7d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f79480061f0 0x7f79581131d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 --2- 172.21.15.79:0/2007776061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7958113710 0x7f795810d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 >> 172.21.15.79:0/2007776061 conn(0x7f7958071800 msgr2=0x7f79581021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 shutdown_connections 2024-05-09T06:23:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:23:00.395+0000 7f795ed8e700 1 -- 172.21.15.79:0/2007776061 wait complete. 2024-05-09T06:23:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:dumped monmap epoch 2 2024-05-09T06:23:01.070 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:00 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/2007776061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:23:01.071 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-09T06:23:01.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-09T06:23:01.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:00 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2007776061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:23:01.372 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.452 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.453 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.453 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:23:02.453 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:23:02.453 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:02 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:02.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:02.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:23:02.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:02 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:03.523 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:03 smithi062 ceph-mon[26920]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:03.524 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:03 smithi062 ceph-mon[26920]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:03.524 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:03 smithi062 ceph-mon[26920]: Reconfiguring mon.smithi062 (unknown last config time)... 2024-05-09T06:23:03.524 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:03 smithi062 ceph-mon[26920]: Reconfiguring daemon mon.smithi062 on smithi062 2024-05-09T06:23:03.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:03 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:03.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:03 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:03.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:03 smithi079 ceph-mon[35268]: Reconfiguring mon.smithi062 (unknown last config time)... 2024-05-09T06:23:03.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:03 smithi079 ceph-mon[35268]: Reconfiguring daemon mon.smithi062 on smithi062 2024-05-09T06:23:03.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.984+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/99442028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 msgr2=0x7f3a64065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.984+0000 7f3a6b0c1700 1 --2- 172.21.15.62:0/99442028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 0x7f3a64065ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a50004940 tx=0x7f3a50009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.984+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/99442028 shutdown_connections 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.984+0000 7f3a6b0c1700 1 --2- 172.21.15.62:0/99442028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 0x7f3a64065ab0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.984+0000 7f3a6b0c1700 1 --2- 172.21.15.62:0/99442028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a64102e50 0x7f3a64103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.985+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/99442028 >> 172.21.15.62:0/99442028 conn(0x7f3a64071d00 msgr2=0x7f3a64072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.985+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/99442028 shutdown_connections 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.985+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/99442028 wait complete. 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.985+0000 7f3a6b0c1700 1 Processor -- start 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.985+0000 7f3a6b0c1700 1 -- start start 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a6b0c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 0x7f3a640fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a6b0c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a64102e50 0x7f3a640fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a6b0c1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640fc880 con 0x7f3a64065640 2024-05-09T06:23:03.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a6b0c1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640fc9c0 con 0x7f3a64102e50 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a68e5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 0x7f3a640fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a68e5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 0x7f3a640fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52200/0 (socket says 172.21.15.62:52200) 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a68e5d700 1 -- 172.21.15.62:0/2163496033 learned_addr learned my addr 172.21.15.62:0/2163496033 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a63fff700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a64102e50 0x7f3a640fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a68e5d700 1 -- 172.21.15.62:0/2163496033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a64102e50 msgr2=0x7f3a640fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a68e5d700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a64102e50 0x7f3a640fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a68e5d700 1 -- 172.21.15.62:0/2163496033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50005040 con 0x7f3a64065640 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a68e5d700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 0x7f3a640fbdb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800c8c0 tx=0x7f3a580044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a617fa700 1 -- 172.21.15.62:0/2163496033 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a5800a980 con 0x7f3a64065640 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a64119e70 con 0x7f3a64065640 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a617fa700 1 -- 172.21.15.62:0/2163496033 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a5800ce60 con 0x7f3a64065640 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.986+0000 7f3a617fa700 1 -- 172.21.15.62:0/2163496033 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a580115e0 con 0x7f3a64065640 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.987+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6411a2f0 con 0x7f3a64065640 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.988+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a64100100 con 0x7f3a64065640 2024-05-09T06:23:03.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.988+0000 7f3a617fa700 1 -- 172.21.15.62:0/2163496033 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f3a58011740 con 0x7f3a64065640 2024-05-09T06:23:03.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.989+0000 7f3a617fa700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a54069210 0x7f3a5406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:03.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.989+0000 7f3a617fa700 1 -- 172.21.15.62:0/2163496033 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3a58086150 con 0x7f3a64065640 2024-05-09T06:23:03.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.989+0000 7f3a63fff700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a54069210 0x7f3a5406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:03.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.989+0000 7f3a63fff700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a54069210 0x7f3a5406b6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3a50004f90 tx=0x7f3a50009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:03.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:03.997+0000 7f3a617fa700 1 -- 172.21.15.62:0/2163496033 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3a58053560 con 0x7f3a64065640 2024-05-09T06:23:04.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.198+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3a640fe540 con 0x7f3a64065640 2024-05-09T06:23:04.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.198+0000 7f3a617fa700 1 -- 172.21.15.62:0/2163496033 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7f3a58085900 con 0x7f3a64065640 2024-05-09T06:23:04.181 INFO:teuthology.orchestra.run.smithi062.stdout:# minimal ceph.conf for f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:23:04.181 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-05-09T06:23:04.181 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:23:04.181 INFO:teuthology.orchestra.run.smithi062.stdout: mon_host = [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] 2024-05-09T06:23:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a54069210 msgr2=0x7f3a5406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a54069210 0x7f3a5406b6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3a50004f90 tx=0x7f3a50009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 msgr2=0x7f3a640fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 0x7f3a640fbdb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800c8c0 tx=0x7f3a580044c0 comp rx=0 tx=0).stop 2024-05-09T06:23:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 shutdown_connections 2024-05-09T06:23:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3a54069210 0x7f3a5406b6c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a64065640 0x7f3a640fbdb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:04.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 --2- 172.21.15.62:0/2163496033 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a64102e50 0x7f3a640fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:04.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 >> 172.21.15.62:0/2163496033 conn(0x7f3a64071d00 msgr2=0x7f3a640fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:04.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 shutdown_connections 2024-05-09T06:23:04.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:04.200+0000 7f3a6b0c1700 1 -- 172.21.15.62:0/2163496033 wait complete. 2024-05-09T06:23:04.482 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:04 smithi062 ceph-mon[26920]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:04.482 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:04.482 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:04.482 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi062.juuasl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:04.482 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:04.482 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:04.483 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:04.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:04 smithi079 ceph-mon[35268]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:04.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:04.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:04.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi062.juuasl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:04.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:04.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:04.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:05.362 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:05 smithi062 ceph-mon[26920]: Reconfiguring mgr.smithi062.juuasl (unknown last config time)... 2024-05-09T06:23:05.362 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:05 smithi062 ceph-mon[26920]: Reconfiguring daemon mgr.smithi062.juuasl on smithi062 2024-05-09T06:23:05.363 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:05 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2163496033' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:05.388 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-09T06:23:05.388 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:23:05.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T06:23:05.417 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:23:05.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:23:05.484 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:23:05.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T06:23:05.511 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:05 smithi079 ceph-mon[35268]: Reconfiguring mgr.smithi062.juuasl (unknown last config time)... 2024-05-09T06:23:05.511 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:05 smithi079 ceph-mon[35268]: Reconfiguring daemon mgr.smithi062.juuasl on smithi062 2024-05-09T06:23:05.512 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:05 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2163496033' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:05.517 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:23:05.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:23:05.586 INFO:tasks.cephadm:Deploying OSDs... 2024-05-09T06:23:05.587 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:23:05.587 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T06:23:05.604 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T06:23:05.604 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-05-09T06:23:05.660 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T06:23:05.661 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:05.661 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-09T06:23:05.661 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:05.661 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:05.661 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-09 06:22:20.507576710 +0000 2024-05-09T06:23:05.661 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-09 06:15:32.958619300 +0000 2024-05-09T06:23:05.661 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-09 06:15:32.958619300 +0000 2024-05-09T06:23:05.661 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-09 06:15:32.958619300 +0000 2024-05-09T06:23:05.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T06:23:05.725 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-09T06:23:05.725 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-09T06:23:05.725 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000264188 s, 1.9 MB/s 2024-05-09T06:23:05.726 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T06:23:05.784 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-09 06:22:20.507576710 +0000 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-09 06:15:33.312613208 +0000 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-09 06:15:33.312613208 +0000 2024-05-09T06:23:05.840 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-09 06:15:33.312613208 +0000 2024-05-09T06:23:05.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T06:23:05.906 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-09T06:23:05.906 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-09T06:23:05.907 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000181389 s, 2.8 MB/s 2024-05-09T06:23:05.910 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T06:23:05.967 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-05-09T06:23:06.024 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T06:23:06.025 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:06.025 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-09T06:23:06.025 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:06.025 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:06.025 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-09 06:22:20.507576710 +0000 2024-05-09T06:23:06.025 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-09 06:15:33.663607166 +0000 2024-05-09T06:23:06.025 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-09 06:15:33.663607166 +0000 2024-05-09T06:23:06.025 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-09 06:15:33.663607166 +0000 2024-05-09T06:23:06.025 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T06:23:06.089 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-09T06:23:06.089 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-09T06:23:06.089 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000180377 s, 2.8 MB/s 2024-05-09T06:23:06.090 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T06:23:06.149 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-05-09T06:23:06.207 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T06:23:06.207 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:06.207 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-09T06:23:06.207 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:06.207 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:06.207 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-09 06:22:20.508576694 +0000 2024-05-09T06:23:06.207 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-09 06:15:34.017601074 +0000 2024-05-09T06:23:06.208 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-09 06:15:34.017601074 +0000 2024-05-09T06:23:06.208 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-09 06:15:34.017601074 +0000 2024-05-09T06:23:06.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T06:23:06.272 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-09T06:23:06.272 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-09T06:23:06.272 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000170247 s, 3.0 MB/s 2024-05-09T06:23:06.274 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T06:23:06.331 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:23:06.331 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T06:23:06.351 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T06:23:06.351 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-05-09T06:23:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T06:23:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:06.410 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-09T06:23:06.410 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:06.410 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:06.411 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-05-09 06:22:52.437281974 +0000 2024-05-09T06:23:06.411 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-05-09 06:15:25.811365478 +0000 2024-05-09T06:23:06.411 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-05-09 06:15:25.811365478 +0000 2024-05-09T06:23:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-05-09 06:15:25.811365478 +0000 2024-05-09T06:23:06.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T06:23:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:06 smithi062 ceph-mon[26920]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:06 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:06 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:06 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi062", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:06 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:06.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:06 smithi079 ceph-mon[35268]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:06.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:06 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:06.476 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:06 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:06.476 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:06 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi062", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:06.476 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:06 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-05-09T06:23:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-05-09T06:23:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000290134 s, 1.8 MB/s 2024-05-09T06:23:06.480 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T06:23:06.539 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-05-09 06:22:52.438281951 +0000 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-05-09 06:15:26.171357554 +0000 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-05-09 06:15:26.171357554 +0000 2024-05-09T06:23:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-05-09 06:15:26.171357554 +0000 2024-05-09T06:23:06.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T06:23:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-05-09T06:23:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-05-09T06:23:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000245304 s, 2.1 MB/s 2024-05-09T06:23:06.664 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T06:23:06.723 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-05-09T06:23:06.779 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T06:23:06.779 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-09T06:23:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-05-09 06:22:52.438281951 +0000 2024-05-09T06:23:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-05-09 06:15:26.529349675 +0000 2024-05-09T06:23:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-05-09 06:15:26.529349675 +0000 2024-05-09T06:23:06.780 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-05-09 06:15:26.529349675 +0000 2024-05-09T06:23:06.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T06:23:06.845 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-05-09T06:23:06.845 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-05-09T06:23:06.845 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000200653 s, 2.6 MB/s 2024-05-09T06:23:06.846 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T06:23:06.904 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-05-09T06:23:06.960 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T06:23:06.961 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:06.961 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-09T06:23:06.961 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:06.961 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:06.961 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-05-09 06:22:52.438281951 +0000 2024-05-09T06:23:06.961 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-05-09 06:15:26.858342434 +0000 2024-05-09T06:23:06.961 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-05-09 06:15:26.858342434 +0000 2024-05-09T06:23:06.961 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-05-09 06:15:26.858342434 +0000 2024-05-09T06:23:06.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T06:23:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-05-09T06:23:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-05-09T06:23:07.025 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000196722 s, 2.6 MB/s 2024-05-09T06:23:07.026 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T06:23:07.083 INFO:tasks.cephadm:Deploying osd.0 on smithi062 with /dev/vg_nvme/lv_4... 2024-05-09T06:23:07.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T06:23:07.365 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:07 smithi062 ceph-mon[26920]: Reconfiguring crash.smithi062 (monmap changed)... 2024-05-09T06:23:07.365 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:07 smithi062 ceph-mon[26920]: Reconfiguring daemon crash.smithi062 on smithi062 2024-05-09T06:23:07.442 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:23:07.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:07 smithi079 ceph-mon[35268]: Reconfiguring crash.smithi062 (monmap changed)... 2024-05-09T06:23:07.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:07 smithi079 ceph-mon[35268]: Reconfiguring daemon crash.smithi062 on smithi062 2024-05-09T06:23:08.477 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:08 smithi062 ceph-mon[26920]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:08.477 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:08 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:08.477 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:08 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:08.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:08 smithi079 ceph-mon[35268]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:08.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:08 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:08.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:08 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:09.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:09 smithi079 ceph-mon[35268]: Reconfiguring alertmanager.smithi062 (dependencies changed)... 2024-05-09T06:23:09.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:09 smithi079 ceph-mon[35268]: Reconfiguring daemon alertmanager.smithi062 on smithi062 2024-05-09T06:23:09.629 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:09 smithi062 ceph-mon[26920]: Reconfiguring alertmanager.smithi062 (dependencies changed)... 2024-05-09T06:23:09.629 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:09 smithi062 ceph-mon[26920]: Reconfiguring daemon alertmanager.smithi062 on smithi062 2024-05-09T06:23:10.329 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:10 smithi062 ceph-mon[26920]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:10.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:10 smithi079 ceph-mon[35268]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:11.744 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T06:23:11.744 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T06:23:11.745 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-05-09T06:23:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-05-09T06:23:11.745 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0139464 s, 752 MB/s 2024-05-09T06:23:11.745 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-05-09T06:23:12.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:12 smithi062 ceph-mon[26920]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:12.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:12 smithi079 ceph-mon[35268]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:13.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_4 2024-05-09T06:23:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:23:14.238 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:14 smithi062 ceph-mon[26920]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:14.238 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:14.238 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:14.238 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:14.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:14 smithi079 ceph-mon[35268]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:14.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:14.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:14.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:15.233 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:15 smithi062 ceph-mon[26920]: Reconfiguring grafana.smithi062 (dependencies changed)... 2024-05-09T06:23:15.233 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:15 smithi062 ceph-mon[26920]: Reconfiguring daemon grafana.smithi062 on smithi062 2024-05-09T06:23:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:15 smithi079 ceph-mon[35268]: Reconfiguring grafana.smithi062 (dependencies changed)... 2024-05-09T06:23:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:15 smithi079 ceph-mon[35268]: Reconfiguring daemon grafana.smithi062 on smithi062 2024-05-09T06:23:16.402 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:16 smithi062 ceph-mon[26920]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:16 smithi079 ceph-mon[35268]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 -- 172.21.15.62:0/3101990607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fcf60 msgr2=0x7f64b80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:17.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 --2- 172.21.15.62:0/3101990607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fcf60 0x7f64b80fd3d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f64a8004940 tx=0x7f64a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 -- 172.21.15.62:0/3101990607 shutdown_connections 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 --2- 172.21.15.62:0/3101990607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fcf60 0x7f64b80fd3d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 --2- 172.21.15.62:0/3101990607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b80fbcb0 0x7f64b80fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 -- 172.21.15.62:0/3101990607 >> 172.21.15.62:0/3101990607 conn(0x7f64b80f7430 msgr2=0x7f64b80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 -- 172.21.15.62:0/3101990607 shutdown_connections 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 -- 172.21.15.62:0/3101990607 wait complete. 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 Processor -- start 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.167+0000 7f64c0059700 1 -- start start 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64c0059700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fbcb0 0x7f64b810db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64c0059700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b80fcf60 0x7f64b810e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64c0059700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b810e640 con 0x7f64b80fbcb0 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64c0059700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b810edf0 con 0x7f64b80fcf60 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64bddf5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fbcb0 0x7f64b810db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:17.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64bddf5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fbcb0 0x7f64b810db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55758/0 (socket says 172.21.15.62:55758) 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64bddf5700 1 -- 172.21.15.62:0/3825496719 learned_addr learned my addr 172.21.15.62:0/3825496719 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64bd5f4700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b80fcf60 0x7f64b810e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64bddf5700 1 -- 172.21.15.62:0/3825496719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b80fcf60 msgr2=0x7f64b810e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64bddf5700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b80fcf60 0x7f64b810e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64bddf5700 1 -- 172.21.15.62:0/3825496719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a8005040 con 0x7f64b80fbcb0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64bddf5700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fbcb0 0x7f64b810db00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f64b4002a50 tx=0x7f64b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64ae7fc700 1 -- 172.21.15.62:0/3825496719 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64b4007cc0 con 0x7f64b80fbcb0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64ae7fc700 1 -- 172.21.15.62:0/3825496719 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64b400f040 con 0x7f64b80fbcb0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64ae7fc700 1 -- 172.21.15.62:0/3825496719 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64b400db70 con 0x7f64b80fbcb0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b810f0d0 con 0x7f64b80fbcb0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.168+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b810f610 con 0x7f64b80fbcb0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.169+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b8101af0 con 0x7f64b80fbcb0 2024-05-09T06:23:17.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.170+0000 7f64ae7fc700 1 -- 172.21.15.62:0/3825496719 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f64b400dd10 con 0x7f64b80fbcb0 2024-05-09T06:23:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.170+0000 7f64ae7fc700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f64a4069210 0x7f64a406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.170+0000 7f64ae7fc700 1 -- 172.21.15.62:0/3825496719 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f64b40856e0 con 0x7f64b80fbcb0 2024-05-09T06:23:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.170+0000 7f64bd5f4700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f64a4069210 0x7f64a406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.171+0000 7f64bd5f4700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f64a4069210 0x7f64a406b6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f64a800b3b0 tx=0x7f64a8009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.175+0000 7f64ae7fc700 1 -- 172.21.15.62:0/3825496719 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f64b4056580 con 0x7f64b80fbcb0 2024-05-09T06:23:17.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:16.379+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f64b810f880 con 0x7f64a4069210 2024-05-09T06:23:17.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:17 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:23:17.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:17 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:23:17.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:17 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:17 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:23:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:17 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:23:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:17 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:18.553 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:18 smithi062 ceph-mon[26920]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:23:18.553 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:18 smithi062 ceph-mon[26920]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:18.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:18 smithi079 ceph-mon[35268]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:23:18.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:18 smithi079 ceph-mon[35268]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:20.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:20 smithi062 ceph-mon[26920]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:20.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:20.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:20.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:20 smithi079 ceph-mon[35268]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:20.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:20.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:21.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:21 smithi062 ceph-mon[26920]: Reconfiguring prometheus.smithi062 (dependencies changed)... 2024-05-09T06:23:21.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:21 smithi062 ceph-mon[26920]: Reconfiguring daemon prometheus.smithi062 on smithi062 2024-05-09T06:23:21.588 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:21 smithi079 ceph-mon[35268]: Reconfiguring prometheus.smithi062 (dependencies changed)... 2024-05-09T06:23:21.588 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:21 smithi079 ceph-mon[35268]: Reconfiguring daemon prometheus.smithi062 on smithi062 2024-05-09T06:23:22.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:22 smithi079 ceph-mon[35268]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:22.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:22 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/709701570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ec38550-8a22-471a-a786-5316f095bcd4"}]: dispatch 2024-05-09T06:23:22.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:22 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/709701570' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ec38550-8a22-471a-a786-5316f095bcd4"}]': finished 2024-05-09T06:23:22.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:22 smithi079 ceph-mon[35268]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T06:23:22.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:22 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:22.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:22 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3656846657' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:23:22.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:22 smithi062 ceph-mon[26920]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:22.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:22 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/709701570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ec38550-8a22-471a-a786-5316f095bcd4"}]: dispatch 2024-05-09T06:23:22.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:22 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/709701570' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ec38550-8a22-471a-a786-5316f095bcd4"}]': finished 2024-05-09T06:23:22.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:22 smithi062 ceph-mon[26920]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T06:23:22.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:22 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:22.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:22 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3656846657' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:23:24.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:24 smithi079 ceph-mon[35268]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:24.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:24 smithi062 ceph-mon[26920]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:26.347 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:26 smithi062 ceph-mon[26920]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:26.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:26 smithi079 ceph-mon[35268]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:28.568 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:28 smithi062 ceph-mon[26920]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:28.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:28 smithi079 ceph-mon[35268]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:29.548 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:30.540 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:30 smithi062 ceph-mon[26920]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:30.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:30 smithi079 ceph-mon[35268]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:32.367 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:32 smithi079 ceph-mon[35268]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:32.367 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:32 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:32.368 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:32 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:32.368 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:32 smithi079 ceph-mon[35268]: Reconfiguring crash.smithi079 (monmap changed)... 2024-05-09T06:23:32.368 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:32 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:32.368 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:32 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:32.368 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:32 smithi079 ceph-mon[35268]: Reconfiguring daemon crash.smithi079 on smithi079 2024-05-09T06:23:32.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:32 smithi062 ceph-mon[26920]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:32.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:32 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:32.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:32 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:32.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:32 smithi062 ceph-mon[26920]: Reconfiguring crash.smithi079 (monmap changed)... 2024-05-09T06:23:32.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:32 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:32.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:32 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:32.400 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:32 smithi062 ceph-mon[26920]: Reconfiguring daemon crash.smithi079 on smithi079 2024-05-09T06:23:33.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:33.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:33.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:23:33.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:33.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: Deploying daemon osd.0 on smithi062 2024-05-09T06:23:33.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: Reconfiguring mgr.smithi079.genyri (monmap changed)... 2024-05-09T06:23:33.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:33.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:33.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:33.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: Reconfiguring daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:23:33.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:33 smithi062 ceph-mon[26920]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:33.838 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:33.838 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: Deploying daemon osd.0 on smithi062 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: Reconfiguring mgr.smithi079.genyri (monmap changed)... 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: Reconfiguring daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:23:33.839 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:33 smithi079 ceph-mon[35268]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:34.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:34 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:34.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:34 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:34.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:34 smithi079 ceph-mon[35268]: Reconfiguring mon.smithi079 (monmap changed)... 2024-05-09T06:23:34.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:34 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:23:34.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:34 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:23:34.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:34 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:34.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:34 smithi079 ceph-mon[35268]: Reconfiguring daemon mon.smithi079 on smithi079 2024-05-09T06:23:34.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:34.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:34.879 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:34 smithi062 ceph-mon[26920]: Reconfiguring mon.smithi079 (monmap changed)... 2024-05-09T06:23:34.879 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:23:34.879 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:23:34.879 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:34 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:34.879 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:34 smithi062 ceph-mon[26920]: Reconfiguring daemon mon.smithi079 on smithi079 2024-05-09T06:23:36.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:23:36.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:23:36.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi062.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi062.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi062.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi062.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:36.280 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.291 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.291 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:23:36.291 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:23:36.291 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T06:23:36.291 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T06:23:36.291 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi062.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi062.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi062.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi062.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:36.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:38.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:37 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:38.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:37 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:38.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:37 smithi079 ceph-mon[35268]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:38.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:37 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:38.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:37 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:38.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:37 smithi062 ceph-mon[26920]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:40.221 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:40 smithi062 ceph-mon[26920]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:40.221 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:40 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:40.221 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:40 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:40.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:40 smithi079 ceph-mon[35268]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:40.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:40 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:40.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:40 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:42.311 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:42 smithi062 ceph-mon[26920]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:42.311 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:42 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:42.311 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:42 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:42.312 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:42 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:42.312 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:42 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:23:42.312 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:42 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:42.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:42 smithi079 ceph-mon[35268]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:42.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:42 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:42.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:42 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:42.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:42 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:42.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:42 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:23:42.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:42 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.001+0000 7f64ae7fc700 1 -- 172.21.15.62:0/3825496719 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f64b810f880 con 0x7f64a4069210 2024-05-09T06:23:42.985 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 0 on host 'smithi062' 2024-05-09T06:23:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f64a4069210 msgr2=0x7f64a406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f64a4069210 0x7f64a406b6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f64a800b3b0 tx=0x7f64a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fbcb0 msgr2=0x7f64b810db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fbcb0 0x7f64b810db00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f64b4002a50 tx=0x7f64b40046b0 comp rx=0 tx=0).stop 2024-05-09T06:23:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 shutdown_connections 2024-05-09T06:23:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f64a4069210 0x7f64a406b6c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b80fbcb0 0x7f64b810db00 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f64b4002a50 tx=0x7f64b40046b0 comp rx=0 tx=0).stop 2024-05-09T06:23:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 --2- 172.21.15.62:0/3825496719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b80fcf60 0x7f64b810e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 >> 172.21.15.62:0/3825496719 conn(0x7f64b80f7430 msgr2=0x7f64b8065c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 shutdown_connections 2024-05-09T06:23:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:43.003+0000 7f64c0059700 1 -- 172.21.15.62:0/3825496719 wait complete. 2024-05-09T06:23:43.501 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:43.501 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:43.502 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:43.502 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:43 smithi079 ceph-mon[35268]: from='osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T06:23:43.552 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:43.553 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:43.553 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:43.553 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:43 smithi062 ceph-mon[26920]: from='osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T06:23:43.578 DEBUG:teuthology.orchestra.run.smithi062:osd.0> sudo journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.0.service 2024-05-09T06:23:43.580 INFO:tasks.cephadm:Deploying osd.1 on smithi062 with /dev/vg_nvme/lv_3... 2024-05-09T06:23:43.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T06:23:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:44 smithi062 ceph-mon[26920]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:44.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:44 smithi062 ceph-mon[26920]: from='osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T06:23:44.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:44 smithi062 ceph-mon[26920]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T06:23:44.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:44.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:44 smithi062 ceph-mon[26920]: from='osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:23:44.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:44.535 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:23:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:44 smithi079 ceph-mon[35268]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:44 smithi079 ceph-mon[35268]: from='osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T06:23:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:44 smithi079 ceph-mon[35268]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T06:23:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:44 smithi079 ceph-mon[35268]: from='osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:23:44.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:45.330 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:23:44 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[45168]: 2024-05-09T06:23:44.973+0000 7f8ffc908700 -1 osd.0 0 waiting for initial osdmap 2024-05-09T06:23:45.330 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:23:44 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[45168]: 2024-05-09T06:23:44.976+0000 7f8ff7703700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:23:46.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:45 smithi062 ceph-mon[26920]: from='osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-09T06:23:46.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:45 smithi062 ceph-mon[26920]: osdmap e8: 1 total, 0 up, 1 in 2024-05-09T06:23:46.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:46.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:46.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:45 smithi062 ceph-mon[26920]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:46.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:45 smithi079 ceph-mon[35268]: from='osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-09T06:23:46.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:45 smithi079 ceph-mon[35268]: osdmap e8: 1 total, 0 up, 1 in 2024-05-09T06:23:46.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:46.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:46.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:45 smithi079 ceph-mon[35268]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:47.181 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T06:23:47.181 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T06:23:47.181 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-05-09T06:23:47.181 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-05-09T06:23:47.181 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0161515 s, 649 MB/s 2024-05-09T06:23:47.181 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-05-09T06:23:47.258 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:46 smithi062 ceph-mon[26920]: purged_snaps scrub starts 2024-05-09T06:23:47.258 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:46 smithi062 ceph-mon[26920]: purged_snaps scrub ok 2024-05-09T06:23:47.258 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:46 smithi062 ceph-mon[26920]: osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] boot 2024-05-09T06:23:47.258 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:46 smithi062 ceph-mon[26920]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T06:23:47.258 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:46 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:47.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:46 smithi079 ceph-mon[35268]: purged_snaps scrub starts 2024-05-09T06:23:47.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:46 smithi079 ceph-mon[35268]: purged_snaps scrub ok 2024-05-09T06:23:47.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:46 smithi079 ceph-mon[35268]: osd.0 [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] boot 2024-05-09T06:23:47.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:46 smithi079 ceph-mon[35268]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T06:23:47.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:46 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:48.008 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:47 smithi062 ceph-mon[26920]: osdmap e10: 1 total, 1 up, 1 in 2024-05-09T06:23:48.009 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:47 smithi062 ceph-mon[26920]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:48.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_3 2024-05-09T06:23:48.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:47 smithi079 ceph-mon[35268]: osdmap e10: 1 total, 1 up, 1 in 2024-05-09T06:23:48.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:47 smithi079 ceph-mon[35268]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:48.463 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:23:50.313 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:50 smithi062 ceph-mon[26920]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:50.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:50 smithi079 ceph-mon[35268]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:51.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.345+0000 7f208d378700 1 -- 172.21.15.62:0/2833344798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 msgr2=0x7f20880fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:51.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.345+0000 7f208d378700 1 --2- 172.21.15.62:0/2833344798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 0x7f20880fe440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f207c004940 tx=0x7f207c009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:51.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.345+0000 7f208d378700 1 -- 172.21.15.62:0/2833344798 shutdown_connections 2024-05-09T06:23:51.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.345+0000 7f208d378700 1 --2- 172.21.15.62:0/2833344798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 0x7f20880fe440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:51.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.345+0000 7f208d378700 1 --2- 172.21.15.62:0/2833344798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880fce60 0x7f20880fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:51.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.345+0000 7f208d378700 1 -- 172.21.15.62:0/2833344798 >> 172.21.15.62:0/2833344798 conn(0x7f20880f8540 msgr2=0x7f20880fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.345+0000 7f208d378700 1 -- 172.21.15.62:0/2833344798 shutdown_connections 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.345+0000 7f208d378700 1 -- 172.21.15.62:0/2833344798 wait complete. 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f208d378700 1 Processor -- start 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f208d378700 1 -- start start 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f208d378700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880fce60 0x7f208810d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f208d378700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 0x7f208810de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f208d378700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208810e480 con 0x7f20880fdfd0 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f208d378700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208810ecd0 con 0x7f20880fce60 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f20867fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 0x7f208810de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f2086ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880fce60 0x7f208810d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f20867fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 0x7f208810de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42378/0 (socket says 172.21.15.62:42378) 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f20867fc700 1 -- 172.21.15.62:0/867447739 learned_addr learned my addr 172.21.15.62:0/867447739 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f2086ffd700 1 -- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 msgr2=0x7f208810de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:51.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f2086ffd700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 0x7f208810de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:51.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.346+0000 7f2086ffd700 1 -- 172.21.15.62:0/867447739 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c005040 con 0x7f20880fce60 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.347+0000 7f2086ffd700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880fce60 0x7f208810d940 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2078009fd0 tx=0x7f207800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.347+0000 7f206f7fe700 1 -- 172.21.15.62:0/867447739 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2078004e90 con 0x7f20880fce60 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.347+0000 7f206f7fe700 1 -- 172.21.15.62:0/867447739 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f207800f040 con 0x7f20880fce60 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.347+0000 7f206f7fe700 1 -- 172.21.15.62:0/867447739 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f207800ca50 con 0x7f20880fce60 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.347+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208810ef50 con 0x7f20880fce60 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.347+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208810f490 con 0x7f20880fce60 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.348+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208805f5c0 con 0x7f20880fce60 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.348+0000 7f206f7fe700 1 -- 172.21.15.62:0/867447739 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f207800cbb0 con 0x7f20880fce60 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.349+0000 7f206f7fe700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2070069210 0x7f207006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:51.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.349+0000 7f206f7fe700 1 -- 172.21.15.62:0/867447739 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f2078085cf0 con 0x7f20880fce60 2024-05-09T06:23:51.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.349+0000 7f20867fc700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2070069210 0x7f207006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:51.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.349+0000 7f20867fc700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2070069210 0x7f207006b6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f207c009b30 tx=0x7f207c009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:51.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.353+0000 7f206f7fe700 1 -- 172.21.15.62:0/867447739 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f207804e250 con 0x7f20880fce60 2024-05-09T06:23:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:23:51.578+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f208810f750 con 0x7f2070069210 2024-05-09T06:23:52.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:52 smithi062 ceph-mon[26920]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:52.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:52 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:52.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:52 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:52.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:52 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:23:52.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:52 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:23:52.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:52 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:52 smithi079 ceph-mon[35268]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:52 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:52 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:52 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:23:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:52 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:23:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:52 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:53.387 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:53 smithi062 ceph-mon[26920]: from='client.24117 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:23:53.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:53 smithi079 ceph-mon[35268]: from='client.24117 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:23:54.345 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:54 smithi062 ceph-mon[26920]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:54.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:54 smithi079 ceph-mon[35268]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:55.697 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: Detected new or changed devices on smithi062 2024-05-09T06:23:55.697 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:55.697 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:55.697 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:23:55.698 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: Adjusting osd_memory_target on smithi062 to 12864M 2024-05-09T06:23:55.698 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:55.698 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:55.698 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:23:55.698 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:55.698 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:55.698 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:55 smithi062 ceph-mon[26920]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:55.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: Detected new or changed devices on smithi062 2024-05-09T06:23:55.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:55.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:55.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:23:55.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: Adjusting osd_memory_target on smithi062 to 12864M 2024-05-09T06:23:55.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:55.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:55.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:23:55.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:55.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:55.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:55 smithi079 ceph-mon[35268]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:56.615 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:56 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1242832299' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24f6e595-6093-4c5b-8fdd-f73da61b14ea"}]: dispatch 2024-05-09T06:23:56.615 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:56 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1242832299' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24f6e595-6093-4c5b-8fdd-f73da61b14ea"}]': finished 2024-05-09T06:23:56.615 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:56 smithi062 ceph-mon[26920]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T06:23:56.615 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:56 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:23:56.615 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:56 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:56.615 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:56 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:56.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:56 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1242832299' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24f6e595-6093-4c5b-8fdd-f73da61b14ea"}]: dispatch 2024-05-09T06:23:56.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:56 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1242832299' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24f6e595-6093-4c5b-8fdd-f73da61b14ea"}]': finished 2024-05-09T06:23:56.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:56 smithi079 ceph-mon[35268]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T06:23:56.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:56 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:23:56.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:56 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:56.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:56 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:23:57.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:57 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2856483416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:23:57.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:57 smithi079 ceph-mon[35268]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:23:57.855 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:57 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2856483416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:23:57.856 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:57 smithi062 ceph-mon[26920]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:59 smithi062 ceph-mon[26920]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:00.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:23:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:00.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:00.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:00.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:00.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:00.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:00.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:59 smithi079 ceph-mon[35268]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:00.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:23:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:02.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:02 smithi062 ceph-mon[26920]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:02.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:02 smithi079 ceph-mon[35268]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:04.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:04 smithi079 ceph-mon[35268]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:04.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:24:04.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:04.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:04 smithi079 ceph-mon[35268]: Deploying daemon osd.1 on smithi062 2024-05-09T06:24:04.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:04 smithi062 ceph-mon[26920]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:04.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:24:04.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:04.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:04 smithi062 ceph-mon[26920]: Deploying daemon osd.1 on smithi062 2024-05-09T06:24:06.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:06 smithi062 ceph-mon[26920]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:06.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:06 smithi079 ceph-mon[35268]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:08.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:08 smithi079 ceph-mon[35268]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:08.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:08 smithi062 ceph-mon[26920]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:09.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:09 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:09.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:09 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:09.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:09 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:09.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:09 smithi079 ceph-mon[35268]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:09.909 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:09 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:09.909 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:09 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:09.909 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:09 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:09.909 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:09 smithi062 ceph-mon[26920]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:12.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:12 smithi079 ceph-mon[35268]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:12.349 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:12 smithi062 ceph-mon[26920]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:12.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.436+0000 7f206f7fe700 1 -- 172.21.15.62:0/867447739 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f208810f750 con 0x7f2070069210 2024-05-09T06:24:12.420 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 1 on host 'smithi062' 2024-05-09T06:24:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2070069210 msgr2=0x7f207006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2070069210 0x7f207006b6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f207c009b30 tx=0x7f207c009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880fce60 msgr2=0x7f208810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880fce60 0x7f208810d940 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2078009fd0 tx=0x7f207800b040 comp rx=0 tx=0).stop 2024-05-09T06:24:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 shutdown_connections 2024-05-09T06:24:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2070069210 0x7f207006b6c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20880fce60 0x7f208810d940 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 --2- 172.21.15.62:0/867447739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20880fdfd0 0x7f208810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 >> 172.21.15.62:0/867447739 conn(0x7f20880f8540 msgr2=0x7f20880f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 shutdown_connections 2024-05-09T06:24:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:12.439+0000 7f208d378700 1 -- 172.21.15.62:0/867447739 wait complete. 2024-05-09T06:24:13.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:13 smithi079 ceph-mon[35268]: from='osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T06:24:13.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:13 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:13.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:13 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:13.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:13 smithi062 ceph-mon[26920]: from='osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T06:24:13.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:13 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:13.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:13 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:13.562 DEBUG:teuthology.orchestra.run.smithi062:osd.1> sudo journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.1.service 2024-05-09T06:24:13.565 INFO:tasks.cephadm:Deploying osd.2 on smithi062 with /dev/vg_nvme/lv_2... 2024-05-09T06:24:13.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T06:24:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:24:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:14 smithi062 ceph-mon[26920]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:14 smithi062 ceph-mon[26920]: from='osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T06:24:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:14 smithi062 ceph-mon[26920]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T06:24:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:14 smithi062 ceph-mon[26920]: from='osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:24:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:14.414 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:14 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[52726]: 2024-05-09T06:24:14.113+0000 7f6fb262d700 -1 osd.1 0 waiting for initial osdmap 2024-05-09T06:24:14.414 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:14 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[52726]: 2024-05-09T06:24:14.117+0000 7f6fadc29700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:24:14.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:14 smithi079 ceph-mon[35268]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:14.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:14 smithi079 ceph-mon[35268]: from='osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T06:24:14.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:14 smithi079 ceph-mon[35268]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T06:24:14.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:14.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:14 smithi079 ceph-mon[35268]: from='osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:24:14.596 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:15.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:15 smithi062 ceph-mon[26920]: from='osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-09T06:24:15.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:15 smithi062 ceph-mon[26920]: osdmap e13: 2 total, 1 up, 2 in 2024-05-09T06:24:15.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:15 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:15.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:15 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:15 smithi079 ceph-mon[35268]: from='osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-09T06:24:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:15 smithi079 ceph-mon[35268]: osdmap e13: 2 total, 1 up, 2 in 2024-05-09T06:24:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:15 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:15 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:16.342 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:16 smithi062 ceph-mon[26920]: purged_snaps scrub starts 2024-05-09T06:24:16.342 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:16 smithi062 ceph-mon[26920]: purged_snaps scrub ok 2024-05-09T06:24:16.342 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:16 smithi062 ceph-mon[26920]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:16.342 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:16.342 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:16 smithi062 ceph-mon[26920]: osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] boot 2024-05-09T06:24:16.342 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:16 smithi062 ceph-mon[26920]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T06:24:16.342 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:16 smithi079 ceph-mon[35268]: purged_snaps scrub starts 2024-05-09T06:24:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:16 smithi079 ceph-mon[35268]: purged_snaps scrub ok 2024-05-09T06:24:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:16 smithi079 ceph-mon[35268]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:16 smithi079 ceph-mon[35268]: osd.1 [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] boot 2024-05-09T06:24:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:16 smithi079 ceph-mon[35268]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T06:24:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T06:24:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T06:24:16.960 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-05-09T06:24:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-05-09T06:24:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0134421 s, 780 MB/s 2024-05-09T06:24:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-05-09T06:24:17.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:17 smithi062 ceph-mon[26920]: osdmap e15: 2 total, 2 up, 2 in 2024-05-09T06:24:17.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:17 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:17.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:17 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:17.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:17 smithi079 ceph-mon[35268]: osdmap e15: 2 total, 2 up, 2 in 2024-05-09T06:24:17.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:17 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:17.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:17 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:17.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_2 2024-05-09T06:24:18.402 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:24:18.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:18 smithi062 ceph-mon[26920]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:18 smithi079 ceph-mon[35268]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:20.347 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:20 smithi062 ceph-mon[26920]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:20.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:20 smithi079 ceph-mon[35268]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.184+0000 7f9ad1d67700 1 -- 172.21.15.62:0/4280437572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc066f30 msgr2=0x7f9acc0ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.184+0000 7f9ad1d67700 1 --2- 172.21.15.62:0/4280437572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc066f30 0x7f9acc0ff9d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9abc004940 tx=0x7f9abc009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.184+0000 7f9ad1d67700 1 -- 172.21.15.62:0/4280437572 shutdown_connections 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.184+0000 7f9ad1d67700 1 --2- 172.21.15.62:0/4280437572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc0fff10 0x7f9acc102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.184+0000 7f9ad1d67700 1 --2- 172.21.15.62:0/4280437572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc066f30 0x7f9acc0ff9d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.184+0000 7f9ad1d67700 1 -- 172.21.15.62:0/4280437572 >> 172.21.15.62:0/4280437572 conn(0x7f9acc0f7440 msgr2=0x7f9acc0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.184+0000 7f9ad1d67700 1 -- 172.21.15.62:0/4280437572 shutdown_connections 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.185+0000 7f9ad1d67700 1 -- 172.21.15.62:0/4280437572 wait complete. 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.185+0000 7f9ad1d67700 1 Processor -- start 2024-05-09T06:24:21.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.185+0000 7f9ad1d67700 1 -- start start 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.185+0000 7f9ad1d67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc066f30 0x7f9acc10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.185+0000 7f9ad1d67700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc0fff10 0x7f9acc10def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.185+0000 7f9ad1d67700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc10e4f0 con 0x7f9acc0fff10 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.185+0000 7f9ad1d67700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc10e660 con 0x7f9acc066f30 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9acaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc0fff10 0x7f9acc10def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9acaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc0fff10 0x7f9acc10def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58064/0 (socket says 172.21.15.62:58064) 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9acaffd700 1 -- 172.21.15.62:0/987777575 learned_addr learned my addr 172.21.15.62:0/987777575 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9acb7fe700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc066f30 0x7f9acc10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9acaffd700 1 -- 172.21.15.62:0/987777575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc066f30 msgr2=0x7f9acc10d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9acaffd700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc066f30 0x7f9acc10d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9acaffd700 1 -- 172.21.15.62:0/987777575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc005040 con 0x7f9acc0fff10 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9acaffd700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc0fff10 0x7f9acc10def0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000c830 tx=0x7f9ac0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:24:21.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9ab3fff700 1 -- 172.21.15.62:0/987777575 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac00106f0 con 0x7f9acc0fff10 2024-05-09T06:24:21.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc1130c0 con 0x7f9acc0fff10 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc113680 con 0x7f9acc0fff10 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9ab3fff700 1 -- 172.21.15.62:0/987777575 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ac0010d20 con 0x7f9acc0fff10 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.186+0000 7f9ab3fff700 1 -- 172.21.15.62:0/987777575 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac0012400 con 0x7f9acc0fff10 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.188+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab80052e0 con 0x7f9acc0fff10 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.188+0000 7f9ab3fff700 1 -- 172.21.15.62:0/987777575 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f9ac0012560 con 0x7f9acc0fff10 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.188+0000 7f9ab3fff700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9ab406d620 0x7f9ab406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.189+0000 7f9ab3fff700 1 -- 172.21.15.62:0/987777575 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f9ac0086310 con 0x7f9acc0fff10 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.189+0000 7f9acb7fe700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9ab406d620 0x7f9ab406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:21.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.189+0000 7f9acb7fe700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9ab406d620 0x7f9ab406fad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00b970 tx=0x7f9abc009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:24:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.193+0000 7f9ab3fff700 1 -- 172.21.15.62:0/987777575 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9ac0056e10 con 0x7f9acc0fff10 2024-05-09T06:24:21.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:21.413+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ab8000bf0 con 0x7f9ab406d620 2024-05-09T06:24:22.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: Detected new or changed devices on smithi062 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: Adjusting osd_memory_target on smithi062 to 6432M 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:22.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:22.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:24:22.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:24:22.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:22.112 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: Detected new or changed devices on smithi062 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: Adjusting osd_memory_target on smithi062 to 6432M 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:22.113 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:22.114 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:24:22.114 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:24:22.114 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:22 smithi079 ceph-mon[35268]: from='client.14294 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:24:23.141 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:22 smithi062 ceph-mon[26920]: from='client.14294 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:24:24.034 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:23 smithi062 ceph-mon[26920]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:24.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:23 smithi079 ceph-mon[35268]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:24.858 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:24 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3135753266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a38acec-7591-47bb-ad1e-0330768d0fc9"}]: dispatch 2024-05-09T06:24:24.858 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:24 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3135753266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a38acec-7591-47bb-ad1e-0330768d0fc9"}]': finished 2024-05-09T06:24:24.858 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:24 smithi062 ceph-mon[26920]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T06:24:24.858 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:24 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:25.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:24 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3135753266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a38acec-7591-47bb-ad1e-0330768d0fc9"}]: dispatch 2024-05-09T06:24:25.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:24 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3135753266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a38acec-7591-47bb-ad1e-0330768d0fc9"}]': finished 2024-05-09T06:24:25.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:24 smithi079 ceph-mon[35268]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T06:24:25.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:24 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:25.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:25 smithi062 ceph-mon[26920]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:25.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:25 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2082674836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:24:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:25 smithi079 ceph-mon[35268]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:25 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2082674836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:24:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:27 smithi079 ceph-mon[35268]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:27 smithi062 ceph-mon[26920]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:29.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:30.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:30 smithi062 ceph-mon[26920]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:30.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:30 smithi079 ceph-mon[35268]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:32.388 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:32 smithi062 ceph-mon[26920]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:32.389 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:32 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:24:32.389 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:32 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:32.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:32 smithi079 ceph-mon[35268]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:32.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:32 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:24:32.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:32 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:33.246 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:33 smithi062 ceph-mon[26920]: Deploying daemon osd.2 on smithi062 2024-05-09T06:24:33.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:33 smithi079 ceph-mon[35268]: Deploying daemon osd.2 on smithi062 2024-05-09T06:24:34.334 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:34 smithi062 ceph-mon[26920]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:34.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:34 smithi079 ceph-mon[35268]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:36.300 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:36 smithi062 ceph-mon[26920]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:36.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:36 smithi079 ceph-mon[35268]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:38.360 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:38 smithi062 ceph-mon[26920]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:38.360 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:38.360 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:38.360 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:38 smithi079 ceph-mon[35268]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:40.513 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:40 smithi062 ceph-mon[26920]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:40.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:40 smithi079 ceph-mon[35268]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:41.000 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 2 on host 'smithi062' 2024-05-09T06:24:41.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.017+0000 7f9ab3fff700 1 -- 172.21.15.62:0/987777575 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9ab8000bf0 con 0x7f9ab406d620 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9ab406d620 msgr2=0x7f9ab406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9ab406d620 0x7f9ab406fad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00b970 tx=0x7f9abc009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc0fff10 msgr2=0x7f9acc10def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc0fff10 0x7f9acc10def0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000c830 tx=0x7f9ac0004470 comp rx=0 tx=0).stop 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 shutdown_connections 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9ab406d620 0x7f9ab406fad0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc066f30 0x7f9acc10d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 --2- 172.21.15.62:0/987777575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9acc0fff10 0x7f9acc10def0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 >> 172.21.15.62:0/987777575 conn(0x7f9acc0f7440 msgr2=0x7f9acc0f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 shutdown_connections 2024-05-09T06:24:41.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:24:41.019+0000 7f9ad1d67700 1 -- 172.21.15.62:0/987777575 wait complete. 2024-05-09T06:24:41.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:41 smithi079 ceph-mon[35268]: from='osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T06:24:41.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:41 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:41.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:41 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:41.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:41 smithi062 ceph-mon[26920]: from='osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T06:24:41.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:41.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:41.936 DEBUG:teuthology.orchestra.run.smithi062:osd.2> sudo journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.2.service 2024-05-09T06:24:41.939 INFO:tasks.cephadm:Deploying osd.3 on smithi079 with /dev/vg_nvme/lv_4... 2024-05-09T06:24:41.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T06:24:42.199 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi079/config 2024-05-09T06:24:42.312 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:42 smithi079 ceph-mon[35268]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:42.312 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:42 smithi079 ceph-mon[35268]: from='osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T06:24:42.312 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:42 smithi079 ceph-mon[35268]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T06:24:42.312 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:42 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:42.312 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:42 smithi079 ceph-mon[35268]: from='osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:24:42.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:42 smithi062 ceph-mon[26920]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:42.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:42 smithi062 ceph-mon[26920]: from='osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T06:24:42.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:42 smithi062 ceph-mon[26920]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T06:24:42.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:42 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:42.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:42 smithi062 ceph-mon[26920]: from='osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:24:42.664 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:42 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[60484]: 2024-05-09T06:24:42.223+0000 7f6ad469a700 -1 osd.2 0 waiting for initial osdmap 2024-05-09T06:24:42.664 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:42 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[60484]: 2024-05-09T06:24:42.231+0000 7f6acf495700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:24:43.469 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:43 smithi079 ceph-mon[35268]: from='osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-09T06:24:43.470 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:43 smithi079 ceph-mon[35268]: osdmap e18: 3 total, 2 up, 3 in 2024-05-09T06:24:43.470 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:43.470 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:43.569 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:43 smithi062 ceph-mon[26920]: from='osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-05-09T06:24:43.569 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:43 smithi062 ceph-mon[26920]: osdmap e18: 3 total, 2 up, 3 in 2024-05-09T06:24:43.569 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:43.569 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:44.011 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T06:24:44.011 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T06:24:44.011 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2024-05-09T06:24:44.012 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2024-05-09T06:24:44.012 INFO:teuthology.orchestra.run.smithi079.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123702 s, 848 MB/s 2024-05-09T06:24:44.012 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: purged_snaps scrub starts 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: purged_snaps scrub ok 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] boot 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:44.474 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: purged_snaps scrub starts 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: purged_snaps scrub ok 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: osd.2 [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] boot 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:44.475 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:44.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_4 2024-05-09T06:24:44.891 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi079/config 2024-05-09T06:24:45.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:45 smithi062 ceph-mon[26920]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T06:24:45.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:45 smithi079 ceph-mon[35268]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.394+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/188425180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fdfd0 msgr2=0x7f5d580fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 --2- 172.21.15.79:0/188425180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fdfd0 0x7f5d580fe440 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c004940 tx=0x7f5d4c009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/188425180 shutdown_connections 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 --2- 172.21.15.79:0/188425180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fdfd0 0x7f5d580fe440 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 --2- 172.21.15.79:0/188425180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d580fce60 0x7f5d580fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/188425180 >> 172.21.15.79:0/188425180 conn(0x7f5d580f8540 msgr2=0x7f5d580fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/188425180 shutdown_connections 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/188425180 wait complete. 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 Processor -- start 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.395+0000 7f5d5c8ff700 1 -- start start 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5c8ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fce60 0x7f5d5810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:46.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5c8ff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d580fdfd0 0x7f5d5810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:46.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5c8ff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5810e450 con 0x7f5d580fdfd0 2024-05-09T06:24:46.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5c8ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5810e5c0 con 0x7f5d580fce60 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fce60 0x7f5d5810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fce60 0x7f5d5810d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46696/0 (socket says 172.21.15.79:46696) 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5659c700 1 -- 172.21.15.79:0/2191910676 learned_addr learned my addr 172.21.15.79:0/2191910676 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d55d9b700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d580fdfd0 0x7f5d5810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5659c700 1 -- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d580fdfd0 msgr2=0x7f5d5810de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5659c700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d580fdfd0 0x7f5d5810de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5659c700 1 -- 172.21.15.79:0/2191910676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c005040 con 0x7f5d580fce60 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5659c700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fce60 0x7f5d5810d910 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5d48002a50 tx=0x7f5d480046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:24:46.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d46ffd700 1 -- 172.21.15.79:0/2191910676 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d48007cc0 con 0x7f5d580fce60 2024-05-09T06:24:46.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d46ffd700 1 -- 172.21.15.79:0/2191910676 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d4800f040 con 0x7f5d580fce60 2024-05-09T06:24:46.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d58112fc0 con 0x7f5d580fce60 2024-05-09T06:24:46.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d46ffd700 1 -- 172.21.15.79:0/2191910676 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4800da30 con 0x7f5d580fce60 2024-05-09T06:24:46.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.396+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d58113550 con 0x7f5d580fce60 2024-05-09T06:24:46.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.397+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5804c710 con 0x7f5d580fce60 2024-05-09T06:24:46.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.398+0000 7f5d46ffd700 1 -- 172.21.15.79:0/2191910676 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f5d4800db90 con 0x7f5d580fce60 2024-05-09T06:24:46.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.398+0000 7f5d46ffd700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5d40069210 0x7f5d4006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:46.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.399+0000 7f5d46ffd700 1 -- 172.21.15.79:0/2191910676 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f5d48086570 con 0x7f5d580fce60 2024-05-09T06:24:46.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.399+0000 7f5d55d9b700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5d40069210 0x7f5d4006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:46.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.399+0000 7f5d55d9b700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5d40069210 0x7f5d4006b6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00b3b0 tx=0x7f5d4c009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:24:46.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.403+0000 7f5d46ffd700 1 -- 172.21.15.79:0/2191910676 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5d48056c50 con 0x7f5d580fce60 2024-05-09T06:24:46.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:46.598+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d58113740 con 0x7f5d40069210 2024-05-09T06:24:46.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:46 smithi062 ceph-mon[26920]: pgmap v76: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:46.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:46 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-09T06:24:46.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:46 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-09T06:24:46.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:46 smithi062 ceph-mon[26920]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T06:24:46.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:46 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T06:24:46.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:46 smithi079 ceph-mon[35268]: pgmap v76: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:46.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:46 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-09T06:24:46.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:46 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-09T06:24:46.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:46 smithi079 ceph-mon[35268]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T06:24:46.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:46 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T06:24:47.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:47 smithi079 ceph-mon[35268]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:24:47.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:47 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:24:47.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:47 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T06:24:47.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:47 smithi079 ceph-mon[35268]: osdmap e22: 3 total, 3 up, 3 in 2024-05-09T06:24:47.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:47 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:24:47.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:47 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:47.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:47 smithi079 ceph-mon[35268]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:47.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:24:47.615+0000 7f5d46ffd700 1 -- 172.21.15.79:0/2191910676 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5d48053590 con 0x7f5d580fce60 2024-05-09T06:24:47.801 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:47 smithi062 ceph-mon[26920]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:24:47.802 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:24:47.802 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T06:24:47.802 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:47 smithi062 ceph-mon[26920]: osdmap e22: 3 total, 3 up, 3 in 2024-05-09T06:24:47.802 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:24:47.802 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:47 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:47.802 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:47 smithi062 ceph-mon[26920]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:47.803 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:24:47 smithi062 sudo[64686]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:24:47.803 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:24:47 smithi062 sudo[64686]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:47.803 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:24:47 smithi062 sudo[64686]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:47.803 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:24:47 smithi062 sudo[64686]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:48.085 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:24:47 smithi062 sudo[64697]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:24:48.085 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:24:47 smithi062 sudo[64697]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:48.085 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:24:47 smithi062 sudo[64697]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:48.085 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:24:47 smithi062 sudo[64697]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:48.663 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:48 smithi062 sudo[64764]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:24:48.663 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:48 smithi062 sudo[64764]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:48.663 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:48 smithi062 sudo[64764]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:48.663 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:48 smithi062 sudo[64764]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:48.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: osdmap e23: 3 total, 3 up, 3 in 2024-05-09T06:24:48.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: mgrmap e19: smithi062.juuasl(active, since 2m), standbys: smithi079.genyri 2024-05-09T06:24:48.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:48.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: Detected new or changed devices on smithi062 2024-05-09T06:24:48.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: Adjusting osd_memory_target on smithi062 to 4288M 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:48.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:48 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:49.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: osdmap e23: 3 total, 3 up, 3 in 2024-05-09T06:24:49.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: mgrmap e19: smithi062.juuasl(active, since 2m), standbys: smithi079.genyri 2024-05-09T06:24:49.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:49.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: Detected new or changed devices on smithi062 2024-05-09T06:24:49.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:49.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: Adjusting osd_memory_target on smithi062 to 4288M 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:49.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:48 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:49.162 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:48 smithi062 sudo[64767]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:24:49.163 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:48 smithi062 sudo[64767]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:49.163 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:48 smithi062 sudo[64767]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:49.163 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:24:48 smithi062 sudo[64767]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:49.595 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:49 smithi062 sudo[64770]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:24:49.595 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:49 smithi062 sudo[64770]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:49.595 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:49 smithi062 sudo[64770]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:49.595 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:49 smithi062 sudo[64770]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:49.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:49 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/722468805' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc60aef9-47d8-41c9-8339-ff9e30ad307b"}]: dispatch 2024-05-09T06:24:49.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:49 smithi079 ceph-mon[35268]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc60aef9-47d8-41c9-8339-ff9e30ad307b"}]: dispatch 2024-05-09T06:24:49.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:49 smithi079 ceph-mon[35268]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc60aef9-47d8-41c9-8339-ff9e30ad307b"}]': finished 2024-05-09T06:24:49.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:49 smithi079 ceph-mon[35268]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T06:24:49.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:49 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:24:49.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:49 smithi079 ceph-mon[35268]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:49.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:49 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/2528864567' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:24:49.912 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:49 smithi062 sudo[64773]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:24:49.913 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:49 smithi062 sudo[64773]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:49.913 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:49 smithi062 sudo[64773]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:49.913 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:24:49 smithi062 sudo[64773]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:49.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:49 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/722468805' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc60aef9-47d8-41c9-8339-ff9e30ad307b"}]: dispatch 2024-05-09T06:24:49.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:49 smithi062 ceph-mon[26920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc60aef9-47d8-41c9-8339-ff9e30ad307b"}]: dispatch 2024-05-09T06:24:49.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:49 smithi062 ceph-mon[26920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc60aef9-47d8-41c9-8339-ff9e30ad307b"}]': finished 2024-05-09T06:24:49.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:49 smithi062 ceph-mon[26920]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T06:24:49.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:49 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:24:49.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:49 smithi062 ceph-mon[26920]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:49.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:49 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2528864567' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:24:50.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:50 smithi062 sudo[64776]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:24:50.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:50 smithi062 sudo[64776]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:50.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:50 smithi062 sudo[64776]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:50.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:50 smithi062 sudo[64776]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:51.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:50 smithi062 sudo[64779]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:24:51.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:50 smithi062 sudo[64779]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:51.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:50 smithi062 sudo[64779]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:51.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:50 smithi062 sudo[64779]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:51.173 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:50 smithi079 sudo[39137]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:24:51.173 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:50 smithi079 sudo[39137]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:51.173 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:50 smithi079 sudo[39137]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:51.173 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:50 smithi079 sudo[39137]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 sudo[39326]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 sudo[39326]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 sudo[39326]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 sudo[39326]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 ceph-mon[35268]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 ceph-mon[35268]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:24:51.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:51 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:24:51.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:51 smithi062 ceph-mon[26920]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T06:24:51.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:51 smithi062 ceph-mon[26920]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T06:24:51.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:51 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:24:51.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:51 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:24:51.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:51 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:24:51.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:51 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:24:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:52 smithi079 ceph-mon[35268]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T06:24:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:52 smithi079 ceph-mon[35268]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:52 smithi079 ceph-mon[35268]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T06:24:52.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:52 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:52.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:52 smithi062 ceph-mon[26920]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T06:24:52.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:52 smithi062 ceph-mon[26920]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:52.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:52 smithi062 ceph-mon[26920]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T06:24:52.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:52 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:24:54.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:54 smithi079 ceph-mon[35268]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:54.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:54 smithi062 ceph-mon[26920]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:56.479 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:56 smithi079 ceph-mon[35268]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:56.479 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:56 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:24:56.479 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:56 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:56.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:56 smithi062 ceph-mon[26920]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:24:56.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:56 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:24:56.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:56 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:57.299 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:57 smithi079 ceph-mon[35268]: Deploying daemon osd.3 on smithi079 2024-05-09T06:24:57.514 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:57 smithi062 ceph-mon[26920]: Deploying daemon osd.3 on smithi079 2024-05-09T06:24:58.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:58 smithi079 ceph-mon[35268]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-05-09T06:24:58.664 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:58 smithi062 ceph-mon[26920]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-05-09T06:24:59.487 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:24:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:59.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:24:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:00.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:00 smithi079 ceph-mon[35268]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-09T06:25:00.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:00 smithi062 ceph-mon[26920]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-09T06:25:01.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:01 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:01.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:01 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:01.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:01 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:01.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:01 smithi062 ceph-mon[26920]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-05-09T06:25:02.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:01 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:02.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:01 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:02.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:01 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:02.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:01 smithi079 ceph-mon[35268]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-05-09T06:25:03.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.859+0000 7f5d46ffd700 1 -- 172.21.15.79:0/2191910676 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5d58113740 con 0x7f5d40069210 2024-05-09T06:25:03.843 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 3 on host 'smithi079' 2024-05-09T06:25:03.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5d40069210 msgr2=0x7f5d4006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:03.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5d40069210 0x7f5d4006b6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00b3b0 tx=0x7f5d4c009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:03.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fce60 msgr2=0x7f5d5810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:03.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fce60 0x7f5d5810d910 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5d48002a50 tx=0x7f5d480046b0 comp rx=0 tx=0).stop 2024-05-09T06:25:03.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 shutdown_connections 2024-05-09T06:25:03.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5d40069210 0x7f5d4006b6c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:03.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d580fce60 0x7f5d5810d910 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:03.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 --2- 172.21.15.79:0/2191910676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d580fdfd0 0x7f5d5810de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:03.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 >> 172.21.15.79:0/2191910676 conn(0x7f5d580f8540 msgr2=0x7f5d580f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:03.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 shutdown_connections 2024-05-09T06:25:03.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:03.862+0000 7f5d5c8ff700 1 -- 172.21.15.79:0/2191910676 wait complete. 2024-05-09T06:25:04.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:04 smithi079 ceph-mon[35268]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-09T06:25:04.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:04.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:04 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:04.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:04 smithi062 ceph-mon[26920]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-09T06:25:04.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:04.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:04 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:04.701 DEBUG:teuthology.orchestra.run.smithi079:osd.3> sudo journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.3.service 2024-05-09T06:25:04.707 INFO:tasks.cephadm:Deploying osd.4 on smithi079 with /dev/vg_nvme/lv_3... 2024-05-09T06:25:04.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T06:25:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi079/config 2024-05-09T06:25:05.389 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:05 smithi079 ceph-mon[35268]: from='osd.3 [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:25:05.389 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:05 smithi079 ceph-mon[35268]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:25:05.389 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:05 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:05.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:05 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:05.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:05 smithi062 ceph-mon[26920]: from='osd.3 [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:25:05.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:05 smithi062 ceph-mon[26920]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:25:05.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:05 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:05.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:05 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:06.296 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:06 smithi079 ceph-mon[35268]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-09T06:25:06.296 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:06 smithi079 ceph-mon[35268]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T06:25:06.296 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:06 smithi079 ceph-mon[35268]: osdmap e25: 4 total, 3 up, 4 in 2024-05-09T06:25:06.296 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:06 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:06.296 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:06 smithi079 ceph-mon[35268]: from='osd.3 [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:06.296 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:06 smithi079 ceph-mon[35268]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:06.297 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:25:06 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[40732]: 2024-05-09T06:25:06.127+0000 7f9c451bb700 -1 osd.3 0 waiting for initial osdmap 2024-05-09T06:25:06.297 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:25:06 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[40732]: 2024-05-09T06:25:06.132+0000 7f9c3f7b5700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:25:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:06 smithi062 ceph-mon[26920]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-05-09T06:25:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:06 smithi062 ceph-mon[26920]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T06:25:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:06 smithi062 ceph-mon[26920]: osdmap e25: 4 total, 3 up, 4 in 2024-05-09T06:25:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:06 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:06 smithi062 ceph-mon[26920]: from='osd.3 [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:06.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:06 smithi062 ceph-mon[26920]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:06.900 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T06:25:06.900 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T06:25:06.901 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2024-05-09T06:25:06.901 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2024-05-09T06:25:06.901 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127885 s, 820 MB/s 2024-05-09T06:25:06.901 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2024-05-09T06:25:07.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:07 smithi079 ceph-mon[35268]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-05-09T06:25:07.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:07 smithi079 ceph-mon[35268]: osdmap e26: 4 total, 3 up, 4 in 2024-05-09T06:25:07.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:07 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:07.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:07 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:07.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:07 smithi062 ceph-mon[26920]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-05-09T06:25:07.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:07 smithi062 ceph-mon[26920]: osdmap e26: 4 total, 3 up, 4 in 2024-05-09T06:25:07.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:07 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:07.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:07 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:08.012 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_3 2024-05-09T06:25:08.283 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:08 smithi079 ceph-mon[35268]: purged_snaps scrub starts 2024-05-09T06:25:08.283 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:08 smithi079 ceph-mon[35268]: purged_snaps scrub ok 2024-05-09T06:25:08.283 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:08 smithi079 ceph-mon[35268]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:08.284 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:08 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:08.284 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:08 smithi079 ceph-mon[35268]: osd.3 [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] boot 2024-05-09T06:25:08.284 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:08 smithi079 ceph-mon[35268]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T06:25:08.284 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:08 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:08.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:08 smithi062 ceph-mon[26920]: purged_snaps scrub starts 2024-05-09T06:25:08.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:08 smithi062 ceph-mon[26920]: purged_snaps scrub ok 2024-05-09T06:25:08.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:08 smithi062 ceph-mon[26920]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:08.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:08 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:08.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:08 smithi062 ceph-mon[26920]: osd.3 [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] boot 2024-05-09T06:25:08.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:08 smithi062 ceph-mon[26920]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T06:25:08.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:08 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:08.472 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi079/config 2024-05-09T06:25:09.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:09 smithi079 ceph-mon[35268]: osdmap e28: 4 total, 4 up, 4 in 2024-05-09T06:25:09.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:09 smithi062 ceph-mon[26920]: osdmap e28: 4 total, 4 up, 4 in 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: osdmap e29: 4 total, 4 up, 4 in 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:10.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:10.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:10.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:10 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:10.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: osdmap e29: 4 total, 4 up, 4 in 2024-05-09T06:25:10.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:10.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:10.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:10.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:10.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:10.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:10.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:10 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 -- 172.21.15.79:0/1140071429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fcf70 msgr2=0x7f8a7c0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 --2- 172.21.15.79:0/1140071429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fcf70 0x7f8a7c0fd3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a70004940 tx=0x7f8a70009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 -- 172.21.15.79:0/1140071429 shutdown_connections 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 --2- 172.21.15.79:0/1140071429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fcf70 0x7f8a7c0fd3e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 --2- 172.21.15.79:0/1140071429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c0fbcc0 0x7f8a7c0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 -- 172.21.15.79:0/1140071429 >> 172.21.15.79:0/1140071429 conn(0x7f8a7c0f7440 msgr2=0x7f8a7c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 -- 172.21.15.79:0/1140071429 shutdown_connections 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 -- 172.21.15.79:0/1140071429 wait complete. 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 Processor -- start 2024-05-09T06:25:10.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 -- start start 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.573+0000 7f8a811c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fbcc0 0x7f8a7c066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a811c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c0fcf70 0x7f8a7c112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a811c8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c112bd0 con 0x7f8a7c0fcf70 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a811c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c112d10 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fbcc0 0x7f8a7c066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fbcc0 0x7f8a7c066d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33318/0 (socket says 172.21.15.79:33318) 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7ad9d700 1 -- 172.21.15.79:0/4082935532 learned_addr learned my addr 172.21.15.79:0/4082935532 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7a59c700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c0fcf70 0x7f8a7c112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7ad9d700 1 -- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c0fcf70 msgr2=0x7f8a7c112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7ad9d700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c0fcf70 0x7f8a7c112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7ad9d700 1 -- 172.21.15.79:0/4082935532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70005040 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7a59c700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c0fcf70 0x7f8a7c112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a7ad9d700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fbcc0 0x7f8a7c066d10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c002a80 tx=0x7f8a6c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:10.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a637fe700 1 -- 172.21.15.79:0/4082935532 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6c007cc0 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7c112f40 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a637fe700 1 -- 172.21.15.79:0/4082935532 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a6c00f040 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a637fe700 1 -- 172.21.15.79:0/4082935532 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6c0096f0 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.574+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c113420 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.575+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7c04c710 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.576+0000 7f8a637fe700 1 -- 172.21.15.79:0/4082935532 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8a6c00d690 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.576+0000 7f8a637fe700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f8a640692a0 0x7f8a6406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:10.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.576+0000 7f8a637fe700 1 -- 172.21.15.79:0/4082935532 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f8a6c086380 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.576+0000 7f8a7a59c700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f8a640692a0 0x7f8a6406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:10.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.577+0000 7f8a7a59c700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f8a640692a0 0x7f8a6406b750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000b3b0 tx=0x7f8a70009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:10.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.581+0000 7f8a637fe700 1 -- 172.21.15.79:0/4082935532 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8a6c04d250 con 0x7f8a7c0fbcc0 2024-05-09T06:25:10.754 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:10.771+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a7c113640 con 0x7f8a640692a0 2024-05-09T06:25:11.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:11 smithi062 ceph-mon[26920]: Detected new or changed devices on smithi079 2024-05-09T06:25:11.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:11 smithi062 ceph-mon[26920]: Adjusting osd_memory_target on smithi079 to 15936M 2024-05-09T06:25:11.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:11 smithi062 ceph-mon[26920]: osdmap e30: 4 total, 4 up, 4 in 2024-05-09T06:25:11.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:11 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:11.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:11 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:11.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:11 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:11.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:11 smithi062 ceph-mon[26920]: osdmap e31: 4 total, 4 up, 4 in 2024-05-09T06:25:11.440 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:11 smithi079 ceph-mon[35268]: Detected new or changed devices on smithi079 2024-05-09T06:25:11.440 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:11 smithi079 ceph-mon[35268]: Adjusting osd_memory_target on smithi079 to 15936M 2024-05-09T06:25:11.440 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:11 smithi079 ceph-mon[35268]: osdmap e30: 4 total, 4 up, 4 in 2024-05-09T06:25:11.440 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:11 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:11.440 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:11 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:11.440 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:11 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:11.440 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:11 smithi079 ceph-mon[35268]: osdmap e31: 4 total, 4 up, 4 in 2024-05-09T06:25:12.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:12 smithi062 ceph-mon[26920]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:12.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:12 smithi062 ceph-mon[26920]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:12.438 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:12 smithi079 ceph-mon[35268]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:12.438 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:12 smithi079 ceph-mon[35268]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:13.406 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:13 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/213848284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5234289d-7aea-415e-a8fc-e45c5af2b4c8"}]: dispatch 2024-05-09T06:25:13.406 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:13 smithi079 ceph-mon[35268]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5234289d-7aea-415e-a8fc-e45c5af2b4c8"}]: dispatch 2024-05-09T06:25:13.406 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:13 smithi079 ceph-mon[35268]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5234289d-7aea-415e-a8fc-e45c5af2b4c8"}]': finished 2024-05-09T06:25:13.406 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:13 smithi079 ceph-mon[35268]: osdmap e32: 5 total, 4 up, 5 in 2024-05-09T06:25:13.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:13 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:13.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:13 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/213848284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5234289d-7aea-415e-a8fc-e45c5af2b4c8"}]: dispatch 2024-05-09T06:25:13.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:13 smithi062 ceph-mon[26920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5234289d-7aea-415e-a8fc-e45c5af2b4c8"}]: dispatch 2024-05-09T06:25:13.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:13 smithi062 ceph-mon[26920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5234289d-7aea-415e-a8fc-e45c5af2b4c8"}]': finished 2024-05-09T06:25:13.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:13 smithi062 ceph-mon[26920]: osdmap e32: 5 total, 4 up, 5 in 2024-05-09T06:25:13.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:13 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:14 smithi062 ceph-mon[26920]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-09T06:25:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:14 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2958919098' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:14.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:14.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:14 smithi079 ceph-mon[35268]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-09T06:25:14.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:14 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/2958919098' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:14.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:16.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:16 smithi062 ceph-mon[26920]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-09T06:25:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:16 smithi079 ceph-mon[35268]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-09T06:25:18.272 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:18 smithi079 ceph-mon[35268]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-09T06:25:18.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:18 smithi062 ceph-mon[26920]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-09T06:25:20.241 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:20 smithi079 ceph-mon[35268]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T06:25:20.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:20 smithi062 ceph-mon[26920]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T06:25:21.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:25:21.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:21 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:21.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:21 smithi062 ceph-mon[26920]: Deploying daemon osd.4 on smithi079 2024-05-09T06:25:21.446 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:25:21.447 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:21 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:21.447 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:21 smithi079 ceph-mon[35268]: Deploying daemon osd.4 on smithi079 2024-05-09T06:25:22.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:22 smithi079 ceph-mon[35268]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:22.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:22 smithi062 ceph-mon[26920]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:24 smithi062 ceph-mon[26920]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:24.485 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:24 smithi079 ceph-mon[35268]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:26.251 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:26 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:26.252 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:26 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:26.252 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:26 smithi079 ceph-mon[35268]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:26.252 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:26 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:26.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:26 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:26.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:26 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:26.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:26 smithi062 ceph-mon[26920]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:26.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:26 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:28.275 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:28 smithi079 ceph-mon[35268]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:28.319 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 4 on host 'smithi079' 2024-05-09T06:25:28.319 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.336+0000 7f8a637fe700 1 -- 172.21.15.79:0/4082935532 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8a7c113640 con 0x7f8a640692a0 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.338+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f8a640692a0 msgr2=0x7f8a6406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.338+0000 7f8a811c8700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f8a640692a0 0x7f8a6406b750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000b3b0 tx=0x7f8a70009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.338+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fbcc0 msgr2=0x7f8a7c066d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.338+0000 7f8a811c8700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fbcc0 0x7f8a7c066d10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c002a80 tx=0x7f8a6c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.338+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 shutdown_connections 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.338+0000 7f8a811c8700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f8a640692a0 0x7f8a6406b750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.339+0000 7f8a811c8700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c0fbcc0 0x7f8a7c066d10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.339+0000 7f8a811c8700 1 --2- 172.21.15.79:0/4082935532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c0fcf70 0x7f8a7c112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.339+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 >> 172.21.15.79:0/4082935532 conn(0x7f8a7c0f7440 msgr2=0x7f8a7c0f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:28.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.339+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 shutdown_connections 2024-05-09T06:25:28.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:28.339+0000 7f8a811c8700 1 -- 172.21.15.79:0/4082935532 wait complete. 2024-05-09T06:25:28.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:28 smithi062 ceph-mon[26920]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:28.856 DEBUG:teuthology.orchestra.run.smithi079:osd.4> sudo journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.4.service 2024-05-09T06:25:28.858 INFO:tasks.cephadm:Deploying osd.5 on smithi079 with /dev/vg_nvme/lv_2... 2024-05-09T06:25:28.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T06:25:29.093 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:25:28 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[47557]: 2024-05-09T06:25:28.966+0000 7f0f8727c540 -1 osd.4 0 log_to_monitors true 2024-05-09T06:25:29.195 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi079/config 2024-05-09T06:25:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:29 smithi079 ceph-mon[35268]: from='osd.4 [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:25:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:29 smithi079 ceph-mon[35268]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:25:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:29 smithi079 ceph-mon[35268]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:29.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:29.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:29.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:29 smithi062 ceph-mon[26920]: from='osd.4 [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:25:29.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:29 smithi062 ceph-mon[26920]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:25:29.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:29 smithi062 ceph-mon[26920]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:29.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:30.507 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:30 smithi079 ceph-mon[35268]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T06:25:30.507 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:30 smithi079 ceph-mon[35268]: osdmap e33: 5 total, 4 up, 5 in 2024-05-09T06:25:30.507 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:30 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:30.507 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:30 smithi079 ceph-mon[35268]: from='osd.4 [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:30.508 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:30 smithi079 ceph-mon[35268]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:30.508 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:25:30 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[47557]: 2024-05-09T06:25:30.338+0000 7f0f7da4d700 -1 osd.4 0 waiting for initial osdmap 2024-05-09T06:25:30.508 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:25:30 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[47557]: 2024-05-09T06:25:30.345+0000 7f0f78848700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:25:30.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:30 smithi062 ceph-mon[26920]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T06:25:30.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:30 smithi062 ceph-mon[26920]: osdmap e33: 5 total, 4 up, 5 in 2024-05-09T06:25:30.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:30 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:30.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:30 smithi062 ceph-mon[26920]: from='osd.4 [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:30.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:30 smithi062 ceph-mon[26920]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:31.089 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T06:25:31.089 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T06:25:31.089 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2024-05-09T06:25:31.090 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2024-05-09T06:25:31.090 INFO:teuthology.orchestra.run.smithi079.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0143816 s, 729 MB/s 2024-05-09T06:25:31.090 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2024-05-09T06:25:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:31 smithi079 ceph-mon[35268]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-05-09T06:25:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:31 smithi079 ceph-mon[35268]: osdmap e34: 5 total, 4 up, 5 in 2024-05-09T06:25:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:31 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:31 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:31 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:31 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:31 smithi079 ceph-mon[35268]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:31.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:31 smithi062 ceph-mon[26920]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-05-09T06:25:31.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:31 smithi062 ceph-mon[26920]: osdmap e34: 5 total, 4 up, 5 in 2024-05-09T06:25:31.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:31 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:31.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:31 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:31.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:31 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:31.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:31 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:31.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:31 smithi062 ceph-mon[26920]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:31.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_2 2024-05-09T06:25:32.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:32 smithi079 ceph-mon[35268]: purged_snaps scrub starts 2024-05-09T06:25:32.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:32 smithi079 ceph-mon[35268]: purged_snaps scrub ok 2024-05-09T06:25:32.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:32 smithi079 ceph-mon[35268]: osd.4 [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] boot 2024-05-09T06:25:32.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:32 smithi079 ceph-mon[35268]: osdmap e35: 5 total, 5 up, 5 in 2024-05-09T06:25:32.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:32 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:32.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:32 smithi062 ceph-mon[26920]: purged_snaps scrub starts 2024-05-09T06:25:32.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:32 smithi062 ceph-mon[26920]: purged_snaps scrub ok 2024-05-09T06:25:32.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:32 smithi062 ceph-mon[26920]: osd.4 [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] boot 2024-05-09T06:25:32.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:32 smithi062 ceph-mon[26920]: osdmap e35: 5 total, 5 up, 5 in 2024-05-09T06:25:32.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:32 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi079/config 2024-05-09T06:25:34.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:33 smithi079 ceph-mon[35268]: osdmap e36: 5 total, 5 up, 5 in 2024-05-09T06:25:34.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:33 smithi079 ceph-mon[35268]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:34.096 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:33 smithi062 ceph-mon[26920]: osdmap e36: 5 total, 5 up, 5 in 2024-05-09T06:25:34.096 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:33 smithi062 ceph-mon[26920]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:35.433 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 -- 172.21.15.79:0/3655108855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 msgr2=0x7f56cc0fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 --2- 172.21.15.79:0/3655108855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 0x7f56cc0fc240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f56bc004940 tx=0x7f56bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 -- 172.21.15.79:0/3655108855 shutdown_connections 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 --2- 172.21.15.79:0/3655108855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56cc0fcfa0 0x7f56cc0fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 --2- 172.21.15.79:0/3655108855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 0x7f56cc0fc240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 -- 172.21.15.79:0/3655108855 >> 172.21.15.79:0/3655108855 conn(0x7f56cc0f7440 msgr2=0x7f56cc0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 -- 172.21.15.79:0/3655108855 shutdown_connections 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 -- 172.21.15.79:0/3655108855 wait complete. 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 Processor -- start 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.450+0000 7f56d2bc6700 1 -- start start 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d2bc6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 0x7f56cc10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:35.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d2bc6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56cc0fcfa0 0x7f56cc10df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d2bc6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc10e5e0 con 0x7f56cc0fcfa0 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d2bc6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc10edd0 con 0x7f56cc0fbe30 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d0962700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 0x7f56cc10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d0962700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 0x7f56cc10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39394/0 (socket says 172.21.15.79:39394) 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d0962700 1 -- 172.21.15.79:0/2089351527 learned_addr learned my addr 172.21.15.79:0/2089351527 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56c3fff700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56cc0fcfa0 0x7f56cc10df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d0962700 1 -- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56cc0fcfa0 msgr2=0x7f56cc10df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d0962700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56cc0fcfa0 0x7f56cc10df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d0962700 1 -- 172.21.15.79:0/2089351527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc005040 con 0x7f56cc0fbe30 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56c3fff700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56cc0fcfa0 0x7f56cc10df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.451+0000 7f56d0962700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 0x7f56cc10da10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00b3b0 tx=0x7f56bc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:35.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.452+0000 7f56c17fa700 1 -- 172.21.15.79:0/2089351527 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56bc00e040 con 0x7f56cc0fbe30 2024-05-09T06:25:35.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.452+0000 7f56c17fa700 1 -- 172.21.15.79:0/2089351527 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56bc00bcc0 con 0x7f56cc0fbe30 2024-05-09T06:25:35.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.452+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc10f050 con 0x7f56cc0fbe30 2024-05-09T06:25:35.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.452+0000 7f56c17fa700 1 -- 172.21.15.79:0/2089351527 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56bc01c630 con 0x7f56cc0fbe30 2024-05-09T06:25:35.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.452+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc10f610 con 0x7f56cc0fbe30 2024-05-09T06:25:35.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.453+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc101b30 con 0x7f56cc0fbe30 2024-05-09T06:25:35.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.453+0000 7f56c17fa700 1 -- 172.21.15.79:0/2089351527 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f56bc013980 con 0x7f56cc0fbe30 2024-05-09T06:25:35.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.454+0000 7f56c17fa700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f56b40692a0 0x7f56b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:35.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.454+0000 7f56c17fa700 1 -- 172.21.15.79:0/2089351527 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f56bc087ae0 con 0x7f56cc0fbe30 2024-05-09T06:25:35.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.454+0000 7f56c3fff700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f56b40692a0 0x7f56b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:35.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.454+0000 7f56c3fff700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f56b40692a0 0x7f56b406b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009b10 tx=0x7f56c8008040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:35.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.458+0000 7f56c17fa700 1 -- 172.21.15.79:0/2089351527 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f56bc057d10 con 0x7f56cc0fbe30 2024-05-09T06:25:35.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:35.651+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f56cc104a20 con 0x7f56b40692a0 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: Detected new or changed devices on smithi079 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: Adjusting osd_memory_target on smithi079 to 7968M 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:35.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:35.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:35.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:35.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:35.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:35 smithi079 ceph-mon[35268]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: Detected new or changed devices on smithi079 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: Adjusting osd_memory_target on smithi079 to 7968M 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:35.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:35.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:35.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:35.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:35 smithi062 ceph-mon[26920]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:36.613 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:36 smithi079 ceph-mon[35268]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:36.614 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:36.614 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:36.614 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:36.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:36 smithi062 ceph-mon[26920]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:36.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:36.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:36.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:37.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:37 smithi079 ceph-mon[35268]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:37.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:37 smithi062 ceph-mon[26920]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:38 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/1169442755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd6b559c-e9b6-4e08-bee4-8bb0df38614f"}]: dispatch 2024-05-09T06:25:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:38 smithi079 ceph-mon[35268]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd6b559c-e9b6-4e08-bee4-8bb0df38614f"}]: dispatch 2024-05-09T06:25:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:38 smithi079 ceph-mon[35268]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd6b559c-e9b6-4e08-bee4-8bb0df38614f"}]': finished 2024-05-09T06:25:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:38 smithi079 ceph-mon[35268]: osdmap e37: 6 total, 5 up, 6 in 2024-05-09T06:25:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:38.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:38 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/1169442755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd6b559c-e9b6-4e08-bee4-8bb0df38614f"}]: dispatch 2024-05-09T06:25:38.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:38 smithi062 ceph-mon[26920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd6b559c-e9b6-4e08-bee4-8bb0df38614f"}]: dispatch 2024-05-09T06:25:38.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:38 smithi062 ceph-mon[26920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd6b559c-e9b6-4e08-bee4-8bb0df38614f"}]': finished 2024-05-09T06:25:38.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:38 smithi062 ceph-mon[26920]: osdmap e37: 6 total, 5 up, 6 in 2024-05-09T06:25:38.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:39.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:39 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/1005334359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:39.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:39 smithi079 ceph-mon[35268]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:39.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:39 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/1005334359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:39.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:39 smithi062 ceph-mon[26920]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:42.396 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:42 smithi079 ceph-mon[35268]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:42.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:42 smithi062 ceph-mon[26920]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:44.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:44 smithi079 ceph-mon[35268]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:44.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:44 smithi062 ceph-mon[26920]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:45.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:25:45.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:45.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:25:45.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:46.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:46 smithi062 ceph-mon[26920]: Deploying daemon osd.5 on smithi079 2024-05-09T06:25:46.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:46 smithi062 ceph-mon[26920]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:46.454 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:46 smithi079 ceph-mon[35268]: Deploying daemon osd.5 on smithi079 2024-05-09T06:25:46.454 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:46 smithi079 ceph-mon[35268]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:48.392 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:48 smithi079 ceph-mon[35268]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:48 smithi062 ceph-mon[26920]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:50.374 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:50 smithi079 ceph-mon[35268]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:50.374 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:50.374 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:50.374 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:50 smithi062 ceph-mon[26920]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:50.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:52.391 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:52 smithi079 ceph-mon[35268]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:52.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:52 smithi062 ceph-mon[26920]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:53.650 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 5 on host 'smithi079' 2024-05-09T06:25:53.650 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.667+0000 7f56c17fa700 1 -- 172.21.15.79:0/2089351527 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f56cc104a20 con 0x7f56b40692a0 2024-05-09T06:25:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f56b40692a0 msgr2=0x7f56b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f56b40692a0 0x7f56b406b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009b10 tx=0x7f56c8008040 comp rx=0 tx=0).stop 2024-05-09T06:25:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 msgr2=0x7f56cc10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 0x7f56cc10da10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00b3b0 tx=0x7f56bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 shutdown_connections 2024-05-09T06:25:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f56b40692a0 0x7f56b406b750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56cc0fbe30 0x7f56cc10da10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 --2- 172.21.15.79:0/2089351527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56cc0fcfa0 0x7f56cc10df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 >> 172.21.15.79:0/2089351527 conn(0x7f56cc0f7440 msgr2=0x7f56cc0f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 shutdown_connections 2024-05-09T06:25:53.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:25:53.670+0000 7f56d2bc6700 1 -- 172.21.15.79:0/2089351527 wait complete. 2024-05-09T06:25:54.273 DEBUG:teuthology.orchestra.run.smithi079:osd.5> sudo journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.5.service 2024-05-09T06:25:54.276 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-05-09T06:25:54.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T06:25:54.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:54 smithi062 ceph-mon[26920]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:54.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:54 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:54.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:54 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:54.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:54 smithi062 ceph-mon[26920]: from='osd.5 [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:25:54.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:54 smithi062 ceph-mon[26920]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:25:54.554 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:25:54.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:54 smithi079 ceph-mon[35268]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:54.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:54 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:54.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:54 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:54.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:54 smithi079 ceph-mon[35268]: from='osd.5 [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:25:54.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:54 smithi079 ceph-mon[35268]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:25:55.422 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:55.422 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:55.422 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:55 smithi079 ceph-mon[35268]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T06:25:55.422 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:55 smithi079 ceph-mon[35268]: osdmap e38: 6 total, 5 up, 6 in 2024-05-09T06:25:55.422 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:55 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:55.422 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:55 smithi079 ceph-mon[35268]: from='osd.5 [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:55.422 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:55 smithi079 ceph-mon[35268]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:55.422 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:55 smithi079 ceph-mon[35268]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:55.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:55.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:55.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:55 smithi062 ceph-mon[26920]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T06:25:55.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:55 smithi062 ceph-mon[26920]: osdmap e38: 6 total, 5 up, 6 in 2024-05-09T06:25:55.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:55 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:55.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:55 smithi062 ceph-mon[26920]: from='osd.5 [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:55.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:55 smithi062 ceph-mon[26920]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:25:55.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:55 smithi062 ceph-mon[26920]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:55.844 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:25:55 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[54463]: 2024-05-09T06:25:55.649+0000 7f2414b5b700 -1 osd.5 0 waiting for initial osdmap 2024-05-09T06:25:55.844 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:25:55 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[54463]: 2024-05-09T06:25:55.657+0000 7f241195a700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:25:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.321+0000 7f441d8c4700 1 -- 172.21.15.62:0/3804105639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 msgr2=0x7f44180fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.321+0000 7f441d8c4700 1 --2- 172.21.15.62:0/3804105639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 0x7f44180fe830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4408004940 tx=0x7f4408009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.321+0000 7f441d8c4700 1 -- 172.21.15.62:0/3804105639 shutdown_connections 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.321+0000 7f441d8c4700 1 --2- 172.21.15.62:0/3804105639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44180fed70 0x7f44180faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.321+0000 7f441d8c4700 1 --2- 172.21.15.62:0/3804105639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 0x7f44180fe830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.321+0000 7f441d8c4700 1 -- 172.21.15.62:0/3804105639 >> 172.21.15.62:0/3804105639 conn(0x7f44180f6be0 msgr2=0x7f44180f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.321+0000 7f441d8c4700 1 -- 172.21.15.62:0/3804105639 shutdown_connections 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.321+0000 7f441d8c4700 1 -- 172.21.15.62:0/3804105639 wait complete. 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f441d8c4700 1 Processor -- start 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f441d8c4700 1 -- start start 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f441d8c4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 0x7f44180fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f441d8c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44180fed70 0x7f44180fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f441d8c4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180fe030 con 0x7f44180fe420 2024-05-09T06:25:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f441d8c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180fc620 con 0x7f44180fed70 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f4416ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 0x7f44180fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f4416ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 0x7f44180fda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50992/0 (socket says 172.21.15.62:50992) 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f4416ffd700 1 -- 172.21.15.62:0/1570455883 learned_addr learned my addr 172.21.15.62:0/1570455883 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.322+0000 7f44167fc700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44180fed70 0x7f44180fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f4416ffd700 1 -- 172.21.15.62:0/1570455883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44180fed70 msgr2=0x7f44180fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f4416ffd700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44180fed70 0x7f44180fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f4416ffd700 1 -- 172.21.15.62:0/1570455883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4408005040 con 0x7f44180fe420 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f4416ffd700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 0x7f44180fda30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4408013870 tx=0x7f4408009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f43ff7fe700 1 -- 172.21.15.62:0/1570455883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4408021070 con 0x7f44180fe420 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f43ff7fe700 1 -- 172.21.15.62:0/1570455883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4408009430 con 0x7f44180fe420 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44180fc870 con 0x7f44180fe420 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f43ff7fe700 1 -- 172.21.15.62:0/1570455883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f440800e070 con 0x7f44180fe420 2024-05-09T06:25:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.323+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44180fcdb0 con 0x7f44180fe420 2024-05-09T06:25:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.324+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441804c710 con 0x7f44180fe420 2024-05-09T06:25:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.325+0000 7f43ff7fe700 1 -- 172.21.15.62:0/1570455883 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f440801c750 con 0x7f44180fe420 2024-05-09T06:25:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.325+0000 7f43ff7fe700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4400069240 0x7f440006b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.325+0000 7f43ff7fe700 1 -- 172.21.15.62:0/1570455883 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f4408088000 con 0x7f44180fe420 2024-05-09T06:25:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.325+0000 7f44167fc700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4400069240 0x7f440006b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.326+0000 7f44167fc700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4400069240 0x7f440006b6f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f440c009b80 tx=0x7f440c00b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.330+0000 7f43ff7fe700 1 -- 172.21.15.62:0/1570455883 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4408058210 con 0x7f44180fe420 2024-05-09T06:25:56.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.526+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4418115b80 con 0x7f44180fe420 2024-05-09T06:25:56.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.526+0000 7f43ff7fe700 1 -- 172.21.15.62:0/1570455883 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4408057da0 con 0x7f44180fe420 2024-05-09T06:25:56.508 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:25:56.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4400069240 msgr2=0x7f440006b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:56.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4400069240 0x7f440006b6f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f440c009b80 tx=0x7f440c00b040 comp rx=0 tx=0).stop 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 msgr2=0x7f44180fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 0x7f44180fda30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4408013870 tx=0x7f4408009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 shutdown_connections 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4400069240 0x7f440006b6f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44180fe420 0x7f44180fda30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 --2- 172.21.15.62:0/1570455883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44180fed70 0x7f44180fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 >> 172.21.15.62:0/1570455883 conn(0x7f44180f6be0 msgr2=0x7f44180f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 shutdown_connections 2024-05-09T06:25:56.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:25:56.528+0000 7f441d8c4700 1 -- 172.21.15.62:0/1570455883 wait complete. 2024-05-09T06:25:56.863 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:56 smithi062 ceph-mon[26920]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-05-09T06:25:56.863 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:56 smithi062 ceph-mon[26920]: osdmap e39: 6 total, 5 up, 6 in 2024-05-09T06:25:56.863 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:56 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:56.864 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:56 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:56.864 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:56 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1570455883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T06:25:57.006 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:56 smithi079 ceph-mon[35268]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-05-09T06:25:57.006 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:56 smithi079 ceph-mon[35268]: osdmap e39: 6 total, 5 up, 6 in 2024-05-09T06:25:57.006 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:56 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:57.006 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:56 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:57.006 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:56 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1570455883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T06:25:57.190 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1715235931,"num_in_osds":6,"osd_in_since":1715235937,"num_remapped_pgs":0} 2024-05-09T06:25:57.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:57 smithi079 ceph-mon[35268]: purged_snaps scrub starts 2024-05-09T06:25:57.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:57 smithi079 ceph-mon[35268]: purged_snaps scrub ok 2024-05-09T06:25:57.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:57 smithi079 ceph-mon[35268]: osd.5 [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] boot 2024-05-09T06:25:57.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:57 smithi079 ceph-mon[35268]: osdmap e40: 6 total, 6 up, 6 in 2024-05-09T06:25:57.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:57 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:57.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:57 smithi079 ceph-mon[35268]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:57.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:57 smithi062 ceph-mon[26920]: purged_snaps scrub starts 2024-05-09T06:25:57.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:57 smithi062 ceph-mon[26920]: purged_snaps scrub ok 2024-05-09T06:25:57.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:57 smithi062 ceph-mon[26920]: osd.5 [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] boot 2024-05-09T06:25:57.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:57 smithi062 ceph-mon[26920]: osdmap e40: 6 total, 6 up, 6 in 2024-05-09T06:25:57.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:57 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:57.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:57 smithi062 ceph-mon[26920]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:58.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T06:25:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:25:58.891 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: osdmap e41: 6 total, 6 up, 6 in 2024-05-09T06:25:58.891 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: Detected new or changed devices on smithi079 2024-05-09T06:25:58.891 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:58.891 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: Adjusting osd_memory_target on smithi079 to 5312M 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:58.892 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: osdmap e41: 6 total, 6 up, 6 in 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: Detected new or changed devices on smithi079 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: Adjusting osd_memory_target on smithi079 to 5312M 2024-05-09T06:25:59.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:59.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:59.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:59.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:59.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:59.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:59.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:59.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:25:59.798 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:59 smithi062 ceph-mon[26920]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:25:59.799 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:25:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:00.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 -- 172.21.15.62:0/3830712708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fed30 msgr2=0x7f13e80fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:00.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 --2- 172.21.15.62:0/3830712708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fed30 0x7f13e80fae70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13dc004940 tx=0x7f13dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:00.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 -- 172.21.15.62:0/3830712708 shutdown_connections 2024-05-09T06:26:00.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 --2- 172.21.15.62:0/3830712708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fed30 0x7f13e80fae70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:00.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 --2- 172.21.15.62:0/3830712708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e80fe3e0 0x7f13e80fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:00.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 -- 172.21.15.62:0/3830712708 >> 172.21.15.62:0/3830712708 conn(0x7f13e80f6b80 msgr2=0x7f13e80f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:00.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 -- 172.21.15.62:0/3830712708 shutdown_connections 2024-05-09T06:26:00.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 -- 172.21.15.62:0/3830712708 wait complete. 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 Processor -- start 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.050+0000 7f13edc43700 1 -- start start 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13edc43700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fe3e0 0x7f13e80fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13edc43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e80fed30 0x7f13e80fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13edc43700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80fc6e0 con 0x7f13e80fe3e0 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13edc43700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80fc850 con 0x7f13e80fed30 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13e77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fe3e0 0x7f13e80fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13e77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fe3e0 0x7f13e80fdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51020/0 (socket says 172.21.15.62:51020) 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13e77fe700 1 -- 172.21.15.62:0/2024061212 learned_addr learned my addr 172.21.15.62:0/2024061212 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13e6ffd700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e80fed30 0x7f13e80fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13e77fe700 1 -- 172.21.15.62:0/2024061212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e80fed30 msgr2=0x7f13e80fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13e77fe700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e80fed30 0x7f13e80fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13e77fe700 1 -- 172.21.15.62:0/2024061212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc005040 con 0x7f13e80fe3e0 2024-05-09T06:26:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13e77fe700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fe3e0 0x7f13e80fdbd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f13d800b790 tx=0x7f13d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:00.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.051+0000 7f13cffff700 1 -- 172.21.15.62:0/2024061212 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13d800f770 con 0x7f13e80fe3e0 2024-05-09T06:26:00.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.052+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e80fcb30 con 0x7f13e80fe3e0 2024-05-09T06:26:00.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.052+0000 7f13cffff700 1 -- 172.21.15.62:0/2024061212 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13d800fda0 con 0x7f13e80fe3e0 2024-05-09T06:26:00.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.052+0000 7f13cffff700 1 -- 172.21.15.62:0/2024061212 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13d800d310 con 0x7f13e80fe3e0 2024-05-09T06:26:00.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.052+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e8115aa0 con 0x7f13e80fe3e0 2024-05-09T06:26:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.053+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e805f5c0 con 0x7f13e80fe3e0 2024-05-09T06:26:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.053+0000 7f13cffff700 1 -- 172.21.15.62:0/2024061212 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f13d8010420 con 0x7f13e80fe3e0 2024-05-09T06:26:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.054+0000 7f13cffff700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f13d00692a0 0x7f13d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.054+0000 7f13cffff700 1 -- 172.21.15.62:0/2024061212 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f13d8086e50 con 0x7f13e80fe3e0 2024-05-09T06:26:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.054+0000 7f13e6ffd700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f13d00692a0 0x7f13d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.054+0000 7f13e6ffd700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f13d00692a0 0x7f13d006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00b3b0 tx=0x7f13dc009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:00.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.058+0000 7f13cffff700 1 -- 172.21.15.62:0/2024061212 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f13d80534c0 con 0x7f13e80fe3e0 2024-05-09T06:26:00.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:59 smithi079 ceph-mon[35268]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:00.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:25:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.261+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f13e804bed0 con 0x7f13e80fe3e0 2024-05-09T06:26:00.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.261+0000 7f13cffff700 1 -- 172.21.15.62:0/2024061212 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f13d8056ae0 con 0x7f13e80fe3e0 2024-05-09T06:26:00.244 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:26:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.263+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f13d00692a0 msgr2=0x7f13d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.263+0000 7f13edc43700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f13d00692a0 0x7f13d006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00b3b0 tx=0x7f13dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.263+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fe3e0 msgr2=0x7f13e80fdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.264+0000 7f13edc43700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fe3e0 0x7f13e80fdbd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f13d800b790 tx=0x7f13d8009250 comp rx=0 tx=0).stop 2024-05-09T06:26:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.264+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 shutdown_connections 2024-05-09T06:26:00.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.264+0000 7f13edc43700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f13d00692a0 0x7f13d006b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:00.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.264+0000 7f13edc43700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13e80fe3e0 0x7f13e80fdbd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:00.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.264+0000 7f13edc43700 1 --2- 172.21.15.62:0/2024061212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13e80fed30 0x7f13e80fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:00.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.264+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 >> 172.21.15.62:0/2024061212 conn(0x7f13e80f6b80 msgr2=0x7f13e80f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:00.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.264+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 shutdown_connections 2024-05-09T06:26:00.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:00.264+0000 7f13edc43700 1 -- 172.21.15.62:0/2024061212 wait complete. 2024-05-09T06:26:00.887 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1715235956,"num_in_osds":6,"osd_in_since":1715235937,"num_remapped_pgs":0} 2024-05-09T06:26:00.888 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T06:26:00.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:00 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2024061212' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T06:26:01.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:00 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2024061212' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T06:26:01.163 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:01.891 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:01 smithi062 ceph-mon[26920]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:02.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:01 smithi079 ceph-mon[35268]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.798+0000 7f620ad60700 1 -- 172.21.15.62:0/2114076005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62040fb520 msgr2=0x7f62040fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.798+0000 7f620ad60700 1 --2- 172.21.15.62:0/2114076005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62040fb520 0x7f62040fb990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009ce0 tx=0x7f61f4004d10 comp rx=0 tx=0).stop 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.798+0000 7f620ad60700 1 -- 172.21.15.62:0/2114076005 shutdown_connections 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.798+0000 7f620ad60700 1 --2- 172.21.15.62:0/2114076005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62040fb520 0x7f62040fb990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.798+0000 7f620ad60700 1 --2- 172.21.15.62:0/2114076005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6204102f60 0x7f6204103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.798+0000 7f620ad60700 1 -- 172.21.15.62:0/2114076005 >> 172.21.15.62:0/2114076005 conn(0x7f62040714d0 msgr2=0x7f62040718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.798+0000 7f620ad60700 1 -- 172.21.15.62:0/2114076005 shutdown_connections 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.798+0000 7f620ad60700 1 -- 172.21.15.62:0/2114076005 wait complete. 2024-05-09T06:26:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.799+0000 7f620ad60700 1 Processor -- start 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.799+0000 7f620ad60700 1 -- start start 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.799+0000 7f620ad60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62040fb520 0x7f6204113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.799+0000 7f620ad60700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6204102f60 0x7f62041140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.799+0000 7f620ad60700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62041147c0 con 0x7f6204102f60 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.799+0000 7f620ad60700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620410dd10 con 0x7f62040fb520 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.799+0000 7f6203fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6204102f60 0x7f62041140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.799+0000 7f6203fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6204102f60 0x7f62041140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51048/0 (socket says 172.21.15.62:51048) 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f6203fff700 1 -- 172.21.15.62:0/3465128980 learned_addr learned my addr 172.21.15.62:0/3465128980 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f6208afc700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62040fb520 0x7f6204113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f6203fff700 1 -- 172.21.15.62:0/3465128980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62040fb520 msgr2=0x7f6204113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f6203fff700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62040fb520 0x7f6204113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f6203fff700 1 -- 172.21.15.62:0/3465128980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4009940 con 0x7f6204102f60 2024-05-09T06:26:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f6203fff700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6204102f60 0x7f62041140e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f61f400be90 tx=0x7f61f4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f62017fa700 1 -- 172.21.15.62:0/3465128980 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61f400e040 con 0x7f6204102f60 2024-05-09T06:26:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620410df30 con 0x7f6204102f60 2024-05-09T06:26:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f62017fa700 1 -- 172.21.15.62:0/3465128980 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61f4004610 con 0x7f6204102f60 2024-05-09T06:26:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f62017fa700 1 -- 172.21.15.62:0/3465128980 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61f401c6d0 con 0x7f6204102f60 2024-05-09T06:26:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.800+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620410e470 con 0x7f6204102f60 2024-05-09T06:26:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.801+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6204100250 con 0x7f6204102f60 2024-05-09T06:26:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.802+0000 7f62017fa700 1 -- 172.21.15.62:0/3465128980 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f61f4012b00 con 0x7f6204102f60 2024-05-09T06:26:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.803+0000 7f62017fa700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f61f00692a0 0x7f61f006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.803+0000 7f62017fa700 1 -- 172.21.15.62:0/3465128980 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f61f4088c90 con 0x7f6204102f60 2024-05-09T06:26:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.803+0000 7f6208afc700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f61f00692a0 0x7f61f006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.803+0000 7f6208afc700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f61f00692a0 0x7f61f006b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009bf0 tx=0x7f61ec0091a0 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:02.807+0000 7f62017fa700 1 -- 172.21.15.62:0/3465128980 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f61f4058e30 con 0x7f6204102f60 2024-05-09T06:26:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.002+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62040fe840 con 0x7f6204102f60 2024-05-09T06:26:02.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.003+0000 7f62017fa700 1 -- 172.21.15.62:0/3465128980 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11039 (secure 0 0 0) 0x7f61f4004e10 con 0x7f6204102f60 2024-05-09T06:26:02.986 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:26:02.986 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":41,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","created":"2024-05-09T06:19:56.093674+0000","modified":"2024-05-09T06:25:57.650145+0000","last_up_change":"2024-05-09T06:25:56.648710+0000","last_in_change":"2024-05-09T06:25:37.980211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T06:24:45.550223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"3ec38550-8a22-471a-a786-5316f095bcd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6803","nonce":2745260923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6805","nonce":2745260923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6809","nonce":2745260923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6807","nonce":2745260923}]},"public_addr":"172.21.15.62:6803/2745260923","cluster_addr":"172.21.15.62:6805/2745260923","heartbeat_back_addr":"172.21.15.62:6809/2745260923","heartbeat_front_addr":"172.21.15.62:6807/2745260923","state":["exists","up"]},{"osd":1,"uuid":"24f6e595-6093-4c5b-8fdd-f73da61b14ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6811","nonce":3967749242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6813","nonce":3967749242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6817","nonce":3967749242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6815","nonce":3967749242}]},"public_addr":"172.21.15.62:6811/3967749242","cluster_addr":"172.21.15.62:6813/3967749242","heartbeat_back_addr":"172.21.15.62:6817/3967749242","heartbeat_front_addr":"172.21.15.62:6815/3967749242","state":["exists","up"]},{"osd":2,"uuid":"4a38acec-7591-47bb-ad1e-0330768d0fc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6819","nonce":3065937068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6821","nonce":3065937068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6825","nonce":3065937068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6823","nonce":3065937068}]},"public_addr":"172.21.15.62:6819/3065937068","cluster_addr":"172.21.15.62:6821/3065937068","heartbeat_back_addr":"172.21.15.62:6825/3065937068","heartbeat_front_addr":"172.21.15.62:6823/3065937068","state":["exists","up"]},{"osd":3,"uuid":"bc60aef9-47d8-41c9-8339-ff9e30ad307b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6801","nonce":2562186552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6803","nonce":2562186552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6807","nonce":2562186552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6805","nonce":2562186552}]},"public_addr":"172.21.15.79:6801/2562186552","cluster_addr":"172.21.15.79:6803/2562186552","heartbeat_back_addr":"172.21.15.79:6807/2562186552","heartbeat_front_addr":"172.21.15.79:6805/2562186552","state":["exists","up"]},{"osd":4,"uuid":"5234289d-7aea-415e-a8fc-e45c5af2b4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6809","nonce":1486614570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6811","nonce":1486614570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6815","nonce":1486614570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6813","nonce":1486614570}]},"public_addr":"172.21.15.79:6809/1486614570","cluster_addr":"172.21.15.79:6811/1486614570","heartbeat_back_addr":"172.21.15.79:6815/1486614570","heartbeat_front_addr":"172.21.15.79:6813/1486614570","state":["exists","up"]},{"osd":5,"uuid":"bd6b559c-e9b6-4e08-bee4-8bb0df38614f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6817","nonce":638252503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6819","nonce":638252503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6823","nonce":638252503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6821","nonce":638252503}]},"public_addr":"172.21.15.79:6817/638252503","cluster_addr":"172.21.15.79:6819/638252503","heartbeat_back_addr":"172.21.15.79:6823/638252503","heartbeat_front_addr":"172.21.15.79:6821/638252503","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:23:44.033973+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:13.359807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:41.830940+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:05.491134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:29.958354+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:54.884839+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:0/1042226830":"2024-05-10T06:22:29.031235+0000","172.21.15.62:6801/2116890721":"2024-05-10T06:22:29.031235+0000","172.21.15.62:6800/2116890721":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/995524261":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/1371502517":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/849368193":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/1289942620":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/851126602":"2024-05-10T06:21:00.610342+0000","172.21.15.62:6801/942541084":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/626723007":"2024-05-10T06:20:29.771562+0000","172.21.15.62:0/2849696799":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6800/21732303":"2024-05-10T06:20:29.771562+0000","172.21.15.62:0/3633776630":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6801/21732303":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6800/942541084":"2024-05-10T06:21:00.610342+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T06:26:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f61f00692a0 msgr2=0x7f61f006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f61f00692a0 0x7f61f006b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009bf0 tx=0x7f61ec0091a0 comp rx=0 tx=0).stop 2024-05-09T06:26:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6204102f60 msgr2=0x7f62041140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6204102f60 0x7f62041140e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f61f400be90 tx=0x7f61f4004d10 comp rx=0 tx=0).stop 2024-05-09T06:26:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 shutdown_connections 2024-05-09T06:26:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f61f00692a0 0x7f61f006b750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62040fb520 0x7f6204113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 --2- 172.21.15.62:0/3465128980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6204102f60 0x7f62041140e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.005+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 >> 172.21.15.62:0/3465128980 conn(0x7f62040714d0 msgr2=0x7f62040fa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.006+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 shutdown_connections 2024-05-09T06:26:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:03.006+0000 7f620ad60700 1 -- 172.21.15.62:0/3465128980 wait complete. 2024-05-09T06:26:03.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:03 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3465128980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:03.348 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:03 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3465128980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:03.768 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T06:24:45.550223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-05-09T06:26:03.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-09T06:26:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:04.327 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:04 smithi062 ceph-mon[26920]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:04.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:04 smithi079 ceph-mon[35268]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:05.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.778+0000 7ff7b8605700 1 -- 172.21.15.62:0/3104153196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 msgr2=0x7ff7b0106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:05.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.778+0000 7ff7b8605700 1 --2- 172.21.15.62:0/3104153196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 0x7ff7b0106e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004940 tx=0x7ff7a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:05.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 -- 172.21.15.62:0/3104153196 shutdown_connections 2024-05-09T06:26:05.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 --2- 172.21.15.62:0/3104153196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 0x7ff7b0106e50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:05.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 --2- 172.21.15.62:0/3104153196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b00fde70 0x7ff7b00fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:05.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 -- 172.21.15.62:0/3104153196 >> 172.21.15.62:0/3104153196 conn(0x7ff7b00f7860 msgr2=0x7ff7b00f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 -- 172.21.15.62:0/3104153196 shutdown_connections 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 -- 172.21.15.62:0/3104153196 wait complete. 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 Processor -- start 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 -- start start 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b00fde70 0x7ff7b00fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 0x7ff7b00fc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00fdbf0 con 0x7ff7b00fe810 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.779+0000 7ff7b8605700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00fc720 con 0x7ff7b00fde70 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b5ba0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 0x7ff7b00fc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b5ba0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 0x7ff7b00fc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49310/0 (socket says 172.21.15.62:49310) 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b5ba0700 1 -- 172.21.15.62:0/3161616263 learned_addr learned my addr 172.21.15.62:0/3161616263 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b63a1700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b00fde70 0x7ff7b00fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b5ba0700 1 -- 172.21.15.62:0/3161616263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b00fde70 msgr2=0x7ff7b00fbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b5ba0700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b00fde70 0x7ff7b00fbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:05.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b5ba0700 1 -- 172.21.15.62:0/3161616263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0005040 con 0x7ff7b00fe810 2024-05-09T06:26:05.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b5ba0700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 0x7ff7b00fc1e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004890 tx=0x7ff7a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:05.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7a6ffd700 1 -- 172.21.15.62:0/3161616263 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a000e040 con 0x7ff7b00fe810 2024-05-09T06:26:05.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7a6ffd700 1 -- 172.21.15.62:0/3161616263 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7a0009af0 con 0x7ff7b00fe810 2024-05-09T06:26:05.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b00fca00 con 0x7ff7b00fe810 2024-05-09T06:26:05.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7a6ffd700 1 -- 172.21.15.62:0/3161616263 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a001c630 con 0x7ff7b00fe810 2024-05-09T06:26:05.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.780+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b011a080 con 0x7ff7b00fe810 2024-05-09T06:26:05.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.781+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b0066af0 con 0x7ff7b00fe810 2024-05-09T06:26:05.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.782+0000 7ff7a6ffd700 1 -- 172.21.15.62:0/3161616263 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff7a000bbc0 con 0x7ff7b00fe810 2024-05-09T06:26:05.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.782+0000 7ff7a6ffd700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff79c0692a0 0x7ff79c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:05.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.782+0000 7ff7a6ffd700 1 -- 172.21.15.62:0/3161616263 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff7a0088020 con 0x7ff7b00fe810 2024-05-09T06:26:05.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.782+0000 7ff7b63a1700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff79c0692a0 0x7ff79c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:05.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.783+0000 7ff7b63a1700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff79c0692a0 0x7ff79c06b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac007fd0 tx=0x7ff7ac009040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:05.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.787+0000 7ff7a6ffd700 1 -- 172.21.15.62:0/3161616263 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff7a0054730 con 0x7ff7b00fe810 2024-05-09T06:26:05.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.982+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7b0109e30 con 0x7ff7b00fe810 2024-05-09T06:26:05.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.982+0000 7ff7a6ffd700 1 -- 172.21.15.62:0/3161616263 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7a0057d50 con 0x7ff7b00fe810 2024-05-09T06:26:05.965 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff79c0692a0 msgr2=0x7ff79c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff79c0692a0 0x7ff79c06b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac007fd0 tx=0x7ff7ac009040 comp rx=0 tx=0).stop 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 msgr2=0x7ff7b00fc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 0x7ff7b00fc1e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004890 tx=0x7ff7a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 shutdown_connections 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff79c0692a0 0x7ff79c06b750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b00fde70 0x7ff7b00fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 --2- 172.21.15.62:0/3161616263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7b00fe810 0x7ff7b00fc1e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 >> 172.21.15.62:0/3161616263 conn(0x7ff7b00f7860 msgr2=0x7ff7b01016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 shutdown_connections 2024-05-09T06:26:05.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:05.984+0000 7ff7b8605700 1 -- 172.21.15.62:0/3161616263 wait complete. 2024-05-09T06:26:06.339 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:06 smithi062 ceph-mon[26920]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:06.339 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:06 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3161616263' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T06:26:06.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:06 smithi079 ceph-mon[35268]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:06.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:06 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3161616263' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T06:26:06.767 INFO:tasks.cephadm:Setting up client nodes... 2024-05-09T06:26:06.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T06:26:07.040 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:08.366 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:08 smithi062 ceph-mon[26920]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:08.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:08 smithi079 ceph-mon[35268]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:08.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 -- 172.21.15.62:0/2621490303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 msgr2=0x7f19100fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 --2- 172.21.15.62:0/2621490303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 0x7f19100fe840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1900004940 tx=0x7f1900009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 -- 172.21.15.62:0/2621490303 shutdown_connections 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 --2- 172.21.15.62:0/2621490303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100fed80 0x7f19100faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 --2- 172.21.15.62:0/2621490303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 0x7f19100fe840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 -- 172.21.15.62:0/2621490303 >> 172.21.15.62:0/2621490303 conn(0x7f19100f6bd0 msgr2=0x7f19100f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 -- 172.21.15.62:0/2621490303 shutdown_connections 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 -- 172.21.15.62:0/2621490303 wait complete. 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.772+0000 7f1915df4700 1 Processor -- start 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f1915df4700 1 -- start start 2024-05-09T06:26:08.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f1915df4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 0x7f191010d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f1915df4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100fed80 0x7f191010de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f1915df4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191010e410 con 0x7f19100fe430 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f1915df4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191010e580 con 0x7f19100fed80 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 0x7f191010d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 0x7f191010d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49326/0 (socket says 172.21.15.62:49326) 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f190f7fe700 1 -- 172.21.15.62:0/1112954103 learned_addr learned my addr 172.21.15.62:0/1112954103 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f190effd700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100fed80 0x7f191010de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f190f7fe700 1 -- 172.21.15.62:0/1112954103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100fed80 msgr2=0x7f191010de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f190f7fe700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100fed80 0x7f191010de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f190f7fe700 1 -- 172.21.15.62:0/1112954103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900005040 con 0x7f19100fe430 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.773+0000 7f190f7fe700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 0x7f191010d8d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f190000b3b0 tx=0x7f1900009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.774+0000 7f18f7fff700 1 -- 172.21.15.62:0/1112954103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190000e040 con 0x7f19100fe430 2024-05-09T06:26:08.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.774+0000 7f18f7fff700 1 -- 172.21.15.62:0/1112954103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f190000bcc0 con 0x7f19100fe430 2024-05-09T06:26:08.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.774+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1910112f80 con 0x7f19100fe430 2024-05-09T06:26:08.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.774+0000 7f18f7fff700 1 -- 172.21.15.62:0/1112954103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190001c630 con 0x7f19100fe430 2024-05-09T06:26:08.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.774+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19101134b0 con 0x7f19100fe430 2024-05-09T06:26:08.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.775+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191004c710 con 0x7f19100fe430 2024-05-09T06:26:08.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.775+0000 7f18f7fff700 1 -- 172.21.15.62:0/1112954103 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1900013980 con 0x7f19100fe430 2024-05-09T06:26:08.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.776+0000 7f18f7fff700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f18f80692a0 0x7f18f806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:08.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.776+0000 7f18f7fff700 1 -- 172.21.15.62:0/1112954103 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1900087c80 con 0x7f19100fe430 2024-05-09T06:26:08.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.776+0000 7f190effd700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f18f80692a0 0x7f18f806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:08.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.776+0000 7f190effd700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f18f80692a0 0x7f18f806b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1904007fd0 tx=0x7f1904009040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:08.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:08.780+0000 7f18f7fff700 1 -- 172.21.15.62:0/1112954103 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1900057d00 con 0x7f19100fe430 2024-05-09T06:26:09.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.051+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f19101139c0 con 0x7f19100fe430 2024-05-09T06:26:09.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.055+0000 7f18f7fff700 1 -- 172.21.15.62:0/1112954103 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1900057890 con 0x7f19100fe430 2024-05-09T06:26:09.038 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-05-09T06:26:09.038 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCBbDxm1y4uAxAAUDFhHWleYJ2NbQeGXmScEA== 2024-05-09T06:26:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f18f80692a0 msgr2=0x7f18f806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f18f80692a0 0x7f18f806b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1904007fd0 tx=0x7f1904009040 comp rx=0 tx=0).stop 2024-05-09T06:26:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 msgr2=0x7f191010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 0x7f191010d8d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f190000b3b0 tx=0x7f1900009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:09.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 shutdown_connections 2024-05-09T06:26:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f18f80692a0 0x7f18f806b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19100fe430 0x7f191010d8d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 --2- 172.21.15.62:0/1112954103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19100fed80 0x7f191010de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 >> 172.21.15.62:0/1112954103 conn(0x7f19100f6bd0 msgr2=0x7f19100f8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 shutdown_connections 2024-05-09T06:26:09.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:09.057+0000 7f1915df4700 1 -- 172.21.15.62:0/1112954103 wait complete. 2024-05-09T06:26:09.362 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:09 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1112954103' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:09.362 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:09 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1112954103' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T06:26:09.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:09 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1112954103' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:09.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:09 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1112954103' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T06:26:09.751 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:26:09.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-09T06:26:09.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T06:26:09.792 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T06:26:10.065 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi079/config 2024-05-09T06:26:10.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:10 smithi062 ceph-mon[26920]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:10.430 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:10 smithi079 ceph-mon[35268]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:11.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.574+0000 7f46ef19e700 1 -- 172.21.15.79:0/1892532651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 msgr2=0x7f46e80fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:11.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.574+0000 7f46ef19e700 1 --2- 172.21.15.79:0/1892532651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 0x7f46e80fe440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46d4004940 tx=0x7f46d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.574+0000 7f46ef19e700 1 -- 172.21.15.79:0/1892532651 shutdown_connections 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.574+0000 7f46ef19e700 1 --2- 172.21.15.79:0/1892532651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 0x7f46e80fe440 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.574+0000 7f46ef19e700 1 --2- 172.21.15.79:0/1892532651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46e80fce60 0x7f46e80fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.574+0000 7f46ef19e700 1 -- 172.21.15.79:0/1892532651 >> 172.21.15.79:0/1892532651 conn(0x7f46e80f8540 msgr2=0x7f46e80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.574+0000 7f46ef19e700 1 -- 172.21.15.79:0/1892532651 shutdown_connections 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.574+0000 7f46ef19e700 1 -- 172.21.15.79:0/1892532651 wait complete. 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46ef19e700 1 Processor -- start 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46ef19e700 1 -- start start 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46ef19e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46e80fce60 0x7f46e810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46ef19e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 0x7f46e810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46ef19e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e810e450 con 0x7f46e80fce60 2024-05-09T06:26:11.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46ef19e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e810e5c0 con 0x7f46e80fdfd0 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 0x7f46e810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 0x7f46e810de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58350/0 (socket says 172.21.15.79:58350) 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46e7fff700 1 -- 172.21.15.79:0/2845758119 learned_addr learned my addr 172.21.15.79:0/2845758119 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.575+0000 7f46ecf3a700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46e80fce60 0x7f46e810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46e7fff700 1 -- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46e80fce60 msgr2=0x7f46e810d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46e7fff700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46e80fce60 0x7f46e810d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46e7fff700 1 -- 172.21.15.79:0/2845758119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d4005040 con 0x7f46e80fdfd0 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46e7fff700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 0x7f46e810de50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46d400b3b0 tx=0x7f46d4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46e57fa700 1 -- 172.21.15.79:0/2845758119 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d400e040 con 0x7f46e80fdfd0 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46e57fa700 1 -- 172.21.15.79:0/2845758119 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46d400bcc0 con 0x7f46e80fdfd0 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e8112fc0 con 0x7f46e80fdfd0 2024-05-09T06:26:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46e57fa700 1 -- 172.21.15.79:0/2845758119 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d401c630 con 0x7f46e80fdfd0 2024-05-09T06:26:11.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.576+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e8113550 con 0x7f46e80fdfd0 2024-05-09T06:26:11.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.577+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e804c710 con 0x7f46e80fdfd0 2024-05-09T06:26:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.577+0000 7f46e57fa700 1 -- 172.21.15.79:0/2845758119 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f46d4013420 con 0x7f46e80fdfd0 2024-05-09T06:26:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.578+0000 7f46e57fa700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f46d80692a0 0x7f46d806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.578+0000 7f46e57fa700 1 -- 172.21.15.79:0/2845758119 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f46d4087c90 con 0x7f46e80fdfd0 2024-05-09T06:26:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.578+0000 7f46ecf3a700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f46d80692a0 0x7f46d806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.578+0000 7f46ecf3a700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f46d80692a0 0x7f46d806b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46dc004990 tx=0x7f46dc009ee0 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:11.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.582+0000 7f46e57fa700 1 -- 172.21.15.79:0/2845758119 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f46d4057d10 con 0x7f46e80fdfd0 2024-05-09T06:26:11.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.836+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f46e8113770 con 0x7f46e80fdfd0 2024-05-09T06:26:11.823 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.841+0000 7f46e57fa700 1 -- 172.21.15.79:0/2845758119 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f46d40578a0 con 0x7f46e80fdfd0 2024-05-09T06:26:11.823 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2024-05-09T06:26:11.824 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCDbDxmUvX1MRAAPFWQ4Jn/pyMJ6Eeoxps/0A== 2024-05-09T06:26:11.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f46d80692a0 msgr2=0x7f46d806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:11.825 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f46d80692a0 0x7f46d806b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46dc004990 tx=0x7f46dc009ee0 comp rx=0 tx=0).stop 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 msgr2=0x7f46e810de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 0x7f46e810de50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46d400b3b0 tx=0x7f46d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 shutdown_connections 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f46d80692a0 0x7f46d806b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46e80fce60 0x7f46e810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 --2- 172.21.15.79:0/2845758119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46e80fdfd0 0x7f46e810de50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 >> 172.21.15.79:0/2845758119 conn(0x7f46e80f8540 msgr2=0x7f46e80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 shutdown_connections 2024-05-09T06:26:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:26:11.843+0000 7f46ef19e700 1 -- 172.21.15.79:0/2845758119 wait complete. 2024-05-09T06:26:12.393 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:12 smithi079 ceph-mon[35268]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:12.393 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:12 smithi079 ceph-mon[35268]: from='client.? 172.21.15.79:0/2845758119' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:12.393 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:12 smithi079 ceph-mon[35268]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:12.393 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:12 smithi079 ceph-mon[35268]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T06:26:12.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:12 smithi062 ceph-mon[26920]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:12.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:12 smithi062 ceph-mon[26920]: from='client.? 172.21.15.79:0/2845758119' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:12.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:12 smithi062 ceph-mon[26920]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:12.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:12 smithi062 ceph-mon[26920]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T06:26:12.418 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:26:12.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-05-09T06:26:12.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-09T06:26:12.457 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T06:26:12.457 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-09T06:26:12.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-09T06:26:12.735 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:14.373 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:14 smithi062 ceph-mon[26920]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:14.373 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 -- 172.21.15.62:0/1206465655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 msgr2=0x7fa080103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 --2- 172.21.15.62:0/1206465655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 0x7fa080103330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa070004940 tx=0x7fa070009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 -- 172.21.15.62:0/1206465655 shutdown_connections 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 --2- 172.21.15.62:0/1206465655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0800fb520 0x7fa0800fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 --2- 172.21.15.62:0/1206465655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 0x7fa080103330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 -- 172.21.15.62:0/1206465655 >> 172.21.15.62:0/1206465655 conn(0x7fa0800714d0 msgr2=0x7fa0800718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 -- 172.21.15.62:0/1206465655 shutdown_connections 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 -- 172.21.15.62:0/1206465655 wait complete. 2024-05-09T06:26:14.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 Processor -- start 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.402+0000 7fa085584700 1 -- start start 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa085584700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0800fb520 0x7fa080115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa085584700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 0x7fa0801160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa085584700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa080116700 con 0x7fa080102f60 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa085584700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08010fce0 con 0x7fa0800fb520 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa077fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 0x7fa0801160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa077fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 0x7fa0801160b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48932/0 (socket says 172.21.15.62:48932) 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa077fff700 1 -- 172.21.15.62:0/3692256404 learned_addr learned my addr 172.21.15.62:0/3692256404 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa07effd700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0800fb520 0x7fa080115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa077fff700 1 -- 172.21.15.62:0/3692256404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0800fb520 msgr2=0x7fa080115b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa077fff700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0800fb520 0x7fa080115b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:14.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa077fff700 1 -- 172.21.15.62:0/3692256404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070005040 con 0x7fa080102f60 2024-05-09T06:26:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa077fff700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 0x7fa0801160b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa068002a50 tx=0x7fa0680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.403+0000 7fa0777fe700 1 -- 172.21.15.62:0/3692256404 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa068007cc0 con 0x7fa080102f60 2024-05-09T06:26:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.404+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08010ffc0 con 0x7fa080102f60 2024-05-09T06:26:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.404+0000 7fa0777fe700 1 -- 172.21.15.62:0/3692256404 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa06800f040 con 0x7fa080102f60 2024-05-09T06:26:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.404+0000 7fa0777fe700 1 -- 172.21.15.62:0/3692256404 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa06800da30 con 0x7fa080102f60 2024-05-09T06:26:14.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.404+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa080110500 con 0x7fa080102f60 2024-05-09T06:26:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.405+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa080107410 con 0x7fa080102f60 2024-05-09T06:26:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.405+0000 7fa0777fe700 1 -- 172.21.15.62:0/3692256404 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa06800db90 con 0x7fa080102f60 2024-05-09T06:26:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.406+0000 7fa0777fe700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa06c0692a0 0x7fa06c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.406+0000 7fa0777fe700 1 -- 172.21.15.62:0/3692256404 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa068086c10 con 0x7fa080102f60 2024-05-09T06:26:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.406+0000 7fa07effd700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa06c0692a0 0x7fa06c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:14.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.406+0000 7fa07effd700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa06c0692a0 0x7fa06c06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa070004f90 tx=0x7fa070009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:14.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.410+0000 7fa0777fe700 1 -- 172.21.15.62:0/3692256404 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa068056c90 con 0x7fa080102f60 2024-05-09T06:26:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:14 smithi079 ceph-mon[35268]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:14.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:14.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.660+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa0800fe840 con 0x7fa080102f60 2024-05-09T06:26:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.664+0000 7fa0777fe700 1 -- 172.21.15.62:0/3692256404 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167178 (secure 0 0 0) 0x7fa068056820 con 0x7fa080102f60 2024-05-09T06:26:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:26:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa06c0692a0 msgr2=0x7fa06c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa06c0692a0 0x7fa06c06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa070004f90 tx=0x7fa070009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 msgr2=0x7fa0801160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 0x7fa0801160b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa068002a50 tx=0x7fa0680046b0 comp rx=0 tx=0).stop 2024-05-09T06:26:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 shutdown_connections 2024-05-09T06:26:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa06c0692a0 0x7fa06c06b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0800fb520 0x7fa080115b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 --2- 172.21.15.62:0/3692256404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa080102f60 0x7fa0801160b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.666+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 >> 172.21.15.62:0/3692256404 conn(0x7fa0800714d0 msgr2=0x7fa0800fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.667+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 shutdown_connections 2024-05-09T06:26:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:14.667+0000 7fa085584700 1 -- 172.21.15.62:0/3692256404 wait complete. 2024-05-09T06:26:15.352 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:15 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3692256404' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T06:26:15.380 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":19,"flags":0,"active_gid":14224,"active_name":"smithi062.juuasl","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3998880457},{"type":"v1","addr":"172.21.15.62:6801","nonce":3998880457}]},"active_addr":"172.21.15.62:6801/3998880457","active_change":"2024-05-09T06:22:29.031357+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14246,"name":"smithi079.genyri","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.62:8443/","prometheus":"http://172.21.15.62:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":3025063198}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1725791497}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1346317374}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":671073453}]}]} 2024-05-09T06:26:15.384 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-09T06:26:15.384 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-09T06:26:15.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T06:26:15.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:15 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3692256404' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T06:26:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:16.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:16 smithi062 ceph-mon[26920]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:16.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:16 smithi079 ceph-mon[35268]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:17.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.315+0000 7fafc1f30700 1 -- 172.21.15.62:0/1097149423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 msgr2=0x7fafbc0fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.315+0000 7fafc1f30700 1 --2- 172.21.15.62:0/1097149423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 0x7fafbc0fe1e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fafac004940 tx=0x7fafac009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.315+0000 7fafc1f30700 1 -- 172.21.15.62:0/1097149423 shutdown_connections 2024-05-09T06:26:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.315+0000 7fafc1f30700 1 --2- 172.21.15.62:0/1097149423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafbc0fe7b0 0x7fafbc106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.315+0000 7fafc1f30700 1 --2- 172.21.15.62:0/1097149423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 0x7fafbc0fe1e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.315+0000 7fafc1f30700 1 -- 172.21.15.62:0/1097149423 >> 172.21.15.62:0/1097149423 conn(0x7fafbc0f7820 msgr2=0x7fafbc0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.315+0000 7fafc1f30700 1 -- 172.21.15.62:0/1097149423 shutdown_connections 2024-05-09T06:26:17.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.315+0000 7fafc1f30700 1 -- 172.21.15.62:0/1097149423 wait complete. 2024-05-09T06:26:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafc1f30700 1 Processor -- start 2024-05-09T06:26:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafc1f30700 1 -- start start 2024-05-09T06:26:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafc1f30700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 0x7fafbc0fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafc1f30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafbc0fe7b0 0x7fafbc0fc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafc1f30700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0fdb70 con 0x7fafbc0fde10 2024-05-09T06:26:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafc1f30700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0fc6c0 con 0x7fafbc0fe7b0 2024-05-09T06:26:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafbb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 0x7fafbc0fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:17.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafbb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 0x7fafbc0fbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48954/0 (socket says 172.21.15.62:48954) 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafbb7fe700 1 -- 172.21.15.62:0/1261213372 learned_addr learned my addr 172.21.15.62:0/1261213372 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.316+0000 7fafbaffd700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafbc0fe7b0 0x7fafbc0fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafbb7fe700 1 -- 172.21.15.62:0/1261213372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafbc0fe7b0 msgr2=0x7fafbc0fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafbb7fe700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafbc0fe7b0 0x7fafbc0fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafbb7fe700 1 -- 172.21.15.62:0/1261213372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac005040 con 0x7fafbc0fde10 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafbb7fe700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 0x7fafbc0fbc40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fafac009380 tx=0x7fafac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafa3fff700 1 -- 172.21.15.62:0/1261213372 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafac00e040 con 0x7fafbc0fde10 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafa3fff700 1 -- 172.21.15.62:0/1261213372 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafac009af0 con 0x7fafbc0fde10 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc0fc940 con 0x7fafbc0fde10 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafa3fff700 1 -- 172.21.15.62:0/1261213372 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafac01c3f0 con 0x7fafbc0fde10 2024-05-09T06:26:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.317+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc11a370 con 0x7fafbc0fde10 2024-05-09T06:26:17.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.318+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc066b30 con 0x7fafbc0fde10 2024-05-09T06:26:17.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.319+0000 7fafa3fff700 1 -- 172.21.15.62:0/1261213372 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fafac013420 con 0x7fafbc0fde10 2024-05-09T06:26:17.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.319+0000 7fafa3fff700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fafa40692a0 0x7fafa406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:17.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.319+0000 7fafbaffd700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fafa40692a0 0x7fafa406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:17.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.319+0000 7fafa3fff700 1 -- 172.21.15.62:0/1261213372 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fafac0881b0 con 0x7fafbc0fde10 2024-05-09T06:26:17.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.320+0000 7fafbaffd700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fafa40692a0 0x7fafa406b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafbc102660 tx=0x7fafb000b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:17.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.324+0000 7fafa3fff700 1 -- 172.21.15.62:0/1261213372 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fafac0547a0 con 0x7fafbc0fde10 2024-05-09T06:26:17.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.522+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafbc065f30 con 0x7fafbc0fde10 2024-05-09T06:26:17.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.523+0000 7fafa3fff700 1 -- 172.21.15.62:0/1261213372 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11039 (secure 0 0 0) 0x7fafac057dc0 con 0x7fafbc0fde10 2024-05-09T06:26:17.506 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:26:17.506 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":41,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","created":"2024-05-09T06:19:56.093674+0000","modified":"2024-05-09T06:25:57.650145+0000","last_up_change":"2024-05-09T06:25:56.648710+0000","last_in_change":"2024-05-09T06:25:37.980211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T06:24:45.550223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"3ec38550-8a22-471a-a786-5316f095bcd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6803","nonce":2745260923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6805","nonce":2745260923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6809","nonce":2745260923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6807","nonce":2745260923}]},"public_addr":"172.21.15.62:6803/2745260923","cluster_addr":"172.21.15.62:6805/2745260923","heartbeat_back_addr":"172.21.15.62:6809/2745260923","heartbeat_front_addr":"172.21.15.62:6807/2745260923","state":["exists","up"]},{"osd":1,"uuid":"24f6e595-6093-4c5b-8fdd-f73da61b14ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6811","nonce":3967749242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6813","nonce":3967749242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6817","nonce":3967749242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6815","nonce":3967749242}]},"public_addr":"172.21.15.62:6811/3967749242","cluster_addr":"172.21.15.62:6813/3967749242","heartbeat_back_addr":"172.21.15.62:6817/3967749242","heartbeat_front_addr":"172.21.15.62:6815/3967749242","state":["exists","up"]},{"osd":2,"uuid":"4a38acec-7591-47bb-ad1e-0330768d0fc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6819","nonce":3065937068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6821","nonce":3065937068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6825","nonce":3065937068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6823","nonce":3065937068}]},"public_addr":"172.21.15.62:6819/3065937068","cluster_addr":"172.21.15.62:6821/3065937068","heartbeat_back_addr":"172.21.15.62:6825/3065937068","heartbeat_front_addr":"172.21.15.62:6823/3065937068","state":["exists","up"]},{"osd":3,"uuid":"bc60aef9-47d8-41c9-8339-ff9e30ad307b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6801","nonce":2562186552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6803","nonce":2562186552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6807","nonce":2562186552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6805","nonce":2562186552}]},"public_addr":"172.21.15.79:6801/2562186552","cluster_addr":"172.21.15.79:6803/2562186552","heartbeat_back_addr":"172.21.15.79:6807/2562186552","heartbeat_front_addr":"172.21.15.79:6805/2562186552","state":["exists","up"]},{"osd":4,"uuid":"5234289d-7aea-415e-a8fc-e45c5af2b4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6809","nonce":1486614570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6811","nonce":1486614570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6815","nonce":1486614570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6813","nonce":1486614570}]},"public_addr":"172.21.15.79:6809/1486614570","cluster_addr":"172.21.15.79:6811/1486614570","heartbeat_back_addr":"172.21.15.79:6815/1486614570","heartbeat_front_addr":"172.21.15.79:6813/1486614570","state":["exists","up"]},{"osd":5,"uuid":"bd6b559c-e9b6-4e08-bee4-8bb0df38614f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6817","nonce":638252503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6819","nonce":638252503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6823","nonce":638252503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6821","nonce":638252503}]},"public_addr":"172.21.15.79:6817/638252503","cluster_addr":"172.21.15.79:6819/638252503","heartbeat_back_addr":"172.21.15.79:6823/638252503","heartbeat_front_addr":"172.21.15.79:6821/638252503","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:23:44.033973+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:13.359807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:41.830940+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:05.491134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:29.958354+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:54.884839+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:0/1042226830":"2024-05-10T06:22:29.031235+0000","172.21.15.62:6801/2116890721":"2024-05-10T06:22:29.031235+0000","172.21.15.62:6800/2116890721":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/995524261":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/1371502517":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/849368193":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/1289942620":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/851126602":"2024-05-10T06:21:00.610342+0000","172.21.15.62:6801/942541084":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/626723007":"2024-05-10T06:20:29.771562+0000","172.21.15.62:0/2849696799":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6800/21732303":"2024-05-10T06:20:29.771562+0000","172.21.15.62:0/3633776630":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6801/21732303":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6800/942541084":"2024-05-10T06:21:00.610342+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fafa40692a0 msgr2=0x7fafa406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fafa40692a0 0x7fafa406b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafbc102660 tx=0x7fafb000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 msgr2=0x7fafbc0fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 0x7fafbc0fbc40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fafac009380 tx=0x7fafac009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 shutdown_connections 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fafa40692a0 0x7fafa406b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fafbc0fde10 0x7fafbc0fbc40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 --2- 172.21.15.62:0/1261213372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafbc0fe7b0 0x7fafbc0fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 >> 172.21.15.62:0/1261213372 conn(0x7fafbc0f7820 msgr2=0x7fafbc0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 shutdown_connections 2024-05-09T06:26:17.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:17.525+0000 7fafc1f30700 1 -- 172.21.15.62:0/1261213372 wait complete. 2024-05-09T06:26:18.167 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:18 smithi062 ceph-mon[26920]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:18.167 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:18 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1261213372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:18.168 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-09T06:26:18.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T06:26:18.438 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:18 smithi079 ceph-mon[35268]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:18.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:18 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1261213372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 -- 172.21.15.62:0/1801875888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 msgr2=0x7f99ac0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 --2- 172.21.15.62:0/1801875888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 0x7f99ac0fb830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f99a0004940 tx=0x7f99a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 -- 172.21.15.62:0/1801875888 shutdown_connections 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 --2- 172.21.15.62:0/1801875888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 0x7f99ac0fb830 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 --2- 172.21.15.62:0/1801875888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac102e60 0x7f99ac103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 -- 172.21.15.62:0/1801875888 >> 172.21.15.62:0/1801875888 conn(0x7f99ac072320 msgr2=0x7f99ac072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 -- 172.21.15.62:0/1801875888 shutdown_connections 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 -- 172.21.15.62:0/1801875888 wait complete. 2024-05-09T06:26:20.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 Processor -- start 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.184+0000 7f99b09b2700 1 -- start start 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99b09b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 0x7f99ac0fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99b09b2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac102e60 0x7f99ac0fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99b09b2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0fe580 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99b09b2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0fd020 con 0x7f99ac102e60 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 0x7f99ac0fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 0x7f99ac0fc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48982/0 (socket says 172.21.15.62:48982) 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99aa59c700 1 -- 172.21.15.62:0/851457860 learned_addr learned my addr 172.21.15.62:0/851457860 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:20.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99a9d9b700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac102e60 0x7f99ac0fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99aa59c700 1 -- 172.21.15.62:0/851457860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac102e60 msgr2=0x7f99ac0fcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99aa59c700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac102e60 0x7f99ac0fcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99aa59c700 1 -- 172.21.15.62:0/851457860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a0005040 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f99aa59c700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 0x7f99ac0fc5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f999c00b790 tx=0x7f999c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.185+0000 7f999affd700 1 -- 172.21.15.62:0/851457860 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f999c00f770 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.186+0000 7f999affd700 1 -- 172.21.15.62:0/851457860 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f999c00fda0 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.186+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac0fd300 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.186+0000 7f999affd700 1 -- 172.21.15.62:0/851457860 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f999c00d310 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.186+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac11a190 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.187+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac100160 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.188+0000 7f999affd700 1 -- 172.21.15.62:0/851457860 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f999c010420 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.188+0000 7f999affd700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f99940692a0 0x7f999406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:20.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.188+0000 7f999affd700 1 -- 172.21.15.62:0/851457860 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f999c087500 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.188+0000 7f99a9d9b700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f99940692a0 0x7f999406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:20.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.189+0000 7f99a9d9b700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f99940692a0 0x7f999406b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99a000b3b0 tx=0x7f99a0009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:20.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.192+0000 7f999affd700 1 -- 172.21.15.62:0/851457860 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f999c053c10 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.247 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:20 smithi062 ceph-mon[26920]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.405+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99ac0fe760 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.406+0000 7f999affd700 1 -- 172.21.15.62:0/851457860 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11039 (secure 0 0 0) 0x7f999c057230 con 0x7f99ac0fb3c0 2024-05-09T06:26:20.389 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:26:20.389 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":41,"fsid":"f8b094b6-0dcb-11ef-bc97-c7b262605968","created":"2024-05-09T06:19:56.093674+0000","modified":"2024-05-09T06:25:57.650145+0000","last_up_change":"2024-05-09T06:25:56.648710+0000","last_in_change":"2024-05-09T06:25:37.980211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T06:24:45.550223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"3ec38550-8a22-471a-a786-5316f095bcd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6803","nonce":2745260923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6805","nonce":2745260923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6809","nonce":2745260923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2745260923},{"type":"v1","addr":"172.21.15.62:6807","nonce":2745260923}]},"public_addr":"172.21.15.62:6803/2745260923","cluster_addr":"172.21.15.62:6805/2745260923","heartbeat_back_addr":"172.21.15.62:6809/2745260923","heartbeat_front_addr":"172.21.15.62:6807/2745260923","state":["exists","up"]},{"osd":1,"uuid":"24f6e595-6093-4c5b-8fdd-f73da61b14ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6811","nonce":3967749242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6813","nonce":3967749242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6817","nonce":3967749242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3967749242},{"type":"v1","addr":"172.21.15.62:6815","nonce":3967749242}]},"public_addr":"172.21.15.62:6811/3967749242","cluster_addr":"172.21.15.62:6813/3967749242","heartbeat_back_addr":"172.21.15.62:6817/3967749242","heartbeat_front_addr":"172.21.15.62:6815/3967749242","state":["exists","up"]},{"osd":2,"uuid":"4a38acec-7591-47bb-ad1e-0330768d0fc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6819","nonce":3065937068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6821","nonce":3065937068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6825","nonce":3065937068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3065937068},{"type":"v1","addr":"172.21.15.62:6823","nonce":3065937068}]},"public_addr":"172.21.15.62:6819/3065937068","cluster_addr":"172.21.15.62:6821/3065937068","heartbeat_back_addr":"172.21.15.62:6825/3065937068","heartbeat_front_addr":"172.21.15.62:6823/3065937068","state":["exists","up"]},{"osd":3,"uuid":"bc60aef9-47d8-41c9-8339-ff9e30ad307b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6801","nonce":2562186552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6803","nonce":2562186552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6807","nonce":2562186552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2562186552},{"type":"v1","addr":"172.21.15.79:6805","nonce":2562186552}]},"public_addr":"172.21.15.79:6801/2562186552","cluster_addr":"172.21.15.79:6803/2562186552","heartbeat_back_addr":"172.21.15.79:6807/2562186552","heartbeat_front_addr":"172.21.15.79:6805/2562186552","state":["exists","up"]},{"osd":4,"uuid":"5234289d-7aea-415e-a8fc-e45c5af2b4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6809","nonce":1486614570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6811","nonce":1486614570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6815","nonce":1486614570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1486614570},{"type":"v1","addr":"172.21.15.79:6813","nonce":1486614570}]},"public_addr":"172.21.15.79:6809/1486614570","cluster_addr":"172.21.15.79:6811/1486614570","heartbeat_back_addr":"172.21.15.79:6815/1486614570","heartbeat_front_addr":"172.21.15.79:6813/1486614570","state":["exists","up"]},{"osd":5,"uuid":"bd6b559c-e9b6-4e08-bee4-8bb0df38614f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6817","nonce":638252503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6819","nonce":638252503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6823","nonce":638252503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":638252503},{"type":"v1","addr":"172.21.15.79:6821","nonce":638252503}]},"public_addr":"172.21.15.79:6817/638252503","cluster_addr":"172.21.15.79:6819/638252503","heartbeat_back_addr":"172.21.15.79:6823/638252503","heartbeat_front_addr":"172.21.15.79:6821/638252503","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:23:44.033973+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:13.359807+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:41.830940+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:05.491134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:29.958354+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:54.884839+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:0/1042226830":"2024-05-10T06:22:29.031235+0000","172.21.15.62:6801/2116890721":"2024-05-10T06:22:29.031235+0000","172.21.15.62:6800/2116890721":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/995524261":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/1371502517":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/849368193":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/1289942620":"2024-05-10T06:22:29.031235+0000","172.21.15.62:0/851126602":"2024-05-10T06:21:00.610342+0000","172.21.15.62:6801/942541084":"2024-05-10T06:21:00.610342+0000","172.21.15.62:0/626723007":"2024-05-10T06:20:29.771562+0000","172.21.15.62:0/2849696799":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6800/21732303":"2024-05-10T06:20:29.771562+0000","172.21.15.62:0/3633776630":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6801/21732303":"2024-05-10T06:20:29.771562+0000","172.21.15.62:6800/942541084":"2024-05-10T06:21:00.610342+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.408+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f99940692a0 msgr2=0x7f999406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.408+0000 7f99b09b2700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f99940692a0 0x7f999406b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99a000b3b0 tx=0x7f99a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.408+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 msgr2=0x7f99ac0fc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.409+0000 7f99b09b2700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 0x7f99ac0fc5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f999c00b790 tx=0x7f999c009250 comp rx=0 tx=0).stop 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.409+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 shutdown_connections 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.409+0000 7f99b09b2700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f99940692a0 0x7f999406b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.409+0000 7f99b09b2700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99ac0fb3c0 0x7f99ac0fc5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.409+0000 7f99b09b2700 1 --2- 172.21.15.62:0/851457860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99ac102e60 0x7f99ac0fcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:20.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.409+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 >> 172.21.15.62:0/851457860 conn(0x7f99ac072320 msgr2=0x7f99ac0fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:20.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.409+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 shutdown_connections 2024-05-09T06:26:20.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:20.409+0000 7f99b09b2700 1 -- 172.21.15.62:0/851457860 wait complete. 2024-05-09T06:26:20.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:20 smithi079 ceph-mon[35268]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:21.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-09T06:26:21.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-09T06:26:21.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-09T06:26:21.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-09T06:26:21.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-09T06:26:21.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-09T06:26:21.390 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:21.393 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:21.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:21 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/851457860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:21.495 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:21 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/851457860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:22 smithi062 ceph-mon[26920]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:22.506 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:22 smithi079 ceph-mon[35268]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:23.274 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:23.275 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:24.335 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:24 smithi062 ceph-mon[26920]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.460+0000 7fe1dc877700 1 -- 172.21.15.62:0/4181633218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 msgr2=0x7fe1d81020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.460+0000 7fe1dc877700 1 --2- 172.21.15.62:0/4181633218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 0x7fe1d81020a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8004940 tx=0x7fe1c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 -- 172.21.15.62:0/4181633218 shutdown_connections 2024-05-09T06:26:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 --2- 172.21.15.62:0/4181633218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d8102670 0x7fe1d80fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 --2- 172.21.15.62:0/4181633218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 0x7fe1d81020a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 -- 172.21.15.62:0/4181633218 >> 172.21.15.62:0/4181633218 conn(0x7fe1d8071460 msgr2=0x7fe1d8071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 -- 172.21.15.62:0/4181633218 shutdown_connections 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 -- 172.21.15.62:0/4181633218 wait complete. 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 Processor -- start 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 -- start start 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 0x7fe1d8113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d8102670 0x7fe1d8114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8114750 con 0x7fe1d8101cd0 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1dc877700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d810dab0 con 0x7fe1d8102670 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1d659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 0x7fe1d8113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1d659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 0x7fe1d8113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44314/0 (socket says 172.21.15.62:44314) 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.461+0000 7fe1d659c700 1 -- 172.21.15.62:0/3552504431 learned_addr learned my addr 172.21.15.62:0/3552504431 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1d5d9b700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d8102670 0x7fe1d8114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1d659c700 1 -- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d8102670 msgr2=0x7fe1d8114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1d659c700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d8102670 0x7fe1d8114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1d659c700 1 -- 172.21.15.62:0/3552504431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8005040 con 0x7fe1d8101cd0 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1d5d9b700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d8102670 0x7fe1d8114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1d659c700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 0x7fe1d8113b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800b3b0 tx=0x7fe1c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c800e030 con 0x7fe1d8101cd0 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1c800bde0 con 0x7fe1d8101cd0 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d810dd30 con 0x7fe1d8101cd0 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c8013e50 con 0x7fe1d8101cd0 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.462+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d810e2f0 con 0x7fe1d8101cd0 2024-05-09T06:26:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.463+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1d810e8d0 con 0x7fe1d8101cd0 2024-05-09T06:26:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.464+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe1c80136b0 con 0x7fe1d8101cd0 2024-05-09T06:26:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.464+0000 7fe1c6ffd700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe1c00692a0 0x7fe1c006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.464+0000 7fe1d5d9b700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe1c00692a0 0x7fe1c006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.464+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe1c8088810 con 0x7fe1d8101cd0 2024-05-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.464+0000 7fe1c6ffd700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] conn(0x7fe1c006ef70 0x7fe1c0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.464+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 --> [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1c0071a30 con 0x7fe1c006ef70 2024-05-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.464+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1c808d220 con 0x7fe1d8101cd0 2024-05-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.465+0000 7fe1d5d9b700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe1c00692a0 0x7fe1c006b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc006fd0 tx=0x7fe1cc008040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.465+0000 7fe1d6d9d700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] conn(0x7fe1c006ef70 0x7fe1c0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.465+0000 7fe1d6d9d700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] conn(0x7fe1c006ef70 0x7fe1c0071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.466+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 <== osd.4 v2:172.21.15.79:6808/1486614570 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe1c0071a30 con 0x7fe1c006ef70 2024-05-09T06:26:24.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.481+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 --> [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1d80f9e00 con 0x7fe1c006ef70 2024-05-09T06:26:24.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1c6ffd700 1 -- 172.21.15.62:0/3552504431 <== osd.4 v2:172.21.15.79:6808/1486614570 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe1d80f9e00 con 0x7fe1c006ef70 2024-05-09T06:26:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] conn(0x7fe1c006ef70 msgr2=0x7fe1c0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] conn(0x7fe1c006ef70 0x7fe1c0071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe1c00692a0 msgr2=0x7fe1c006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe1c00692a0 0x7fe1c006b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc006fd0 tx=0x7fe1cc008040 comp rx=0 tx=0).stop 2024-05-09T06:26:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 msgr2=0x7fe1d8113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 0x7fe1d8113b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800b3b0 tx=0x7fe1c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 shutdown_connections 2024-05-09T06:26:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe1c00692a0 0x7fe1c006b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:6808/1486614570,v1:172.21.15.79:6809/1486614570] conn(0x7fe1c006ef70 0x7fe1c0071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8101cd0 0x7fe1d8113b30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 --2- 172.21.15.62:0/3552504431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1d8102670 0x7fe1d8114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.482+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 >> 172.21.15.62:0/3552504431 conn(0x7fe1d8071460 msgr2=0x7fe1d80f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.483+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 shutdown_connections 2024-05-09T06:26:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:24.483+0000 7fe1dc877700 1 -- 172.21.15.62:0/3552504431 wait complete. 2024-05-09T06:26:24.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:24 smithi079 ceph-mon[35268]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:26.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:26 smithi062 ceph-mon[26920]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:26.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:26 smithi079 ceph-mon[35268]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.160+0000 7f85d857c700 1 -- 172.21.15.62:0/436703782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 msgr2=0x7f85d0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.160+0000 7f85d857c700 1 --2- 172.21.15.62:0/436703782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 0x7f85d0102160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f85cc004940 tx=0x7f85cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 -- 172.21.15.62:0/436703782 shutdown_connections 2024-05-09T06:26:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 --2- 172.21.15.62:0/436703782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d00fbd40 0x7f85d00fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 --2- 172.21.15.62:0/436703782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 0x7f85d0102160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 -- 172.21.15.62:0/436703782 >> 172.21.15.62:0/436703782 conn(0x7f85d0071d00 msgr2=0x7f85d0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:27.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 -- 172.21.15.62:0/436703782 shutdown_connections 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 -- 172.21.15.62:0/436703782 wait complete. 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 Processor -- start 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 -- start start 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d00fbd40 0x7f85d010eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 0x7f85d010f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d010f6d0 con 0x7f85d0101d90 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d857c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d010f840 con 0x7f85d00fbd40 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.161+0000 7f85d5b17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 0x7f85d010f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d5b17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 0x7f85d010f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44322/0 (socket says 172.21.15.62:44322) 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d5b17700 1 -- 172.21.15.62:0/266015121 learned_addr learned my addr 172.21.15.62:0/266015121 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d6318700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d00fbd40 0x7f85d010eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d5b17700 1 -- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d00fbd40 msgr2=0x7f85d010eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d5b17700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d00fbd40 0x7f85d010eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d5b17700 1 -- 172.21.15.62:0/266015121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc005040 con 0x7f85d0101d90 2024-05-09T06:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d6318700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d00fbd40 0x7f85d010eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d5b17700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 0x7f85d010f080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c8c0 tx=0x7f85c00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c000a980 con 0x7f85d0101d90 2024-05-09T06:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85c000ce60 con 0x7f85d0101d90 2024-05-09T06:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d0117bb0 con 0x7f85d0101d90 2024-05-09T06:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c00115e0 con 0x7f85d0101d90 2024-05-09T06:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.162+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d01180e0 con 0x7f85d0101d90 2024-05-09T06:26:27.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.163+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85d0106440 con 0x7f85d0101d90 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.164+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f85c0012400 con 0x7f85d0101d90 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.164+0000 7f85c6ffd700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f85bc0692a0 0x7f85bc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.164+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f85c00879b0 con 0x7f85d0101d90 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.164+0000 7f85d6318700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f85bc0692a0 0x7f85bc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.164+0000 7f85c6ffd700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] conn(0x7f85bc06ef70 0x7f85bc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.164+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 --> [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85bc071a30 con 0x7f85bc06ef70 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.164+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85c0087db0 con 0x7f85d0101d90 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.165+0000 7f85d6b19700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] conn(0x7f85bc06ef70 0x7f85bc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.165+0000 7f85d6318700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f85bc0692a0 0x7f85bc06b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b3b0 tx=0x7f85cc009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.165+0000 7f85d6b19700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] conn(0x7f85bc06ef70 0x7f85bc071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.166+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 <== osd.5 v2:172.21.15.79:6816/638252503 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f85bc071a30 con 0x7f85bc06ef70 2024-05-09T06:26:27.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.181+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 --> [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85d00fd430 con 0x7f85bc06ef70 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.181+0000 7f85c6ffd700 1 -- 172.21.15.62:0/266015121 <== osd.5 v2:172.21.15.79:6816/638252503 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f85d00fd430 con 0x7f85bc06ef70 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] conn(0x7f85bc06ef70 msgr2=0x7f85bc071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] conn(0x7f85bc06ef70 0x7f85bc071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f85bc0692a0 msgr2=0x7f85bc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f85bc0692a0 0x7f85bc06b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b3b0 tx=0x7f85cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 msgr2=0x7f85d010f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 0x7f85d010f080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c8c0 tx=0x7f85c00044c0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 shutdown_connections 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:6816/638252503,v1:172.21.15.79:6817/638252503] conn(0x7f85bc06ef70 0x7f85bc071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f85bc0692a0 0x7f85bc06b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85d00fbd40 0x7f85d010eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 --2- 172.21.15.62:0/266015121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85d0101d90 0x7f85d010f080 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 >> 172.21.15.62:0/266015121 conn(0x7f85d0071d00 msgr2=0x7f85d0104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 shutdown_connections 2024-05-09T06:26:27.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:26.182+0000 7f85d857c700 1 -- 172.21.15.62:0/266015121 wait complete. 2024-05-09T06:26:27.883 INFO:teuthology.orchestra.run.smithi062.stdout:171798691849 2024-05-09T06:26:27.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-09T06:26:28.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:28 smithi062 ceph-mon[26920]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:28.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:28 smithi079 ceph-mon[35268]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:28.914 INFO:teuthology.orchestra.run.smithi062.stdout:150323855373 2024-05-09T06:26:28.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-09T06:26:29.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.113+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/1458459533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb40fbd40 msgr2=0x7fcfb40fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.113+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/1458459533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb40fbd40 0x7fcfb40fc1b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4004940 tx=0x7fcfa4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.113+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/1458459533 shutdown_connections 2024-05-09T06:26:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.113+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/1458459533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb40fbd40 0x7fcfb40fc1b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.113+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/1458459533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb4101d90 0x7fcfb4102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.113+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/1458459533 >> 172.21.15.62:0/1458459533 conn(0x7fcfb4071d00 msgr2=0x7fcfb4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.113+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/1458459533 shutdown_connections 2024-05-09T06:26:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.113+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/1458459533 wait complete. 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfbbfe4700 1 Processor -- start 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfbbfe4700 1 -- start start 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfbbfe4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb40fbd40 0x7fcfb410eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfbbfe4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb4101d90 0x7fcfb410f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfbbfe4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb410f6e0 con 0x7fcfb4101d90 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfbbfe4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb410f820 con 0x7fcfb40fbd40 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfb957f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb4101d90 0x7fcfb410f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfb957f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb4101d90 0x7fcfb410f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44336/0 (socket says 172.21.15.62:44336) 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfb957f700 1 -- 172.21.15.62:0/2258391387 learned_addr learned my addr 172.21.15.62:0/2258391387 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfb9d80700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb40fbd40 0x7fcfb410eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfb957f700 1 -- 172.21.15.62:0/2258391387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb40fbd40 msgr2=0x7fcfb410eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfb957f700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb40fbd40 0x7fcfb410eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfb957f700 1 -- 172.21.15.62:0/2258391387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa4005040 con 0x7fcfb4101d90 2024-05-09T06:26:30.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.114+0000 7fcfb957f700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb4101d90 0x7fcfb410f090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400b3b0 tx=0x7fcfa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.115+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa400e040 con 0x7fcfb4101d90 2024-05-09T06:26:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.115+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb4117bc0 con 0x7fcfb4101d90 2024-05-09T06:26:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.115+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfa4013420 con 0x7fcfb4101d90 2024-05-09T06:26:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.115+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa401c630 con 0x7fcfb4101d90 2024-05-09T06:26:30.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.115+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb41180d0 con 0x7fcfb4101d90 2024-05-09T06:26:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.116+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfb40faa80 con 0x7fcfb4101d90 2024-05-09T06:26:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.116+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fcfa4013590 con 0x7fcfb4101d90 2024-05-09T06:26:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfaa7fc700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fcfa00692a0 0x7fcfa006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcfa4087fe0 con 0x7fcfb4101d90 2024-05-09T06:26:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfb9d80700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fcfa00692a0 0x7fcfa006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfaa7fc700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] conn(0x7fcfa006ef70 0x7fcfa0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 --> [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfa0071a30 con 0x7fcfa006ef70 2024-05-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa408a650 con 0x7fcfb4101d90 2024-05-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfba581700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] conn(0x7fcfa006ef70 0x7fcfa0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfb9d80700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fcfa00692a0 0x7fcfa006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0004f40 tx=0x7fcfb000b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.117+0000 7fcfba581700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] conn(0x7fcfa006ef70 0x7fcfa0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:30.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.118+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 <== osd.0 v2:172.21.15.62:6802/2745260923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcfa0071a30 con 0x7fcfa006ef70 2024-05-09T06:26:30.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.134+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 --> [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfb410f9e0 con 0x7fcfa006ef70 2024-05-09T06:26:30.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.134+0000 7fcfaa7fc700 1 -- 172.21.15.62:0/2258391387 <== osd.0 v2:172.21.15.62:6802/2745260923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfac00a8d0 con 0x7fcfa006ef70 2024-05-09T06:26:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.134+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] conn(0x7fcfa006ef70 msgr2=0x7fcfa0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.134+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] conn(0x7fcfa006ef70 0x7fcfa0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.134+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fcfa00692a0 msgr2=0x7fcfa006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.134+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fcfa00692a0 0x7fcfa006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0004f40 tx=0x7fcfb000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.134+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb4101d90 msgr2=0x7fcfb410f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb4101d90 0x7fcfb410f090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400b3b0 tx=0x7fcfa4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:30.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 shutdown_connections 2024-05-09T06:26:30.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6802/2745260923,v1:172.21.15.62:6803/2745260923] conn(0x7fcfa006ef70 0x7fcfa0071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fcfa00692a0 0x7fcfa006b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcfb40fbd40 0x7fcfb410eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 --2- 172.21.15.62:0/2258391387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb4101d90 0x7fcfb410f090 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 >> 172.21.15.62:0/2258391387 conn(0x7fcfb4071d00 msgr2=0x7fcfb40fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:30.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 shutdown_connections 2024-05-09T06:26:30.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.135+0000 7fcfbbfe4700 1 -- 172.21.15.62:0/2258391387 wait complete. 2024-05-09T06:26:30.333 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:30 smithi062 ceph-mon[26920]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:30.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:30 smithi079 ceph-mon[35268]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.806+0000 7efe48024700 1 -- 172.21.15.62:0/4099500638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 msgr2=0x7efe401031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.806+0000 7efe48024700 1 --2- 172.21.15.62:0/4099500638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 0x7efe401031b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efe3c004940 tx=0x7efe3c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 -- 172.21.15.62:0/4099500638 shutdown_connections 2024-05-09T06:26:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 --2- 172.21.15.62:0/4099500638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe40103780 0x7efe400fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 --2- 172.21.15.62:0/4099500638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 0x7efe401031b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 -- 172.21.15.62:0/4099500638 >> 172.21.15.62:0/4099500638 conn(0x7efe400f89b0 msgr2=0x7efe400fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 -- 172.21.15.62:0/4099500638 shutdown_connections 2024-05-09T06:26:30.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 -- 172.21.15.62:0/4099500638 wait complete. 2024-05-09T06:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 Processor -- start 2024-05-09T06:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 -- start start 2024-05-09T06:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 0x7efe40113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe40103780 0x7efe401140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe40114780 con 0x7efe40102de0 2024-05-09T06:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.807+0000 7efe48024700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4010dae0 con 0x7efe40103780 2024-05-09T06:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe45dc0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 0x7efe40113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe45dc0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 0x7efe40113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44356/0 (socket says 172.21.15.62:44356) 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe45dc0700 1 -- 172.21.15.62:0/2465135803 learned_addr learned my addr 172.21.15.62:0/2465135803 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe455bf700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe40103780 0x7efe401140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe45dc0700 1 -- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe40103780 msgr2=0x7efe401140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe45dc0700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe40103780 0x7efe401140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe45dc0700 1 -- 172.21.15.62:0/2465135803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c005040 con 0x7efe40102de0 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe45dc0700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 0x7efe40113b60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00b3b0 tx=0x7efe3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3c00e040 con 0x7efe40102de0 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4010dd60 con 0x7efe40102de0 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe3c00bbc0 con 0x7efe40102de0 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3c01c3f0 con 0x7efe40102de0 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.808+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4010e320 con 0x7efe40102de0 2024-05-09T06:26:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.809+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe4010e840 con 0x7efe40102de0 2024-05-09T06:26:30.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.810+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7efe3c00bd30 con 0x7efe40102de0 2024-05-09T06:26:30.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.810+0000 7efe367fc700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efe2c0692a0 0x7efe2c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.810+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efe3c0880f0 con 0x7efe40102de0 2024-05-09T06:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.810+0000 7efe455bf700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efe2c0692a0 0x7efe2c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.810+0000 7efe367fc700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] conn(0x7efe2c06ef70 0x7efe2c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.811+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 --> [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe2c071a30 con 0x7efe2c06ef70 2024-05-09T06:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.811+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe3c08a6e0 con 0x7efe40102de0 2024-05-09T06:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.811+0000 7efe465c1700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] conn(0x7efe2c06ef70 0x7efe2c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.811+0000 7efe455bf700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efe2c0692a0 0x7efe2c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe30006fd0 tx=0x7efe30008040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:30.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.811+0000 7efe465c1700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] conn(0x7efe2c06ef70 0x7efe2c071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.812+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 <== osd.3 v2:172.21.15.79:6800/2562186552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7efe2c071a30 con 0x7efe2c06ef70 2024-05-09T06:26:30.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.827+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 --> [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe4005e660 con 0x7efe2c06ef70 2024-05-09T06:26:30.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.827+0000 7efe367fc700 1 -- 172.21.15.62:0/2465135803 <== osd.3 v2:172.21.15.79:6800/2562186552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efe4005e660 con 0x7efe2c06ef70 2024-05-09T06:26:30.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] conn(0x7efe2c06ef70 msgr2=0x7efe2c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] conn(0x7efe2c06ef70 0x7efe2c071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efe2c0692a0 msgr2=0x7efe2c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efe2c0692a0 0x7efe2c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe30006fd0 tx=0x7efe30008040 comp rx=0 tx=0).stop 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 msgr2=0x7efe40113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 0x7efe40113b60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00b3b0 tx=0x7efe3c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 shutdown_connections 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:6800/2562186552,v1:172.21.15.79:6801/2562186552] conn(0x7efe2c06ef70 0x7efe2c071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efe2c0692a0 0x7efe2c06b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe40102de0 0x7efe40113b60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 --2- 172.21.15.62:0/2465135803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe40103780 0x7efe401140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 >> 172.21.15.62:0/2465135803 conn(0x7efe400f89b0 msgr2=0x7efe400fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 shutdown_connections 2024-05-09T06:26:30.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.828+0000 7efe48024700 1 -- 172.21.15.62:0/2465135803 wait complete. 2024-05-09T06:26:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.992+0000 7f22b98d3700 1 -- 172.21.15.62:0/4204407742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 msgr2=0x7f22b40fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.992+0000 7f22b98d3700 1 --2- 172.21.15.62:0/4204407742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 0x7f22b40fb600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f22a8004940 tx=0x7f22a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.992+0000 7f22b98d3700 1 -- 172.21.15.62:0/4204407742 shutdown_connections 2024-05-09T06:26:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.992+0000 7f22b98d3700 1 --2- 172.21.15.62:0/4204407742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 0x7f22b40fb600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:31.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.992+0000 7f22b98d3700 1 --2- 172.21.15.62:0/4204407742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b4101cd0 0x7f22b41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.992+0000 7f22b98d3700 1 -- 172.21.15.62:0/4204407742 >> 172.21.15.62:0/4204407742 conn(0x7f22b4071460 msgr2=0x7f22b4071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.992+0000 7f22b98d3700 1 -- 172.21.15.62:0/4204407742 shutdown_connections 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.992+0000 7f22b98d3700 1 -- 172.21.15.62:0/4204407742 wait complete. 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b98d3700 1 Processor -- start 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b98d3700 1 -- start start 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b98d3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b4101cd0 0x7f22b4113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b98d3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 0x7f22b41140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b98d3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b4114740 con 0x7f22b4102670 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b98d3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b410db30 con 0x7f22b4101cd0 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 0x7f22b41140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b27fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 0x7f22b41140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44376/0 (socket says 172.21.15.62:44376) 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.993+0000 7f22b27fc700 1 -- 172.21.15.62:0/475761252 learned_addr learned my addr 172.21.15.62:0/475761252 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:31.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f22b2ffd700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b4101cd0 0x7f22b4113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f22b27fc700 1 -- 172.21.15.62:0/475761252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b4101cd0 msgr2=0x7f22b4113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f22b27fc700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b4101cd0 0x7f22b4113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f22b27fc700 1 -- 172.21.15.62:0/475761252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8005040 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f22b2ffd700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b4101cd0 0x7f22b4113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f22b27fc700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 0x7f22b41140f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22a800b3b0 tx=0x7f22a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a800e040 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b410ddb0 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22a8013420 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a801c630 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.994+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b410e370 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.995+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22b410e890 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.996+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f22a8013590 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.996+0000 7f229b7fe700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f229c0692a0 0x7f229c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.996+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f22a8088af0 con 0x7f22b4102670 2024-05-09T06:26:31.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.996+0000 7f22b2ffd700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f229c0692a0 0x7f229c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.996+0000 7f229b7fe700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] conn(0x7f229c06ef70 0x7f229c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.996+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 --> [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f229c071a30 con 0x7f229c06ef70 2024-05-09T06:26:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.996+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22a8088ed0 con 0x7f22b4102670 2024-05-09T06:26:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.996+0000 7f22b37fe700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] conn(0x7f229c06ef70 0x7f229c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.997+0000 7f22b2ffd700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f229c0692a0 0x7f229c06b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009fd0 tx=0x7f22a400b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.997+0000 7f22b37fe700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] conn(0x7f229c06ef70 0x7f229c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:30.997+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 <== osd.2 v2:172.21.15.62:6818/3065937068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f229c071a30 con 0x7f229c06ef70 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.012+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 --> [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22b41013a0 con 0x7f229c06ef70 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f229b7fe700 1 -- 172.21.15.62:0/475761252 <== osd.2 v2:172.21.15.62:6818/3065937068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22b41013a0 con 0x7f229c06ef70 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] conn(0x7f229c06ef70 msgr2=0x7f229c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] conn(0x7f229c06ef70 0x7f229c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f229c0692a0 msgr2=0x7f229c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f229c0692a0 0x7f229c06b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009fd0 tx=0x7f22a400b040 comp rx=0 tx=0).stop 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 msgr2=0x7f22b41140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 0x7f22b41140f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22a800b3b0 tx=0x7f22a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 shutdown_connections 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6818/3065937068,v1:172.21.15.62:6819/3065937068] conn(0x7f229c06ef70 0x7f229c071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:31.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f229c0692a0 0x7f229c06b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b4101cd0 0x7f22b4113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 --2- 172.21.15.62:0/475761252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22b4102670 0x7f22b41140f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 >> 172.21.15.62:0/475761252 conn(0x7f22b4071460 msgr2=0x7f22b41009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 shutdown_connections 2024-05-09T06:26:31.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:31.013+0000 7f22b98d3700 1 -- 172.21.15.62:0/475761252 wait complete. 2024-05-09T06:26:31.958 INFO:teuthology.orchestra.run.smithi062.stdout:81604378648 2024-05-09T06:26:31.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-09T06:26:32.329 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:32 smithi062 ceph-mon[26920]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:32.354 INFO:teuthology.orchestra.run.smithi062.stdout:115964117012 2024-05-09T06:26:32.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-09T06:26:32.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:32 smithi079 ceph-mon[35268]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:32.950 INFO:teuthology.orchestra.run.smithi062.stdout:38654705698 2024-05-09T06:26:32.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-09T06:26:33.911 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:33.912 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:33.912 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:33.914 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:33.916 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.960+0000 7f617effd700 1 -- 172.21.15.62:0/3564195132 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617400bcb0 con 0x7f61800fc600 2024-05-09T06:26:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.961+0000 7f61864a7700 1 -- 172.21.15.62:0/3564195132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fc600 msgr2=0x7f6180100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.961+0000 7f61864a7700 1 --2- 172.21.15.62:0/3564195132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fc600 0x7f6180100c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6174004940 tx=0x7f6174009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.962+0000 7f61864a7700 1 -- 172.21.15.62:0/3564195132 shutdown_connections 2024-05-09T06:26:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.962+0000 7f61864a7700 1 --2- 172.21.15.62:0/3564195132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fc600 0x7f6180100c20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.962+0000 7f61864a7700 1 --2- 172.21.15.62:0/3564195132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800fbc60 0x7f61800fc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.962+0000 7f61864a7700 1 -- 172.21.15.62:0/3564195132 >> 172.21.15.62:0/3564195132 conn(0x7f61800f78e0 msgr2=0x7f61800f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.962+0000 7f61864a7700 1 -- 172.21.15.62:0/3564195132 shutdown_connections 2024-05-09T06:26:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.962+0000 7f61864a7700 1 -- 172.21.15.62:0/3564195132 wait complete. 2024-05-09T06:26:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.963+0000 7f61864a7700 1 Processor -- start 2024-05-09T06:26:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.963+0000 7f61864a7700 1 -- start start 2024-05-09T06:26:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.963+0000 7f61864a7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fbc60 0x7f6180119fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.963+0000 7f61864a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800fc600 0x7f618011a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.963+0000 7f61864a7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618011ab40 con 0x7f61800fbc60 2024-05-09T06:26:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.963+0000 7f61864a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6180114120 con 0x7f61800fc600 2024-05-09T06:26:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.964+0000 7f617f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800fc600 0x7f618011a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.964+0000 7f617f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800fc600 0x7f618011a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:44604/0 (socket says 172.21.15.62:44604) 2024-05-09T06:26:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.964+0000 7f617f7fe700 1 -- 172.21.15.62:0/1603631598 learned_addr learned my addr 172.21.15.62:0/1603631598 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:33.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.964+0000 7f617ffff700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fbc60 0x7f6180119fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.965+0000 7f617f7fe700 1 -- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fbc60 msgr2=0x7f6180119fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.965+0000 7f617f7fe700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fbc60 0x7f6180119fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.965+0000 7f617f7fe700 1 -- 172.21.15.62:0/1603631598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6174005040 con 0x7f61800fc600 2024-05-09T06:26:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.965+0000 7f617ffff700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fbc60 0x7f6180119fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:26:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.965+0000 7f617f7fe700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800fc600 0x7f618011a4f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6174008da0 tx=0x7f6174009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.966+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617400e070 con 0x7f61800fc600 2024-05-09T06:26:33.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.966+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6174004290 con 0x7f61800fc600 2024-05-09T06:26:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.966+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6174013e50 con 0x7f61800fc600 2024-05-09T06:26:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.966+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61801143a0 con 0x7f61800fc600 2024-05-09T06:26:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.967+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61801148b0 con 0x7f61800fc600 2024-05-09T06:26:33.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.967+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6180114e50 con 0x7f61800fc600 2024-05-09T06:26:33.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.969+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6174013420 con 0x7f61800fc600 2024-05-09T06:26:33.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.970+0000 7f617cff9700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6168069130 0x7f616806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:33.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.970+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f61740888d0 con 0x7f61800fc600 2024-05-09T06:26:33.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.970+0000 7f617cff9700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] conn(0x7f616806ec90 0x7f61680710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:33.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.970+0000 7f617ffff700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6168069130 0x7f616806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:33.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.970+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 --> [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6168071750 con 0x7f616806ec90 2024-05-09T06:26:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.970+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6174088c00 con 0x7f61800fc600 2024-05-09T06:26:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.970+0000 7f6184a44700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] conn(0x7f616806ec90 0x7f61680710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.971+0000 7f6184a44700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] conn(0x7f616806ec90 0x7f61680710a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.971+0000 7f617ffff700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6168069130 0x7f616806b5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6170010520 tx=0x7f617000b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:33.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.972+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 <== osd.1 v2:172.21.15.62:6810/3967749242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6168071750 con 0x7f616806ec90 2024-05-09T06:26:33.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.991+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 --> [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6180114fc0 con 0x7f616806ec90 2024-05-09T06:26:33.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.991+0000 7f617cff9700 1 -- 172.21.15.62:0/1603631598 <== osd.1 v2:172.21.15.62:6810/3967749242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6180114fc0 con 0x7f616806ec90 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] conn(0x7f616806ec90 msgr2=0x7f61680710a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] conn(0x7f616806ec90 0x7f61680710a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6168069130 msgr2=0x7f616806b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6168069130 0x7f616806b5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6170010520 tx=0x7f617000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800fc600 msgr2=0x7f618011a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800fc600 0x7f618011a4f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6174008da0 tx=0x7f6174009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 shutdown_connections 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6810/3967749242,v1:172.21.15.62:6811/3967749242] conn(0x7f616806ec90 0x7f61680710a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6168069130 0x7f616806b5e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61800fbc60 0x7f6180119fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 --2- 172.21.15.62:0/1603631598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61800fc600 0x7f618011a4f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 >> 172.21.15.62:0/1603631598 conn(0x7f61800f78e0 msgr2=0x7f618010aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:33.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 shutdown_connections 2024-05-09T06:26:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:33.992+0000 7f61864a7700 1 -- 172.21.15.62:0/1603631598 wait complete. 2024-05-09T06:26:34.206 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:34 smithi062 ceph-mon[26920]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:34 smithi079 ceph-mon[35268]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:36.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:36 smithi062 ceph-mon[26920]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:36.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:36 smithi079 ceph-mon[35268]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:36.746 INFO:teuthology.orchestra.run.smithi062.stdout:60129542175 2024-05-09T06:26:36.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-09T06:26:38.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:38 smithi062 ceph-mon[26920]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:38 smithi079 ceph-mon[35268]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.952+0000 7f9592b37700 1 -- 172.21.15.62:0/3773744471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 msgr2=0x7f958c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.952+0000 7f9592b37700 1 --2- 172.21.15.62:0/3773744471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 0x7f958c102160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9580004940 tx=0x7f9580009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.952+0000 7f9592b37700 1 -- 172.21.15.62:0/3773744471 shutdown_connections 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.952+0000 7f9592b37700 1 --2- 172.21.15.62:0/3773744471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c0fbd40 0x7f958c0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.952+0000 7f9592b37700 1 --2- 172.21.15.62:0/3773744471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 0x7f958c102160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.952+0000 7f9592b37700 1 -- 172.21.15.62:0/3773744471 >> 172.21.15.62:0/3773744471 conn(0x7f958c071d00 msgr2=0x7f958c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.952+0000 7f9592b37700 1 -- 172.21.15.62:0/3773744471 shutdown_connections 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.952+0000 7f9592b37700 1 -- 172.21.15.62:0/3773744471 wait complete. 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f9592b37700 1 Processor -- start 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f9592b37700 1 -- start start 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f9592b37700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c0fbd40 0x7f958c10eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f9592b37700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 0x7f958c10f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f9592b37700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c10f760 con 0x7f958c101d90 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f9592b37700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c10f8a0 con 0x7f958c0fbd40 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f958bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 0x7f958c10f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:39.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f958bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 0x7f958c10f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34758/0 (socket says 172.21.15.62:34758) 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f958bfff700 1 -- 172.21.15.62:0/3489369431 learned_addr learned my addr 172.21.15.62:0/3489369431 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.953+0000 7f95908d3700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c0fbd40 0x7f958c10eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f958bfff700 1 -- 172.21.15.62:0/3489369431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c0fbd40 msgr2=0x7f958c10eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f958bfff700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c0fbd40 0x7f958c10eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f958bfff700 1 -- 172.21.15.62:0/3489369431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580005040 con 0x7f958c101d90 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f958bfff700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 0x7f958c10f080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f957800b790 tx=0x7f9578009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f95897fa700 1 -- 172.21.15.62:0/3489369431 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f957800f6f0 con 0x7f958c101d90 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f95897fa700 1 -- 172.21.15.62:0/3489369431 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f957800fd20 con 0x7f958c101d90 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c117c10 con 0x7f958c101d90 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f95897fa700 1 -- 172.21.15.62:0/3489369431 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95780103a0 con 0x7f958c101d90 2024-05-09T06:26:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.954+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c1181a0 con 0x7f958c101d90 2024-05-09T06:26:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.955+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c0fd430 con 0x7f958c101d90 2024-05-09T06:26:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.956+0000 7f95897fa700 1 -- 172.21.15.62:0/3489369431 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9578011400 con 0x7f958c101d90 2024-05-09T06:26:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.956+0000 7f95897fa700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f957c0692a0 0x7f957c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.956+0000 7f95897fa700 1 -- 172.21.15.62:0/3489369431 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9578086c40 con 0x7f958c101d90 2024-05-09T06:26:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.956+0000 7f95908d3700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f957c0692a0 0x7f957c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:39.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.957+0000 7f95908d3700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f957c0692a0 0x7f957c06b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9580004890 tx=0x7f9580009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:39.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:39.961+0000 7f95897fa700 1 -- 172.21.15.62:0/3489369431 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f95780532b0 con 0x7f958c101d90 2024-05-09T06:26:40.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.160+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f958c05f5c0 con 0x7f958c101d90 2024-05-09T06:26:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.160+0000 7f95897fa700 1 -- 172.21.15.62:0/3489369431 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95780568d0 con 0x7f958c101d90 2024-05-09T06:26:40.143 INFO:teuthology.orchestra.run.smithi062.stdout:115964117014 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.162+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f957c0692a0 msgr2=0x7f957c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.162+0000 7f9592b37700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f957c0692a0 0x7f957c06b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9580004890 tx=0x7f9580009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.162+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 msgr2=0x7f958c10f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.162+0000 7f9592b37700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 0x7f958c10f080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f957800b790 tx=0x7f9578009250 comp rx=0 tx=0).stop 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.163+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 shutdown_connections 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.163+0000 7f9592b37700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f957c0692a0 0x7f957c06b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.163+0000 7f9592b37700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c0fbd40 0x7f958c10eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.163+0000 7f9592b37700 1 --2- 172.21.15.62:0/3489369431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f958c101d90 0x7f958c10f080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.163+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 >> 172.21.15.62:0/3489369431 conn(0x7f958c071d00 msgr2=0x7f958c0fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:40.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.163+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 shutdown_connections 2024-05-09T06:26:40.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.163+0000 7f9592b37700 1 -- 172.21.15.62:0/3489369431 wait complete. 2024-05-09T06:26:40.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.171+0000 7efd79410700 1 -- 172.21.15.62:0/2023673274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 msgr2=0x7efd741020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.171+0000 7efd79410700 1 --2- 172.21.15.62:0/2023673274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 0x7efd741020a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd64004940 tx=0x7efd64009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.171+0000 7efd79410700 1 -- 172.21.15.62:0/2023673274 shutdown_connections 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.171+0000 7efd79410700 1 --2- 172.21.15.62:0/2023673274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd74102670 0x7efd740fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.171+0000 7efd79410700 1 --2- 172.21.15.62:0/2023673274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 0x7efd741020a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.171+0000 7efd79410700 1 -- 172.21.15.62:0/2023673274 >> 172.21.15.62:0/2023673274 conn(0x7efd74071460 msgr2=0x7efd74071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.171+0000 7efd79410700 1 -- 172.21.15.62:0/2023673274 shutdown_connections 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.171+0000 7efd79410700 1 -- 172.21.15.62:0/2023673274 wait complete. 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd79410700 1 Processor -- start 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd79410700 1 -- start start 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd79410700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 0x7efd740fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd79410700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd74102670 0x7efd740fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd79410700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd740fd2b0 con 0x7efd74101cd0 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd79410700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd740fd3f0 con 0x7efd74102670 2024-05-09T06:26:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd72ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 0x7efd740fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd72ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 0x7efd740fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34780/0 (socket says 172.21.15.62:34780) 2024-05-09T06:26:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd72ffd700 1 -- 172.21.15.62:0/3906089454 learned_addr learned my addr 172.21.15.62:0/3906089454 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd727fc700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd74102670 0x7efd740fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd72ffd700 1 -- 172.21.15.62:0/3906089454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd74102670 msgr2=0x7efd740fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd72ffd700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd74102670 0x7efd740fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd72ffd700 1 -- 172.21.15.62:0/3906089454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64005040 con 0x7efd74101cd0 2024-05-09T06:26:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.172+0000 7efd72ffd700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 0x7efd740fc7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd6400b3b0 tx=0x7efd64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.173+0000 7efd5b7fe700 1 -- 172.21.15.62:0/3906089454 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd6400e040 con 0x7efd74101cd0 2024-05-09T06:26:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.173+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd740fd640 con 0x7efd74101cd0 2024-05-09T06:26:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.173+0000 7efd5b7fe700 1 -- 172.21.15.62:0/3906089454 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd64013420 con 0x7efd74101cd0 2024-05-09T06:26:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.173+0000 7efd5b7fe700 1 -- 172.21.15.62:0/3906089454 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd6401c630 con 0x7efd74101cd0 2024-05-09T06:26:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.173+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7411a2b0 con 0x7efd74101cd0 2024-05-09T06:26:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.174+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd74065200 con 0x7efd74101cd0 2024-05-09T06:26:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.174+0000 7efd5b7fe700 1 -- 172.21.15.62:0/3906089454 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7efd64013590 con 0x7efd74101cd0 2024-05-09T06:26:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.175+0000 7efd5b7fe700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efd5c0692a0 0x7efd5c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.175+0000 7efd5b7fe700 1 -- 172.21.15.62:0/3906089454 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efd64088020 con 0x7efd74101cd0 2024-05-09T06:26:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.175+0000 7efd727fc700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efd5c0692a0 0x7efd5c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:40.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.176+0000 7efd727fc700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efd5c0692a0 0x7efd5c06b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd740fe120 tx=0x7efd6800b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:40.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.180+0000 7efd5b7fe700 1 -- 172.21.15.62:0/3906089454 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efd64054690 con 0x7efd74101cd0 2024-05-09T06:26:40.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.381+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd7404bed0 con 0x7efd74101cd0 2024-05-09T06:26:40.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.381+0000 7efd5b7fe700 1 -- 172.21.15.62:0/3906089454 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd64057cb0 con 0x7efd74101cd0 2024-05-09T06:26:40.364 INFO:teuthology.orchestra.run.smithi062.stdout:38654705700 2024-05-09T06:26:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efd5c0692a0 msgr2=0x7efd5c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efd5c0692a0 0x7efd5c06b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd740fe120 tx=0x7efd6800b040 comp rx=0 tx=0).stop 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 msgr2=0x7efd740fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 0x7efd740fc7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd6400b3b0 tx=0x7efd64009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 shutdown_connections 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7efd5c0692a0 0x7efd5c06b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd74101cd0 0x7efd740fc7e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 --2- 172.21.15.62:0/3906089454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd74102670 0x7efd740fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 >> 172.21.15.62:0/3906089454 conn(0x7efd74071460 msgr2=0x7efd740fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 shutdown_connections 2024-05-09T06:26:40.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:40.383+0000 7efd79410700 1 -- 172.21.15.62:0/3906089454 wait complete. 2024-05-09T06:26:40.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:40 smithi062 ceph-mon[26920]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:40.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:40 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3489369431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T06:26:40.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:40 smithi079 ceph-mon[35268]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:40.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:40 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3489369431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T06:26:41.470 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:41 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3906089454' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T06:26:41.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:41 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3906089454' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T06:26:41.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.590+0000 7f6a9da96700 1 -- 172.21.15.62:0/4007811935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a98101d90 msgr2=0x7f6a98102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:41.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.590+0000 7f6a9da96700 1 --2- 172.21.15.62:0/4007811935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a98101d90 0x7f6a98102160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009ce0 tx=0x7f6a88004d10 comp rx=0 tx=0).stop 2024-05-09T06:26:41.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.590+0000 7f6a9da96700 1 -- 172.21.15.62:0/4007811935 shutdown_connections 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.590+0000 7f6a9da96700 1 --2- 172.21.15.62:0/4007811935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a980fbd40 0x7f6a980fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.590+0000 7f6a9da96700 1 --2- 172.21.15.62:0/4007811935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a98101d90 0x7f6a98102160 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.590+0000 7f6a9da96700 1 -- 172.21.15.62:0/4007811935 >> 172.21.15.62:0/4007811935 conn(0x7f6a98071d00 msgr2=0x7f6a98072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.590+0000 7f6a9da96700 1 -- 172.21.15.62:0/4007811935 shutdown_connections 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.590+0000 7f6a9da96700 1 -- 172.21.15.62:0/4007811935 wait complete. 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a9da96700 1 Processor -- start 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a9da96700 1 -- start start 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a9da96700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a980fbd40 0x7f6a9810eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a9da96700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98101d90 0x7f6a9810f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a9da96700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9810f7e0 con 0x7f6a980fbd40 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a9da96700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9810f950 con 0x7f6a98101d90 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a977fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a980fbd40 0x7f6a9810eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a977fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a980fbd40 0x7f6a9810eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34798/0 (socket says 172.21.15.62:34798) 2024-05-09T06:26:41.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a977fe700 1 -- 172.21.15.62:0/3513804599 learned_addr learned my addr 172.21.15.62:0/3513804599 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.591+0000 7f6a96ffd700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98101d90 0x7f6a9810f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a977fe700 1 -- 172.21.15.62:0/3513804599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98101d90 msgr2=0x7f6a9810f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a977fe700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98101d90 0x7f6a9810f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a977fe700 1 -- 172.21.15.62:0/3513804599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009940 con 0x7f6a980fbd40 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a977fe700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a980fbd40 0x7f6a9810eca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6a88003400 tx=0x7f6a88004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a8ffff700 1 -- 172.21.15.62:0/3513804599 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a8800e040 con 0x7f6a980fbd40 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a8ffff700 1 -- 172.21.15.62:0/3513804599 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a88008da0 con 0x7f6a980fbd40 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a98117d10 con 0x7f6a980fbd40 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a8ffff700 1 -- 172.21.15.62:0/3513804599 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a8801c6d0 con 0x7f6a980fbd40 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.592+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981181f0 con 0x7f6a980fbd40 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.593+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a980fd430 con 0x7f6a980fbd40 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.593+0000 7f6a8ffff700 1 -- 172.21.15.62:0/3513804599 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6a88012b00 con 0x7f6a980fbd40 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.594+0000 7f6a8ffff700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6a840692a0 0x7f6a8406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:41.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.594+0000 7f6a8ffff700 1 -- 172.21.15.62:0/3513804599 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6a88088990 con 0x7f6a980fbd40 2024-05-09T06:26:41.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.594+0000 7f6a96ffd700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6a840692a0 0x7f6a8406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:41.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.594+0000 7f6a96ffd700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6a840692a0 0x7f6a8406b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a98065fb0 tx=0x7f6a8000b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:41.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.598+0000 7f6a8ffff700 1 -- 172.21.15.62:0/3513804599 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6a88054f80 con 0x7f6a980fbd40 2024-05-09T06:26:41.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.838+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a9804bed0 con 0x7f6a980fbd40 2024-05-09T06:26:41.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.838+0000 7f6a8ffff700 1 -- 172.21.15.62:0/3513804599 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a880585a0 con 0x7f6a980fbd40 2024-05-09T06:26:41.821 INFO:teuthology.orchestra.run.smithi062.stdout:81604378650 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.840+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6a840692a0 msgr2=0x7f6a8406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.840+0000 7f6a9da96700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6a840692a0 0x7f6a8406b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a98065fb0 tx=0x7f6a8000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.840+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a980fbd40 msgr2=0x7f6a9810eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.840+0000 7f6a9da96700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a980fbd40 0x7f6a9810eca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6a88003400 tx=0x7f6a88004d10 comp rx=0 tx=0).stop 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.841+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 shutdown_connections 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.841+0000 7f6a9da96700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f6a840692a0 0x7f6a8406b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.841+0000 7f6a9da96700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a980fbd40 0x7f6a9810eca0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.841+0000 7f6a9da96700 1 --2- 172.21.15.62:0/3513804599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98101d90 0x7f6a9810f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.841+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 >> 172.21.15.62:0/3513804599 conn(0x7f6a98071d00 msgr2=0x7f6a98104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.841+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 shutdown_connections 2024-05-09T06:26:41.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.841+0000 7f6a9da96700 1 -- 172.21.15.62:0/3513804599 wait complete. 2024-05-09T06:26:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 -- 172.21.15.62:0/678229510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 msgr2=0x7ff5b00fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 --2- 172.21.15.62:0/678229510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 0x7ff5b00fc1b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4004940 tx=0x7ff5a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 -- 172.21.15.62:0/678229510 shutdown_connections 2024-05-09T06:26:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 --2- 172.21.15.62:0/678229510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 0x7ff5b00fc1b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 --2- 172.21.15.62:0/678229510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5b0101d90 0x7ff5b0102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 -- 172.21.15.62:0/678229510 >> 172.21.15.62:0/678229510 conn(0x7ff5b0071d00 msgr2=0x7ff5b0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:41.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 -- 172.21.15.62:0/678229510 shutdown_connections 2024-05-09T06:26:41.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 -- 172.21.15.62:0/678229510 wait complete. 2024-05-09T06:26:41.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.870+0000 7ff5b577e700 1 Processor -- start 2024-05-09T06:26:41.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5b577e700 1 -- start start 2024-05-09T06:26:41.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5b577e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 0x7ff5b0113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:41.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5b577e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5b0101d90 0x7ff5b0114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5b577e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b01146a0 con 0x7ff5b00fbd40 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5b577e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b010da90 con 0x7ff5b0101d90 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5aeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 0x7ff5b0113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5aeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 0x7ff5b0113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34816/0 (socket says 172.21.15.62:34816) 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5aeffd700 1 -- 172.21.15.62:0/1915764969 learned_addr learned my addr 172.21.15.62:0/1915764969 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5ae7fc700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5b0101d90 0x7ff5b0114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5aeffd700 1 -- 172.21.15.62:0/1915764969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5b0101d90 msgr2=0x7ff5b0114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5aeffd700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5b0101d90 0x7ff5b0114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5aeffd700 1 -- 172.21.15.62:0/1915764969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4005040 con 0x7ff5b00fbd40 2024-05-09T06:26:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.871+0000 7ff5aeffd700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 0x7ff5b0113b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000eb40 tx=0x7ff5a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:41.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.872+0000 7ff5977fe700 1 -- 172.21.15.62:0/1915764969 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a0007cc0 con 0x7ff5b00fbd40 2024-05-09T06:26:41.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.872+0000 7ff5977fe700 1 -- 172.21.15.62:0/1915764969 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5a000f040 con 0x7ff5b00fbd40 2024-05-09T06:26:41.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.872+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b010dd10 con 0x7ff5b00fbd40 2024-05-09T06:26:41.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.872+0000 7ff5977fe700 1 -- 172.21.15.62:0/1915764969 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a0009620 con 0x7ff5b00fbd40 2024-05-09T06:26:41.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.872+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b010e220 con 0x7ff5b00fbd40 2024-05-09T06:26:41.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.873+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b00fd430 con 0x7ff5b00fbd40 2024-05-09T06:26:41.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.874+0000 7ff5977fe700 1 -- 172.21.15.62:0/1915764969 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff5a0009780 con 0x7ff5b00fbd40 2024-05-09T06:26:41.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.874+0000 7ff5977fe700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff5980692a0 0x7ff59806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:41.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.874+0000 7ff5977fe700 1 -- 172.21.15.62:0/1915764969 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff5a0086a60 con 0x7ff5b00fbd40 2024-05-09T06:26:41.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.874+0000 7ff5ae7fc700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff5980692a0 0x7ff59806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:41.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.875+0000 7ff5ae7fc700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff5980692a0 0x7ff59806b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff5b010ed70 tx=0x7ff5a4009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:41.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:41.879+0000 7ff5977fe700 1 -- 172.21.15.62:0/1915764969 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff5a004e250 con 0x7ff5b00fbd40 2024-05-09T06:26:42.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.079+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff5b0108df0 con 0x7ff5b00fbd40 2024-05-09T06:26:42.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.079+0000 7ff5977fe700 1 -- 172.21.15.62:0/1915764969 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5a0056c10 con 0x7ff5b00fbd40 2024-05-09T06:26:42.062 INFO:teuthology.orchestra.run.smithi062.stdout:171798691852 2024-05-09T06:26:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.081+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff5980692a0 msgr2=0x7ff59806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.081+0000 7ff5b577e700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff5980692a0 0x7ff59806b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff5b010ed70 tx=0x7ff5a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.081+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 msgr2=0x7ff5b0113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.081+0000 7ff5b577e700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 0x7ff5b0113b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000eb40 tx=0x7ff5a000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.082+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 shutdown_connections 2024-05-09T06:26:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.082+0000 7ff5b577e700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff5980692a0 0x7ff59806b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.082+0000 7ff5b577e700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5b00fbd40 0x7ff5b0113b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.082+0000 7ff5b577e700 1 --2- 172.21.15.62:0/1915764969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5b0101d90 0x7ff5b0114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.082+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 >> 172.21.15.62:0/1915764969 conn(0x7ff5b0071d00 msgr2=0x7ff5b00fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:42.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.082+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 shutdown_connections 2024-05-09T06:26:42.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:42.082+0000 7ff5b577e700 1 -- 172.21.15.62:0/1915764969 wait complete. 2024-05-09T06:26:42.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:42 smithi062 ceph-mon[26920]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:42.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:42 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3513804599' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T06:26:42.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:42 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1915764969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T06:26:42.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:42 smithi079 ceph-mon[35268]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:42.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:42 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3513804599' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T06:26:42.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:42 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1915764969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T06:26:42.612 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117012 got 115964117014 for osd.3 2024-05-09T06:26:42.612 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:43.000 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-05-09T06:26:43.001 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 -- 172.21.15.62:0/3439468400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fe800 msgr2=0x7f94e0106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 --2- 172.21.15.62:0/3439468400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fe800 0x7f94e0106e40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94d0004940 tx=0x7f94d0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 -- 172.21.15.62:0/3439468400 shutdown_connections 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 --2- 172.21.15.62:0/3439468400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fe800 0x7f94e0106e40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 --2- 172.21.15.62:0/3439468400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e00fde60 0x7f94e00fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 -- 172.21.15.62:0/3439468400 >> 172.21.15.62:0/3439468400 conn(0x7f94e00f7870 msgr2=0x7f94e00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 -- 172.21.15.62:0/3439468400 shutdown_connections 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 -- 172.21.15.62:0/3439468400 wait complete. 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 Processor -- start 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.200+0000 7f94e83cd700 1 -- start start 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e83cd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fde60 0x7f94e0113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:43.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e83cd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e00fe800 0x7f94e0113e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e83cd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01144b0 con 0x7f94e00fde60 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e83cd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e010dab0 con 0x7f94e00fe800 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e6169700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fde60 0x7f94e0113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e6169700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fde60 0x7f94e0113920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34834/0 (socket says 172.21.15.62:34834) 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e6169700 1 -- 172.21.15.62:0/1943651261 learned_addr learned my addr 172.21.15.62:0/1943651261 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e5968700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e00fe800 0x7f94e0113e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e6169700 1 -- 172.21.15.62:0/1943651261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e00fe800 msgr2=0x7f94e0113e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e6169700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e00fe800 0x7f94e0113e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e6169700 1 -- 172.21.15.62:0/1943651261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0005040 con 0x7f94e00fde60 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e6169700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fde60 0x7f94e0113920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00c8c0 tx=0x7f94dc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94d6ffd700 1 -- 172.21.15.62:0/1943651261 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94dc00a980 con 0x7f94e00fde60 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94d6ffd700 1 -- 172.21.15.62:0/1943651261 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94dc00ce60 con 0x7f94e00fde60 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e010dd90 con 0x7f94e00fde60 2024-05-09T06:26:43.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94d6ffd700 1 -- 172.21.15.62:0/1943651261 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94dc0115e0 con 0x7f94e00fde60 2024-05-09T06:26:43.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.201+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e010e2d0 con 0x7f94e00fde60 2024-05-09T06:26:43.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.202+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e0066ad0 con 0x7f94e00fde60 2024-05-09T06:26:43.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.203+0000 7f94d6ffd700 1 -- 172.21.15.62:0/1943651261 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f94dc012400 con 0x7f94e00fde60 2024-05-09T06:26:43.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.203+0000 7f94d6ffd700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94cc0692a0 0x7f94cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:43.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.203+0000 7f94d6ffd700 1 -- 172.21.15.62:0/1943651261 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f94dc086e60 con 0x7f94e00fde60 2024-05-09T06:26:43.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.203+0000 7f94e5968700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94cc0692a0 0x7f94cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:43.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.204+0000 7f94e5968700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94cc0692a0 0x7f94cc06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94d0000c00 tx=0x7f94d0009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:43.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.208+0000 7f94d6ffd700 1 -- 172.21.15.62:0/1943651261 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f94dc057000 con 0x7f94e00fde60 2024-05-09T06:26:43.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.406+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f94e0109e20 con 0x7f94e00fde60 2024-05-09T06:26:43.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.406+0000 7f94d6ffd700 1 -- 172.21.15.62:0/1943651261 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94dc0126b0 con 0x7f94e00fde60 2024-05-09T06:26:43.389 INFO:teuthology.orchestra.run.smithi062.stdout:150323855377 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.408+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94cc0692a0 msgr2=0x7f94cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.408+0000 7f94e83cd700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94cc0692a0 0x7f94cc06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94d0000c00 tx=0x7f94d0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.408+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fde60 msgr2=0x7f94e0113920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.408+0000 7f94e83cd700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fde60 0x7f94e0113920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00c8c0 tx=0x7f94dc0044c0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.409+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 shutdown_connections 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.409+0000 7f94e83cd700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94cc0692a0 0x7f94cc06b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.409+0000 7f94e83cd700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94e00fde60 0x7f94e0113920 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.409+0000 7f94e83cd700 1 --2- 172.21.15.62:0/1943651261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94e00fe800 0x7f94e0113e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.409+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 >> 172.21.15.62:0/1943651261 conn(0x7f94e00f7870 msgr2=0x7f94e00f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:43.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.409+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 shutdown_connections 2024-05-09T06:26:43.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:43.409+0000 7f94e83cd700 1 -- 172.21.15.62:0/1943651261 wait complete. 2024-05-09T06:26:43.968 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855373 got 150323855377 for osd.4 2024-05-09T06:26:43.969 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:44.330 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:44 smithi062 ceph-mon[26920]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:44.330 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:44 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1943651261' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T06:26:44.330 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:44.356 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705700 for osd.0 2024-05-09T06:26:44.356 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:44.401 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:44 smithi079 ceph-mon[35268]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:44 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1943651261' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T06:26:44.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:44.807 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691849 got 171798691852 for osd.5 2024-05-09T06:26:44.808 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:46.376 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:46 smithi062 ceph-mon[26920]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.422+0000 7f3892bf0700 1 -- 172.21.15.62:0/1883545179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c103790 msgr2=0x7f388c0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.422+0000 7f3892bf0700 1 --2- 172.21.15.62:0/1883545179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c103790 0x7f388c0fce00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3878004940 tx=0x7f3878009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.422+0000 7f3892bf0700 1 -- 172.21.15.62:0/1883545179 shutdown_connections 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.422+0000 7f3892bf0700 1 --2- 172.21.15.62:0/1883545179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c103790 0x7f388c0fce00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.422+0000 7f3892bf0700 1 --2- 172.21.15.62:0/1883545179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f388c102df0 0x7f388c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.422+0000 7f3892bf0700 1 -- 172.21.15.62:0/1883545179 >> 172.21.15.62:0/1883545179 conn(0x7f388c0f8980 msgr2=0x7f388c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.422+0000 7f3892bf0700 1 -- 172.21.15.62:0/1883545179 shutdown_connections 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.422+0000 7f3892bf0700 1 -- 172.21.15.62:0/1883545179 wait complete. 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f3892bf0700 1 Processor -- start 2024-05-09T06:26:46.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f3892bf0700 1 -- start start 2024-05-09T06:26:46.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f3892bf0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c102df0 0x7f388c113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:46.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f3892bf0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f388c103790 0x7f388c114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:46.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f3892bf0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c114750 con 0x7f388c102df0 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f3892bf0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c10dab0 con 0x7f388c103790 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f389098c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c102df0 0x7f388c113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f389098c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c102df0 0x7f388c113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57846/0 (socket says 172.21.15.62:57846) 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.423+0000 7f389098c700 1 -- 172.21.15.62:0/3345692083 learned_addr learned my addr 172.21.15.62:0/3345692083 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f388bfff700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f388c103790 0x7f388c114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f389098c700 1 -- 172.21.15.62:0/3345692083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f388c103790 msgr2=0x7f388c114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f389098c700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f388c103790 0x7f388c114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f389098c700 1 -- 172.21.15.62:0/3345692083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878005040 con 0x7f388c102df0 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f388bfff700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f388c103790 0x7f388c114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f389098c700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c102df0 0x7f388c113b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f388000b790 tx=0x7f3880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f38897fa700 1 -- 172.21.15.62:0/3345692083 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388000f770 con 0x7f388c102df0 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f38897fa700 1 -- 172.21.15.62:0/3345692083 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f388000fda0 con 0x7f388c102df0 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f38897fa700 1 -- 172.21.15.62:0/3345692083 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388000d310 con 0x7f388c102df0 2024-05-09T06:26:46.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c10dd90 con 0x7f388c102df0 2024-05-09T06:26:46.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.424+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c10e350 con 0x7f388c102df0 2024-05-09T06:26:46.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.425+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c100100 con 0x7f388c102df0 2024-05-09T06:26:46.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.426+0000 7f38897fa700 1 -- 172.21.15.62:0/3345692083 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3880010420 con 0x7f388c102df0 2024-05-09T06:26:46.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.426+0000 7f38897fa700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f387c0692a0 0x7f387c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:46.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.427+0000 7f388bfff700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f387c0692a0 0x7f387c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:46.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.427+0000 7f38897fa700 1 -- 172.21.15.62:0/3345692083 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3880086d70 con 0x7f388c102df0 2024-05-09T06:26:46.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.427+0000 7f388bfff700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f387c0692a0 0x7f387c06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f388c10ec70 tx=0x7f3878009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:46.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.431+0000 7f38897fa700 1 -- 172.21.15.62:0/3345692083 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3880056f10 con 0x7f388c102df0 2024-05-09T06:26:46.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:46 smithi079 ceph-mon[35268]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:46.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.626+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f388c10f180 con 0x7f388c102df0 2024-05-09T06:26:46.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.627+0000 7f38897fa700 1 -- 172.21.15.62:0/3345692083 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3880056aa0 con 0x7f388c102df0 2024-05-09T06:26:46.609 INFO:teuthology.orchestra.run.smithi062.stdout:60129542177 2024-05-09T06:26:46.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f387c0692a0 msgr2=0x7f387c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f387c0692a0 0x7f387c06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f388c10ec70 tx=0x7f3878009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c102df0 msgr2=0x7f388c113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c102df0 0x7f388c113b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f388000b790 tx=0x7f3880009250 comp rx=0 tx=0).stop 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 shutdown_connections 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f387c0692a0 0x7f387c06b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f388c102df0 0x7f388c113b30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 --2- 172.21.15.62:0/3345692083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f388c103790 0x7f388c114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 >> 172.21.15.62:0/3345692083 conn(0x7f388c0f8980 msgr2=0x7f388c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 shutdown_connections 2024-05-09T06:26:46.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:46.629+0000 7f3892bf0700 1 -- 172.21.15.62:0/3345692083 wait complete. 2024-05-09T06:26:47.255 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:47 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3345692083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T06:26:47.282 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542175 got 60129542177 for osd.1 2024-05-09T06:26:47.282 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:47.282 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-09T06:26:47.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T06:26:47.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:47 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3345692083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T06:26:47.551 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:48.361 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:48 smithi062 ceph-mon[26920]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:48.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:48 smithi079 ceph-mon[35268]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:49.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.245+0000 7fe604cb0700 1 -- 172.21.15.62:0/3012626441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 msgr2=0x7fe600102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.245+0000 7fe604cb0700 1 --2- 172.21.15.62:0/3012626441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 0x7fe600102160 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0004940 tx=0x7fe5f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.246+0000 7fe604cb0700 1 -- 172.21.15.62:0/3012626441 shutdown_connections 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.246+0000 7fe604cb0700 1 --2- 172.21.15.62:0/3012626441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6000fbd40 0x7fe6000fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.246+0000 7fe604cb0700 1 --2- 172.21.15.62:0/3012626441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 0x7fe600102160 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.246+0000 7fe604cb0700 1 -- 172.21.15.62:0/3012626441 >> 172.21.15.62:0/3012626441 conn(0x7fe600071d00 msgr2=0x7fe600072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.246+0000 7fe604cb0700 1 -- 172.21.15.62:0/3012626441 shutdown_connections 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.246+0000 7fe604cb0700 1 -- 172.21.15.62:0/3012626441 wait complete. 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.246+0000 7fe604cb0700 1 Processor -- start 2024-05-09T06:26:49.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.246+0000 7fe604cb0700 1 -- start start 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe604cb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6000fbd40 0x7fe600102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe604cb0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 0x7fe600103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe604cb0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6001035f0 con 0x7fe600101d90 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe604cb0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600103730 con 0x7fe6000fbd40 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5fdd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 0x7fe600103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5fdd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 0x7fe600103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57858/0 (socket says 172.21.15.62:57858) 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5fdd9b700 1 -- 172.21.15.62:0/2349069264 learned_addr learned my addr 172.21.15.62:0/2349069264 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5fe59c700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6000fbd40 0x7fe600102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5fdd9b700 1 -- 172.21.15.62:0/2349069264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6000fbd40 msgr2=0x7fe600102b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5fdd9b700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6000fbd40 0x7fe600102b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5fdd9b700 1 -- 172.21.15.62:0/2349069264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f0005040 con 0x7fe600101d90 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5fdd9b700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 0x7fe600103060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c8c0 tx=0x7fe5f40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5eeffd700 1 -- 172.21.15.62:0/2349069264 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f400a760 con 0x7fe600101d90 2024-05-09T06:26:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5eeffd700 1 -- 172.21.15.62:0/2349069264 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5f400ad90 con 0x7fe600101d90 2024-05-09T06:26:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.247+0000 7fe5eeffd700 1 -- 172.21.15.62:0/2349069264 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f40113a0 con 0x7fe600101d90 2024-05-09T06:26:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.248+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600119e80 con 0x7fe600101d90 2024-05-09T06:26:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.248+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60011a300 con 0x7fe600101d90 2024-05-09T06:26:49.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.249+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6000fd430 con 0x7fe600101d90 2024-05-09T06:26:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.249+0000 7fe5eeffd700 1 -- 172.21.15.62:0/2349069264 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe5f4012400 con 0x7fe600101d90 2024-05-09T06:26:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.250+0000 7fe5eeffd700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe5e80692b0 0x7fe5e806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.250+0000 7fe5eeffd700 1 -- 172.21.15.62:0/2349069264 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe5f4086df0 con 0x7fe600101d90 2024-05-09T06:26:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.250+0000 7fe5fe59c700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe5e80692b0 0x7fe5e806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:49.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.250+0000 7fe5fe59c700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe5e80692b0 0x7fe5e806b760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000b3b0 tx=0x7fe5f0009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:49.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.258+0000 7fe5eeffd700 1 -- 172.21.15.62:0/2349069264 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe5f4053500 con 0x7fe600101d90 2024-05-09T06:26:49.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.450+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe60004bed0 con 0x7fe5e80692b0 2024-05-09T06:26:49.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.451+0000 7fe5eeffd700 1 -- 172.21.15.62:0/2349069264 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28339 (secure 0 0 0) 0x7fe60004bed0 con 0x7fe5e80692b0 2024-05-09T06:26:49.434 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:26:49.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe5e80692b0 msgr2=0x7fe5e806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:49.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe5e80692b0 0x7fe5e806b760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000b3b0 tx=0x7fe5f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:49.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 msgr2=0x7fe600103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:49.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 0x7fe600103060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c8c0 tx=0x7fe5f40044c0 comp rx=0 tx=0).stop 2024-05-09T06:26:49.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 shutdown_connections 2024-05-09T06:26:49.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe5e80692b0 0x7fe5e806b760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:49.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6000fbd40 0x7fe600102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:49.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 --2- 172.21.15.62:0/2349069264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe600101d90 0x7fe600103060 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:49.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 >> 172.21.15.62:0/2349069264 conn(0x7fe600071d00 msgr2=0x7fe6000655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:49.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 shutdown_connections 2024-05-09T06:26:49.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:49.454+0000 7fe604cb0700 1 -- 172.21.15.62:0/2349069264 wait complete. 2024-05-09T06:26:49.437 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-09T06:26:50.045 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-05-09T06:26:49.077292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788076,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682836,"statfs":{"total":575970213888,"available":574139224064,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001799"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":190,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-09T06:25:56.652163+0000","last_change":"2024-05-09T06:25:31.336848+0000","last_active":"2024-05-09T06:25:56.652163+0000","last_peered":"2024-05-09T06:25:56.652163+0000","last_clean":"2024-05-09T06:25:56.652163+0000","last_became_active":"2024-05-09T06:25:31.336433+0000","last_became_peered":"2024-05-09T06:25:31.336433+0000","last_unstale":"2024-05-09T06:25:56.652163+0000","last_undegraded":"2024-05-09T06:25:56.652163+0000","last_fullsized":"2024-05-09T06:25:56.652163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T06:24:45.600402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T06:24:45.600402+0000","last_clean_scrub_stamp":"2024-05-09T06:24:45.600402+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:14.686298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.748}]},{"osd":2,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298308,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446844,"statfs":{"total":95995035648,"available":95689568256,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu May 9 06:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu May 9 06:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu May 9 06:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu May 9 06:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.312}]},{"osd":3,"last update":"Thu May 9 06:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu May 9 06:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 06:26:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.34200000000000003,"15min":0.33700000000000002},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.224}]},{"osd":2,"last update":"Thu May 9 06:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.247}]},{"osd":3,"last update":"Thu May 9 06:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.432}]},{"osd":4,"last update":"Thu May 9 06:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.25800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu May 9 06:26:44 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38200000000000001,"15min":0.38800000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.373},{"interface":"front","average":{"1min":0.375,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu May 9 06:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T06:26:50.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T06:26:50.239 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:50 smithi062 ceph-mon[26920]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:50.320 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:50.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:50 smithi079 ceph-mon[35268]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:51.401 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:51 smithi062 ceph-mon[26920]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:26:51.495 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:51 smithi079 ceph-mon[35268]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:26:51.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.931+0000 7f40aae0e700 1 -- 172.21.15.62:0/3389707125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 msgr2=0x7f40a40fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:51.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.931+0000 7f40aae0e700 1 --2- 172.21.15.62:0/3389707125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 0x7f40a40fbd20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4090004940 tx=0x7f4090009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.932+0000 7f40aae0e700 1 -- 172.21.15.62:0/3389707125 shutdown_connections 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.932+0000 7f40aae0e700 1 --2- 172.21.15.62:0/3389707125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 0x7f40a40fbd20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.932+0000 7f40aae0e700 1 --2- 172.21.15.62:0/3389707125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a4101d10 0x7f40a41020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.932+0000 7f40aae0e700 1 -- 172.21.15.62:0/3389707125 >> 172.21.15.62:0/3389707125 conn(0x7f40a40f7860 msgr2=0x7f40a40f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.932+0000 7f40aae0e700 1 -- 172.21.15.62:0/3389707125 shutdown_connections 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.932+0000 7f40aae0e700 1 -- 172.21.15.62:0/3389707125 wait complete. 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.932+0000 7f40aae0e700 1 Processor -- start 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.932+0000 7f40aae0e700 1 -- start start 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40aae0e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a4101d10 0x7f40a41128a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40aae0e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 0x7f40a4112de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40aae0e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a4113430 con 0x7f40a41026b0 2024-05-09T06:26:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40aae0e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a410ca30 con 0x7f40a4101d10 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 0x7f40a4112de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 0x7f40a4112de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57870/0 (socket says 172.21.15.62:57870) 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a3fff700 1 -- 172.21.15.62:0/92744483 learned_addr learned my addr 172.21.15.62:0/92744483 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a3fff700 1 -- 172.21.15.62:0/92744483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a4101d10 msgr2=0x7f40a41128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a8baa700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a4101d10 0x7f40a41128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a3fff700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a4101d10 0x7f40a41128a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a3fff700 1 -- 172.21.15.62:0/92744483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090005040 con 0x7f40a41026b0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a3fff700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 0x7f40a4112de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4090009100 tx=0x7f4090009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a17fa700 1 -- 172.21.15.62:0/92744483 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409000e040 con 0x7f40a41026b0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a410ccb0 con 0x7f40a41026b0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a17fa700 1 -- 172.21.15.62:0/92744483 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4090013420 con 0x7f40a41026b0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40a17fa700 1 -- 172.21.15.62:0/92744483 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409001c610 con 0x7f40a41026b0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.933+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a410d270 con 0x7f40a41026b0 2024-05-09T06:26:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.934+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a40fd460 con 0x7f40a41026b0 2024-05-09T06:26:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.935+0000 7f40a17fa700 1 -- 172.21.15.62:0/92744483 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4090013590 con 0x7f40a41026b0 2024-05-09T06:26:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.935+0000 7f40a17fa700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40940692a0 0x7f409406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.936+0000 7f40a17fa700 1 -- 172.21.15.62:0/92744483 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f40900880e0 con 0x7f40a41026b0 2024-05-09T06:26:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.936+0000 7f40a8baa700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40940692a0 0x7f409406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.936+0000 7f40a8baa700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40940692a0 0x7f409406b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4098007fd0 tx=0x7f4098009040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:51.940+0000 7f40a17fa700 1 -- 172.21.15.62:0/92744483 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f40900581e0 con 0x7f40a41026b0 2024-05-09T06:26:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.130+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40a4108df0 con 0x7f40940692a0 2024-05-09T06:26:52.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.131+0000 7f40a17fa700 1 -- 172.21.15.62:0/92744483 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28367 (secure 0 0 0) 0x7f40a4108df0 con 0x7f40940692a0 2024-05-09T06:26:52.114 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.133+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40940692a0 msgr2=0x7f409406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.133+0000 7f40aae0e700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40940692a0 0x7f409406b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4098007fd0 tx=0x7f4098009040 comp rx=0 tx=0).stop 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.133+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 msgr2=0x7f40a4112de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.133+0000 7f40aae0e700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 0x7f40a4112de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4090009100 tx=0x7f4090009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.134+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 shutdown_connections 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.134+0000 7f40aae0e700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40940692a0 0x7f409406b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.134+0000 7f40aae0e700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a4101d10 0x7f40a41128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.134+0000 7f40aae0e700 1 --2- 172.21.15.62:0/92744483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f40a41026b0 0x7f40a4112de0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.134+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 >> 172.21.15.62:0/92744483 conn(0x7f40a40f7860 msgr2=0x7f40a40f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.134+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 shutdown_connections 2024-05-09T06:26:52.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:52.134+0000 7f40aae0e700 1 -- 172.21.15.62:0/92744483 wait complete. 2024-05-09T06:26:52.117 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-05-09T06:26:52.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:52 smithi062 ceph-mon[26920]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:52.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:52 smithi079 ceph-mon[35268]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:52.760 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-05-09T06:26:51.077589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788076,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682836,"statfs":{"total":575970213888,"available":574139224064,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001773"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":190,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-09T06:25:56.652163+0000","last_change":"2024-05-09T06:25:31.336848+0000","last_active":"2024-05-09T06:25:56.652163+0000","last_peered":"2024-05-09T06:25:56.652163+0000","last_clean":"2024-05-09T06:25:56.652163+0000","last_became_active":"2024-05-09T06:25:31.336433+0000","last_became_peered":"2024-05-09T06:25:31.336433+0000","last_unstale":"2024-05-09T06:25:56.652163+0000","last_undegraded":"2024-05-09T06:25:56.652163+0000","last_fullsized":"2024-05-09T06:25:56.652163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T06:24:45.600402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T06:24:45.600402+0000","last_clean_scrub_stamp":"2024-05-09T06:24:45.600402+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:14.686298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.748}]},{"osd":2,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298308,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446844,"statfs":{"total":95995035648,"available":95689568256,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu May 9 06:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu May 9 06:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu May 9 06:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu May 9 06:25:47 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu May 9 06:26:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu May 9 06:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 06:26:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.34200000000000003,"15min":0.33700000000000002},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.373}]},{"osd":2,"last update":"Thu May 9 06:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu May 9 06:26:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.622},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu May 9 06:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.25800000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.251,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu May 9 06:26:44 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38200000000000001,"15min":0.38800000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.373},{"interface":"front","average":{"1min":0.375,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu May 9 06:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu May 9 06:26:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T06:26:52.761 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-09T06:26:52.761 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T06:26:52.761 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-09T06:26:52.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-09T06:26:53.031 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:53.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:53 smithi062 ceph-mon[26920]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:26:53.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:53 smithi079 ceph-mon[35268]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:26:54.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:54 smithi062 ceph-mon[26920]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:54.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:54 smithi079 ceph-mon[35268]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.680+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2990489723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b40fb520 msgr2=0x7f97b40fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.680+0000 7f97bc5f1700 1 --2- 172.21.15.62:0/2990489723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b40fb520 0x7f97b40fb990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f97a4004940 tx=0x7f97a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.681+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2990489723 shutdown_connections 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.681+0000 7f97bc5f1700 1 --2- 172.21.15.62:0/2990489723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b40fb520 0x7f97b40fb990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.681+0000 7f97bc5f1700 1 --2- 172.21.15.62:0/2990489723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b4102f60 0x7f97b4103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.681+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2990489723 >> 172.21.15.62:0/2990489723 conn(0x7f97b40714d0 msgr2=0x7f97b40718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.681+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2990489723 shutdown_connections 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.681+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2990489723 wait complete. 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.681+0000 7f97bc5f1700 1 Processor -- start 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.681+0000 7f97bc5f1700 1 -- start start 2024-05-09T06:26:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97bc5f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b40fb520 0x7f97b40fc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97bc5f1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b4102f60 0x7f97b40fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97bc5f1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40fe650 con 0x7f97b4102f60 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97bc5f1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40fd180 con 0x7f97b40fb520 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97b9b8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b4102f60 0x7f97b40fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97b9b8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b4102f60 0x7f97b40fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54936/0 (socket says 172.21.15.62:54936) 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97b9b8c700 1 -- 172.21.15.62:0/2961623511 learned_addr learned my addr 172.21.15.62:0/2961623511 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97ba38d700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b40fb520 0x7f97b40fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97b9b8c700 1 -- 172.21.15.62:0/2961623511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b40fb520 msgr2=0x7f97b40fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97b9b8c700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b40fb520 0x7f97b40fc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97b9b8c700 1 -- 172.21.15.62:0/2961623511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4005040 con 0x7f97b4102f60 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97b9b8c700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b4102f60 0x7f97b40fcc40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f97a400b3b0 tx=0x7f97a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97aaffd700 1 -- 172.21.15.62:0/2961623511 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a400e040 con 0x7f97b4102f60 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97aaffd700 1 -- 172.21.15.62:0/2961623511 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97a4013420 con 0x7f97b4102f60 2024-05-09T06:26:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b40fd400 con 0x7f97b4102f60 2024-05-09T06:26:54.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97aaffd700 1 -- 172.21.15.62:0/2961623511 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a401c630 con 0x7f97b4102f60 2024-05-09T06:26:54.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.682+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b411a0b0 con 0x7f97b4102f60 2024-05-09T06:26:54.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.683+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b4100250 con 0x7f97b4102f60 2024-05-09T06:26:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.684+0000 7f97aaffd700 1 -- 172.21.15.62:0/2961623511 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f97a4013590 con 0x7f97b4102f60 2024-05-09T06:26:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.684+0000 7f97aaffd700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f97a00692a0 0x7f97a006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.684+0000 7f97aaffd700 1 -- 172.21.15.62:0/2961623511 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f97a4087f50 con 0x7f97b4102f60 2024-05-09T06:26:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.684+0000 7f97ba38d700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f97a00692a0 0x7f97a006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.685+0000 7f97ba38d700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f97a00692a0 0x7f97a006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97b0004f60 tx=0x7f97b000b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:54.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.689+0000 7f97aaffd700 1 -- 172.21.15.62:0/2961623511 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f97a40ba250 con 0x7f97b4102f60 2024-05-09T06:26:54.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.925+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f97b40fe840 con 0x7f97b4102f60 2024-05-09T06:26:54.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.925+0000 7f97aaffd700 1 -- 172.21.15.62:0/2961623511 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f97a4054660 con 0x7f97b4102f60 2024-05-09T06:26:54.907 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:26:54.908 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T06:26:54.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f97a00692a0 msgr2=0x7f97a006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:54.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f97a00692a0 0x7f97a006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97b0004f60 tx=0x7f97b000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:54.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b4102f60 msgr2=0x7f97b40fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:54.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b4102f60 0x7f97b40fcc40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f97a400b3b0 tx=0x7f97a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:54.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 shutdown_connections 2024-05-09T06:26:54.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f97a00692a0 0x7f97a006b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:54.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97b40fb520 0x7f97b40fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:54.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 --2- 172.21.15.62:0/2961623511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97b4102f60 0x7f97b40fcc40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:54.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.927+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 >> 172.21.15.62:0/2961623511 conn(0x7f97b40714d0 msgr2=0x7f97b40fa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:54.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.928+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 shutdown_connections 2024-05-09T06:26:54.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:54.928+0000 7f97bc5f1700 1 -- 172.21.15.62:0/2961623511 wait complete. 2024-05-09T06:26:55.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:55 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2961623511' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T06:26:55.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:55 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2961623511' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T06:26:55.650 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-09T06:26:55.650 INFO:tasks.cephadm:Setup complete, yielding 2024-05-09T06:26:55.650 INFO:teuthology.run_tasks:Running task print... 2024-05-09T06:26:55.659 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-05-09T06:26:55.659 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:26:55.672 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:26:55.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-05-09T06:26:55.941 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:56.393 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:56 smithi062 ceph-mon[26920]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:56.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:56 smithi079 ceph-mon[35268]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.537+0000 7f4173c7e700 1 -- 172.21.15.62:0/3890357934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fcf60 msgr2=0x7f416c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.537+0000 7f4173c7e700 1 --2- 172.21.15.62:0/3890357934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fcf60 0x7f416c0fd3d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4160004940 tx=0x7f4160009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.537+0000 7f4173c7e700 1 -- 172.21.15.62:0/3890357934 shutdown_connections 2024-05-09T06:26:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.537+0000 7f4173c7e700 1 --2- 172.21.15.62:0/3890357934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fcf60 0x7f416c0fd3d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.537+0000 7f4173c7e700 1 --2- 172.21.15.62:0/3890357934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0fbcb0 0x7f416c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.537+0000 7f4173c7e700 1 -- 172.21.15.62:0/3890357934 >> 172.21.15.62:0/3890357934 conn(0x7f416c0f7430 msgr2=0x7f416c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.537+0000 7f4173c7e700 1 -- 172.21.15.62:0/3890357934 shutdown_connections 2024-05-09T06:26:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.537+0000 7f4173c7e700 1 -- 172.21.15.62:0/3890357934 wait complete. 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4173c7e700 1 Processor -- start 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4173c7e700 1 -- start start 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4173c7e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fbcb0 0x7f416c10c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4173c7e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0fcf60 0x7f416c10cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4173c7e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c10d3e0 con 0x7f416c0fbcb0 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4173c7e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c10dc30 con 0x7f416c0fcf60 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4171a1a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fbcb0 0x7f416c10c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4171a1a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fbcb0 0x7f416c10c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54960/0 (socket says 172.21.15.62:54960) 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.538+0000 7f4171a1a700 1 -- 172.21.15.62:0/1900172035 learned_addr learned my addr 172.21.15.62:0/1900172035 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f4171219700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0fcf60 0x7f416c10cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f4171a1a700 1 -- 172.21.15.62:0/1900172035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0fcf60 msgr2=0x7f416c10cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f4171a1a700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0fcf60 0x7f416c10cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f4171a1a700 1 -- 172.21.15.62:0/1900172035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160005040 con 0x7f416c0fbcb0 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f4171219700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0fcf60 0x7f416c10cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:26:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f4171a1a700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fbcb0 0x7f416c10c8a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f416800eb40 tx=0x7f416800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f415e7fc700 1 -- 172.21.15.62:0/1900172035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4168007cc0 con 0x7f416c0fbcb0 2024-05-09T06:26:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c10deb0 con 0x7f416c0fbcb0 2024-05-09T06:26:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f415e7fc700 1 -- 172.21.15.62:0/1900172035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f416800f040 con 0x7f416c0fbcb0 2024-05-09T06:26:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f415e7fc700 1 -- 172.21.15.62:0/1900172035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4168009620 con 0x7f416c0fbcb0 2024-05-09T06:26:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.539+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416c10e3f0 con 0x7f416c0fbcb0 2024-05-09T06:26:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.540+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416c05f5c0 con 0x7f416c0fbcb0 2024-05-09T06:26:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.541+0000 7f415e7fc700 1 -- 172.21.15.62:0/1900172035 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4168009780 con 0x7f416c0fbcb0 2024-05-09T06:26:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.541+0000 7f415e7fc700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f41580692a0 0x7f415806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.541+0000 7f415e7fc700 1 -- 172.21.15.62:0/1900172035 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4168086ad0 con 0x7f416c0fbcb0 2024-05-09T06:26:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.541+0000 7f4171219700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f41580692a0 0x7f415806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.541+0000 7f4171219700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f41580692a0 0x7f415806b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4160009b30 tx=0x7f4160009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.545+0000 7f415e7fc700 1 -- 172.21.15.62:0/1900172035 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f416804e250 con 0x7f416c0fbcb0 2024-05-09T06:26:57.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.743+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f416c04bed0 con 0x7f416c0fbcb0 2024-05-09T06:26:57.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.748+0000 7f415e7fc700 1 -- 172.21.15.62:0/1900172035 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f4168056c00 con 0x7f416c0fbcb0 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f41580692a0 msgr2=0x7f415806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f41580692a0 0x7f415806b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4160009b30 tx=0x7f4160009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fbcb0 msgr2=0x7f416c10c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fbcb0 0x7f416c10c8a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f416800eb40 tx=0x7f416800b040 comp rx=0 tx=0).stop 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 shutdown_connections 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f41580692a0 0x7f415806b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416c0fbcb0 0x7f416c10c8a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 --2- 172.21.15.62:0/1900172035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0fcf60 0x7f416c10cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 >> 172.21.15.62:0/1900172035 conn(0x7f416c0f7430 msgr2=0x7f416c0f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 shutdown_connections 2024-05-09T06:26:57.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:26:57.750+0000 7f4173c7e700 1 -- 172.21.15.62:0/1900172035 wait complete. 2024-05-09T06:26:58.303 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:58 smithi062 ceph-mon[26920]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:58.303 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:58 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1900172035' entity='client.admin' 2024-05-09T06:26:58.303 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:58 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:26:58.327 INFO:teuthology.run_tasks:Running task print... 2024-05-09T06:26:58.340 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-05-09T06:26:58.340 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:26:58.357 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:26:58.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-09T06:26:58.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:58 smithi079 ceph-mon[35268]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:58.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:58 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1900172035' entity='client.admin' 2024-05-09T06:26:58.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:58 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:26:58.633 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:26:59.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:26:59.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:26:59.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:26:59.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:26:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:59.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:26:59.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:26:59.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:26:59.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:26:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:00.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.219+0000 7f9c591f3700 1 -- 172.21.15.62:0/4155228168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 msgr2=0x7f9c540fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:00.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.219+0000 7f9c591f3700 1 --2- 172.21.15.62:0/4155228168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 0x7f9c540fd3d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9c48004940 tx=0x7f9c48009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:00.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.220+0000 7f9c591f3700 1 -- 172.21.15.62:0/4155228168 shutdown_connections 2024-05-09T06:27:00.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.220+0000 7f9c591f3700 1 --2- 172.21.15.62:0/4155228168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 0x7f9c540fd3d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:00.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.220+0000 7f9c591f3700 1 --2- 172.21.15.62:0/4155228168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c540fbcb0 0x7f9c540fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:00.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.220+0000 7f9c591f3700 1 -- 172.21.15.62:0/4155228168 >> 172.21.15.62:0/4155228168 conn(0x7f9c540f7430 msgr2=0x7f9c540f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:00.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.220+0000 7f9c591f3700 1 -- 172.21.15.62:0/4155228168 shutdown_connections 2024-05-09T06:27:00.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.220+0000 7f9c591f3700 1 -- 172.21.15.62:0/4155228168 wait complete. 2024-05-09T06:27:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.220+0000 7f9c591f3700 1 Processor -- start 2024-05-09T06:27:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c591f3700 1 -- start start 2024-05-09T06:27:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c591f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c540fbcb0 0x7f9c541106f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c591f3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 0x7f9c54112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:00.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c591f3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540663e0 con 0x7f9c540fcf60 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c591f3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54066520 con 0x7f9c540fbcb0 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c5259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 0x7f9c54112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c5259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 0x7f9c54112c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54980/0 (socket says 172.21.15.62:54980) 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c5259c700 1 -- 172.21.15.62:0/4113636565 learned_addr learned my addr 172.21.15.62:0/4113636565 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c52d9d700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c540fbcb0 0x7f9c541106f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c5259c700 1 -- 172.21.15.62:0/4113636565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c540fbcb0 msgr2=0x7f9c541106f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c5259c700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c540fbcb0 0x7f9c541106f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c5259c700 1 -- 172.21.15.62:0/4113636565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48005040 con 0x7f9c540fcf60 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c5259c700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 0x7f9c54112c40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009180 tx=0x7f9c48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.221+0000 7f9c3b7fe700 1 -- 172.21.15.62:0/4113636565 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4800e040 con 0x7f9c540fcf60 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.222+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c54113240 con 0x7f9c540fcf60 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.222+0000 7f9c3b7fe700 1 -- 172.21.15.62:0/4113636565 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c4800bcc0 con 0x7f9c540fcf60 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.222+0000 7f9c3b7fe700 1 -- 172.21.15.62:0/4113636565 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4801c630 con 0x7f9c540fcf60 2024-05-09T06:27:00.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.222+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c54113800 con 0x7f9c540fcf60 2024-05-09T06:27:00.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.223+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5405f5c0 con 0x7f9c540fcf60 2024-05-09T06:27:00.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.223+0000 7f9c3b7fe700 1 -- 172.21.15.62:0/4113636565 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9c48013420 con 0x7f9c540fcf60 2024-05-09T06:27:00.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.223+0000 7f9c3b7fe700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9c3c0692a0 0x7f9c3c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:00.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.224+0000 7f9c3b7fe700 1 -- 172.21.15.62:0/4113636565 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9c48087b90 con 0x7f9c540fcf60 2024-05-09T06:27:00.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.224+0000 7f9c52d9d700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9c3c0692a0 0x7f9c3c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:00.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.224+0000 7f9c52d9d700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9c3c0692a0 0x7f9c3c06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c54065fd0 tx=0x7f9c440091a0 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:00.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.228+0000 7f9c3b7fe700 1 -- 172.21.15.62:0/4113636565 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9c48054200 con 0x7f9c540fcf60 2024-05-09T06:27:00.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:00 smithi062 ceph-mon[26920]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:00.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.441+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c54101200 con 0x7f9c3c0692a0 2024-05-09T06:27:00.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.443+0000 7f9c3b7fe700 1 -- 172.21.15.62:0/4113636565 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9c54101200 con 0x7f9c3c0692a0 2024-05-09T06:27:00.425 INFO:teuthology.orchestra.run.smithi062.stdout:Backend: cephadm 2024-05-09T06:27:00.425 INFO:teuthology.orchestra.run.smithi062.stdout:Available: Yes 2024-05-09T06:27:00.425 INFO:teuthology.orchestra.run.smithi062.stdout:Paused: No 2024-05-09T06:27:00.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9c3c0692a0 msgr2=0x7f9c3c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:00.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9c3c0692a0 0x7f9c3c06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c54065fd0 tx=0x7f9c440091a0 comp rx=0 tx=0).stop 2024-05-09T06:27:00.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 msgr2=0x7f9c54112c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:00.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 0x7f9c54112c40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009180 tx=0x7f9c48009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:00.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 shutdown_connections 2024-05-09T06:27:00.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9c3c0692a0 0x7f9c3c06b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:00.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c540fbcb0 0x7f9c541106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:00.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 --2- 172.21.15.62:0/4113636565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c540fcf60 0x7f9c54112c40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:00.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 >> 172.21.15.62:0/4113636565 conn(0x7f9c540f7430 msgr2=0x7f9c540f8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:00.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 shutdown_connections 2024-05-09T06:27:00.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:00.445+0000 7f9c591f3700 1 -- 172.21.15.62:0/4113636565 wait complete. 2024-05-09T06:27:00.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:00 smithi079 ceph-mon[35268]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:01.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-09T06:27:01.314 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:02.463 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:02 smithi062 ceph-mon[26920]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:02.781 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:02 smithi062 ceph-mon[26920]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:02.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:02 smithi079 ceph-mon[35268]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:02.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:02 smithi079 ceph-mon[35268]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.005+0000 7f0c75ebd700 1 -- 172.21.15.62:0/2091619239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 msgr2=0x7f0c700fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.005+0000 7f0c75ebd700 1 --2- 172.21.15.62:0/2091619239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 0x7f0c700fd270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c60004940 tx=0x7f0c60009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.005+0000 7f0c75ebd700 1 -- 172.21.15.62:0/2091619239 shutdown_connections 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.005+0000 7f0c75ebd700 1 --2- 172.21.15.62:0/2091619239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c700fdfd0 0x7f0c700fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.005+0000 7f0c75ebd700 1 --2- 172.21.15.62:0/2091619239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 0x7f0c700fd270 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.005+0000 7f0c75ebd700 1 -- 172.21.15.62:0/2091619239 >> 172.21.15.62:0/2091619239 conn(0x7f0c700f8540 msgr2=0x7f0c700fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.005+0000 7f0c75ebd700 1 -- 172.21.15.62:0/2091619239 shutdown_connections 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.005+0000 7f0c75ebd700 1 -- 172.21.15.62:0/2091619239 wait complete. 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c75ebd700 1 Processor -- start 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c75ebd700 1 -- start start 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c75ebd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 0x7f0c70071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c75ebd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c700fdfd0 0x7f0c700702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c75ebd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70072200 con 0x7f0c700fce60 2024-05-09T06:27:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c75ebd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700707f0 con 0x7f0c700fdfd0 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c6f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 0x7f0c70071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c6f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 0x7f0c70071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54988/0 (socket says 172.21.15.62:54988) 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.006+0000 7f0c6f7fe700 1 -- 172.21.15.62:0/3564490808 learned_addr learned my addr 172.21.15.62:0/3564490808 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c6effd700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c700fdfd0 0x7f0c700702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c6f7fe700 1 -- 172.21.15.62:0/3564490808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c700fdfd0 msgr2=0x7f0c700702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c6f7fe700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c700fdfd0 0x7f0c700702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c6f7fe700 1 -- 172.21.15.62:0/3564490808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60005040 con 0x7f0c700fce60 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c6f7fe700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 0x7f0c70071c00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000b3b0 tx=0x7f0c60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c57fff700 1 -- 172.21.15.62:0/3564490808 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c6000e040 con 0x7f0c700fce60 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c70070a40 con 0x7f0c700fce60 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c57fff700 1 -- 172.21.15.62:0/3564490808 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c6000bcc0 con 0x7f0c700fce60 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c57fff700 1 -- 172.21.15.62:0/3564490808 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c6001c630 con 0x7f0c700fce60 2024-05-09T06:27:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.007+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c70071000 con 0x7f0c700fce60 2024-05-09T06:27:02.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.008+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7004c710 con 0x7f0c700fce60 2024-05-09T06:27:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.009+0000 7f0c57fff700 1 -- 172.21.15.62:0/3564490808 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0c60013980 con 0x7f0c700fce60 2024-05-09T06:27:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.009+0000 7f0c57fff700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c580692a0 0x7f0c5806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.009+0000 7f0c57fff700 1 -- 172.21.15.62:0/3564490808 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0c60087c80 con 0x7f0c700fce60 2024-05-09T06:27:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.009+0000 7f0c6effd700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c580692a0 0x7f0c5806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:02.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.010+0000 7f0c6effd700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c580692a0 0x7f0c5806b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c64007fd0 tx=0x7f0c64009040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:02.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.014+0000 7f0c57fff700 1 -- 172.21.15.62:0/3564490808 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0c60057d00 con 0x7f0c700fce60 2024-05-09T06:27:03.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.219+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c70102360 con 0x7f0c580692a0 2024-05-09T06:27:03.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.227+0000 7f0c57fff700 1 -- 172.21.15.62:0/3564490808 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f0c70102360 con 0x7f0c580692a0 2024-05-09T06:27:03.209 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:27:03.209 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (3m) 2m ago 5m 25.8M - 0.25.0 c8568f914cd2 b9c4737eec20 2024-05-09T06:27:03.209 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (5m) 2m ago 5m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:27:03.209 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (4m) 68s ago 4m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:27:03.209 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (3m) 2m ago 5m 78.3M - 9.4.7 954c08fa6188 06a19fe449ea 2024-05-09T06:27:03.209 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:9283 running (7m) 2m ago 7m 470M - 17.2.7-933-g4ba5a836 b96134859c76 f1bb37d51b2f 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283 running (4m) 68s ago 4m 432M - 17.2.7-933-g4ba5a836 b96134859c76 fb4cbe68939f 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (7m) 2m ago 7m 43.2M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (4m) 68s ago 4m 38.9M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (5m) 2m ago 5m 16.4M - 1.5.0 0da6a335fe13 a2eb68715549 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (4m) 68s ago 4m 16.2M - 1.5.0 0da6a335fe13 9d423500267f 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (3m) 2m ago 3m 36.0M 4288M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (2m) 2m ago 2m 38.1M 4288M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (2m) 2m ago 2m 13.3M 4288M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (2m) 68s ago 2m 38.8M 5312M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (98s) 68s ago 98s 37.1M 5312M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (73s) 68s ago 73s 11.0M 5312M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:27:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (3m) 2m ago 4m 39.9M - 2.43.0 a07b618ecd1d c90458655289 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c580692a0 msgr2=0x7f0c5806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c580692a0 0x7f0c5806b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c64007fd0 tx=0x7f0c64009040 comp rx=0 tx=0).stop 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 msgr2=0x7f0c70071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 0x7f0c70071c00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000b3b0 tx=0x7f0c60009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 shutdown_connections 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c580692a0 0x7f0c5806b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c700fce60 0x7f0c70071c00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 --2- 172.21.15.62:0/3564490808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c700fdfd0 0x7f0c700702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.229+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 >> 172.21.15.62:0/3564490808 conn(0x7f0c700f8540 msgr2=0x7f0c700f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.230+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 shutdown_connections 2024-05-09T06:27:03.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:03.230+0000 7f0c75ebd700 1 -- 172.21.15.62:0/3564490808 wait complete. 2024-05-09T06:27:03.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-09T06:27:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:04.348 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:04 smithi062 ceph-mon[26920]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:04.349 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:04 smithi062 ceph-mon[26920]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:04.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:04 smithi079 ceph-mon[35268]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:04.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:04 smithi079 ceph-mon[35268]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.601+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3480323290 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fbcc0 msgr2=0x7fb0040fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.601+0000 7fb00a1b3700 1 --2- 172.21.15.62:0/3480323290 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fbcc0 0x7fb0040fc0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faff4004940 tx=0x7faff4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.601+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3480323290 shutdown_connections 2024-05-09T06:27:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.601+0000 7fb00a1b3700 1 --2- 172.21.15.62:0/3480323290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0040fcf70 0x7fb0040fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.601+0000 7fb00a1b3700 1 --2- 172.21.15.62:0/3480323290 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fbcc0 0x7fb0040fc0d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.601+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3480323290 >> 172.21.15.62:0/3480323290 conn(0x7fb0040f7440 msgr2=0x7fb0040f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.601+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3480323290 shutdown_connections 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.601+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3480323290 wait complete. 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb00a1b3700 1 Processor -- start 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb00a1b3700 1 -- start start 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb00a1b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0040fbcc0 0x7fb00410c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb00a1b3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fcf70 0x7fb00410cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb00a1b3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00410d3f0 con 0x7fb0040fcf70 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb00a1b3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00410d560 con 0x7fb0040fbcc0 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb002ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fcf70 0x7fb00410cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb002ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fcf70 0x7fb00410cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34556/0 (socket says 172.21.15.62:34556) 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb002ffd700 1 -- 172.21.15.62:0/3851818819 learned_addr learned my addr 172.21.15.62:0/3851818819 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.602+0000 7fb0037fe700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0040fbcc0 0x7fb00410c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7fb002ffd700 1 -- 172.21.15.62:0/3851818819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0040fbcc0 msgr2=0x7fb00410c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7fb002ffd700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0040fbcc0 0x7fb00410c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7fb002ffd700 1 -- 172.21.15.62:0/3851818819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff4005040 con 0x7fb0040fcf70 2024-05-09T06:27:05.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7fb002ffd700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fcf70 0x7fb00410cdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fafec00c830 tx=0x7fafec004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:05.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7faffbfff700 1 -- 172.21.15.62:0/3851818819 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafec0106f0 con 0x7fb0040fcf70 2024-05-09T06:27:05.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7faffbfff700 1 -- 172.21.15.62:0/3851818819 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafec010d20 con 0x7fb0040fcf70 2024-05-09T06:27:05.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb004111fc0 con 0x7fb0040fcf70 2024-05-09T06:27:05.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7faffbfff700 1 -- 172.21.15.62:0/3851818819 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafec0113a0 con 0x7fb0040fcf70 2024-05-09T06:27:05.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.603+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb004112550 con 0x7fb0040fcf70 2024-05-09T06:27:05.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.604+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00404c710 con 0x7fb0040fcf70 2024-05-09T06:27:05.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.605+0000 7faffbfff700 1 -- 172.21.15.62:0/3851818819 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fafec012400 con 0x7fb0040fcf70 2024-05-09T06:27:05.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.605+0000 7faffbfff700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7faff00692a0 0x7faff006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:05.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.605+0000 7faffbfff700 1 -- 172.21.15.62:0/3851818819 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fafec086e20 con 0x7fb0040fcf70 2024-05-09T06:27:05.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.605+0000 7fb0037fe700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7faff00692a0 0x7faff006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:05.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.606+0000 7fb0037fe700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7faff00692a0 0x7faff006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faff400b3b0 tx=0x7faff4009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:05.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.609+0000 7faffbfff700 1 -- 172.21.15.62:0/3851818819 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fafec056f20 con 0x7fb0040fcf70 2024-05-09T06:27:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.811+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0041012d0 con 0x7faff00692a0 2024-05-09T06:27:05.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.815+0000 7faffbfff700 1 -- 172.21.15.62:0/3851818819 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7fb0041012d0 con 0x7faff00692a0 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:crash 2/2 2m ago 6m * 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:mgr 2/2 2m ago 6m count:2 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:mon 2/2 2m ago 5m smithi062:172.21.15.62=smithi062;smithi079:172.21.15.79=smithi079;count:2 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:osd 6 2m ago - 2024-05-09T06:27:05.798 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7faff00692a0 msgr2=0x7faff006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7faff00692a0 0x7faff006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faff400b3b0 tx=0x7faff4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fcf70 msgr2=0x7fb00410cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fcf70 0x7fb00410cdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fafec00c830 tx=0x7fafec004470 comp rx=0 tx=0).stop 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 shutdown_connections 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7faff00692a0 0x7faff006b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0040fbcc0 0x7fb00410c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 --2- 172.21.15.62:0/3851818819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0040fcf70 0x7fb00410cdf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.817+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 >> 172.21.15.62:0/3851818819 conn(0x7fb0040f7440 msgr2=0x7fb0040f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.818+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 shutdown_connections 2024-05-09T06:27:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:05.818+0000 7fb00a1b3700 1 -- 172.21.15.62:0/3851818819 wait complete. 2024-05-09T06:27:06.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:06 smithi062 ceph-mon[26920]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:06.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-09T06:27:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:06 smithi079 ceph-mon[35268]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:06.697 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:07.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:07 smithi079 ceph-mon[35268]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:07.665 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:07 smithi062 ceph-mon[26920]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.306+0000 7f1ba21fa700 1 -- 172.21.15.62:0/2044192170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 msgr2=0x7f1b9c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.306+0000 7f1ba21fa700 1 --2- 172.21.15.62:0/2044192170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 0x7f1b9c070350 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c004940 tx=0x7f1b8c009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.306+0000 7f1ba21fa700 1 -- 172.21.15.62:0/2044192170 shutdown_connections 2024-05-09T06:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.306+0000 7f1ba21fa700 1 --2- 172.21.15.62:0/2044192170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9c070890 0x7f1b9c070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.306+0000 7f1ba21fa700 1 --2- 172.21.15.62:0/2044192170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 0x7f1b9c070350 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.306+0000 7f1ba21fa700 1 -- 172.21.15.62:0/2044192170 >> 172.21.15.62:0/2044192170 conn(0x7f1b9c0f8540 msgr2=0x7f1b9c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.306+0000 7f1ba21fa700 1 -- 172.21.15.62:0/2044192170 shutdown_connections 2024-05-09T06:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.306+0000 7f1ba21fa700 1 -- 172.21.15.62:0/2044192170 wait complete. 2024-05-09T06:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.307+0000 7f1ba21fa700 1 Processor -- start 2024-05-09T06:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.307+0000 7f1ba21fa700 1 -- start start 2024-05-09T06:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.307+0000 7f1ba21fa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9c070890 0x7f1b9c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.307+0000 7f1ba21fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 0x7f1b9c1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1ba21fa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c114b30 con 0x7f1b9c071e40 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1ba21fa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c1194d0 con 0x7f1b9c070890 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b9affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 0x7f1b9c1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b9affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 0x7f1b9c1144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34586/0 (socket says 172.21.15.62:34586) 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b9affd700 1 -- 172.21.15.62:0/3619285005 learned_addr learned my addr 172.21.15.62:0/3619285005 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b9b7fe700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9c070890 0x7f1b9c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b9affd700 1 -- 172.21.15.62:0/3619285005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9c070890 msgr2=0x7f1b9c113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b9affd700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9c070890 0x7f1b9c113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b9affd700 1 -- 172.21.15.62:0/3619285005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c005040 con 0x7f1b9c071e40 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b9affd700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 0x7f1b9c1144a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000b790 tx=0x7f1b90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b83fff700 1 -- 172.21.15.62:0/3619285005 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9000f6f0 con 0x7f1b9c071e40 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b83fff700 1 -- 172.21.15.62:0/3619285005 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b9000fd20 con 0x7f1b9c071e40 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c119730 con 0x7f1b9c071e40 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1b83fff700 1 -- 172.21.15.62:0/3619285005 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b900103a0 con 0x7f1b9c071e40 2024-05-09T06:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.308+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c119ca0 con 0x7f1b9c071e40 2024-05-09T06:27:08.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.309+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c04c710 con 0x7f1b9c071e40 2024-05-09T06:27:08.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.310+0000 7f1b83fff700 1 -- 172.21.15.62:0/3619285005 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1b90011400 con 0x7f1b9c071e40 2024-05-09T06:27:08.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.310+0000 7f1b83fff700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b840692a0 0x7f1b8406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:08.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.310+0000 7f1b83fff700 1 -- 172.21.15.62:0/3619285005 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1b90086c40 con 0x7f1b9c071e40 2024-05-09T06:27:08.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.310+0000 7f1b9b7fe700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b840692a0 0x7f1b8406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:08.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.311+0000 7f1b9b7fe700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b840692a0 0x7f1b8406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c004890 tx=0x7f1b8c009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.315+0000 7f1b83fff700 1 -- 172.21.15.62:0/3619285005 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1b90056d40 con 0x7f1b9c071e40 2024-05-09T06:27:08.368 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:08 smithi062 ceph-mon[26920]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:08.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.519+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b9c0ff980 con 0x7f1b840692a0 2024-05-09T06:27:08.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.521+0000 7f1b83fff700 1 -- 172.21.15.62:0/3619285005 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7f1b9c0ff980 con 0x7f1b840692a0 2024-05-09T06:27:08.503 INFO:teuthology.orchestra.run.smithi062.stdout:HOST ADDR LABELS STATUS 2024-05-09T06:27:08.503 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062 172.21.15.62 2024-05-09T06:27:08.503 INFO:teuthology.orchestra.run.smithi062.stdout:smithi079 172.21.15.79 2024-05-09T06:27:08.503 INFO:teuthology.orchestra.run.smithi062.stdout:2 hosts in cluster 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b840692a0 msgr2=0x7f1b8406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b840692a0 0x7f1b8406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c004890 tx=0x7f1b8c009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 msgr2=0x7f1b9c1144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 0x7f1b9c1144a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000b790 tx=0x7f1b90009250 comp rx=0 tx=0).stop 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 shutdown_connections 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b840692a0 0x7f1b8406b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b9c070890 0x7f1b9c113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 --2- 172.21.15.62:0/3619285005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b9c071e40 0x7f1b9c1144a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 >> 172.21.15.62:0/3619285005 conn(0x7f1b9c0f8540 msgr2=0x7f1b9c0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:08.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 shutdown_connections 2024-05-09T06:27:08.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:08.523+0000 7f1ba21fa700 1 -- 172.21.15.62:0/3619285005 wait complete. 2024-05-09T06:27:08.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:08 smithi079 ceph-mon[35268]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:09.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-09T06:27:09.365 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:10.443 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:10 smithi062 ceph-mon[26920]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:10.443 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:10 smithi062 ceph-mon[26920]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:10.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:10 smithi079 ceph-mon[35268]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:10.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:10 smithi079 ceph-mon[35268]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:10.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.971+0000 7f33a5545700 1 -- 172.21.15.62:0/227815856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 msgr2=0x7f33a00fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.971+0000 7f33a5545700 1 --2- 172.21.15.62:0/227815856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 0x7f33a00fae70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3388004940 tx=0x7f3388009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.971+0000 7f33a5545700 1 -- 172.21.15.62:0/227815856 shutdown_connections 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.971+0000 7f33a5545700 1 --2- 172.21.15.62:0/227815856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 0x7f33a00fae70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.971+0000 7f33a5545700 1 --2- 172.21.15.62:0/227815856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a00fe3e0 0x7f33a00fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.971+0000 7f33a5545700 1 -- 172.21.15.62:0/227815856 >> 172.21.15.62:0/227815856 conn(0x7f33a00f6b80 msgr2=0x7f33a00f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.971+0000 7f33a5545700 1 -- 172.21.15.62:0/227815856 shutdown_connections 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.971+0000 7f33a5545700 1 -- 172.21.15.62:0/227815856 wait complete. 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33a5545700 1 Processor -- start 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33a5545700 1 -- start start 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33a5545700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a00fe3e0 0x7f33a010d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33a5545700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 0x7f33a010df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33a5545700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a010e500 con 0x7f33a00fed30 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33a5545700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a010ed50 con 0x7f33a00fe3e0 2024-05-09T06:27:10.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33967fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 0x7f33a010df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:10.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33967fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 0x7f33a010df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34616/0 (socket says 172.21.15.62:34616) 2024-05-09T06:27:10.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.972+0000 7f33967fc700 1 -- 172.21.15.62:0/1113281236 learned_addr learned my addr 172.21.15.62:0/1113281236 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f339effd700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a00fe3e0 0x7f33a010d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f33967fc700 1 -- 172.21.15.62:0/1113281236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a00fe3e0 msgr2=0x7f33a010d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f33967fc700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a00fe3e0 0x7f33a010d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f33967fc700 1 -- 172.21.15.62:0/1113281236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388005040 con 0x7f33a00fed30 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f33967fc700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 0x7f33a010df00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f338800b3b0 tx=0x7f3388009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f3397fff700 1 -- 172.21.15.62:0/1113281236 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338800e040 con 0x7f33a00fed30 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f3397fff700 1 -- 172.21.15.62:0/1113281236 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3388004290 con 0x7f33a00fed30 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f3397fff700 1 -- 172.21.15.62:0/1113281236 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338801c630 con 0x7f33a00fed30 2024-05-09T06:27:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a010efd0 con 0x7f33a00fed30 2024-05-09T06:27:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.973+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a010f510 con 0x7f33a00fed30 2024-05-09T06:27:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.974+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a005f5c0 con 0x7f33a00fed30 2024-05-09T06:27:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.975+0000 7f3397fff700 1 -- 172.21.15.62:0/1113281236 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f338800bbf0 con 0x7f33a00fed30 2024-05-09T06:27:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.975+0000 7f3397fff700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f338c0692b0 0x7f338c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.975+0000 7f339effd700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f338c0692b0 0x7f338c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:10.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.975+0000 7f3397fff700 1 -- 172.21.15.62:0/1113281236 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f33880882b0 con 0x7f33a00fed30 2024-05-09T06:27:10.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.976+0000 7f339effd700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f338c0692b0 0x7f338c06b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3390007fd0 tx=0x7f3390009040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:10.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:10.980+0000 7f3397fff700 1 -- 172.21.15.62:0/1113281236 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f33880583b0 con 0x7f33a00fed30 2024-05-09T06:27:11.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.184+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f33a010f840 con 0x7f338c0692b0 2024-05-09T06:27:11.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.185+0000 7f3397fff700 1 -- 172.21.15.62:0/1113281236 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f33a010f840 con 0x7f338c0692b0 2024-05-09T06:27:11.167 INFO:teuthology.orchestra.run.smithi062.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-09T06:27:11.167 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440094400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-05-09T06:27:11.167 INFO:teuthology.orchestra.run.smithi062.stdout:smithi079 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013G400BGN 372G No 73s ago Has a FileSystem, LVM detected 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f338c0692b0 msgr2=0x7f338c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f338c0692b0 0x7f338c06b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3390007fd0 tx=0x7f3390009040 comp rx=0 tx=0).stop 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 msgr2=0x7f33a010df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 0x7f33a010df00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f338800b3b0 tx=0x7f3388009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 shutdown_connections 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f338c0692b0 0x7f338c06b760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a00fe3e0 0x7f33a010d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 --2- 172.21.15.62:0/1113281236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33a00fed30 0x7f33a010df00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.187+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 >> 172.21.15.62:0/1113281236 conn(0x7f33a00f6b80 msgr2=0x7f33a00f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:11.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.188+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 shutdown_connections 2024-05-09T06:27:11.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:11.188+0000 7f33a5545700 1 -- 172.21.15.62:0/1113281236 wait complete. 2024-05-09T06:27:11.827 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:11.836 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:27:11.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-05-09T06:27:12.110 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:12.561 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:12 smithi062 ceph-mon[26920]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:12.561 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:12 smithi062 ceph-mon[26920]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:12 smithi079 ceph-mon[35268]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:12 smithi079 ceph-mon[35268]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.691+0000 7f1c27430700 1 -- 172.21.15.62:0/1139904000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 msgr2=0x7f1c200fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.691+0000 7f1c27430700 1 --2- 172.21.15.62:0/1139904000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 0x7f1c200fe460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009ce0 tx=0x7f1c1c004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.691+0000 7f1c27430700 1 -- 172.21.15.62:0/1139904000 shutdown_connections 2024-05-09T06:27:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.691+0000 7f1c27430700 1 --2- 172.21.15.62:0/1139904000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 0x7f1c200fe460 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.691+0000 7f1c27430700 1 --2- 172.21.15.62:0/1139904000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c200fce80 0x7f1c200fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.691+0000 7f1c27430700 1 -- 172.21.15.62:0/1139904000 >> 172.21.15.62:0/1139904000 conn(0x7f1c200f8580 msgr2=0x7f1c200fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.691+0000 7f1c27430700 1 -- 172.21.15.62:0/1139904000 shutdown_connections 2024-05-09T06:27:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.691+0000 7f1c27430700 1 -- 172.21.15.62:0/1139904000 wait complete. 2024-05-09T06:27:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c27430700 1 Processor -- start 2024-05-09T06:27:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c27430700 1 -- start start 2024-05-09T06:27:13.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c27430700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c200fce80 0x7f1c2010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:13.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c27430700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 0x7f1c2010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:13.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c27430700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2010e5c0 con 0x7f1c200fdff0 2024-05-09T06:27:13.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c27430700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2010e730 con 0x7f1c200fce80 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c249cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 0x7f1c2010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c249cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 0x7f1c2010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48194/0 (socket says 172.21.15.62:48194) 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c251cc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c200fce80 0x7f1c2010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.692+0000 7f1c249cb700 1 -- 172.21.15.62:0/4036729408 learned_addr learned my addr 172.21.15.62:0/4036729408 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c249cb700 1 -- 172.21.15.62:0/4036729408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c200fce80 msgr2=0x7f1c2010da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c249cb700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c200fce80 0x7f1c2010da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c249cb700 1 -- 172.21.15.62:0/4036729408 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c009940 con 0x7f1c200fdff0 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c249cb700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 0x7f1c2010dfc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009380 tx=0x7f1c1c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c11ffb700 1 -- 172.21.15.62:0/4036729408 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c1c00e040 con 0x7f1c200fdff0 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c11ffb700 1 -- 172.21.15.62:0/4036729408 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c1c0128e0 con 0x7f1c200fdff0 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c20113130 con 0x7f1c200fdff0 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c11ffb700 1 -- 172.21.15.62:0/4036729408 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c1c01c930 con 0x7f1c200fdff0 2024-05-09T06:27:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.693+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c201136f0 con 0x7f1c200fdff0 2024-05-09T06:27:13.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.694+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2004c710 con 0x7f1c200fdff0 2024-05-09T06:27:13.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.695+0000 7f1c11ffb700 1 -- 172.21.15.62:0/4036729408 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1c1c012a50 con 0x7f1c200fdff0 2024-05-09T06:27:13.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.695+0000 7f1c11ffb700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1c0c0692a0 0x7f1c0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:13.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.695+0000 7f1c11ffb700 1 -- 172.21.15.62:0/4036729408 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1c1c0889d0 con 0x7f1c200fdff0 2024-05-09T06:27:13.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.695+0000 7f1c251cc700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1c0c0692a0 0x7f1c0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:13.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.696+0000 7f1c251cc700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1c0c0692a0 0x7f1c0c06b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c14004f40 tx=0x7f1c1400b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.700+0000 7f1c11ffb700 1 -- 172.21.15.62:0/4036729408 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1c1c058a50 con 0x7f1c200fdff0 2024-05-09T06:27:13.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:13.923+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c20102360 con 0x7f1c0c0692a0 2024-05-09T06:27:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:14 smithi079 ceph-mon[35268]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-09T06:27:14.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:14 smithi062 ceph-mon[26920]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:14.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-09T06:27:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.436+0000 7f1c11ffb700 1 -- 172.21.15.62:0/4036729408 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1c20102360 con 0x7f1c0c0692a0 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1c0c0692a0 msgr2=0x7f1c0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1c0c0692a0 0x7f1c0c06b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c14004f40 tx=0x7f1c1400b040 comp rx=0 tx=0).stop 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 msgr2=0x7f1c2010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 0x7f1c2010dfc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009380 tx=0x7f1c1c004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 shutdown_connections 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1c0c0692a0 0x7f1c0c06b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c200fce80 0x7f1c2010da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 --2- 172.21.15.62:0/4036729408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c200fdff0 0x7f1c2010dfc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 >> 172.21.15.62:0/4036729408 conn(0x7f1c200f8580 msgr2=0x7f1c200f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.440+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 shutdown_connections 2024-05-09T06:27:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:15.441+0000 7f1c27430700 1 -- 172.21.15.62:0/4036729408 wait complete. 2024-05-09T06:27:15.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:15 smithi079 ceph-mon[35268]: from='client.14476 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:15 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:15 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-09T06:27:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:15 smithi079 ceph-mon[35268]: osdmap e42: 6 total, 6 up, 6 in 2024-05-09T06:27:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:15 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-09T06:27:15.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:15 smithi079 ceph-mon[35268]: pgmap v173: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:15 smithi062 ceph-mon[26920]: from='client.14476 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:15 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:15 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-09T06:27:15.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:15 smithi062 ceph-mon[26920]: osdmap e42: 6 total, 6 up, 6 in 2024-05-09T06:27:15.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:15 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-09T06:27:15.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:15 smithi062 ceph-mon[26920]: pgmap v173: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:15.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:15 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[26916]: 2024-05-09T06:27:15.418+0000 7f2b1aa32700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:27:16.104 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: osdmap e43: 6 total, 6 up, 6 in 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: osdmap e44: 6 total, 6 up, 6 in 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-09T06:27:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: fsmap cephfs:0 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: Saving service mds.cephfs spec with placement count:4 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.etsgzx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.etsgzx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:16 smithi079 ceph-mon[35268]: Deploying daemon mds.cephfs.smithi062.etsgzx on smithi062 2024-05-09T06:27:16.606 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T06:27:16.606 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: osdmap e43: 6 total, 6 up, 6 in 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: osdmap e44: 6 total, 6 up, 6 in 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: fsmap cephfs:0 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: Saving service mds.cephfs spec with placement count:4 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:16.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:16.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:16.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.etsgzx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:16.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.etsgzx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:16.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:16.608 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:16 smithi062 ceph-mon[26920]: Deploying daemon mds.cephfs.smithi062.etsgzx on smithi062 2024-05-09T06:27:16.915 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:17.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:17 smithi062 ceph-mon[26920]: osdmap e45: 6 total, 6 up, 6 in 2024-05-09T06:27:17.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:17 smithi062 ceph-mon[26920]: pgmap v177: 65 pgs: 14 creating+peering, 14 active+clean, 37 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:17.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:17 smithi079 ceph-mon[35268]: osdmap e45: 6 total, 6 up, 6 in 2024-05-09T06:27:17.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:17 smithi079 ceph-mon[35268]: pgmap v177: 65 pgs: 14 creating+peering, 14 active+clean, 37 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:18.775 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:18 smithi062 ceph-mon[26920]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-09T06:27:18.775 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:18 smithi062 ceph-mon[26920]: osdmap e46: 6 total, 6 up, 6 in 2024-05-09T06:27:18.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:18 smithi079 ceph-mon[35268]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-09T06:27:18.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:18 smithi079 ceph-mon[35268]: osdmap e46: 6 total, 6 up, 6 in 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 -- 172.21.15.62:0/1055371887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fcca0 msgr2=0x7f1b1c0fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 --2- 172.21.15.62:0/1055371887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fcca0 0x7f1b1c0fd110 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1b04004940 tx=0x7f1b04009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 -- 172.21.15.62:0/1055371887 shutdown_connections 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 --2- 172.21.15.62:0/1055371887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fcca0 0x7f1b1c0fd110 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 --2- 172.21.15.62:0/1055371887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b1c0fc350 0x7f1b1c0fc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 -- 172.21.15.62:0/1055371887 >> 172.21.15.62:0/1055371887 conn(0x7f1b1c0f6be0 msgr2=0x7f1b1c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 -- 172.21.15.62:0/1055371887 shutdown_connections 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 -- 172.21.15.62:0/1055371887 wait complete. 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 Processor -- start 2024-05-09T06:27:19.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.345+0000 7f1b21e6f700 1 -- start start 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b21e6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fc350 0x7f1b1c10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b21e6f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b1c0fcca0 0x7f1b1c10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b21e6f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c10e4c0 con 0x7f1b1c0fc350 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b21e6f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c112e60 con 0x7f1b1c0fcca0 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b1b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fc350 0x7f1b1c10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b1b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fc350 0x7f1b1c10d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48222/0 (socket says 172.21.15.62:48222) 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b1b7fe700 1 -- 172.21.15.62:0/2482838942 learned_addr learned my addr 172.21.15.62:0/2482838942 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b12ffd700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b1c0fcca0 0x7f1b1c10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b1b7fe700 1 -- 172.21.15.62:0/2482838942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b1c0fcca0 msgr2=0x7f1b1c10de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b1b7fe700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b1c0fcca0 0x7f1b1c10de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b1b7fe700 1 -- 172.21.15.62:0/2482838942 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04005040 con 0x7f1b1c0fc350 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b1b7fe700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fc350 0x7f1b1c10d8f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00b790 tx=0x7f1b0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b18ff9700 1 -- 172.21.15.62:0/2482838942 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b0c00f6f0 con 0x7f1b1c0fc350 2024-05-09T06:27:19.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b18ff9700 1 -- 172.21.15.62:0/2482838942 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b0c00fd20 con 0x7f1b1c0fc350 2024-05-09T06:27:19.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.346+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c1130c0 con 0x7f1b1c0fc350 2024-05-09T06:27:19.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.347+0000 7f1b18ff9700 1 -- 172.21.15.62:0/2482838942 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b0c0103a0 con 0x7f1b1c0fc350 2024-05-09T06:27:19.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.347+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c113630 con 0x7f1b1c0fc350 2024-05-09T06:27:19.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.348+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c101ca0 con 0x7f1b1c0fc350 2024-05-09T06:27:19.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.348+0000 7f1b18ff9700 1 -- 172.21.15.62:0/2482838942 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1b0c011400 con 0x7f1b1c0fc350 2024-05-09T06:27:19.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.349+0000 7f1b18ff9700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b080692a0 0x7f1b0806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:19.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.349+0000 7f1b18ff9700 1 -- 172.21.15.62:0/2482838942 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1b0c086f80 con 0x7f1b1c0fc350 2024-05-09T06:27:19.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.349+0000 7f1b12ffd700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b080692a0 0x7f1b0806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:19.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.349+0000 7f1b12ffd700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b080692a0 0x7f1b0806b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009fd0 tx=0x7f1b04009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:19.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.353+0000 7f1b18ff9700 1 -- 172.21.15.62:0/2482838942 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1b0c056d40 con 0x7f1b1c0fc350 2024-05-09T06:27:19.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:19 smithi062 ceph-mon[26920]: pgmap v179: 65 pgs: 14 creating+peering, 42 active+clean, 9 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:19.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.607+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1b1c02b2d0 con 0x7f1b1c0fc350 2024-05-09T06:27:19.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.607+0000 7f1b18ff9700 1 -- 172.21.15.62:0/2482838942 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f1b0c0568d0 con 0x7f1b1c0fc350 2024-05-09T06:27:19.590 INFO:teuthology.orchestra.run.smithi062.stdout:e2 2024-05-09T06:27:19.590 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:27:19.590 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:27:19.590 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:27:19.590 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 2 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:15.419126+0000 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:27:19.591 INFO:teuthology.orchestra.run.smithi062.stdout:in 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:up {} 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data disabled 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 0 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:27:19.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:27:19.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b080692a0 msgr2=0x7f1b0806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b080692a0 0x7f1b0806b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009fd0 tx=0x7f1b04009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fc350 msgr2=0x7f1b1c10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fc350 0x7f1b1c10d8f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00b790 tx=0x7f1b0c009250 comp rx=0 tx=0).stop 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 shutdown_connections 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1b080692a0 0x7f1b0806b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b1c0fc350 0x7f1b1c10d8f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 --2- 172.21.15.62:0/2482838942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b1c0fcca0 0x7f1b1c10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 >> 172.21.15.62:0/2482838942 conn(0x7f1b1c0f6be0 msgr2=0x7f1b1c0f8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 shutdown_connections 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:19.610+0000 7f1b21e6f700 1 -- 172.21.15.62:0/2482838942 wait complete. 2024-05-09T06:27:19.594 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 2 2024-05-09T06:27:19.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:19 smithi079 ceph-mon[35268]: pgmap v179: 65 pgs: 14 creating+peering, 42 active+clean, 9 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:20.355 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:20.365 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:27:20.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-05-09T06:27:20.659 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.qwqgdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.qwqgdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: Deploying daemon mds.cephfs.smithi079.qwqgdo on smithi079 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2482838942' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] up:boot 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: daemon mds.cephfs.smithi062.etsgzx assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: Cluster is now healthy 2024-05-09T06:27:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: fsmap cephfs:0 1 up:standby 2024-05-09T06:27:20.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:27:20.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:creating} 2024-05-09T06:27:20.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:20 smithi062 ceph-mon[26920]: daemon mds.cephfs.smithi062.etsgzx is now active in filesystem cephfs as rank 0 2024-05-09T06:27:20.665 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.qwqgdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.qwqgdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: Deploying daemon mds.cephfs.smithi079.qwqgdo on smithi079 2024-05-09T06:27:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2482838942' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] up:boot 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: daemon mds.cephfs.smithi062.etsgzx assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: Cluster is now healthy 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: fsmap cephfs:0 1 up:standby 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:creating} 2024-05-09T06:27:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:20 smithi079 ceph-mon[35268]: daemon mds.cephfs.smithi062.etsgzx is now active in filesystem cephfs as rank 0 2024-05-09T06:27:21.814 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:21 smithi062 ceph-mon[26920]: pgmap v180: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-05-09T06:27:21.815 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:21 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] up:active 2024-05-09T06:27:21.815 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:21 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 2024-05-09T06:27:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:21 smithi079 ceph-mon[35268]: pgmap v180: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-05-09T06:27:21.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:21 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] up:active 2024-05-09T06:27:21.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:21 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 2024-05-09T06:27:22.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.449+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3925264444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fed30 msgr2=0x7f5c500fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:22.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.449+0000 7f5c54e8c700 1 --2- 172.21.15.62:0/3925264444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fed30 0x7f5c500fae70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c44004940 tx=0x7f5c44009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:22.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.449+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3925264444 shutdown_connections 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.449+0000 7f5c54e8c700 1 --2- 172.21.15.62:0/3925264444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fed30 0x7f5c500fae70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.449+0000 7f5c54e8c700 1 --2- 172.21.15.62:0/3925264444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c500fe3e0 0x7f5c500fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.449+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3925264444 >> 172.21.15.62:0/3925264444 conn(0x7f5c500f6b80 msgr2=0x7f5c500f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.449+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3925264444 shutdown_connections 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.449+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3925264444 wait complete. 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.450+0000 7f5c54e8c700 1 Processor -- start 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.450+0000 7f5c54e8c700 1 -- start start 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.450+0000 7f5c54e8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fe3e0 0x7f5c5010d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.450+0000 7f5c54e8c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c500fed30 0x7f5c5010df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.450+0000 7f5c54e8c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5010e5c0 con 0x7f5c500fe3e0 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.450+0000 7f5c54e8c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5010edb0 con 0x7f5c500fed30 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.450+0000 7f5c4e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fe3e0 0x7f5c5010d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:22.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c4e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fe3e0 0x7f5c5010d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48256/0 (socket says 172.21.15.62:48256) 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c4e59c700 1 -- 172.21.15.62:0/3527267649 learned_addr learned my addr 172.21.15.62:0/3527267649 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c4dd9b700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c500fed30 0x7f5c5010df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c4e59c700 1 -- 172.21.15.62:0/3527267649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c500fed30 msgr2=0x7f5c5010df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c4e59c700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c500fed30 0x7f5c5010df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c4e59c700 1 -- 172.21.15.62:0/3527267649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44005040 con 0x7f5c500fe3e0 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c4e59c700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fe3e0 0x7f5c5010d9f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000b790 tx=0x7f5c40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c3effd700 1 -- 172.21.15.62:0/3527267649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4000f6f0 con 0x7f5c500fe3e0 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c3effd700 1 -- 172.21.15.62:0/3527267649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c4000fd20 con 0x7f5c500fe3e0 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5010f090 con 0x7f5c500fe3e0 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c3effd700 1 -- 172.21.15.62:0/3527267649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c400103a0 con 0x7f5c500fe3e0 2024-05-09T06:27:22.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.451+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5010f650 con 0x7f5c500fe3e0 2024-05-09T06:27:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.452+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5005f5c0 con 0x7f5c500fe3e0 2024-05-09T06:27:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.453+0000 7f5c3effd700 1 -- 172.21.15.62:0/3527267649 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5c40011400 con 0x7f5c500fe3e0 2024-05-09T06:27:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.453+0000 7f5c3effd700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5c380692b0 0x7f5c3806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.453+0000 7f5c3effd700 1 -- 172.21.15.62:0/3527267649 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5c40086f80 con 0x7f5c500fe3e0 2024-05-09T06:27:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.453+0000 7f5c4dd9b700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5c380692b0 0x7f5c3806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:22.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.454+0000 7f5c4dd9b700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5c380692b0 0x7f5c3806b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009fd0 tx=0x7f5c44009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.458+0000 7f5c3effd700 1 -- 172.21.15.62:0/3527267649 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5c40056d40 con 0x7f5c500fe3e0 2024-05-09T06:27:22.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:22.705+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f5c5004bed0 con 0x7f5c500fe3e0 2024-05-09T06:27:23.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.bwemju", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.bwemju", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: Deploying daemon mds.cephfs.smithi062.bwemju on smithi062 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:boot 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 1 up:standby 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 1 up:standby 2024-05-09T06:27:23.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:22 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3527267649' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-05-09T06:27:23.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.bwemju", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.bwemju", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: Deploying daemon mds.cephfs.smithi062.bwemju on smithi062 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:boot 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 1 up:standby 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 1 up:standby 2024-05-09T06:27:23.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:22 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3527267649' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-05-09T06:27:23.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.582+0000 7f5c3effd700 1 -- 172.21.15.62:0/3527267649 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5c400568d0 con 0x7f5c500fe3e0 2024-05-09T06:27:23.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.584+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5c380692b0 msgr2=0x7f5c3806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:23.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.584+0000 7f5c54e8c700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5c380692b0 0x7f5c3806b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009fd0 tx=0x7f5c44009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.584+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fe3e0 msgr2=0x7f5c5010d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.584+0000 7f5c54e8c700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fe3e0 0x7f5c5010d9f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000b790 tx=0x7f5c40009250 comp rx=0 tx=0).stop 2024-05-09T06:27:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.585+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 shutdown_connections 2024-05-09T06:27:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.585+0000 7f5c54e8c700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5c380692b0 0x7f5c3806b760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.585+0000 7f5c54e8c700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c500fe3e0 0x7f5c5010d9f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.585+0000 7f5c54e8c700 1 --2- 172.21.15.62:0/3527267649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c500fed30 0x7f5c5010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:23.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.585+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 >> 172.21.15.62:0/3527267649 conn(0x7f5c500f6b80 msgr2=0x7f5c500f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:23.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.585+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 shutdown_connections 2024-05-09T06:27:23.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:23.585+0000 7f5c54e8c700 1 -- 172.21.15.62:0/3527267649 wait complete. 2024-05-09T06:27:23.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:23 smithi062 ceph-mon[26920]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 2 op/s 2024-05-09T06:27:23.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:23 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3527267649' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-05-09T06:27:23.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:23 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 1 up:standby 2024-05-09T06:27:24.006 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:23 smithi079 ceph-mon[35268]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 2 op/s 2024-05-09T06:27:24.007 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:23 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3527267649' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-05-09T06:27:24.007 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:23 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 1 up:standby 2024-05-09T06:27:24.319 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:24.329 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:27:24.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-05-09T06:27:24.907 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:boot 2024-05-09T06:27:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 2 up:standby 2024-05-09T06:27:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:27:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pdxygz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:26.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pdxygz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:26.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:26.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: Deploying daemon mds.cephfs.smithi079.pdxygz on smithi079 2024-05-09T06:27:26.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:25 smithi079 ceph-mon[35268]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-05-09T06:27:26.134 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:boot 2024-05-09T06:27:26.134 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 2 up:standby 2024-05-09T06:27:26.134 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:27:26.134 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:26.134 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:26.134 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:26.135 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pdxygz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:26.135 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pdxygz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:26.135 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:26.135 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: Deploying daemon mds.cephfs.smithi079.pdxygz on smithi079 2024-05-09T06:27:26.135 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:25 smithi062 ceph-mon[26920]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-05-09T06:27:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.478+0000 7f5b67ef1700 1 -- 172.21.15.62:0/635730305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b600fff60 msgr2=0x7f5b60102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.478+0000 7f5b67ef1700 1 --2- 172.21.15.62:0/635730305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b600fff60 0x7f5b60102340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5b54004940 tx=0x7f5b54009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.478+0000 7f5b67ef1700 1 -- 172.21.15.62:0/635730305 shutdown_connections 2024-05-09T06:27:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.478+0000 7f5b67ef1700 1 --2- 172.21.15.62:0/635730305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b600fff60 0x7f5b60102340 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.478+0000 7f5b67ef1700 1 --2- 172.21.15.62:0/635730305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b60066240 0x7f5b600ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.478+0000 7f5b67ef1700 1 -- 172.21.15.62:0/635730305 >> 172.21.15.62:0/635730305 conn(0x7f5b600f7430 msgr2=0x7f5b600f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.478+0000 7f5b67ef1700 1 -- 172.21.15.62:0/635730305 shutdown_connections 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.478+0000 7f5b67ef1700 1 -- 172.21.15.62:0/635730305 wait complete. 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b67ef1700 1 Processor -- start 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b67ef1700 1 -- start start 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b67ef1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b60066240 0x7f5b600fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b67ef1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b600fff60 0x7f5b600fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b67ef1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600fbed0 con 0x7f5b60066240 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b67ef1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600fc040 con 0x7f5b600fff60 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b65c8d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b60066240 0x7f5b600fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b65c8d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b60066240 0x7f5b600fd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39200/0 (socket says 172.21.15.62:39200) 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b65c8d700 1 -- 172.21.15.62:0/2492466444 learned_addr learned my addr 172.21.15.62:0/2492466444 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:26.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b6548c700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b600fff60 0x7f5b600fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b65c8d700 1 -- 172.21.15.62:0/2492466444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b600fff60 msgr2=0x7f5b600fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b65c8d700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b600fff60 0x7f5b600fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.479+0000 7f5b65c8d700 1 -- 172.21.15.62:0/2492466444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54005040 con 0x7f5b60066240 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.480+0000 7f5b65c8d700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b60066240 0x7f5b600fd450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000ca90 tx=0x7f5b50007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.480+0000 7f5b5e7fc700 1 -- 172.21.15.62:0/2492466444 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b5000a980 con 0x7f5b60066240 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.480+0000 7f5b5e7fc700 1 -- 172.21.15.62:0/2492466444 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b50012440 con 0x7f5b60066240 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.480+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b600fc320 con 0x7f5b60066240 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.480+0000 7f5b5e7fc700 1 -- 172.21.15.62:0/2492466444 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b500115e0 con 0x7f5b60066240 2024-05-09T06:27:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.480+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b60115a50 con 0x7f5b60066240 2024-05-09T06:27:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.481+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6005f5c0 con 0x7f5b60066240 2024-05-09T06:27:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.481+0000 7f5b5e7fc700 1 -- 172.21.15.62:0/2492466444 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5b500125b0 con 0x7f5b60066240 2024-05-09T06:27:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.482+0000 7f5b5e7fc700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5b480692a0 0x7f5b4806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.482+0000 7f5b5e7fc700 1 -- 172.21.15.62:0/2492466444 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5b50087810 con 0x7f5b60066240 2024-05-09T06:27:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.482+0000 7f5b6548c700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5b480692a0 0x7f5b4806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.482+0000 7f5b6548c700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5b480692a0 0x7f5b4806b750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400b3b0 tx=0x7f5b54009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:26.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.486+0000 7f5b5e7fc700 1 -- 172.21.15.62:0/2492466444 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5b50053b40 con 0x7f5b60066240 2024-05-09T06:27:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.731+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5b60105890 con 0x7f5b60066240 2024-05-09T06:27:26.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.959+0000 7f5b5e7fc700 1 -- 172.21.15.62:0/2492466444 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5b50057160 con 0x7f5b60066240 2024-05-09T06:27:26.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5b480692a0 msgr2=0x7f5b4806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:26.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5b480692a0 0x7f5b4806b750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400b3b0 tx=0x7f5b54009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b60066240 msgr2=0x7f5b600fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b60066240 0x7f5b600fd450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000ca90 tx=0x7f5b50007f00 comp rx=0 tx=0).stop 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 shutdown_connections 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f5b480692a0 0x7f5b4806b750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b60066240 0x7f5b600fd450 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 --2- 172.21.15.62:0/2492466444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b600fff60 0x7f5b600fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 >> 172.21.15.62:0/2492466444 conn(0x7f5b600f7430 msgr2=0x7f5b600f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 shutdown_connections 2024-05-09T06:27:26.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:26.962+0000 7f5b67ef1700 1 -- 172.21.15.62:0/2492466444 wait complete. 2024-05-09T06:27:27.006 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:26 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2492466444' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-09T06:27:27.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:26 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2492466444' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-09T06:27:27.558 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:27.568 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:27:27.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-05-09T06:27:27.852 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:28.201 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2492466444' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-09T06:27:28.201 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 2 up:standby 2024-05-09T06:27:28.202 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-09T06:27:28.202 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.202 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.202 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.202 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.202 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.202 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:27 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:28.275 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2492466444' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-09T06:27:28.275 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 2 up:standby 2024-05-09T06:27:28.275 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-09T06:27:28.275 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.275 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.276 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.276 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.276 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:28.276 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:27 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:29.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:28 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:boot 2024-05-09T06:27:29.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:28 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:27:29.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:28 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:27:29.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:28 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:29.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:28 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:boot 2024-05-09T06:27:29.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:28 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:27:29.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:28 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:27:29.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:28 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.020+0000 7f37fa5fb700 1 -- 172.21.15.62:0/650587861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 msgr2=0x7f37f40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.020+0000 7f37fa5fb700 1 --2- 172.21.15.62:0/650587861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 0x7f37f40fc0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f37e4004940 tx=0x7f37e4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.020+0000 7f37fa5fb700 1 -- 172.21.15.62:0/650587861 shutdown_connections 2024-05-09T06:27:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.020+0000 7f37fa5fb700 1 --2- 172.21.15.62:0/650587861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37f40fcf60 0x7f37f40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.020+0000 7f37fa5fb700 1 --2- 172.21.15.62:0/650587861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 0x7f37f40fc0c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.020+0000 7f37fa5fb700 1 -- 172.21.15.62:0/650587861 >> 172.21.15.62:0/650587861 conn(0x7f37f40f7430 msgr2=0x7f37f40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.020+0000 7f37fa5fb700 1 -- 172.21.15.62:0/650587861 shutdown_connections 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.020+0000 7f37fa5fb700 1 -- 172.21.15.62:0/650587861 wait complete. 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37fa5fb700 1 Processor -- start 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37fa5fb700 1 -- start start 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37fa5fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 0x7f37f40ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37fa5fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37f40fcf60 0x7f37f40fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37fa5fb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40fe7e0 con 0x7f37f40fbcb0 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37fa5fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40fe920 con 0x7f37f40fcf60 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37f3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 0x7f37f40ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37f3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 0x7f37f40ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39214/0 (socket says 172.21.15.62:39214) 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37f3fff700 1 -- 172.21.15.62:0/1179088536 learned_addr learned my addr 172.21.15.62:0/1179088536 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37ebfff700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37f40fcf60 0x7f37f40fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37f3fff700 1 -- 172.21.15.62:0/1179088536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37f40fcf60 msgr2=0x7f37f40fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37f3fff700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37f40fcf60 0x7f37f40fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:30.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.021+0000 7f37f3fff700 1 -- 172.21.15.62:0/1179088536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4005040 con 0x7f37f40fbcb0 2024-05-09T06:27:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.022+0000 7f37f3fff700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 0x7f37f40ffd30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b3b0 tx=0x7f37e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.022+0000 7f37f17fa700 1 -- 172.21.15.62:0/1179088536 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37e400e040 con 0x7f37f40fbcb0 2024-05-09T06:27:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.022+0000 7f37f17fa700 1 -- 172.21.15.62:0/1179088536 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37e4004290 con 0x7f37f40fbcb0 2024-05-09T06:27:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.022+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f40feba0 con 0x7f37f40fbcb0 2024-05-09T06:27:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.022+0000 7f37f17fa700 1 -- 172.21.15.62:0/1179088536 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37e401c630 con 0x7f37f40fbcb0 2024-05-09T06:27:30.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.022+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f4115b10 con 0x7f37f40fbcb0 2024-05-09T06:27:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.023+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f4101af0 con 0x7f37f40fbcb0 2024-05-09T06:27:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.023+0000 7f37f17fa700 1 -- 172.21.15.62:0/1179088536 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f37e400bbf0 con 0x7f37f40fbcb0 2024-05-09T06:27:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.024+0000 7f37f17fa700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f37e00692b0 0x7f37e006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.024+0000 7f37f17fa700 1 -- 172.21.15.62:0/1179088536 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f37e40885f0 con 0x7f37f40fbcb0 2024-05-09T06:27:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.024+0000 7f37ebfff700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f37e00692b0 0x7f37e006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:30.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.024+0000 7f37ebfff700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f37e00692b0 0x7f37e006b760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37dc007fd0 tx=0x7f37dc009040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:30.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.028+0000 7f37f17fa700 1 -- 172.21.15.62:0/1179088536 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f37e4054920 con 0x7f37f40fbcb0 2024-05-09T06:27:30.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:29 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] up:active 2024-05-09T06:27:30.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:29 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:standby 2024-05-09T06:27:30.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:29 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:27:30.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:29 smithi062 ceph-mon[26920]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T06:27:30.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:30.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:30.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:30.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.315+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37f405f5c0 con 0x7f37f40fbcb0 2024-05-09T06:27:30.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:29 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] up:active 2024-05-09T06:27:30.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:29 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:standby 2024-05-09T06:27:30.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:29 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:27:30.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:29 smithi079 ceph-mon[35268]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T06:27:30.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:30.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:30.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:30.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.544+0000 7f37f17fa700 1 -- 172.21.15.62:0/1179088536 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v13) v1 ==== 168+0+0 (secure 0 0 0) 0x7f37e4057f40 con 0x7f37f40fbcb0 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f37e00692b0 msgr2=0x7f37e006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f37e00692b0 0x7f37e006b760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37dc007fd0 tx=0x7f37dc009040 comp rx=0 tx=0).stop 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 msgr2=0x7f37f40ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 0x7f37f40ffd30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f37e400b3b0 tx=0x7f37e4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 shutdown_connections 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f37e00692b0 0x7f37e006b760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f40fbcb0 0x7f37f40ffd30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 --2- 172.21.15.62:0/1179088536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37f40fcf60 0x7f37f40fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 >> 172.21.15.62:0/1179088536 conn(0x7f37f40f7430 msgr2=0x7f37f4065c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 shutdown_connections 2024-05-09T06:27:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:30.547+0000 7f37fa5fb700 1 -- 172.21.15.62:0/1179088536 wait complete. 2024-05-09T06:27:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:inline data enabled 2024-05-09T06:27:31.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:30 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1179088536' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:27:31.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:30 smithi062 ceph-mon[26920]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-05-09T06:27:31.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:30 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:standby 2024-05-09T06:27:31.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:30 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1179088536' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:27:31.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:30 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:27:31.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:30 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1179088536' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:27:31.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:30 smithi079 ceph-mon[35268]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-05-09T06:27:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:30 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:standby 2024-05-09T06:27:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:30 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1179088536' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:27:31.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:30 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:27:31.488 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:31.498 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:27:31.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T06:27:32.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:31 smithi062 ceph-mon[26920]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T06:27:32.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:31 smithi079 ceph-mon[35268]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T06:27:32.476 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:33.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:32 smithi079 ceph-mon[35268]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:standby 2024-05-09T06:27:33.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:32 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:27:33.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:32 smithi062 ceph-mon[26920]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:standby 2024-05-09T06:27:33.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:32 smithi062 ceph-mon[26920]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:27:34.072 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:33 smithi062 ceph-mon[26920]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 3 op/s 2024-05-09T06:27:34.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:33 smithi079 ceph-mon[35268]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 3 op/s 2024-05-09T06:27:35.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.257+0000 7f949efc0700 1 -- 172.21.15.62:0/2554678907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 msgr2=0x7f94980fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.257+0000 7f949efc0700 1 --2- 172.21.15.62:0/2554678907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 0x7f94980fd270 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9488004940 tx=0x7f9488009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 -- 172.21.15.62:0/2554678907 shutdown_connections 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 --2- 172.21.15.62:0/2554678907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94980fdfd0 0x7f94980fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 --2- 172.21.15.62:0/2554678907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 0x7f94980fd270 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 -- 172.21.15.62:0/2554678907 >> 172.21.15.62:0/2554678907 conn(0x7f94980f8540 msgr2=0x7f94980fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 -- 172.21.15.62:0/2554678907 shutdown_connections 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 -- 172.21.15.62:0/2554678907 wait complete. 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 Processor -- start 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 -- start start 2024-05-09T06:27:35.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 0x7f949810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94980fdfd0 0x7f949810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949810e450 con 0x7f94980fce60 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.258+0000 7f949efc0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949810e5c0 con 0x7f94980fdfd0 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949cd5c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 0x7f949810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949cd5c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 0x7f949810d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42012/0 (socket says 172.21.15.62:42012) 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949cd5c700 1 -- 172.21.15.62:0/1266852242 learned_addr learned my addr 172.21.15.62:0/1266852242 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f9497fff700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94980fdfd0 0x7f949810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949cd5c700 1 -- 172.21.15.62:0/1266852242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94980fdfd0 msgr2=0x7f949810de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949cd5c700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94980fdfd0 0x7f949810de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949cd5c700 1 -- 172.21.15.62:0/1266852242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488005040 con 0x7f94980fce60 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f9497fff700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94980fdfd0 0x7f949810de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949cd5c700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 0x7f949810d910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f948800b3b0 tx=0x7f9488009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f94957fa700 1 -- 172.21.15.62:0/1266852242 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948800e040 con 0x7f94980fce60 2024-05-09T06:27:35.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f94957fa700 1 -- 172.21.15.62:0/1266852242 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f948800bcc0 con 0x7f94980fce60 2024-05-09T06:27:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9498112fc0 con 0x7f94980fce60 2024-05-09T06:27:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f94957fa700 1 -- 172.21.15.62:0/1266852242 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948801c630 con 0x7f94980fce60 2024-05-09T06:27:35.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.259+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94981134f0 con 0x7f94980fce60 2024-05-09T06:27:35.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.260+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949804c710 con 0x7f94980fce60 2024-05-09T06:27:35.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.261+0000 7f94957fa700 1 -- 172.21.15.62:0/1266852242 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9488013980 con 0x7f94980fce60 2024-05-09T06:27:35.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.261+0000 7f94957fa700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94840692a0 0x7f948406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:35.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.261+0000 7f9497fff700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94840692a0 0x7f948406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:35.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.261+0000 7f94957fa700 1 -- 172.21.15.62:0/1266852242 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9488087fb0 con 0x7f94980fce60 2024-05-09T06:27:35.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.262+0000 7f9497fff700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94840692a0 0x7f948406b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9480004550 tx=0x7f9480009040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:35.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.266+0000 7f94957fa700 1 -- 172.21.15.62:0/1266852242 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9488057cf0 con 0x7f94980fce60 2024-05-09T06:27:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.523+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9498113710 con 0x7f94980fce60 2024-05-09T06:27:35.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.524+0000 7f94957fa700 1 -- 172.21.15.62:0/1266852242 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1802 (secure 0 0 0) 0x7f9488057880 con 0x7f94980fce60 2024-05-09T06:27:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:27:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:27:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:27:35.506 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:27:35.507 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:27:35.508 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:27:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:27:35.509 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:27:35.509 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:27:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:27:35.509 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:27:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:27:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:27:35.509 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:27:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94840692a0 msgr2=0x7f948406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94840692a0 0x7f948406b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9480004550 tx=0x7f9480009040 comp rx=0 tx=0).stop 2024-05-09T06:27:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 msgr2=0x7f949810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 0x7f949810d910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f948800b3b0 tx=0x7f9488009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 shutdown_connections 2024-05-09T06:27:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f94840692a0 0x7f948406b750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94980fce60 0x7f949810d910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 --2- 172.21.15.62:0/1266852242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94980fdfd0 0x7f949810de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 >> 172.21.15.62:0/1266852242 conn(0x7f94980f8540 msgr2=0x7f94980f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 shutdown_connections 2024-05-09T06:27:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:35.526+0000 7f949efc0700 1 -- 172.21.15.62:0/1266852242 wait complete. 2024-05-09T06:27:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:27:36.158 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:36 smithi062 ceph-mon[26920]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 2 op/s 2024-05-09T06:27:36.158 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:36.158 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:36.158 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:36.158 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:36.158 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:36.159 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:36 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1266852242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:27:36.159 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:36 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:36.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-05-09T06:27:36.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:36 smithi079 ceph-mon[35268]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 2 op/s 2024-05-09T06:27:36.408 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:36.408 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:36.408 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:36.408 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:36.408 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:36.408 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:36 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1266852242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:27:36.408 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:36 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:37.107 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:38.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:38 smithi062 ceph-mon[26920]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-05-09T06:27:38.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:38.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:38 smithi079 ceph-mon[35268]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-05-09T06:27:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:38.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.896+0000 7ff2a102f700 1 -- 172.21.15.62:0/377717009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0ffee0 msgr2=0x7ff29c102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.896+0000 7ff2a102f700 1 --2- 172.21.15.62:0/377717009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0ffee0 0x7ff29c102300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff290004940 tx=0x7ff290009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.896+0000 7ff2a102f700 1 -- 172.21.15.62:0/377717009 shutdown_connections 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.896+0000 7ff2a102f700 1 --2- 172.21.15.62:0/377717009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0ffee0 0x7ff29c102300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.896+0000 7ff2a102f700 1 --2- 172.21.15.62:0/377717009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c0662c0 0x7ff29c0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.896+0000 7ff2a102f700 1 -- 172.21.15.62:0/377717009 >> 172.21.15.62:0/377717009 conn(0x7ff29c0f7430 msgr2=0x7ff29c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.896+0000 7ff2a102f700 1 -- 172.21.15.62:0/377717009 shutdown_connections 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.896+0000 7ff2a102f700 1 -- 172.21.15.62:0/377717009 wait complete. 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff2a102f700 1 Processor -- start 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff2a102f700 1 -- start start 2024-05-09T06:27:39.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff2a102f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0662c0 0x7ff29c0fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff2a102f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c0ffee0 0x7ff29c0fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff2a102f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0fbe50 con 0x7ff29c0662c0 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff2a102f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0fbfc0 con 0x7ff29c0ffee0 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff29ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0662c0 0x7ff29c0fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff29ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0662c0 0x7ff29c0fd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42018/0 (socket says 172.21.15.62:42018) 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.897+0000 7ff29ad9d700 1 -- 172.21.15.62:0/1611380102 learned_addr learned my addr 172.21.15.62:0/1611380102 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff29a59c700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c0ffee0 0x7ff29c0fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff29ad9d700 1 -- 172.21.15.62:0/1611380102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c0ffee0 msgr2=0x7ff29c0fb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff29ad9d700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c0ffee0 0x7ff29c0fb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff29ad9d700 1 -- 172.21.15.62:0/1611380102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290005040 con 0x7ff29c0662c0 2024-05-09T06:27:39.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff29ad9d700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0662c0 0x7ff29c0fd3d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff28c002a50 tx=0x7ff28c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff2837fe700 1 -- 172.21.15.62:0/1611380102 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28c007cc0 con 0x7ff29c0662c0 2024-05-09T06:27:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff2837fe700 1 -- 172.21.15.62:0/1611380102 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff28c00f040 con 0x7ff29c0662c0 2024-05-09T06:27:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c0fc2a0 con 0x7ff29c0662c0 2024-05-09T06:27:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff2837fe700 1 -- 172.21.15.62:0/1611380102 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28c00d9c0 con 0x7ff29c0662c0 2024-05-09T06:27:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.898+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c115a30 con 0x7ff29c0662c0 2024-05-09T06:27:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.899+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c05f5c0 con 0x7ff29c0662c0 2024-05-09T06:27:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.900+0000 7ff2837fe700 1 -- 172.21.15.62:0/1611380102 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff28c009730 con 0x7ff29c0662c0 2024-05-09T06:27:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.900+0000 7ff2837fe700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff2840692a0 0x7ff28406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.900+0000 7ff2837fe700 1 -- 172.21.15.62:0/1611380102 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff28c086f40 con 0x7ff29c0662c0 2024-05-09T06:27:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.900+0000 7ff29a59c700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff2840692a0 0x7ff28406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:39.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.901+0000 7ff29a59c700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff2840692a0 0x7ff28406b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff29000b970 tx=0x7ff290009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:39.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:39.905+0000 7ff2837fe700 1 -- 172.21.15.62:0/1611380102 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff28c0531f0 con 0x7ff29c0662c0 2024-05-09T06:27:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.178+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff29c04bed0 con 0x7ff29c0662c0 2024-05-09T06:27:40.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.179+0000 7ff2837fe700 1 -- 172.21.15.62:0/1611380102 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4680 (secure 0 0 0) 0x7ff28c056810 con 0x7ff29c0662c0 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff2840692a0 msgr2=0x7ff28406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff2840692a0 0x7ff28406b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff29000b970 tx=0x7ff290009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0662c0 msgr2=0x7ff29c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0662c0 0x7ff29c0fd3d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff28c002a50 tx=0x7ff28c004600 comp rx=0 tx=0).stop 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 shutdown_connections 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff2840692a0 0x7ff28406b750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29c0662c0 0x7ff29c0fd3d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 --2- 172.21.15.62:0/1611380102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff29c0ffee0 0x7ff29c0fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 >> 172.21.15.62:0/1611380102 conn(0x7ff29c0f7430 msgr2=0x7ff29c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:40.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 shutdown_connections 2024-05-09T06:27:40.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:40.182+0000 7ff2a102f700 1 -- 172.21.15.62:0/1611380102 wait complete. 2024-05-09T06:27:40.165 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:27:40.174 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:27:40.356 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:40 smithi062 ceph-mon[26920]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:40.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:40 smithi079 ceph-mon[35268]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:41.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-05-09T06:27:41.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:41 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1611380102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:27:41.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:41 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1611380102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:27:41.831 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:42.284 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:42 smithi062 ceph-mon[26920]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:42.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:42 smithi079 ceph-mon[35268]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.446+0000 7f1adb7cf700 1 -- 172.21.15.62:0/1735448998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fd2e0 msgr2=0x7f1ad40fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.446+0000 7f1adb7cf700 1 --2- 172.21.15.62:0/1735448998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fd2e0 0x7f1ad40fd6f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0004940 tx=0x7f1ad0009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.446+0000 7f1adb7cf700 1 -- 172.21.15.62:0/1735448998 shutdown_connections 2024-05-09T06:27:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.446+0000 7f1adb7cf700 1 --2- 172.21.15.62:0/1735448998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad40fdc30 0x7f1ad40fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.446+0000 7f1adb7cf700 1 --2- 172.21.15.62:0/1735448998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fd2e0 0x7f1ad40fd6f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.446+0000 7f1adb7cf700 1 -- 172.21.15.62:0/1735448998 >> 172.21.15.62:0/1735448998 conn(0x7f1ad40f6be0 msgr2=0x7f1ad40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:43.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1adb7cf700 1 -- 172.21.15.62:0/1735448998 shutdown_connections 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1adb7cf700 1 -- 172.21.15.62:0/1735448998 wait complete. 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1adb7cf700 1 Processor -- start 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1adb7cf700 1 -- start start 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1adb7cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad40fd2e0 0x7f1ad40fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1adb7cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fdc30 0x7f1ad4112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1adb7cf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4112c90 con 0x7f1ad40fdc30 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1adb7cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4112dd0 con 0x7f1ad40fd2e0 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1ad8d6a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fdc30 0x7f1ad4112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1ad8d6a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fdc30 0x7f1ad4112750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42040/0 (socket says 172.21.15.62:42040) 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1ad8d6a700 1 -- 172.21.15.62:0/576905842 learned_addr learned my addr 172.21.15.62:0/576905842 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.447+0000 7f1ad956b700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad40fd2e0 0x7f1ad40fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1ad8d6a700 1 -- 172.21.15.62:0/576905842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad40fd2e0 msgr2=0x7f1ad40fb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1ad8d6a700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad40fd2e0 0x7f1ad40fb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1ad8d6a700 1 -- 172.21.15.62:0/576905842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0005040 con 0x7f1ad40fdc30 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1ad8d6a700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fdc30 0x7f1ad4112750 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4002a50 tx=0x7f1ac4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:43.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/576905842 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac4007cc0 con 0x7f1ad40fdc30 2024-05-09T06:27:43.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/576905842 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ac400f040 con 0x7f1ad40fdc30 2024-05-09T06:27:43.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/576905842 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac400d960 con 0x7f1ad40fdc30 2024-05-09T06:27:43.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad4113060 con 0x7f1ad40fdc30 2024-05-09T06:27:43.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.448+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad4113620 con 0x7f1ad40fdc30 2024-05-09T06:27:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.449+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad404c710 con 0x7f1ad40fdc30 2024-05-09T06:27:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.450+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/576905842 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1ac4009730 con 0x7f1ad40fdc30 2024-05-09T06:27:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.450+0000 7f1ac9ffb700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1ac00692a0 0x7f1ac006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.451+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/576905842 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1ac4086e20 con 0x7f1ad40fdc30 2024-05-09T06:27:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.451+0000 7f1ad956b700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1ac00692a0 0x7f1ac006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:43.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.451+0000 7f1ad956b700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1ac00692a0 0x7f1ac006b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b970 tx=0x7f1ad0009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:43.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.455+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/576905842 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1ac4056be0 con 0x7f1ad40fdc30 2024-05-09T06:27:43.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.735+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f1ad4104800 con 0x7f1ad40fdc30 2024-05-09T06:27:43.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.735+0000 7f1ac9ffb700 1 -- 172.21.15.62:0/576905842 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7f1ac4056770 con 0x7f1ad40fdc30 2024-05-09T06:27:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1ac00692a0 msgr2=0x7f1ac006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1ac00692a0 0x7f1ac006b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b970 tx=0x7f1ad0009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fdc30 msgr2=0x7f1ad4112750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fdc30 0x7f1ad4112750 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4002a50 tx=0x7f1ac4004600 comp rx=0 tx=0).stop 2024-05-09T06:27:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 shutdown_connections 2024-05-09T06:27:43.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f1ac00692a0 0x7f1ac006b750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad40fd2e0 0x7f1ad40fb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 --2- 172.21.15.62:0/576905842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40fdc30 0x7f1ad4112750 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.737+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 >> 172.21.15.62:0/576905842 conn(0x7f1ad40f6be0 msgr2=0x7f1ad40f82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:43.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.738+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 shutdown_connections 2024-05-09T06:27:43.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:43.738+0000 7f1adb7cf700 1 -- 172.21.15.62:0/576905842 wait complete. 2024-05-09T06:27:43.730 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:27:44.077 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:44.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:44.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:44.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:44.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:43 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:44.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:43 smithi062 ceph-mon[26920]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:44.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:43 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/576905842' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-09T06:27:44.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:44.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:44.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:44.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:44.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:43 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:44.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:43 smithi079 ceph-mon[35268]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:44.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:43 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/576905842' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-09T06:27:44.379 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-05-09T06:27:44.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T06:27:44.661 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:45.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:45.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:45.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:27:45.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 -- 172.21.15.62:0/3177693725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 msgr2=0x7f41040fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 --2- 172.21.15.62:0/3177693725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 0x7f41040fe230 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009ce0 tx=0x7f40f4004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 -- 172.21.15.62:0/3177693725 shutdown_connections 2024-05-09T06:27:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 --2- 172.21.15.62:0/3177693725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41040fe800 0x7f4104106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 --2- 172.21.15.62:0/3177693725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 0x7f41040fe230 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:46.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 -- 172.21.15.62:0/3177693725 >> 172.21.15.62:0/3177693725 conn(0x7f41040f7870 msgr2=0x7f41040f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 -- 172.21.15.62:0/3177693725 shutdown_connections 2024-05-09T06:27:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 -- 172.21.15.62:0/3177693725 wait complete. 2024-05-09T06:27:46.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 Processor -- start 2024-05-09T06:27:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.208+0000 7f4109c6d700 1 -- start start 2024-05-09T06:27:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f4109c6d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 0x7f41040fbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f4109c6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41040fe800 0x7f41040fc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f4109c6d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41040fdbe0 con 0x7f41040fde60 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f4109c6d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41040fc710 con 0x7f41040fe800 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f41037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 0x7f41040fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f41037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 0x7f41040fbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42164/0 (socket says 172.21.15.62:42164) 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f41037fe700 1 -- 172.21.15.62:0/1314117536 learned_addr learned my addr 172.21.15.62:0/1314117536 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f4102ffd700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41040fe800 0x7f41040fc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f41037fe700 1 -- 172.21.15.62:0/1314117536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41040fe800 msgr2=0x7f41040fc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f41037fe700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41040fe800 0x7f41040fc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f41037fe700 1 -- 172.21.15.62:0/1314117536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f4009940 con 0x7f41040fde60 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f41037fe700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 0x7f41040fbc90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f40f4007c00 tx=0x7f40f4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.209+0000 7f40fbfff700 1 -- 172.21.15.62:0/1314117536 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f400e070 con 0x7f41040fde60 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.210+0000 7f40fbfff700 1 -- 172.21.15.62:0/1314117536 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40f40128e0 con 0x7f41040fde60 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.210+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41040fc9f0 con 0x7f41040fde60 2024-05-09T06:27:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.210+0000 7f40fbfff700 1 -- 172.21.15.62:0/1314117536 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f401b890 con 0x7f41040fde60 2024-05-09T06:27:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.210+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4104119fe0 con 0x7f41040fde60 2024-05-09T06:27:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.211+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4104066ad0 con 0x7f41040fde60 2024-05-09T06:27:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.211+0000 7f40fbfff700 1 -- 172.21.15.62:0/1314117536 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f40f4019040 con 0x7f41040fde60 2024-05-09T06:27:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.212+0000 7f40fbfff700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40f00692a0 0x7f40f006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.212+0000 7f4102ffd700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40f00692a0 0x7f40f006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:46.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.212+0000 7f40fbfff700 1 -- 172.21.15.62:0/1314117536 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f40f4088650 con 0x7f41040fde60 2024-05-09T06:27:46.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.212+0000 7f4102ffd700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40f00692a0 0x7f40f006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41040fd3c0 tx=0x7f40ec00b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:46.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.216+0000 7f40fbfff700 1 -- 172.21.15.62:0/1314117536 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f40f4054900 con 0x7f41040fde60 2024-05-09T06:27:46.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:46 smithi079 ceph-mon[35268]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:46.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:46 smithi062 ceph-mon[26920]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:46.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.457+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f410404c710 con 0x7f41040fde60 2024-05-09T06:27:46.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.458+0000 7f40fbfff700 1 -- 172.21.15.62:0/1314117536 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4680 (secure 0 0 0) 0x7f40f4057f20 con 0x7f41040fde60 2024-05-09T06:27:46.440 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:27:46.440 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6829/490880971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":490880971},{"type":"v1","addr":"172.21.15.62:6829","nonce":490880971}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:27:30.542268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi062.etsgzx","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6827/2962760421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2962760421},{"type":"v1","addr":"172.21.15.62:6827","nonce":2962760421}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-05-09T06:27:46.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40f00692a0 msgr2=0x7f40f006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40f00692a0 0x7f40f006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41040fd3c0 tx=0x7f40ec00b040 comp rx=0 tx=0).stop 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 msgr2=0x7f41040fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 0x7f41040fbc90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f40f4007c00 tx=0x7f40f4004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 shutdown_connections 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f40f00692a0 0x7f40f006b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41040fde60 0x7f41040fbc90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 --2- 172.21.15.62:0/1314117536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41040fe800 0x7f41040fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 >> 172.21.15.62:0/1314117536 conn(0x7f41040f7870 msgr2=0x7f41040f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 shutdown_connections 2024-05-09T06:27:46.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:46.460+0000 7f4109c6d700 1 -- 172.21.15.62:0/1314117536 wait complete. 2024-05-09T06:27:46.444 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:27:47.054 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2024-05-09T06:27:47.054 INFO:teuthology.run_tasks:Running task kclient... 2024-05-09T06:27:47.078 INFO:tasks.kclient:Mounting kernel clients... 2024-05-09T06:27:47.079 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-05-09T06:27:47.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:47.079 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-09T06:27:47.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:47.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-05-09T06:27:47.170 INFO:teuthology.orchestra.run.smithi062.stderr:Cannot find device "ceph-brx" 2024-05-09T06:27:47.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:27:47.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:47.172 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-05-09T06:27:47.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:47.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-05-09T06:27:47.259 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:47 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1314117536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:27:47.268 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2024-05-09T06:27:47.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:27:47.269 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-09T06:27:47.270 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T06:27:47.270 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T06:27:47.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T06:27:47.294 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:47 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1314117536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:27:47.546 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:48.331 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:48 smithi062 ceph-mon[26920]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:48.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:48 smithi079 ceph-mon[35268]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:49.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 -- 172.21.15.62:0/3270781269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fbf40 msgr2=0x7fb580101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:49.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 --2- 172.21.15.62:0/3270781269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fbf40 0x7fb580101a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb574004940 tx=0x7fb574009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:49.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 -- 172.21.15.62:0/3270781269 shutdown_connections 2024-05-09T06:27:49.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 --2- 172.21.15.62:0/3270781269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fbf40 0x7fb580101a30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:49.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 --2- 172.21.15.62:0/3270781269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5800fb5a0 0x7fb5800fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:49.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 -- 172.21.15.62:0/3270781269 >> 172.21.15.62:0/3270781269 conn(0x7fb580073350 msgr2=0x7fb580073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:49.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 -- 172.21.15.62:0/3270781269 shutdown_connections 2024-05-09T06:27:49.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 -- 172.21.15.62:0/3270781269 wait complete. 2024-05-09T06:27:49.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 Processor -- start 2024-05-09T06:27:49.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 -- start start 2024-05-09T06:27:49.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fb5a0 0x7fb580113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:49.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5800fbf40 0x7fb580113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:49.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580114670 con 0x7fb5800fb5a0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.112+0000 7fb584bd0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58010dbc0 con 0x7fb5800fbf40 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb57e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fb5a0 0x7fb580113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb57e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fb5a0 0x7fb580113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42180/0 (socket says 172.21.15.62:42180) 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb57e59c700 1 -- 172.21.15.62:0/2701845414 learned_addr learned my addr 172.21.15.62:0/2701845414 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb57dd9b700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5800fbf40 0x7fb580113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb57e59c700 1 -- 172.21.15.62:0/2701845414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5800fbf40 msgr2=0x7fb580113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb57e59c700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5800fbf40 0x7fb580113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb57e59c700 1 -- 172.21.15.62:0/2701845414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574005040 con 0x7fb5800fb5a0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb57e59c700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fb5a0 0x7fb580113a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb57000b790 tx=0x7fb570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb56effd700 1 -- 172.21.15.62:0/2701845414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb57000f6f0 con 0x7fb5800fb5a0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb56effd700 1 -- 172.21.15.62:0/2701845414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb57000fd20 con 0x7fb5800fb5a0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58010de40 con 0x7fb5800fb5a0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb56effd700 1 -- 172.21.15.62:0/2701845414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5700103a0 con 0x7fb5800fb5a0 2024-05-09T06:27:49.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.113+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58010e350 con 0x7fb5800fb5a0 2024-05-09T06:27:49.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.114+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5800fe670 con 0x7fb5800fb5a0 2024-05-09T06:27:49.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.115+0000 7fb56effd700 1 -- 172.21.15.62:0/2701845414 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb570011400 con 0x7fb5800fb5a0 2024-05-09T06:27:49.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.115+0000 7fb56effd700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb5680692a0 0x7fb56806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:49.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.115+0000 7fb56effd700 1 -- 172.21.15.62:0/2701845414 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb570086ea0 con 0x7fb5800fb5a0 2024-05-09T06:27:49.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.115+0000 7fb57dd9b700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb5680692a0 0x7fb56806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:49.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.116+0000 7fb57dd9b700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb5680692a0 0x7fb56806b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb57400b3b0 tx=0x7fb574009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:49.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.120+0000 7fb56effd700 1 -- 172.21.15.62:0/2701845414 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb570056d00 con 0x7fb5800fb5a0 2024-05-09T06:27:49.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.360+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb58010f0a0 con 0x7fb5800fb5a0 2024-05-09T06:27:49.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.361+0000 7fb56effd700 1 -- 172.21.15.62:0/2701845414 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fb570056890 con 0x7fb5800fb5a0 2024-05-09T06:27:49.344 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-09T06:27:49.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb5680692a0 msgr2=0x7fb56806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:49.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb5680692a0 0x7fb56806b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb57400b3b0 tx=0x7fb574009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:49.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fb5a0 msgr2=0x7fb580113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:49.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fb5a0 0x7fb580113a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb57000b790 tx=0x7fb570009250 comp rx=0 tx=0).stop 2024-05-09T06:27:49.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 shutdown_connections 2024-05-09T06:27:49.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb5680692a0 0x7fb56806b750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:49.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5800fb5a0 0x7fb580113a50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:49.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 --2- 172.21.15.62:0/2701845414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5800fbf40 0x7fb580113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:49.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 >> 172.21.15.62:0/2701845414 conn(0x7fb580073350 msgr2=0x7fb5800f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:49.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 shutdown_connections 2024-05-09T06:27:49.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:49.363+0000 7fb584bd0700 1 -- 172.21.15.62:0/2701845414 wait complete. 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T06:27:49.997 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T06:27:49.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:49.998 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-05-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-05-09T06:27:50.055 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42225sec preferred_lft 42225sec 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-05-09T06:27:50.056 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:27:50.057 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T06:27:50.057 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:50.057 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-09T06:27:50.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2024-05-09T06:27:50.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2024-05-09T06:27:50.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2024-05-09T06:27:50.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T06:27:50.058 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-09T06:27:50.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:50.222 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:50 smithi062 ceph-mon[26920]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:50.222 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:50 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2701845414' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T06:27:50.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:50.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:50.268 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T06:27:50.294 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-05-09T06:27:50.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:50.295 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-05-09T06:27:50.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:50 smithi079 ceph-mon[35268]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:50.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:50 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2701845414' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T06:27:50.367 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-05-09T06:27:50.367 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T06:27:50.367 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T06:27:50.367 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T06:27:50.367 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T06:27:50.367 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:50.367 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-09T06:27:50.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T06:27:50.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T06:27:50.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T06:27:50.368 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-09T06:27:50.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:50.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:50.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:50.698 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-09T06:27:50.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:50.715 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2024-05-09T06:27:50.772 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:50.772 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-09T06:27:50.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T06:27:50.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T06:27:50.772 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-09T06:27:50.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:50.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:50.893 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T06:27:50.893 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:50.893 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-09T06:27:50.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T06:27:50.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T06:27:50.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T06:27:50.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T06:27:50.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T06:27:50.894 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-09T06:27:50.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:51.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:51.020 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:51.021 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-09T06:27:51.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2024-05-09T06:27:51.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T06:27:51.021 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-09T06:27:51.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:51.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:51.104 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T06:27:51.104 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T06:27:51.131 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T06:27:51.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T06:27:51.131 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T06:27:51.190 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T06:27:51.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:51.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T06:27:51.284 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T06:27:51.284 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T06:27:51.284 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2024-05-09T06:27:51.390 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T06:27:51.390 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T06:27:51.390 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2024-05-09T06:27:51.390 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.79:3300" 2024-05-09T06:27:51.390 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T06:27:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T06:27:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T06:27:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2024-05-09T06:27:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.79:3300" 2024-05-09T06:27:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T06:27:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.79:6789" 2024-05-09T06:27:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.79:6789:/ 2024-05-09T06:27:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f8b094b6-0dcb-11ef-bc97-c7b262605968" will pass to kernel 2024-05-09T06:27:51.396 INFO:teuthology.orchestra.run.smithi062.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-09T06:27:51.396 INFO:teuthology.orchestra.run.smithi062.stdout: You just mounted a file system that supports labels which does not 2024-05-09T06:27:51.396 INFO:teuthology.orchestra.run.smithi062.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T06:27:51.396 INFO:teuthology.orchestra.run.smithi062.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T06:27:51.396 INFO:teuthology.orchestra.run.smithi062.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T06:27:51.398 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T06:27:51.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:51.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T06:27:51.430 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:27:51.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:27:51.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:51.534 INFO:teuthology.orchestra.run.smithi062.stdout:client14526 2024-05-09T06:27:51.534 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:27:51.535 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:27:51.552 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:27:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:27:51.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:51.654 INFO:teuthology.orchestra.run.smithi062.stdout:client14526 2024-05-09T06:27:51.655 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:27:51.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:27:51.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:51.718 INFO:teuthology.orchestra.run.smithi062.stdout:client14526 2024-05-09T06:27:51.718 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968.client14526/status') 2024-05-09T06:27:51.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:51.782 INFO:teuthology.orchestra.run.smithi062.stdout:instance: client.14526 (3)192.168.0.1:0/2072281023 2024-05-09T06:27:51.782 INFO:teuthology.orchestra.run.smithi062.stdout:blocklisted: false 2024-05-09T06:27:51.782 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records in 2024-05-09T06:27:51.782 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records out 2024-05-09T06:27:51.783 INFO:teuthology.orchestra.run.smithi062.stderr:70 bytes copied, 2.4283e-05 s, 2.9 MB/s 2024-05-09T06:27:51.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:51.790 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-09T06:27:51.790 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T06:27:51.790 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T06:27:51.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T06:27:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:52.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:52 smithi079 ceph-mon[35268]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:52.384 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:52 smithi062 ceph-mon[26920]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.586+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/1950869072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14102610 msgr2=0x7f3d140fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.586+0000 7f3d1a9ae700 1 --2- 172.21.15.62:0/1950869072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14102610 0x7f3d140fbc80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc004940 tx=0x7f3cfc009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.586+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/1950869072 shutdown_connections 2024-05-09T06:27:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.586+0000 7f3d1a9ae700 1 --2- 172.21.15.62:0/1950869072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14102610 0x7f3d140fbc80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.586+0000 7f3d1a9ae700 1 --2- 172.21.15.62:0/1950869072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d14101c70 0x7f3d14102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.586+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/1950869072 >> 172.21.15.62:0/1950869072 conn(0x7f3d140f7820 msgr2=0x7f3d140f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.586+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/1950869072 shutdown_connections 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.586+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/1950869072 wait complete. 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d1a9ae700 1 Processor -- start 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d1a9ae700 1 -- start start 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d1a9ae700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14101c70 0x7f3d1410ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d1a9ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d14102610 0x7f3d1410f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d1a9ae700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1410f6b0 con 0x7f3d14101c70 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d1a9ae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1410f7f0 con 0x7f3d14102610 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14101c70 0x7f3d1410ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d13fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14101c70 0x7f3d1410ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42206/0 (socket says 172.21.15.62:42206) 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d13fff700 1 -- 172.21.15.62:0/376354128 learned_addr learned my addr 172.21.15.62:0/376354128 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d0bfff700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d14102610 0x7f3d1410f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d13fff700 1 -- 172.21.15.62:0/376354128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d14102610 msgr2=0x7f3d1410f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d13fff700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d14102610 0x7f3d1410f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.587+0000 7f3d13fff700 1 -- 172.21.15.62:0/376354128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc005040 con 0x7f3d14101c70 2024-05-09T06:27:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.588+0000 7f3d13fff700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14101c70 0x7f3d1410ec30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3d04002a50 tx=0x7f3d040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.588+0000 7f3d117fa700 1 -- 172.21.15.62:0/376354128 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d04007cc0 con 0x7f3d14101c70 2024-05-09T06:27:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.588+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d14117ae0 con 0x7f3d14101c70 2024-05-09T06:27:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.588+0000 7f3d117fa700 1 -- 172.21.15.62:0/376354128 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d0400f040 con 0x7f3d14101c70 2024-05-09T06:27:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.588+0000 7f3d117fa700 1 -- 172.21.15.62:0/376354128 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0400da30 con 0x7f3d14101c70 2024-05-09T06:27:53.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.588+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d14118070 con 0x7f3d14101c70 2024-05-09T06:27:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.589+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d140fd3c0 con 0x7f3d14101c70 2024-05-09T06:27:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.589+0000 7f3d117fa700 1 -- 172.21.15.62:0/376354128 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3d0400dbf0 con 0x7f3d14101c70 2024-05-09T06:27:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.590+0000 7f3d117fa700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3d000692a0 0x7f3d0006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.590+0000 7f3d117fa700 1 -- 172.21.15.62:0/376354128 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3d04086e70 con 0x7f3d14101c70 2024-05-09T06:27:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.590+0000 7f3d0bfff700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3d000692a0 0x7f3d0006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:53.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.590+0000 7f3d0bfff700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3d000692a0 0x7f3d0006b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc004890 tx=0x7f3cfc009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:53.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.594+0000 7f3d117fa700 1 -- 172.21.15.62:0/376354128 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3d040531a0 con 0x7f3d14101c70 2024-05-09T06:27:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.841+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d14066640 con 0x7f3d14101c70 2024-05-09T06:27:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.841+0000 7f3d117fa700 1 -- 172.21.15.62:0/376354128 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f3d0400dea0 con 0x7f3d14101c70 2024-05-09T06:27:53.824 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3d000692a0 msgr2=0x7f3d0006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3d000692a0 0x7f3d0006b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc004890 tx=0x7f3cfc009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14101c70 msgr2=0x7f3d1410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14101c70 0x7f3d1410ec30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3d04002a50 tx=0x7f3d040046b0 comp rx=0 tx=0).stop 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 shutdown_connections 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f3d000692a0 0x7f3d0006b750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d14101c70 0x7f3d1410ec30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 --2- 172.21.15.62:0/376354128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d14102610 0x7f3d1410f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 >> 172.21.15.62:0/376354128 conn(0x7f3d140f7820 msgr2=0x7f3d140f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:53.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 shutdown_connections 2024-05-09T06:27:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:53.844+0000 7f3d1a9ae700 1 -- 172.21.15.62:0/376354128 wait complete. 2024-05-09T06:27:54.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:54 smithi062 ceph-mon[26920]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:54.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:54 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/376354128' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T06:27:54.460 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T06:27:54.460 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T06:27:54.460 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-05-09T06:27:54.460 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-09T06:27:54.460 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T06:27:54.460 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T06:27:54.461 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T06:27:54.461 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T06:27:54.461 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-09T06:27:54.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:54.461 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-05-09T06:27:54.481 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T06:27:54.481 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T06:27:54.481 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T06:27:54.481 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:27:54.481 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42218sec preferred_lft 42218sec 2024-05-09T06:27:54.482 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-05-09T06:27:54.483 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:27:54.483 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T06:27:54.483 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:54.483 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-05-09T06:27:54.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-05-09T06:27:54.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-05-09T06:27:54.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-05-09T06:27:54.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T06:27:54.483 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-05-09T06:27:54.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:54.587 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:54 smithi079 ceph-mon[35268]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:54.588 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:54 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/376354128' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T06:27:54.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:54.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:54.691 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T06:27:54.716 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-05-09T06:27:54.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:54.718 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-05-09T06:27:54.786 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-05-09T06:27:54.786 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T06:27:54.786 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T06:27:54.786 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T06:27:54.786 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T06:27:54.787 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:54.787 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-05-09T06:27:54.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T06:27:54.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T06:27:54.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T06:27:54.787 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-05-09T06:27:54.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:55.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:55.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:55.079 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-05-09T06:27:55.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:55.095 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-05-09T06:27:55.151 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:55.151 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-05-09T06:27:55.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T06:27:55.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-09T06:27:55.151 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-05-09T06:27:55.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:55.268 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-09T06:27:55.269 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:55.269 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-05-09T06:27:55.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-09T06:27:55.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T06:27:55.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-09T06:27:55.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-09T06:27:55.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-09T06:27:55.269 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-05-09T06:27:55.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:55.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:55.395 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:27:55.395 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-05-09T06:27:55.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-05-09T06:27:55.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T06:27:55.396 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-05-09T06:27:55.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:55.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:55.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T06:27:55.472 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-09T06:27:55.487 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-09T06:27:55.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T06:27:55.488 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-09T06:27:55.539 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T06:27:55.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:55.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T06:27:55.632 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T06:27:55.632 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T06:27:55.632 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-05-09T06:27:55.754 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T06:27:55.754 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T06:27:55.754 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-05-09T06:27:55.754 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.79:3300" 2024-05-09T06:27:55.754 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T06:27:55.759 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T06:27:55.759 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T06:27:55.759 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-05-09T06:27:55.759 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.79:3300" 2024-05-09T06:27:55.759 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T06:27:55.759 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.79:6789" 2024-05-09T06:27:55.760 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.79:6789:/ 2024-05-09T06:27:55.760 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f8b094b6-0dcb-11ef-bc97-c7b262605968" will pass to kernel 2024-05-09T06:27:55.760 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-09T06:27:55.760 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-05-09T06:27:55.760 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T06:27:55.760 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T06:27:55.760 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T06:27:55.762 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T06:27:55.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:27:55.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-09T06:27:55.787 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:27:55.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:27:55.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:55.885 INFO:teuthology.orchestra.run.smithi079.stdout:client14532 2024-05-09T06:27:55.885 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:27:55.885 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:27:55.902 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:27:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:27:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:55.998 INFO:teuthology.orchestra.run.smithi079.stdout:client14532 2024-05-09T06:27:55.999 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:27:56.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:27:56.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:56.055 INFO:teuthology.orchestra.run.smithi079.stdout:client14532 2024-05-09T06:27:56.055 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968.client14532/status') 2024-05-09T06:27:56.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:27:56.113 INFO:teuthology.orchestra.run.smithi079.stdout:instance: client.14532 (3)172.21.15.79:0/875005746 2024-05-09T06:27:56.113 INFO:teuthology.orchestra.run.smithi079.stdout:blocklisted: false 2024-05-09T06:27:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records in 2024-05-09T06:27:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records out 2024-05-09T06:27:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:70 bytes copied, 3.8058e-05 s, 1.8 MB/s 2024-05-09T06:27:56.114 INFO:teuthology.orchestra.run.smithi079.stderr:2024-05-09T06:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:27:56.120 INFO:teuthology.run_tasks:Running task print... 2024-05-09T06:27:56.130 INFO:teuthology.task.print:**** done client 2024-05-09T06:27:56.130 INFO:teuthology.run_tasks:Running task parallel... 2024-05-09T06:27:56.139 INFO:teuthology.task.parallel:starting parallel... 2024-05-09T06:27:56.139 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-09T06:27:56.140 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T06:27:56.140 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:27:56.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-09T06:27:56.141 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-09T06:27:56.141 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-09T06:27:56.144 INFO:tasks.workunit:Pulling workunits from ref 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:27:56.144 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T06:27:56.144 INFO:tasks.workunit:timeout=3h 2024-05-09T06:27:56.144 INFO:tasks.workunit:cleanup=True 2024-05-09T06:27:56.145 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T06:27:56.166 INFO:teuthology.orchestra.run.smithi062.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T06:27:56.166 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-09T06:27:56.166 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 90h/144d Inode: 1 Links: 2 2024-05-09T06:27:56.166 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:27:56.167 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-09T06:27:56.167 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T06:27:56.167 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-09 06:27:20.445909260 +0000 2024-05-09T06:27:56.167 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-09 06:27:51.446133604 +0000 2024-05-09T06:27:56.167 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-09 06:27:20.445909260 +0000 2024-05-09T06:27:56.167 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T06:27:56.167 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T06:27:56.238 DEBUG:teuthology.orchestra.run.smithi079:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6fh/111d Inode: 1 Links: 3 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-05-09 06:27:56.251054943 +0000 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-05-09 06:27:56.251054943 +0000 2024-05-09T06:27:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-05-09 06:27:20.445909260 +0000 2024-05-09T06:27:56.255 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-09T06:27:56.256 DEBUG:teuthology.orchestra.run.smithi079:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-09T06:27:56.323 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:27:56.324 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:27:56.341 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T06:27:56.380 INFO:tasks.workunit.client.1.smithi079.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-09T06:27:56.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:56 smithi062 ceph-mon[26920]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:27:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:56.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:56 smithi079 ceph-mon[35268]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:27:58.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.090+0000 7fa7b5935700 1 -- 172.21.15.62:0/3317716743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fce60 msgr2=0x7fa7b00fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.090+0000 7fa7b5935700 1 --2- 172.21.15.62:0/3317716743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fce60 0x7fa7b00fd270 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0004940 tx=0x7fa7a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.091+0000 7fa7b5935700 1 -- 172.21.15.62:0/3317716743 shutdown_connections 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.091+0000 7fa7b5935700 1 --2- 172.21.15.62:0/3317716743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00fdfd0 0x7fa7b00fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.091+0000 7fa7b5935700 1 --2- 172.21.15.62:0/3317716743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fce60 0x7fa7b00fd270 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.091+0000 7fa7b5935700 1 -- 172.21.15.62:0/3317716743 >> 172.21.15.62:0/3317716743 conn(0x7fa7b00f8540 msgr2=0x7fa7b00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.091+0000 7fa7b5935700 1 -- 172.21.15.62:0/3317716743 shutdown_connections 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.091+0000 7fa7b5935700 1 -- 172.21.15.62:0/3317716743 wait complete. 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.091+0000 7fa7b5935700 1 Processor -- start 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.091+0000 7fa7b5935700 1 -- start start 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7b5935700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00fce60 0x7fa7b010d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7b5935700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fdfd0 0x7fa7b010dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7b5935700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b010e200 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7b5935700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b010e370 con 0x7fa7b00fce60 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7ae7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fdfd0 0x7fa7b010dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7ae7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fdfd0 0x7fa7b010dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53306/0 (socket says 172.21.15.62:53306) 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7ae7fc700 1 -- 172.21.15.62:0/1125173974 learned_addr learned my addr 172.21.15.62:0/1125173974 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7aeffd700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00fce60 0x7fa7b010d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7ae7fc700 1 -- 172.21.15.62:0/1125173974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00fce60 msgr2=0x7fa7b010d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7ae7fc700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00fce60 0x7fa7b010d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7ae7fc700 1 -- 172.21.15.62:0/1125173974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0005040 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7ae7fc700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fdfd0 0x7fa7b010dc00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4002a50 tx=0x7fa7a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7977fe700 1 -- 172.21.15.62:0/1125173974 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7a4007cc0 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b0112dd0 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7977fe700 1 -- 172.21.15.62:0/1125173974 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7a400f040 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7977fe700 1 -- 172.21.15.62:0/1125173974 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7a400da30 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.092+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b0113360 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.094+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b004c710 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.094+0000 7fa7977fe700 1 -- 172.21.15.62:0/1125173974 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa7a400db90 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.094+0000 7fa7977fe700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa7980692a0 0x7fa79806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.094+0000 7fa7977fe700 1 -- 172.21.15.62:0/1125173974 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa7a4086f50 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.094+0000 7fa7aeffd700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa7980692a0 0x7fa79806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:58.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.095+0000 7fa7aeffd700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa7980692a0 0x7fa79806b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009fd0 tx=0x7fa7a0009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:58.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.099+0000 7fa7977fe700 1 -- 172.21.15.62:0/1125173974 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa7a4056c90 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.303+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fa7b01058c0 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.304+0000 7fa7977fe700 1 -- 172.21.15.62:0/1125173974 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fa7a4056820 con 0x7fa7b00fdfd0 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.305+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa7980692a0 msgr2=0x7fa79806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa7980692a0 0x7fa79806b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009fd0 tx=0x7fa7a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fdfd0 msgr2=0x7fa7b010dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fdfd0 0x7fa7b010dc00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4002a50 tx=0x7fa7a40046b0 comp rx=0 tx=0).stop 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 shutdown_connections 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fa7980692a0 0x7fa79806b750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7b00fce60 0x7fa7b010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 --2- 172.21.15.62:0/1125173974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b00fdfd0 0x7fa7b010dc00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:58.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 >> 172.21.15.62:0/1125173974 conn(0x7fa7b00f8540 msgr2=0x7fa7b00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:58.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 shutdown_connections 2024-05-09T06:27:58.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:27:58.306+0000 7fa7b5935700 1 -- 172.21.15.62:0/1125173974 wait complete. 2024-05-09T06:27:58.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:58 smithi062 ceph-mon[26920]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:27:58.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:58 smithi079 ceph-mon[35268]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:27:58.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-09T06:27:59.265 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:27:59.390 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:27:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:59.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:27:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:00.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:00 smithi062 ceph-mon[26920]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-05-09T06:28:00.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:00 smithi079 ceph-mon[35268]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-05-09T06:28:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.057+0000 7f03d58c5700 1 -- 172.21.15.62:0/4279056985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 msgr2=0x7f03d00fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.057+0000 7f03d58c5700 1 --2- 172.21.15.62:0/4279056985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 0x7f03d00fae70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f03c4004940 tx=0x7f03c4009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.057+0000 7f03d58c5700 1 -- 172.21.15.62:0/4279056985 shutdown_connections 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.057+0000 7f03d58c5700 1 --2- 172.21.15.62:0/4279056985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 0x7f03d00fae70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.057+0000 7f03d58c5700 1 --2- 172.21.15.62:0/4279056985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03d00fe3e0 0x7f03d00fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.057+0000 7f03d58c5700 1 -- 172.21.15.62:0/4279056985 >> 172.21.15.62:0/4279056985 conn(0x7f03d00f6b80 msgr2=0x7f03d00f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.057+0000 7f03d58c5700 1 -- 172.21.15.62:0/4279056985 shutdown_connections 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.057+0000 7f03d58c5700 1 -- 172.21.15.62:0/4279056985 wait complete. 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03d58c5700 1 Processor -- start 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03d58c5700 1 -- start start 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03d58c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03d00fe3e0 0x7f03d00fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03d58c5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 0x7f03d00fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03d58c5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00fc650 con 0x7f03d00fed30 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03d58c5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d00fc7c0 con 0x7f03d00fe3e0 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03ce7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 0x7f03d00fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03ce7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 0x7f03d00fc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53332/0 (socket says 172.21.15.62:53332) 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03ceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03d00fe3e0 0x7f03d00fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.058+0000 7f03ce7fc700 1 -- 172.21.15.62:0/1711522753 learned_addr learned my addr 172.21.15.62:0/1711522753 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03ce7fc700 1 -- 172.21.15.62:0/1711522753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03d00fe3e0 msgr2=0x7f03d00fdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03ce7fc700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03d00fe3e0 0x7f03d00fdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03ce7fc700 1 -- 172.21.15.62:0/1711522753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4005040 con 0x7f03d00fed30 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03ce7fc700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 0x7f03d00fc0a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f03c4013870 tx=0x7f03c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03b77fe700 1 -- 172.21.15.62:0/1711522753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c4021070 con 0x7f03d00fed30 2024-05-09T06:28:01.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03b77fe700 1 -- 172.21.15.62:0/1711522753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03c4009430 con 0x7f03d00fed30 2024-05-09T06:28:01.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d00fca40 con 0x7f03d00fed30 2024-05-09T06:28:01.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03b77fe700 1 -- 172.21.15.62:0/1711522753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c400e070 con 0x7f03d00fed30 2024-05-09T06:28:01.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.059+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d0115990 con 0x7f03d00fed30 2024-05-09T06:28:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.060+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d005f5c0 con 0x7f03d00fed30 2024-05-09T06:28:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.061+0000 7f03b77fe700 1 -- 172.21.15.62:0/1711522753 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f03c401c750 con 0x7f03d00fed30 2024-05-09T06:28:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.061+0000 7f03b77fe700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f03b8069230 0x7f03b806b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.061+0000 7f03b77fe700 1 -- 172.21.15.62:0/1711522753 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f03c4088460 con 0x7f03d00fed30 2024-05-09T06:28:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.062+0000 7f03ceffd700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f03b8069230 0x7f03b806b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.062+0000 7f03ceffd700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f03b8069230 0x7f03b806b6e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03d00fd960 tx=0x7f03c000b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:01.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.066+0000 7f03b77fe700 1 -- 172.21.15.62:0/1711522753 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f03c4054790 con 0x7f03d00fed30 2024-05-09T06:28:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.276+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f03d004bed0 con 0x7f03d00fed30 2024-05-09T06:28:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.276+0000 7f03b77fe700 1 -- 172.21.15.62:0/1711522753 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f03c4057db0 con 0x7f03d00fed30 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.278+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f03b8069230 msgr2=0x7f03b806b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.278+0000 7f03d58c5700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f03b8069230 0x7f03b806b6e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03d00fd960 tx=0x7f03c000b040 comp rx=0 tx=0).stop 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.278+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 msgr2=0x7f03d00fc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.278+0000 7f03d58c5700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 0x7f03d00fc0a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f03c4013870 tx=0x7f03c4009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.278+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 shutdown_connections 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.278+0000 7f03d58c5700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f03b8069230 0x7f03b806b6e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.278+0000 7f03d58c5700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03d00fe3e0 0x7f03d00fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.278+0000 7f03d58c5700 1 --2- 172.21.15.62:0/1711522753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03d00fed30 0x7f03d00fc0a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.279+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 >> 172.21.15.62:0/1711522753 conn(0x7f03d00f6b80 msgr2=0x7f03d00f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.279+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 shutdown_connections 2024-05-09T06:28:01.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:01.279+0000 7f03d58c5700 1 -- 172.21.15.62:0/1711522753 wait complete. 2024-05-09T06:28:01.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:01 smithi062 ceph-mon[26920]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-05-09T06:28:02.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-09T06:28:02.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:01 smithi079 ceph-mon[35268]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-05-09T06:28:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:28:04.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:04 smithi062 ceph-mon[26920]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.325+0000 7ff4ec91d700 1 -- 172.21.15.62:0/2859310848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e80fff40 msgr2=0x7ff4e8102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.325+0000 7ff4ec91d700 1 --2- 172.21.15.62:0/2859310848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e80fff40 0x7ff4e8102320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc004940 tx=0x7ff4dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.325+0000 7ff4ec91d700 1 -- 172.21.15.62:0/2859310848 shutdown_connections 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.325+0000 7ff4ec91d700 1 --2- 172.21.15.62:0/2859310848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e80fff40 0x7ff4e8102320 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.325+0000 7ff4ec91d700 1 --2- 172.21.15.62:0/2859310848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e8066260 0x7ff4e80ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.325+0000 7ff4ec91d700 1 -- 172.21.15.62:0/2859310848 >> 172.21.15.62:0/2859310848 conn(0x7ff4e80f7430 msgr2=0x7ff4e80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.325+0000 7ff4ec91d700 1 -- 172.21.15.62:0/2859310848 shutdown_connections 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.325+0000 7ff4ec91d700 1 -- 172.21.15.62:0/2859310848 wait complete. 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.326+0000 7ff4ec91d700 1 Processor -- start 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.326+0000 7ff4ec91d700 1 -- start start 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.326+0000 7ff4ec91d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e8066260 0x7ff4e810fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.326+0000 7ff4ec91d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80fff40 0x7ff4e8110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.326+0000 7ff4ec91d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e8110710 con 0x7ff4e8066260 2024-05-09T06:28:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.326+0000 7ff4ec91d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e8110f10 con 0x7ff4e80fff40 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4e659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e8066260 0x7ff4e810fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4e659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e8066260 0x7ff4e810fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46748/0 (socket says 172.21.15.62:46748) 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4e659c700 1 -- 172.21.15.62:0/1151850941 learned_addr learned my addr 172.21.15.62:0/1151850941 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4e5d9b700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80fff40 0x7ff4e8110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4e659c700 1 -- 172.21.15.62:0/1151850941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80fff40 msgr2=0x7ff4e8110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4e659c700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80fff40 0x7ff4e8110110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4e659c700 1 -- 172.21.15.62:0/1151850941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc005040 con 0x7ff4e8066260 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4e659c700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e8066260 0x7ff4e810fbd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800eb70 tx=0x7ff4d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4d6ffd700 1 -- 172.21.15.62:0/1151850941 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d8007cc0 con 0x7ff4e8066260 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4d6ffd700 1 -- 172.21.15.62:0/1151850941 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4d800f040 con 0x7ff4e8066260 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e8111190 con 0x7ff4e8066260 2024-05-09T06:28:04.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4d6ffd700 1 -- 172.21.15.62:0/1151850941 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d800cb20 con 0x7ff4e8066260 2024-05-09T06:28:04.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.327+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e81116d0 con 0x7ff4e8066260 2024-05-09T06:28:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.329+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e805f5c0 con 0x7ff4e8066260 2024-05-09T06:28:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.329+0000 7ff4d6ffd700 1 -- 172.21.15.62:0/1151850941 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff4d800cc80 con 0x7ff4e8066260 2024-05-09T06:28:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.330+0000 7ff4d6ffd700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff4d00692a0 0x7ff4d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.330+0000 7ff4d6ffd700 1 -- 172.21.15.62:0/1151850941 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff4d8086ba0 con 0x7ff4e8066260 2024-05-09T06:28:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.330+0000 7ff4e5d9b700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff4d00692a0 0x7ff4d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.330+0000 7ff4e5d9b700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff4d00692a0 0x7ff4d006b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009b30 tx=0x7ff4dc009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:04.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.334+0000 7ff4d6ffd700 1 -- 172.21.15.62:0/1151850941 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff4d804e250 con 0x7ff4e8066260 2024-05-09T06:28:04.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.557+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7ff4e804bed0 con 0x7ff4e8066260 2024-05-09T06:28:04.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.557+0000 7ff4d6ffd700 1 -- 172.21.15.62:0/1151850941 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7ff4d8056700 con 0x7ff4e8066260 2024-05-09T06:28:04.621 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:04 smithi079 ceph-mon[35268]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff4d00692a0 msgr2=0x7ff4d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff4d00692a0 0x7ff4d006b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009b30 tx=0x7ff4dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e8066260 msgr2=0x7ff4e810fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e8066260 0x7ff4e810fbd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800eb70 tx=0x7ff4d800b040 comp rx=0 tx=0).stop 2024-05-09T06:28:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 shutdown_connections 2024-05-09T06:28:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff4d00692a0 0x7ff4d006b750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff4e8066260 0x7ff4e810fbd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:04.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 --2- 172.21.15.62:0/1151850941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4e80fff40 0x7ff4e8110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:04.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 >> 172.21.15.62:0/1151850941 conn(0x7ff4e80f7430 msgr2=0x7ff4e80fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:04.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 shutdown_connections 2024-05-09T06:28:04.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:04.560+0000 7ff4ec91d700 1 -- 172.21.15.62:0/1151850941 wait complete. 2024-05-09T06:28:05.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-05-09T06:28:05.627 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:28:06.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:06 smithi062 ceph-mon[26920]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:06 smithi079 ceph-mon[35268]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.479+0000 7f092341a700 1 -- 172.21.15.62:0/385732098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c066220 msgr2=0x7f091c0ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.479+0000 7f092341a700 1 --2- 172.21.15.62:0/385732098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c066220 0x7f091c0ffa40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0918004940 tx=0x7f0918009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.479+0000 7f092341a700 1 -- 172.21.15.62:0/385732098 shutdown_connections 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.479+0000 7f092341a700 1 --2- 172.21.15.62:0/385732098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c0fff80 0x7f091c102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.479+0000 7f092341a700 1 --2- 172.21.15.62:0/385732098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c066220 0x7f091c0ffa40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.479+0000 7f092341a700 1 -- 172.21.15.62:0/385732098 >> 172.21.15.62:0/385732098 conn(0x7f091c0f7430 msgr2=0x7f091c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.479+0000 7f092341a700 1 -- 172.21.15.62:0/385732098 shutdown_connections 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.479+0000 7f092341a700 1 -- 172.21.15.62:0/385732098 wait complete. 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f092341a700 1 Processor -- start 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f092341a700 1 -- start start 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f092341a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c066220 0x7f091c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f092341a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c0fff80 0x7f091c10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f092341a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c10e540 con 0x7f091c0fff80 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f092341a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c10ed40 con 0x7f091c066220 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f09211b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c066220 0x7f091c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f09209b5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c0fff80 0x7f091c10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f09211b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c066220 0x7f091c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:39532/0 (socket says 172.21.15.62:39532) 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.480+0000 7f09211b6700 1 -- 172.21.15.62:0/885256169 learned_addr learned my addr 172.21.15.62:0/885256169 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f09211b6700 1 -- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c0fff80 msgr2=0x7f091c10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f09211b6700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c0fff80 0x7f091c10df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f09211b6700 1 -- 172.21.15.62:0/885256169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918005040 con 0x7f091c066220 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f09209b5700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c0fff80 0x7f091c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f09211b6700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c066220 0x7f091c10da00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0918004090 tx=0x7f0918009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:07.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f0911ffb700 1 -- 172.21.15.62:0/885256169 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0918021070 con 0x7f091c066220 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f0911ffb700 1 -- 172.21.15.62:0/885256169 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f091801c400 con 0x7f091c066220 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f0911ffb700 1 -- 172.21.15.62:0/885256169 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f091800e070 con 0x7f091c066220 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.481+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c10efc0 con 0x7f091c066220 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.482+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c10f4b0 con 0x7f091c066220 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.483+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c05f5c0 con 0x7f091c066220 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.483+0000 7f0911ffb700 1 -- 172.21.15.62:0/885256169 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f091801ca90 con 0x7f091c066220 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.483+0000 7f0911ffb700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f09080692b0 0x7f090806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.483+0000 7f0911ffb700 1 -- 172.21.15.62:0/885256169 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0918088570 con 0x7f091c066220 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.483+0000 7f09209b5700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f09080692b0 0x7f090806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:07.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.484+0000 7f09209b5700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f09080692b0 0x7f090806b760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f090c009b80 tx=0x7f090c00b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:07.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.488+0000 7f0911ffb700 1 -- 172.21.15.62:0/885256169 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0918058290 con 0x7f091c066220 2024-05-09T06:28:07.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:07.704+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f091c10f790 con 0x7f09080692b0 2024-05-09T06:28:08.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:08 smithi062 ceph-mon[26920]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-05-09T06:28:08.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:08 smithi079 ceph-mon[35268]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-05-09T06:28:09.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:09 smithi062 ceph-mon[26920]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:09.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:09 smithi079 ceph-mon[35268]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:10.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:10 smithi062 ceph-mon[26920]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-05-09T06:28:10.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:10 smithi079 ceph-mon[35268]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-05-09T06:28:12.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:12 smithi062 ceph-mon[26920]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T06:28:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:12 smithi079 ceph-mon[35268]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T06:28:14.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:14 smithi062 ceph-mon[26920]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T06:28:14.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:14 smithi079 ceph-mon[35268]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T06:28:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:16.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:16 smithi062 ceph-mon[26920]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:16.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:16 smithi079 ceph-mon[35268]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:18.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:18 smithi062 ceph-mon[26920]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:18 smithi079 ceph-mon[35268]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:20.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:20 smithi062 ceph-mon[26920]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:20.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:20 smithi079 ceph-mon[35268]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:22.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:22 smithi079 ceph-mon[35268]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:22 smithi062 ceph-mon[26920]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:24 smithi079 ceph-mon[35268]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:24 smithi062 ceph-mon[26920]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:26.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:26 smithi062 ceph-mon[26920]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:26.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:26 smithi079 ceph-mon[35268]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:28.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:28 smithi062 ceph-mon[26920]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:28.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:28 smithi079 ceph-mon[35268]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:29.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:30.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:30 smithi062 ceph-mon[26920]: pgmap v214: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:30.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:30 smithi079 ceph-mon[35268]: pgmap v214: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:32.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:32 smithi079 ceph-mon[35268]: pgmap v215: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:32.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:32 smithi062 ceph-mon[26920]: pgmap v215: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:34.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:34 smithi079 ceph-mon[35268]: pgmap v216: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:34.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:34 smithi062 ceph-mon[26920]: pgmap v216: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:36.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:36 smithi079 ceph-mon[35268]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-09T06:28:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:36 smithi062 ceph-mon[26920]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-09T06:28:38.474 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:38 smithi062 ceph-mon[26920]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:38 smithi079 ceph-mon[35268]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:39.654 INFO:teuthology.orchestra.run.smithi062.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:39.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.672+0000 7f0911ffb700 1 -- 172.21.15.62:0/885256169 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f091c10f790 con 0x7f09080692b0 2024-05-09T06:28:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f09080692b0 msgr2=0x7f090806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f09080692b0 0x7f090806b760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f090c009b80 tx=0x7f090c00b040 comp rx=0 tx=0).stop 2024-05-09T06:28:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c066220 msgr2=0x7f091c10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c066220 0x7f091c10da00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0918004090 tx=0x7f0918009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 shutdown_connections 2024-05-09T06:28:39.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f09080692b0 0x7f090806b760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c066220 0x7f091c10da00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 --2- 172.21.15.62:0/885256169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f091c0fff80 0x7f091c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 >> 172.21.15.62:0/885256169 conn(0x7f091c0f7430 msgr2=0x7f091c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 shutdown_connections 2024-05-09T06:28:39.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:39.675+0000 7f092341a700 1 -- 172.21.15.62:0/885256169 wait complete. 2024-05-09T06:28:40.341 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:40 smithi062 ceph-mon[26920]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:40.341 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:40 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:28:40.341 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:40 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:28:40.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-05-09T06:28:40.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:40 smithi079 ceph-mon[35268]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:40.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:40 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:28:40.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:40 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:28:40.778 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:28:41.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:41 smithi062 ceph-mon[26920]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:41.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:28:41.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:28:41.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:41 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:28:41.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:41 smithi079 ceph-mon[35268]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:41.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:41 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:28:41.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:41 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:28:41.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:41 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:28:42.464 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:42 smithi062 ceph-mon[26920]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:42.464 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:42 smithi062 ceph-mon[26920]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.589+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1591090415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 msgr2=0x7fc398102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.589+0000 7fc3a02d9700 1 --2- 172.21.15.62:0/1591090415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 0x7fc398102300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc388004940 tx=0x7fc388009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.589+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1591090415 shutdown_connections 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.589+0000 7fc3a02d9700 1 --2- 172.21.15.62:0/1591090415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 0x7fc398102300 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.589+0000 7fc3a02d9700 1 --2- 172.21.15.62:0/1591090415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3980662c0 0x7fc3980ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.589+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1591090415 >> 172.21.15.62:0/1591090415 conn(0x7fc3980f7430 msgr2=0x7fc3980f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.590+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1591090415 shutdown_connections 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.590+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1591090415 wait complete. 2024-05-09T06:28:42.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.590+0000 7fc3a02d9700 1 Processor -- start 2024-05-09T06:28:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.590+0000 7fc3a02d9700 1 -- start start 2024-05-09T06:28:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc3a02d9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3980662c0 0x7fc3980fd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc3a02d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 0x7fc3980fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc3a02d9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc398111660 con 0x7fc3980662c0 2024-05-09T06:28:42.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc3a02d9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3981117a0 con 0x7fc3980ffee0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc39d874700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 0x7fc3980fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc39e075700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3980662c0 0x7fc3980fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc39d874700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 0x7fc3980fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:40558/0 (socket says 172.21.15.62:40558) 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc39d874700 1 -- 172.21.15.62:0/1958287780 learned_addr learned my addr 172.21.15.62:0/1958287780 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc39d874700 1 -- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3980662c0 msgr2=0x7fc3980fd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc39d874700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3980662c0 0x7fc3980fd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.591+0000 7fc39d874700 1 -- 172.21.15.62:0/1958287780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388005040 con 0x7fc3980ffee0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.592+0000 7fc39d874700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 0x7fc3980fb8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc38800b0d0 tx=0x7fc388009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.592+0000 7fc38effd700 1 -- 172.21.15.62:0/1958287780 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38800e030 con 0x7fc3980ffee0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.592+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3980fbde0 con 0x7fc3980ffee0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.592+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3980fc370 con 0x7fc3980ffee0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.592+0000 7fc38effd700 1 -- 172.21.15.62:0/1958287780 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc38801c400 con 0x7fc3980ffee0 2024-05-09T06:28:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.592+0000 7fc38effd700 1 -- 172.21.15.62:0/1958287780 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38800b630 con 0x7fc3980ffee0 2024-05-09T06:28:42.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.593+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39805f5c0 con 0x7fc3980ffee0 2024-05-09T06:28:42.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.594+0000 7fc38effd700 1 -- 172.21.15.62:0/1958287780 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc38800b8a0 con 0x7fc3980ffee0 2024-05-09T06:28:42.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.594+0000 7fc38effd700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc3840692a0 0x7fc38406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:42.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.594+0000 7fc38effd700 1 -- 172.21.15.62:0/1958287780 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc388088ab0 con 0x7fc3980ffee0 2024-05-09T06:28:42.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.594+0000 7fc39e075700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc3840692a0 0x7fc38406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:42.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.595+0000 7fc39e075700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc3840692a0 0x7fc38406b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3980fd0c0 tx=0x7fc39400b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:42.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.601+0000 7fc38effd700 1 -- 172.21.15.62:0/1958287780 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc388054ef0 con 0x7fc3980ffee0 2024-05-09T06:28:42.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:42 smithi079 ceph-mon[35268]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:42.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:42 smithi079 ceph-mon[35268]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:42.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.847+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3980fc6f0 con 0x7fc3840692a0 2024-05-09T06:28:42.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.848+0000 7fc38effd700 1 -- 172.21.15.62:0/1958287780 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fc3980fc6f0 con 0x7fc3840692a0 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.850+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc3840692a0 msgr2=0x7fc38406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.850+0000 7fc3a02d9700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc3840692a0 0x7fc38406b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3980fd0c0 tx=0x7fc39400b040 comp rx=0 tx=0).stop 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.850+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 msgr2=0x7fc3980fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.850+0000 7fc3a02d9700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 0x7fc3980fb8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc38800b0d0 tx=0x7fc388009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.850+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 shutdown_connections 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.851+0000 7fc3a02d9700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fc3840692a0 0x7fc38406b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.851+0000 7fc3a02d9700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3980662c0 0x7fc3980fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.851+0000 7fc3a02d9700 1 --2- 172.21.15.62:0/1958287780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3980ffee0 0x7fc3980fb8a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.851+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 >> 172.21.15.62:0/1958287780 conn(0x7fc3980f7430 msgr2=0x7fc3980f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.851+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 shutdown_connections 2024-05-09T06:28:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:42.851+0000 7fc3a02d9700 1 -- 172.21.15.62:0/1958287780 wait complete. 2024-05-09T06:28:42.847 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:28:42.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.000+0000 7f52d6808700 1 -- 172.21.15.62:0/678259363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fcf60 msgr2=0x7f52d00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:42.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.000+0000 7f52d6808700 1 --2- 172.21.15.62:0/678259363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fcf60 0x7f52d00fd3d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f52c40049c0 tx=0x7f52c4009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:42.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.000+0000 7f52d6808700 1 -- 172.21.15.62:0/678259363 shutdown_connections 2024-05-09T06:28:42.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.000+0000 7f52d6808700 1 --2- 172.21.15.62:0/678259363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fcf60 0x7f52d00fd3d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.000+0000 7f52d6808700 1 --2- 172.21.15.62:0/678259363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52d00fbcb0 0x7f52d00fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.000+0000 7f52d6808700 1 -- 172.21.15.62:0/678259363 >> 172.21.15.62:0/678259363 conn(0x7f52d00f7430 msgr2=0x7f52d00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:42.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.000+0000 7f52d6808700 1 -- 172.21.15.62:0/678259363 shutdown_connections 2024-05-09T06:28:42.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.000+0000 7f52d6808700 1 -- 172.21.15.62:0/678259363 wait complete. 2024-05-09T06:28:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.001+0000 7f52d6808700 1 Processor -- start 2024-05-09T06:28:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.001+0000 7f52d6808700 1 -- start start 2024-05-09T06:28:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.002+0000 7f52d6808700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fbcb0 0x7f52d010b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.002+0000 7f52d6808700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52d00fcf60 0x7f52d010bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.002+0000 7f52d6808700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d010c2d0 con 0x7f52d00fbcb0 2024-05-09T06:28:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.002+0000 7f52d6808700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d010cb20 con 0x7f52d00fcf60 2024-05-09T06:28:42.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.002+0000 7f52cffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fbcb0 0x7f52d010b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:42.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.002+0000 7f52cf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52d00fcf60 0x7f52d010bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:42.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.002+0000 7f52cf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52d00fcf60 0x7f52d010bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:40578/0 (socket says 172.21.15.62:40578) 2024-05-09T06:28:42.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.002+0000 7f52cf7fe700 1 -- 172.21.15.62:0/4150953805 learned_addr learned my addr 172.21.15.62:0/4150953805 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:28:42.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52cffff700 1 -- 172.21.15.62:0/4150953805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52d00fcf60 msgr2=0x7f52d010bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52cffff700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52d00fcf60 0x7f52d010bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52cffff700 1 -- 172.21.15.62:0/4150953805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4005040 con 0x7f52d00fbcb0 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52cffff700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fbcb0 0x7f52d010b790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009fd0 tx=0x7f52c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52ccff9700 1 -- 172.21.15.62:0/4150953805 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52c0004e90 con 0x7f52d00fbcb0 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d010cda0 con 0x7f52d00fbcb0 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52ccff9700 1 -- 172.21.15.62:0/4150953805 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52c000f040 con 0x7f52d00fbcb0 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52ccff9700 1 -- 172.21.15.62:0/4150953805 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52c000c9b0 con 0x7f52d00fbcb0 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.003+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d010d290 con 0x7f52d00fbcb0 2024-05-09T06:28:42.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.005+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d005f5c0 con 0x7f52d00fbcb0 2024-05-09T06:28:42.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.005+0000 7f52ccff9700 1 -- 172.21.15.62:0/4150953805 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f52c000cb60 con 0x7f52d00fbcb0 2024-05-09T06:28:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.006+0000 7f52ccff9700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f52b8069300 0x7f52b806b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.006+0000 7f52ccff9700 1 -- 172.21.15.62:0/4150953805 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f52c0086cc0 con 0x7f52d00fbcb0 2024-05-09T06:28:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.006+0000 7f52cf7fe700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f52b8069300 0x7f52b806b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.006+0000 7f52cf7fe700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f52b8069300 0x7f52b806b7b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52c400b830 tx=0x7f52c401e040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:42.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.010+0000 7f52ccff9700 1 -- 172.21.15.62:0/4150953805 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f52c004e250 con 0x7f52d00fbcb0 2024-05-09T06:28:43.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.328+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52d010d5c0 con 0x7f52b8069300 2024-05-09T06:28:43.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.330+0000 7f52ccff9700 1 -- 172.21.15.62:0/4150953805 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f52d010d5c0 con 0x7f52b8069300 2024-05-09T06:28:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f52b8069300 msgr2=0x7f52b806b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f52b8069300 0x7f52b806b7b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52c400b830 tx=0x7f52c401e040 comp rx=0 tx=0).stop 2024-05-09T06:28:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fbcb0 msgr2=0x7f52d010b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fbcb0 0x7f52d010b790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009fd0 tx=0x7f52c000b040 comp rx=0 tx=0).stop 2024-05-09T06:28:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 shutdown_connections 2024-05-09T06:28:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f52b8069300 0x7f52b806b7b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52d00fbcb0 0x7f52d010b790 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 --2- 172.21.15.62:0/4150953805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52d00fcf60 0x7f52d010bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 >> 172.21.15.62:0/4150953805 conn(0x7f52d00f7430 msgr2=0x7f52d00f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.334+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 shutdown_connections 2024-05-09T06:28:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.335+0000 7f52d6808700 1 -- 172.21.15.62:0/4150953805 wait complete. 2024-05-09T06:28:43.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.506+0000 7effe4905700 1 -- 172.21.15.62:0/2376387927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 msgr2=0x7effe00fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:43.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.506+0000 7effe4905700 1 --2- 172.21.15.62:0/2376387927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 0x7effe00fd2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7effd0004940 tx=0x7effd0009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:43.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.507+0000 7effe4905700 1 -- 172.21.15.62:0/2376387927 shutdown_connections 2024-05-09T06:28:43.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.507+0000 7effe4905700 1 --2- 172.21.15.62:0/2376387927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effe00fe090 0x7effe00fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.507+0000 7effe4905700 1 --2- 172.21.15.62:0/2376387927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 0x7effe00fd2a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.507+0000 7effe4905700 1 -- 172.21.15.62:0/2376387927 >> 172.21.15.62:0/2376387927 conn(0x7effe00f85c0 msgr2=0x7effe00fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:43.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.507+0000 7effe4905700 1 -- 172.21.15.62:0/2376387927 shutdown_connections 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.507+0000 7effe4905700 1 -- 172.21.15.62:0/2376387927 wait complete. 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.507+0000 7effe4905700 1 Processor -- start 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.507+0000 7effe4905700 1 -- start start 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.508+0000 7effe4905700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 0x7effe0102f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.508+0000 7effe4905700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effe00fe090 0x7effe0103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.508+0000 7effe4905700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0103ab0 con 0x7effe00fe090 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.508+0000 7effe4905700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0104320 con 0x7effe00fce90 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.508+0000 7effde59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 0x7effe0102f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.508+0000 7effde59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 0x7effe0102f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:40588/0 (socket says 172.21.15.62:40588) 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.508+0000 7effde59c700 1 -- 172.21.15.62:0/3570723265 learned_addr learned my addr 172.21.15.62:0/3570723265 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.508+0000 7effddd9b700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effe00fe090 0x7effe0103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:43.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.509+0000 7effddd9b700 1 -- 172.21.15.62:0/3570723265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 msgr2=0x7effe0102f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:43.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.509+0000 7effddd9b700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 0x7effe0102f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.509+0000 7effddd9b700 1 -- 172.21.15.62:0/3570723265 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8005040 con 0x7effe00fe090 2024-05-09T06:28:43.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.509+0000 7effddd9b700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effe00fe090 0x7effe0103460 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7effc801a4d0 tx=0x7effc801ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:43.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.509+0000 7effd6ffd700 1 -- 172.21.15.62:0/3570723265 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc8028070 con 0x7effe00fe090 2024-05-09T06:28:43.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.510+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd0005040 con 0x7effe00fe090 2024-05-09T06:28:43.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.510+0000 7effd6ffd700 1 -- 172.21.15.62:0/3570723265 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effc8020040 con 0x7effe00fe090 2024-05-09T06:28:43.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.510+0000 7effd6ffd700 1 -- 172.21.15.62:0/3570723265 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc8024b10 con 0x7effe00fe090 2024-05-09T06:28:43.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.510+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe0104950 con 0x7effe00fe090 2024-05-09T06:28:43.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.511+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe006fc00 con 0x7effe00fe090 2024-05-09T06:28:43.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.513+0000 7effd6ffd700 1 -- 172.21.15.62:0/3570723265 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7effc801f600 con 0x7effe00fe090 2024-05-09T06:28:43.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.513+0000 7effd6ffd700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7effcc0693c0 0x7effcc06b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:43.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.513+0000 7effd6ffd700 1 -- 172.21.15.62:0/3570723265 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7effc8097e10 con 0x7effe00fe090 2024-05-09T06:28:43.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.514+0000 7effde59c700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7effcc0693c0 0x7effcc06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:43.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.514+0000 7effde59c700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7effcc0693c0 0x7effcc06b870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effd0004560 tx=0x7effd0009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:43.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.521+0000 7effd6ffd700 1 -- 172.21.15.62:0/3570723265 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7effc80640a0 con 0x7effe00fe090 2024-05-09T06:28:43.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.933+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effe006a0e0 con 0x7effcc0693c0 2024-05-09T06:28:43.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.954+0000 7effd6ffd700 1 -- 172.21.15.62:0/3570723265 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7effe006a0e0 con 0x7effcc0693c0 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (5m) 60s ago 7m 24.9M - 0.25.0 c8568f914cd2 b9c4737eec20 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (7m) 60s ago 7m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (6m) 66s ago 6m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (5m) 60s ago 6m 84.5M - 9.4.7 954c08fa6188 06a19fe449ea 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (79s) 60s ago 79s 12.1M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (85s) 60s ago 84s 15.9M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (77s) 66s ago 76s 12.0M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (82s) 66s ago 82s 12.1M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:28:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:9283 running (8m) 60s ago 8m 481M - 17.2.7-933-g4ba5a836 b96134859c76 f1bb37d51b2f 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283 running (5m) 66s ago 5m 433M - 17.2.7-933-g4ba5a836 b96134859c76 fb4cbe68939f 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (8m) 60s ago 8m 47.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (5m) 66s ago 5m 36.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (7m) 60s ago 7m 15.9M - 1.5.0 0da6a335fe13 a2eb68715549 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (5m) 66s ago 5m 15.7M - 1.5.0 0da6a335fe13 9d423500267f 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (5m) 60s ago 5m 45.6M 4288M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (4m) 60s ago 4m 48.0M 4288M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (4m) 60s ago 4m 46.4M 4288M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (3m) 66s ago 3m 44.5M 5312M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (3m) 66s ago 3m 42.1M 5312M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (2m) 66s ago 2m 41.4M 5312M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:28:43.937 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (5m) 60s ago 6m 58.4M - 2.43.0 a07b618ecd1d c90458655289 2024-05-09T06:28:43.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7effcc0693c0 msgr2=0x7effcc06b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:43.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7effcc0693c0 0x7effcc06b870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effd0004560 tx=0x7effd0009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:43.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effe00fe090 msgr2=0x7effe0103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:43.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effe00fe090 0x7effe0103460 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7effc801a4d0 tx=0x7effc801ae40 comp rx=0 tx=0).stop 2024-05-09T06:28:43.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 shutdown_connections 2024-05-09T06:28:43.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7effcc0693c0 0x7effcc06b870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effe00fce90 0x7effe0102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 --2- 172.21.15.62:0/3570723265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effe00fe090 0x7effe0103460 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:43.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.957+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 >> 172.21.15.62:0/3570723265 conn(0x7effe00f85c0 msgr2=0x7effe00f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:43.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.958+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 shutdown_connections 2024-05-09T06:28:43.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:43.958+0000 7effe4905700 1 -- 172.21.15.62:0/3570723265 wait complete. 2024-05-09T06:28:44.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.128+0000 7f4d5bfd1700 1 -- 172.21.15.62:0/2315586263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 msgr2=0x7f4d541006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:44.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.128+0000 7f4d5bfd1700 1 --2- 172.21.15.62:0/2315586263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 0x7f4d541006e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d44004940 tx=0x7f4d44009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:44.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.128+0000 7f4d5bfd1700 1 -- 172.21.15.62:0/2315586263 shutdown_connections 2024-05-09T06:28:44.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.128+0000 7f4d5bfd1700 1 --2- 172.21.15.62:0/2315586263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 0x7f4d541006e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.128+0000 7f4d5bfd1700 1 --2- 172.21.15.62:0/2315586263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d540fefc0 0x7f4d540ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.128+0000 7f4d5bfd1700 1 -- 172.21.15.62:0/2315586263 >> 172.21.15.62:0/2315586263 conn(0x7f4d540fa8f0 msgr2=0x7f4d540fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:44.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.129+0000 7f4d5bfd1700 1 -- 172.21.15.62:0/2315586263 shutdown_connections 2024-05-09T06:28:44.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.129+0000 7f4d5bfd1700 1 -- 172.21.15.62:0/2315586263 wait complete. 2024-05-09T06:28:44.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.129+0000 7f4d5bfd1700 1 Processor -- start 2024-05-09T06:28:44.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.129+0000 7f4d5bfd1700 1 -- start start 2024-05-09T06:28:44.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.130+0000 7f4d5bfd1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d540fefc0 0x7f4d5406ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:44.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.130+0000 7f4d5bfd1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 0x7f4d5406f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:44.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.130+0000 7f4d5bfd1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5406fa70 con 0x7f4d54100270 2024-05-09T06:28:44.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.130+0000 7f4d5bfd1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5406fbe0 con 0x7f4d540fefc0 2024-05-09T06:28:44.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.130+0000 7f4d59d6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d540fefc0 0x7f4d5406ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:44.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.130+0000 7f4d59d6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d540fefc0 0x7f4d5406ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:54274/0 (socket says 172.21.15.62:54274) 2024-05-09T06:28:44.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.130+0000 7f4d59d6d700 1 -- 172.21.15.62:0/3151730979 learned_addr learned my addr 172.21.15.62:0/3151730979 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:28:44.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.131+0000 7f4d5956c700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 0x7f4d5406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:44.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.131+0000 7f4d5956c700 1 -- 172.21.15.62:0/3151730979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d540fefc0 msgr2=0x7f4d5406ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:44.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.131+0000 7f4d5956c700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d540fefc0 0x7f4d5406ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.131+0000 7f4d5956c700 1 -- 172.21.15.62:0/3151730979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44005040 con 0x7f4d54100270 2024-05-09T06:28:44.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.131+0000 7f4d5956c700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 0x7f4d5406f470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d44000c00 tx=0x7f4d44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:44.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.132+0000 7f4d4a7fc700 1 -- 172.21.15.62:0/3151730979 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d4400e070 con 0x7f4d54100270 2024-05-09T06:28:44.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.132+0000 7f4d4a7fc700 1 -- 172.21.15.62:0/3151730979 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d4401c400 con 0x7f4d54100270 2024-05-09T06:28:44.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.132+0000 7f4d4a7fc700 1 -- 172.21.15.62:0/3151730979 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d4400b650 con 0x7f4d54100270 2024-05-09T06:28:44.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.132+0000 7f4d5bfd1700 1 -- 172.21.15.62:0/3151730979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5411d910 con 0x7f4d54100270 2024-05-09T06:28:44.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.132+0000 7f4d5bfd1700 1 -- 172.21.15.62:0/3151730979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5411de70 con 0x7f4d54100270 2024-05-09T06:28:44.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.134+0000 7f4d3ffff700 1 -- 172.21.15.62:0/3151730979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d340052b0 con 0x7f4d54100270 2024-05-09T06:28:44.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.136+0000 7f4d4a7fc700 1 -- 172.21.15.62:0/3151730979 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4d4401ca20 con 0x7f4d54100270 2024-05-09T06:28:44.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.137+0000 7f4d4a7fc700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4d400692a0 0x7f4d4006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:44.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.137+0000 7f4d4a7fc700 1 -- 172.21.15.62:0/3151730979 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4d44088b90 con 0x7f4d54100270 2024-05-09T06:28:44.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.138+0000 7f4d59d6d700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4d400692a0 0x7f4d4006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:44.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.138+0000 7f4d59d6d700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4d400692a0 0x7f4d4006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4d54119740 tx=0x7f4d5000b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:44.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.142+0000 7f4d4a7fc700 1 -- 172.21.15.62:0/3151730979 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4d440589f0 con 0x7f4d54100270 2024-05-09T06:28:44.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:44 smithi062 ceph-mon[26920]: from='client.24339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:44.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:44 smithi062 ceph-mon[26920]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T06:28:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:44 smithi062 ceph-mon[26920]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:28:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:28:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:28:44.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.578+0000 7f4d3ffff700 1 -- 172.21.15.62:0/3151730979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4d34005830 con 0x7f4d54100270 2024-05-09T06:28:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.579+0000 7f4d4a7fc700 1 -- 172.21.15.62:0/3151730979 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f4d44058580 con 0x7f4d54100270 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:28:44.561 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:28:44.562 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 14 2024-05-09T06:28:44.562 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:28:44.562 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:28:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 -- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4d400692a0 msgr2=0x7f4d4006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4d400692a0 0x7f4d4006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4d54119740 tx=0x7f4d5000b040 comp rx=0 tx=0).stop 2024-05-09T06:28:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 -- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 msgr2=0x7f4d5406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 0x7f4d5406f470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d44000c00 tx=0x7f4d44009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 -- 172.21.15.62:0/3151730979 shutdown_connections 2024-05-09T06:28:44.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4d400692a0 0x7f4d4006b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d540fefc0 0x7f4d5406ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 --2- 172.21.15.62:0/3151730979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d54100270 0x7f4d5406f470 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.581+0000 7f4d3ffff700 1 -- 172.21.15.62:0/3151730979 >> 172.21.15.62:0/3151730979 conn(0x7f4d540fa8f0 msgr2=0x7f4d54103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:44.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.582+0000 7f4d3ffff700 1 -- 172.21.15.62:0/3151730979 shutdown_connections 2024-05-09T06:28:44.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.582+0000 7f4d3ffff700 1 -- 172.21.15.62:0/3151730979 wait complete. 2024-05-09T06:28:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:44 smithi079 ceph-mon[35268]: from='client.24339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:44 smithi079 ceph-mon[35268]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T06:28:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:44 smithi079 ceph-mon[35268]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:28:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:28:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:28:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.691+0000 7f2378ce5700 1 -- 172.21.15.62:0/3585768217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2374066240 msgr2=0x7f23740ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.691+0000 7f2378ce5700 1 --2- 172.21.15.62:0/3585768217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2374066240 0x7f23740ffa20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2364004940 tx=0x7f2364009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.692+0000 7f2378ce5700 1 -- 172.21.15.62:0/3585768217 shutdown_connections 2024-05-09T06:28:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.692+0000 7f2378ce5700 1 --2- 172.21.15.62:0/3585768217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23740fff60 0x7f2374102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.692+0000 7f2378ce5700 1 --2- 172.21.15.62:0/3585768217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2374066240 0x7f23740ffa20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.692+0000 7f2378ce5700 1 -- 172.21.15.62:0/3585768217 >> 172.21.15.62:0/3585768217 conn(0x7f23740f7430 msgr2=0x7f23740f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:44.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.692+0000 7f2378ce5700 1 -- 172.21.15.62:0/3585768217 shutdown_connections 2024-05-09T06:28:44.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.692+0000 7f2378ce5700 1 -- 172.21.15.62:0/3585768217 wait complete. 2024-05-09T06:28:44.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.692+0000 7f2378ce5700 1 Processor -- start 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f2378ce5700 1 -- start start 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f2378ce5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2374066240 0x7f23740fd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f2378ce5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23740fff60 0x7f23740fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f2378ce5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23740fbeb0 con 0x7f23740fff60 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f2378ce5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23740fbff0 con 0x7f2374066240 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f237259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2374066240 0x7f23740fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f237259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2374066240 0x7f23740fd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:54290/0 (socket says 172.21.15.62:54290) 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f237259c700 1 -- 172.21.15.62:0/3460318316 learned_addr learned my addr 172.21.15.62:0/3460318316 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.693+0000 7f2371d9b700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23740fff60 0x7f23740fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f2371d9b700 1 -- 172.21.15.62:0/3460318316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2374066240 msgr2=0x7f23740fd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f2371d9b700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2374066240 0x7f23740fd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f2371d9b700 1 -- 172.21.15.62:0/3460318316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364005040 con 0x7f23740fff60 2024-05-09T06:28:44.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f237259c700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2374066240 0x7f23740fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:28:44.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f2371d9b700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23740fff60 0x7f23740fb920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2368009fd0 tx=0x7f236800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:44.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f2362ffd700 1 -- 172.21.15.62:0/3460318316 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2368004e90 con 0x7f23740fff60 2024-05-09T06:28:44.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f2362ffd700 1 -- 172.21.15.62:0/3460318316 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f236800f040 con 0x7f23740fff60 2024-05-09T06:28:44.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f2378ce5700 1 -- 172.21.15.62:0/3460318316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23740fc270 con 0x7f23740fff60 2024-05-09T06:28:44.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.694+0000 7f2378ce5700 1 -- 172.21.15.62:0/3460318316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23740fc6f0 con 0x7f23740fff60 2024-05-09T06:28:44.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.695+0000 7f2362ffd700 1 -- 172.21.15.62:0/3460318316 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236800c9b0 con 0x7f23740fff60 2024-05-09T06:28:44.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.696+0000 7f2360ff9700 1 -- 172.21.15.62:0/3460318316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237405f5c0 con 0x7f23740fff60 2024-05-09T06:28:44.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.697+0000 7f2362ffd700 1 -- 172.21.15.62:0/3460318316 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f236800cb10 con 0x7f23740fff60 2024-05-09T06:28:44.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.697+0000 7f2362ffd700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f235c069300 0x7f235c06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:44.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.698+0000 7f2362ffd700 1 -- 172.21.15.62:0/3460318316 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2368086bb0 con 0x7f23740fff60 2024-05-09T06:28:44.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.698+0000 7f237259c700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f235c069300 0x7f235c06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:44.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.698+0000 7f237259c700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f235c069300 0x7f235c06b7b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f236400b0d0 tx=0x7f2364009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:44.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.705+0000 7f2362ffd700 1 -- 172.21.15.62:0/3460318316 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f236804e250 con 0x7f23740fff60 2024-05-09T06:28:44.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.923+0000 7f2360ff9700 1 -- 172.21.15.62:0/3460318316 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2374105a30 con 0x7f235c069300 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.925+0000 7f2362ffd700 1 -- 172.21.15.62:0/3460318316 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f2374105a30 con 0x7f235c069300 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "0/2 daemons upgraded", 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc image on host smithi079", 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:28:44.907 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:28:44.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 -- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f235c069300 msgr2=0x7f235c06b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:44.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f235c069300 0x7f235c06b7b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f236400b0d0 tx=0x7f2364009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 -- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23740fff60 msgr2=0x7f23740fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23740fff60 0x7f23740fb920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2368009fd0 tx=0x7f236800b040 comp rx=0 tx=0).stop 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 -- 172.21.15.62:0/3460318316 shutdown_connections 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f235c069300 0x7f235c06b7b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2374066240 0x7f23740fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 --2- 172.21.15.62:0/3460318316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23740fff60 0x7f23740fb920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.927+0000 7f2360ff9700 1 -- 172.21.15.62:0/3460318316 >> 172.21.15.62:0/3460318316 conn(0x7f23740f7430 msgr2=0x7f23740f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.928+0000 7f2360ff9700 1 -- 172.21.15.62:0/3460318316 shutdown_connections 2024-05-09T06:28:44.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:28:44.928+0000 7f2360ff9700 1 -- 172.21.15.62:0/3460318316 wait complete. 2024-05-09T06:28:45.042 INFO:tasks.workunit.client.1.smithi079.stderr:Note: switching to '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'. 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr: 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr: 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr: 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr: git switch -c 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr: 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr:Or undo this operation with: 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr: 2024-05-09T06:28:45.043 INFO:tasks.workunit.client.1.smithi079.stderr: git switch - 2024-05-09T06:28:45.044 INFO:tasks.workunit.client.1.smithi079.stderr: 2024-05-09T06:28:45.044 INFO:tasks.workunit.client.1.smithi079.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T06:28:45.044 INFO:tasks.workunit.client.1.smithi079.stderr: 2024-05-09T06:28:45.044 INFO:tasks.workunit.client.1.smithi079.stderr:HEAD is now at 720f8e954cd Merge pull request #55437 from tchaikov/ehh-upstart 2024-05-09T06:28:45.045 DEBUG:teuthology.orchestra.run.smithi079:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-09T06:28:45.146 INFO:tasks.workunit.client.1.smithi079.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T06:28:45.149 INFO:tasks.workunit.client.1.smithi079.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T06:28:45.149 INFO:tasks.workunit.client.1.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T06:28:45.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:45 smithi079 ceph-mon[35268]: Upgrade: Target is version 19.0.0-3575-g720f8e95 (unknown) 2024-05-09T06:28:45.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:45 smithi079 ceph-mon[35268]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc'] 2024-05-09T06:28:45.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:45 smithi079 ceph-mon[35268]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:45.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:45 smithi079 ceph-mon[35268]: Upgrade: Need to upgrade myself (mgr.smithi062.juuasl) 2024-05-09T06:28:45.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:45 smithi079 ceph-mon[35268]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc on smithi079 2024-05-09T06:28:45.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:45 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3151730979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:28:45.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:45 smithi062 ceph-mon[26920]: Upgrade: Target is version 19.0.0-3575-g720f8e95 (unknown) 2024-05-09T06:28:45.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:45 smithi062 ceph-mon[26920]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc'] 2024-05-09T06:28:45.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:45 smithi062 ceph-mon[26920]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:45.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:45 smithi062 ceph-mon[26920]: Upgrade: Need to upgrade myself (mgr.smithi062.juuasl) 2024-05-09T06:28:45.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:45 smithi062 ceph-mon[26920]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc on smithi079 2024-05-09T06:28:45.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:45 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3151730979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:28:45.866 INFO:tasks.workunit.client.1.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T06:28:45.921 INFO:tasks.workunit.client.1.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T06:28:45.961 INFO:tasks.workunit.client.1.smithi079.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T06:28:45.963 INFO:tasks.workunit.client.1.smithi079.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T06:28:45.963 INFO:tasks.workunit.client.1.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T06:28:46.007 INFO:tasks.workunit.client.1.smithi079.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T06:28:46.010 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:28:46.011 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-09T06:28:46.026 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-05-09T06:28:46.029 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-09T06:28:46.029 DEBUG:teuthology.orchestra.run.smithi079:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-05-09T06:28:46.089 INFO:tasks.workunit.client.1.smithi079.stderr:+ mkdir -p fsstress 2024-05-09T06:28:46.090 INFO:tasks.workunit.client.1.smithi079.stderr:+ pushd fsstress 2024-05-09T06:28:46.091 INFO:tasks.workunit.client.1.smithi079.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T06:28:46.091 INFO:tasks.workunit.client.1.smithi079.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-09T06:28:46.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:46 smithi079 ceph-mon[35268]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:46.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:46 smithi079 ceph-mon[35268]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T06:28:46.606 INFO:tasks.workunit.client.1.smithi079.stderr:+ tar xzf ltp-full.tgz 2024-05-09T06:28:46.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:46 smithi062 ceph-mon[26920]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:46.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:46 smithi062 ceph-mon[26920]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T06:28:48.464 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:48 smithi062 ceph-mon[26920]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:28:48.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:48 smithi079 ceph-mon[35268]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:28:50.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:50 smithi079 ceph-mon[35268]: pgmap v224: 65 pgs: 65 active+clean; 2.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s wr, 0 op/s 2024-05-09T06:28:50.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:50 smithi062 ceph-mon[26920]: pgmap v224: 65 pgs: 65 active+clean; 2.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s wr, 0 op/s 2024-05-09T06:28:52.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:52 smithi079 ceph-mon[35268]: pgmap v225: 65 pgs: 65 active+clean; 2.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s wr, 0 op/s 2024-05-09T06:28:52.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:52 smithi062 ceph-mon[26920]: pgmap v225: 65 pgs: 65 active+clean; 2.8 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s wr, 0 op/s 2024-05-09T06:28:54.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:54 smithi062 ceph-mon[26920]: pgmap v226: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s wr, 60 op/s 2024-05-09T06:28:54.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:54 smithi079 ceph-mon[35268]: pgmap v226: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s wr, 60 op/s 2024-05-09T06:28:56.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:56 smithi079 ceph-mon[35268]: pgmap v227: 65 pgs: 65 active+clean; 22 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s wr, 131 op/s 2024-05-09T06:28:56.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:56 smithi062 ceph-mon[26920]: pgmap v227: 65 pgs: 65 active+clean; 22 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s wr, 131 op/s 2024-05-09T06:28:58.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:58 smithi079 ceph-mon[35268]: pgmap v228: 65 pgs: 65 active+clean; 37 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s wr, 241 op/s 2024-05-09T06:28:58.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:58 smithi062 ceph-mon[26920]: pgmap v228: 65 pgs: 65 active+clean; 37 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s wr, 241 op/s 2024-05-09T06:28:59.269 INFO:tasks.workunit.client.0.smithi062.stderr:Updating files: 96% (12135/12535) Updating files: 97% (12159/12535) Updating files: 98% (12285/12535) Updating files: 99% (12410/12535) Updating files: 100% (12535/12535) Updating files: 100% (12535/12535), done. 2024-05-09T06:28:59.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:28:59 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:59.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:28:59 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:59.739 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'. 2024-05-09T06:28:59.739 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-09T06:28:59.739 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T06:28:59.739 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T06:28:59.739 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T06:28:59.739 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-05-09T06:28:59.740 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 720f8e954cd Merge pull request #55437 from tchaikov/ehh-upstart 2024-05-09T06:28:59.741 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T06:29:00.013 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T06:29:00.016 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T06:29:00.016 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T06:29:00.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:00 smithi079 ceph-mon[35268]: pgmap v229: 65 pgs: 65 active+clean; 41 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 246 op/s 2024-05-09T06:29:00.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:00 smithi062 ceph-mon[26920]: pgmap v229: 65 pgs: 65 active+clean; 41 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 246 op/s 2024-05-09T06:29:02.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:02 smithi079 ceph-mon[35268]: pgmap v230: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 246 op/s 2024-05-09T06:29:02.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:02 smithi062 ceph-mon[26920]: pgmap v230: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 246 op/s 2024-05-09T06:29:04.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:04 smithi062 ceph-mon[26920]: pgmap v231: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 246 op/s 2024-05-09T06:29:04.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:04 smithi079 ceph-mon[35268]: pgmap v231: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 246 op/s 2024-05-09T06:29:05.329 INFO:tasks.workunit.client.1.smithi079.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-09T06:29:05.330 INFO:tasks.workunit.client.1.smithi079.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T06:29:05.330 INFO:tasks.workunit.client.1.smithi079.stderr:+ make 2024-05-09T06:29:05.458 INFO:tasks.workunit.client.1.smithi079.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-09T06:29:05.692 INFO:tasks.workunit.client.1.smithi079.stderr:++ readlink -f fsstress 2024-05-09T06:29:05.693 INFO:tasks.workunit.client.1.smithi079.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-09T06:29:05.693 INFO:tasks.workunit.client.1.smithi079.stderr:+ popd 2024-05-09T06:29:05.693 INFO:tasks.workunit.client.1.smithi079.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T06:29:05.693 INFO:tasks.workunit.client.1.smithi079.stderr:+ popd 2024-05-09T06:29:05.694 INFO:tasks.workunit.client.1.smithi079.stdout:~/cephtest/mnt.1/client.1/tmp 2024-05-09T06:29:05.694 INFO:tasks.workunit.client.1.smithi079.stderr:++ mktemp -d -p . 2024-05-09T06:29:05.695 INFO:tasks.workunit.client.1.smithi079.stderr:+ T=./tmp.7Uz5uDasSK 2024-05-09T06:29:05.695 INFO:tasks.workunit.client.1.smithi079.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.7Uz5uDasSK -l 1 -n 1000 -p 10 -v 2024-05-09T06:29:05.696 INFO:tasks.workunit.client.1.smithi079.stdout:seed = 1714847876 2024-05-09T06:29:05.699 INFO:tasks.workunit.client.1.smithi079.stdout:1/0: fdatasync - no filename 2024-05-09T06:29:05.699 INFO:tasks.workunit.client.1.smithi079.stdout:1/1: read - no filename 2024-05-09T06:29:05.699 INFO:tasks.workunit.client.1.smithi079.stdout:1/2: truncate - no filename 2024-05-09T06:29:05.699 INFO:tasks.workunit.client.1.smithi079.stdout:1/3: chown . 17883806 1 2024-05-09T06:29:05.699 INFO:tasks.workunit.client.1.smithi079.stdout:1/4: dwrite - no filename 2024-05-09T06:29:05.699 INFO:tasks.workunit.client.1.smithi079.stdout:1/5: dwrite - no filename 2024-05-09T06:29:05.700 INFO:tasks.workunit.client.1.smithi079.stdout:0/0: mknod c0 0 2024-05-09T06:29:05.700 INFO:tasks.workunit.client.1.smithi079.stdout:0/1: chown c0 610 1 2024-05-09T06:29:05.700 INFO:tasks.workunit.client.1.smithi079.stdout:0/2: truncate - no filename 2024-05-09T06:29:05.700 INFO:tasks.workunit.client.1.smithi079.stdout:0/3: rename c0 to c1 0 2024-05-09T06:29:05.701 INFO:tasks.workunit.client.1.smithi079.stdout:3/0: read - no filename 2024-05-09T06:29:05.701 INFO:tasks.workunit.client.1.smithi079.stdout:2/0: creat f0 x:0 0 0 2024-05-09T06:29:05.701 INFO:tasks.workunit.client.1.smithi079.stdout:2/1: dread - f0 zero size 2024-05-09T06:29:05.702 INFO:tasks.workunit.client.1.smithi079.stdout:0/4: symlink l2 0 2024-05-09T06:29:05.702 INFO:tasks.workunit.client.1.smithi079.stdout:0/5: dwrite - no filename 2024-05-09T06:29:05.703 INFO:tasks.workunit.client.1.smithi079.stdout:3/1: creat f0 x:0 0 0 2024-05-09T06:29:05.703 INFO:tasks.workunit.client.1.smithi079.stdout:3/2: creat f1 x:0 0 0 2024-05-09T06:29:05.703 INFO:tasks.workunit.client.1.smithi079.stdout:3/3: write f0 [1004381,23501] 0 2024-05-09T06:29:05.704 INFO:tasks.workunit.client.1.smithi079.stdout:2/2: rename f0 to f1 0 2024-05-09T06:29:05.704 INFO:tasks.workunit.client.1.smithi079.stdout:2/3: fdatasync f1 0 2024-05-09T06:29:05.704 INFO:tasks.workunit.client.1.smithi079.stdout:2/4: dread - f1 zero size 2024-05-09T06:29:05.704 INFO:tasks.workunit.client.1.smithi079.stdout:2/5: creat f2 x:0 0 0 2024-05-09T06:29:05.704 INFO:tasks.workunit.client.1.smithi079.stdout:0/6: mkdir d3 0 2024-05-09T06:29:05.706 INFO:tasks.workunit.client.1.smithi079.stdout:5/0: rename - no filename 2024-05-09T06:29:05.707 INFO:tasks.workunit.client.1.smithi079.stdout:5/1: chown . 1217 1 2024-05-09T06:29:05.711 INFO:tasks.workunit.client.1.smithi079.stdout:4/0: mknod c0 0 2024-05-09T06:29:05.711 INFO:tasks.workunit.client.1.smithi079.stdout:4/1: dread - no filename 2024-05-09T06:29:05.711 INFO:tasks.workunit.client.1.smithi079.stdout:4/2: truncate - no filename 2024-05-09T06:29:05.711 INFO:tasks.workunit.client.1.smithi079.stdout:4/3: stat c0 0 2024-05-09T06:29:05.711 INFO:tasks.workunit.client.1.smithi079.stdout:4/4: dwrite - no filename 2024-05-09T06:29:05.711 INFO:tasks.workunit.client.1.smithi079.stdout:4/5: readlink - no filename 2024-05-09T06:29:05.711 INFO:tasks.workunit.client.1.smithi079.stdout:4/6: dread - no filename 2024-05-09T06:29:05.712 INFO:tasks.workunit.client.1.smithi079.stdout:0/7: creat d3/f4 x:0 0 0 2024-05-09T06:29:05.715 INFO:tasks.workunit.client.1.smithi079.stdout:5/2: creat f0 x:0 0 0 2024-05-09T06:29:05.715 INFO:tasks.workunit.client.1.smithi079.stdout:4/7: creat f1 x:0 0 0 2024-05-09T06:29:05.717 INFO:tasks.workunit.client.1.smithi079.stdout:0/8: mkdir d3/d5 0 2024-05-09T06:29:05.718 INFO:tasks.workunit.client.1.smithi079.stdout:0/9: fdatasync d3/f4 0 2024-05-09T06:29:05.718 INFO:tasks.workunit.client.1.smithi079.stdout:7/0: dwrite - no filename 2024-05-09T06:29:05.718 INFO:tasks.workunit.client.1.smithi079.stdout:7/1: chown . 546054 1 2024-05-09T06:29:05.718 INFO:tasks.workunit.client.1.smithi079.stdout:7/2: dread - no filename 2024-05-09T06:29:05.721 INFO:tasks.workunit.client.1.smithi079.stdout:5/3: mknod c1 0 2024-05-09T06:29:05.721 INFO:tasks.workunit.client.1.smithi079.stdout:6/0: mkdir d0 0 2024-05-09T06:29:05.721 INFO:tasks.workunit.client.1.smithi079.stdout:6/1: write - no filename 2024-05-09T06:29:05.721 INFO:tasks.workunit.client.1.smithi079.stdout:6/2: chown d0 1229214 1 2024-05-09T06:29:05.721 INFO:tasks.workunit.client.1.smithi079.stdout:6/3: dread - no filename 2024-05-09T06:29:05.721 INFO:tasks.workunit.client.1.smithi079.stdout:6/4: unlink - no file 2024-05-09T06:29:05.721 INFO:tasks.workunit.client.1.smithi079.stdout:6/5: stat d0 0 2024-05-09T06:29:05.723 INFO:tasks.workunit.client.1.smithi079.stdout:4/8: rename f1 to f2 0 2024-05-09T06:29:05.724 INFO:tasks.workunit.client.1.smithi079.stdout:7/3: mknod c0 0 2024-05-09T06:29:05.725 INFO:tasks.workunit.client.1.smithi079.stdout:5/4: rename c1 to c2 0 2024-05-09T06:29:05.725 INFO:tasks.workunit.client.1.smithi079.stdout:5/5: dread - f0 zero size 2024-05-09T06:29:05.725 INFO:tasks.workunit.client.1.smithi079.stdout:5/6: rmdir - no directory 2024-05-09T06:29:05.727 INFO:tasks.workunit.client.1.smithi079.stdout:8/0: creat f0 x:0 0 0 2024-05-09T06:29:05.727 INFO:tasks.workunit.client.1.smithi079.stdout:8/1: rmdir - no directory 2024-05-09T06:29:05.730 INFO:tasks.workunit.client.1.smithi079.stdout:5/7: unlink f0 0 2024-05-09T06:29:05.730 INFO:tasks.workunit.client.1.smithi079.stdout:5/8: dread - no filename 2024-05-09T06:29:05.731 INFO:tasks.workunit.client.1.smithi079.stdout:9/0: creat f0 x:0 0 0 2024-05-09T06:29:05.731 INFO:tasks.workunit.client.1.smithi079.stdout:8/2: mkdir d1 0 2024-05-09T06:29:05.733 INFO:tasks.workunit.client.1.smithi079.stdout:9/1: mkdir d1 0 2024-05-09T06:29:05.733 INFO:tasks.workunit.client.1.smithi079.stdout:9/2: stat d1 0 2024-05-09T06:29:05.733 INFO:tasks.workunit.client.1.smithi079.stdout:9/3: fdatasync f0 0 2024-05-09T06:29:05.733 INFO:tasks.workunit.client.1.smithi079.stdout:9/4: getdents d1 0 2024-05-09T06:29:05.733 INFO:tasks.workunit.client.1.smithi079.stdout:9/5: read - f0 zero size 2024-05-09T06:29:05.733 INFO:tasks.workunit.client.1.smithi079.stdout:9/6: dread - f0 zero size 2024-05-09T06:29:05.737 INFO:tasks.workunit.client.1.smithi079.stdout:8/3: symlink d1/l2 0 2024-05-09T06:29:05.737 INFO:tasks.workunit.client.1.smithi079.stdout:8/4: write f0 [381387,53336] 0 2024-05-09T06:29:05.742 INFO:tasks.workunit.client.1.smithi079.stdout:8/5: mkdir d1/d3 0 2024-05-09T06:29:05.920 INFO:tasks.workunit.client.1.smithi079.stdout:3/4: dwrite f1 [0,4194304] 0 2024-05-09T06:29:06.154 INFO:tasks.workunit.client.1.smithi079.stdout:4/9: dwrite f2 [0,4194304] 0 2024-05-09T06:29:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:06 smithi079 ceph-mon[35268]: pgmap v232: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s wr, 192 op/s 2024-05-09T06:29:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:06 smithi062 ceph-mon[26920]: pgmap v232: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s wr, 192 op/s 2024-05-09T06:29:06.825 INFO:tasks.workunit.client.1.smithi079.stdout:5/9: link c2 c3 0 2024-05-09T06:29:06.825 INFO:tasks.workunit.client.1.smithi079.stdout:9/7: fsync f0 0 2024-05-09T06:29:06.825 INFO:tasks.workunit.client.1.smithi079.stdout:9/8: dread - f0 zero size 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/4: getdents . 0 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/5: dwrite - no filename 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/6: write - no filename 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/7: readlink - no filename 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/8: fsync - no filename 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/9: dwrite - no filename 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/10: dwrite - no filename 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/11: write - no filename 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/12: dread - no filename 2024-05-09T06:29:06.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/13: write - no filename 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:7/14: write - no filename 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:7/15: truncate - no filename 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:2/6: unlink f1 0 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:2/7: dread - f2 zero size 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:4/10: fsync f2 0 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:0/10: rename c1 to d3/d5/c6 0 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:6/6: rename d0 to d0/d1 22 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:6/7: dread - no filename 2024-05-09T06:29:06.857 INFO:tasks.workunit.client.1.smithi079.stdout:0/11: chown d3/d5 14106604 1 2024-05-09T06:29:06.858 INFO:tasks.workunit.client.1.smithi079.stdout:6/8: rename d0 to d0/d2 22 2024-05-09T06:29:06.858 INFO:tasks.workunit.client.1.smithi079.stdout:6/9: chown d0 1027976 1 2024-05-09T06:29:06.858 INFO:tasks.workunit.client.1.smithi079.stdout:6/10: dread - no filename 2024-05-09T06:29:06.858 INFO:tasks.workunit.client.1.smithi079.stdout:6/11: truncate - no filename 2024-05-09T06:29:06.858 INFO:tasks.workunit.client.1.smithi079.stdout:8/6: fsync f0 0 2024-05-09T06:29:06.976 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T06:29:07.134 INFO:tasks.workunit.client.1.smithi079.stdout:2/8: dwrite f2 [0,4194304] 0 2024-05-09T06:29:07.143 INFO:tasks.workunit.client.1.smithi079.stdout:2/9: dread f2 [0,4194304] 0 2024-05-09T06:29:07.143 INFO:tasks.workunit.client.1.smithi079.stdout:2/10: chown f2 47 1 2024-05-09T06:29:07.166 INFO:tasks.workunit.client.1.smithi079.stdout:8/7: dwrite f0 [0,4194304] 0 2024-05-09T06:29:07.166 INFO:tasks.workunit.client.1.smithi079.stdout:8/8: fdatasync f0 0 2024-05-09T06:29:07.581 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T06:29:07.700 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T06:29:07.702 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T06:29:07.702 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T06:29:07.875 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T06:29:07.879 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:29:07.879 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T06:29:07.895 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-05-09T06:29:07.897 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-09T06:29:07.897 DEBUG:teuthology.orchestra.run.smithi062:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-05-09T06:29:07.960 INFO:tasks.workunit.client.0.smithi062.stderr:+ mkdir -p fsstress 2024-05-09T06:29:07.962 INFO:tasks.workunit.client.0.smithi062.stderr:+ pushd fsstress 2024-05-09T06:29:07.963 INFO:tasks.workunit.client.0.smithi062.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T06:29:07.963 INFO:tasks.workunit.client.0.smithi062.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-09T06:29:08.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:08 smithi079 ceph-mon[35268]: pgmap v233: 65 pgs: 65 active+clean; 71 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.3 MiB/s wr, 204 op/s 2024-05-09T06:29:08.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:08 smithi062 ceph-mon[26920]: pgmap v233: 65 pgs: 65 active+clean; 71 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.3 MiB/s wr, 204 op/s 2024-05-09T06:29:10.182 INFO:tasks.workunit.client.1.smithi079.stdout:5/10: unlink c2 0 2024-05-09T06:29:10.186 INFO:tasks.workunit.client.1.smithi079.stdout:9/9: symlink d1/l2 0 2024-05-09T06:29:10.186 INFO:tasks.workunit.client.1.smithi079.stdout:9/10: chown d1 66 1 2024-05-09T06:29:10.196 INFO:tasks.workunit.client.1.smithi079.stdout:7/16: mknod c1 0 2024-05-09T06:29:10.196 INFO:tasks.workunit.client.1.smithi079.stdout:7/17: stat c0 0 2024-05-09T06:29:10.201 INFO:tasks.workunit.client.1.smithi079.stdout:9/11: dwrite f0 [0,4194304] 0 2024-05-09T06:29:10.201 INFO:tasks.workunit.client.1.smithi079.stdout:9/12: stat f0 0 2024-05-09T06:29:10.210 INFO:tasks.workunit.client.1.smithi079.stdout:0/12: mkdir d3/d7 0 2024-05-09T06:29:10.210 INFO:tasks.workunit.client.1.smithi079.stdout:0/13: dread - d3/f4 zero size 2024-05-09T06:29:10.210 INFO:tasks.workunit.client.1.smithi079.stdout:0/14: dread - d3/f4 zero size 2024-05-09T06:29:10.211 INFO:tasks.workunit.client.1.smithi079.stdout:6/12: symlink d0/l3 0 2024-05-09T06:29:10.216 INFO:tasks.workunit.client.1.smithi079.stdout:9/13: dwrite f0 [0,4194304] 0 2024-05-09T06:29:10.493 INFO:tasks.workunit.client.1.smithi079.stdout:2/11: link f2 f3 0 2024-05-09T06:29:10.496 INFO:tasks.workunit.client.1.smithi079.stdout:2/12: write f2 [419640,73484] 0 2024-05-09T06:29:10.513 INFO:tasks.workunit.client.1.smithi079.stdout:8/9: creat d1/d3/f4 x:0 0 0 2024-05-09T06:29:10.514 INFO:tasks.workunit.client.1.smithi079.stdout:2/13: dwrite f2 [0,4194304] 0 2024-05-09T06:29:10.514 INFO:tasks.workunit.client.1.smithi079.stdout:2/14: chown f2 64237 1 2024-05-09T06:29:10.519 INFO:tasks.workunit.client.1.smithi079.stdout:3/5: unlink f0 0 2024-05-09T06:29:10.519 INFO:tasks.workunit.client.1.smithi079.stdout:3/6: fsync f1 0 2024-05-09T06:29:10.527 INFO:tasks.workunit.client.1.smithi079.stdout:3/7: dread f1 [0,4194304] 0 2024-05-09T06:29:10.541 INFO:tasks.workunit.client.0.smithi062.stderr:+ tar xzf ltp-full.tgz 2024-05-09T06:29:10.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:10 smithi079 ceph-mon[35268]: pgmap v234: 65 pgs: 65 active+clean; 112 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 341 KiB/s rd, 6.4 MiB/s wr, 382 op/s 2024-05-09T06:29:10.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:10 smithi062 ceph-mon[26920]: pgmap v234: 65 pgs: 65 active+clean; 112 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 341 KiB/s rd, 6.4 MiB/s wr, 382 op/s 2024-05-09T06:29:11.352 INFO:tasks.workunit.client.1.smithi079.stdout:8/10: dwrite f0 [4194304,4194304] 0 2024-05-09T06:29:12.204 INFO:tasks.workunit.client.1.smithi079.stdout:7/18: rename c0 to c2 0 2024-05-09T06:29:12.208 INFO:tasks.workunit.client.1.smithi079.stdout:4/11: truncate f2 3773717 0 2024-05-09T06:29:12.208 INFO:tasks.workunit.client.1.smithi079.stdout:4/12: creat f3 x:0 0 0 2024-05-09T06:29:12.210 INFO:tasks.workunit.client.1.smithi079.stdout:0/15: creat d3/d5/f8 x:0 0 0 2024-05-09T06:29:12.211 INFO:tasks.workunit.client.1.smithi079.stdout:6/13: rmdir d0 39 2024-05-09T06:29:12.213 INFO:tasks.workunit.client.1.smithi079.stdout:9/14: link f0 d1/f3 0 2024-05-09T06:29:12.219 INFO:tasks.workunit.client.1.smithi079.stdout:2/15: symlink l4 0 2024-05-09T06:29:12.221 INFO:tasks.workunit.client.1.smithi079.stdout:9/15: write d1/f3 [4065969,35499] 0 2024-05-09T06:29:12.227 INFO:tasks.workunit.client.1.smithi079.stdout:9/16: dread f0 [0,4194304] 0 2024-05-09T06:29:12.228 INFO:tasks.workunit.client.1.smithi079.stdout:8/11: getdents d1 0 2024-05-09T06:29:12.229 INFO:tasks.workunit.client.1.smithi079.stdout:7/19: creat f3 x:0 0 0 2024-05-09T06:29:12.230 INFO:tasks.workunit.client.1.smithi079.stdout:2/16: dread f3 [0,4194304] 0 2024-05-09T06:29:12.230 INFO:tasks.workunit.client.1.smithi079.stdout:2/17: rmdir - no directory 2024-05-09T06:29:12.230 INFO:tasks.workunit.client.1.smithi079.stdout:2/18: creat f5 x:0 0 0 2024-05-09T06:29:12.235 INFO:tasks.workunit.client.1.smithi079.stdout:0/16: creat d3/d7/f9 x:0 0 0 2024-05-09T06:29:12.235 INFO:tasks.workunit.client.1.smithi079.stdout:0/17: creat d3/d7/fa x:0 0 0 2024-05-09T06:29:12.235 INFO:tasks.workunit.client.1.smithi079.stdout:0/18: fdatasync d3/d5/f8 0 2024-05-09T06:29:12.235 INFO:tasks.workunit.client.1.smithi079.stdout:0/19: write d3/d7/f9 [272519,53114] 0 2024-05-09T06:29:12.235 INFO:tasks.workunit.client.1.smithi079.stdout:6/14: symlink d0/l4 0 2024-05-09T06:29:12.235 INFO:tasks.workunit.client.1.smithi079.stdout:6/15: write - no filename 2024-05-09T06:29:12.236 INFO:tasks.workunit.client.1.smithi079.stdout:6/16: truncate - no filename 2024-05-09T06:29:12.236 INFO:tasks.workunit.client.1.smithi079.stdout:6/17: dread - no filename 2024-05-09T06:29:12.236 INFO:tasks.workunit.client.1.smithi079.stdout:3/8: getdents . 0 2024-05-09T06:29:12.239 INFO:tasks.workunit.client.1.smithi079.stdout:9/17: symlink d1/l4 0 2024-05-09T06:29:12.240 INFO:tasks.workunit.client.1.smithi079.stdout:9/18: chown d1/f3 65516093 1 2024-05-09T06:29:12.240 INFO:tasks.workunit.client.1.smithi079.stdout:9/19: read d1/f3 [317041,2591] 0 2024-05-09T06:29:12.241 INFO:tasks.workunit.client.1.smithi079.stdout:2/19: read f2 [2460767,99913] 0 2024-05-09T06:29:12.241 INFO:tasks.workunit.client.1.smithi079.stdout:8/12: rmdir d1 39 2024-05-09T06:29:12.247 INFO:tasks.workunit.client.1.smithi079.stdout:6/18: rmdir d0 39 2024-05-09T06:29:12.247 INFO:tasks.workunit.client.1.smithi079.stdout:6/19: dread - no filename 2024-05-09T06:29:12.248 INFO:tasks.workunit.client.1.smithi079.stdout:6/20: truncate - no filename 2024-05-09T06:29:12.248 INFO:tasks.workunit.client.1.smithi079.stdout:6/21: readlink d0/l3 0 2024-05-09T06:29:12.248 INFO:tasks.workunit.client.1.smithi079.stdout:2/20: dread f3 [0,4194304] 0 2024-05-09T06:29:12.248 INFO:tasks.workunit.client.1.smithi079.stdout:3/9: truncate f1 803277 0 2024-05-09T06:29:12.250 INFO:tasks.workunit.client.1.smithi079.stdout:7/20: dwrite f3 [0,4194304] 0 2024-05-09T06:29:12.250 INFO:tasks.workunit.client.1.smithi079.stdout:7/21: chown c2 63769 1 2024-05-09T06:29:12.251 INFO:tasks.workunit.client.1.smithi079.stdout:6/22: creat d0/f5 x:0 0 0 2024-05-09T06:29:12.251 INFO:tasks.workunit.client.1.smithi079.stdout:6/23: read - d0/f5 zero size 2024-05-09T06:29:12.252 INFO:tasks.workunit.client.1.smithi079.stdout:2/21: symlink l6 0 2024-05-09T06:29:12.252 INFO:tasks.workunit.client.1.smithi079.stdout:2/22: write f5 [794428,75601] 0 2024-05-09T06:29:12.252 INFO:tasks.workunit.client.1.smithi079.stdout:2/23: creat f7 x:0 0 0 2024-05-09T06:29:12.253 INFO:tasks.workunit.client.1.smithi079.stdout:8/13: dread f0 [0,4194304] 0 2024-05-09T06:29:12.253 INFO:tasks.workunit.client.1.smithi079.stdout:3/10: mknod c2 0 2024-05-09T06:29:12.257 INFO:tasks.workunit.client.1.smithi079.stdout:6/24: mkdir d0/d6 0 2024-05-09T06:29:12.258 INFO:tasks.workunit.client.1.smithi079.stdout:6/25: read - d0/f5 zero size 2024-05-09T06:29:12.258 INFO:tasks.workunit.client.1.smithi079.stdout:6/26: truncate d0/f5 969984 0 2024-05-09T06:29:12.260 INFO:tasks.workunit.client.1.smithi079.stdout:8/14: mkdir d1/d5 0 2024-05-09T06:29:12.261 INFO:tasks.workunit.client.1.smithi079.stdout:3/11: creat f3 x:0 0 0 2024-05-09T06:29:12.262 INFO:tasks.workunit.client.1.smithi079.stdout:3/12: chown f1 11 1 2024-05-09T06:29:12.262 INFO:tasks.workunit.client.1.smithi079.stdout:7/22: read f3 [3282938,120571] 0 2024-05-09T06:29:12.263 INFO:tasks.workunit.client.1.smithi079.stdout:6/27: symlink d0/l7 0 2024-05-09T06:29:12.265 INFO:tasks.workunit.client.1.smithi079.stdout:8/15: rename f0 to d1/d3/f6 0 2024-05-09T06:29:12.266 INFO:tasks.workunit.client.1.smithi079.stdout:7/23: mkdir d4 0 2024-05-09T06:29:12.268 INFO:tasks.workunit.client.1.smithi079.stdout:6/28: symlink d0/l8 0 2024-05-09T06:29:12.268 INFO:tasks.workunit.client.1.smithi079.stdout:6/29: chown d0/l7 429 1 2024-05-09T06:29:12.268 INFO:tasks.workunit.client.1.smithi079.stdout:6/30: readlink d0/l3 0 2024-05-09T06:29:12.269 INFO:tasks.workunit.client.1.smithi079.stdout:8/16: mknod d1/d5/c7 0 2024-05-09T06:29:12.270 INFO:tasks.workunit.client.1.smithi079.stdout:6/31: mknod d0/d6/c9 0 2024-05-09T06:29:12.272 INFO:tasks.workunit.client.1.smithi079.stdout:0/20: dwrite d3/f4 [0,4194304] 0 2024-05-09T06:29:12.272 INFO:tasks.workunit.client.1.smithi079.stdout:9/20: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:29:12.272 INFO:tasks.workunit.client.1.smithi079.stdout:9/21: chown d1/l4 485551074 1 2024-05-09T06:29:12.276 INFO:tasks.workunit.client.1.smithi079.stdout:6/32: rename d0/l4 to d0/d6/la 0 2024-05-09T06:29:12.276 INFO:tasks.workunit.client.1.smithi079.stdout:6/33: chown d0/d6/la 2 1 2024-05-09T06:29:12.278 INFO:tasks.workunit.client.1.smithi079.stdout:6/34: write d0/f5 [356019,111462] 0 2024-05-09T06:29:12.278 INFO:tasks.workunit.client.1.smithi079.stdout:6/35: write d0/f5 [1783785,49921] 0 2024-05-09T06:29:12.281 INFO:tasks.workunit.client.1.smithi079.stdout:0/21: mkdir d3/db 0 2024-05-09T06:29:12.283 INFO:tasks.workunit.client.1.smithi079.stdout:9/22: mkdir d1/d5 0 2024-05-09T06:29:12.283 INFO:tasks.workunit.client.1.smithi079.stdout:9/23: getdents d1/d5 0 2024-05-09T06:29:12.285 INFO:tasks.workunit.client.1.smithi079.stdout:6/36: mknod d0/d6/cb 0 2024-05-09T06:29:12.285 INFO:tasks.workunit.client.1.smithi079.stdout:6/37: chown d0 39 1 2024-05-09T06:29:12.285 INFO:tasks.workunit.client.1.smithi079.stdout:6/38: chown d0/d6/c9 52 1 2024-05-09T06:29:12.285 INFO:tasks.workunit.client.1.smithi079.stdout:6/39: chown d0/d6/cb 851780 1 2024-05-09T06:29:12.285 INFO:tasks.workunit.client.1.smithi079.stdout:6/40: creat d0/fc x:0 0 0 2024-05-09T06:29:12.285 INFO:tasks.workunit.client.1.smithi079.stdout:6/41: read d0/f5 [391159,16476] 0 2024-05-09T06:29:12.286 INFO:tasks.workunit.client.1.smithi079.stdout:0/22: symlink d3/lc 0 2024-05-09T06:29:12.289 INFO:tasks.workunit.client.1.smithi079.stdout:6/42: rmdir d0/d6 39 2024-05-09T06:29:12.290 INFO:tasks.workunit.client.1.smithi079.stdout:7/24: dwrite f3 [0,4194304] 0 2024-05-09T06:29:12.291 INFO:tasks.workunit.client.1.smithi079.stdout:2/24: dwrite f5 [0,4194304] 0 2024-05-09T06:29:12.291 INFO:tasks.workunit.client.1.smithi079.stdout:2/25: truncate f2 5179604 0 2024-05-09T06:29:12.291 INFO:tasks.workunit.client.1.smithi079.stdout:2/26: truncate f7 320792 0 2024-05-09T06:29:12.291 INFO:tasks.workunit.client.1.smithi079.stdout:0/23: mkdir d3/dd 0 2024-05-09T06:29:12.291 INFO:tasks.workunit.client.1.smithi079.stdout:0/24: chown d3/lc 2173 1 2024-05-09T06:29:12.293 INFO:tasks.workunit.client.1.smithi079.stdout:6/43: mknod d0/d6/cd 0 2024-05-09T06:29:12.298 INFO:tasks.workunit.client.1.smithi079.stdout:9/24: dread d1/f3 [0,4194304] 0 2024-05-09T06:29:12.301 INFO:tasks.workunit.client.1.smithi079.stdout:7/25: write f3 [3016269,77251] 0 2024-05-09T06:29:12.303 INFO:tasks.workunit.client.1.smithi079.stdout:9/25: mkdir d1/d6 0 2024-05-09T06:29:12.303 INFO:tasks.workunit.client.1.smithi079.stdout:9/26: chown d1/d6 70 1 2024-05-09T06:29:12.308 INFO:tasks.workunit.client.1.smithi079.stdout:9/27: unlink d1/l2 0 2024-05-09T06:29:12.312 INFO:tasks.workunit.client.1.smithi079.stdout:7/26: dread f3 [0,4194304] 0 2024-05-09T06:29:12.312 INFO:tasks.workunit.client.1.smithi079.stdout:7/27: write f3 [3848303,122012] 0 2024-05-09T06:29:12.312 INFO:tasks.workunit.client.1.smithi079.stdout:9/28: mkdir d1/d6/d7 0 2024-05-09T06:29:12.316 INFO:tasks.workunit.client.1.smithi079.stdout:9/29: write d1/f3 [1629977,71262] 0 2024-05-09T06:29:12.318 INFO:tasks.workunit.client.1.smithi079.stdout:2/27: dwrite f2 [4194304,4194304] 0 2024-05-09T06:29:12.322 INFO:tasks.workunit.client.1.smithi079.stdout:9/30: symlink d1/d6/d7/l8 0 2024-05-09T06:29:12.322 INFO:tasks.workunit.client.1.smithi079.stdout:2/28: mkdir d8 0 2024-05-09T06:29:12.323 INFO:tasks.workunit.client.1.smithi079.stdout:2/29: creat d8/f9 x:0 0 0 2024-05-09T06:29:12.323 INFO:tasks.workunit.client.1.smithi079.stdout:2/30: truncate f5 4317935 0 2024-05-09T06:29:12.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/28: dread f3 [0,4194304] 0 2024-05-09T06:29:12.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/29: rename d4 to d4/d5 22 2024-05-09T06:29:12.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/30: chown d4 9 1 2024-05-09T06:29:12.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/31: write f3 [1825416,63494] 0 2024-05-09T06:29:12.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/32: chown d4 83 1 2024-05-09T06:29:12.331 INFO:tasks.workunit.client.1.smithi079.stdout:0/25: dwrite d3/d5/f8 [0,4194304] 0 2024-05-09T06:29:12.331 INFO:tasks.workunit.client.1.smithi079.stdout:0/26: creat d3/d5/fe x:0 0 0 2024-05-09T06:29:12.331 INFO:tasks.workunit.client.1.smithi079.stdout:0/27: creat d3/d5/ff x:0 0 0 2024-05-09T06:29:12.331 INFO:tasks.workunit.client.1.smithi079.stdout:0/28: chown d3/db 999720 1 2024-05-09T06:29:12.331 INFO:tasks.workunit.client.1.smithi079.stdout:6/44: dwrite d0/fc [0,4194304] 0 2024-05-09T06:29:12.337 INFO:tasks.workunit.client.1.smithi079.stdout:2/31: write f5 [1641512,61287] 0 2024-05-09T06:29:12.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/32: dread f7 [0,4194304] 0 2024-05-09T06:29:12.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/33: creat d8/fa x:0 0 0 2024-05-09T06:29:12.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/34: read - d8/fa zero size 2024-05-09T06:29:12.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/35: chown d8/f9 39105 1 2024-05-09T06:29:12.341 INFO:tasks.workunit.client.1.smithi079.stdout:0/29: dread d3/d5/f8 [0,4194304] 0 2024-05-09T06:29:12.341 INFO:tasks.workunit.client.1.smithi079.stdout:0/30: stat d3/db 0 2024-05-09T06:29:12.341 INFO:tasks.workunit.client.1.smithi079.stdout:0/31: write d3/d7/f9 [1109078,19511] 0 2024-05-09T06:29:12.346 INFO:tasks.workunit.client.1.smithi079.stdout:2/36: mkdir d8/db 0 2024-05-09T06:29:12.346 INFO:tasks.workunit.client.1.smithi079.stdout:2/37: readlink l6 0 2024-05-09T06:29:12.346 INFO:tasks.workunit.client.1.smithi079.stdout:2/38: getdents d8/db 0 2024-05-09T06:29:12.349 INFO:tasks.workunit.client.1.smithi079.stdout:2/39: mkdir d8/db/dc 0 2024-05-09T06:29:12.353 INFO:tasks.workunit.client.1.smithi079.stdout:2/40: creat d8/db/dc/fd x:0 0 0 2024-05-09T06:29:12.357 INFO:tasks.workunit.client.1.smithi079.stdout:2/41: symlink d8/db/dc/le 0 2024-05-09T06:29:12.358 INFO:tasks.workunit.client.1.smithi079.stdout:7/33: dwrite f3 [0,4194304] 0 2024-05-09T06:29:12.358 INFO:tasks.workunit.client.1.smithi079.stdout:7/34: fdatasync f3 0 2024-05-09T06:29:12.360 INFO:tasks.workunit.client.1.smithi079.stdout:6/45: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:29:12.360 INFO:tasks.workunit.client.1.smithi079.stdout:6/46: readlink d0/l7 0 2024-05-09T06:29:12.362 INFO:tasks.workunit.client.1.smithi079.stdout:7/35: rename f3 to d4/f6 0 2024-05-09T06:29:12.366 INFO:tasks.workunit.client.1.smithi079.stdout:6/47: mkdir d0/de 0 2024-05-09T06:29:12.375 INFO:tasks.workunit.client.1.smithi079.stdout:6/48: dread d0/fc [0,4194304] 0 2024-05-09T06:29:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:12 smithi079 ceph-mon[35268]: pgmap v235: 65 pgs: 65 active+clean; 130 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 341 KiB/s rd, 7.6 MiB/s wr, 553 op/s 2024-05-09T06:29:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:12 smithi062 ceph-mon[26920]: pgmap v235: 65 pgs: 65 active+clean; 130 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 341 KiB/s rd, 7.6 MiB/s wr, 553 op/s 2024-05-09T06:29:12.978 INFO:tasks.workunit.client.1.smithi079.stdout:4/13: write f2 [4205598,93957] 0 2024-05-09T06:29:12.982 INFO:tasks.workunit.client.1.smithi079.stdout:5/11: getdents . 0 2024-05-09T06:29:12.984 INFO:tasks.workunit.client.1.smithi079.stdout:5/12: symlink l4 0 2024-05-09T06:29:12.985 INFO:tasks.workunit.client.1.smithi079.stdout:5/13: creat f5 x:0 0 0 2024-05-09T06:29:12.987 INFO:tasks.workunit.client.1.smithi079.stdout:5/14: mknod c6 0 2024-05-09T06:29:12.987 INFO:tasks.workunit.client.1.smithi079.stdout:5/15: write f5 [79714,66123] 0 2024-05-09T06:29:12.987 INFO:tasks.workunit.client.1.smithi079.stdout:4/14: fsync f3 0 2024-05-09T06:29:12.987 INFO:tasks.workunit.client.1.smithi079.stdout:4/15: dread - f3 zero size 2024-05-09T06:29:12.988 INFO:tasks.workunit.client.1.smithi079.stdout:5/16: mknod c7 0 2024-05-09T06:29:12.988 INFO:tasks.workunit.client.1.smithi079.stdout:5/17: read f5 [109144,38968] 0 2024-05-09T06:29:12.989 INFO:tasks.workunit.client.1.smithi079.stdout:5/18: symlink l8 0 2024-05-09T06:29:12.989 INFO:tasks.workunit.client.1.smithi079.stdout:5/19: write f5 [1146983,122962] 0 2024-05-09T06:29:12.992 INFO:tasks.workunit.client.1.smithi079.stdout:5/20: fdatasync f5 0 2024-05-09T06:29:12.992 INFO:tasks.workunit.client.1.smithi079.stdout:5/21: rmdir - no directory 2024-05-09T06:29:12.992 INFO:tasks.workunit.client.1.smithi079.stdout:5/22: readlink l8 0 2024-05-09T06:29:12.997 INFO:tasks.workunit.client.1.smithi079.stdout:1/6: sync 2024-05-09T06:29:12.997 INFO:tasks.workunit.client.1.smithi079.stdout:4/16: write f2 [2570245,120954] 0 2024-05-09T06:29:12.997 INFO:tasks.workunit.client.1.smithi079.stdout:4/17: truncate f3 714480 0 2024-05-09T06:29:12.999 INFO:tasks.workunit.client.1.smithi079.stdout:1/7: mkdir d0 0 2024-05-09T06:29:12.999 INFO:tasks.workunit.client.1.smithi079.stdout:1/8: dwrite - no filename 2024-05-09T06:29:12.999 INFO:tasks.workunit.client.1.smithi079.stdout:1/9: dread - no filename 2024-05-09T06:29:13.002 INFO:tasks.workunit.client.1.smithi079.stdout:4/18: link f3 f4 0 2024-05-09T06:29:13.003 INFO:tasks.workunit.client.1.smithi079.stdout:1/10: creat d0/f1 x:0 0 0 2024-05-09T06:29:13.003 INFO:tasks.workunit.client.1.smithi079.stdout:1/11: dread - d0/f1 zero size 2024-05-09T06:29:13.010 INFO:tasks.workunit.client.1.smithi079.stdout:8/17: fsync d1/d3/f6 0 2024-05-09T06:29:13.010 INFO:tasks.workunit.client.1.smithi079.stdout:8/18: write d1/d3/f4 [226343,90498] 0 2024-05-09T06:29:13.010 INFO:tasks.workunit.client.1.smithi079.stdout:3/13: dwrite f1 [0,4194304] 0 2024-05-09T06:29:13.011 INFO:tasks.workunit.client.1.smithi079.stdout:3/14: chown f3 975787 1 2024-05-09T06:29:13.011 INFO:tasks.workunit.client.1.smithi079.stdout:3/15: fdatasync f1 0 2024-05-09T06:29:13.011 INFO:tasks.workunit.client.1.smithi079.stdout:3/16: chown f1 7132147 1 2024-05-09T06:29:13.013 INFO:tasks.workunit.client.1.smithi079.stdout:3/17: getdents . 0 2024-05-09T06:29:13.013 INFO:tasks.workunit.client.1.smithi079.stdout:8/19: dread d1/d3/f6 [0,4194304] 0 2024-05-09T06:29:13.014 INFO:tasks.workunit.client.1.smithi079.stdout:3/18: rename c2 to c4 0 2024-05-09T06:29:13.017 INFO:tasks.workunit.client.1.smithi079.stdout:3/19: unlink f1 0 2024-05-09T06:29:13.018 INFO:tasks.workunit.client.1.smithi079.stdout:3/20: dread - f3 zero size 2024-05-09T06:29:13.020 INFO:tasks.workunit.client.1.smithi079.stdout:1/12: dwrite d0/f1 [0,4194304] 0 2024-05-09T06:29:13.025 INFO:tasks.workunit.client.1.smithi079.stdout:8/20: write d1/d3/f6 [5967166,70359] 0 2024-05-09T06:29:13.025 INFO:tasks.workunit.client.1.smithi079.stdout:8/21: chown d1/d5/c7 961791104 1 2024-05-09T06:29:13.026 INFO:tasks.workunit.client.1.smithi079.stdout:8/22: creat d1/f8 x:0 0 0 2024-05-09T06:29:13.029 INFO:tasks.workunit.client.1.smithi079.stdout:6/49: getdents d0/d6 0 2024-05-09T06:29:13.033 INFO:tasks.workunit.client.1.smithi079.stdout:3/21: dwrite f3 [0,4194304] 0 2024-05-09T06:29:13.035 INFO:tasks.workunit.client.1.smithi079.stdout:6/50: write d0/f5 [1393722,118136] 0 2024-05-09T06:29:13.040 INFO:tasks.workunit.client.1.smithi079.stdout:9/31: truncate f0 3181741 0 2024-05-09T06:29:13.041 INFO:tasks.workunit.client.1.smithi079.stdout:9/32: rmdir d1/d6/d7 39 2024-05-09T06:29:13.041 INFO:tasks.workunit.client.1.smithi079.stdout:9/33: readlink d1/l4 0 2024-05-09T06:29:13.043 INFO:tasks.workunit.client.1.smithi079.stdout:9/34: symlink d1/d5/l9 0 2024-05-09T06:29:13.045 INFO:tasks.workunit.client.1.smithi079.stdout:9/35: unlink d1/d6/d7/l8 0 2024-05-09T06:29:13.049 INFO:tasks.workunit.client.1.smithi079.stdout:8/23: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:13.050 INFO:tasks.workunit.client.1.smithi079.stdout:3/22: dwrite f3 [0,4194304] 0 2024-05-09T06:29:13.050 INFO:tasks.workunit.client.1.smithi079.stdout:3/23: rmdir - no directory 2024-05-09T06:29:13.050 INFO:tasks.workunit.client.1.smithi079.stdout:3/24: fsync f3 0 2024-05-09T06:29:13.051 INFO:tasks.workunit.client.1.smithi079.stdout:8/24: fsync d1/d3/f6 0 2024-05-09T06:29:13.053 INFO:tasks.workunit.client.1.smithi079.stdout:3/25: creat f5 x:0 0 0 2024-05-09T06:29:13.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/25: symlink d1/d5/l9 0 2024-05-09T06:29:13.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/26: fsync d1/d3/f6 0 2024-05-09T06:29:13.055 INFO:tasks.workunit.client.1.smithi079.stdout:0/32: getdents d3/d5 0 2024-05-09T06:29:13.057 INFO:tasks.workunit.client.1.smithi079.stdout:3/26: creat f6 x:0 0 0 2024-05-09T06:29:13.059 INFO:tasks.workunit.client.1.smithi079.stdout:6/51: dread d0/f5 [0,4194304] 0 2024-05-09T06:29:13.062 INFO:tasks.workunit.client.1.smithi079.stdout:2/42: rmdir d8/db/dc 39 2024-05-09T06:29:13.063 INFO:tasks.workunit.client.1.smithi079.stdout:2/43: read f5 [4296156,59634] 0 2024-05-09T06:29:13.064 INFO:tasks.workunit.client.1.smithi079.stdout:2/44: unlink f2 0 2024-05-09T06:29:13.065 INFO:tasks.workunit.client.1.smithi079.stdout:2/45: creat d8/db/dc/ff x:0 0 0 2024-05-09T06:29:13.065 INFO:tasks.workunit.client.1.smithi079.stdout:2/46: read - d8/db/dc/fd zero size 2024-05-09T06:29:13.069 INFO:tasks.workunit.client.1.smithi079.stdout:7/36: truncate d4/f6 3204377 0 2024-05-09T06:29:13.074 INFO:tasks.workunit.client.1.smithi079.stdout:0/33: dwrite d3/d7/fa [0,4194304] 0 2024-05-09T06:29:13.081 INFO:tasks.workunit.client.1.smithi079.stdout:0/34: dread d3/d7/f9 [0,4194304] 0 2024-05-09T06:29:13.081 INFO:tasks.workunit.client.1.smithi079.stdout:2/47: dwrite d8/f9 [0,4194304] 0 2024-05-09T06:29:13.081 INFO:tasks.workunit.client.1.smithi079.stdout:2/48: creat d8/f10 x:0 0 0 2024-05-09T06:29:13.082 INFO:tasks.workunit.client.1.smithi079.stdout:0/35: creat d3/dd/f10 x:0 0 0 2024-05-09T06:29:13.086 INFO:tasks.workunit.client.1.smithi079.stdout:2/49: mkdir d8/db/d11 0 2024-05-09T06:29:13.087 INFO:tasks.workunit.client.1.smithi079.stdout:0/36: dread d3/d5/f8 [0,4194304] 0 2024-05-09T06:29:13.087 INFO:tasks.workunit.client.1.smithi079.stdout:2/50: creat d8/db/f12 x:0 0 0 2024-05-09T06:29:13.087 INFO:tasks.workunit.client.1.smithi079.stdout:2/51: dread - d8/db/f12 zero size 2024-05-09T06:29:13.088 INFO:tasks.workunit.client.1.smithi079.stdout:2/52: symlink d8/db/dc/l13 0 2024-05-09T06:29:13.089 INFO:tasks.workunit.client.1.smithi079.stdout:2/53: symlink d8/db/d11/l14 0 2024-05-09T06:29:13.089 INFO:tasks.workunit.client.1.smithi079.stdout:2/54: write d8/db/dc/ff [36928,46333] 0 2024-05-09T06:29:13.089 INFO:tasks.workunit.client.1.smithi079.stdout:2/55: chown l6 4 1 2024-05-09T06:29:13.089 INFO:tasks.workunit.client.1.smithi079.stdout:2/56: readlink d8/db/dc/l13 0 2024-05-09T06:29:13.113 INFO:tasks.workunit.client.1.smithi079.stdout:0/37: dwrite d3/f4 [0,4194304] 0 2024-05-09T06:29:13.114 INFO:tasks.workunit.client.1.smithi079.stdout:0/38: creat d3/db/f11 x:0 0 0 2024-05-09T06:29:13.114 INFO:tasks.workunit.client.1.smithi079.stdout:0/39: chown d3 53 1 2024-05-09T06:29:13.115 INFO:tasks.workunit.client.1.smithi079.stdout:0/40: symlink d3/db/l12 0 2024-05-09T06:29:13.115 INFO:tasks.workunit.client.1.smithi079.stdout:0/41: creat d3/d7/f13 x:0 0 0 2024-05-09T06:29:13.121 INFO:tasks.workunit.client.1.smithi079.stdout:2/57: dwrite d8/fa [0,4194304] 0 2024-05-09T06:29:13.125 INFO:tasks.workunit.client.1.smithi079.stdout:2/58: symlink d8/db/d11/l15 0 2024-05-09T06:29:13.125 INFO:tasks.workunit.client.1.smithi079.stdout:2/59: dread - d8/db/dc/fd zero size 2024-05-09T06:29:13.125 INFO:tasks.workunit.client.1.smithi079.stdout:0/42: write d3/d7/fa [1574330,84985] 0 2024-05-09T06:29:13.125 INFO:tasks.workunit.client.1.smithi079.stdout:0/43: truncate d3/d5/ff 828379 0 2024-05-09T06:29:13.125 INFO:tasks.workunit.client.1.smithi079.stdout:0/44: readlink d3/lc 0 2024-05-09T06:29:13.125 INFO:tasks.workunit.client.1.smithi079.stdout:0/45: write d3/dd/f10 [291481,115698] 0 2024-05-09T06:29:13.126 INFO:tasks.workunit.client.1.smithi079.stdout:2/60: link l6 d8/l16 0 2024-05-09T06:29:13.126 INFO:tasks.workunit.client.1.smithi079.stdout:2/61: truncate d8/db/f12 241364 0 2024-05-09T06:29:13.126 INFO:tasks.workunit.client.1.smithi079.stdout:2/62: write d8/f10 [341183,11935] 0 2024-05-09T06:29:13.127 INFO:tasks.workunit.client.1.smithi079.stdout:0/46: symlink d3/db/l14 0 2024-05-09T06:29:13.127 INFO:tasks.workunit.client.1.smithi079.stdout:2/63: fdatasync d8/f10 0 2024-05-09T06:29:13.129 INFO:tasks.workunit.client.1.smithi079.stdout:0/47: unlink d3/d7/f9 0 2024-05-09T06:29:13.129 INFO:tasks.workunit.client.1.smithi079.stdout:0/48: chown d3/d5/f8 422 1 2024-05-09T06:29:13.130 INFO:tasks.workunit.client.1.smithi079.stdout:2/64: unlink d8/db/dc/ff 0 2024-05-09T06:29:13.132 INFO:tasks.workunit.client.1.smithi079.stdout:0/49: mknod d3/d5/c15 0 2024-05-09T06:29:13.132 INFO:tasks.workunit.client.1.smithi079.stdout:0/50: readlink l2 0 2024-05-09T06:29:13.132 INFO:tasks.workunit.client.1.smithi079.stdout:0/51: creat d3/f16 x:0 0 0 2024-05-09T06:29:13.133 INFO:tasks.workunit.client.1.smithi079.stdout:2/65: symlink d8/db/dc/l17 0 2024-05-09T06:29:13.135 INFO:tasks.workunit.client.1.smithi079.stdout:0/52: symlink d3/db/l17 0 2024-05-09T06:29:13.148 INFO:tasks.workunit.client.1.smithi079.stdout:2/66: dwrite d8/f10 [0,4194304] 0 2024-05-09T06:29:13.150 INFO:tasks.workunit.client.1.smithi079.stdout:2/67: rename d8/db/dc/l13 to d8/l18 0 2024-05-09T06:29:13.151 INFO:tasks.workunit.client.1.smithi079.stdout:2/68: rmdir d8/db/d11 39 2024-05-09T06:29:13.151 INFO:tasks.workunit.client.1.smithi079.stdout:2/69: write f5 [858292,127435] 0 2024-05-09T06:29:13.151 INFO:tasks.workunit.client.1.smithi079.stdout:2/70: creat d8/db/f19 x:0 0 0 2024-05-09T06:29:13.152 INFO:tasks.workunit.client.1.smithi079.stdout:2/71: chown f7 378496481 1 2024-05-09T06:29:13.154 INFO:tasks.workunit.client.1.smithi079.stdout:2/72: link d8/db/dc/fd d8/db/f1a 0 2024-05-09T06:29:13.154 INFO:tasks.workunit.client.1.smithi079.stdout:2/73: truncate d8/db/f12 394364 0 2024-05-09T06:29:13.154 INFO:tasks.workunit.client.1.smithi079.stdout:2/74: read - d8/db/f19 zero size 2024-05-09T06:29:13.357 INFO:tasks.workunit.client.1.smithi079.stdout:4/19: getdents . 0 2024-05-09T06:29:13.358 INFO:tasks.workunit.client.1.smithi079.stdout:1/13: rmdir d0 39 2024-05-09T06:29:13.360 INFO:tasks.workunit.client.1.smithi079.stdout:4/20: rename f3 to f5 0 2024-05-09T06:29:13.362 INFO:tasks.workunit.client.1.smithi079.stdout:1/14: link d0/f1 d0/f2 0 2024-05-09T06:29:13.366 INFO:tasks.workunit.client.1.smithi079.stdout:4/21: mkdir d6 0 2024-05-09T06:29:13.368 INFO:tasks.workunit.client.1.smithi079.stdout:6/52: truncate d0/f5 369579 0 2024-05-09T06:29:13.369 INFO:tasks.workunit.client.1.smithi079.stdout:1/15: rename d0/f1 to d0/f3 0 2024-05-09T06:29:13.372 INFO:tasks.workunit.client.1.smithi079.stdout:4/22: dread f4 [0,4194304] 0 2024-05-09T06:29:13.372 INFO:tasks.workunit.client.1.smithi079.stdout:4/23: dread f4 [0,4194304] 0 2024-05-09T06:29:13.373 INFO:tasks.workunit.client.1.smithi079.stdout:4/24: truncate f4 847884 0 2024-05-09T06:29:13.373 INFO:tasks.workunit.client.1.smithi079.stdout:9/36: rmdir d1 39 2024-05-09T06:29:13.373 INFO:tasks.workunit.client.1.smithi079.stdout:9/37: readlink d1/l4 0 2024-05-09T06:29:13.374 INFO:tasks.workunit.client.1.smithi079.stdout:1/16: read d0/f2 [1763655,107495] 0 2024-05-09T06:29:13.378 INFO:tasks.workunit.client.1.smithi079.stdout:1/17: link d0/f2 d0/f4 0 2024-05-09T06:29:13.379 INFO:tasks.workunit.client.1.smithi079.stdout:1/18: write d0/f4 [2030327,34968] 0 2024-05-09T06:29:13.381 INFO:tasks.workunit.client.1.smithi079.stdout:1/19: creat d0/f5 x:0 0 0 2024-05-09T06:29:13.382 INFO:tasks.workunit.client.1.smithi079.stdout:1/20: write d0/f5 [879936,18034] 0 2024-05-09T06:29:13.388 INFO:tasks.workunit.client.1.smithi079.stdout:1/21: rename d0/f4 to d0/f6 0 2024-05-09T06:29:13.391 INFO:tasks.workunit.client.1.smithi079.stdout:9/38: dwrite f0 [0,4194304] 0 2024-05-09T06:29:13.397 INFO:tasks.workunit.client.1.smithi079.stdout:9/39: mkdir d1/d6/da 0 2024-05-09T06:29:13.400 INFO:tasks.workunit.client.1.smithi079.stdout:9/40: mknod d1/d6/cb 0 2024-05-09T06:29:13.401 INFO:tasks.workunit.client.1.smithi079.stdout:1/22: fdatasync d0/f6 0 2024-05-09T06:29:13.402 INFO:tasks.workunit.client.1.smithi079.stdout:4/25: dwrite f2 [4194304,4194304] 0 2024-05-09T06:29:13.402 INFO:tasks.workunit.client.1.smithi079.stdout:7/37: dwrite d4/f6 [0,4194304] 0 2024-05-09T06:29:13.403 INFO:tasks.workunit.client.1.smithi079.stdout:4/26: write f5 [717443,94421] 0 2024-05-09T06:29:13.403 INFO:tasks.workunit.client.1.smithi079.stdout:4/27: chown f4 1400477 1 2024-05-09T06:29:13.403 INFO:tasks.workunit.client.1.smithi079.stdout:4/28: write f4 [1680004,6222] 0 2024-05-09T06:29:13.403 INFO:tasks.workunit.client.1.smithi079.stdout:4/29: stat f2 0 2024-05-09T06:29:13.407 INFO:tasks.workunit.client.1.smithi079.stdout:0/53: rmdir d3/d7 39 2024-05-09T06:29:13.409 INFO:tasks.workunit.client.1.smithi079.stdout:9/41: dread d1/f3 [0,4194304] 0 2024-05-09T06:29:13.409 INFO:tasks.workunit.client.1.smithi079.stdout:9/42: fdatasync f0 0 2024-05-09T06:29:13.410 INFO:tasks.workunit.client.1.smithi079.stdout:4/30: rename c0 to d6/c7 0 2024-05-09T06:29:13.412 INFO:tasks.workunit.client.1.smithi079.stdout:7/38: write d4/f6 [285462,47879] 0 2024-05-09T06:29:13.413 INFO:tasks.workunit.client.1.smithi079.stdout:0/54: mkdir d3/dd/d18 0 2024-05-09T06:29:13.413 INFO:tasks.workunit.client.1.smithi079.stdout:0/55: chown d3/dd 56731 1 2024-05-09T06:29:13.415 INFO:tasks.workunit.client.1.smithi079.stdout:9/43: dread f0 [0,4194304] 0 2024-05-09T06:29:13.415 INFO:tasks.workunit.client.1.smithi079.stdout:9/44: chown d1/l4 7960894 1 2024-05-09T06:29:13.417 INFO:tasks.workunit.client.1.smithi079.stdout:7/39: mkdir d4/d7 0 2024-05-09T06:29:13.417 INFO:tasks.workunit.client.1.smithi079.stdout:0/56: dread d3/dd/f10 [0,4194304] 0 2024-05-09T06:29:13.418 INFO:tasks.workunit.client.1.smithi079.stdout:1/23: dwrite d0/f6 [4194304,4194304] 0 2024-05-09T06:29:13.419 INFO:tasks.workunit.client.1.smithi079.stdout:9/45: creat d1/d6/da/fc x:0 0 0 2024-05-09T06:29:13.420 INFO:tasks.workunit.client.1.smithi079.stdout:4/31: dread f4 [0,4194304] 0 2024-05-09T06:29:13.422 INFO:tasks.workunit.client.1.smithi079.stdout:7/40: mkdir d4/d8 0 2024-05-09T06:29:13.422 INFO:tasks.workunit.client.1.smithi079.stdout:7/41: write d4/f6 [1583333,61654] 0 2024-05-09T06:29:13.422 INFO:tasks.workunit.client.1.smithi079.stdout:7/42: write d4/f6 [4515475,108267] 0 2024-05-09T06:29:13.422 INFO:tasks.workunit.client.1.smithi079.stdout:7/43: chown c1 35452 1 2024-05-09T06:29:13.422 INFO:tasks.workunit.client.1.smithi079.stdout:7/44: chown c2 1041614 1 2024-05-09T06:29:13.422 INFO:tasks.workunit.client.1.smithi079.stdout:7/45: write d4/f6 [646263,36118] 0 2024-05-09T06:29:13.422 INFO:tasks.workunit.client.1.smithi079.stdout:7/46: chown d4/d8 2091 1 2024-05-09T06:29:13.422 INFO:tasks.workunit.client.1.smithi079.stdout:9/46: dread f0 [0,4194304] 0 2024-05-09T06:29:13.425 INFO:tasks.workunit.client.1.smithi079.stdout:0/57: link d3/db/l12 d3/d7/l19 0 2024-05-09T06:29:13.425 INFO:tasks.workunit.client.1.smithi079.stdout:0/58: chown d3/dd/d18 405 1 2024-05-09T06:29:13.427 INFO:tasks.workunit.client.1.smithi079.stdout:1/24: mkdir d0/d7 0 2024-05-09T06:29:13.427 INFO:tasks.workunit.client.1.smithi079.stdout:1/25: stat d0/f2 0 2024-05-09T06:29:13.430 INFO:tasks.workunit.client.1.smithi079.stdout:4/32: mkdir d6/d8 0 2024-05-09T06:29:13.432 INFO:tasks.workunit.client.1.smithi079.stdout:7/47: symlink d4/l9 0 2024-05-09T06:29:13.432 INFO:tasks.workunit.client.1.smithi079.stdout:7/48: chown d4/l9 92279 1 2024-05-09T06:29:13.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/59: rename d3/d5/c6 to d3/dd/c1a 0 2024-05-09T06:29:13.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/60: readlink l2 0 2024-05-09T06:29:13.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/61: chown d3/d7 10953 1 2024-05-09T06:29:13.436 INFO:tasks.workunit.client.1.smithi079.stdout:1/26: symlink d0/d7/l8 0 2024-05-09T06:29:13.438 INFO:tasks.workunit.client.1.smithi079.stdout:4/33: mkdir d6/d8/d9 0 2024-05-09T06:29:13.438 INFO:tasks.workunit.client.1.smithi079.stdout:4/34: fdatasync f5 0 2024-05-09T06:29:13.440 INFO:tasks.workunit.client.1.smithi079.stdout:9/47: dwrite d1/f3 [4194304,4194304] 0 2024-05-09T06:29:13.440 INFO:tasks.workunit.client.1.smithi079.stdout:0/62: dread d3/d5/f8 [0,4194304] 0 2024-05-09T06:29:13.440 INFO:tasks.workunit.client.1.smithi079.stdout:0/63: write d3/d7/fa [4765822,31090] 0 2024-05-09T06:29:13.440 INFO:tasks.workunit.client.1.smithi079.stdout:7/49: rename c1 to d4/ca 0 2024-05-09T06:29:13.440 INFO:tasks.workunit.client.1.smithi079.stdout:4/35: dread f5 [0,4194304] 0 2024-05-09T06:29:13.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/64: mknod d3/dd/d18/c1b 0 2024-05-09T06:29:13.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/65: creat d3/dd/f1c x:0 0 0 2024-05-09T06:29:13.447 INFO:tasks.workunit.client.1.smithi079.stdout:7/50: mknod d4/cb 0 2024-05-09T06:29:13.449 INFO:tasks.workunit.client.1.smithi079.stdout:4/36: rmdir d6/d8 39 2024-05-09T06:29:13.451 INFO:tasks.workunit.client.1.smithi079.stdout:4/37: dread f5 [0,4194304] 0 2024-05-09T06:29:13.454 INFO:tasks.workunit.client.1.smithi079.stdout:0/66: dread d3/f4 [0,4194304] 0 2024-05-09T06:29:13.454 INFO:tasks.workunit.client.1.smithi079.stdout:7/51: fsync d4/f6 0 2024-05-09T06:29:13.454 INFO:tasks.workunit.client.1.smithi079.stdout:7/52: rename d4/d8 to d4/d8/dc 22 2024-05-09T06:29:13.455 INFO:tasks.workunit.client.1.smithi079.stdout:9/48: dwrite f0 [0,4194304] 0 2024-05-09T06:29:13.457 INFO:tasks.workunit.client.1.smithi079.stdout:0/67: creat d3/d7/f1d x:0 0 0 2024-05-09T06:29:13.458 INFO:tasks.workunit.client.1.smithi079.stdout:7/53: dread d4/f6 [0,4194304] 0 2024-05-09T06:29:13.462 INFO:tasks.workunit.client.1.smithi079.stdout:0/68: mkdir d3/d7/d1e 0 2024-05-09T06:29:13.464 INFO:tasks.workunit.client.1.smithi079.stdout:7/54: mkdir d4/d7/dd 0 2024-05-09T06:29:13.466 INFO:tasks.workunit.client.1.smithi079.stdout:9/49: dread f0 [4194304,4194304] 0 2024-05-09T06:29:13.466 INFO:tasks.workunit.client.1.smithi079.stdout:9/50: stat d1/d5 0 2024-05-09T06:29:13.466 INFO:tasks.workunit.client.1.smithi079.stdout:0/69: unlink l2 0 2024-05-09T06:29:13.467 INFO:tasks.workunit.client.1.smithi079.stdout:7/55: creat d4/d7/dd/fe x:0 0 0 2024-05-09T06:29:13.470 INFO:tasks.workunit.client.1.smithi079.stdout:9/51: write f0 [5940361,99744] 0 2024-05-09T06:29:13.470 INFO:tasks.workunit.client.1.smithi079.stdout:9/52: dread - d1/d6/da/fc zero size 2024-05-09T06:29:13.471 INFO:tasks.workunit.client.1.smithi079.stdout:7/56: rmdir d4/d8 0 2024-05-09T06:29:13.471 INFO:tasks.workunit.client.1.smithi079.stdout:7/57: readlink d4/l9 0 2024-05-09T06:29:13.474 INFO:tasks.workunit.client.1.smithi079.stdout:9/53: creat d1/fd x:0 0 0 2024-05-09T06:29:13.474 INFO:tasks.workunit.client.1.smithi079.stdout:9/54: dread - d1/d6/da/fc zero size 2024-05-09T06:29:13.474 INFO:tasks.workunit.client.1.smithi079.stdout:9/55: read - d1/d6/da/fc zero size 2024-05-09T06:29:13.476 INFO:tasks.workunit.client.1.smithi079.stdout:7/58: rename c2 to d4/d7/cf 0 2024-05-09T06:29:13.486 INFO:tasks.workunit.client.1.smithi079.stdout:6/53: write d0/f5 [117921,123387] 0 2024-05-09T06:29:13.488 INFO:tasks.workunit.client.1.smithi079.stdout:1/27: link d0/f3 d0/d7/f9 0 2024-05-09T06:29:13.489 INFO:tasks.workunit.client.1.smithi079.stdout:9/56: dwrite f0 [0,4194304] 0 2024-05-09T06:29:13.489 INFO:tasks.workunit.client.1.smithi079.stdout:9/57: truncate d1/d6/da/fc 1036478 0 2024-05-09T06:29:13.492 INFO:tasks.workunit.client.1.smithi079.stdout:9/58: creat d1/d5/fe x:0 0 0 2024-05-09T06:29:13.504 INFO:tasks.workunit.client.1.smithi079.stdout:9/59: dread f0 [4194304,4194304] 0 2024-05-09T06:29:13.504 INFO:tasks.workunit.client.1.smithi079.stdout:9/60: chown d1/d6 69 1 2024-05-09T06:29:13.516 INFO:tasks.workunit.client.1.smithi079.stdout:6/54: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:29:13.516 INFO:tasks.workunit.client.1.smithi079.stdout:6/55: chown d0/f5 4024662 1 2024-05-09T06:29:13.521 INFO:tasks.workunit.client.1.smithi079.stdout:1/28: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:29:13.528 INFO:tasks.workunit.client.1.smithi079.stdout:1/29: dread d0/f6 [0,4194304] 0 2024-05-09T06:29:13.538 INFO:tasks.workunit.client.1.smithi079.stdout:4/38: getdents d6 0 2024-05-09T06:29:13.541 INFO:tasks.workunit.client.1.smithi079.stdout:4/39: link f5 d6/fa 0 2024-05-09T06:29:13.544 INFO:tasks.workunit.client.1.smithi079.stdout:4/40: unlink f4 0 2024-05-09T06:29:13.548 INFO:tasks.workunit.client.1.smithi079.stdout:7/59: rename d4/ca to d4/d7/dd/c10 0 2024-05-09T06:29:13.549 INFO:tasks.workunit.client.1.smithi079.stdout:4/41: creat d6/d8/d9/fb x:0 0 0 2024-05-09T06:29:13.551 INFO:tasks.workunit.client.1.smithi079.stdout:6/56: rename d0/l3 to d0/de/lf 0 2024-05-09T06:29:13.554 INFO:tasks.workunit.client.1.smithi079.stdout:7/60: creat d4/f11 x:0 0 0 2024-05-09T06:29:13.554 INFO:tasks.workunit.client.1.smithi079.stdout:7/61: write d4/d7/dd/fe [371310,8869] 0 2024-05-09T06:29:13.554 INFO:tasks.workunit.client.1.smithi079.stdout:7/62: write d4/f11 [713269,88698] 0 2024-05-09T06:29:13.554 INFO:tasks.workunit.client.1.smithi079.stdout:7/63: chown d4/f11 3 1 2024-05-09T06:29:13.554 INFO:tasks.workunit.client.1.smithi079.stdout:7/64: fdatasync d4/f6 0 2024-05-09T06:29:13.554 INFO:tasks.workunit.client.1.smithi079.stdout:7/65: creat d4/f12 x:0 0 0 2024-05-09T06:29:13.556 INFO:tasks.workunit.client.1.smithi079.stdout:0/70: getdents d3/dd 0 2024-05-09T06:29:13.556 INFO:tasks.workunit.client.1.smithi079.stdout:0/71: write d3/d7/f13 [661955,101060] 0 2024-05-09T06:29:13.556 INFO:tasks.workunit.client.1.smithi079.stdout:4/42: dread d6/fa [0,4194304] 0 2024-05-09T06:29:13.557 INFO:tasks.workunit.client.1.smithi079.stdout:4/43: readlink - no filename 2024-05-09T06:29:13.560 INFO:tasks.workunit.client.1.smithi079.stdout:6/57: rename d0/d6/la to d0/l10 0 2024-05-09T06:29:13.563 INFO:tasks.workunit.client.1.smithi079.stdout:7/66: creat d4/d7/f13 x:0 0 0 2024-05-09T06:29:13.563 INFO:tasks.workunit.client.1.smithi079.stdout:7/67: creat d4/f14 x:0 0 0 2024-05-09T06:29:13.563 INFO:tasks.workunit.client.1.smithi079.stdout:7/68: creat d4/d7/dd/f15 x:0 0 0 2024-05-09T06:29:13.563 INFO:tasks.workunit.client.1.smithi079.stdout:7/69: creat d4/d7/dd/f16 x:0 0 0 2024-05-09T06:29:13.563 INFO:tasks.workunit.client.1.smithi079.stdout:7/70: creat d4/f17 x:0 0 0 2024-05-09T06:29:13.563 INFO:tasks.workunit.client.1.smithi079.stdout:7/71: chown d4/cb 1646257 1 2024-05-09T06:29:13.564 INFO:tasks.workunit.client.1.smithi079.stdout:7/72: chown d4/f12 0 1 2024-05-09T06:29:13.569 INFO:tasks.workunit.client.1.smithi079.stdout:6/58: dread d0/f5 [0,4194304] 0 2024-05-09T06:29:13.572 INFO:tasks.workunit.client.1.smithi079.stdout:4/44: rename f5 to d6/d8/d9/fc 0 2024-05-09T06:29:13.585 INFO:tasks.workunit.client.1.smithi079.stdout:4/45: read f2 [6858016,126971] 0 2024-05-09T06:29:13.587 INFO:tasks.workunit.client.1.smithi079.stdout:4/46: dread d6/d8/d9/fc [0,4194304] 0 2024-05-09T06:29:13.587 INFO:tasks.workunit.client.1.smithi079.stdout:4/47: dread - d6/d8/d9/fb zero size 2024-05-09T06:29:13.591 INFO:tasks.workunit.client.1.smithi079.stdout:9/61: fsync d1/d5/fe 0 2024-05-09T06:29:13.596 INFO:tasks.workunit.client.1.smithi079.stdout:6/59: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:29:13.606 INFO:tasks.workunit.client.1.smithi079.stdout:9/62: dwrite d1/fd [0,4194304] 0 2024-05-09T06:29:13.615 INFO:tasks.workunit.client.1.smithi079.stdout:9/63: dread f0 [0,4194304] 0 2024-05-09T06:29:13.615 INFO:tasks.workunit.client.1.smithi079.stdout:9/64: creat d1/d5/ff x:0 0 0 2024-05-09T06:29:13.615 INFO:tasks.workunit.client.1.smithi079.stdout:9/65: readlink d1/d5/l9 0 2024-05-09T06:29:13.615 INFO:tasks.workunit.client.1.smithi079.stdout:9/66: write d1/d5/ff [592674,41870] 0 2024-05-09T06:29:13.618 INFO:tasks.workunit.client.1.smithi079.stdout:9/67: dread d1/f3 [0,4194304] 0 2024-05-09T06:29:13.636 INFO:tasks.workunit.client.1.smithi079.stdout:4/48: fsync d6/d8/d9/fb 0 2024-05-09T06:29:13.640 INFO:tasks.workunit.client.1.smithi079.stdout:4/49: mkdir d6/dd 0 2024-05-09T06:29:13.655 INFO:tasks.workunit.client.1.smithi079.stdout:4/50: rmdir d6/d8/d9 39 2024-05-09T06:29:13.658 INFO:tasks.workunit.client.1.smithi079.stdout:4/51: mknod d6/d8/ce 0 2024-05-09T06:29:13.662 INFO:tasks.workunit.client.1.smithi079.stdout:4/52: mkdir d6/dd/df 0 2024-05-09T06:29:13.664 INFO:tasks.workunit.client.1.smithi079.stdout:4/53: dread d6/fa [0,4194304] 0 2024-05-09T06:29:13.665 INFO:tasks.workunit.client.1.smithi079.stdout:4/54: write d6/d8/d9/fb [751029,11282] 0 2024-05-09T06:29:13.665 INFO:tasks.workunit.client.1.smithi079.stdout:4/55: chown d6/d8/d9 305 1 2024-05-09T06:29:13.671 INFO:tasks.workunit.client.1.smithi079.stdout:4/56: truncate f2 295855 0 2024-05-09T06:29:13.671 INFO:tasks.workunit.client.1.smithi079.stdout:4/57: chown d6/d8/d9 222 1 2024-05-09T06:29:13.674 INFO:tasks.workunit.client.1.smithi079.stdout:4/58: creat d6/d8/f10 x:0 0 0 2024-05-09T06:29:13.678 INFO:tasks.workunit.client.1.smithi079.stdout:4/59: link d6/d8/ce d6/c11 0 2024-05-09T06:29:13.680 INFO:tasks.workunit.client.1.smithi079.stdout:4/60: symlink d6/d8/d9/l12 0 2024-05-09T06:29:13.683 INFO:tasks.workunit.client.1.smithi079.stdout:4/61: dread d6/fa [0,4194304] 0 2024-05-09T06:29:13.683 INFO:tasks.workunit.client.1.smithi079.stdout:4/62: readlink d6/d8/d9/l12 0 2024-05-09T06:29:13.695 INFO:tasks.workunit.client.1.smithi079.stdout:4/63: dwrite d6/d8/f10 [0,4194304] 0 2024-05-09T06:29:13.700 INFO:tasks.workunit.client.1.smithi079.stdout:4/64: creat d6/dd/df/f13 x:0 0 0 2024-05-09T06:29:13.700 INFO:tasks.workunit.client.1.smithi079.stdout:4/65: fdatasync d6/fa 0 2024-05-09T06:29:13.701 INFO:tasks.workunit.client.1.smithi079.stdout:9/68: truncate d1/f3 947300 0 2024-05-09T06:29:13.704 INFO:tasks.workunit.client.1.smithi079.stdout:4/66: creat d6/d8/d9/f14 x:0 0 0 2024-05-09T06:29:13.704 INFO:tasks.workunit.client.1.smithi079.stdout:4/67: chown d6/dd/df 26193 1 2024-05-09T06:29:13.706 INFO:tasks.workunit.client.1.smithi079.stdout:4/68: dread d6/d8/d9/fc [0,4194304] 0 2024-05-09T06:29:13.707 INFO:tasks.workunit.client.1.smithi079.stdout:9/69: link d1/d6/da/fc d1/d5/f10 0 2024-05-09T06:29:13.749 INFO:tasks.workunit.client.1.smithi079.stdout:4/69: write f2 [593298,19651] 0 2024-05-09T06:29:13.749 INFO:tasks.workunit.client.1.smithi079.stdout:4/70: stat d6/d8/d9/f14 0 2024-05-09T06:29:13.795 INFO:tasks.workunit.client.1.smithi079.stdout:9/70: link d1/f3 d1/d6/d7/f11 0 2024-05-09T06:29:13.796 INFO:tasks.workunit.client.1.smithi079.stdout:9/71: write d1/d5/f10 [305782,70960] 0 2024-05-09T06:29:13.796 INFO:tasks.workunit.client.1.smithi079.stdout:9/72: readlink d1/l4 0 2024-05-09T06:29:13.796 INFO:tasks.workunit.client.1.smithi079.stdout:4/71: rmdir d6/d8/d9 39 2024-05-09T06:29:13.796 INFO:tasks.workunit.client.1.smithi079.stdout:4/72: fdatasync d6/d8/d9/f14 0 2024-05-09T06:29:13.796 INFO:tasks.workunit.client.1.smithi079.stdout:9/73: read f0 [574095,66285] 0 2024-05-09T06:29:13.798 INFO:tasks.workunit.client.1.smithi079.stdout:4/73: dread d6/fa [0,4194304] 0 2024-05-09T06:29:13.798 INFO:tasks.workunit.client.1.smithi079.stdout:4/74: dread - d6/d8/d9/f14 zero size 2024-05-09T06:29:13.798 INFO:tasks.workunit.client.1.smithi079.stdout:4/75: write d6/fa [830157,77077] 0 2024-05-09T06:29:13.804 INFO:tasks.workunit.client.1.smithi079.stdout:4/76: mkdir d6/d15 0 2024-05-09T06:29:13.806 INFO:tasks.workunit.client.1.smithi079.stdout:4/77: symlink d6/dd/l16 0 2024-05-09T06:29:13.808 INFO:tasks.workunit.client.1.smithi079.stdout:4/78: creat d6/d8/d9/f17 x:0 0 0 2024-05-09T06:29:13.828 INFO:tasks.workunit.client.1.smithi079.stdout:4/79: dwrite d6/dd/df/f13 [0,4194304] 0 2024-05-09T06:29:13.828 INFO:tasks.workunit.client.1.smithi079.stdout:4/80: dread - d6/d8/d9/f17 zero size 2024-05-09T06:29:13.828 INFO:tasks.workunit.client.1.smithi079.stdout:4/81: read f2 [230904,33691] 0 2024-05-09T06:29:13.828 INFO:tasks.workunit.client.1.smithi079.stdout:4/82: write d6/d8/d9/fb [1785383,51037] 0 2024-05-09T06:29:13.832 INFO:tasks.workunit.client.1.smithi079.stdout:4/83: mknod d6/dd/c18 0 2024-05-09T06:29:13.837 INFO:tasks.workunit.client.1.smithi079.stdout:4/84: rmdir d6/dd/df 39 2024-05-09T06:29:13.837 INFO:tasks.workunit.client.1.smithi079.stdout:4/85: write d6/d8/d9/fb [1049142,24528] 0 2024-05-09T06:29:13.840 INFO:tasks.workunit.client.1.smithi079.stdout:4/86: rename d6/d8/d9/fb to d6/dd/df/f19 0 2024-05-09T06:29:13.844 INFO:tasks.workunit.client.1.smithi079.stdout:4/87: mkdir d6/d1a 0 2024-05-09T06:29:13.844 INFO:tasks.workunit.client.1.smithi079.stdout:4/88: chown d6/d8/d9/f14 13 1 2024-05-09T06:29:13.846 INFO:tasks.workunit.client.1.smithi079.stdout:4/89: creat d6/dd/f1b x:0 0 0 2024-05-09T06:29:13.849 INFO:tasks.workunit.client.1.smithi079.stdout:4/90: creat d6/d1a/f1c x:0 0 0 2024-05-09T06:29:13.849 INFO:tasks.workunit.client.1.smithi079.stdout:4/91: write d6/dd/df/f19 [2276557,129422] 0 2024-05-09T06:29:13.854 INFO:tasks.workunit.client.1.smithi079.stdout:4/92: dread d6/d8/d9/fc [0,4194304] 0 2024-05-09T06:29:13.855 INFO:tasks.workunit.client.1.smithi079.stdout:4/93: chown d6 94 1 2024-05-09T06:29:13.855 INFO:tasks.workunit.client.1.smithi079.stdout:4/94: write d6/dd/f1b [934577,106399] 0 2024-05-09T06:29:13.855 INFO:tasks.workunit.client.1.smithi079.stdout:4/95: chown d6/dd/f1b 311573 1 2024-05-09T06:29:13.867 INFO:tasks.workunit.client.1.smithi079.stdout:4/96: dwrite d6/d1a/f1c [0,4194304] 0 2024-05-09T06:29:13.867 INFO:tasks.workunit.client.1.smithi079.stdout:4/97: dread - d6/d8/d9/f14 zero size 2024-05-09T06:29:13.872 INFO:tasks.workunit.client.1.smithi079.stdout:4/98: symlink d6/dd/l1d 0 2024-05-09T06:29:13.875 INFO:tasks.workunit.client.1.smithi079.stdout:9/74: truncate d1/d6/da/fc 544535 0 2024-05-09T06:29:13.879 INFO:tasks.workunit.client.1.smithi079.stdout:4/99: read d6/d1a/f1c [1685186,123596] 0 2024-05-09T06:29:13.879 INFO:tasks.workunit.client.1.smithi079.stdout:4/100: chown d6/dd/l1d 31 1 2024-05-09T06:29:13.888 INFO:tasks.workunit.client.1.smithi079.stdout:4/101: dread d6/dd/df/f19 [0,4194304] 0 2024-05-09T06:29:13.889 INFO:tasks.workunit.client.1.smithi079.stdout:9/75: dwrite d1/fd [0,4194304] 0 2024-05-09T06:29:13.889 INFO:tasks.workunit.client.1.smithi079.stdout:9/76: read f0 [880560,90902] 0 2024-05-09T06:29:13.890 INFO:tasks.workunit.client.1.smithi079.stdout:4/102: symlink d6/d8/l1e 0 2024-05-09T06:29:13.891 INFO:tasks.workunit.client.1.smithi079.stdout:9/77: mknod d1/d6/c12 0 2024-05-09T06:29:13.893 INFO:tasks.workunit.client.1.smithi079.stdout:4/103: mknod d6/dd/c1f 0 2024-05-09T06:29:13.893 INFO:tasks.workunit.client.1.smithi079.stdout:4/104: chown d6/d8/l1e 7122 1 2024-05-09T06:29:13.897 INFO:tasks.workunit.client.1.smithi079.stdout:4/105: mkdir d6/d1a/d20 0 2024-05-09T06:29:13.897 INFO:tasks.workunit.client.1.smithi079.stdout:4/106: truncate d6/d8/d9/f17 83899 0 2024-05-09T06:29:13.897 INFO:tasks.workunit.client.1.smithi079.stdout:4/107: fsync d6/d8/f10 0 2024-05-09T06:29:13.897 INFO:tasks.workunit.client.1.smithi079.stdout:4/108: write d6/d8/d9/f17 [655413,82660] 0 2024-05-09T06:29:13.897 INFO:tasks.workunit.client.1.smithi079.stdout:4/109: getdents d6/d15 0 2024-05-09T06:29:13.897 INFO:tasks.workunit.client.1.smithi079.stdout:4/110: write d6/d8/d9/f14 [978175,111785] 0 2024-05-09T06:29:13.914 INFO:tasks.workunit.client.1.smithi079.stdout:4/111: dwrite d6/d8/d9/f14 [0,4194304] 0 2024-05-09T06:29:13.919 INFO:tasks.workunit.client.1.smithi079.stdout:4/112: creat d6/dd/df/f21 x:0 0 0 2024-05-09T06:29:13.922 INFO:tasks.workunit.client.1.smithi079.stdout:4/113: unlink d6/c11 0 2024-05-09T06:29:13.922 INFO:tasks.workunit.client.1.smithi079.stdout:4/114: write d6/d8/d9/f17 [291958,42502] 0 2024-05-09T06:29:13.924 INFO:tasks.workunit.client.1.smithi079.stdout:4/115: rmdir d6/d1a/d20 0 2024-05-09T06:29:13.938 INFO:tasks.workunit.client.1.smithi079.stdout:4/116: dwrite d6/d1a/f1c [0,4194304] 0 2024-05-09T06:29:13.938 INFO:tasks.workunit.client.1.smithi079.stdout:4/117: chown d6/dd 1 1 2024-05-09T06:29:13.938 INFO:tasks.workunit.client.1.smithi079.stdout:4/118: fsync d6/dd/df/f13 0 2024-05-09T06:29:13.951 INFO:tasks.workunit.client.1.smithi079.stdout:4/119: dwrite d6/dd/df/f13 [4194304,4194304] 0 2024-05-09T06:29:13.951 INFO:tasks.workunit.client.1.smithi079.stdout:4/120: chown d6/dd/l1d 1797 1 2024-05-09T06:29:13.951 INFO:tasks.workunit.client.1.smithi079.stdout:4/121: chown d6/d8/d9/f14 8 1 2024-05-09T06:29:13.961 INFO:tasks.workunit.client.1.smithi079.stdout:9/78: link d1/d6/da/fc d1/d6/f13 0 2024-05-09T06:29:13.964 INFO:tasks.workunit.client.1.smithi079.stdout:9/79: creat d1/d6/d7/f14 x:0 0 0 2024-05-09T06:29:13.964 INFO:tasks.workunit.client.1.smithi079.stdout:9/80: creat d1/d5/f15 x:0 0 0 2024-05-09T06:29:13.967 INFO:tasks.workunit.client.1.smithi079.stdout:4/122: dwrite d6/dd/df/f19 [0,4194304] 0 2024-05-09T06:29:13.968 INFO:tasks.workunit.client.1.smithi079.stdout:4/123: fdatasync d6/d8/d9/f14 0 2024-05-09T06:29:13.977 INFO:tasks.workunit.client.1.smithi079.stdout:9/81: dwrite d1/d6/d7/f11 [0,4194304] 0 2024-05-09T06:29:13.997 INFO:tasks.workunit.client.1.smithi079.stdout:4/124: dwrite d6/d8/d9/f17 [0,4194304] 0 2024-05-09T06:29:13.998 INFO:tasks.workunit.client.1.smithi079.stdout:4/125: chown d6/dd/df/f19 0 1 2024-05-09T06:29:13.998 INFO:tasks.workunit.client.1.smithi079.stdout:9/82: dwrite d1/d5/f15 [0,4194304] 0 2024-05-09T06:29:13.999 INFO:tasks.workunit.client.1.smithi079.stdout:9/83: dread d1/d5/f10 [0,4194304] 0 2024-05-09T06:29:14.036 INFO:tasks.workunit.client.1.smithi079.stdout:9/84: rmdir d1/d6/d7 39 2024-05-09T06:29:14.038 INFO:tasks.workunit.client.1.smithi079.stdout:9/85: dread d1/d5/ff [0,4194304] 0 2024-05-09T06:29:14.038 INFO:tasks.workunit.client.1.smithi079.stdout:9/86: creat d1/d5/f16 x:0 0 0 2024-05-09T06:29:14.038 INFO:tasks.workunit.client.1.smithi079.stdout:9/87: fdatasync d1/f3 0 2024-05-09T06:29:14.038 INFO:tasks.workunit.client.1.smithi079.stdout:9/88: dread - d1/d5/fe zero size 2024-05-09T06:29:14.041 INFO:tasks.workunit.client.1.smithi079.stdout:9/89: getdents d1/d6 0 2024-05-09T06:29:14.041 INFO:tasks.workunit.client.1.smithi079.stdout:9/90: creat d1/f17 x:0 0 0 2024-05-09T06:29:14.047 INFO:tasks.workunit.client.1.smithi079.stdout:9/91: dread d1/f3 [0,4194304] 0 2024-05-09T06:29:14.051 INFO:tasks.workunit.client.1.smithi079.stdout:9/92: creat d1/d6/f18 x:0 0 0 2024-05-09T06:29:14.071 INFO:tasks.workunit.client.1.smithi079.stdout:9/93: dwrite d1/fd [4194304,4194304] 0 2024-05-09T06:29:14.151 INFO:tasks.workunit.client.1.smithi079.stdout:9/94: dwrite d1/d5/f15 [0,4194304] 0 2024-05-09T06:29:14.312 INFO:tasks.workunit.client.1.smithi079.stdout:9/95: rmdir d1/d5 39 2024-05-09T06:29:14.322 INFO:tasks.workunit.client.1.smithi079.stdout:9/96: mkdir d1/d6/d7/d19 0 2024-05-09T06:29:14.323 INFO:tasks.workunit.client.1.smithi079.stdout:9/97: chown d1/l4 877536 1 2024-05-09T06:29:14.323 INFO:tasks.workunit.client.1.smithi079.stdout:9/98: creat d1/d6/da/f1a x:0 0 0 2024-05-09T06:29:14.338 INFO:tasks.workunit.client.1.smithi079.stdout:9/99: dread d1/d5/ff [0,4194304] 0 2024-05-09T06:29:14.339 INFO:tasks.workunit.client.1.smithi079.stdout:9/100: symlink d1/l1b 0 2024-05-09T06:29:14.344 INFO:tasks.workunit.client.1.smithi079.stdout:9/101: unlink d1/d6/c12 0 2024-05-09T06:29:14.379 INFO:tasks.workunit.client.1.smithi079.stdout:9/102: dwrite d1/d6/d7/f11 [0,4194304] 0 2024-05-09T06:29:14.379 INFO:tasks.workunit.client.1.smithi079.stdout:9/103: chown d1/l4 1067 1 2024-05-09T06:29:14.379 INFO:tasks.workunit.client.1.smithi079.stdout:9/104: creat d1/d6/f1c x:0 0 0 2024-05-09T06:29:14.379 INFO:tasks.workunit.client.1.smithi079.stdout:9/105: dread - d1/d6/da/f1a zero size 2024-05-09T06:29:14.380 INFO:tasks.workunit.client.1.smithi079.stdout:9/106: truncate d1/d6/f1c 852016 0 2024-05-09T06:29:14.384 INFO:tasks.workunit.client.1.smithi079.stdout:9/107: mknod d1/d6/d7/d19/c1d 0 2024-05-09T06:29:14.393 INFO:tasks.workunit.client.1.smithi079.stdout:9/108: write d1/fd [1525770,14158] 0 2024-05-09T06:29:14.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:14 smithi062 ceph-mon[26920]: pgmap v236: 65 pgs: 65 active+clean; 148 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 663 op/s 2024-05-09T06:29:14.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:14 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:14.413 INFO:tasks.workunit.client.1.smithi079.stdout:9/109: dwrite d1/d6/f13 [0,4194304] 0 2024-05-09T06:29:14.420 INFO:tasks.workunit.client.1.smithi079.stdout:9/110: link d1/d6/d7/f11 d1/d6/d7/d19/f1e 0 2024-05-09T06:29:14.433 INFO:tasks.workunit.client.1.smithi079.stdout:9/111: dwrite d1/d6/f18 [0,4194304] 0 2024-05-09T06:29:14.441 INFO:tasks.workunit.client.1.smithi079.stdout:9/112: write f0 [3709989,87565] 0 2024-05-09T06:29:14.441 INFO:tasks.workunit.client.1.smithi079.stdout:9/113: fdatasync d1/d5/f10 0 2024-05-09T06:29:14.441 INFO:tasks.workunit.client.1.smithi079.stdout:9/114: stat d1/d5/f15 0 2024-05-09T06:29:14.471 INFO:tasks.workunit.client.1.smithi079.stdout:9/115: unlink f0 0 2024-05-09T06:29:14.521 INFO:tasks.workunit.client.1.smithi079.stdout:9/116: link d1/d5/f15 d1/d6/d7/d19/f1f 0 2024-05-09T06:29:14.521 INFO:tasks.workunit.client.1.smithi079.stdout:9/117: dread - d1/f17 zero size 2024-05-09T06:29:14.521 INFO:tasks.workunit.client.1.smithi079.stdout:9/118: creat d1/d6/f20 x:0 0 0 2024-05-09T06:29:14.524 INFO:tasks.workunit.client.1.smithi079.stdout:9/119: creat d1/d5/f21 x:0 0 0 2024-05-09T06:29:14.532 INFO:tasks.workunit.client.1.smithi079.stdout:9/120: dread d1/d6/d7/f11 [0,4194304] 0 2024-05-09T06:29:14.534 INFO:tasks.workunit.client.1.smithi079.stdout:9/121: rename d1/d5/fe to d1/d6/d7/f22 0 2024-05-09T06:29:14.536 INFO:tasks.workunit.client.1.smithi079.stdout:9/122: mkdir d1/d6/d7/d19/d23 0 2024-05-09T06:29:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:14 smithi079 ceph-mon[35268]: pgmap v236: 65 pgs: 65 active+clean; 148 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 663 op/s 2024-05-09T06:29:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:14 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.063+0000 7fda556f2700 1 -- 172.21.15.62:0/2314740201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda500fbcc0 msgr2=0x7fda500fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.063+0000 7fda556f2700 1 --2- 172.21.15.62:0/2314740201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda500fbcc0 0x7fda500fc0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda40004940 tx=0x7fda40009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.063+0000 7fda556f2700 1 -- 172.21.15.62:0/2314740201 shutdown_connections 2024-05-09T06:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.063+0000 7fda556f2700 1 --2- 172.21.15.62:0/2314740201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500fcf70 0x7fda500fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.063+0000 7fda556f2700 1 --2- 172.21.15.62:0/2314740201 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda500fbcc0 0x7fda500fc0d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.063+0000 7fda556f2700 1 -- 172.21.15.62:0/2314740201 >> 172.21.15.62:0/2314740201 conn(0x7fda500f7420 msgr2=0x7fda500f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.063+0000 7fda556f2700 1 -- 172.21.15.62:0/2314740201 shutdown_connections 2024-05-09T06:29:15.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.063+0000 7fda556f2700 1 -- 172.21.15.62:0/2314740201 wait complete. 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.064+0000 7fda556f2700 1 Processor -- start 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.064+0000 7fda556f2700 1 -- start start 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.064+0000 7fda556f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500fbcc0 0x7fda50110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.064+0000 7fda556f2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda500fcf70 0x7fda50112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.064+0000 7fda556f2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda50066b70 con 0x7fda500fcf70 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.064+0000 7fda556f2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda50066cb0 con 0x7fda500fbcc0 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda4effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500fbcc0 0x7fda50110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda4e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda500fcf70 0x7fda50112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda4effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500fbcc0 0x7fda50110710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:39382/0 (socket says 172.21.15.62:39382) 2024-05-09T06:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda4effd700 1 -- 172.21.15.62:0/3468954010 learned_addr learned my addr 172.21.15.62:0/3468954010 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda4effd700 1 -- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda500fcf70 msgr2=0x7fda50112c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda4effd700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda500fcf70 0x7fda50112c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda4effd700 1 -- 172.21.15.62:0/3468954010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40005040 con 0x7fda500fbcc0 2024-05-09T06:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda4effd700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500fbcc0 0x7fda50110710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda40013870 tx=0x7fda40009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda377fe700 1 -- 172.21.15.62:0/3468954010 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda40021070 con 0x7fda500fbcc0 2024-05-09T06:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda377fe700 1 -- 172.21.15.62:0/3468954010 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda40009430 con 0x7fda500fbcc0 2024-05-09T06:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.065+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda501131a0 con 0x7fda500fbcc0 2024-05-09T06:29:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.066+0000 7fda377fe700 1 -- 172.21.15.62:0/3468954010 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda4000e070 con 0x7fda500fbcc0 2024-05-09T06:29:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.066+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda50113690 con 0x7fda500fbcc0 2024-05-09T06:29:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.067+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5005f5c0 con 0x7fda500fbcc0 2024-05-09T06:29:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.067+0000 7fda377fe700 1 -- 172.21.15.62:0/3468954010 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fda40013af0 con 0x7fda500fbcc0 2024-05-09T06:29:15.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.068+0000 7fda377fe700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fda38069230 0x7fda3806b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.068+0000 7fda377fe700 1 -- 172.21.15.62:0/3468954010 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fda400884b0 con 0x7fda500fbcc0 2024-05-09T06:29:15.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.068+0000 7fda4e7fc700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fda38069230 0x7fda3806b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.068+0000 7fda4e7fc700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fda38069230 0x7fda3806b6e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda44009b80 tx=0x7fda4400b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:15.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.072+0000 7fda377fe700 1 -- 172.21.15.62:0/3468954010 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fda40054780 con 0x7fda500fbcc0 2024-05-09T06:29:15.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.374+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda50101260 con 0x7fda38069230 2024-05-09T06:29:15.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.375+0000 7fda377fe700 1 -- 172.21.15.62:0/3468954010 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fda50101260 con 0x7fda38069230 2024-05-09T06:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fda38069230 msgr2=0x7fda3806b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fda38069230 0x7fda3806b6e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda44009b80 tx=0x7fda4400b040 comp rx=0 tx=0).stop 2024-05-09T06:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500fbcc0 msgr2=0x7fda50110710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500fbcc0 0x7fda50110710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda40013870 tx=0x7fda40009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 shutdown_connections 2024-05-09T06:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fda38069230 0x7fda3806b6e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda500fbcc0 0x7fda50110710 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 --2- 172.21.15.62:0/3468954010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda500fcf70 0x7fda50112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 >> 172.21.15.62:0/3468954010 conn(0x7fda500f7420 msgr2=0x7fda500f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:15.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 shutdown_connections 2024-05-09T06:29:15.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.378+0000 7fda556f2700 1 -- 172.21.15.62:0/3468954010 wait complete. 2024-05-09T06:29:15.372 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:29:15.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.505+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/393649383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb40fff40 msgr2=0x7f4bb4102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.505+0000 7f4bb8d0e700 1 --2- 172.21.15.62:0/393649383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb40fff40 0x7f4bb4102320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8004940 tx=0x7f4ba8009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:15.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.506+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/393649383 shutdown_connections 2024-05-09T06:29:15.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.506+0000 7f4bb8d0e700 1 --2- 172.21.15.62:0/393649383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb40fff40 0x7f4bb4102320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.506+0000 7f4bb8d0e700 1 --2- 172.21.15.62:0/393649383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bb4066260 0x7f4bb40ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.506+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/393649383 >> 172.21.15.62:0/393649383 conn(0x7f4bb40f7430 msgr2=0x7f4bb40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:15.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.506+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/393649383 shutdown_connections 2024-05-09T06:29:15.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.506+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/393649383 wait complete. 2024-05-09T06:29:15.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.506+0000 7f4bb8d0e700 1 Processor -- start 2024-05-09T06:29:15.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.506+0000 7f4bb8d0e700 1 -- start start 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb8d0e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb4066260 0x7f4bb410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb8d0e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bb40fff40 0x7f4bb41100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb8d0e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb41106b0 con 0x7f4bb4066260 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb8d0e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb4110f00 con 0x7f4bb40fff40 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb4066260 0x7f4bb410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bb40fff40 0x7f4bb41100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb4066260 0x7f4bb410fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51210/0 (socket says 172.21.15.62:51210) 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb259c700 1 -- 172.21.15.62:0/200384938 learned_addr learned my addr 172.21.15.62:0/200384938 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb259c700 1 -- 172.21.15.62:0/200384938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bb40fff40 msgr2=0x7f4bb41100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb259c700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bb40fff40 0x7f4bb41100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb259c700 1 -- 172.21.15.62:0/200384938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba8005040 con 0x7f4bb4066260 2024-05-09T06:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb1d9b700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bb40fff40 0x7f4bb41100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.507+0000 7f4bb259c700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb4066260 0x7f4bb410fb70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400eb70 tx=0x7f4ba400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.508+0000 7f4ba2ffd700 1 -- 172.21.15.62:0/200384938 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ba4007cc0 con 0x7f4bb4066260 2024-05-09T06:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.508+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb4111180 con 0x7f4bb4066260 2024-05-09T06:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.508+0000 7f4ba2ffd700 1 -- 172.21.15.62:0/200384938 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ba400f040 con 0x7f4bb4066260 2024-05-09T06:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.508+0000 7f4ba2ffd700 1 -- 172.21.15.62:0/200384938 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ba400cb20 con 0x7f4bb4066260 2024-05-09T06:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.508+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb41116c0 con 0x7f4bb4066260 2024-05-09T06:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.509+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb405f5c0 con 0x7f4bb4066260 2024-05-09T06:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.510+0000 7f4ba2ffd700 1 -- 172.21.15.62:0/200384938 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4ba400cc80 con 0x7f4bb4066260 2024-05-09T06:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.510+0000 7f4ba2ffd700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4b9c0692b0 0x7f4b9c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.511+0000 7f4ba2ffd700 1 -- 172.21.15.62:0/200384938 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4ba4086ba0 con 0x7f4bb4066260 2024-05-09T06:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.511+0000 7f4bb1d9b700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4b9c0692b0 0x7f4b9c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.511+0000 7f4bb1d9b700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4b9c0692b0 0x7f4b9c06b760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800b0d0 tx=0x7f4ba8009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:15.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.519+0000 7f4ba2ffd700 1 -- 172.21.15.62:0/200384938 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4ba404e250 con 0x7f4bb4066260 2024-05-09T06:29:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.801+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bb41119a0 con 0x7f4b9c0692b0 2024-05-09T06:29:15.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.802+0000 7f4ba2ffd700 1 -- 172.21.15.62:0/200384938 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4bb41119a0 con 0x7f4b9c0692b0 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.804+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4b9c0692b0 msgr2=0x7f4b9c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.804+0000 7f4bb8d0e700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4b9c0692b0 0x7f4b9c06b760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800b0d0 tx=0x7f4ba8009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.804+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb4066260 msgr2=0x7f4bb410fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.804+0000 7f4bb8d0e700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb4066260 0x7f4bb410fb70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400eb70 tx=0x7f4ba400b040 comp rx=0 tx=0).stop 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.805+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 shutdown_connections 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.805+0000 7f4bb8d0e700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f4b9c0692b0 0x7f4b9c06b760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.805+0000 7f4bb8d0e700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bb4066260 0x7f4bb410fb70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.805+0000 7f4bb8d0e700 1 --2- 172.21.15.62:0/200384938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bb40fff40 0x7f4bb41100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.805+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 >> 172.21.15.62:0/200384938 conn(0x7f4bb40f7430 msgr2=0x7f4bb40fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.805+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 shutdown_connections 2024-05-09T06:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.805+0000 7f4bb8d0e700 1 -- 172.21.15.62:0/200384938 wait complete. 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.939+0000 7eff7c00e700 1 -- 172.21.15.62:0/1465585823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 msgr2=0x7eff740fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.939+0000 7eff7c00e700 1 --2- 172.21.15.62:0/1465585823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 0x7eff740fe830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7eff70004940 tx=0x7eff70009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 -- 172.21.15.62:0/1465585823 shutdown_connections 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 --2- 172.21.15.62:0/1465585823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff740fed70 0x7eff740faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 --2- 172.21.15.62:0/1465585823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 0x7eff740fe830 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 -- 172.21.15.62:0/1465585823 >> 172.21.15.62:0/1465585823 conn(0x7eff740f6be0 msgr2=0x7eff740f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 -- 172.21.15.62:0/1465585823 shutdown_connections 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 -- 172.21.15.62:0/1465585823 wait complete. 2024-05-09T06:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 Processor -- start 2024-05-09T06:29:15.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 -- start start 2024-05-09T06:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 0x7eff740fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff740fed70 0x7eff740fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740fe030 con 0x7eff740fe420 2024-05-09T06:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.940+0000 7eff7c00e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740fc620 con 0x7eff740fed70 2024-05-09T06:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff79daa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 0x7eff740fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff79daa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 0x7eff740fda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51214/0 (socket says 172.21.15.62:51214) 2024-05-09T06:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff79daa700 1 -- 172.21.15.62:0/3657488248 learned_addr learned my addr 172.21.15.62:0/3657488248 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff795a9700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff740fed70 0x7eff740fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff79daa700 1 -- 172.21.15.62:0/3657488248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff740fed70 msgr2=0x7eff740fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff79daa700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff740fed70 0x7eff740fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff79daa700 1 -- 172.21.15.62:0/3657488248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70005040 con 0x7eff740fe420 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff79daa700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 0x7eff740fda30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff70013870 tx=0x7eff70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff6a7fc700 1 -- 172.21.15.62:0/3657488248 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff70021070 con 0x7eff740fe420 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.941+0000 7eff6a7fc700 1 -- 172.21.15.62:0/3657488248 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff70009430 con 0x7eff740fe420 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.942+0000 7eff6a7fc700 1 -- 172.21.15.62:0/3657488248 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff7000e070 con 0x7eff740fe420 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.942+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff740fc870 con 0x7eff740fe420 2024-05-09T06:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.942+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff740fcdb0 con 0x7eff740fe420 2024-05-09T06:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.943+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7404c710 con 0x7eff740fe420 2024-05-09T06:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.944+0000 7eff6a7fc700 1 -- 172.21.15.62:0/3657488248 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7eff7001c750 con 0x7eff740fe420 2024-05-09T06:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.944+0000 7eff6a7fc700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7eff60069240 0x7eff6006b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.944+0000 7eff6a7fc700 1 -- 172.21.15.62:0/3657488248 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7eff70088460 con 0x7eff740fe420 2024-05-09T06:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.944+0000 7eff795a9700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7eff60069240 0x7eff6006b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.945+0000 7eff795a9700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7eff60069240 0x7eff6006b6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff64009b80 tx=0x7eff6400b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:15.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:15.953+0000 7eff6a7fc700 1 -- 172.21.15.62:0/3657488248 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7eff70058220 con 0x7eff740fe420 2024-05-09T06:29:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.236+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7eff74102470 con 0x7eff60069240 2024-05-09T06:29:16.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.255+0000 7eff6a7fc700 1 -- 172.21.15.62:0/3657488248 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7eff74102470 con 0x7eff60069240 2024-05-09T06:29:16.238 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (6m) 93s ago 7m 24.9M - 0.25.0 c8568f914cd2 b9c4737eec20 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (7m) 93s ago 7m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (6m) 98s ago 6m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (5m) 93s ago 7m 84.5M - 9.4.7 954c08fa6188 06a19fe449ea 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (111s) 93s ago 111s 12.1M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (117s) 93s ago 116s 15.9M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (109s) 98s ago 108s 12.0M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (114s) 98s ago 114s 12.1M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:9283 running (9m) 93s ago 9m 481M - 17.2.7-933-g4ba5a836 b96134859c76 f1bb37d51b2f 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283 running (6m) 98s ago 6m 433M - 17.2.7-933-g4ba5a836 b96134859c76 fb4cbe68939f 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (9m) 93s ago 9m 47.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (6m) 98s ago 6m 36.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (7m) 93s ago 7m 15.9M - 1.5.0 0da6a335fe13 a2eb68715549 2024-05-09T06:29:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (6m) 98s ago 6m 15.7M - 1.5.0 0da6a335fe13 9d423500267f 2024-05-09T06:29:16.240 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (5m) 93s ago 5m 45.6M 4288M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:29:16.240 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (5m) 93s ago 5m 48.0M 4288M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:29:16.240 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (4m) 93s ago 4m 46.4M 4288M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:29:16.240 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (4m) 98s ago 4m 44.5M 5312M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:29:16.240 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (3m) 98s ago 3m 42.1M 5312M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:29:16.240 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (3m) 98s ago 3m 41.4M 5312M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:29:16.240 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (5m) 93s ago 6m 58.4M - 2.43.0 a07b618ecd1d c90458655289 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7eff60069240 msgr2=0x7eff6006b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7eff60069240 0x7eff6006b6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff64009b80 tx=0x7eff6400b040 comp rx=0 tx=0).stop 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 msgr2=0x7eff740fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 0x7eff740fda30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff70013870 tx=0x7eff70009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 shutdown_connections 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7eff60069240 0x7eff6006b6f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff740fe420 0x7eff740fda30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 --2- 172.21.15.62:0/3657488248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff740fed70 0x7eff740fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 >> 172.21.15.62:0/3657488248 conn(0x7eff740f6be0 msgr2=0x7eff740f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 shutdown_connections 2024-05-09T06:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.258+0000 7eff7c00e700 1 -- 172.21.15.62:0/3657488248 wait complete. 2024-05-09T06:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.366+0000 7f9bf84e6700 1 -- 172.21.15.62:0/730535765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 msgr2=0x7f9bf0101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.366+0000 7f9bf84e6700 1 --2- 172.21.15.62:0/730535765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 0x7f9bf0101e90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9bec004940 tx=0x7f9bec009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.366+0000 7f9bf84e6700 1 -- 172.21.15.62:0/730535765 shutdown_connections 2024-05-09T06:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.366+0000 7f9bf84e6700 1 --2- 172.21.15.62:0/730535765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bf01023d0 0x7f9bf01047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.366+0000 7f9bf84e6700 1 --2- 172.21.15.62:0/730535765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 0x7f9bf0101e90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.366+0000 7f9bf84e6700 1 -- 172.21.15.62:0/730535765 >> 172.21.15.62:0/730535765 conn(0x7f9bf00f74c0 msgr2=0x7f9bf00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.366+0000 7f9bf84e6700 1 -- 172.21.15.62:0/730535765 shutdown_connections 2024-05-09T06:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.366+0000 7f9bf84e6700 1 -- 172.21.15.62:0/730535765 wait complete. 2024-05-09T06:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf84e6700 1 Processor -- start 2024-05-09T06:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf84e6700 1 -- start start 2024-05-09T06:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf84e6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 0x7f9bf010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf84e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bf01023d0 0x7f9bf0110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf84e6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0110780 con 0x7f9bf0066af0 2024-05-09T06:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf84e6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0110f80 con 0x7f9bf01023d0 2024-05-09T06:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf6282700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 0x7f9bf010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf6282700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 0x7f9bf010fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51234/0 (socket says 172.21.15.62:51234) 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf5a81700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bf01023d0 0x7f9bf0110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.367+0000 7f9bf6282700 1 -- 172.21.15.62:0/1141960642 learned_addr learned my addr 172.21.15.62:0/1141960642 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9bf6282700 1 -- 172.21.15.62:0/1141960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bf01023d0 msgr2=0x7f9bf0110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9bf6282700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bf01023d0 0x7f9bf0110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9bf6282700 1 -- 172.21.15.62:0/1141960642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec005040 con 0x7f9bf0066af0 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9bf5a81700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bf01023d0 0x7f9bf0110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9bf6282700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 0x7f9bf010fc40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9bec000c00 tx=0x7f9bec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9be6ffd700 1 -- 172.21.15.62:0/1141960642 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bec00e030 con 0x7f9bf0066af0 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf0111200 con 0x7f9bf0066af0 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9be6ffd700 1 -- 172.21.15.62:0/1141960642 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bec013de0 con 0x7f9bf0066af0 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9be6ffd700 1 -- 172.21.15.62:0/1141960642 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bec01ce50 con 0x7f9bf0066af0 2024-05-09T06:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.368+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf0111740 con 0x7f9bf0066af0 2024-05-09T06:29:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.369+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf005f5c0 con 0x7f9bf0066af0 2024-05-09T06:29:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.371+0000 7f9be6ffd700 1 -- 172.21.15.62:0/1141960642 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9bec01c400 con 0x7f9bf0066af0 2024-05-09T06:29:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.371+0000 7f9be6ffd700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9bdc069230 0x7f9bdc06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.371+0000 7f9be6ffd700 1 -- 172.21.15.62:0/1141960642 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9bec088c30 con 0x7f9bf0066af0 2024-05-09T06:29:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.371+0000 7f9bf5a81700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9bdc069230 0x7f9bdc06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.372+0000 7f9bf5a81700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9bdc069230 0x7f9bdc06b6e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009b80 tx=0x7f9be000b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.376+0000 7f9be6ffd700 1 -- 172.21.15.62:0/1141960642 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9bec058970 con 0x7f9bf0066af0 2024-05-09T06:29:16.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:16 smithi079 ceph-mon[35268]: pgmap v237: 65 pgs: 65 active+clean; 181 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s rd, 14 MiB/s wr, 672 op/s 2024-05-09T06:29:16.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:16 smithi062 ceph-mon[26920]: pgmap v237: 65 pgs: 65 active+clean; 181 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s rd, 14 MiB/s wr, 672 op/s 2024-05-09T06:29:16.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.742+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9bf0111a60 con 0x7f9bf0066af0 2024-05-09T06:29:16.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.743+0000 7f9be6ffd700 1 -- 172.21.15.62:0/1141960642 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f9bec058500 con 0x7f9bf0066af0 2024-05-09T06:29:16.724 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 14 2024-05-09T06:29:16.725 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:29:16.726 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:29:16.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9bdc069230 msgr2=0x7f9bdc06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9bdc069230 0x7f9bdc06b6e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009b80 tx=0x7f9be000b040 comp rx=0 tx=0).stop 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 msgr2=0x7f9bf010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 0x7f9bf010fc40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9bec000c00 tx=0x7f9bec009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 shutdown_connections 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f9bdc069230 0x7f9bdc06b6e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9bf0066af0 0x7f9bf010fc40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 --2- 172.21.15.62:0/1141960642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bf01023d0 0x7f9bf0110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.745+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 >> 172.21.15.62:0/1141960642 conn(0x7f9bf00f74c0 msgr2=0x7f9bf00f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.746+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 shutdown_connections 2024-05-09T06:29:16.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.746+0000 7f9bf84e6700 1 -- 172.21.15.62:0/1141960642 wait complete. 2024-05-09T06:29:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1848886905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fdfd0 msgr2=0x7f7bac0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 --2- 172.21.15.62:0/1848886905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fdfd0 0x7f7bac0fe440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b94004940 tx=0x7f7b94009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1848886905 shutdown_connections 2024-05-09T06:29:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 --2- 172.21.15.62:0/1848886905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fdfd0 0x7f7bac0fe440 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 --2- 172.21.15.62:0/1848886905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bac0fce60 0x7f7bac0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1848886905 >> 172.21.15.62:0/1848886905 conn(0x7f7bac0f8540 msgr2=0x7f7bac0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1848886905 shutdown_connections 2024-05-09T06:29:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1848886905 wait complete. 2024-05-09T06:29:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 Processor -- start 2024-05-09T06:29:16.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.864+0000 7f7bb1de8700 1 -- start start 2024-05-09T06:29:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7bb1de8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fce60 0x7f7bac10d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7bb1de8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bac0fdfd0 0x7f7bac10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7bb1de8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac10e450 con 0x7f7bac0fce60 2024-05-09T06:29:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7bb1de8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac10e5c0 con 0x7f7bac0fdfd0 2024-05-09T06:29:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7ba3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bac0fdfd0 0x7f7bac10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7bab7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fce60 0x7f7bac10d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:16.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7ba3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bac0fdfd0 0x7f7bac10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:39450/0 (socket says 172.21.15.62:39450) 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7ba3fff700 1 -- 172.21.15.62:0/1472274887 learned_addr learned my addr 172.21.15.62:0/1472274887 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7bab7fe700 1 -- 172.21.15.62:0/1472274887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bac0fdfd0 msgr2=0x7f7bac10de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7bab7fe700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bac0fdfd0 0x7f7bac10de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7bab7fe700 1 -- 172.21.15.62:0/1472274887 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94005040 con 0x7f7bac0fce60 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.865+0000 7f7ba3fff700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bac0fdfd0 0x7f7bac10de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.866+0000 7f7bab7fe700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fce60 0x7f7bac10d910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00c800 tx=0x7f7b9c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.866+0000 7f7ba8ff9700 1 -- 172.21.15.62:0/1472274887 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b9c0106f0 con 0x7f7bac0fce60 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.866+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac112fc0 con 0x7f7bac0fce60 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.866+0000 7f7ba8ff9700 1 -- 172.21.15.62:0/1472274887 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b9c010d20 con 0x7f7bac0fce60 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.866+0000 7f7ba8ff9700 1 -- 172.21.15.62:0/1472274887 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b9c0113a0 con 0x7f7bac0fce60 2024-05-09T06:29:16.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.866+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac113550 con 0x7f7bac0fce60 2024-05-09T06:29:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.867+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac04c710 con 0x7f7bac0fce60 2024-05-09T06:29:16.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.868+0000 7f7ba8ff9700 1 -- 172.21.15.62:0/1472274887 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7b9c011620 con 0x7f7bac0fce60 2024-05-09T06:29:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.869+0000 7f7ba8ff9700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f7b980692a0 0x7f7b9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.869+0000 7f7ba8ff9700 1 -- 172.21.15.62:0/1472274887 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7b9c087160 con 0x7f7bac0fce60 2024-05-09T06:29:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.869+0000 7f7ba3fff700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f7b980692a0 0x7f7b9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:16.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.870+0000 7f7ba3fff700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f7b980692a0 0x7f7b9806b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b94004f90 tx=0x7f7b94009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:16.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:16.875+0000 7f7ba8ff9700 1 -- 172.21.15.62:0/1472274887 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7b9c056f20 con 0x7f7bac0fce60 2024-05-09T06:29:17.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.126+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bac102390 con 0x7f7b980692a0 2024-05-09T06:29:17.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.128+0000 7f7ba8ff9700 1 -- 172.21.15.62:0/1472274887 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7bac102390 con 0x7f7b980692a0 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "0/2 daemons upgraded", 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc image on host smithi079", 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:29:17.110 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f7b980692a0 msgr2=0x7f7b9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f7b980692a0 0x7f7b9806b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b94004f90 tx=0x7f7b94009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fce60 msgr2=0x7f7bac10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fce60 0x7f7bac10d910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00c800 tx=0x7f7b9c004430 comp rx=0 tx=0).stop 2024-05-09T06:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 shutdown_connections 2024-05-09T06:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f7b980692a0 0x7f7b9806b750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bac0fce60 0x7f7bac10d910 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:17.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 --2- 172.21.15.62:0/1472274887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bac0fdfd0 0x7f7bac10de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 >> 172.21.15.62:0/1472274887 conn(0x7f7bac0f8540 msgr2=0x7f7bac0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 shutdown_connections 2024-05-09T06:29:17.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:17.131+0000 7f7bb1de8700 1 -- 172.21.15.62:0/1472274887 wait complete. 2024-05-09T06:29:17.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:17 smithi079 ceph-mon[35268]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:17.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:17 smithi079 ceph-mon[35268]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:17.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:17 smithi079 ceph-mon[35268]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:17.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:17 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1141960642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:29:17.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:17 smithi062 ceph-mon[26920]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:17.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:17 smithi062 ceph-mon[26920]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:17.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:17 smithi062 ceph-mon[26920]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:17.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:17 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1141960642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:29:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:18 smithi079 ceph-mon[35268]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 20 MiB/s wr, 736 op/s 2024-05-09T06:29:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:18 smithi079 ceph-mon[35268]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:18.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:18 smithi062 ceph-mon[26920]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 20 MiB/s wr, 736 op/s 2024-05-09T06:29:18.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:18 smithi062 ceph-mon[26920]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:19.953 INFO:tasks.workunit.client.1.smithi079.stdout:5/23: sync 2024-05-09T06:29:19.953 INFO:tasks.workunit.client.1.smithi079.stdout:5/24: chown c7 1332 1 2024-05-09T06:29:19.953 INFO:tasks.workunit.client.1.smithi079.stdout:5/25: fsync f5 0 2024-05-09T06:29:20.504 INFO:tasks.workunit.client.1.smithi079.stdout:5/26: write f5 [1449717,13792] 0 2024-05-09T06:29:20.507 INFO:tasks.workunit.client.1.smithi079.stdout:5/27: mknod c9 0 2024-05-09T06:29:20.509 INFO:tasks.workunit.client.1.smithi079.stdout:5/28: creat fa x:0 0 0 2024-05-09T06:29:20.510 INFO:tasks.workunit.client.1.smithi079.stdout:5/29: write fa [707028,82344] 0 2024-05-09T06:29:20.510 INFO:tasks.workunit.client.1.smithi079.stdout:5/30: write fa [791682,129949] 0 2024-05-09T06:29:20.513 INFO:tasks.workunit.client.1.smithi079.stdout:5/31: symlink lb 0 2024-05-09T06:29:20.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:20 smithi079 ceph-mon[35268]: pgmap v239: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 26 MiB/s wr, 720 op/s 2024-05-09T06:29:20.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:20 smithi062 ceph-mon[26920]: pgmap v239: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 26 MiB/s wr, 720 op/s 2024-05-09T06:29:22.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:22 smithi079 ceph-mon[35268]: pgmap v240: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 23 MiB/s wr, 438 op/s 2024-05-09T06:29:22.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:22 smithi062 ceph-mon[26920]: pgmap v240: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 23 MiB/s wr, 438 op/s 2024-05-09T06:29:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:24 smithi062 ceph-mon[26920]: pgmap v241: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 22 MiB/s wr, 265 op/s 2024-05-09T06:29:24.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:24 smithi079 ceph-mon[35268]: pgmap v241: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 22 MiB/s wr, 265 op/s 2024-05-09T06:29:25.928 INFO:tasks.workunit.client.1.smithi079.stdout:8/27: sync 2024-05-09T06:29:25.928 INFO:tasks.workunit.client.1.smithi079.stdout:8/28: creat d1/d3/fa x:0 0 0 2024-05-09T06:29:25.950 INFO:tasks.workunit.client.1.smithi079.stdout:8/29: dread d1/f8 [0,4194304] 0 2024-05-09T06:29:25.950 INFO:tasks.workunit.client.1.smithi079.stdout:8/30: read d1/d3/f6 [7475774,94237] 0 2024-05-09T06:29:25.951 INFO:tasks.workunit.client.1.smithi079.stdout:8/31: mkdir d1/db 0 2024-05-09T06:29:25.953 INFO:tasks.workunit.client.1.smithi079.stdout:8/32: mkdir d1/d5/dc 0 2024-05-09T06:29:25.953 INFO:tasks.workunit.client.1.smithi079.stdout:8/33: fsync d1/d3/f6 0 2024-05-09T06:29:25.954 INFO:tasks.workunit.client.1.smithi079.stdout:8/34: symlink d1/ld 0 2024-05-09T06:29:25.957 INFO:tasks.workunit.client.1.smithi079.stdout:8/35: rename d1/d5/c7 to d1/db/ce 0 2024-05-09T06:29:25.957 INFO:tasks.workunit.client.1.smithi079.stdout:8/36: creat d1/d3/ff x:0 0 0 2024-05-09T06:29:26.034 INFO:tasks.workunit.client.1.smithi079.stdout:8/37: write d1/d3/f6 [2723828,26705] 0 2024-05-09T06:29:26.034 INFO:tasks.workunit.client.1.smithi079.stdout:8/38: dread - d1/d3/fa zero size 2024-05-09T06:29:26.034 INFO:tasks.workunit.client.1.smithi079.stdout:8/39: write d1/d3/ff [646199,98905] 0 2024-05-09T06:29:26.036 INFO:tasks.workunit.client.1.smithi079.stdout:8/40: mknod d1/d3/c10 0 2024-05-09T06:29:26.038 INFO:tasks.workunit.client.1.smithi079.stdout:8/41: creat d1/d5/f11 x:0 0 0 2024-05-09T06:29:26.039 INFO:tasks.workunit.client.1.smithi079.stdout:8/42: creat d1/d5/dc/f12 x:0 0 0 2024-05-09T06:29:26.041 INFO:tasks.workunit.client.1.smithi079.stdout:8/43: creat d1/db/f13 x:0 0 0 2024-05-09T06:29:26.041 INFO:tasks.workunit.client.1.smithi079.stdout:8/44: chown d1/d5/dc/f12 12412 1 2024-05-09T06:29:26.459 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:26 smithi079 ceph-mon[35268]: pgmap v242: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 19 MiB/s wr, 165 op/s 2024-05-09T06:29:26.632 INFO:tasks.workunit.client.1.smithi079.stdout:8/45: fsync d1/d3/fa 0 2024-05-09T06:29:26.633 INFO:tasks.workunit.client.1.smithi079.stdout:8/46: creat d1/d3/f14 x:0 0 0 2024-05-09T06:29:26.633 INFO:tasks.workunit.client.1.smithi079.stdout:8/47: read - d1/d5/f11 zero size 2024-05-09T06:29:26.649 INFO:tasks.workunit.client.1.smithi079.stdout:8/48: dwrite d1/d5/dc/f12 [0,4194304] 0 2024-05-09T06:29:26.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:26 smithi062 ceph-mon[26920]: pgmap v242: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 19 MiB/s wr, 165 op/s 2024-05-09T06:29:26.671 INFO:tasks.workunit.client.1.smithi079.stdout:8/49: dwrite d1/d5/f11 [0,4194304] 0 2024-05-09T06:29:26.671 INFO:tasks.workunit.client.1.smithi079.stdout:8/50: chown d1/d5/dc 1585911097 1 2024-05-09T06:29:26.676 INFO:tasks.workunit.client.1.smithi079.stdout:8/51: mknod d1/d5/dc/c15 0 2024-05-09T06:29:26.676 INFO:tasks.workunit.client.1.smithi079.stdout:8/52: readlink d1/l2 0 2024-05-09T06:29:26.676 INFO:tasks.workunit.client.1.smithi079.stdout:8/53: dread - d1/d3/fa zero size 2024-05-09T06:29:26.676 INFO:tasks.workunit.client.1.smithi079.stdout:8/54: chown d1/d5/dc/c15 241 1 2024-05-09T06:29:26.732 INFO:tasks.workunit.client.1.smithi079.stdout:1/30: sync 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:5/32: sync 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:3/27: sync 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:5/33: chown c7 133022010 1 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:9/123: sync 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:0/72: sync 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:6/60: sync 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:4/126: sync 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:2/75: sync 2024-05-09T06:29:26.733 INFO:tasks.workunit.client.1.smithi079.stdout:7/73: sync 2024-05-09T06:29:26.735 INFO:tasks.workunit.client.1.smithi079.stdout:1/31: mkdir d0/d7/da 0 2024-05-09T06:29:26.736 INFO:tasks.workunit.client.1.smithi079.stdout:5/34: dread f5 [0,4194304] 0 2024-05-09T06:29:26.736 INFO:tasks.workunit.client.1.smithi079.stdout:5/35: rmdir - no directory 2024-05-09T06:29:26.738 INFO:tasks.workunit.client.1.smithi079.stdout:0/73: dread d3/f4 [0,4194304] 0 2024-05-09T06:29:26.739 INFO:tasks.workunit.client.1.smithi079.stdout:6/61: mknod d0/c11 0 2024-05-09T06:29:26.740 INFO:tasks.workunit.client.1.smithi079.stdout:4/127: dread d6/d8/d9/fc [0,4194304] 0 2024-05-09T06:29:26.741 INFO:tasks.workunit.client.1.smithi079.stdout:3/28: dread f3 [0,4194304] 0 2024-05-09T06:29:26.743 INFO:tasks.workunit.client.1.smithi079.stdout:1/32: creat d0/d7/fb x:0 0 0 2024-05-09T06:29:26.743 INFO:tasks.workunit.client.1.smithi079.stdout:1/33: chown d0/d7/l8 0 1 2024-05-09T06:29:26.743 INFO:tasks.workunit.client.1.smithi079.stdout:1/34: stat d0/f3 0 2024-05-09T06:29:26.744 INFO:tasks.workunit.client.1.smithi079.stdout:5/36: creat fc x:0 0 0 2024-05-09T06:29:26.745 INFO:tasks.workunit.client.1.smithi079.stdout:9/124: write d1/d6/d7/d19/f1e [2801711,91490] 0 2024-05-09T06:29:26.747 INFO:tasks.workunit.client.1.smithi079.stdout:0/74: rmdir d3/dd 39 2024-05-09T06:29:26.748 INFO:tasks.workunit.client.1.smithi079.stdout:6/62: creat d0/f12 x:0 0 0 2024-05-09T06:29:26.748 INFO:tasks.workunit.client.1.smithi079.stdout:6/63: readlink d0/l7 0 2024-05-09T06:29:26.752 INFO:tasks.workunit.client.1.smithi079.stdout:3/29: creat f7 x:0 0 0 2024-05-09T06:29:26.753 INFO:tasks.workunit.client.1.smithi079.stdout:7/74: dwrite d4/d7/dd/f16 [0,4194304] 0 2024-05-09T06:29:26.755 INFO:tasks.workunit.client.1.smithi079.stdout:6/64: dread d0/fc [0,4194304] 0 2024-05-09T06:29:26.755 INFO:tasks.workunit.client.1.smithi079.stdout:2/76: rename d8/db/f1a to d8/db/f1b 0 2024-05-09T06:29:26.756 INFO:tasks.workunit.client.1.smithi079.stdout:3/30: dread f3 [0,4194304] 0 2024-05-09T06:29:26.757 INFO:tasks.workunit.client.1.smithi079.stdout:1/35: rename d0/f6 to d0/d7/fc 0 2024-05-09T06:29:26.759 INFO:tasks.workunit.client.1.smithi079.stdout:3/31: write f3 [1470181,31508] 0 2024-05-09T06:29:26.759 INFO:tasks.workunit.client.1.smithi079.stdout:3/32: fsync f5 0 2024-05-09T06:29:26.759 INFO:tasks.workunit.client.1.smithi079.stdout:3/33: truncate f5 552162 0 2024-05-09T06:29:26.760 INFO:tasks.workunit.client.1.smithi079.stdout:3/34: dread - f6 zero size 2024-05-09T06:29:26.760 INFO:tasks.workunit.client.1.smithi079.stdout:9/125: creat d1/d5/f24 x:0 0 0 2024-05-09T06:29:26.760 INFO:tasks.workunit.client.1.smithi079.stdout:9/126: chown d1/d6/d7/d19/f1e 31 1 2024-05-09T06:29:26.765 INFO:tasks.workunit.client.1.smithi079.stdout:7/75: creat d4/d7/f18 x:0 0 0 2024-05-09T06:29:26.767 INFO:tasks.workunit.client.1.smithi079.stdout:6/65: mkdir d0/d13 0 2024-05-09T06:29:26.767 INFO:tasks.workunit.client.1.smithi079.stdout:6/66: readlink d0/de/lf 0 2024-05-09T06:29:26.769 INFO:tasks.workunit.client.1.smithi079.stdout:2/77: mknod d8/db/c1c 0 2024-05-09T06:29:26.769 INFO:tasks.workunit.client.1.smithi079.stdout:2/78: fdatasync d8/db/f1b 0 2024-05-09T06:29:26.773 INFO:tasks.workunit.client.1.smithi079.stdout:1/36: creat d0/fd x:0 0 0 2024-05-09T06:29:26.774 INFO:tasks.workunit.client.1.smithi079.stdout:5/37: symlink ld 0 2024-05-09T06:29:26.775 INFO:tasks.workunit.client.1.smithi079.stdout:5/38: fdatasync f5 0 2024-05-09T06:29:26.775 INFO:tasks.workunit.client.1.smithi079.stdout:5/39: rmdir - no directory 2024-05-09T06:29:26.775 INFO:tasks.workunit.client.1.smithi079.stdout:5/40: write f5 [204782,1210] 0 2024-05-09T06:29:26.775 INFO:tasks.workunit.client.1.smithi079.stdout:5/41: truncate fc 917192 0 2024-05-09T06:29:26.775 INFO:tasks.workunit.client.1.smithi079.stdout:5/42: chown c9 85097199 1 2024-05-09T06:29:26.780 INFO:tasks.workunit.client.1.smithi079.stdout:9/127: creat d1/d6/d7/f25 x:0 0 0 2024-05-09T06:29:26.782 INFO:tasks.workunit.client.1.smithi079.stdout:7/76: rename d4/d7/dd/c10 to d4/d7/dd/c19 0 2024-05-09T06:29:26.782 INFO:tasks.workunit.client.1.smithi079.stdout:7/77: write d4/d7/f13 [615636,129922] 0 2024-05-09T06:29:26.783 INFO:tasks.workunit.client.1.smithi079.stdout:2/79: dwrite d8/db/f1b [0,4194304] 0 2024-05-09T06:29:26.783 INFO:tasks.workunit.client.1.smithi079.stdout:6/67: truncate d0/f5 3708063 0 2024-05-09T06:29:26.789 INFO:tasks.workunit.client.1.smithi079.stdout:1/37: mkdir d0/d7/de 0 2024-05-09T06:29:26.789 INFO:tasks.workunit.client.1.smithi079.stdout:1/38: dread - d0/d7/fb zero size 2024-05-09T06:29:26.789 INFO:tasks.workunit.client.1.smithi079.stdout:6/68: dread d0/fc [0,4194304] 0 2024-05-09T06:29:26.789 INFO:tasks.workunit.client.1.smithi079.stdout:6/69: read - d0/f12 zero size 2024-05-09T06:29:26.789 INFO:tasks.workunit.client.1.smithi079.stdout:6/70: readlink d0/l10 0 2024-05-09T06:29:26.792 INFO:tasks.workunit.client.1.smithi079.stdout:8/55: getdents d1/d3 0 2024-05-09T06:29:26.793 INFO:tasks.workunit.client.1.smithi079.stdout:9/128: fsync d1/fd 0 2024-05-09T06:29:26.801 INFO:tasks.workunit.client.1.smithi079.stdout:2/80: dwrite d8/db/dc/fd [0,4194304] 0 2024-05-09T06:29:26.802 INFO:tasks.workunit.client.1.smithi079.stdout:0/75: rename d3/d7 to d3/dd/d1f 0 2024-05-09T06:29:26.802 INFO:tasks.workunit.client.1.smithi079.stdout:0/76: readlink d3/db/l14 0 2024-05-09T06:29:26.804 INFO:tasks.workunit.client.1.smithi079.stdout:5/43: link c7 ce 0 2024-05-09T06:29:26.805 INFO:tasks.workunit.client.1.smithi079.stdout:8/56: symlink d1/d3/l16 0 2024-05-09T06:29:26.806 INFO:tasks.workunit.client.1.smithi079.stdout:9/129: mknod d1/d6/c26 0 2024-05-09T06:29:26.807 INFO:tasks.workunit.client.1.smithi079.stdout:9/130: fdatasync d1/d6/f20 0 2024-05-09T06:29:26.807 INFO:tasks.workunit.client.1.smithi079.stdout:9/131: stat d1/d5/ff 0 2024-05-09T06:29:26.807 INFO:tasks.workunit.client.1.smithi079.stdout:9/132: fsync d1/fd 0 2024-05-09T06:29:26.810 INFO:tasks.workunit.client.1.smithi079.stdout:7/78: rename d4/l9 to d4/d7/dd/l1a 0 2024-05-09T06:29:26.810 INFO:tasks.workunit.client.1.smithi079.stdout:7/79: creat d4/d7/f1b x:0 0 0 2024-05-09T06:29:26.812 INFO:tasks.workunit.client.1.smithi079.stdout:8/57: creat d1/d3/f17 x:0 0 0 2024-05-09T06:29:26.814 INFO:tasks.workunit.client.1.smithi079.stdout:2/81: getdents d8/db/dc 0 2024-05-09T06:29:26.815 INFO:tasks.workunit.client.1.smithi079.stdout:6/71: dwrite d0/fc [0,4194304] 0 2024-05-09T06:29:26.817 INFO:tasks.workunit.client.1.smithi079.stdout:1/39: rename d0/d7/de to d0/df 0 2024-05-09T06:29:26.820 INFO:tasks.workunit.client.1.smithi079.stdout:5/44: symlink lf 0 2024-05-09T06:29:26.822 INFO:tasks.workunit.client.1.smithi079.stdout:8/58: mkdir d1/d18 0 2024-05-09T06:29:26.824 INFO:tasks.workunit.client.1.smithi079.stdout:2/82: dread d8/db/f12 [0,4194304] 0 2024-05-09T06:29:26.827 INFO:tasks.workunit.client.1.smithi079.stdout:0/77: rename d3/d5/f8 to d3/dd/d1f/f20 0 2024-05-09T06:29:26.833 INFO:tasks.workunit.client.1.smithi079.stdout:8/59: mknod d1/d5/c19 0 2024-05-09T06:29:26.837 INFO:tasks.workunit.client.1.smithi079.stdout:9/133: rename d1/d5/l9 to d1/d6/d7/l27 0 2024-05-09T06:29:26.838 INFO:tasks.workunit.client.1.smithi079.stdout:9/134: dread d1/d6/f1c [0,4194304] 0 2024-05-09T06:29:26.839 INFO:tasks.workunit.client.1.smithi079.stdout:5/45: mknod c10 0 2024-05-09T06:29:26.841 INFO:tasks.workunit.client.1.smithi079.stdout:8/60: rename d1/db/f13 to d1/f1a 0 2024-05-09T06:29:26.843 INFO:tasks.workunit.client.1.smithi079.stdout:2/83: dread f3 [4194304,4194304] 0 2024-05-09T06:29:26.843 INFO:tasks.workunit.client.1.smithi079.stdout:2/84: chown d8/db/dc 438863447 1 2024-05-09T06:29:26.844 INFO:tasks.workunit.client.1.smithi079.stdout:5/46: creat f11 x:0 0 0 2024-05-09T06:29:26.844 INFO:tasks.workunit.client.1.smithi079.stdout:5/47: chown c10 0 1 2024-05-09T06:29:26.844 INFO:tasks.workunit.client.1.smithi079.stdout:5/48: chown ce 2298 1 2024-05-09T06:29:26.846 INFO:tasks.workunit.client.1.smithi079.stdout:9/135: mkdir d1/d6/d7/d19/d23/d28 0 2024-05-09T06:29:26.848 INFO:tasks.workunit.client.1.smithi079.stdout:2/85: creat d8/db/dc/f1d x:0 0 0 2024-05-09T06:29:26.849 INFO:tasks.workunit.client.1.smithi079.stdout:5/49: creat f12 x:0 0 0 2024-05-09T06:29:26.851 INFO:tasks.workunit.client.1.smithi079.stdout:8/61: getdents d1/d5/dc 0 2024-05-09T06:29:26.851 INFO:tasks.workunit.client.1.smithi079.stdout:8/62: dread - d1/f1a zero size 2024-05-09T06:29:26.853 INFO:tasks.workunit.client.1.smithi079.stdout:2/86: mknod d8/db/c1e 0 2024-05-09T06:29:26.858 INFO:tasks.workunit.client.1.smithi079.stdout:9/136: rename d1/d6/d7/f11 to d1/f29 0 2024-05-09T06:29:26.859 INFO:tasks.workunit.client.1.smithi079.stdout:5/50: mkdir d13 0 2024-05-09T06:29:26.863 INFO:tasks.workunit.client.1.smithi079.stdout:5/51: symlink d13/l14 0 2024-05-09T06:29:26.867 INFO:tasks.workunit.client.1.smithi079.stdout:2/87: dwrite d8/db/f1b [0,4194304] 0 2024-05-09T06:29:26.868 INFO:tasks.workunit.client.1.smithi079.stdout:5/52: rename c3 to d13/c15 0 2024-05-09T06:29:26.871 INFO:tasks.workunit.client.1.smithi079.stdout:2/88: mknod d8/db/c1f 0 2024-05-09T06:29:26.873 INFO:tasks.workunit.client.1.smithi079.stdout:5/53: rename f5 to d13/f16 0 2024-05-09T06:29:26.873 INFO:tasks.workunit.client.1.smithi079.stdout:5/54: truncate fa 1790656 0 2024-05-09T06:29:26.875 INFO:tasks.workunit.client.1.smithi079.stdout:2/89: dread f7 [0,4194304] 0 2024-05-09T06:29:26.876 INFO:tasks.workunit.client.1.smithi079.stdout:5/55: creat d13/f17 x:0 0 0 2024-05-09T06:29:26.876 INFO:tasks.workunit.client.1.smithi079.stdout:5/56: write d13/f16 [551081,27567] 0 2024-05-09T06:29:26.877 INFO:tasks.workunit.client.1.smithi079.stdout:2/90: mknod d8/db/c20 0 2024-05-09T06:29:26.886 INFO:tasks.workunit.client.1.smithi079.stdout:2/91: dread d8/f9 [0,4194304] 0 2024-05-09T06:29:26.886 INFO:tasks.workunit.client.1.smithi079.stdout:2/92: chown d8/db/dc/le 766333856 1 2024-05-09T06:29:26.895 INFO:tasks.workunit.client.1.smithi079.stdout:5/57: dwrite fa [0,4194304] 0 2024-05-09T06:29:26.921 INFO:tasks.workunit.client.1.smithi079.stdout:4/128: dwrite d6/dd/df/f19 [4194304,4194304] 0 2024-05-09T06:29:26.924 INFO:tasks.workunit.client.1.smithi079.stdout:4/129: truncate d6/d8/d9/f17 2212159 0 2024-05-09T06:29:26.928 INFO:tasks.workunit.client.1.smithi079.stdout:4/130: mknod d6/c22 0 2024-05-09T06:29:26.929 INFO:tasks.workunit.client.1.smithi079.stdout:3/35: truncate f3 520139 0 2024-05-09T06:29:26.931 INFO:tasks.workunit.client.1.smithi079.stdout:4/131: unlink d6/dd/df/f19 0 2024-05-09T06:29:26.938 INFO:tasks.workunit.client.1.smithi079.stdout:7/80: link d4/d7/dd/c19 d4/d7/dd/c1c 0 2024-05-09T06:29:26.942 INFO:tasks.workunit.client.1.smithi079.stdout:7/81: unlink d4/d7/dd/c19 0 2024-05-09T06:29:26.942 INFO:tasks.workunit.client.1.smithi079.stdout:7/82: creat d4/d7/f1d x:0 0 0 2024-05-09T06:29:26.942 INFO:tasks.workunit.client.1.smithi079.stdout:7/83: truncate d4/d7/dd/fe 1109380 0 2024-05-09T06:29:26.948 INFO:tasks.workunit.client.1.smithi079.stdout:7/84: unlink d4/d7/dd/fe 0 2024-05-09T06:29:26.948 INFO:tasks.workunit.client.1.smithi079.stdout:7/85: fdatasync d4/f17 0 2024-05-09T06:29:26.948 INFO:tasks.workunit.client.1.smithi079.stdout:7/86: readlink d4/d7/dd/l1a 0 2024-05-09T06:29:26.948 INFO:tasks.workunit.client.1.smithi079.stdout:7/87: dread - d4/f17 zero size 2024-05-09T06:29:26.948 INFO:tasks.workunit.client.1.smithi079.stdout:7/88: truncate d4/f12 197108 0 2024-05-09T06:29:26.948 INFO:tasks.workunit.client.1.smithi079.stdout:7/89: write d4/f6 [195212,97998] 0 2024-05-09T06:29:26.948 INFO:tasks.workunit.client.1.smithi079.stdout:7/90: creat d4/d7/dd/f1e x:0 0 0 2024-05-09T06:29:26.955 INFO:tasks.workunit.client.1.smithi079.stdout:4/132: dwrite d6/dd/df/f21 [0,4194304] 0 2024-05-09T06:29:26.955 INFO:tasks.workunit.client.1.smithi079.stdout:4/133: creat d6/d8/d9/f23 x:0 0 0 2024-05-09T06:29:26.956 INFO:tasks.workunit.client.1.smithi079.stdout:7/91: unlink d4/f17 0 2024-05-09T06:29:26.964 INFO:tasks.workunit.client.1.smithi079.stdout:4/134: creat d6/f24 x:0 0 0 2024-05-09T06:29:26.969 INFO:tasks.workunit.client.1.smithi079.stdout:4/135: symlink d6/d15/l25 0 2024-05-09T06:29:26.978 INFO:tasks.workunit.client.1.smithi079.stdout:7/92: dwrite d4/d7/f13 [0,4194304] 0 2024-05-09T06:29:26.978 INFO:tasks.workunit.client.1.smithi079.stdout:7/93: stat d4 0 2024-05-09T06:29:26.981 INFO:tasks.workunit.client.1.smithi079.stdout:7/94: mknod d4/d7/c1f 0 2024-05-09T06:29:26.981 INFO:tasks.workunit.client.1.smithi079.stdout:7/95: dread - d4/d7/f1d zero size 2024-05-09T06:29:26.990 INFO:tasks.workunit.client.1.smithi079.stdout:9/137: getdents d1/d5 0 2024-05-09T06:29:26.993 INFO:tasks.workunit.client.1.smithi079.stdout:9/138: mknod d1/d6/c2a 0 2024-05-09T06:29:26.995 INFO:tasks.workunit.client.1.smithi079.stdout:8/63: getdents d1/db 0 2024-05-09T06:29:26.999 INFO:tasks.workunit.client.1.smithi079.stdout:9/139: mkdir d1/d6/d7/d19/d23/d2b 0 2024-05-09T06:29:27.022 INFO:tasks.workunit.client.1.smithi079.stdout:9/140: dwrite d1/d6/da/f1a [0,4194304] 0 2024-05-09T06:29:27.022 INFO:tasks.workunit.client.1.smithi079.stdout:9/141: fdatasync d1/d5/ff 0 2024-05-09T06:29:27.025 INFO:tasks.workunit.client.1.smithi079.stdout:5/58: rmdir d13 39 2024-05-09T06:29:27.029 INFO:tasks.workunit.client.1.smithi079.stdout:5/59: creat d13/f18 x:0 0 0 2024-05-09T06:29:27.029 INFO:tasks.workunit.client.1.smithi079.stdout:5/60: chown d13/f16 0 1 2024-05-09T06:29:27.029 INFO:tasks.workunit.client.1.smithi079.stdout:5/61: creat d13/f19 x:0 0 0 2024-05-09T06:29:27.030 INFO:tasks.workunit.client.1.smithi079.stdout:5/62: fsync d13/f17 0 2024-05-09T06:29:27.030 INFO:tasks.workunit.client.1.smithi079.stdout:5/63: chown d13/f19 1 1 2024-05-09T06:29:27.034 INFO:tasks.workunit.client.1.smithi079.stdout:9/142: dwrite d1/d5/f21 [0,4194304] 0 2024-05-09T06:29:27.040 INFO:tasks.workunit.client.1.smithi079.stdout:9/143: symlink d1/d6/d7/d19/d23/d28/l2c 0 2024-05-09T06:29:27.040 INFO:tasks.workunit.client.1.smithi079.stdout:9/144: chown d1/d6/d7/d19/d23/d2b 29 1 2024-05-09T06:29:27.048 INFO:tasks.workunit.client.1.smithi079.stdout:9/145: dread d1/fd [4194304,4194304] 0 2024-05-09T06:29:27.050 INFO:tasks.workunit.client.1.smithi079.stdout:9/146: mkdir d1/d6/da/d2d 0 2024-05-09T06:29:27.052 INFO:tasks.workunit.client.1.smithi079.stdout:2/93: dwrite d8/db/f12 [0,4194304] 0 2024-05-09T06:29:27.065 INFO:tasks.workunit.client.1.smithi079.stdout:9/147: dread d1/d6/d7/d19/f1f [0,4194304] 0 2024-05-09T06:29:27.074 INFO:tasks.workunit.client.1.smithi079.stdout:9/148: dread d1/d6/da/f1a [0,4194304] 0 2024-05-09T06:29:27.077 INFO:tasks.workunit.client.1.smithi079.stdout:9/149: unlink d1/d5/f15 0 2024-05-09T06:29:27.077 INFO:tasks.workunit.client.1.smithi079.stdout:9/150: creat d1/d6/da/f2e x:0 0 0 2024-05-09T06:29:27.077 INFO:tasks.workunit.client.1.smithi079.stdout:9/151: readlink d1/d6/d7/l27 0 2024-05-09T06:29:27.077 INFO:tasks.workunit.client.1.smithi079.stdout:9/152: fsync d1/d5/f16 0 2024-05-09T06:29:27.081 INFO:tasks.workunit.client.1.smithi079.stdout:9/153: write d1/f3 [2480189,61940] 0 2024-05-09T06:29:27.084 INFO:tasks.workunit.client.1.smithi079.stdout:9/154: mknod d1/d5/c2f 0 2024-05-09T06:29:27.090 INFO:tasks.workunit.client.1.smithi079.stdout:9/155: dread d1/f29 [0,4194304] 0 2024-05-09T06:29:27.095 INFO:tasks.workunit.client.1.smithi079.stdout:9/156: link d1/d5/ff d1/d6/d7/d19/f30 0 2024-05-09T06:29:27.108 INFO:tasks.workunit.client.1.smithi079.stdout:9/157: dwrite d1/d6/da/f2e [0,4194304] 0 2024-05-09T06:29:27.108 INFO:tasks.workunit.client.1.smithi079.stdout:9/158: creat d1/d6/d7/f31 x:0 0 0 2024-05-09T06:29:27.115 INFO:tasks.workunit.client.1.smithi079.stdout:9/159: unlink d1/d5/f16 0 2024-05-09T06:29:27.115 INFO:tasks.workunit.client.1.smithi079.stdout:7/96: rmdir d4/d7 39 2024-05-09T06:29:27.115 INFO:tasks.workunit.client.1.smithi079.stdout:7/97: chown d4/d7/dd 39114434 1 2024-05-09T06:29:27.116 INFO:tasks.workunit.client.1.smithi079.stdout:4/136: write d6/d8/d9/f14 [3507049,27370] 0 2024-05-09T06:29:27.116 INFO:tasks.workunit.client.1.smithi079.stdout:4/137: write d6/f24 [434093,35530] 0 2024-05-09T06:29:27.119 INFO:tasks.workunit.client.1.smithi079.stdout:9/160: rename d1/d6/da/f1a to d1/d6/d7/d19/d23/d2b/f32 0 2024-05-09T06:29:27.140 INFO:tasks.workunit.client.1.smithi079.stdout:9/161: dread d1/d6/d7/d19/f1f [0,4194304] 0 2024-05-09T06:29:27.167 INFO:tasks.workunit.client.1.smithi079.stdout:5/64: getdents d13 0 2024-05-09T06:29:27.167 INFO:tasks.workunit.client.1.smithi079.stdout:5/65: write d13/f17 [421920,123070] 0 2024-05-09T06:29:27.169 INFO:tasks.workunit.client.1.smithi079.stdout:5/66: creat d13/f1a x:0 0 0 2024-05-09T06:29:27.171 INFO:tasks.workunit.client.1.smithi079.stdout:5/67: mkdir d13/d1b 0 2024-05-09T06:29:27.239 INFO:tasks.workunit.client.1.smithi079.stdout:5/68: dwrite d13/f1a [0,4194304] 0 2024-05-09T06:29:27.239 INFO:tasks.workunit.client.1.smithi079.stdout:4/138: dwrite d6/dd/f1b [0,4194304] 0 2024-05-09T06:29:27.239 INFO:tasks.workunit.client.1.smithi079.stdout:7/98: dwrite d4/f12 [0,4194304] 0 2024-05-09T06:29:27.242 INFO:tasks.workunit.client.1.smithi079.stdout:7/99: dread d4/f6 [0,4194304] 0 2024-05-09T06:29:27.242 INFO:tasks.workunit.client.1.smithi079.stdout:5/69: mknod d13/d1b/c1c 0 2024-05-09T06:29:27.243 INFO:tasks.workunit.client.1.smithi079.stdout:5/70: chown l4 3830003 1 2024-05-09T06:29:27.243 INFO:tasks.workunit.client.1.smithi079.stdout:5/71: chown fa 11 1 2024-05-09T06:29:27.243 INFO:tasks.workunit.client.1.smithi079.stdout:4/139: write d6/d8/f10 [1244436,130507] 0 2024-05-09T06:29:27.244 INFO:tasks.workunit.client.1.smithi079.stdout:4/140: chown d6/dd/df 64 1 2024-05-09T06:29:27.244 INFO:tasks.workunit.client.1.smithi079.stdout:2/94: dwrite f7 [0,4194304] 0 2024-05-09T06:29:27.249 INFO:tasks.workunit.client.1.smithi079.stdout:9/162: rename d1/d6/d7/d19/d23 to d1/d33 0 2024-05-09T06:29:27.255 INFO:tasks.workunit.client.1.smithi079.stdout:7/100: rmdir d4/d7/dd 39 2024-05-09T06:29:27.255 INFO:tasks.workunit.client.1.smithi079.stdout:7/101: stat d4/cb 0 2024-05-09T06:29:27.256 INFO:tasks.workunit.client.1.smithi079.stdout:4/141: mkdir d6/d1a/d26 0 2024-05-09T06:29:27.260 INFO:tasks.workunit.client.1.smithi079.stdout:2/95: mknod d8/db/d11/c21 0 2024-05-09T06:29:27.262 INFO:tasks.workunit.client.1.smithi079.stdout:5/72: rename c7 to d13/d1b/c1d 0 2024-05-09T06:29:27.262 INFO:tasks.workunit.client.1.smithi079.stdout:5/73: stat fc 0 2024-05-09T06:29:27.262 INFO:tasks.workunit.client.1.smithi079.stdout:5/74: readlink d13/l14 0 2024-05-09T06:29:27.266 INFO:tasks.workunit.client.1.smithi079.stdout:4/142: dread d6/dd/f1b [0,4194304] 0 2024-05-09T06:29:27.266 INFO:tasks.workunit.client.1.smithi079.stdout:4/143: truncate d6/f24 565026 0 2024-05-09T06:29:27.267 INFO:tasks.workunit.client.1.smithi079.stdout:4/144: truncate d6/d8/d9/f23 702854 0 2024-05-09T06:29:27.267 INFO:tasks.workunit.client.1.smithi079.stdout:7/102: mkdir d4/d20 0 2024-05-09T06:29:27.267 INFO:tasks.workunit.client.1.smithi079.stdout:7/103: dread - d4/f14 zero size 2024-05-09T06:29:27.267 INFO:tasks.workunit.client.1.smithi079.stdout:7/104: read - d4/f14 zero size 2024-05-09T06:29:27.268 INFO:tasks.workunit.client.1.smithi079.stdout:2/96: mknod d8/db/c22 0 2024-05-09T06:29:27.269 INFO:tasks.workunit.client.1.smithi079.stdout:5/75: stat ce 0 2024-05-09T06:29:27.269 INFO:tasks.workunit.client.1.smithi079.stdout:5/76: chown l4 32179083 1 2024-05-09T06:29:27.272 INFO:tasks.workunit.client.1.smithi079.stdout:4/145: mkdir d6/d8/d27 0 2024-05-09T06:29:27.273 INFO:tasks.workunit.client.1.smithi079.stdout:7/105: chown d4/d7/dd/f16 124 1 2024-05-09T06:29:27.275 INFO:tasks.workunit.client.1.smithi079.stdout:2/97: write f7 [2042061,115169] 0 2024-05-09T06:29:27.279 INFO:tasks.workunit.client.1.smithi079.stdout:5/77: dread fa [0,4194304] 0 2024-05-09T06:29:27.284 INFO:tasks.workunit.client.1.smithi079.stdout:5/78: dread fa [0,4194304] 0 2024-05-09T06:29:27.284 INFO:tasks.workunit.client.1.smithi079.stdout:5/79: creat d13/f1e x:0 0 0 2024-05-09T06:29:27.289 INFO:tasks.workunit.client.1.smithi079.stdout:5/80: symlink d13/l1f 0 2024-05-09T06:29:27.294 INFO:tasks.workunit.client.1.smithi079.stdout:5/81: creat d13/d1b/f20 x:0 0 0 2024-05-09T06:29:27.294 INFO:tasks.workunit.client.1.smithi079.stdout:5/82: stat d13/d1b 0 2024-05-09T06:29:27.302 INFO:tasks.workunit.client.1.smithi079.stdout:4/146: dwrite d6/d8/f10 [0,4194304] 0 2024-05-09T06:29:27.303 INFO:tasks.workunit.client.1.smithi079.stdout:2/98: dwrite d8/db/dc/fd [0,4194304] 0 2024-05-09T06:29:27.303 INFO:tasks.workunit.client.1.smithi079.stdout:2/99: chown d8/db/dc/le 1513 1 2024-05-09T06:29:27.304 INFO:tasks.workunit.client.1.smithi079.stdout:7/106: dwrite d4/d7/f18 [0,4194304] 0 2024-05-09T06:29:27.304 INFO:tasks.workunit.client.1.smithi079.stdout:5/83: fdatasync d13/f17 0 2024-05-09T06:29:27.305 INFO:tasks.workunit.client.1.smithi079.stdout:4/147: link d6/dd/l1d d6/dd/l28 0 2024-05-09T06:29:27.305 INFO:tasks.workunit.client.1.smithi079.stdout:4/148: write d6/d8/d9/f14 [4217192,45791] 0 2024-05-09T06:29:27.305 INFO:tasks.workunit.client.1.smithi079.stdout:4/149: write f2 [678911,6913] 0 2024-05-09T06:29:27.310 INFO:tasks.workunit.client.1.smithi079.stdout:2/100: mkdir d8/db/d23 0 2024-05-09T06:29:27.314 INFO:tasks.workunit.client.1.smithi079.stdout:4/150: creat d6/d8/d27/f29 x:0 0 0 2024-05-09T06:29:27.317 INFO:tasks.workunit.client.1.smithi079.stdout:4/151: mkdir d6/d1a/d26/d2a 0 2024-05-09T06:29:27.319 INFO:tasks.workunit.client.1.smithi079.stdout:7/107: dwrite d4/f11 [0,4194304] 0 2024-05-09T06:29:27.325 INFO:tasks.workunit.client.1.smithi079.stdout:4/152: dread d6/d8/d9/f14 [0,4194304] 0 2024-05-09T06:29:27.325 INFO:tasks.workunit.client.1.smithi079.stdout:7/108: creat d4/d7/dd/f21 x:0 0 0 2024-05-09T06:29:27.327 INFO:tasks.workunit.client.1.smithi079.stdout:4/153: mknod d6/d8/c2b 0 2024-05-09T06:29:27.327 INFO:tasks.workunit.client.1.smithi079.stdout:4/154: chown d6/d8/l1e 8 1 2024-05-09T06:29:27.328 INFO:tasks.workunit.client.1.smithi079.stdout:7/109: mkdir d4/d7/d22 0 2024-05-09T06:29:27.328 INFO:tasks.workunit.client.1.smithi079.stdout:7/110: write d4/f14 [886684,124259] 0 2024-05-09T06:29:27.330 INFO:tasks.workunit.client.1.smithi079.stdout:2/101: dwrite f5 [0,4194304] 0 2024-05-09T06:29:27.330 INFO:tasks.workunit.client.1.smithi079.stdout:2/102: chown d8 6399654 1 2024-05-09T06:29:27.331 INFO:tasks.workunit.client.1.smithi079.stdout:4/155: rename d6/d8/d9/l12 to d6/dd/l2c 0 2024-05-09T06:29:27.332 INFO:tasks.workunit.client.1.smithi079.stdout:7/111: creat d4/d7/d22/f23 x:0 0 0 2024-05-09T06:29:27.332 INFO:tasks.workunit.client.1.smithi079.stdout:7/112: fsync d4/d7/f13 0 2024-05-09T06:29:27.334 INFO:tasks.workunit.client.1.smithi079.stdout:4/156: creat d6/d1a/d26/d2a/f2d x:0 0 0 2024-05-09T06:29:27.334 INFO:tasks.workunit.client.1.smithi079.stdout:4/157: chown d6/dd/l28 319585855 1 2024-05-09T06:29:27.334 INFO:tasks.workunit.client.1.smithi079.stdout:4/158: creat d6/d8/d27/f2e x:0 0 0 2024-05-09T06:29:27.340 INFO:tasks.workunit.client.1.smithi079.stdout:4/159: dread d6/f24 [0,4194304] 0 2024-05-09T06:29:27.342 INFO:tasks.workunit.client.1.smithi079.stdout:2/103: dread d8/db/f12 [0,4194304] 0 2024-05-09T06:29:27.342 INFO:tasks.workunit.client.1.smithi079.stdout:4/160: link d6/d8/d9/fc d6/dd/f2f 0 2024-05-09T06:29:27.344 INFO:tasks.workunit.client.1.smithi079.stdout:2/104: creat d8/db/d11/f24 x:0 0 0 2024-05-09T06:29:27.345 INFO:tasks.workunit.client.1.smithi079.stdout:7/113: read d4/d7/f13 [820115,125261] 0 2024-05-09T06:29:27.345 INFO:tasks.workunit.client.1.smithi079.stdout:7/114: write d4/d7/dd/f21 [283638,42765] 0 2024-05-09T06:29:27.348 INFO:tasks.workunit.client.1.smithi079.stdout:2/105: rmdir d8/db/d23 0 2024-05-09T06:29:27.350 INFO:tasks.workunit.client.1.smithi079.stdout:4/161: write d6/dd/df/f21 [3478142,88562] 0 2024-05-09T06:29:27.351 INFO:tasks.workunit.client.1.smithi079.stdout:7/115: dread d4/d7/dd/f21 [0,4194304] 0 2024-05-09T06:29:27.366 INFO:tasks.workunit.client.1.smithi079.stdout:2/106: dwrite d8/db/f12 [0,4194304] 0 2024-05-09T06:29:27.375 INFO:tasks.workunit.client.1.smithi079.stdout:9/163: getdents d1 0 2024-05-09T06:29:27.375 INFO:tasks.workunit.client.1.smithi079.stdout:2/107: read d8/db/f12 [1475627,44520] 0 2024-05-09T06:29:27.380 INFO:tasks.workunit.client.1.smithi079.stdout:9/164: rename d1/d6/d7/f25 to d1/d33/d28/f34 0 2024-05-09T06:29:27.383 INFO:tasks.workunit.client.1.smithi079.stdout:2/108: mknod d8/db/dc/c25 0 2024-05-09T06:29:27.385 INFO:tasks.workunit.client.1.smithi079.stdout:9/165: creat d1/d6/f35 x:0 0 0 2024-05-09T06:29:27.387 INFO:tasks.workunit.client.1.smithi079.stdout:2/109: unlink f7 0 2024-05-09T06:29:27.390 INFO:tasks.workunit.client.1.smithi079.stdout:9/166: mkdir d1/d33/d28/d36 0 2024-05-09T06:29:27.393 INFO:tasks.workunit.client.1.smithi079.stdout:2/110: dread d8/db/dc/fd [0,4194304] 0 2024-05-09T06:29:27.394 INFO:tasks.workunit.client.1.smithi079.stdout:9/167: rename d1/d6/f35 to d1/d33/f37 0 2024-05-09T06:29:27.396 INFO:tasks.workunit.client.1.smithi079.stdout:2/111: symlink d8/db/dc/l26 0 2024-05-09T06:29:27.412 INFO:tasks.workunit.client.1.smithi079.stdout:5/84: getdents d13/d1b 0 2024-05-09T06:29:27.412 INFO:tasks.workunit.client.1.smithi079.stdout:5/85: write f11 [1040897,88757] 0 2024-05-09T06:29:27.412 INFO:tasks.workunit.client.1.smithi079.stdout:5/86: creat d13/f21 x:0 0 0 2024-05-09T06:29:27.415 INFO:tasks.workunit.client.1.smithi079.stdout:9/168: dwrite d1/fd [4194304,4194304] 0 2024-05-09T06:29:27.418 INFO:tasks.workunit.client.1.smithi079.stdout:9/169: mkdir d1/d33/d28/d36/d38 0 2024-05-09T06:29:27.418 INFO:tasks.workunit.client.1.smithi079.stdout:5/87: dread d13/f1a [0,4194304] 0 2024-05-09T06:29:27.418 INFO:tasks.workunit.client.1.smithi079.stdout:5/88: write f12 [1003627,3614] 0 2024-05-09T06:29:27.420 INFO:tasks.workunit.client.1.smithi079.stdout:9/170: mknod d1/d6/da/c39 0 2024-05-09T06:29:27.420 INFO:tasks.workunit.client.1.smithi079.stdout:9/171: chown d1/f3 9995167 1 2024-05-09T06:29:27.422 INFO:tasks.workunit.client.1.smithi079.stdout:5/89: creat d13/d1b/f22 x:0 0 0 2024-05-09T06:29:27.422 INFO:tasks.workunit.client.1.smithi079.stdout:5/90: dread - d13/f1e zero size 2024-05-09T06:29:27.424 INFO:tasks.workunit.client.1.smithi079.stdout:9/172: mkdir d1/d33/d28/d36/d38/d3a 0 2024-05-09T06:29:27.425 INFO:tasks.workunit.client.1.smithi079.stdout:5/91: symlink d13/l23 0 2024-05-09T06:29:27.427 INFO:tasks.workunit.client.1.smithi079.stdout:9/173: mknod d1/d33/d2b/c3b 0 2024-05-09T06:29:27.430 INFO:tasks.workunit.client.1.smithi079.stdout:5/92: symlink d13/l24 0 2024-05-09T06:29:27.431 INFO:tasks.workunit.client.1.smithi079.stdout:5/93: creat d13/d1b/f25 x:0 0 0 2024-05-09T06:29:27.431 INFO:tasks.workunit.client.1.smithi079.stdout:5/94: read - d13/f18 zero size 2024-05-09T06:29:27.431 INFO:tasks.workunit.client.1.smithi079.stdout:5/95: stat f11 0 2024-05-09T06:29:27.433 INFO:tasks.workunit.client.1.smithi079.stdout:5/96: write fa [1399675,106234] 0 2024-05-09T06:29:27.434 INFO:tasks.workunit.client.1.smithi079.stdout:5/97: stat lf 0 2024-05-09T06:29:27.438 INFO:tasks.workunit.client.1.smithi079.stdout:5/98: mkdir d13/d1b/d26 0 2024-05-09T06:29:27.438 INFO:tasks.workunit.client.1.smithi079.stdout:5/99: truncate d13/d1b/f22 444285 0 2024-05-09T06:29:27.438 INFO:tasks.workunit.client.1.smithi079.stdout:5/100: dread - d13/f1e zero size 2024-05-09T06:29:27.439 INFO:tasks.workunit.client.1.smithi079.stdout:5/101: write f11 [1336516,102780] 0 2024-05-09T06:29:27.439 INFO:tasks.workunit.client.1.smithi079.stdout:5/102: read d13/f1a [1387365,33101] 0 2024-05-09T06:29:27.439 INFO:tasks.workunit.client.1.smithi079.stdout:9/174: dwrite d1/d5/f24 [0,4194304] 0 2024-05-09T06:29:27.445 INFO:tasks.workunit.client.1.smithi079.stdout:9/175: symlink d1/d33/d28/l3c 0 2024-05-09T06:29:27.447 INFO:tasks.workunit.client.1.smithi079.stdout:9/176: rmdir d1 39 2024-05-09T06:29:27.451 INFO:tasks.workunit.client.1.smithi079.stdout:9/177: symlink d1/d6/d7/l3d 0 2024-05-09T06:29:27.451 INFO:tasks.workunit.client.1.smithi079.stdout:7/116: rmdir d4/d7/dd 39 2024-05-09T06:29:27.453 INFO:tasks.workunit.client.1.smithi079.stdout:9/178: fdatasync d1/d6/d7/d19/f30 0 2024-05-09T06:29:27.456 INFO:tasks.workunit.client.1.smithi079.stdout:9/179: mkdir d1/d33/d28/d3e 0 2024-05-09T06:29:27.457 INFO:tasks.workunit.client.1.smithi079.stdout:5/103: dwrite f12 [0,4194304] 0 2024-05-09T06:29:27.458 INFO:tasks.workunit.client.1.smithi079.stdout:7/117: rename d4/f12 to d4/d7/dd/f24 0 2024-05-09T06:29:27.460 INFO:tasks.workunit.client.1.smithi079.stdout:9/180: mknod d1/d33/d28/c3f 0 2024-05-09T06:29:27.463 INFO:tasks.workunit.client.1.smithi079.stdout:5/104: rename d13/l1f to d13/d1b/d26/l27 0 2024-05-09T06:29:27.463 INFO:tasks.workunit.client.1.smithi079.stdout:5/105: creat d13/d1b/f28 x:0 0 0 2024-05-09T06:29:27.463 INFO:tasks.workunit.client.1.smithi079.stdout:5/106: dread - d13/f18 zero size 2024-05-09T06:29:27.465 INFO:tasks.workunit.client.1.smithi079.stdout:7/118: creat d4/d7/f25 x:0 0 0 2024-05-09T06:29:27.465 INFO:tasks.workunit.client.1.smithi079.stdout:7/119: write d4/d7/f1b [1046153,99552] 0 2024-05-09T06:29:27.466 INFO:tasks.workunit.client.1.smithi079.stdout:9/181: symlink d1/d5/l40 0 2024-05-09T06:29:27.471 INFO:tasks.workunit.client.1.smithi079.stdout:5/107: mknod d13/d1b/c29 0 2024-05-09T06:29:27.472 INFO:tasks.workunit.client.1.smithi079.stdout:5/108: fsync d13/f1a 0 2024-05-09T06:29:27.472 INFO:tasks.workunit.client.1.smithi079.stdout:5/109: write d13/d1b/f25 [945020,56309] 0 2024-05-09T06:29:27.473 INFO:tasks.workunit.client.1.smithi079.stdout:7/120: dread d4/d7/dd/f24 [0,4194304] 0 2024-05-09T06:29:27.473 INFO:tasks.workunit.client.1.smithi079.stdout:7/121: getdents d4/d20 0 2024-05-09T06:29:27.474 INFO:tasks.workunit.client.1.smithi079.stdout:7/122: dread - d4/d7/f1d zero size 2024-05-09T06:29:27.474 INFO:tasks.workunit.client.1.smithi079.stdout:5/110: mkdir d13/d2a 0 2024-05-09T06:29:27.474 INFO:tasks.workunit.client.1.smithi079.stdout:5/111: truncate d13/d1b/f25 1079476 0 2024-05-09T06:29:27.474 INFO:tasks.workunit.client.1.smithi079.stdout:5/112: chown d13/d1b/c1c 39021895 1 2024-05-09T06:29:27.476 INFO:tasks.workunit.client.1.smithi079.stdout:9/182: rename d1/l1b to d1/d33/l41 0 2024-05-09T06:29:27.478 INFO:tasks.workunit.client.1.smithi079.stdout:9/183: mkdir d1/d33/d28/d36/d38/d42 0 2024-05-09T06:29:27.480 INFO:tasks.workunit.client.1.smithi079.stdout:4/162: write d6/d1a/f1c [1100132,100590] 0 2024-05-09T06:29:27.482 INFO:tasks.workunit.client.1.smithi079.stdout:9/184: symlink d1/d33/d28/d3e/l43 0 2024-05-09T06:29:27.484 INFO:tasks.workunit.client.1.smithi079.stdout:4/163: creat d6/d1a/d26/f30 x:0 0 0 2024-05-09T06:29:27.489 INFO:tasks.workunit.client.1.smithi079.stdout:4/164: creat d6/d15/f31 x:0 0 0 2024-05-09T06:29:27.491 INFO:tasks.workunit.client.1.smithi079.stdout:4/165: dread d6/f24 [0,4194304] 0 2024-05-09T06:29:27.495 INFO:tasks.workunit.client.1.smithi079.stdout:4/166: mkdir d6/d8/d32 0 2024-05-09T06:29:27.497 INFO:tasks.workunit.client.1.smithi079.stdout:5/113: dwrite d13/f1e [0,4194304] 0 2024-05-09T06:29:27.497 INFO:tasks.workunit.client.1.smithi079.stdout:7/123: dwrite d4/d7/d22/f23 [0,4194304] 0 2024-05-09T06:29:27.498 INFO:tasks.workunit.client.1.smithi079.stdout:4/167: truncate d6/fa 223242 0 2024-05-09T06:29:27.501 INFO:tasks.workunit.client.1.smithi079.stdout:9/185: dwrite d1/d6/f18 [0,4194304] 0 2024-05-09T06:29:27.501 INFO:tasks.workunit.client.1.smithi079.stdout:9/186: fsync d1/d5/f10 0 2024-05-09T06:29:27.501 INFO:tasks.workunit.client.1.smithi079.stdout:9/187: truncate d1/d6/d7/f22 139037 0 2024-05-09T06:29:27.509 INFO:tasks.workunit.client.1.smithi079.stdout:7/124: creat d4/f26 x:0 0 0 2024-05-09T06:29:27.510 INFO:tasks.workunit.client.1.smithi079.stdout:7/125: write d4/f6 [4378582,107368] 0 2024-05-09T06:29:27.519 INFO:tasks.workunit.client.1.smithi079.stdout:4/168: creat d6/f33 x:0 0 0 2024-05-09T06:29:27.525 INFO:tasks.workunit.client.1.smithi079.stdout:9/188: creat d1/d33/d28/d3e/f44 x:0 0 0 2024-05-09T06:29:27.526 INFO:tasks.workunit.client.1.smithi079.stdout:2/112: write f3 [1706705,8827] 0 2024-05-09T06:29:27.526 INFO:tasks.workunit.client.1.smithi079.stdout:2/113: fsync d8/db/f19 0 2024-05-09T06:29:27.546 INFO:tasks.workunit.client.1.smithi079.stdout:9/189: dwrite d1/d6/f1c [0,4194304] 0 2024-05-09T06:29:27.546 INFO:tasks.workunit.client.1.smithi079.stdout:4/169: dwrite d6/dd/df/f21 [4194304,4194304] 0 2024-05-09T06:29:27.556 INFO:tasks.workunit.client.1.smithi079.stdout:2/114: chown l4 46 1 2024-05-09T06:29:27.560 INFO:tasks.workunit.client.1.smithi079.stdout:9/190: rename d1/d33/d28/d36/d38/d42 to d1/d45 0 2024-05-09T06:29:27.562 INFO:tasks.workunit.client.1.smithi079.stdout:9/191: dread d1/d6/d7/d19/f30 [0,4194304] 0 2024-05-09T06:29:27.565 INFO:tasks.workunit.client.1.smithi079.stdout:4/170: mkdir d6/dd/d34 0 2024-05-09T06:29:27.565 INFO:tasks.workunit.client.1.smithi079.stdout:4/171: readlink d6/d8/l1e 0 2024-05-09T06:29:27.568 INFO:tasks.workunit.client.1.smithi079.stdout:7/126: unlink d4/d7/dd/f15 0 2024-05-09T06:29:27.570 INFO:tasks.workunit.client.1.smithi079.stdout:2/115: dwrite d8/db/dc/fd [0,4194304] 0 2024-05-09T06:29:27.571 INFO:tasks.workunit.client.1.smithi079.stdout:9/192: creat d1/d33/f46 x:0 0 0 2024-05-09T06:29:27.572 INFO:tasks.workunit.client.1.smithi079.stdout:9/193: chown d1/d6/cb 8066414 1 2024-05-09T06:29:27.573 INFO:tasks.workunit.client.1.smithi079.stdout:4/172: rename d6/d8/d9/f14 to d6/dd/df/f35 0 2024-05-09T06:29:27.578 INFO:tasks.workunit.client.1.smithi079.stdout:9/194: symlink d1/d6/da/d2d/l47 0 2024-05-09T06:29:27.578 INFO:tasks.workunit.client.1.smithi079.stdout:9/195: chown d1/d33/d28/d36/d38 4 1 2024-05-09T06:29:27.581 INFO:tasks.workunit.client.1.smithi079.stdout:7/127: getdents d4/d7/d22 0 2024-05-09T06:29:27.582 INFO:tasks.workunit.client.1.smithi079.stdout:2/116: rmdir d8/db/dc 39 2024-05-09T06:29:27.588 INFO:tasks.workunit.client.1.smithi079.stdout:9/196: mkdir d1/d33/d48 0 2024-05-09T06:29:27.588 INFO:tasks.workunit.client.1.smithi079.stdout:9/197: fsync d1/d6/d7/d19/f30 0 2024-05-09T06:29:27.590 INFO:tasks.workunit.client.1.smithi079.stdout:2/117: dread d8/db/f1b [0,4194304] 0 2024-05-09T06:29:27.594 INFO:tasks.workunit.client.1.smithi079.stdout:2/118: mkdir d8/db/dc/d27 0 2024-05-09T06:29:27.596 INFO:tasks.workunit.client.1.smithi079.stdout:9/198: dread d1/d6/d7/d19/f1f [0,4194304] 0 2024-05-09T06:29:27.598 INFO:tasks.workunit.client.1.smithi079.stdout:2/119: truncate d8/f9 151423 0 2024-05-09T06:29:27.598 INFO:tasks.workunit.client.1.smithi079.stdout:2/120: chown d8/db/d11/l14 100 1 2024-05-09T06:29:27.601 INFO:tasks.workunit.client.1.smithi079.stdout:7/128: dwrite d4/d7/f1b [0,4194304] 0 2024-05-09T06:29:27.611 INFO:tasks.workunit.client.1.smithi079.stdout:7/129: rename d4/d7/dd/c1c to d4/d7/dd/c27 0 2024-05-09T06:29:27.619 INFO:tasks.workunit.client.1.smithi079.stdout:2/121: dwrite f5 [4194304,4194304] 0 2024-05-09T06:29:27.629 INFO:tasks.workunit.client.1.smithi079.stdout:2/122: write f5 [5821913,101976] 0 2024-05-09T06:29:27.632 INFO:tasks.workunit.client.1.smithi079.stdout:7/130: dwrite d4/d7/f1b [0,4194304] 0 2024-05-09T06:29:27.641 INFO:tasks.workunit.client.1.smithi079.stdout:9/199: getdents d1/d33/d28/d3e 0 2024-05-09T06:29:27.642 INFO:tasks.workunit.client.1.smithi079.stdout:7/131: write d4/f11 [3109913,73952] 0 2024-05-09T06:29:27.644 INFO:tasks.workunit.client.1.smithi079.stdout:9/200: link d1/d6/c26 d1/d6/da/d2d/c49 0 2024-05-09T06:29:27.646 INFO:tasks.workunit.client.1.smithi079.stdout:7/132: mkdir d4/d7/d22/d28 0 2024-05-09T06:29:27.648 INFO:tasks.workunit.client.1.smithi079.stdout:9/201: link d1/d6/d7/f31 d1/d6/da/f4a 0 2024-05-09T06:29:27.650 INFO:tasks.workunit.client.1.smithi079.stdout:7/133: mknod d4/c29 0 2024-05-09T06:29:27.652 INFO:tasks.workunit.client.1.smithi079.stdout:9/202: symlink d1/d33/d48/l4b 0 2024-05-09T06:29:27.654 INFO:tasks.workunit.client.1.smithi079.stdout:7/134: creat d4/d7/d22/f2a x:0 0 0 2024-05-09T06:29:27.654 INFO:tasks.workunit.client.1.smithi079.stdout:7/135: read - d4/d7/f25 zero size 2024-05-09T06:29:27.656 INFO:tasks.workunit.client.1.smithi079.stdout:9/203: mkdir d1/d33/d28/d4c 0 2024-05-09T06:29:27.661 INFO:tasks.workunit.client.1.smithi079.stdout:9/204: rmdir d1/d5 39 2024-05-09T06:29:27.664 INFO:tasks.workunit.client.1.smithi079.stdout:9/205: getdents d1/d5 0 2024-05-09T06:29:27.674 INFO:tasks.workunit.client.1.smithi079.stdout:9/206: dread d1/d6/da/f2e [0,4194304] 0 2024-05-09T06:29:27.674 INFO:tasks.workunit.client.1.smithi079.stdout:7/136: dwrite d4/d7/dd/f1e [0,4194304] 0 2024-05-09T06:29:27.674 INFO:tasks.workunit.client.1.smithi079.stdout:7/137: chown d4/d7 11 1 2024-05-09T06:29:27.682 INFO:tasks.workunit.client.1.smithi079.stdout:9/207: mkdir d1/d33/d28/d36/d4d 0 2024-05-09T06:29:27.685 INFO:tasks.workunit.client.1.smithi079.stdout:9/208: dread d1/f29 [0,4194304] 0 2024-05-09T06:29:27.685 INFO:tasks.workunit.client.1.smithi079.stdout:9/209: chown d1/d6/cb 93729 1 2024-05-09T06:29:27.685 INFO:tasks.workunit.client.1.smithi079.stdout:9/210: stat d1/d33/d28/d36 0 2024-05-09T06:29:27.707 INFO:tasks.workunit.client.1.smithi079.stdout:4/173: dwrite d6/dd/df/f13 [4194304,4194304] 0 2024-05-09T06:29:27.711 INFO:tasks.workunit.client.1.smithi079.stdout:4/174: creat d6/dd/f36 x:0 0 0 2024-05-09T06:29:27.715 INFO:tasks.workunit.client.1.smithi079.stdout:7/138: getdents d4/d7/dd 0 2024-05-09T06:29:27.715 INFO:tasks.workunit.client.1.smithi079.stdout:7/139: creat d4/d7/f2b x:0 0 0 2024-05-09T06:29:27.720 INFO:tasks.workunit.client.1.smithi079.stdout:4/175: write d6/d8/d9/fc [126079,22730] 0 2024-05-09T06:29:27.720 INFO:tasks.workunit.client.1.smithi079.stdout:4/176: dread - d6/d1a/d26/d2a/f2d zero size 2024-05-09T06:29:27.722 INFO:tasks.workunit.client.1.smithi079.stdout:4/177: symlink d6/dd/l37 0 2024-05-09T06:29:27.722 INFO:tasks.workunit.client.1.smithi079.stdout:4/178: truncate f2 1200306 0 2024-05-09T06:29:27.734 INFO:tasks.workunit.client.1.smithi079.stdout:4/179: dwrite d6/dd/f36 [0,4194304] 0 2024-05-09T06:29:27.740 INFO:tasks.workunit.client.1.smithi079.stdout:4/180: rename d6/d8/c2b to d6/d8/c38 0 2024-05-09T06:29:27.740 INFO:tasks.workunit.client.1.smithi079.stdout:4/181: chown d6/d8/d32 103000 1 2024-05-09T06:29:27.740 INFO:tasks.workunit.client.1.smithi079.stdout:4/182: fdatasync d6/d1a/d26/d2a/f2d 0 2024-05-09T06:29:27.740 INFO:tasks.workunit.client.1.smithi079.stdout:4/183: truncate d6/dd/f2f 1139512 0 2024-05-09T06:29:27.746 INFO:tasks.workunit.client.1.smithi079.stdout:4/184: dread d6/dd/f36 [0,4194304] 0 2024-05-09T06:29:27.751 INFO:tasks.workunit.client.1.smithi079.stdout:9/211: rename d1/d6/da to d1/d33/d28/d4c/d4e 0 2024-05-09T06:29:27.753 INFO:tasks.workunit.client.1.smithi079.stdout:4/185: mknod d6/dd/df/c39 0 2024-05-09T06:29:27.753 INFO:tasks.workunit.client.1.smithi079.stdout:4/186: write d6/d8/d9/f23 [646137,80550] 0 2024-05-09T06:29:27.757 INFO:tasks.workunit.client.1.smithi079.stdout:9/212: link d1/d5/l40 d1/d33/l4f 0 2024-05-09T06:29:27.757 INFO:tasks.workunit.client.1.smithi079.stdout:9/213: stat d1/d33/d28 0 2024-05-09T06:29:27.760 INFO:tasks.workunit.client.1.smithi079.stdout:9/214: unlink d1/d33/d28/l3c 0 2024-05-09T06:29:27.760 INFO:tasks.workunit.client.1.smithi079.stdout:9/215: truncate d1/d33/d28/d4c/d4e/f4a 85528 0 2024-05-09T06:29:27.762 INFO:tasks.workunit.client.1.smithi079.stdout:9/216: truncate d1/d6/f13 2675583 0 2024-05-09T06:29:27.769 INFO:tasks.workunit.client.1.smithi079.stdout:9/217: symlink d1/d33/d28/l50 0 2024-05-09T06:29:27.772 INFO:tasks.workunit.client.1.smithi079.stdout:4/187: dwrite d6/d8/d9/f23 [0,4194304] 0 2024-05-09T06:29:27.781 INFO:tasks.workunit.client.1.smithi079.stdout:9/218: dwrite d1/d33/d28/d4c/d4e/f2e [4194304,4194304] 0 2024-05-09T06:29:27.873 INFO:tasks.workunit.client.1.smithi079.stdout:0/78: sync 2024-05-09T06:29:27.873 INFO:tasks.workunit.client.1.smithi079.stdout:1/40: sync 2024-05-09T06:29:27.873 INFO:tasks.workunit.client.1.smithi079.stdout:6/72: sync 2024-05-09T06:29:27.873 INFO:tasks.workunit.client.1.smithi079.stdout:9/219: write d1/d33/d28/d4c/d4e/fc [201975,113780] 0 2024-05-09T06:29:27.873 INFO:tasks.workunit.client.1.smithi079.stdout:1/41: chown d0/d7/fc 434 1 2024-05-09T06:29:27.876 INFO:tasks.workunit.client.1.smithi079.stdout:9/220: chown d1/d6/d7/d19/c1d 535325 1 2024-05-09T06:29:27.876 INFO:tasks.workunit.client.1.smithi079.stdout:0/79: read d3/dd/d1f/f20 [3452419,128549] 0 2024-05-09T06:29:27.877 INFO:tasks.workunit.client.1.smithi079.stdout:1/42: mknod d0/df/c10 0 2024-05-09T06:29:27.879 INFO:tasks.workunit.client.1.smithi079.stdout:6/73: creat d0/d6/f14 x:0 0 0 2024-05-09T06:29:27.879 INFO:tasks.workunit.client.1.smithi079.stdout:6/74: dread - d0/f12 zero size 2024-05-09T06:29:27.879 INFO:tasks.workunit.client.1.smithi079.stdout:6/75: dread - d0/f12 zero size 2024-05-09T06:29:27.881 INFO:tasks.workunit.client.1.smithi079.stdout:0/80: creat d3/d5/f21 x:0 0 0 2024-05-09T06:29:27.882 INFO:tasks.workunit.client.1.smithi079.stdout:9/221: dread d1/d33/d28/d4c/d4e/fc [0,4194304] 0 2024-05-09T06:29:27.882 INFO:tasks.workunit.client.1.smithi079.stdout:9/222: fsync d1/d33/d2b/f32 0 2024-05-09T06:29:27.885 INFO:tasks.workunit.client.1.smithi079.stdout:3/36: sync 2024-05-09T06:29:27.885 INFO:tasks.workunit.client.1.smithi079.stdout:5/114: sync 2024-05-09T06:29:27.886 INFO:tasks.workunit.client.1.smithi079.stdout:0/81: dread d3/dd/d1f/fa [0,4194304] 0 2024-05-09T06:29:27.886 INFO:tasks.workunit.client.1.smithi079.stdout:3/37: dread - f6 zero size 2024-05-09T06:29:27.886 INFO:tasks.workunit.client.1.smithi079.stdout:8/64: sync 2024-05-09T06:29:27.886 INFO:tasks.workunit.client.1.smithi079.stdout:8/65: chown d1/d5 810782574 1 2024-05-09T06:29:27.886 INFO:tasks.workunit.client.1.smithi079.stdout:8/66: truncate d1/f1a 179400 0 2024-05-09T06:29:27.887 INFO:tasks.workunit.client.1.smithi079.stdout:6/76: dread d0/fc [0,4194304] 0 2024-05-09T06:29:27.890 INFO:tasks.workunit.client.1.smithi079.stdout:5/115: rename f12 to d13/d2a/f2b 0 2024-05-09T06:29:27.890 INFO:tasks.workunit.client.1.smithi079.stdout:5/116: read - d13/f21 zero size 2024-05-09T06:29:27.892 INFO:tasks.workunit.client.1.smithi079.stdout:1/43: dread d0/f5 [0,4194304] 0 2024-05-09T06:29:27.893 INFO:tasks.workunit.client.1.smithi079.stdout:1/44: chown d0/df 1085 1 2024-05-09T06:29:27.893 INFO:tasks.workunit.client.1.smithi079.stdout:0/82: mknod d3/dd/c22 0 2024-05-09T06:29:27.893 INFO:tasks.workunit.client.1.smithi079.stdout:0/83: chown d3/dd/d1f/f1d 15028263 1 2024-05-09T06:29:27.894 INFO:tasks.workunit.client.1.smithi079.stdout:8/67: write d1/d3/f6 [4171013,73987] 0 2024-05-09T06:29:27.895 INFO:tasks.workunit.client.1.smithi079.stdout:8/68: fsync d1/d5/f11 0 2024-05-09T06:29:27.895 INFO:tasks.workunit.client.1.smithi079.stdout:2/123: sync 2024-05-09T06:29:27.895 INFO:tasks.workunit.client.1.smithi079.stdout:4/188: sync 2024-05-09T06:29:27.895 INFO:tasks.workunit.client.1.smithi079.stdout:7/140: sync 2024-05-09T06:29:27.895 INFO:tasks.workunit.client.1.smithi079.stdout:2/124: fdatasync d8/db/f1b 0 2024-05-09T06:29:27.897 INFO:tasks.workunit.client.1.smithi079.stdout:5/117: mknod d13/d2a/c2c 0 2024-05-09T06:29:27.902 INFO:tasks.workunit.client.1.smithi079.stdout:1/45: mkdir d0/d7/d11 0 2024-05-09T06:29:27.906 INFO:tasks.workunit.client.1.smithi079.stdout:0/84: truncate d3/f4 1174714 0 2024-05-09T06:29:27.907 INFO:tasks.workunit.client.1.smithi079.stdout:8/69: creat d1/d5/dc/f1b x:0 0 0 2024-05-09T06:29:27.909 INFO:tasks.workunit.client.1.smithi079.stdout:7/141: unlink d4/d7/dd/l1a 0 2024-05-09T06:29:27.910 INFO:tasks.workunit.client.1.smithi079.stdout:2/125: symlink d8/db/d11/l28 0 2024-05-09T06:29:27.912 INFO:tasks.workunit.client.1.smithi079.stdout:4/189: symlink d6/dd/d34/l3a 0 2024-05-09T06:29:27.912 INFO:tasks.workunit.client.1.smithi079.stdout:4/190: creat d6/dd/df/f3b x:0 0 0 2024-05-09T06:29:27.914 INFO:tasks.workunit.client.1.smithi079.stdout:5/118: rename d13/d1b/c1c to d13/d1b/c2d 0 2024-05-09T06:29:27.915 INFO:tasks.workunit.client.1.smithi079.stdout:1/46: mkdir d0/d12 0 2024-05-09T06:29:27.919 INFO:tasks.workunit.client.1.smithi079.stdout:0/85: unlink d3/dd/f10 0 2024-05-09T06:29:27.921 INFO:tasks.workunit.client.1.smithi079.stdout:9/223: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:29:27.922 INFO:tasks.workunit.client.1.smithi079.stdout:6/77: dwrite d0/d6/f14 [0,4194304] 0 2024-05-09T06:29:27.922 INFO:tasks.workunit.client.1.smithi079.stdout:6/78: creat d0/f15 x:0 0 0 2024-05-09T06:29:27.922 INFO:tasks.workunit.client.1.smithi079.stdout:3/38: dwrite f5 [0,4194304] 0 2024-05-09T06:29:27.923 INFO:tasks.workunit.client.1.smithi079.stdout:7/142: symlink d4/d20/l2c 0 2024-05-09T06:29:27.923 INFO:tasks.workunit.client.1.smithi079.stdout:2/126: symlink d8/db/l29 0 2024-05-09T06:29:27.927 INFO:tasks.workunit.client.1.smithi079.stdout:5/119: dwrite d13/f16 [0,4194304] 0 2024-05-09T06:29:27.928 INFO:tasks.workunit.client.1.smithi079.stdout:1/47: mknod d0/d7/da/c13 0 2024-05-09T06:29:27.930 INFO:tasks.workunit.client.1.smithi079.stdout:0/86: mknod d3/dd/d1f/c23 0 2024-05-09T06:29:27.930 INFO:tasks.workunit.client.1.smithi079.stdout:0/87: creat d3/db/f24 x:0 0 0 2024-05-09T06:29:27.930 INFO:tasks.workunit.client.1.smithi079.stdout:0/88: truncate d3/db/f24 509040 0 2024-05-09T06:29:27.932 INFO:tasks.workunit.client.1.smithi079.stdout:8/70: rename d1/d5/dc/f12 to d1/d3/f1c 0 2024-05-09T06:29:27.934 INFO:tasks.workunit.client.1.smithi079.stdout:9/224: mkdir d1/d33/d28/d36/d4d/d51 0 2024-05-09T06:29:27.934 INFO:tasks.workunit.client.1.smithi079.stdout:9/225: fsync d1/d6/f1c 0 2024-05-09T06:29:27.934 INFO:tasks.workunit.client.1.smithi079.stdout:9/226: stat d1/d33/d28/d36/d4d/d51 0 2024-05-09T06:29:27.934 INFO:tasks.workunit.client.1.smithi079.stdout:9/227: write d1/d33/d28/d4c/d4e/fc [1140554,14474] 0 2024-05-09T06:29:27.936 INFO:tasks.workunit.client.1.smithi079.stdout:6/79: dwrite d0/fc [4194304,4194304] 0 2024-05-09T06:29:27.945 INFO:tasks.workunit.client.1.smithi079.stdout:7/143: symlink d4/d7/d22/l2d 0 2024-05-09T06:29:27.945 INFO:tasks.workunit.client.1.smithi079.stdout:7/144: chown d4/f26 126009620 1 2024-05-09T06:29:27.947 INFO:tasks.workunit.client.1.smithi079.stdout:2/127: rmdir d8/db/dc/d27 0 2024-05-09T06:29:27.947 INFO:tasks.workunit.client.1.smithi079.stdout:2/128: chown d8/db/d11/c21 3297 1 2024-05-09T06:29:27.947 INFO:tasks.workunit.client.1.smithi079.stdout:2/129: truncate d8/f9 768443 0 2024-05-09T06:29:27.950 INFO:tasks.workunit.client.1.smithi079.stdout:4/191: rmdir d6/d1a/d26 39 2024-05-09T06:29:27.950 INFO:tasks.workunit.client.1.smithi079.stdout:4/192: readlink d6/d8/l1e 0 2024-05-09T06:29:27.950 INFO:tasks.workunit.client.1.smithi079.stdout:4/193: chown d6/dd/df/f35 2004647 1 2024-05-09T06:29:27.951 INFO:tasks.workunit.client.1.smithi079.stdout:6/80: dwrite d0/f15 [0,4194304] 0 2024-05-09T06:29:27.956 INFO:tasks.workunit.client.1.smithi079.stdout:5/120: creat d13/d1b/d26/f2e x:0 0 0 2024-05-09T06:29:27.956 INFO:tasks.workunit.client.1.smithi079.stdout:5/121: chown c10 1446793 1 2024-05-09T06:29:27.958 INFO:tasks.workunit.client.1.smithi079.stdout:1/48: creat d0/df/f14 x:0 0 0 2024-05-09T06:29:27.962 INFO:tasks.workunit.client.1.smithi079.stdout:0/89: rename d3/d5/c15 to d3/dd/d1f/c25 0 2024-05-09T06:29:27.963 INFO:tasks.workunit.client.1.smithi079.stdout:0/90: readlink d3/db/l17 0 2024-05-09T06:29:27.964 INFO:tasks.workunit.client.1.smithi079.stdout:8/71: chown d1/d3/fa 813981 1 2024-05-09T06:29:27.964 INFO:tasks.workunit.client.1.smithi079.stdout:8/72: readlink d1/ld 0 2024-05-09T06:29:27.968 INFO:tasks.workunit.client.1.smithi079.stdout:3/39: link f7 f8 0 2024-05-09T06:29:27.970 INFO:tasks.workunit.client.1.smithi079.stdout:7/145: mknod d4/d7/d22/c2e 0 2024-05-09T06:29:27.970 INFO:tasks.workunit.client.1.smithi079.stdout:7/146: chown d4/d7/c1f 25057100 1 2024-05-09T06:29:27.971 INFO:tasks.workunit.client.1.smithi079.stdout:2/130: dwrite d8/f9 [0,4194304] 0 2024-05-09T06:29:27.971 INFO:tasks.workunit.client.1.smithi079.stdout:2/131: chown d8/db/dc 223456783 1 2024-05-09T06:29:27.972 INFO:tasks.workunit.client.1.smithi079.stdout:2/132: rename d8/db/dc to d8/db/dc/d2a 22 2024-05-09T06:29:27.974 INFO:tasks.workunit.client.1.smithi079.stdout:4/194: symlink d6/d8/d9/l3c 0 2024-05-09T06:29:27.974 INFO:tasks.workunit.client.1.smithi079.stdout:4/195: write d6/dd/df/f3b [996141,3545] 0 2024-05-09T06:29:27.979 INFO:tasks.workunit.client.1.smithi079.stdout:3/40: write f5 [3618870,124258] 0 2024-05-09T06:29:27.979 INFO:tasks.workunit.client.1.smithi079.stdout:3/41: dread - f6 zero size 2024-05-09T06:29:27.979 INFO:tasks.workunit.client.1.smithi079.stdout:5/122: dwrite d13/d1b/f28 [0,4194304] 0 2024-05-09T06:29:27.979 INFO:tasks.workunit.client.1.smithi079.stdout:6/81: mkdir d0/d6/d16 0 2024-05-09T06:29:27.979 INFO:tasks.workunit.client.1.smithi079.stdout:6/82: read - d0/f12 zero size 2024-05-09T06:29:27.980 INFO:tasks.workunit.client.1.smithi079.stdout:8/73: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:27.980 INFO:tasks.workunit.client.1.smithi079.stdout:8/74: write d1/d5/dc/f1b [58565,66433] 0 2024-05-09T06:29:27.983 INFO:tasks.workunit.client.1.smithi079.stdout:0/91: symlink d3/dd/d18/l26 0 2024-05-09T06:29:27.983 INFO:tasks.workunit.client.1.smithi079.stdout:0/92: dread - d3/f16 zero size 2024-05-09T06:29:27.983 INFO:tasks.workunit.client.1.smithi079.stdout:0/93: write d3/dd/d1f/f1d [743359,72238] 0 2024-05-09T06:29:27.988 INFO:tasks.workunit.client.1.smithi079.stdout:7/147: rmdir d4/d20 39 2024-05-09T06:29:27.988 INFO:tasks.workunit.client.1.smithi079.stdout:7/148: write d4/d7/f13 [2108937,122297] 0 2024-05-09T06:29:27.988 INFO:tasks.workunit.client.1.smithi079.stdout:7/149: chown d4/d7/dd/f21 6579 1 2024-05-09T06:29:27.989 INFO:tasks.workunit.client.1.smithi079.stdout:2/133: symlink d8/db/l2b 0 2024-05-09T06:29:27.990 INFO:tasks.workunit.client.1.smithi079.stdout:4/196: rmdir d6/d1a/d26/d2a 39 2024-05-09T06:29:27.992 INFO:tasks.workunit.client.1.smithi079.stdout:3/42: creat f9 x:0 0 0 2024-05-09T06:29:27.992 INFO:tasks.workunit.client.1.smithi079.stdout:3/43: write f3 [1269129,71119] 0 2024-05-09T06:29:27.996 INFO:tasks.workunit.client.1.smithi079.stdout:7/150: dread d4/d7/f13 [0,4194304] 0 2024-05-09T06:29:27.996 INFO:tasks.workunit.client.1.smithi079.stdout:7/151: dread - d4/f26 zero size 2024-05-09T06:29:28.000 INFO:tasks.workunit.client.1.smithi079.stdout:6/83: rmdir d0/d13 0 2024-05-09T06:29:28.018 INFO:tasks.workunit.client.1.smithi079.stdout:7/152: dwrite d4/f26 [0,4194304] 0 2024-05-09T06:29:28.018 INFO:tasks.workunit.client.1.smithi079.stdout:7/153: creat d4/d7/d22/f2f x:0 0 0 2024-05-09T06:29:28.021 INFO:tasks.workunit.client.1.smithi079.stdout:2/134: mkdir d8/db/dc/d2c 0 2024-05-09T06:29:28.023 INFO:tasks.workunit.client.1.smithi079.stdout:4/197: mkdir d6/d8/d27/d3d 0 2024-05-09T06:29:28.026 INFO:tasks.workunit.client.1.smithi079.stdout:3/44: creat fa x:0 0 0 2024-05-09T06:29:28.030 INFO:tasks.workunit.client.1.smithi079.stdout:6/84: mknod d0/d6/c17 0 2024-05-09T06:29:28.034 INFO:tasks.workunit.client.1.smithi079.stdout:7/154: dread d4/f26 [0,4194304] 0 2024-05-09T06:29:28.034 INFO:tasks.workunit.client.1.smithi079.stdout:2/135: dread d8/f9 [0,4194304] 0 2024-05-09T06:29:28.034 INFO:tasks.workunit.client.1.smithi079.stdout:2/136: write d8/db/d11/f24 [628229,64351] 0 2024-05-09T06:29:28.038 INFO:tasks.workunit.client.1.smithi079.stdout:5/123: getdents d13/d1b/d26 0 2024-05-09T06:29:28.038 INFO:tasks.workunit.client.1.smithi079.stdout:5/124: truncate d13/d1b/f25 1192621 0 2024-05-09T06:29:28.038 INFO:tasks.workunit.client.1.smithi079.stdout:5/125: readlink ld 0 2024-05-09T06:29:28.040 INFO:tasks.workunit.client.1.smithi079.stdout:4/198: link d6/dd/d34/l3a d6/d15/l3e 0 2024-05-09T06:29:28.041 INFO:tasks.workunit.client.1.smithi079.stdout:1/49: rmdir d0 39 2024-05-09T06:29:28.046 INFO:tasks.workunit.client.1.smithi079.stdout:6/85: rename d0/de/lf to d0/de/l18 0 2024-05-09T06:29:28.046 INFO:tasks.workunit.client.1.smithi079.stdout:6/86: creat d0/f19 x:0 0 0 2024-05-09T06:29:28.046 INFO:tasks.workunit.client.1.smithi079.stdout:6/87: write d0/f12 [507026,16886] 0 2024-05-09T06:29:28.046 INFO:tasks.workunit.client.1.smithi079.stdout:6/88: chown d0/d6/cd 5025 1 2024-05-09T06:29:28.048 INFO:tasks.workunit.client.1.smithi079.stdout:2/137: mkdir d8/db/dc/d2c/d2d 0 2024-05-09T06:29:28.049 INFO:tasks.workunit.client.1.smithi079.stdout:5/126: truncate fa 1904012 0 2024-05-09T06:29:28.050 INFO:tasks.workunit.client.1.smithi079.stdout:7/155: dwrite d4/d7/d22/f23 [4194304,4194304] 0 2024-05-09T06:29:28.051 INFO:tasks.workunit.client.1.smithi079.stdout:5/127: dread fc [0,4194304] 0 2024-05-09T06:29:28.051 INFO:tasks.workunit.client.1.smithi079.stdout:5/128: creat d13/d1b/f2f x:0 0 0 2024-05-09T06:29:28.052 INFO:tasks.workunit.client.1.smithi079.stdout:4/199: symlink d6/d8/d32/l3f 0 2024-05-09T06:29:28.055 INFO:tasks.workunit.client.1.smithi079.stdout:4/200: dread f2 [0,4194304] 0 2024-05-09T06:29:28.055 INFO:tasks.workunit.client.1.smithi079.stdout:1/50: creat d0/d7/d11/f15 x:0 0 0 2024-05-09T06:29:28.055 INFO:tasks.workunit.client.1.smithi079.stdout:1/51: fdatasync d0/f3 0 2024-05-09T06:29:28.055 INFO:tasks.workunit.client.1.smithi079.stdout:1/52: readlink d0/d7/l8 0 2024-05-09T06:29:28.055 INFO:tasks.workunit.client.1.smithi079.stdout:1/53: read - d0/fd zero size 2024-05-09T06:29:28.056 INFO:tasks.workunit.client.1.smithi079.stdout:3/45: rename f9 to fb 0 2024-05-09T06:29:28.057 INFO:tasks.workunit.client.1.smithi079.stdout:3/46: dread - f8 zero size 2024-05-09T06:29:28.059 INFO:tasks.workunit.client.1.smithi079.stdout:0/94: rename d3/db to d3/d5/d27 0 2024-05-09T06:29:28.059 INFO:tasks.workunit.client.1.smithi079.stdout:0/95: fsync d3/f4 0 2024-05-09T06:29:28.059 INFO:tasks.workunit.client.1.smithi079.stdout:0/96: write d3/dd/d1f/fa [3081989,119546] 0 2024-05-09T06:29:28.063 INFO:tasks.workunit.client.1.smithi079.stdout:2/138: mkdir d8/db/dc/d2c/d2e 0 2024-05-09T06:29:28.068 INFO:tasks.workunit.client.1.smithi079.stdout:5/129: mknod d13/c30 0 2024-05-09T06:29:28.069 INFO:tasks.workunit.client.1.smithi079.stdout:9/228: truncate d1/f29 3917708 0 2024-05-09T06:29:28.070 INFO:tasks.workunit.client.1.smithi079.stdout:4/201: creat d6/d8/d32/f40 x:0 0 0 2024-05-09T06:29:28.071 INFO:tasks.workunit.client.1.smithi079.stdout:7/156: dwrite d4/d7/f2b [0,4194304] 0 2024-05-09T06:29:28.071 INFO:tasks.workunit.client.1.smithi079.stdout:7/157: fsync d4/d7/d22/f23 0 2024-05-09T06:29:28.071 INFO:tasks.workunit.client.1.smithi079.stdout:7/158: fdatasync d4/f14 0 2024-05-09T06:29:28.073 INFO:tasks.workunit.client.1.smithi079.stdout:6/89: dwrite d0/fc [0,4194304] 0 2024-05-09T06:29:28.077 INFO:tasks.workunit.client.1.smithi079.stdout:1/54: rename d0/d7/da to d0/d12/d16 0 2024-05-09T06:29:28.077 INFO:tasks.workunit.client.1.smithi079.stdout:1/55: write d0/df/f14 [232435,33902] 0 2024-05-09T06:29:28.078 INFO:tasks.workunit.client.1.smithi079.stdout:2/139: write f3 [5421043,11800] 0 2024-05-09T06:29:28.080 INFO:tasks.workunit.client.1.smithi079.stdout:5/130: truncate f11 965157 0 2024-05-09T06:29:28.088 INFO:tasks.workunit.client.1.smithi079.stdout:7/159: mkdir d4/d30 0 2024-05-09T06:29:28.088 INFO:tasks.workunit.client.1.smithi079.stdout:7/160: chown d4/d7/f13 2 1 2024-05-09T06:29:28.088 INFO:tasks.workunit.client.1.smithi079.stdout:7/161: chown d4/d7/d22/f23 478 1 2024-05-09T06:29:28.091 INFO:tasks.workunit.client.1.smithi079.stdout:3/47: link f5 fc 0 2024-05-09T06:29:28.091 INFO:tasks.workunit.client.1.smithi079.stdout:3/48: chown f7 206404 1 2024-05-09T06:29:28.094 INFO:tasks.workunit.client.1.smithi079.stdout:9/229: dwrite d1/d33/d28/d3e/f44 [0,4194304] 0 2024-05-09T06:29:28.094 INFO:tasks.workunit.client.1.smithi079.stdout:4/202: dwrite d6/d15/f31 [0,4194304] 0 2024-05-09T06:29:28.095 INFO:tasks.workunit.client.1.smithi079.stdout:0/97: rename d3/f16 to d3/dd/d1f/f28 0 2024-05-09T06:29:28.095 INFO:tasks.workunit.client.1.smithi079.stdout:0/98: write d3/dd/f1c [642105,25637] 0 2024-05-09T06:29:28.097 INFO:tasks.workunit.client.1.smithi079.stdout:1/56: mknod d0/d12/d16/c17 0 2024-05-09T06:29:28.097 INFO:tasks.workunit.client.1.smithi079.stdout:1/57: chown d0/f2 143471082 1 2024-05-09T06:29:28.097 INFO:tasks.workunit.client.1.smithi079.stdout:1/58: write d0/d7/fb [305619,36619] 0 2024-05-09T06:29:28.097 INFO:tasks.workunit.client.1.smithi079.stdout:1/59: chown d0/d12 96 1 2024-05-09T06:29:28.098 INFO:tasks.workunit.client.1.smithi079.stdout:2/140: truncate d8/f10 1866509 0 2024-05-09T06:29:28.099 INFO:tasks.workunit.client.1.smithi079.stdout:2/141: creat d8/db/d11/f2f x:0 0 0 2024-05-09T06:29:28.100 INFO:tasks.workunit.client.1.smithi079.stdout:5/131: link d13/l23 d13/d1b/l31 0 2024-05-09T06:29:28.103 INFO:tasks.workunit.client.1.smithi079.stdout:3/49: creat fd x:0 0 0 2024-05-09T06:29:28.110 INFO:tasks.workunit.client.1.smithi079.stdout:9/230: creat d1/d5/f52 x:0 0 0 2024-05-09T06:29:28.121 INFO:tasks.workunit.client.1.smithi079.stdout:7/162: dwrite d4/d7/d22/f2a [0,4194304] 0 2024-05-09T06:29:28.121 INFO:tasks.workunit.client.1.smithi079.stdout:0/99: dwrite d3/dd/d1f/f13 [0,4194304] 0 2024-05-09T06:29:28.123 INFO:tasks.workunit.client.1.smithi079.stdout:2/142: dwrite d8/db/d11/f2f [0,4194304] 0 2024-05-09T06:29:28.133 INFO:tasks.workunit.client.1.smithi079.stdout:6/90: rename d0/l8 to d0/de/l1a 0 2024-05-09T06:29:28.135 INFO:tasks.workunit.client.1.smithi079.stdout:6/91: dread d0/f12 [0,4194304] 0 2024-05-09T06:29:28.135 INFO:tasks.workunit.client.1.smithi079.stdout:1/60: creat d0/d12/f18 x:0 0 0 2024-05-09T06:29:28.136 INFO:tasks.workunit.client.1.smithi079.stdout:1/61: fsync d0/d7/d11/f15 0 2024-05-09T06:29:28.136 INFO:tasks.workunit.client.1.smithi079.stdout:1/62: chown d0/f5 423283997 1 2024-05-09T06:29:28.136 INFO:tasks.workunit.client.1.smithi079.stdout:1/63: dread - d0/d12/f18 zero size 2024-05-09T06:29:28.139 INFO:tasks.workunit.client.1.smithi079.stdout:5/132: symlink d13/l32 0 2024-05-09T06:29:28.140 INFO:tasks.workunit.client.1.smithi079.stdout:5/133: write fa [2012744,86273] 0 2024-05-09T06:29:28.145 INFO:tasks.workunit.client.1.smithi079.stdout:9/231: link d1/d33/f37 d1/d33/d2b/f53 0 2024-05-09T06:29:28.146 INFO:tasks.workunit.client.1.smithi079.stdout:7/163: dwrite d4/d7/f25 [0,4194304] 0 2024-05-09T06:29:28.155 INFO:tasks.workunit.client.1.smithi079.stdout:0/100: read d3/d5/ff [11239,91523] 0 2024-05-09T06:29:28.155 INFO:tasks.workunit.client.1.smithi079.stdout:0/101: write d3/d5/fe [921548,48874] 0 2024-05-09T06:29:28.158 INFO:tasks.workunit.client.1.smithi079.stdout:6/92: mkdir d0/d6/d1b 0 2024-05-09T06:29:28.158 INFO:tasks.workunit.client.1.smithi079.stdout:7/164: dread d4/d7/f13 [0,4194304] 0 2024-05-09T06:29:28.158 INFO:tasks.workunit.client.1.smithi079.stdout:1/64: dwrite d0/fd [0,4194304] 0 2024-05-09T06:29:28.159 INFO:tasks.workunit.client.1.smithi079.stdout:7/165: chown d4/c29 1063953 1 2024-05-09T06:29:28.159 INFO:tasks.workunit.client.1.smithi079.stdout:1/65: stat d0/d7/f9 0 2024-05-09T06:29:28.159 INFO:tasks.workunit.client.1.smithi079.stdout:7/166: stat d4/d7/d22/f2f 0 2024-05-09T06:29:28.159 INFO:tasks.workunit.client.1.smithi079.stdout:1/66: truncate d0/df/f14 312350 0 2024-05-09T06:29:28.159 INFO:tasks.workunit.client.1.smithi079.stdout:1/67: stat d0/d7/d11/f15 0 2024-05-09T06:29:28.163 INFO:tasks.workunit.client.1.smithi079.stdout:7/167: dread d4/d7/dd/f24 [0,4194304] 0 2024-05-09T06:29:28.163 INFO:tasks.workunit.client.1.smithi079.stdout:7/168: stat d4/d7/d22/l2d 0 2024-05-09T06:29:28.164 INFO:tasks.workunit.client.1.smithi079.stdout:9/232: dwrite d1/d33/d28/d4c/d4e/f2e [0,4194304] 0 2024-05-09T06:29:28.164 INFO:tasks.workunit.client.1.smithi079.stdout:9/233: chown d1/d33/d28/d4c/d4e/d2d/c49 50 1 2024-05-09T06:29:28.165 INFO:tasks.workunit.client.1.smithi079.stdout:5/134: creat d13/d1b/d26/f33 x:0 0 0 2024-05-09T06:29:28.167 INFO:tasks.workunit.client.1.smithi079.stdout:3/50: rename f6 to fe 0 2024-05-09T06:29:28.167 INFO:tasks.workunit.client.1.smithi079.stdout:3/51: chown fb 1631856 1 2024-05-09T06:29:28.167 INFO:tasks.workunit.client.1.smithi079.stdout:3/52: readlink - no filename 2024-05-09T06:29:28.170 INFO:tasks.workunit.client.1.smithi079.stdout:6/93: write d0/f15 [293538,100270] 0 2024-05-09T06:29:28.170 INFO:tasks.workunit.client.1.smithi079.stdout:6/94: truncate d0/f12 872122 0 2024-05-09T06:29:28.181 INFO:tasks.workunit.client.1.smithi079.stdout:1/68: link d0/d7/d11/f15 d0/d12/d16/f19 0 2024-05-09T06:29:28.181 INFO:tasks.workunit.client.1.smithi079.stdout:1/69: fdatasync d0/d7/f9 0 2024-05-09T06:29:28.181 INFO:tasks.workunit.client.1.smithi079.stdout:1/70: stat d0/d7/fc 0 2024-05-09T06:29:28.182 INFO:tasks.workunit.client.1.smithi079.stdout:1/71: creat d0/d12/f1a x:0 0 0 2024-05-09T06:29:28.185 INFO:tasks.workunit.client.1.smithi079.stdout:3/53: stat c4 0 2024-05-09T06:29:28.189 INFO:tasks.workunit.client.1.smithi079.stdout:6/95: creat d0/de/f1c x:0 0 0 2024-05-09T06:29:28.189 INFO:tasks.workunit.client.1.smithi079.stdout:6/96: readlink d0/l7 0 2024-05-09T06:29:28.191 INFO:tasks.workunit.client.1.smithi079.stdout:0/102: getdents d3/d5 0 2024-05-09T06:29:28.191 INFO:tasks.workunit.client.1.smithi079.stdout:0/103: chown d3/dd/c1a 181928 1 2024-05-09T06:29:28.191 INFO:tasks.workunit.client.1.smithi079.stdout:0/104: readlink d3/lc 0 2024-05-09T06:29:28.191 INFO:tasks.workunit.client.1.smithi079.stdout:0/105: chown d3/dd/d18/l26 4 1 2024-05-09T06:29:28.191 INFO:tasks.workunit.client.1.smithi079.stdout:0/106: dread d3/d5/d27/f24 [0,4194304] 0 2024-05-09T06:29:28.194 INFO:tasks.workunit.client.1.smithi079.stdout:5/135: dwrite d13/d1b/f25 [0,4194304] 0 2024-05-09T06:29:28.194 INFO:tasks.workunit.client.1.smithi079.stdout:5/136: write d13/f19 [725704,122050] 0 2024-05-09T06:29:28.195 INFO:tasks.workunit.client.1.smithi079.stdout:1/72: unlink d0/d7/l8 0 2024-05-09T06:29:28.195 INFO:tasks.workunit.client.1.smithi079.stdout:1/73: write d0/df/f14 [684565,57041] 0 2024-05-09T06:29:28.195 INFO:tasks.workunit.client.1.smithi079.stdout:1/74: stat d0/d12/d16/c13 0 2024-05-09T06:29:28.196 INFO:tasks.workunit.client.1.smithi079.stdout:9/234: dwrite d1/d5/f10 [0,4194304] 0 2024-05-09T06:29:28.196 INFO:tasks.workunit.client.1.smithi079.stdout:7/169: getdents d4 0 2024-05-09T06:29:28.196 INFO:tasks.workunit.client.1.smithi079.stdout:7/170: write d4/f6 [1092323,116613] 0 2024-05-09T06:29:28.196 INFO:tasks.workunit.client.1.smithi079.stdout:7/171: read - d4/d7/d22/f2f zero size 2024-05-09T06:29:28.196 INFO:tasks.workunit.client.1.smithi079.stdout:7/172: chown d4/d7/dd/c27 80050141 1 2024-05-09T06:29:28.197 INFO:tasks.workunit.client.1.smithi079.stdout:5/137: dread fa [0,4194304] 0 2024-05-09T06:29:28.198 INFO:tasks.workunit.client.1.smithi079.stdout:5/138: readlink l8 0 2024-05-09T06:29:28.198 INFO:tasks.workunit.client.1.smithi079.stdout:5/139: truncate d13/d1b/f20 505204 0 2024-05-09T06:29:28.205 INFO:tasks.workunit.client.1.smithi079.stdout:8/75: sync 2024-05-09T06:29:28.205 INFO:tasks.workunit.client.1.smithi079.stdout:8/76: chown d1/l2 50 1 2024-05-09T06:29:28.205 INFO:tasks.workunit.client.1.smithi079.stdout:8/77: creat d1/d5/dc/f1d x:0 0 0 2024-05-09T06:29:28.205 INFO:tasks.workunit.client.1.smithi079.stdout:1/75: rename d0/fd to d0/df/f1b 0 2024-05-09T06:29:28.207 INFO:tasks.workunit.client.1.smithi079.stdout:4/203: write d6/d8/d9/f17 [2929883,15749] 0 2024-05-09T06:29:28.208 INFO:tasks.workunit.client.1.smithi079.stdout:9/235: creat d1/d33/d28/d4c/d4e/f54 x:0 0 0 2024-05-09T06:29:28.208 INFO:tasks.workunit.client.1.smithi079.stdout:0/107: dwrite d3/d5/d27/f11 [0,4194304] 0 2024-05-09T06:29:28.211 INFO:tasks.workunit.client.1.smithi079.stdout:7/173: mkdir d4/d30/d31 0 2024-05-09T06:29:28.213 INFO:tasks.workunit.client.1.smithi079.stdout:3/54: rename f7 to ff 0 2024-05-09T06:29:28.213 INFO:tasks.workunit.client.1.smithi079.stdout:3/55: read f5 [553763,60502] 0 2024-05-09T06:29:28.213 INFO:tasks.workunit.client.1.smithi079.stdout:3/56: truncate fb 187551 0 2024-05-09T06:29:28.213 INFO:tasks.workunit.client.1.smithi079.stdout:3/57: write fb [1203100,119561] 0 2024-05-09T06:29:28.213 INFO:tasks.workunit.client.1.smithi079.stdout:3/58: rmdir - no directory 2024-05-09T06:29:28.213 INFO:tasks.workunit.client.1.smithi079.stdout:3/59: read - fd zero size 2024-05-09T06:29:28.214 INFO:tasks.workunit.client.1.smithi079.stdout:3/60: fsync fc 0 2024-05-09T06:29:28.214 INFO:tasks.workunit.client.1.smithi079.stdout:5/140: mknod d13/c34 0 2024-05-09T06:29:28.217 INFO:tasks.workunit.client.1.smithi079.stdout:4/204: dread d6/d8/f10 [0,4194304] 0 2024-05-09T06:29:28.218 INFO:tasks.workunit.client.1.smithi079.stdout:9/236: write d1/f3 [348291,122711] 0 2024-05-09T06:29:28.218 INFO:tasks.workunit.client.1.smithi079.stdout:8/78: rename d1/d5/c19 to d1/db/c1e 0 2024-05-09T06:29:28.218 INFO:tasks.workunit.client.1.smithi079.stdout:8/79: chown d1/d3/f17 31658 1 2024-05-09T06:29:28.218 INFO:tasks.workunit.client.1.smithi079.stdout:8/80: chown d1/db 12 1 2024-05-09T06:29:28.225 INFO:tasks.workunit.client.1.smithi079.stdout:7/174: mkdir d4/d30/d32 0 2024-05-09T06:29:28.228 INFO:tasks.workunit.client.1.smithi079.stdout:4/205: mkdir d6/d1a/d41 0 2024-05-09T06:29:28.232 INFO:tasks.workunit.client.1.smithi079.stdout:9/237: creat d1/d6/d7/d19/f55 x:0 0 0 2024-05-09T06:29:28.235 INFO:tasks.workunit.client.1.smithi079.stdout:1/76: rename d0/d12/d16/c17 to d0/d12/c1c 0 2024-05-09T06:29:28.238 INFO:tasks.workunit.client.1.smithi079.stdout:7/175: creat d4/d30/d31/f33 x:0 0 0 2024-05-09T06:29:28.238 INFO:tasks.workunit.client.1.smithi079.stdout:7/176: chown d4/d7/dd/c27 4 1 2024-05-09T06:29:28.242 INFO:tasks.workunit.client.1.smithi079.stdout:9/238: mkdir d1/d33/d28/d36/d38/d3a/d56 0 2024-05-09T06:29:28.243 INFO:tasks.workunit.client.1.smithi079.stdout:0/108: dwrite d3/dd/f1c [0,4194304] 0 2024-05-09T06:29:28.243 INFO:tasks.workunit.client.1.smithi079.stdout:3/61: dwrite fa [0,4194304] 0 2024-05-09T06:29:28.243 INFO:tasks.workunit.client.1.smithi079.stdout:3/62: chown fd 397 1 2024-05-09T06:29:28.244 INFO:tasks.workunit.client.1.smithi079.stdout:3/63: rmdir - no directory 2024-05-09T06:29:28.244 INFO:tasks.workunit.client.1.smithi079.stdout:1/77: mknod d0/d12/c1d 0 2024-05-09T06:29:28.244 INFO:tasks.workunit.client.1.smithi079.stdout:1/78: dread - d0/d12/d16/f19 zero size 2024-05-09T06:29:28.244 INFO:tasks.workunit.client.1.smithi079.stdout:1/79: chown d0/df/f1b 100 1 2024-05-09T06:29:28.245 INFO:tasks.workunit.client.1.smithi079.stdout:8/81: dwrite d1/d3/f1c [4194304,4194304] 0 2024-05-09T06:29:28.245 INFO:tasks.workunit.client.1.smithi079.stdout:4/206: rmdir d6/d8/d27 39 2024-05-09T06:29:28.245 INFO:tasks.workunit.client.1.smithi079.stdout:4/207: write d6/dd/df/f35 [85587,76649] 0 2024-05-09T06:29:28.246 INFO:tasks.workunit.client.1.smithi079.stdout:4/208: fsync d6/d15/f31 0 2024-05-09T06:29:28.246 INFO:tasks.workunit.client.1.smithi079.stdout:4/209: truncate d6/d1a/d26/f30 1042400 0 2024-05-09T06:29:28.248 INFO:tasks.workunit.client.1.smithi079.stdout:9/239: creat d1/d33/d28/d36/d38/d3a/f57 x:0 0 0 2024-05-09T06:29:28.250 INFO:tasks.workunit.client.1.smithi079.stdout:7/177: dread d4/d7/f18 [0,4194304] 0 2024-05-09T06:29:28.253 INFO:tasks.workunit.client.1.smithi079.stdout:1/80: symlink d0/d12/d16/l1e 0 2024-05-09T06:29:28.253 INFO:tasks.workunit.client.1.smithi079.stdout:1/81: write d0/d7/f9 [173090,49557] 0 2024-05-09T06:29:28.254 INFO:tasks.workunit.client.1.smithi079.stdout:3/64: write fa [324155,55000] 0 2024-05-09T06:29:28.257 INFO:tasks.workunit.client.1.smithi079.stdout:8/82: creat d1/f1f x:0 0 0 2024-05-09T06:29:28.257 INFO:tasks.workunit.client.1.smithi079.stdout:9/240: dread d1/d5/f21 [0,4194304] 0 2024-05-09T06:29:28.257 INFO:tasks.workunit.client.1.smithi079.stdout:9/241: creat d1/d5/f58 x:0 0 0 2024-05-09T06:29:28.257 INFO:tasks.workunit.client.1.smithi079.stdout:9/242: chown d1/d33/d28 9 1 2024-05-09T06:29:28.257 INFO:tasks.workunit.client.1.smithi079.stdout:9/243: fdatasync d1/d6/f1c 0 2024-05-09T06:29:28.259 INFO:tasks.workunit.client.1.smithi079.stdout:7/178: dread d4/d7/d22/f23 [0,4194304] 0 2024-05-09T06:29:28.259 INFO:tasks.workunit.client.1.smithi079.stdout:7/179: chown d4/d7/d22 123119590 1 2024-05-09T06:29:28.261 INFO:tasks.workunit.client.1.smithi079.stdout:0/109: dwrite d3/d5/d27/f11 [0,4194304] 0 2024-05-09T06:29:28.261 INFO:tasks.workunit.client.1.smithi079.stdout:0/110: chown d3/dd/d18/l26 114938415 1 2024-05-09T06:29:28.262 INFO:tasks.workunit.client.1.smithi079.stdout:4/210: rmdir d6/d8/d27 39 2024-05-09T06:29:28.262 INFO:tasks.workunit.client.1.smithi079.stdout:4/211: chown d6/d1a/d26/d2a/f2d 3553620 1 2024-05-09T06:29:28.262 INFO:tasks.workunit.client.1.smithi079.stdout:4/212: readlink d6/d8/d9/l3c 0 2024-05-09T06:29:28.266 INFO:tasks.workunit.client.1.smithi079.stdout:1/82: rename d0/d12/d16/c13 to d0/d7/c1f 0 2024-05-09T06:29:28.266 INFO:tasks.workunit.client.1.smithi079.stdout:1/83: chown d0/d12/d16/l1e 58 1 2024-05-09T06:29:28.272 INFO:tasks.workunit.client.1.smithi079.stdout:0/111: write d3/dd/d1f/f13 [1477506,21984] 0 2024-05-09T06:29:28.272 INFO:tasks.workunit.client.1.smithi079.stdout:0/112: chown d3/dd/d1f/f1d 99627772 1 2024-05-09T06:29:28.286 INFO:tasks.workunit.client.1.smithi079.stdout:6/97: write d0/f5 [1066741,58292] 0 2024-05-09T06:29:28.287 INFO:tasks.workunit.client.1.smithi079.stdout:3/65: creat f10 x:0 0 0 2024-05-09T06:29:28.288 INFO:tasks.workunit.client.1.smithi079.stdout:1/84: dwrite d0/df/f1b [0,4194304] 0 2024-05-09T06:29:28.292 INFO:tasks.workunit.client.1.smithi079.stdout:8/83: dread - d1/d3/f14 zero size 2024-05-09T06:29:28.292 INFO:tasks.workunit.client.1.smithi079.stdout:0/113: dwrite d3/dd/d1f/f20 [0,4194304] 0 2024-05-09T06:29:28.297 INFO:tasks.workunit.client.1.smithi079.stdout:7/180: mkdir d4/d30/d31/d34 0 2024-05-09T06:29:28.297 INFO:tasks.workunit.client.1.smithi079.stdout:7/181: stat d4/d7/dd/f24 0 2024-05-09T06:29:28.301 INFO:tasks.workunit.client.1.smithi079.stdout:4/213: link d6/dd/df/f35 d6/d8/d27/f42 0 2024-05-09T06:29:28.304 INFO:tasks.workunit.client.1.smithi079.stdout:9/244: rename d1/fd to d1/d45/f59 0 2024-05-09T06:29:28.307 INFO:tasks.workunit.client.1.smithi079.stdout:9/245: read d1/d5/f21 [2457824,21835] 0 2024-05-09T06:29:28.310 INFO:tasks.workunit.client.1.smithi079.stdout:6/98: link d0/de/l1a d0/l1d 0 2024-05-09T06:29:28.310 INFO:tasks.workunit.client.1.smithi079.stdout:6/99: truncate d0/f19 33239 0 2024-05-09T06:29:28.310 INFO:tasks.workunit.client.1.smithi079.stdout:6/100: creat d0/de/f1e x:0 0 0 2024-05-09T06:29:28.310 INFO:tasks.workunit.client.1.smithi079.stdout:6/101: readlink d0/de/l1a 0 2024-05-09T06:29:28.310 INFO:tasks.workunit.client.1.smithi079.stdout:6/102: write d0/d6/f14 [4879161,74314] 0 2024-05-09T06:29:28.311 INFO:tasks.workunit.client.1.smithi079.stdout:3/66: creat f11 x:0 0 0 2024-05-09T06:29:28.311 INFO:tasks.workunit.client.1.smithi079.stdout:3/67: write fe [624521,87574] 0 2024-05-09T06:29:28.312 INFO:tasks.workunit.client.1.smithi079.stdout:1/85: dwrite d0/d7/fb [0,4194304] 0 2024-05-09T06:29:28.312 INFO:tasks.workunit.client.1.smithi079.stdout:1/86: readlink d0/d12/d16/l1e 0 2024-05-09T06:29:28.312 INFO:tasks.workunit.client.1.smithi079.stdout:0/114: dwrite d3/dd/d1f/f13 [0,4194304] 0 2024-05-09T06:29:28.324 INFO:tasks.workunit.client.1.smithi079.stdout:7/182: creat d4/d30/d32/f35 x:0 0 0 2024-05-09T06:29:28.328 INFO:tasks.workunit.client.1.smithi079.stdout:9/246: dwrite d1/d5/f52 [0,4194304] 0 2024-05-09T06:29:28.328 INFO:tasks.workunit.client.1.smithi079.stdout:9/247: truncate d1/d6/d7/d19/f55 889979 0 2024-05-09T06:29:28.328 INFO:tasks.workunit.client.1.smithi079.stdout:9/248: write d1/d33/f46 [757172,39645] 0 2024-05-09T06:29:28.330 INFO:tasks.workunit.client.1.smithi079.stdout:6/103: mkdir d0/d6/d16/d1f 0 2024-05-09T06:29:28.330 INFO:tasks.workunit.client.1.smithi079.stdout:6/104: dread - d0/de/f1e zero size 2024-05-09T06:29:28.335 INFO:tasks.workunit.client.1.smithi079.stdout:4/214: dwrite d6/d8/d27/f42 [0,4194304] 0 2024-05-09T06:29:28.338 INFO:tasks.workunit.client.1.smithi079.stdout:1/87: mkdir d0/d7/d11/d20 0 2024-05-09T06:29:28.341 INFO:tasks.workunit.client.1.smithi079.stdout:0/115: creat d3/dd/d1f/f29 x:0 0 0 2024-05-09T06:29:28.344 INFO:tasks.workunit.client.1.smithi079.stdout:8/84: mkdir d1/d3/d20 0 2024-05-09T06:29:28.344 INFO:tasks.workunit.client.1.smithi079.stdout:0/116: dread d3/d5/fe [0,4194304] 0 2024-05-09T06:29:28.345 INFO:tasks.workunit.client.1.smithi079.stdout:9/249: dwrite d1/d6/f1c [0,4194304] 0 2024-05-09T06:29:28.346 INFO:tasks.workunit.client.1.smithi079.stdout:7/183: truncate d4/f14 90695 0 2024-05-09T06:29:28.352 INFO:tasks.workunit.client.1.smithi079.stdout:3/68: mknod c12 0 2024-05-09T06:29:28.355 INFO:tasks.workunit.client.1.smithi079.stdout:1/88: dwrite d0/d7/d11/f15 [0,4194304] 0 2024-05-09T06:29:28.357 INFO:tasks.workunit.client.1.smithi079.stdout:0/117: creat d3/dd/d1f/d1e/f2a x:0 0 0 2024-05-09T06:29:28.361 INFO:tasks.workunit.client.1.smithi079.stdout:4/215: dwrite d6/dd/df/f21 [0,4194304] 0 2024-05-09T06:29:28.361 INFO:tasks.workunit.client.1.smithi079.stdout:9/250: rename d1/d33/d48/l4b to d1/d33/d28/d36/d38/l5a 0 2024-05-09T06:29:28.364 INFO:tasks.workunit.client.1.smithi079.stdout:3/69: creat f13 x:0 0 0 2024-05-09T06:29:28.371 INFO:tasks.workunit.client.1.smithi079.stdout:1/89: getdents d0/d12/d16 0 2024-05-09T06:29:28.374 INFO:tasks.workunit.client.1.smithi079.stdout:7/184: dwrite d4/d7/f1d [0,4194304] 0 2024-05-09T06:29:28.374 INFO:tasks.workunit.client.1.smithi079.stdout:8/85: link d1/d5/dc/c15 d1/d3/c21 0 2024-05-09T06:29:28.374 INFO:tasks.workunit.client.1.smithi079.stdout:0/118: dwrite d3/dd/d1f/fa [4194304,4194304] 0 2024-05-09T06:29:28.380 INFO:tasks.workunit.client.1.smithi079.stdout:4/216: link d6/c22 d6/d8/d27/d3d/c43 0 2024-05-09T06:29:28.381 INFO:tasks.workunit.client.1.smithi079.stdout:4/217: write d6/d1a/d26/f30 [641958,86445] 0 2024-05-09T06:29:28.382 INFO:tasks.workunit.client.1.smithi079.stdout:9/251: mkdir d1/d5/d5b 0 2024-05-09T06:29:28.383 INFO:tasks.workunit.client.1.smithi079.stdout:6/105: getdents d0 0 2024-05-09T06:29:28.384 INFO:tasks.workunit.client.1.smithi079.stdout:3/70: creat f14 x:0 0 0 2024-05-09T06:29:28.384 INFO:tasks.workunit.client.1.smithi079.stdout:3/71: stat f13 0 2024-05-09T06:29:28.385 INFO:tasks.workunit.client.1.smithi079.stdout:1/90: truncate d0/d7/f9 2907643 0 2024-05-09T06:29:28.389 INFO:tasks.workunit.client.1.smithi079.stdout:4/218: write d6/d8/d27/f42 [2654682,38160] 0 2024-05-09T06:29:28.390 INFO:tasks.workunit.client.1.smithi079.stdout:7/185: symlink d4/d30/l36 0 2024-05-09T06:29:28.392 INFO:tasks.workunit.client.1.smithi079.stdout:8/86: mkdir d1/d3/d20/d22 0 2024-05-09T06:29:28.394 INFO:tasks.workunit.client.1.smithi079.stdout:0/119: getdents d3 0 2024-05-09T06:29:28.394 INFO:tasks.workunit.client.1.smithi079.stdout:2/143: sync 2024-05-09T06:29:28.394 INFO:tasks.workunit.client.1.smithi079.stdout:5/141: sync 2024-05-09T06:29:28.394 INFO:tasks.workunit.client.1.smithi079.stdout:2/144: chown d8/db/d11/l15 65102 1 2024-05-09T06:29:28.394 INFO:tasks.workunit.client.1.smithi079.stdout:2/145: creat d8/db/d11/f30 x:0 0 0 2024-05-09T06:29:28.397 INFO:tasks.workunit.client.1.smithi079.stdout:9/252: symlink d1/d33/d28/d4c/d4e/d2d/l5c 0 2024-05-09T06:29:28.399 INFO:tasks.workunit.client.1.smithi079.stdout:6/106: mkdir d0/d6/d1b/d20 0 2024-05-09T06:29:28.399 INFO:tasks.workunit.client.1.smithi079.stdout:6/107: dread - d0/de/f1c zero size 2024-05-09T06:29:28.399 INFO:tasks.workunit.client.1.smithi079.stdout:6/108: stat d0/f15 0 2024-05-09T06:29:28.403 INFO:tasks.workunit.client.1.smithi079.stdout:4/219: symlink d6/d8/d27/l44 0 2024-05-09T06:29:28.403 INFO:tasks.workunit.client.1.smithi079.stdout:4/220: creat d6/d8/d9/f45 x:0 0 0 2024-05-09T06:29:28.405 INFO:tasks.workunit.client.1.smithi079.stdout:8/87: write d1/d5/f11 [2922641,62733] 0 2024-05-09T06:29:28.405 INFO:tasks.workunit.client.1.smithi079.stdout:8/88: write d1/d5/dc/f1d [1043742,71030] 0 2024-05-09T06:29:28.406 INFO:tasks.workunit.client.1.smithi079.stdout:8/89: stat d1/d3/l16 0 2024-05-09T06:29:28.407 INFO:tasks.workunit.client.1.smithi079.stdout:0/120: write d3/dd/d1f/f13 [2972583,119474] 0 2024-05-09T06:29:28.407 INFO:tasks.workunit.client.1.smithi079.stdout:0/121: chown d3/dd/d18 651568364 1 2024-05-09T06:29:28.407 INFO:tasks.workunit.client.1.smithi079.stdout:0/122: read d3/dd/d1f/f13 [588692,70375] 0 2024-05-09T06:29:28.407 INFO:tasks.workunit.client.1.smithi079.stdout:0/123: fsync d3/d5/d27/f24 0 2024-05-09T06:29:28.408 INFO:tasks.workunit.client.1.smithi079.stdout:0/124: read d3/d5/d27/f24 [99054,73914] 0 2024-05-09T06:29:28.408 INFO:tasks.workunit.client.1.smithi079.stdout:0/125: chown d3 0 1 2024-05-09T06:29:28.411 INFO:tasks.workunit.client.1.smithi079.stdout:2/146: creat d8/db/dc/d2c/f31 x:0 0 0 2024-05-09T06:29:28.411 INFO:tasks.workunit.client.1.smithi079.stdout:2/147: write d8/f9 [4448572,87339] 0 2024-05-09T06:29:28.413 INFO:tasks.workunit.client.1.smithi079.stdout:6/109: mknod d0/de/c21 0 2024-05-09T06:29:28.417 INFO:tasks.workunit.client.1.smithi079.stdout:1/91: dwrite d0/d12/f1a [0,4194304] 0 2024-05-09T06:29:28.419 INFO:tasks.workunit.client.1.smithi079.stdout:5/142: dwrite d13/f18 [0,4194304] 0 2024-05-09T06:29:28.419 INFO:tasks.workunit.client.1.smithi079.stdout:5/143: dread - d13/f21 zero size 2024-05-09T06:29:28.419 INFO:tasks.workunit.client.1.smithi079.stdout:9/253: dwrite d1/d33/d28/d4c/d4e/f54 [0,4194304] 0 2024-05-09T06:29:28.420 INFO:tasks.workunit.client.1.smithi079.stdout:7/186: getdents d4/d7/dd 0 2024-05-09T06:29:28.425 INFO:tasks.workunit.client.1.smithi079.stdout:8/90: link d1/db/ce d1/d3/d20/d22/c23 0 2024-05-09T06:29:28.427 INFO:tasks.workunit.client.1.smithi079.stdout:2/148: mknod d8/db/d11/c32 0 2024-05-09T06:29:28.429 INFO:tasks.workunit.client.1.smithi079.stdout:7/187: dread d4/d7/dd/f16 [0,4194304] 0 2024-05-09T06:29:28.432 INFO:tasks.workunit.client.1.smithi079.stdout:6/110: creat d0/d6/d16/d1f/f22 x:0 0 0 2024-05-09T06:29:28.433 INFO:tasks.workunit.client.1.smithi079.stdout:2/149: dread f3 [4194304,4194304] 0 2024-05-09T06:29:28.437 INFO:tasks.workunit.client.1.smithi079.stdout:7/188: dread d4/d7/dd/f24 [0,4194304] 0 2024-05-09T06:29:28.438 INFO:tasks.workunit.client.1.smithi079.stdout:7/189: stat d4/d7/d22 0 2024-05-09T06:29:28.438 INFO:tasks.workunit.client.1.smithi079.stdout:7/190: write d4/d30/d31/f33 [771746,79184] 0 2024-05-09T06:29:28.438 INFO:tasks.workunit.client.1.smithi079.stdout:7/191: truncate d4/d7/f25 4895775 0 2024-05-09T06:29:28.438 INFO:tasks.workunit.client.1.smithi079.stdout:7/192: readlink d4/d20/l2c 0 2024-05-09T06:29:28.439 INFO:tasks.workunit.client.1.smithi079.stdout:4/221: getdents d6/d15 0 2024-05-09T06:29:28.439 INFO:tasks.workunit.client.1.smithi079.stdout:4/222: fdatasync d6/d8/d9/f17 0 2024-05-09T06:29:28.442 INFO:tasks.workunit.client.1.smithi079.stdout:6/111: dread d0/d6/f14 [0,4194304] 0 2024-05-09T06:29:28.445 INFO:tasks.workunit.client.1.smithi079.stdout:5/144: mkdir d13/d1b/d26/d35 0 2024-05-09T06:29:28.445 INFO:tasks.workunit.client.1.smithi079.stdout:5/145: write d13/d1b/f20 [802446,17385] 0 2024-05-09T06:29:28.446 INFO:tasks.workunit.client.1.smithi079.stdout:5/146: creat d13/d1b/f36 x:0 0 0 2024-05-09T06:29:28.446 INFO:tasks.workunit.client.1.smithi079.stdout:5/147: creat d13/f37 x:0 0 0 2024-05-09T06:29:28.451 INFO:tasks.workunit.client.1.smithi079.stdout:1/92: dread d0/d7/f9 [0,4194304] 0 2024-05-09T06:29:28.455 INFO:tasks.workunit.client.1.smithi079.stdout:2/150: dwrite d8/db/d11/f24 [0,4194304] 0 2024-05-09T06:29:28.455 INFO:tasks.workunit.client.1.smithi079.stdout:2/151: creat d8/db/dc/d2c/f33 x:0 0 0 2024-05-09T06:29:28.458 INFO:tasks.workunit.client.1.smithi079.stdout:9/254: rename d1/d33/d28/l50 to d1/d33/d28/d4c/l5d 0 2024-05-09T06:29:28.460 INFO:tasks.workunit.client.1.smithi079.stdout:6/112: dwrite d0/f12 [0,4194304] 0 2024-05-09T06:29:28.461 INFO:tasks.workunit.client.1.smithi079.stdout:8/91: mknod d1/db/c24 0 2024-05-09T06:29:28.464 INFO:tasks.workunit.client.1.smithi079.stdout:4/223: link d6/d1a/f1c d6/d8/d27/f46 0 2024-05-09T06:29:28.464 INFO:tasks.workunit.client.1.smithi079.stdout:4/224: readlink d6/d8/d27/l44 0 2024-05-09T06:29:28.469 INFO:tasks.workunit.client.1.smithi079.stdout:1/93: mkdir d0/d7/d11/d20/d21 0 2024-05-09T06:29:28.473 INFO:tasks.workunit.client.1.smithi079.stdout:3/72: truncate fe 528207 0 2024-05-09T06:29:28.474 INFO:tasks.workunit.client.1.smithi079.stdout:3/73: dread fb [0,4194304] 0 2024-05-09T06:29:28.480 INFO:tasks.workunit.client.1.smithi079.stdout:2/152: creat d8/db/dc/f34 x:0 0 0 2024-05-09T06:29:28.482 INFO:tasks.workunit.client.1.smithi079.stdout:9/255: rename d1/d33/d28/d4c/d4e/fc to d1/d5/d5b/f5e 0 2024-05-09T06:29:28.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/153: dread f5 [0,4194304] 0 2024-05-09T06:29:28.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/154: creat d8/db/d11/f35 x:0 0 0 2024-05-09T06:29:28.489 INFO:tasks.workunit.client.1.smithi079.stdout:6/113: unlink d0/l7 0 2024-05-09T06:29:28.489 INFO:tasks.workunit.client.1.smithi079.stdout:6/114: creat d0/d6/d16/d1f/f23 x:0 0 0 2024-05-09T06:29:28.489 INFO:tasks.workunit.client.1.smithi079.stdout:6/115: chown d0/d6/c17 49673336 1 2024-05-09T06:29:28.491 INFO:tasks.workunit.client.1.smithi079.stdout:8/92: mknod d1/d5/dc/c25 0 2024-05-09T06:29:28.493 INFO:tasks.workunit.client.1.smithi079.stdout:7/193: getdents d4/d7 0 2024-05-09T06:29:28.493 INFO:tasks.workunit.client.1.smithi079.stdout:7/194: stat d4/d30/d32/f35 0 2024-05-09T06:29:28.494 INFO:tasks.workunit.client.1.smithi079.stdout:7/195: dread d4/f14 [0,4194304] 0 2024-05-09T06:29:28.498 INFO:tasks.workunit.client.1.smithi079.stdout:9/256: dwrite d1/d5/f21 [0,4194304] 0 2024-05-09T06:29:28.498 INFO:tasks.workunit.client.1.smithi079.stdout:1/94: truncate d0/f5 121221 0 2024-05-09T06:29:28.500 INFO:tasks.workunit.client.1.smithi079.stdout:3/74: creat f15 x:0 0 0 2024-05-09T06:29:28.500 INFO:tasks.workunit.client.1.smithi079.stdout:1/95: dread d0/f3 [0,4194304] 0 2024-05-09T06:29:28.507 INFO:tasks.workunit.client.1.smithi079.stdout:7/196: dread d4/d7/f1d [0,4194304] 0 2024-05-09T06:29:28.508 INFO:tasks.workunit.client.1.smithi079.stdout:9/257: read d1/d6/d7/d19/f1f [3533759,122255] 0 2024-05-09T06:29:28.515 INFO:tasks.workunit.client.1.smithi079.stdout:1/96: dwrite d0/d12/d16/f19 [0,4194304] 0 2024-05-09T06:29:28.516 INFO:tasks.workunit.client.1.smithi079.stdout:2/155: rename d8/db/f1b to d8/db/dc/d2c/d2d/f36 0 2024-05-09T06:29:28.519 INFO:tasks.workunit.client.1.smithi079.stdout:8/93: truncate d1/d3/f6 4694610 0 2024-05-09T06:29:28.521 INFO:tasks.workunit.client.1.smithi079.stdout:4/225: getdents d6/d8/d9 0 2024-05-09T06:29:28.522 INFO:tasks.workunit.client.1.smithi079.stdout:3/75: creat f16 x:0 0 0 2024-05-09T06:29:28.522 INFO:tasks.workunit.client.1.smithi079.stdout:3/76: truncate f14 848672 0 2024-05-09T06:29:28.523 INFO:tasks.workunit.client.1.smithi079.stdout:7/197: mkdir d4/d7/d37 0 2024-05-09T06:29:28.524 INFO:tasks.workunit.client.1.smithi079.stdout:7/198: chown d4/d7/d22/f2a 110273810 1 2024-05-09T06:29:28.525 INFO:tasks.workunit.client.1.smithi079.stdout:9/258: rmdir d1 39 2024-05-09T06:29:28.525 INFO:tasks.workunit.client.1.smithi079.stdout:9/259: write d1/d33/d2b/f53 [876106,89673] 0 2024-05-09T06:29:28.531 INFO:tasks.workunit.client.1.smithi079.stdout:1/97: rmdir d0/d12/d16 39 2024-05-09T06:29:28.535 INFO:tasks.workunit.client.1.smithi079.stdout:6/116: rename d0/de/l18 to d0/d6/d16/l24 0 2024-05-09T06:29:28.537 INFO:tasks.workunit.client.1.smithi079.stdout:2/156: mknod d8/db/d11/c37 0 2024-05-09T06:29:28.541 INFO:tasks.workunit.client.1.smithi079.stdout:3/77: creat f17 x:0 0 0 2024-05-09T06:29:28.542 INFO:tasks.workunit.client.1.smithi079.stdout:3/78: dread - ff zero size 2024-05-09T06:29:28.544 INFO:tasks.workunit.client.1.smithi079.stdout:6/117: dread d0/f5 [0,4194304] 0 2024-05-09T06:29:28.544 INFO:tasks.workunit.client.1.smithi079.stdout:8/94: dwrite d1/f1a [0,4194304] 0 2024-05-09T06:29:28.544 INFO:tasks.workunit.client.1.smithi079.stdout:6/118: fsync d0/f12 0 2024-05-09T06:29:28.544 INFO:tasks.workunit.client.1.smithi079.stdout:6/119: chown d0/d6/cd 221 1 2024-05-09T06:29:28.544 INFO:tasks.workunit.client.1.smithi079.stdout:9/260: creat d1/d33/d28/d4c/f5f x:0 0 0 2024-05-09T06:29:28.545 INFO:tasks.workunit.client.1.smithi079.stdout:7/199: dwrite d4/d7/f1d [0,4194304] 0 2024-05-09T06:29:28.549 INFO:tasks.workunit.client.1.smithi079.stdout:4/226: mknod d6/c47 0 2024-05-09T06:29:28.551 INFO:tasks.workunit.client.1.smithi079.stdout:3/79: truncate f5 998148 0 2024-05-09T06:29:28.553 INFO:tasks.workunit.client.1.smithi079.stdout:9/261: write d1/d33/d28/d4c/d4e/f54 [3272850,128844] 0 2024-05-09T06:29:28.562 INFO:tasks.workunit.client.1.smithi079.stdout:8/95: dwrite d1/f1f [0,4194304] 0 2024-05-09T06:29:28.562 INFO:tasks.workunit.client.1.smithi079.stdout:2/157: dwrite d8/db/f12 [0,4194304] 0 2024-05-09T06:29:28.563 INFO:tasks.workunit.client.1.smithi079.stdout:7/200: mknod d4/d30/c38 0 2024-05-09T06:29:28.564 INFO:tasks.workunit.client.1.smithi079.stdout:1/98: getdents d0/d7 0 2024-05-09T06:29:28.567 INFO:tasks.workunit.client.1.smithi079.stdout:4/227: rmdir d6/d8/d27/d3d 39 2024-05-09T06:29:28.567 INFO:tasks.workunit.client.1.smithi079.stdout:4/228: creat d6/dd/f48 x:0 0 0 2024-05-09T06:29:28.571 INFO:tasks.workunit.client.1.smithi079.stdout:1/99: dread d0/df/f14 [0,4194304] 0 2024-05-09T06:29:28.572 INFO:tasks.workunit.client.1.smithi079.stdout:1/100: dread d0/f5 [0,4194304] 0 2024-05-09T06:29:28.573 INFO:tasks.workunit.client.1.smithi079.stdout:1/101: chown d0/d12/d16 341 1 2024-05-09T06:29:28.573 INFO:tasks.workunit.client.1.smithi079.stdout:1/102: write d0/d7/fc [3886430,19199] 0 2024-05-09T06:29:28.573 INFO:tasks.workunit.client.1.smithi079.stdout:1/103: stat d0/d12/c1d 0 2024-05-09T06:29:28.581 INFO:tasks.workunit.client.1.smithi079.stdout:9/262: dwrite d1/d6/f20 [0,4194304] 0 2024-05-09T06:29:28.581 INFO:tasks.workunit.client.1.smithi079.stdout:4/229: write d6/d15/f31 [4110018,108140] 0 2024-05-09T06:29:28.581 INFO:tasks.workunit.client.1.smithi079.stdout:9/263: read d1/d6/d7/f31 [51111,12262] 0 2024-05-09T06:29:28.583 INFO:tasks.workunit.client.1.smithi079.stdout:2/158: symlink d8/l38 0 2024-05-09T06:29:28.585 INFO:tasks.workunit.client.1.smithi079.stdout:7/201: symlink d4/d30/l39 0 2024-05-09T06:29:28.586 INFO:tasks.workunit.client.1.smithi079.stdout:8/96: dwrite d1/d5/f11 [0,4194304] 0 2024-05-09T06:29:28.591 INFO:tasks.workunit.client.1.smithi079.stdout:1/104: mkdir d0/d7/d22 0 2024-05-09T06:29:28.591 INFO:tasks.workunit.client.1.smithi079.stdout:1/105: write d0/d12/d16/f19 [4706448,21504] 0 2024-05-09T06:29:28.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:28 smithi079 ceph-mon[35268]: pgmap v243: 65 pgs: 65 active+clean; 327 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.1 MiB/s rd, 18 MiB/s wr, 405 op/s 2024-05-09T06:29:28.593 INFO:tasks.workunit.client.1.smithi079.stdout:6/120: getdents d0/d6/d16 0 2024-05-09T06:29:28.595 INFO:tasks.workunit.client.1.smithi079.stdout:9/264: dwrite d1/d6/f18 [0,4194304] 0 2024-05-09T06:29:28.601 INFO:tasks.workunit.client.1.smithi079.stdout:4/230: creat d6/d8/f49 x:0 0 0 2024-05-09T06:29:28.601 INFO:tasks.workunit.client.1.smithi079.stdout:4/231: creat d6/d8/d32/f4a x:0 0 0 2024-05-09T06:29:28.601 INFO:tasks.workunit.client.1.smithi079.stdout:4/232: readlink d6/dd/l37 0 2024-05-09T06:29:28.601 INFO:tasks.workunit.client.1.smithi079.stdout:4/233: write d6/d8/d27/f42 [2864536,26828] 0 2024-05-09T06:29:28.603 INFO:tasks.workunit.client.1.smithi079.stdout:2/159: mknod d8/db/c39 0 2024-05-09T06:29:28.605 INFO:tasks.workunit.client.1.smithi079.stdout:7/202: truncate d4/d7/dd/f24 755214 0 2024-05-09T06:29:28.608 INFO:tasks.workunit.client.1.smithi079.stdout:8/97: rmdir d1/d3/d20/d22 39 2024-05-09T06:29:28.612 INFO:tasks.workunit.client.1.smithi079.stdout:1/106: unlink d0/f2 0 2024-05-09T06:29:28.613 INFO:tasks.workunit.client.1.smithi079.stdout:2/160: write d8/db/d11/f2f [105923,108272] 0 2024-05-09T06:29:28.614 INFO:tasks.workunit.client.1.smithi079.stdout:6/121: rmdir d0/d6/d16 39 2024-05-09T06:29:28.615 INFO:tasks.workunit.client.1.smithi079.stdout:6/122: read - d0/de/f1e zero size 2024-05-09T06:29:28.615 INFO:tasks.workunit.client.1.smithi079.stdout:6/123: creat d0/d6/d16/d1f/f25 x:0 0 0 2024-05-09T06:29:28.615 INFO:tasks.workunit.client.1.smithi079.stdout:6/124: readlink d0/l1d 0 2024-05-09T06:29:28.615 INFO:tasks.workunit.client.1.smithi079.stdout:6/125: write d0/d6/d16/d1f/f23 [416856,54140] 0 2024-05-09T06:29:28.619 INFO:tasks.workunit.client.1.smithi079.stdout:9/265: creat d1/d45/f60 x:0 0 0 2024-05-09T06:29:28.622 INFO:tasks.workunit.client.1.smithi079.stdout:4/234: mknod d6/d1a/c4b 0 2024-05-09T06:29:28.623 INFO:tasks.workunit.client.1.smithi079.stdout:4/235: read d6/dd/f2f [742871,13307] 0 2024-05-09T06:29:28.624 INFO:tasks.workunit.client.1.smithi079.stdout:8/98: unlink d1/d3/f1c 0 2024-05-09T06:29:28.625 INFO:tasks.workunit.client.1.smithi079.stdout:8/99: fsync d1/d5/f11 0 2024-05-09T06:29:28.626 INFO:tasks.workunit.client.1.smithi079.stdout:2/161: mknod d8/db/dc/d2c/d2d/c3a 0 2024-05-09T06:29:28.626 INFO:tasks.workunit.client.1.smithi079.stdout:2/162: write f3 [5805611,16059] 0 2024-05-09T06:29:28.629 INFO:tasks.workunit.client.1.smithi079.stdout:6/126: creat d0/d6/d1b/f26 x:0 0 0 2024-05-09T06:29:28.629 INFO:tasks.workunit.client.1.smithi079.stdout:0/126: sync 2024-05-09T06:29:28.630 INFO:tasks.workunit.client.1.smithi079.stdout:7/203: dwrite d4/d7/f1b [0,4194304] 0 2024-05-09T06:29:28.631 INFO:tasks.workunit.client.1.smithi079.stdout:1/107: dwrite d0/d12/f1a [0,4194304] 0 2024-05-09T06:29:28.633 INFO:tasks.workunit.client.1.smithi079.stdout:8/100: truncate d1/f1f 85420 0 2024-05-09T06:29:28.633 INFO:tasks.workunit.client.1.smithi079.stdout:8/101: chown d1/d5/dc 166121032 1 2024-05-09T06:29:28.633 INFO:tasks.workunit.client.1.smithi079.stdout:8/102: chown d1/d5/dc/c15 1 1 2024-05-09T06:29:28.633 INFO:tasks.workunit.client.1.smithi079.stdout:1/108: fsync d0/d7/f9 0 2024-05-09T06:29:28.635 INFO:tasks.workunit.client.1.smithi079.stdout:2/163: mknod d8/db/c3b 0 2024-05-09T06:29:28.637 INFO:tasks.workunit.client.1.smithi079.stdout:6/127: rename d0/d6/d16/d1f/f22 to d0/d6/d16/d1f/f27 0 2024-05-09T06:29:28.639 INFO:tasks.workunit.client.1.smithi079.stdout:0/127: creat d3/d5/f2b x:0 0 0 2024-05-09T06:29:28.639 INFO:tasks.workunit.client.1.smithi079.stdout:0/128: dread - d3/dd/d1f/f29 zero size 2024-05-09T06:29:28.639 INFO:tasks.workunit.client.1.smithi079.stdout:0/129: read d3/dd/d1f/f13 [3546192,59101] 0 2024-05-09T06:29:28.639 INFO:tasks.workunit.client.1.smithi079.stdout:0/130: read - d3/d5/f2b zero size 2024-05-09T06:29:28.640 INFO:tasks.workunit.client.1.smithi079.stdout:7/204: truncate d4/d7/f25 130329 0 2024-05-09T06:29:28.640 INFO:tasks.workunit.client.1.smithi079.stdout:7/205: getdents d4/d7/d37 0 2024-05-09T06:29:28.642 INFO:tasks.workunit.client.1.smithi079.stdout:9/266: truncate d1/d6/f20 2719850 0 2024-05-09T06:29:28.644 INFO:tasks.workunit.client.1.smithi079.stdout:4/236: rename d6/d8/d9/l3c to d6/l4c 0 2024-05-09T06:29:28.644 INFO:tasks.workunit.client.1.smithi079.stdout:4/237: chown d6/dd/l2c 7996 1 2024-05-09T06:29:28.654 INFO:tasks.workunit.client.1.smithi079.stdout:1/109: symlink d0/l23 0 2024-05-09T06:29:28.655 INFO:tasks.workunit.client.1.smithi079.stdout:7/206: dwrite d4/d7/d22/f2a [0,4194304] 0 2024-05-09T06:29:28.656 INFO:tasks.workunit.client.1.smithi079.stdout:2/164: mkdir d8/d3c 0 2024-05-09T06:29:28.658 INFO:tasks.workunit.client.1.smithi079.stdout:6/128: truncate d0/f12 3624723 0 2024-05-09T06:29:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:28 smithi062 ceph-mon[26920]: pgmap v243: 65 pgs: 65 active+clean; 327 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.1 MiB/s rd, 18 MiB/s wr, 405 op/s 2024-05-09T06:29:28.662 INFO:tasks.workunit.client.1.smithi079.stdout:2/165: dread d8/f9 [0,4194304] 0 2024-05-09T06:29:28.662 INFO:tasks.workunit.client.1.smithi079.stdout:2/166: creat d8/db/d11/f3d x:0 0 0 2024-05-09T06:29:28.665 INFO:tasks.workunit.client.1.smithi079.stdout:4/238: unlink d6/d15/l25 0 2024-05-09T06:29:28.665 INFO:tasks.workunit.client.1.smithi079.stdout:4/239: write d6/d8/d27/f46 [4631390,43530] 0 2024-05-09T06:29:28.671 INFO:tasks.workunit.client.1.smithi079.stdout:7/207: creat d4/d30/f3a x:0 0 0 2024-05-09T06:29:28.674 INFO:tasks.workunit.client.1.smithi079.stdout:6/129: mkdir d0/d6/d16/d28 0 2024-05-09T06:29:28.674 INFO:tasks.workunit.client.1.smithi079.stdout:6/130: creat d0/d6/f29 x:0 0 0 2024-05-09T06:29:28.674 INFO:tasks.workunit.client.1.smithi079.stdout:6/131: chown d0/d6/c9 691563062 1 2024-05-09T06:29:28.675 INFO:tasks.workunit.client.1.smithi079.stdout:6/132: stat d0/d6/d16/d1f/f25 0 2024-05-09T06:29:28.675 INFO:tasks.workunit.client.1.smithi079.stdout:6/133: fsync d0/fc 0 2024-05-09T06:29:28.676 INFO:tasks.workunit.client.1.smithi079.stdout:0/131: getdents d3/dd/d1f/d1e 0 2024-05-09T06:29:28.680 INFO:tasks.workunit.client.1.smithi079.stdout:8/103: rename d1/d3/c10 to d1/d3/d20/d22/c26 0 2024-05-09T06:29:28.680 INFO:tasks.workunit.client.1.smithi079.stdout:8/104: write d1/d3/f14 [109748,124346] 0 2024-05-09T06:29:28.680 INFO:tasks.workunit.client.1.smithi079.stdout:8/105: fdatasync d1/d3/f17 0 2024-05-09T06:29:28.684 INFO:tasks.workunit.client.1.smithi079.stdout:2/167: creat d8/db/dc/d2c/d2e/f3e x:0 0 0 2024-05-09T06:29:28.687 INFO:tasks.workunit.client.1.smithi079.stdout:4/240: unlink d6/d8/d27/f29 0 2024-05-09T06:29:28.691 INFO:tasks.workunit.client.1.smithi079.stdout:4/241: fsync d6/d15/f31 0 2024-05-09T06:29:28.693 INFO:tasks.workunit.client.1.smithi079.stdout:6/134: mknod d0/d6/d16/d1f/c2a 0 2024-05-09T06:29:28.696 INFO:tasks.workunit.client.1.smithi079.stdout:0/132: unlink d3/d5/d27/f11 0 2024-05-09T06:29:28.696 INFO:tasks.workunit.client.1.smithi079.stdout:0/133: chown d3/dd/d18/c1b 0 1 2024-05-09T06:29:28.699 INFO:tasks.workunit.client.1.smithi079.stdout:9/267: rename d1/d5/c2f to d1/d33/d28/d36/d4d/d51/c61 0 2024-05-09T06:29:28.702 INFO:tasks.workunit.client.1.smithi079.stdout:8/106: creat d1/db/f27 x:0 0 0 2024-05-09T06:29:28.702 INFO:tasks.workunit.client.1.smithi079.stdout:8/107: dread - d1/d3/f17 zero size 2024-05-09T06:29:28.704 INFO:tasks.workunit.client.1.smithi079.stdout:4/242: mknod d6/d8/c4d 0 2024-05-09T06:29:28.704 INFO:tasks.workunit.client.1.smithi079.stdout:4/243: write d6/d1a/d26/f30 [879731,105399] 0 2024-05-09T06:29:28.704 INFO:tasks.workunit.client.1.smithi079.stdout:4/244: stat d6/d1a/d26/f30 0 2024-05-09T06:29:28.706 INFO:tasks.workunit.client.1.smithi079.stdout:0/134: truncate d3/dd/d1f/f13 1534322 0 2024-05-09T06:29:28.710 INFO:tasks.workunit.client.1.smithi079.stdout:1/110: rename d0/f3 to d0/df/f24 0 2024-05-09T06:29:28.713 INFO:tasks.workunit.client.1.smithi079.stdout:9/268: symlink d1/d5/d5b/l62 0 2024-05-09T06:29:28.714 INFO:tasks.workunit.client.1.smithi079.stdout:8/108: truncate d1/d3/ff 1305841 0 2024-05-09T06:29:28.714 INFO:tasks.workunit.client.1.smithi079.stdout:8/109: dread - d1/d3/f17 zero size 2024-05-09T06:29:28.717 INFO:tasks.workunit.client.1.smithi079.stdout:4/245: link d6/dd/f1b d6/dd/f4e 0 2024-05-09T06:29:28.717 INFO:tasks.workunit.client.1.smithi079.stdout:4/246: truncate d6/d1a/d26/d2a/f2d 197094 0 2024-05-09T06:29:28.717 INFO:tasks.workunit.client.1.smithi079.stdout:4/247: write d6/d1a/d26/f30 [185026,50992] 0 2024-05-09T06:29:28.717 INFO:tasks.workunit.client.1.smithi079.stdout:4/248: readlink d6/dd/d34/l3a 0 2024-05-09T06:29:28.717 INFO:tasks.workunit.client.1.smithi079.stdout:4/249: chown d6/d8/d32 396715603 1 2024-05-09T06:29:28.718 INFO:tasks.workunit.client.1.smithi079.stdout:4/250: write d6/d8/d32/f4a [1048210,81716] 0 2024-05-09T06:29:28.719 INFO:tasks.workunit.client.1.smithi079.stdout:2/168: dwrite d8/db/d11/f24 [0,4194304] 0 2024-05-09T06:29:28.719 INFO:tasks.workunit.client.1.smithi079.stdout:6/135: dwrite d0/de/f1c [0,4194304] 0 2024-05-09T06:29:28.719 INFO:tasks.workunit.client.1.smithi079.stdout:2/169: dread - d8/db/dc/d2c/d2e/f3e zero size 2024-05-09T06:29:28.719 INFO:tasks.workunit.client.1.smithi079.stdout:2/170: write d8/db/d11/f30 [711657,125140] 0 2024-05-09T06:29:28.719 INFO:tasks.workunit.client.1.smithi079.stdout:7/208: dwrite d4/d7/f25 [0,4194304] 0 2024-05-09T06:29:28.719 INFO:tasks.workunit.client.1.smithi079.stdout:7/209: chown d4/d7/d22/l2d 101486 1 2024-05-09T06:29:28.719 INFO:tasks.workunit.client.1.smithi079.stdout:7/210: creat d4/d30/d32/f3b x:0 0 0 2024-05-09T06:29:28.720 INFO:tasks.workunit.client.1.smithi079.stdout:5/148: sync 2024-05-09T06:29:28.721 INFO:tasks.workunit.client.1.smithi079.stdout:6/136: dread d0/d6/f14 [4194304,4194304] 0 2024-05-09T06:29:28.721 INFO:tasks.workunit.client.1.smithi079.stdout:9/269: unlink d1/d33/f46 0 2024-05-09T06:29:28.724 INFO:tasks.workunit.client.1.smithi079.stdout:3/80: sync 2024-05-09T06:29:28.725 INFO:tasks.workunit.client.1.smithi079.stdout:6/137: dread d0/f5 [0,4194304] 0 2024-05-09T06:29:28.734 INFO:tasks.workunit.client.1.smithi079.stdout:2/171: link f5 d8/db/d11/f3f 0 2024-05-09T06:29:28.736 INFO:tasks.workunit.client.1.smithi079.stdout:9/270: dwrite d1/d6/f18 [0,4194304] 0 2024-05-09T06:29:28.739 INFO:tasks.workunit.client.1.smithi079.stdout:7/211: link d4/d7/d22/f2a d4/d30/d31/d34/f3c 0 2024-05-09T06:29:28.740 INFO:tasks.workunit.client.1.smithi079.stdout:5/149: truncate d13/f1e 3349039 0 2024-05-09T06:29:28.747 INFO:tasks.workunit.client.1.smithi079.stdout:8/110: rmdir d1/d3 39 2024-05-09T06:29:28.751 INFO:tasks.workunit.client.1.smithi079.stdout:6/138: creat d0/d6/d1b/d20/f2b x:0 0 0 2024-05-09T06:29:28.752 INFO:tasks.workunit.client.1.smithi079.stdout:4/251: getdents d6 0 2024-05-09T06:29:28.752 INFO:tasks.workunit.client.1.smithi079.stdout:7/212: dwrite d4/d7/dd/f1e [0,4194304] 0 2024-05-09T06:29:28.752 INFO:tasks.workunit.client.1.smithi079.stdout:7/213: stat d4/d7/d22/d28 0 2024-05-09T06:29:28.754 INFO:tasks.workunit.client.1.smithi079.stdout:2/172: rename d8/db/c3b to d8/db/dc/d2c/d2d/c40 0 2024-05-09T06:29:28.755 INFO:tasks.workunit.client.1.smithi079.stdout:2/173: dread - d8/db/d11/f3d zero size 2024-05-09T06:29:28.755 INFO:tasks.workunit.client.1.smithi079.stdout:2/174: fdatasync f3 0 2024-05-09T06:29:28.755 INFO:tasks.workunit.client.1.smithi079.stdout:2/175: write d8/f9 [5527266,118139] 0 2024-05-09T06:29:28.758 INFO:tasks.workunit.client.1.smithi079.stdout:9/271: symlink d1/d33/d28/d3e/l63 0 2024-05-09T06:29:28.764 INFO:tasks.workunit.client.1.smithi079.stdout:8/111: mknod d1/d5/c28 0 2024-05-09T06:29:28.767 INFO:tasks.workunit.client.1.smithi079.stdout:3/81: mknod c18 0 2024-05-09T06:29:28.774 INFO:tasks.workunit.client.1.smithi079.stdout:4/252: rename d6/dd/f1b to d6/d8/f4f 0 2024-05-09T06:29:28.776 INFO:tasks.workunit.client.1.smithi079.stdout:8/112: mkdir d1/d3/d20/d29 0 2024-05-09T06:29:28.782 INFO:tasks.workunit.client.1.smithi079.stdout:7/214: dwrite d4/d7/f18 [0,4194304] 0 2024-05-09T06:29:28.782 INFO:tasks.workunit.client.1.smithi079.stdout:7/215: chown d4/d30/d31/d34 18721255 1 2024-05-09T06:29:28.783 INFO:tasks.workunit.client.1.smithi079.stdout:7/216: chown d4/c29 3 1 2024-05-09T06:29:28.784 INFO:tasks.workunit.client.1.smithi079.stdout:9/272: dwrite d1/d45/f60 [0,4194304] 0 2024-05-09T06:29:28.787 INFO:tasks.workunit.client.1.smithi079.stdout:4/253: rename d6/d8/d27/f42 to d6/d8/f50 0 2024-05-09T06:29:28.787 INFO:tasks.workunit.client.1.smithi079.stdout:4/254: creat d6/d8/d32/f51 x:0 0 0 2024-05-09T06:29:28.789 INFO:tasks.workunit.client.1.smithi079.stdout:7/217: mknod d4/d7/dd/c3d 0 2024-05-09T06:29:28.794 INFO:tasks.workunit.client.1.smithi079.stdout:3/82: dwrite fb [0,4194304] 0 2024-05-09T06:29:28.794 INFO:tasks.workunit.client.1.smithi079.stdout:3/83: fsync f8 0 2024-05-09T06:29:28.795 INFO:tasks.workunit.client.1.smithi079.stdout:3/84: fdatasync f17 0 2024-05-09T06:29:28.795 INFO:tasks.workunit.client.1.smithi079.stdout:3/85: read - f16 zero size 2024-05-09T06:29:28.795 INFO:tasks.workunit.client.1.smithi079.stdout:3/86: dread - fd zero size 2024-05-09T06:29:28.795 INFO:tasks.workunit.client.1.smithi079.stdout:9/273: dread d1/d5/f10 [0,4194304] 0 2024-05-09T06:29:28.795 INFO:tasks.workunit.client.1.smithi079.stdout:2/176: dwrite d8/db/d11/f24 [0,4194304] 0 2024-05-09T06:29:28.795 INFO:tasks.workunit.client.1.smithi079.stdout:0/135: dwrite d3/d5/ff [0,4194304] 0 2024-05-09T06:29:28.795 INFO:tasks.workunit.client.1.smithi079.stdout:2/177: chown d8/db/c1e 179086 1 2024-05-09T06:29:28.795 INFO:tasks.workunit.client.1.smithi079.stdout:2/178: chown d8/db/dc/fd 415053516 1 2024-05-09T06:29:28.806 INFO:tasks.workunit.client.1.smithi079.stdout:3/87: creat f19 x:0 0 0 2024-05-09T06:29:28.806 INFO:tasks.workunit.client.1.smithi079.stdout:3/88: read - f13 zero size 2024-05-09T06:29:28.810 INFO:tasks.workunit.client.1.smithi079.stdout:8/113: truncate d1/d3/f14 143247 0 2024-05-09T06:29:28.810 INFO:tasks.workunit.client.1.smithi079.stdout:8/114: truncate d1/d3/fa 869433 0 2024-05-09T06:29:28.813 INFO:tasks.workunit.client.1.smithi079.stdout:9/274: mkdir d1/d33/d48/d64 0 2024-05-09T06:29:28.814 INFO:tasks.workunit.client.1.smithi079.stdout:9/275: read d1/d33/f37 [725244,23234] 0 2024-05-09T06:29:28.815 INFO:tasks.workunit.client.1.smithi079.stdout:3/89: truncate fc 198847 0 2024-05-09T06:29:28.815 INFO:tasks.workunit.client.1.smithi079.stdout:3/90: dread - f11 zero size 2024-05-09T06:29:28.815 INFO:tasks.workunit.client.1.smithi079.stdout:3/91: write fe [1028330,24794] 0 2024-05-09T06:29:28.815 INFO:tasks.workunit.client.1.smithi079.stdout:3/92: read - f17 zero size 2024-05-09T06:29:28.815 INFO:tasks.workunit.client.1.smithi079.stdout:3/93: chown f3 42 1 2024-05-09T06:29:28.816 INFO:tasks.workunit.client.1.smithi079.stdout:3/94: rmdir - no directory 2024-05-09T06:29:28.816 INFO:tasks.workunit.client.1.smithi079.stdout:3/95: chown f13 14071788 1 2024-05-09T06:29:28.816 INFO:tasks.workunit.client.1.smithi079.stdout:3/96: rmdir - no directory 2024-05-09T06:29:28.817 INFO:tasks.workunit.client.1.smithi079.stdout:8/115: symlink d1/l2a 0 2024-05-09T06:29:28.817 INFO:tasks.workunit.client.1.smithi079.stdout:8/116: fdatasync d1/f8 0 2024-05-09T06:29:28.817 INFO:tasks.workunit.client.1.smithi079.stdout:6/139: rmdir d0 39 2024-05-09T06:29:28.819 INFO:tasks.workunit.client.1.smithi079.stdout:9/276: creat d1/d33/f65 x:0 0 0 2024-05-09T06:29:28.819 INFO:tasks.workunit.client.1.smithi079.stdout:9/277: readlink d1/d33/l41 0 2024-05-09T06:29:28.826 INFO:tasks.workunit.client.1.smithi079.stdout:7/218: dwrite d4/d30/f3a [0,4194304] 0 2024-05-09T06:29:28.826 INFO:tasks.workunit.client.1.smithi079.stdout:4/255: dwrite d6/d1a/d26/f30 [0,4194304] 0 2024-05-09T06:29:28.826 INFO:tasks.workunit.client.1.smithi079.stdout:2/179: dwrite d8/db/dc/f1d [0,4194304] 0 2024-05-09T06:29:28.826 INFO:tasks.workunit.client.1.smithi079.stdout:8/117: mkdir d1/d5/dc/d2b 0 2024-05-09T06:29:28.827 INFO:tasks.workunit.client.1.smithi079.stdout:0/136: dwrite d3/dd/f1c [4194304,4194304] 0 2024-05-09T06:29:28.829 INFO:tasks.workunit.client.1.smithi079.stdout:6/140: symlink d0/d6/d1b/d20/l2c 0 2024-05-09T06:29:28.831 INFO:tasks.workunit.client.1.smithi079.stdout:3/97: mkdir d1a 0 2024-05-09T06:29:28.835 INFO:tasks.workunit.client.1.smithi079.stdout:5/150: write d13/f1e [2470986,15255] 0 2024-05-09T06:29:28.835 INFO:tasks.workunit.client.1.smithi079.stdout:5/151: dread - d13/d1b/f36 zero size 2024-05-09T06:29:28.835 INFO:tasks.workunit.client.1.smithi079.stdout:5/152: creat d13/d1b/f38 x:0 0 0 2024-05-09T06:29:28.835 INFO:tasks.workunit.client.1.smithi079.stdout:5/153: fsync d13/f1a 0 2024-05-09T06:29:28.836 INFO:tasks.workunit.client.1.smithi079.stdout:7/219: creat d4/d7/d22/d28/f3e x:0 0 0 2024-05-09T06:29:28.840 INFO:tasks.workunit.client.1.smithi079.stdout:4/256: creat d6/dd/d34/f52 x:0 0 0 2024-05-09T06:29:28.844 INFO:tasks.workunit.client.1.smithi079.stdout:2/180: link l4 d8/db/dc/d2c/d2d/l41 0 2024-05-09T06:29:28.846 INFO:tasks.workunit.client.1.smithi079.stdout:7/220: dread d4/d30/d31/d34/f3c [0,4194304] 0 2024-05-09T06:29:28.846 INFO:tasks.workunit.client.1.smithi079.stdout:7/221: stat d4/d7/dd/f24 0 2024-05-09T06:29:28.847 INFO:tasks.workunit.client.1.smithi079.stdout:8/118: mknod d1/d5/dc/c2c 0 2024-05-09T06:29:28.847 INFO:tasks.workunit.client.1.smithi079.stdout:8/119: stat d1/d18 0 2024-05-09T06:29:28.847 INFO:tasks.workunit.client.1.smithi079.stdout:9/278: dwrite d1/d33/d2b/f32 [0,4194304] 0 2024-05-09T06:29:28.850 INFO:tasks.workunit.client.1.smithi079.stdout:0/137: mkdir d3/dd/d1f/d1e/d2c 0 2024-05-09T06:29:28.851 INFO:tasks.workunit.client.1.smithi079.stdout:0/138: write d3/d5/f21 [324592,34626] 0 2024-05-09T06:29:28.852 INFO:tasks.workunit.client.1.smithi079.stdout:6/141: mkdir d0/d6/d1b/d2d 0 2024-05-09T06:29:28.855 INFO:tasks.workunit.client.1.smithi079.stdout:3/98: unlink ff 0 2024-05-09T06:29:28.858 INFO:tasks.workunit.client.1.smithi079.stdout:8/120: dread d1/f1a [0,4194304] 0 2024-05-09T06:29:28.861 INFO:tasks.workunit.client.1.smithi079.stdout:5/154: mkdir d13/d1b/d39 0 2024-05-09T06:29:28.861 INFO:tasks.workunit.client.1.smithi079.stdout:5/155: write d13/d1b/d26/f2e [240078,13227] 0 2024-05-09T06:29:28.861 INFO:tasks.workunit.client.1.smithi079.stdout:5/156: write d13/f1a [4851561,22924] 0 2024-05-09T06:29:28.864 INFO:tasks.workunit.client.1.smithi079.stdout:4/257: creat d6/d15/f53 x:0 0 0 2024-05-09T06:29:28.864 INFO:tasks.workunit.client.1.smithi079.stdout:4/258: dread - d6/d15/f53 zero size 2024-05-09T06:29:28.864 INFO:tasks.workunit.client.1.smithi079.stdout:4/259: readlink d6/dd/l16 0 2024-05-09T06:29:28.864 INFO:tasks.workunit.client.1.smithi079.stdout:4/260: truncate d6/f24 1365961 0 2024-05-09T06:29:28.869 INFO:tasks.workunit.client.1.smithi079.stdout:9/279: creat d1/d45/f66 x:0 0 0 2024-05-09T06:29:28.874 INFO:tasks.workunit.client.1.smithi079.stdout:0/139: mkdir d3/d5/d27/d2d 0 2024-05-09T06:29:28.875 INFO:tasks.workunit.client.1.smithi079.stdout:6/142: dwrite d0/d6/d16/d1f/f23 [0,4194304] 0 2024-05-09T06:29:28.878 INFO:tasks.workunit.client.1.smithi079.stdout:3/99: dwrite fd [0,4194304] 0 2024-05-09T06:29:28.882 INFO:tasks.workunit.client.1.smithi079.stdout:4/261: truncate d6/d8/d9/f17 1094477 0 2024-05-09T06:29:28.882 INFO:tasks.workunit.client.1.smithi079.stdout:4/262: fdatasync d6/d1a/f1c 0 2024-05-09T06:29:28.885 INFO:tasks.workunit.client.1.smithi079.stdout:8/121: dwrite d1/f1a [4194304,4194304] 0 2024-05-09T06:29:28.886 INFO:tasks.workunit.client.1.smithi079.stdout:8/122: dread d1/d3/f14 [0,4194304] 0 2024-05-09T06:29:28.888 INFO:tasks.workunit.client.1.smithi079.stdout:6/143: rmdir d0/de 39 2024-05-09T06:29:28.892 INFO:tasks.workunit.client.1.smithi079.stdout:3/100: creat d1a/f1b x:0 0 0 2024-05-09T06:29:28.894 INFO:tasks.workunit.client.1.smithi079.stdout:5/157: getdents d13 0 2024-05-09T06:29:28.898 INFO:tasks.workunit.client.1.smithi079.stdout:9/280: rmdir d1/d6/d7/d19 39 2024-05-09T06:29:28.899 INFO:tasks.workunit.client.1.smithi079.stdout:9/281: dread d1/d6/d7/f31 [0,4194304] 0 2024-05-09T06:29:28.899 INFO:tasks.workunit.client.1.smithi079.stdout:9/282: chown d1/d6/d7/d19/f55 1871046998 1 2024-05-09T06:29:28.906 INFO:tasks.workunit.client.1.smithi079.stdout:0/140: dwrite d3/dd/d1f/d1e/f2a [0,4194304] 0 2024-05-09T06:29:28.906 INFO:tasks.workunit.client.1.smithi079.stdout:6/144: dwrite d0/de/f1e [0,4194304] 0 2024-05-09T06:29:28.906 INFO:tasks.workunit.client.1.smithi079.stdout:6/145: chown d0/d6/d16/l24 174623 1 2024-05-09T06:29:28.908 INFO:tasks.workunit.client.1.smithi079.stdout:5/158: dread d13/d2a/f2b [0,4194304] 0 2024-05-09T06:29:28.908 INFO:tasks.workunit.client.1.smithi079.stdout:5/159: write fc [1661579,82882] 0 2024-05-09T06:29:28.910 INFO:tasks.workunit.client.1.smithi079.stdout:2/181: dwrite d8/db/dc/f1d [4194304,4194304] 0 2024-05-09T06:29:28.910 INFO:tasks.workunit.client.1.smithi079.stdout:2/182: write d8/db/f19 [747321,95555] 0 2024-05-09T06:29:28.930 INFO:tasks.workunit.client.1.smithi079.stdout:5/160: dwrite d13/d1b/d26/f33 [0,4194304] 0 2024-05-09T06:29:28.930 INFO:tasks.workunit.client.1.smithi079.stdout:5/161: dread d13/d1b/f22 [0,4194304] 0 2024-05-09T06:29:28.930 INFO:tasks.workunit.client.1.smithi079.stdout:5/162: write fa [2567957,127085] 0 2024-05-09T06:29:28.930 INFO:tasks.workunit.client.1.smithi079.stdout:5/163: creat d13/d1b/f3a x:0 0 0 2024-05-09T06:29:28.931 INFO:tasks.workunit.client.1.smithi079.stdout:8/123: link d1/l2a d1/d18/l2d 0 2024-05-09T06:29:28.932 INFO:tasks.workunit.client.1.smithi079.stdout:3/101: mkdir d1a/d1c 0 2024-05-09T06:29:28.933 INFO:tasks.workunit.client.1.smithi079.stdout:4/263: getdents d6/d15 0 2024-05-09T06:29:28.936 INFO:tasks.workunit.client.1.smithi079.stdout:9/283: creat d1/d33/d28/d36/f67 x:0 0 0 2024-05-09T06:29:28.936 INFO:tasks.workunit.client.1.smithi079.stdout:9/284: write d1/d5/f21 [4632125,29629] 0 2024-05-09T06:29:28.936 INFO:tasks.workunit.client.1.smithi079.stdout:9/285: readlink d1/d33/d28/l2c 0 2024-05-09T06:29:28.943 INFO:tasks.workunit.client.1.smithi079.stdout:6/146: symlink d0/d6/d1b/d2d/l2e 0 2024-05-09T06:29:28.949 INFO:tasks.workunit.client.1.smithi079.stdout:9/286: dwrite d1/d33/d28/d4c/d4e/f2e [4194304,4194304] 0 2024-05-09T06:29:28.953 INFO:tasks.workunit.client.1.smithi079.stdout:9/287: write d1/d5/f10 [308058,35985] 0 2024-05-09T06:29:28.963 INFO:tasks.workunit.client.1.smithi079.stdout:5/164: rename c6 to d13/d1b/d26/d35/c3b 0 2024-05-09T06:29:28.963 INFO:tasks.workunit.client.1.smithi079.stdout:5/165: creat d13/d1b/d26/f3c x:0 0 0 2024-05-09T06:29:28.966 INFO:tasks.workunit.client.1.smithi079.stdout:6/147: dwrite d0/d6/d16/d1f/f27 [0,4194304] 0 2024-05-09T06:29:28.968 INFO:tasks.workunit.client.1.smithi079.stdout:8/124: dread d1/d3/f4 [0,4194304] 0 2024-05-09T06:29:28.968 INFO:tasks.workunit.client.1.smithi079.stdout:8/125: readlink d1/d18/l2d 0 2024-05-09T06:29:28.968 INFO:tasks.workunit.client.1.smithi079.stdout:8/126: stat d1/d5/dc 0 2024-05-09T06:29:28.968 INFO:tasks.workunit.client.1.smithi079.stdout:8/127: readlink d1/l2 0 2024-05-09T06:29:28.970 INFO:tasks.workunit.client.1.smithi079.stdout:4/264: unlink d6/dd/c18 0 2024-05-09T06:29:28.971 INFO:tasks.workunit.client.1.smithi079.stdout:0/141: truncate d3/dd/f1c 2707109 0 2024-05-09T06:29:28.973 INFO:tasks.workunit.client.1.smithi079.stdout:9/288: write d1/d6/d7/d19/f1e [2297066,8781] 0 2024-05-09T06:29:28.981 INFO:tasks.workunit.client.1.smithi079.stdout:5/166: mkdir d13/d1b/d3d 0 2024-05-09T06:29:28.982 INFO:tasks.workunit.client.1.smithi079.stdout:5/167: dread - d13/f21 zero size 2024-05-09T06:29:28.982 INFO:tasks.workunit.client.1.smithi079.stdout:5/168: readlink ld 0 2024-05-09T06:29:28.982 INFO:tasks.workunit.client.1.smithi079.stdout:5/169: write d13/f16 [4269478,119279] 0 2024-05-09T06:29:28.982 INFO:tasks.workunit.client.1.smithi079.stdout:5/170: stat c9 0 2024-05-09T06:29:28.986 INFO:tasks.workunit.client.1.smithi079.stdout:3/102: mkdir d1a/d1d 0 2024-05-09T06:29:28.988 INFO:tasks.workunit.client.1.smithi079.stdout:8/128: mknod d1/d5/c2e 0 2024-05-09T06:29:28.990 INFO:tasks.workunit.client.1.smithi079.stdout:0/142: creat d3/d5/d27/d2d/f2e x:0 0 0 2024-05-09T06:29:28.998 INFO:tasks.workunit.client.1.smithi079.stdout:9/289: dwrite d1/d33/d28/d36/d38/d3a/f57 [0,4194304] 0 2024-05-09T06:29:28.998 INFO:tasks.workunit.client.1.smithi079.stdout:9/290: chown d1/d33/d48/d64 3 1 2024-05-09T06:29:28.999 INFO:tasks.workunit.client.1.smithi079.stdout:0/143: mknod d3/dd/d1f/c2f 0 2024-05-09T06:29:28.999 INFO:tasks.workunit.client.1.smithi079.stdout:0/144: truncate d3/d5/d27/d2d/f2e 797461 0 2024-05-09T06:29:28.999 INFO:tasks.workunit.client.1.smithi079.stdout:0/145: truncate d3/d5/f21 650786 0 2024-05-09T06:29:29.005 INFO:tasks.workunit.client.1.smithi079.stdout:4/265: dwrite d6/dd/df/f21 [0,4194304] 0 2024-05-09T06:29:29.005 INFO:tasks.workunit.client.1.smithi079.stdout:8/129: dwrite d1/d5/dc/f1b [0,4194304] 0 2024-05-09T06:29:29.006 INFO:tasks.workunit.client.1.smithi079.stdout:6/148: dwrite d0/d6/d16/d1f/f23 [0,4194304] 0 2024-05-09T06:29:29.006 INFO:tasks.workunit.client.1.smithi079.stdout:6/149: write d0/d6/d1b/f26 [1037898,125646] 0 2024-05-09T06:29:29.008 INFO:tasks.workunit.client.1.smithi079.stdout:5/171: truncate fa 2525113 0 2024-05-09T06:29:29.008 INFO:tasks.workunit.client.1.smithi079.stdout:5/172: creat d13/d1b/d26/f3e x:0 0 0 2024-05-09T06:29:29.009 INFO:tasks.workunit.client.1.smithi079.stdout:9/291: mknod d1/d5/d5b/c68 0 2024-05-09T06:29:29.009 INFO:tasks.workunit.client.1.smithi079.stdout:9/292: fdatasync d1/d33/d2b/f53 0 2024-05-09T06:29:29.011 INFO:tasks.workunit.client.1.smithi079.stdout:0/146: link d3/dd/d1f/c2f d3/dd/c30 0 2024-05-09T06:29:29.015 INFO:tasks.workunit.client.1.smithi079.stdout:3/103: dwrite fc [0,4194304] 0 2024-05-09T06:29:29.019 INFO:tasks.workunit.client.1.smithi079.stdout:4/266: rename d6/d8/d9 to d6/d1a/d26/d2a/d54 0 2024-05-09T06:29:29.021 INFO:tasks.workunit.client.1.smithi079.stdout:8/130: mknod d1/d5/dc/c2f 0 2024-05-09T06:29:29.028 INFO:tasks.workunit.client.1.smithi079.stdout:8/131: write d1/d5/dc/f1b [707666,115799] 0 2024-05-09T06:29:29.028 INFO:tasks.workunit.client.1.smithi079.stdout:8/132: creat d1/db/f30 x:0 0 0 2024-05-09T06:29:29.033 INFO:tasks.workunit.client.1.smithi079.stdout:6/150: creat d0/d6/d1b/d20/f2f x:0 0 0 2024-05-09T06:29:29.033 INFO:tasks.workunit.client.1.smithi079.stdout:6/151: write d0/d6/d1b/f26 [919958,66202] 0 2024-05-09T06:29:29.038 INFO:tasks.workunit.client.1.smithi079.stdout:9/293: truncate d1/d5/f24 4024451 0 2024-05-09T06:29:29.040 INFO:tasks.workunit.client.1.smithi079.stdout:0/147: creat d3/dd/d1f/d1e/d2c/f31 x:0 0 0 2024-05-09T06:29:29.042 INFO:tasks.workunit.client.1.smithi079.stdout:3/104: symlink d1a/l1e 0 2024-05-09T06:29:29.042 INFO:tasks.workunit.client.1.smithi079.stdout:8/133: dwrite d1/d3/f14 [0,4194304] 0 2024-05-09T06:29:29.044 INFO:tasks.workunit.client.1.smithi079.stdout:4/267: unlink d6/d1a/f1c 0 2024-05-09T06:29:29.049 INFO:tasks.workunit.client.1.smithi079.stdout:6/152: creat d0/d6/d16/f30 x:0 0 0 2024-05-09T06:29:29.053 INFO:tasks.workunit.client.1.smithi079.stdout:0/148: dwrite d3/dd/d1f/f13 [0,4194304] 0 2024-05-09T06:29:29.053 INFO:tasks.workunit.client.1.smithi079.stdout:6/153: fdatasync d0/d6/d1b/f26 0 2024-05-09T06:29:29.054 INFO:tasks.workunit.client.1.smithi079.stdout:9/294: creat d1/d33/d28/d4c/d4e/d2d/f69 x:0 0 0 2024-05-09T06:29:29.057 INFO:tasks.workunit.client.1.smithi079.stdout:3/105: mkdir d1a/d1c/d1f 0 2024-05-09T06:29:29.057 INFO:tasks.workunit.client.1.smithi079.stdout:3/106: chown d1a/d1c 1092 1 2024-05-09T06:29:29.062 INFO:tasks.workunit.client.1.smithi079.stdout:8/134: rename d1/d5/dc/c15 to d1/d3/d20/d29/c31 0 2024-05-09T06:29:29.064 INFO:tasks.workunit.client.1.smithi079.stdout:8/135: dread d1/d5/dc/f1d [0,4194304] 0 2024-05-09T06:29:29.065 INFO:tasks.workunit.client.1.smithi079.stdout:8/136: write d1/d3/fa [947294,76321] 0 2024-05-09T06:29:29.065 INFO:tasks.workunit.client.1.smithi079.stdout:0/149: creat d3/d5/d27/f32 x:0 0 0 2024-05-09T06:29:29.065 INFO:tasks.workunit.client.1.smithi079.stdout:0/150: chown d3/d5 5 1 2024-05-09T06:29:29.065 INFO:tasks.workunit.client.1.smithi079.stdout:0/151: dread - d3/dd/d1f/d1e/d2c/f31 zero size 2024-05-09T06:29:29.066 INFO:tasks.workunit.client.1.smithi079.stdout:9/295: mknod d1/d6/c6a 0 2024-05-09T06:29:29.073 INFO:tasks.workunit.client.1.smithi079.stdout:5/173: rmdir d13/d1b 39 2024-05-09T06:29:29.073 INFO:tasks.workunit.client.1.smithi079.stdout:5/174: write d13/f19 [1570079,6464] 0 2024-05-09T06:29:29.074 INFO:tasks.workunit.client.1.smithi079.stdout:4/268: rmdir d6/d8/d27 39 2024-05-09T06:29:29.074 INFO:tasks.workunit.client.1.smithi079.stdout:4/269: write d6/dd/df/f3b [1575926,7132] 0 2024-05-09T06:29:29.074 INFO:tasks.workunit.client.1.smithi079.stdout:0/152: dread d3/dd/d1f/f20 [0,4194304] 0 2024-05-09T06:29:29.077 INFO:tasks.workunit.client.1.smithi079.stdout:9/296: mkdir d1/d33/d28/d36/d38/d3a/d56/d6b 0 2024-05-09T06:29:29.077 INFO:tasks.workunit.client.1.smithi079.stdout:9/297: chown d1/d5/f52 1 1 2024-05-09T06:29:29.079 INFO:tasks.workunit.client.1.smithi079.stdout:5/175: rename d13/d2a/c2c to d13/c3f 0 2024-05-09T06:29:29.079 INFO:tasks.workunit.client.1.smithi079.stdout:2/183: sync 2024-05-09T06:29:29.079 INFO:tasks.workunit.client.1.smithi079.stdout:1/111: sync 2024-05-09T06:29:29.079 INFO:tasks.workunit.client.1.smithi079.stdout:7/222: sync 2024-05-09T06:29:29.079 INFO:tasks.workunit.client.1.smithi079.stdout:1/112: stat d0/d7 0 2024-05-09T06:29:29.079 INFO:tasks.workunit.client.1.smithi079.stdout:1/113: write d0/d12/f18 [370973,33124] 0 2024-05-09T06:29:29.079 INFO:tasks.workunit.client.1.smithi079.stdout:2/184: write d8/db/dc/d2c/f33 [582827,98929] 0 2024-05-09T06:29:29.080 INFO:tasks.workunit.client.1.smithi079.stdout:2/185: truncate d8/db/dc/d2c/f31 189198 0 2024-05-09T06:29:29.081 INFO:tasks.workunit.client.1.smithi079.stdout:5/176: mkdir d13/d1b/d3d/d40 0 2024-05-09T06:29:29.084 INFO:tasks.workunit.client.1.smithi079.stdout:1/114: creat d0/d7/d22/f25 x:0 0 0 2024-05-09T06:29:29.084 INFO:tasks.workunit.client.1.smithi079.stdout:1/115: stat d0/d12/d16/f19 0 2024-05-09T06:29:29.084 INFO:tasks.workunit.client.1.smithi079.stdout:1/116: fdatasync d0/d7/fb 0 2024-05-09T06:29:29.086 INFO:tasks.workunit.client.1.smithi079.stdout:2/186: symlink d8/db/dc/d2c/l42 0 2024-05-09T06:29:29.086 INFO:tasks.workunit.client.1.smithi079.stdout:0/153: write d3/dd/d1f/f13 [2188787,114082] 0 2024-05-09T06:29:29.086 INFO:tasks.workunit.client.1.smithi079.stdout:9/298: read d1/d5/f52 [2817876,8085] 0 2024-05-09T06:29:29.088 INFO:tasks.workunit.client.1.smithi079.stdout:5/177: symlink d13/d1b/d3d/d40/l41 0 2024-05-09T06:29:29.089 INFO:tasks.workunit.client.1.smithi079.stdout:8/137: write d1/d3/f14 [198351,98993] 0 2024-05-09T06:29:29.090 INFO:tasks.workunit.client.1.smithi079.stdout:1/117: mkdir d0/d7/d22/d26 0 2024-05-09T06:29:29.091 INFO:tasks.workunit.client.1.smithi079.stdout:7/223: dread d4/d7/f1b [0,4194304] 0 2024-05-09T06:29:29.096 INFO:tasks.workunit.client.1.smithi079.stdout:2/187: symlink d8/db/dc/d2c/l43 0 2024-05-09T06:29:29.096 INFO:tasks.workunit.client.1.smithi079.stdout:2/188: write d8/db/dc/f34 [509836,90568] 0 2024-05-09T06:29:29.097 INFO:tasks.workunit.client.1.smithi079.stdout:0/154: symlink d3/d5/d27/d2d/l33 0 2024-05-09T06:29:29.099 INFO:tasks.workunit.client.1.smithi079.stdout:3/107: dwrite fb [0,4194304] 0 2024-05-09T06:29:29.102 INFO:tasks.workunit.client.1.smithi079.stdout:9/299: mkdir d1/d33/d28/d36/d6c 0 2024-05-09T06:29:29.102 INFO:tasks.workunit.client.1.smithi079.stdout:9/300: write d1/f17 [529050,35959] 0 2024-05-09T06:29:29.102 INFO:tasks.workunit.client.1.smithi079.stdout:9/301: fdatasync d1/d6/d7/f31 0 2024-05-09T06:29:29.103 INFO:tasks.workunit.client.1.smithi079.stdout:5/178: creat d13/d1b/d3d/d40/f42 x:0 0 0 2024-05-09T06:29:29.105 INFO:tasks.workunit.client.1.smithi079.stdout:0/155: dread d3/dd/d1f/fa [0,4194304] 0 2024-05-09T06:29:29.106 INFO:tasks.workunit.client.1.smithi079.stdout:8/138: rmdir d1/d18 39 2024-05-09T06:29:29.113 INFO:tasks.workunit.client.1.smithi079.stdout:7/224: mknod d4/d7/d22/c3f 0 2024-05-09T06:29:29.113 INFO:tasks.workunit.client.1.smithi079.stdout:7/225: chown d4/d30/l39 44013804 1 2024-05-09T06:29:29.113 INFO:tasks.workunit.client.1.smithi079.stdout:7/226: creat d4/d7/d22/f40 x:0 0 0 2024-05-09T06:29:29.117 INFO:tasks.workunit.client.1.smithi079.stdout:2/189: mknod d8/db/dc/c44 0 2024-05-09T06:29:29.122 INFO:tasks.workunit.client.1.smithi079.stdout:0/156: dwrite d3/d5/f2b [0,4194304] 0 2024-05-09T06:29:29.122 INFO:tasks.workunit.client.1.smithi079.stdout:0/157: dread - d3/dd/d1f/d1e/d2c/f31 zero size 2024-05-09T06:29:29.122 INFO:tasks.workunit.client.1.smithi079.stdout:0/158: fsync d3/d5/f2b 0 2024-05-09T06:29:29.122 INFO:tasks.workunit.client.1.smithi079.stdout:3/108: symlink d1a/d1c/l20 0 2024-05-09T06:29:29.125 INFO:tasks.workunit.client.1.smithi079.stdout:9/302: mkdir d1/d33/d28/d3e/d6d 0 2024-05-09T06:29:29.125 INFO:tasks.workunit.client.1.smithi079.stdout:9/303: write d1/d5/f10 [303454,88447] 0 2024-05-09T06:29:29.127 INFO:tasks.workunit.client.1.smithi079.stdout:8/139: creat d1/d3/d20/f32 x:0 0 0 2024-05-09T06:29:29.127 INFO:tasks.workunit.client.1.smithi079.stdout:8/140: truncate d1/d3/f17 251942 0 2024-05-09T06:29:29.129 INFO:tasks.workunit.client.1.smithi079.stdout:5/179: dwrite d13/d1b/f2f [0,4194304] 0 2024-05-09T06:29:29.134 INFO:tasks.workunit.client.1.smithi079.stdout:7/227: dwrite d4/d7/f18 [4194304,4194304] 0 2024-05-09T06:29:29.134 INFO:tasks.workunit.client.1.smithi079.stdout:7/228: chown d4/d7/d37 745 1 2024-05-09T06:29:29.134 INFO:tasks.workunit.client.1.smithi079.stdout:7/229: write d4/d7/d22/d28/f3e [178848,27470] 0 2024-05-09T06:29:29.137 INFO:tasks.workunit.client.1.smithi079.stdout:0/159: creat d3/dd/d18/f34 x:0 0 0 2024-05-09T06:29:29.139 INFO:tasks.workunit.client.1.smithi079.stdout:3/109: mkdir d1a/d21 0 2024-05-09T06:29:29.143 INFO:tasks.workunit.client.1.smithi079.stdout:8/141: unlink d1/d3/ff 0 2024-05-09T06:29:29.150 INFO:tasks.workunit.client.1.smithi079.stdout:7/230: dwrite d4/f14 [0,4194304] 0 2024-05-09T06:29:29.150 INFO:tasks.workunit.client.1.smithi079.stdout:7/231: truncate d4/d7/dd/f21 474980 0 2024-05-09T06:29:29.150 INFO:tasks.workunit.client.1.smithi079.stdout:9/304: dwrite d1/d33/d28/d4c/d4e/f4a [0,4194304] 0 2024-05-09T06:29:29.161 INFO:tasks.workunit.client.1.smithi079.stdout:1/118: rename d0/d7/d22 to d0/d12/d27 0 2024-05-09T06:29:29.164 INFO:tasks.workunit.client.1.smithi079.stdout:0/160: mkdir d3/dd/d1f/d1e/d2c/d35 0 2024-05-09T06:29:29.168 INFO:tasks.workunit.client.1.smithi079.stdout:0/161: write d3/dd/f1c [2038713,116672] 0 2024-05-09T06:29:29.171 INFO:tasks.workunit.client.1.smithi079.stdout:7/232: mknod d4/d20/c41 0 2024-05-09T06:29:29.178 INFO:tasks.workunit.client.1.smithi079.stdout:9/305: link d1/d6/c6a d1/d33/d28/d4c/d4e/c6e 0 2024-05-09T06:29:29.178 INFO:tasks.workunit.client.1.smithi079.stdout:9/306: chown d1/d5/f58 250623863 1 2024-05-09T06:29:29.178 INFO:tasks.workunit.client.1.smithi079.stdout:9/307: write d1/d33/d28/f34 [1043573,81705] 0 2024-05-09T06:29:29.182 INFO:tasks.workunit.client.1.smithi079.stdout:1/119: symlink d0/d7/d11/l28 0 2024-05-09T06:29:29.184 INFO:tasks.workunit.client.1.smithi079.stdout:0/162: mkdir d3/dd/d1f/d1e/d2c/d35/d36 0 2024-05-09T06:29:29.187 INFO:tasks.workunit.client.1.smithi079.stdout:7/233: creat d4/d7/dd/f42 x:0 0 0 2024-05-09T06:29:29.189 INFO:tasks.workunit.client.1.smithi079.stdout:9/308: symlink d1/d6/l6f 0 2024-05-09T06:29:29.191 INFO:tasks.workunit.client.1.smithi079.stdout:9/309: dread d1/d5/ff [0,4194304] 0 2024-05-09T06:29:29.191 INFO:tasks.workunit.client.1.smithi079.stdout:1/120: creat d0/d12/d27/d26/f29 x:0 0 0 2024-05-09T06:29:29.193 INFO:tasks.workunit.client.1.smithi079.stdout:1/121: write d0/d7/fc [3007675,85764] 0 2024-05-09T06:29:29.194 INFO:tasks.workunit.client.1.smithi079.stdout:0/163: mknod d3/c37 0 2024-05-09T06:29:29.194 INFO:tasks.workunit.client.1.smithi079.stdout:1/122: dread d0/f5 [0,4194304] 0 2024-05-09T06:29:29.195 INFO:tasks.workunit.client.1.smithi079.stdout:1/123: write d0/d7/d11/f15 [4697224,97114] 0 2024-05-09T06:29:29.195 INFO:tasks.workunit.client.1.smithi079.stdout:0/164: dread d3/d5/f21 [0,4194304] 0 2024-05-09T06:29:29.195 INFO:tasks.workunit.client.1.smithi079.stdout:7/234: symlink d4/d20/l43 0 2024-05-09T06:29:29.198 INFO:tasks.workunit.client.1.smithi079.stdout:1/124: symlink d0/d7/d11/d20/l2a 0 2024-05-09T06:29:29.199 INFO:tasks.workunit.client.1.smithi079.stdout:1/125: chown d0/d12/d27 60111 1 2024-05-09T06:29:29.199 INFO:tasks.workunit.client.1.smithi079.stdout:1/126: rename d0 to d0/df/d2b 22 2024-05-09T06:29:29.199 INFO:tasks.workunit.client.1.smithi079.stdout:1/127: creat d0/d12/f2c x:0 0 0 2024-05-09T06:29:29.199 INFO:tasks.workunit.client.1.smithi079.stdout:1/128: write d0/d12/d27/f25 [782213,21254] 0 2024-05-09T06:29:29.199 INFO:tasks.workunit.client.1.smithi079.stdout:1/129: read - d0/d12/d27/d26/f29 zero size 2024-05-09T06:29:29.199 INFO:tasks.workunit.client.1.smithi079.stdout:7/235: write d4/d7/d22/f2a [2160190,8871] 0 2024-05-09T06:29:29.199 INFO:tasks.workunit.client.1.smithi079.stdout:7/236: dread - d4/d30/d32/f3b zero size 2024-05-09T06:29:29.199 INFO:tasks.workunit.client.1.smithi079.stdout:7/237: fdatasync d4/f14 0 2024-05-09T06:29:29.203 INFO:tasks.workunit.client.1.smithi079.stdout:1/130: mknod d0/d12/d27/c2d 0 2024-05-09T06:29:29.205 INFO:tasks.workunit.client.1.smithi079.stdout:9/310: dwrite d1/d45/f66 [0,4194304] 0 2024-05-09T06:29:29.207 INFO:tasks.workunit.client.1.smithi079.stdout:7/238: unlink d4/c29 0 2024-05-09T06:29:29.208 INFO:tasks.workunit.client.1.smithi079.stdout:0/165: getdents d3/dd 0 2024-05-09T06:29:29.211 INFO:tasks.workunit.client.1.smithi079.stdout:9/311: dread d1/d33/d28/d4c/d4e/f54 [0,4194304] 0 2024-05-09T06:29:29.214 INFO:tasks.workunit.client.1.smithi079.stdout:9/312: truncate d1/d33/d28/d4c/d4e/f2e 5785328 0 2024-05-09T06:29:29.215 INFO:tasks.workunit.client.1.smithi079.stdout:7/239: rename d4/f14 to d4/d30/f44 0 2024-05-09T06:29:29.217 INFO:tasks.workunit.client.1.smithi079.stdout:9/313: rmdir d1/d33/d2b 39 2024-05-09T06:29:29.217 INFO:tasks.workunit.client.1.smithi079.stdout:9/314: chown d1/d5/f24 211205 1 2024-05-09T06:29:29.217 INFO:tasks.workunit.client.1.smithi079.stdout:9/315: chown d1/d5/d5b/c68 11 1 2024-05-09T06:29:29.217 INFO:tasks.workunit.client.1.smithi079.stdout:9/316: chown d1/d5/d5b/c68 21258 1 2024-05-09T06:29:29.217 INFO:tasks.workunit.client.1.smithi079.stdout:9/317: truncate d1/d45/f59 9086292 0 2024-05-09T06:29:29.228 INFO:tasks.workunit.client.1.smithi079.stdout:7/240: write d4/d7/f25 [1545178,29601] 0 2024-05-09T06:29:29.228 INFO:tasks.workunit.client.1.smithi079.stdout:0/166: dwrite d3/d5/f21 [0,4194304] 0 2024-05-09T06:29:29.228 INFO:tasks.workunit.client.1.smithi079.stdout:0/167: write d3/dd/d18/f34 [376309,80817] 0 2024-05-09T06:29:29.228 INFO:tasks.workunit.client.1.smithi079.stdout:0/168: chown d3/d5/d27/d2d/f2e 429209 1 2024-05-09T06:29:29.236 INFO:tasks.workunit.client.1.smithi079.stdout:7/241: creat d4/d30/d31/d34/f45 x:0 0 0 2024-05-09T06:29:29.236 INFO:tasks.workunit.client.1.smithi079.stdout:1/131: getdents d0/d7/d11/d20 0 2024-05-09T06:29:29.237 INFO:tasks.workunit.client.1.smithi079.stdout:9/318: dwrite d1/d33/d28/d4c/d4e/f4a [0,4194304] 0 2024-05-09T06:29:29.237 INFO:tasks.workunit.client.1.smithi079.stdout:9/319: chown d1/d6/f13 149431 1 2024-05-09T06:29:29.245 INFO:tasks.workunit.client.1.smithi079.stdout:1/132: write d0/df/f1b [2255648,85947] 0 2024-05-09T06:29:29.245 INFO:tasks.workunit.client.1.smithi079.stdout:1/133: getdents d0/d12/d16 0 2024-05-09T06:29:29.245 INFO:tasks.workunit.client.1.smithi079.stdout:1/134: fsync d0/d12/f2c 0 2024-05-09T06:29:29.245 INFO:tasks.workunit.client.1.smithi079.stdout:1/135: creat d0/d7/d11/f2e x:0 0 0 2024-05-09T06:29:29.245 INFO:tasks.workunit.client.1.smithi079.stdout:1/136: dread - d0/d12/f2c zero size 2024-05-09T06:29:29.246 INFO:tasks.workunit.client.1.smithi079.stdout:1/137: write d0/df/f24 [3361682,14378] 0 2024-05-09T06:29:29.246 INFO:tasks.workunit.client.1.smithi079.stdout:1/138: chown d0/d12/f2c 2 1 2024-05-09T06:29:29.246 INFO:tasks.workunit.client.1.smithi079.stdout:1/139: chown d0/d12/d27/f25 1397800 1 2024-05-09T06:29:29.264 INFO:tasks.workunit.client.1.smithi079.stdout:7/242: creat d4/d7/d37/f46 x:0 0 0 2024-05-09T06:29:29.266 INFO:tasks.workunit.client.1.smithi079.stdout:9/320: link d1/d33/d28/f34 d1/d33/d28/d4c/f70 0 2024-05-09T06:29:29.266 INFO:tasks.workunit.client.1.smithi079.stdout:9/321: readlink d1/d33/l4f 0 2024-05-09T06:29:29.266 INFO:tasks.workunit.client.1.smithi079.stdout:9/322: chown d1/d33/d28/d4c/d4e/f54 242975107 1 2024-05-09T06:29:29.268 INFO:tasks.workunit.client.1.smithi079.stdout:1/140: creat d0/d12/d16/f2f x:0 0 0 2024-05-09T06:29:29.269 INFO:tasks.workunit.client.1.smithi079.stdout:9/323: dread d1/d5/d5b/f5e [0,4194304] 0 2024-05-09T06:29:29.269 INFO:tasks.workunit.client.1.smithi079.stdout:9/324: fsync d1/d6/d7/d19/f1f 0 2024-05-09T06:29:29.271 INFO:tasks.workunit.client.1.smithi079.stdout:7/243: rmdir d4/d7/d22/d28 39 2024-05-09T06:29:29.277 INFO:tasks.workunit.client.1.smithi079.stdout:9/325: dread d1/d45/f59 [4194304,4194304] 0 2024-05-09T06:29:29.279 INFO:tasks.workunit.client.1.smithi079.stdout:9/326: rmdir d1 39 2024-05-09T06:29:29.280 INFO:tasks.workunit.client.1.smithi079.stdout:7/244: dread d4/d7/dd/f1e [0,4194304] 0 2024-05-09T06:29:29.282 INFO:tasks.workunit.client.1.smithi079.stdout:9/327: unlink d1/d5/d5b/f5e 0 2024-05-09T06:29:29.283 INFO:tasks.workunit.client.1.smithi079.stdout:1/141: dwrite d0/d12/f1a [4194304,4194304] 0 2024-05-09T06:29:29.283 INFO:tasks.workunit.client.1.smithi079.stdout:1/142: fdatasync d0/d12/f18 0 2024-05-09T06:29:29.285 INFO:tasks.workunit.client.1.smithi079.stdout:7/245: mkdir d4/d7/dd/d47 0 2024-05-09T06:29:29.285 INFO:tasks.workunit.client.1.smithi079.stdout:7/246: getdents d4/d7/dd/d47 0 2024-05-09T06:29:29.292 INFO:tasks.workunit.client.1.smithi079.stdout:1/143: symlink d0/d12/d16/l30 0 2024-05-09T06:29:29.293 INFO:tasks.workunit.client.1.smithi079.stdout:9/328: write d1/d33/d2b/f32 [2226742,43145] 0 2024-05-09T06:29:29.294 INFO:tasks.workunit.client.1.smithi079.stdout:9/329: truncate d1/d33/d2b/f32 4984969 0 2024-05-09T06:29:29.295 INFO:tasks.workunit.client.1.smithi079.stdout:1/144: dread d0/d7/fc [0,4194304] 0 2024-05-09T06:29:29.295 INFO:tasks.workunit.client.1.smithi079.stdout:1/145: stat d0/d7/fb 0 2024-05-09T06:29:29.296 INFO:tasks.workunit.client.1.smithi079.stdout:1/146: write d0/df/f14 [1719173,61914] 0 2024-05-09T06:29:29.297 INFO:tasks.workunit.client.1.smithi079.stdout:7/247: rename d4/d7/f1d to d4/d20/f48 0 2024-05-09T06:29:29.298 INFO:tasks.workunit.client.1.smithi079.stdout:7/248: stat d4/cb 0 2024-05-09T06:29:29.301 INFO:tasks.workunit.client.1.smithi079.stdout:9/330: rename d1/d33/d28/d4c/f5f to d1/d5/d5b/f71 0 2024-05-09T06:29:29.302 INFO:tasks.workunit.client.1.smithi079.stdout:7/249: creat d4/d7/f49 x:0 0 0 2024-05-09T06:29:29.304 INFO:tasks.workunit.client.1.smithi079.stdout:1/147: rename d0/d7/d11/d20/d21 to d0/d12/d31 0 2024-05-09T06:29:29.309 INFO:tasks.workunit.client.1.smithi079.stdout:1/148: link d0/d7/f9 d0/f32 0 2024-05-09T06:29:29.309 INFO:tasks.workunit.client.1.smithi079.stdout:1/149: truncate d0/df/f14 2007803 0 2024-05-09T06:29:29.310 INFO:tasks.workunit.client.1.smithi079.stdout:7/250: write d4/d7/f18 [7487701,116535] 0 2024-05-09T06:29:29.310 INFO:tasks.workunit.client.1.smithi079.stdout:7/251: dread - d4/d7/d22/f2f zero size 2024-05-09T06:29:29.310 INFO:tasks.workunit.client.1.smithi079.stdout:7/252: dread - d4/d30/d32/f3b zero size 2024-05-09T06:29:29.310 INFO:tasks.workunit.client.1.smithi079.stdout:7/253: truncate d4/d30/d32/f3b 861065 0 2024-05-09T06:29:29.313 INFO:tasks.workunit.client.1.smithi079.stdout:7/254: dread d4/d7/dd/f16 [0,4194304] 0 2024-05-09T06:29:29.313 INFO:tasks.workunit.client.1.smithi079.stdout:1/150: dread d0/d12/f18 [0,4194304] 0 2024-05-09T06:29:29.321 INFO:tasks.workunit.client.1.smithi079.stdout:9/331: dwrite d1/d5/f10 [0,4194304] 0 2024-05-09T06:29:29.326 INFO:tasks.workunit.client.1.smithi079.stdout:9/332: symlink d1/d6/d7/l72 0 2024-05-09T06:29:29.329 INFO:tasks.workunit.client.1.smithi079.stdout:9/333: unlink d1/d33/d28/d4c/d4e/c39 0 2024-05-09T06:29:29.332 INFO:tasks.workunit.client.1.smithi079.stdout:9/334: creat d1/d33/d28/d3e/d6d/f73 x:0 0 0 2024-05-09T06:29:29.334 INFO:tasks.workunit.client.1.smithi079.stdout:1/151: dwrite d0/f32 [0,4194304] 0 2024-05-09T06:29:29.338 INFO:tasks.workunit.client.1.smithi079.stdout:7/255: dwrite d4/d30/d31/f33 [0,4194304] 0 2024-05-09T06:29:29.338 INFO:tasks.workunit.client.1.smithi079.stdout:7/256: creat d4/d7/d37/f4a x:0 0 0 2024-05-09T06:29:29.339 INFO:tasks.workunit.client.1.smithi079.stdout:7/257: readlink d4/d20/l43 0 2024-05-09T06:29:29.339 INFO:tasks.workunit.client.1.smithi079.stdout:7/258: write d4/d30/d31/d34/f45 [174519,10482] 0 2024-05-09T06:29:29.339 INFO:tasks.workunit.client.1.smithi079.stdout:7/259: chown d4/d7 49703366 1 2024-05-09T06:29:29.339 INFO:tasks.workunit.client.1.smithi079.stdout:7/260: truncate d4/d7/dd/f42 475709 0 2024-05-09T06:29:29.339 INFO:tasks.workunit.client.1.smithi079.stdout:1/152: mknod d0/d12/d16/c33 0 2024-05-09T06:29:29.346 INFO:tasks.workunit.client.1.smithi079.stdout:7/261: dread d4/d30/d31/f33 [0,4194304] 0 2024-05-09T06:29:29.346 INFO:tasks.workunit.client.1.smithi079.stdout:7/262: chown d4/d30/d31/f33 10222 1 2024-05-09T06:29:29.349 INFO:tasks.workunit.client.1.smithi079.stdout:9/335: dwrite d1/d33/f65 [0,4194304] 0 2024-05-09T06:29:29.349 INFO:tasks.workunit.client.1.smithi079.stdout:9/336: dread - d1/d33/d28/d4c/d4e/d2d/f69 zero size 2024-05-09T06:29:29.349 INFO:tasks.workunit.client.1.smithi079.stdout:9/337: chown d1/d33/d28/d36/d4d 2562325 1 2024-05-09T06:29:29.352 INFO:tasks.workunit.client.1.smithi079.stdout:1/153: symlink d0/d12/d31/l34 0 2024-05-09T06:29:29.352 INFO:tasks.workunit.client.1.smithi079.stdout:1/154: creat d0/d12/d16/f35 x:0 0 0 2024-05-09T06:29:29.354 INFO:tasks.workunit.client.1.smithi079.stdout:7/263: mknod d4/d20/c4b 0 2024-05-09T06:29:29.368 INFO:tasks.workunit.client.1.smithi079.stdout:7/264: dwrite d4/d7/dd/f16 [0,4194304] 0 2024-05-09T06:29:29.377 INFO:tasks.workunit.client.1.smithi079.stdout:9/338: symlink d1/d33/d28/d3e/d6d/l74 0 2024-05-09T06:29:29.383 INFO:tasks.workunit.client.1.smithi079.stdout:1/155: rmdir d0/d7/d11/d20 39 2024-05-09T06:29:29.383 INFO:tasks.workunit.client.1.smithi079.stdout:1/156: chown d0/d12/d16 2642 1 2024-05-09T06:29:29.385 INFO:tasks.workunit.client.1.smithi079.stdout:7/265: symlink d4/d30/d31/l4c 0 2024-05-09T06:29:29.391 INFO:tasks.workunit.client.1.smithi079.stdout:1/157: symlink d0/d12/d27/d26/l36 0 2024-05-09T06:29:29.398 INFO:tasks.workunit.client.1.smithi079.stdout:1/158: dread d0/d7/d11/f15 [0,4194304] 0 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:1/159: link d0/l23 d0/d12/d27/l37 0 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:5/180: sync 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:0/169: sync 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:8/142: sync 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:3/110: sync 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:6/154: sync 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:4/270: sync 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:2/190: sync 2024-05-09T06:29:29.401 INFO:tasks.workunit.client.1.smithi079.stdout:2/191: creat d8/db/d11/f45 x:0 0 0 2024-05-09T06:29:29.403 INFO:tasks.workunit.client.1.smithi079.stdout:1/160: creat d0/d12/d27/d26/f38 x:0 0 0 2024-05-09T06:29:29.404 INFO:tasks.workunit.client.1.smithi079.stdout:3/111: mkdir d1a/d1c/d22 0 2024-05-09T06:29:29.406 INFO:tasks.workunit.client.1.smithi079.stdout:4/271: mkdir d6/d8/d55 0 2024-05-09T06:29:29.407 INFO:tasks.workunit.client.1.smithi079.stdout:5/181: dread fc [0,4194304] 0 2024-05-09T06:29:29.407 INFO:tasks.workunit.client.1.smithi079.stdout:7/266: dwrite d4/d30/d31/d34/f45 [0,4194304] 0 2024-05-09T06:29:29.407 INFO:tasks.workunit.client.1.smithi079.stdout:4/272: dread d6/d1a/d26/d2a/f2d [0,4194304] 0 2024-05-09T06:29:29.407 INFO:tasks.workunit.client.1.smithi079.stdout:4/273: write d6/dd/f2f [1995162,17151] 0 2024-05-09T06:29:29.408 INFO:tasks.workunit.client.1.smithi079.stdout:4/274: truncate d6/d1a/d26/d2a/f2d 1072210 0 2024-05-09T06:29:29.408 INFO:tasks.workunit.client.1.smithi079.stdout:8/143: mkdir d1/d3/d20/d29/d33 0 2024-05-09T06:29:29.410 INFO:tasks.workunit.client.1.smithi079.stdout:5/182: dread d13/f1a [0,4194304] 0 2024-05-09T06:29:29.412 INFO:tasks.workunit.client.1.smithi079.stdout:0/170: mknod d3/dd/d1f/d1e/d2c/d35/d36/c38 0 2024-05-09T06:29:29.415 INFO:tasks.workunit.client.1.smithi079.stdout:6/155: symlink d0/d6/d16/d28/l31 0 2024-05-09T06:29:29.417 INFO:tasks.workunit.client.1.smithi079.stdout:2/192: creat d8/db/dc/d2c/d2d/f46 x:0 0 0 2024-05-09T06:29:29.419 INFO:tasks.workunit.client.1.smithi079.stdout:1/161: rmdir d0/d12/d31 39 2024-05-09T06:29:29.420 INFO:tasks.workunit.client.1.smithi079.stdout:3/112: dread - f16 zero size 2024-05-09T06:29:29.427 INFO:tasks.workunit.client.1.smithi079.stdout:4/275: rename d6/dd/f48 to d6/d1a/d26/d2a/f56 0 2024-05-09T06:29:29.434 INFO:tasks.workunit.client.1.smithi079.stdout:0/171: creat d3/f39 x:0 0 0 2024-05-09T06:29:29.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/172: write d3/dd/d1f/f1d [372087,127127] 0 2024-05-09T06:29:29.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/173: stat d3/d5/d27/f32 0 2024-05-09T06:29:29.436 INFO:tasks.workunit.client.1.smithi079.stdout:6/156: symlink d0/d6/d1b/d20/l32 0 2024-05-09T06:29:29.436 INFO:tasks.workunit.client.1.smithi079.stdout:6/157: read d0/f15 [2719929,78999] 0 2024-05-09T06:29:29.436 INFO:tasks.workunit.client.1.smithi079.stdout:0/174: dread d3/d5/d27/d2d/f2e [0,4194304] 0 2024-05-09T06:29:29.436 INFO:tasks.workunit.client.1.smithi079.stdout:0/175: creat d3/d5/f3a x:0 0 0 2024-05-09T06:29:29.438 INFO:tasks.workunit.client.1.smithi079.stdout:1/162: mkdir d0/d7/d11/d20/d39 0 2024-05-09T06:29:29.438 INFO:tasks.workunit.client.1.smithi079.stdout:1/163: write d0/d12/d16/f35 [248961,31023] 0 2024-05-09T06:29:29.440 INFO:tasks.workunit.client.1.smithi079.stdout:3/113: mknod d1a/d1c/c23 0 2024-05-09T06:29:29.442 INFO:tasks.workunit.client.1.smithi079.stdout:4/276: symlink d6/l57 0 2024-05-09T06:29:29.465 INFO:tasks.workunit.client.1.smithi079.stdout:1/164: dwrite d0/d12/f2c [0,4194304] 0 2024-05-09T06:29:29.467 INFO:tasks.workunit.client.1.smithi079.stdout:3/114: dwrite fc [0,4194304] 0 2024-05-09T06:29:29.468 INFO:tasks.workunit.client.1.smithi079.stdout:5/183: rename d13/d1b to d13/d43 0 2024-05-09T06:29:29.471 INFO:tasks.workunit.client.1.smithi079.stdout:6/158: rename d0/f5 to d0/d6/d1b/d20/f33 0 2024-05-09T06:29:29.471 INFO:tasks.workunit.client.1.smithi079.stdout:0/176: rename d3/d5/d27 to d3/d5/d27/d2d/d3b 22 2024-05-09T06:29:29.471 INFO:tasks.workunit.client.1.smithi079.stdout:0/177: write d3/d5/f3a [714593,45608] 0 2024-05-09T06:29:29.481 INFO:tasks.workunit.client.1.smithi079.stdout:2/193: getdents d8/db/dc/d2c/d2d 0 2024-05-09T06:29:29.483 INFO:tasks.workunit.client.1.smithi079.stdout:1/165: mknod d0/d7/d11/d20/d39/c3a 0 2024-05-09T06:29:29.490 INFO:tasks.workunit.client.1.smithi079.stdout:6/159: getdents d0/d6/d1b 0 2024-05-09T06:29:29.491 INFO:tasks.workunit.client.1.smithi079.stdout:2/194: write d8/db/dc/d2c/d2d/f36 [2878929,95264] 0 2024-05-09T06:29:29.491 INFO:tasks.workunit.client.1.smithi079.stdout:5/184: dwrite d13/f17 [0,4194304] 0 2024-05-09T06:29:29.491 INFO:tasks.workunit.client.1.smithi079.stdout:2/195: dread - d8/db/dc/d2c/d2d/f46 zero size 2024-05-09T06:29:29.492 INFO:tasks.workunit.client.1.smithi079.stdout:0/178: symlink d3/d5/d27/l3c 0 2024-05-09T06:29:29.493 INFO:tasks.workunit.client.1.smithi079.stdout:0/179: dread d3/d5/d27/f24 [0,4194304] 0 2024-05-09T06:29:29.495 INFO:tasks.workunit.client.1.smithi079.stdout:4/277: creat d6/d8/d27/d3d/f58 x:0 0 0 2024-05-09T06:29:29.495 INFO:tasks.workunit.client.1.smithi079.stdout:4/278: chown d6/dd/d34/l3a 0 1 2024-05-09T06:29:29.498 INFO:tasks.workunit.client.1.smithi079.stdout:1/166: creat d0/d7/f3b x:0 0 0 2024-05-09T06:29:29.501 INFO:tasks.workunit.client.1.smithi079.stdout:3/115: rename f17 to d1a/d1c/f24 0 2024-05-09T06:29:29.507 INFO:tasks.workunit.client.1.smithi079.stdout:2/196: symlink d8/d3c/l47 0 2024-05-09T06:29:29.510 INFO:tasks.workunit.client.1.smithi079.stdout:5/185: creat d13/d43/d26/f44 x:0 0 0 2024-05-09T06:29:29.512 INFO:tasks.workunit.client.1.smithi079.stdout:0/180: creat d3/dd/d1f/d1e/d2c/d35/d36/f3d x:0 0 0 2024-05-09T06:29:29.512 INFO:tasks.workunit.client.1.smithi079.stdout:0/181: write d3/dd/d1f/f28 [1018909,33034] 0 2024-05-09T06:29:29.514 INFO:tasks.workunit.client.1.smithi079.stdout:4/279: mkdir d6/d1a/d26/d2a/d54/d59 0 2024-05-09T06:29:29.514 INFO:tasks.workunit.client.1.smithi079.stdout:4/280: write d6/f24 [1224989,32670] 0 2024-05-09T06:29:29.516 INFO:tasks.workunit.client.1.smithi079.stdout:1/167: symlink d0/d12/d16/l3c 0 2024-05-09T06:29:29.519 INFO:tasks.workunit.client.1.smithi079.stdout:5/186: getdents d13/d43/d3d/d40 0 2024-05-09T06:29:29.519 INFO:tasks.workunit.client.1.smithi079.stdout:5/187: truncate d13/d43/d26/f44 114819 0 2024-05-09T06:29:29.523 INFO:tasks.workunit.client.1.smithi079.stdout:0/182: creat d3/dd/f3e x:0 0 0 2024-05-09T06:29:29.525 INFO:tasks.workunit.client.1.smithi079.stdout:4/281: mknod d6/d1a/d26/d2a/c5a 0 2024-05-09T06:29:29.530 INFO:tasks.workunit.client.1.smithi079.stdout:3/116: unlink f14 0 2024-05-09T06:29:29.534 INFO:tasks.workunit.client.1.smithi079.stdout:0/183: rename d3/d5/d27/l14 to d3/dd/d1f/d1e/d2c/d35/d36/l3f 0 2024-05-09T06:29:29.538 INFO:tasks.workunit.client.1.smithi079.stdout:4/282: mkdir d6/d8/d27/d3d/d5b 0 2024-05-09T06:29:29.538 INFO:tasks.workunit.client.1.smithi079.stdout:4/283: dread - d6/dd/d34/f52 zero size 2024-05-09T06:29:29.538 INFO:tasks.workunit.client.1.smithi079.stdout:4/284: write d6/f24 [640930,18531] 0 2024-05-09T06:29:29.538 INFO:tasks.workunit.client.1.smithi079.stdout:4/285: write d6/d1a/d26/d2a/d54/f17 [2047896,68347] 0 2024-05-09T06:29:29.541 INFO:tasks.workunit.client.1.smithi079.stdout:3/117: symlink d1a/d1c/d22/l25 0 2024-05-09T06:29:29.545 INFO:tasks.workunit.client.1.smithi079.stdout:3/118: chown f8 12693457 1 2024-05-09T06:29:29.547 INFO:tasks.workunit.client.1.smithi079.stdout:3/119: creat d1a/d1c/d22/f26 x:0 0 0 2024-05-09T06:29:29.549 INFO:tasks.workunit.client.1.smithi079.stdout:3/120: write f3 [1794794,6999] 0 2024-05-09T06:29:29.551 INFO:tasks.workunit.client.1.smithi079.stdout:3/121: fsync f11 0 2024-05-09T06:29:29.553 INFO:tasks.workunit.client.1.smithi079.stdout:3/122: symlink d1a/l27 0 2024-05-09T06:29:29.555 INFO:tasks.workunit.client.1.smithi079.stdout:3/123: chown c18 512 1 2024-05-09T06:29:29.555 INFO:tasks.workunit.client.1.smithi079.stdout:3/124: chown f3 62918862 1 2024-05-09T06:29:29.557 INFO:tasks.workunit.client.1.smithi079.stdout:3/125: mkdir d1a/d1c/d28 0 2024-05-09T06:29:29.589 INFO:tasks.workunit.client.1.smithi079.stdout:9/339: sync 2024-05-09T06:29:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:29 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:29.595 INFO:tasks.workunit.client.1.smithi079.stdout:5/188: dwrite d13/d43/f20 [0,4194304] 0 2024-05-09T06:29:29.598 INFO:tasks.workunit.client.1.smithi079.stdout:5/189: mkdir d13/d43/d3d/d45 0 2024-05-09T06:29:29.599 INFO:tasks.workunit.client.1.smithi079.stdout:5/190: symlink d13/d43/d3d/l46 0 2024-05-09T06:29:29.602 INFO:tasks.workunit.client.1.smithi079.stdout:5/191: rename d13/d43/d3d/d40/l41 to d13/d43/d39/l47 0 2024-05-09T06:29:29.606 INFO:tasks.workunit.client.1.smithi079.stdout:2/197: dread d8/db/d11/f2f [0,4194304] 0 2024-05-09T06:29:29.608 INFO:tasks.workunit.client.1.smithi079.stdout:2/198: symlink d8/db/dc/d2c/d2d/l48 0 2024-05-09T06:29:29.608 INFO:tasks.workunit.client.1.smithi079.stdout:2/199: dread - d8/db/dc/d2c/d2d/f46 zero size 2024-05-09T06:29:29.608 INFO:tasks.workunit.client.1.smithi079.stdout:2/200: write d8/db/d11/f24 [4735240,95616] 0 2024-05-09T06:29:29.608 INFO:tasks.workunit.client.1.smithi079.stdout:2/201: write d8/db/d11/f35 [849685,103345] 0 2024-05-09T06:29:29.608 INFO:tasks.workunit.client.1.smithi079.stdout:2/202: chown d8/db/d11/l15 271141 1 2024-05-09T06:29:29.610 INFO:tasks.workunit.client.1.smithi079.stdout:2/203: unlink d8/db/dc/d2c/l43 0 2024-05-09T06:29:29.612 INFO:tasks.workunit.client.1.smithi079.stdout:2/204: creat d8/f49 x:0 0 0 2024-05-09T06:29:29.613 INFO:tasks.workunit.client.1.smithi079.stdout:3/126: dwrite d1a/f1b [0,4194304] 0 2024-05-09T06:29:29.613 INFO:tasks.workunit.client.1.smithi079.stdout:3/127: creat d1a/f29 x:0 0 0 2024-05-09T06:29:29.613 INFO:tasks.workunit.client.1.smithi079.stdout:3/128: creat d1a/d1c/d22/f2a x:0 0 0 2024-05-09T06:29:29.619 INFO:tasks.workunit.client.1.smithi079.stdout:2/205: dread d8/db/f19 [0,4194304] 0 2024-05-09T06:29:29.619 INFO:tasks.workunit.client.1.smithi079.stdout:0/184: dwrite d3/dd/d1f/f1d [0,4194304] 0 2024-05-09T06:29:29.623 INFO:tasks.workunit.client.1.smithi079.stdout:2/206: symlink d8/db/dc/d2c/l4a 0 2024-05-09T06:29:29.627 INFO:tasks.workunit.client.1.smithi079.stdout:2/207: mkdir d8/db/d4b 0 2024-05-09T06:29:29.628 INFO:tasks.workunit.client.1.smithi079.stdout:9/340: dwrite d1/d33/d2b/f53 [0,4194304] 0 2024-05-09T06:29:29.630 INFO:tasks.workunit.client.1.smithi079.stdout:5/192: dwrite d13/f17 [0,4194304] 0 2024-05-09T06:29:29.632 INFO:tasks.workunit.client.1.smithi079.stdout:2/208: creat d8/d3c/f4c x:0 0 0 2024-05-09T06:29:29.635 INFO:tasks.workunit.client.1.smithi079.stdout:3/129: dwrite d1a/d1c/d22/f26 [0,4194304] 0 2024-05-09T06:29:29.639 INFO:tasks.workunit.client.1.smithi079.stdout:1/168: rmdir d0/d12/d16 39 2024-05-09T06:29:29.645 INFO:tasks.workunit.client.1.smithi079.stdout:9/341: mkdir d1/d33/d28/d3e/d75 0 2024-05-09T06:29:29.645 INFO:tasks.workunit.client.1.smithi079.stdout:9/342: chown d1/d33/d28/d3e/l63 0 1 2024-05-09T06:29:29.647 INFO:tasks.workunit.client.1.smithi079.stdout:0/185: rmdir d3/d5 39 2024-05-09T06:29:29.648 INFO:tasks.workunit.client.1.smithi079.stdout:5/193: creat d13/f48 x:0 0 0 2024-05-09T06:29:29.650 INFO:tasks.workunit.client.1.smithi079.stdout:2/209: symlink d8/db/d11/l4d 0 2024-05-09T06:29:29.650 INFO:tasks.workunit.client.1.smithi079.stdout:2/210: write d8/db/dc/f34 [1031303,53156] 0 2024-05-09T06:29:29.654 INFO:tasks.workunit.client.1.smithi079.stdout:3/130: dread - f15 zero size 2024-05-09T06:29:29.656 INFO:tasks.workunit.client.1.smithi079.stdout:1/169: mknod d0/d12/d27/c3d 0 2024-05-09T06:29:29.657 INFO:tasks.workunit.client.1.smithi079.stdout:9/343: unlink d1/d5/f52 0 2024-05-09T06:29:29.658 INFO:tasks.workunit.client.1.smithi079.stdout:9/344: write d1/d33/d28/d4c/d4e/d2d/f69 [922550,5632] 0 2024-05-09T06:29:29.659 INFO:tasks.workunit.client.1.smithi079.stdout:0/186: unlink d3/d5/f2b 0 2024-05-09T06:29:29.661 INFO:tasks.workunit.client.1.smithi079.stdout:5/194: unlink d13/d43/c29 0 2024-05-09T06:29:29.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:29 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:29.662 INFO:tasks.workunit.client.1.smithi079.stdout:1/170: write d0/d12/f1a [3151894,61476] 0 2024-05-09T06:29:29.664 INFO:tasks.workunit.client.1.smithi079.stdout:3/131: creat d1a/d1c/d28/f2b x:0 0 0 2024-05-09T06:29:29.664 INFO:tasks.workunit.client.1.smithi079.stdout:3/132: stat d1a/d21 0 2024-05-09T06:29:29.666 INFO:tasks.workunit.client.1.smithi079.stdout:9/345: creat d1/d33/f76 x:0 0 0 2024-05-09T06:29:29.667 INFO:tasks.workunit.client.1.smithi079.stdout:0/187: creat d3/d5/f40 x:0 0 0 2024-05-09T06:29:29.667 INFO:tasks.workunit.client.1.smithi079.stdout:0/188: write d3/dd/d1f/f13 [3380879,23927] 0 2024-05-09T06:29:29.668 INFO:tasks.workunit.client.1.smithi079.stdout:0/189: chown d3/f4 5100693 1 2024-05-09T06:29:29.669 INFO:tasks.workunit.client.1.smithi079.stdout:5/195: getdents d13/d43/d26 0 2024-05-09T06:29:29.669 INFO:tasks.workunit.client.1.smithi079.stdout:5/196: write d13/d43/d26/f3e [950515,72088] 0 2024-05-09T06:29:29.672 INFO:tasks.workunit.client.1.smithi079.stdout:9/346: unlink d1/d33/f65 0 2024-05-09T06:29:29.672 INFO:tasks.workunit.client.1.smithi079.stdout:9/347: chown d1/d45/f66 735531 1 2024-05-09T06:29:29.672 INFO:tasks.workunit.client.1.smithi079.stdout:9/348: chown d1/d33/d28/d36/d38/l5a 8994 1 2024-05-09T06:29:29.676 INFO:tasks.workunit.client.1.smithi079.stdout:5/197: mknod d13/c49 0 2024-05-09T06:29:29.679 INFO:tasks.workunit.client.1.smithi079.stdout:9/349: creat d1/d33/d28/d3e/d75/f77 x:0 0 0 2024-05-09T06:29:29.679 INFO:tasks.workunit.client.1.smithi079.stdout:9/350: chown d1/d33/d28/d36/d4d 51 1 2024-05-09T06:29:29.680 INFO:tasks.workunit.client.1.smithi079.stdout:5/198: mknod d13/d43/d39/c4a 0 2024-05-09T06:29:29.683 INFO:tasks.workunit.client.1.smithi079.stdout:9/351: symlink d1/d33/d2b/l78 0 2024-05-09T06:29:29.685 INFO:tasks.workunit.client.1.smithi079.stdout:1/171: dwrite d0/d12/f18 [0,4194304] 0 2024-05-09T06:29:29.685 INFO:tasks.workunit.client.1.smithi079.stdout:1/172: write d0/d12/f1a [1664026,47198] 0 2024-05-09T06:29:29.686 INFO:tasks.workunit.client.1.smithi079.stdout:3/133: dwrite f15 [0,4194304] 0 2024-05-09T06:29:29.686 INFO:tasks.workunit.client.1.smithi079.stdout:3/134: creat d1a/f2c x:0 0 0 2024-05-09T06:29:29.686 INFO:tasks.workunit.client.1.smithi079.stdout:9/352: symlink d1/l79 0 2024-05-09T06:29:29.694 INFO:tasks.workunit.client.1.smithi079.stdout:1/173: mkdir d0/d7/d3e 0 2024-05-09T06:29:29.697 INFO:tasks.workunit.client.1.smithi079.stdout:0/190: dwrite d3/d5/fe [0,4194304] 0 2024-05-09T06:29:29.697 INFO:tasks.workunit.client.1.smithi079.stdout:0/191: chown d3/dd/d1f/c2f 950 1 2024-05-09T06:29:29.697 INFO:tasks.workunit.client.1.smithi079.stdout:5/199: dwrite f11 [0,4194304] 0 2024-05-09T06:29:29.698 INFO:tasks.workunit.client.1.smithi079.stdout:5/200: write d13/d43/d26/f2e [1271740,41907] 0 2024-05-09T06:29:29.698 INFO:tasks.workunit.client.1.smithi079.stdout:5/201: write d13/f19 [2082962,121037] 0 2024-05-09T06:29:29.698 INFO:tasks.workunit.client.1.smithi079.stdout:5/202: chown d13/d43/d3d/d45 26389406 1 2024-05-09T06:29:29.700 INFO:tasks.workunit.client.1.smithi079.stdout:3/135: creat d1a/d1c/f2d x:0 0 0 2024-05-09T06:29:29.704 INFO:tasks.workunit.client.1.smithi079.stdout:1/174: creat d0/d12/d16/f3f x:0 0 0 2024-05-09T06:29:29.709 INFO:tasks.workunit.client.1.smithi079.stdout:0/192: rename d3/dd/d1f/l19 to d3/dd/d1f/d1e/d2c/d35/d36/l41 0 2024-05-09T06:29:29.713 INFO:tasks.workunit.client.1.smithi079.stdout:5/203: creat d13/d2a/f4b x:0 0 0 2024-05-09T06:29:29.713 INFO:tasks.workunit.client.1.smithi079.stdout:5/204: fsync d13/d43/d26/f3c 0 2024-05-09T06:29:29.716 INFO:tasks.workunit.client.1.smithi079.stdout:1/175: link d0/d12/d27/l37 d0/d7/d11/d20/d39/l40 0 2024-05-09T06:29:29.718 INFO:tasks.workunit.client.1.smithi079.stdout:9/353: rename d1/d33/d28/f34 to d1/d6/d7/f7a 0 2024-05-09T06:29:29.720 INFO:tasks.workunit.client.1.smithi079.stdout:0/193: creat d3/dd/d1f/d1e/f42 x:0 0 0 2024-05-09T06:29:29.723 INFO:tasks.workunit.client.1.smithi079.stdout:0/194: link d3/dd/d1f/c2f d3/dd/d1f/d1e/d2c/c43 0 2024-05-09T06:29:29.724 INFO:tasks.workunit.client.1.smithi079.stdout:1/176: dread d0/d12/f18 [0,4194304] 0 2024-05-09T06:29:29.724 INFO:tasks.workunit.client.1.smithi079.stdout:0/195: write d3/dd/d1f/f29 [394492,91142] 0 2024-05-09T06:29:29.726 INFO:tasks.workunit.client.1.smithi079.stdout:3/136: dread f5 [0,4194304] 0 2024-05-09T06:29:29.726 INFO:tasks.workunit.client.1.smithi079.stdout:3/137: dread - d1a/f2c zero size 2024-05-09T06:29:29.731 INFO:tasks.workunit.client.1.smithi079.stdout:0/196: dread d3/dd/d1f/f28 [0,4194304] 0 2024-05-09T06:29:29.736 INFO:tasks.workunit.client.1.smithi079.stdout:3/138: read f5 [4015321,68338] 0 2024-05-09T06:29:29.744 INFO:tasks.workunit.client.1.smithi079.stdout:9/354: dwrite d1/d33/d28/d4c/d4e/f4a [4194304,4194304] 0 2024-05-09T06:29:29.744 INFO:tasks.workunit.client.1.smithi079.stdout:9/355: creat d1/d33/d28/d36/f7b x:0 0 0 2024-05-09T06:29:29.758 INFO:tasks.workunit.client.1.smithi079.stdout:9/356: write d1/d5/f10 [153789,28806] 0 2024-05-09T06:29:29.758 INFO:tasks.workunit.client.1.smithi079.stdout:9/357: write d1/f17 [632337,80471] 0 2024-05-09T06:29:29.760 INFO:tasks.workunit.client.1.smithi079.stdout:9/358: creat d1/d33/d48/d64/f7c x:0 0 0 2024-05-09T06:29:29.761 INFO:tasks.workunit.client.1.smithi079.stdout:9/359: fdatasync d1/d45/f59 0 2024-05-09T06:29:29.785 INFO:tasks.workunit.client.1.smithi079.stdout:7/267: sync 2024-05-09T06:29:29.785 INFO:tasks.workunit.client.1.smithi079.stdout:8/144: sync 2024-05-09T06:29:29.785 INFO:tasks.workunit.client.1.smithi079.stdout:7/268: fdatasync d4/d30/d32/f35 0 2024-05-09T06:29:29.785 INFO:tasks.workunit.client.1.smithi079.stdout:7/269: truncate d4/d30/d31/f33 5027803 0 2024-05-09T06:29:29.785 INFO:tasks.workunit.client.1.smithi079.stdout:8/145: creat d1/d5/dc/f34 x:0 0 0 2024-05-09T06:29:29.789 INFO:tasks.workunit.client.1.smithi079.stdout:8/146: creat d1/d18/f35 x:0 0 0 2024-05-09T06:29:29.791 INFO:tasks.workunit.client.1.smithi079.stdout:5/205: truncate d13/f17 1767991 0 2024-05-09T06:29:29.794 INFO:tasks.workunit.client.1.smithi079.stdout:7/270: rmdir d4/d30 39 2024-05-09T06:29:29.795 INFO:tasks.workunit.client.1.smithi079.stdout:7/271: write d4/d7/f13 [1977755,127421] 0 2024-05-09T06:29:29.804 INFO:tasks.workunit.client.1.smithi079.stdout:8/147: dwrite d1/d3/d20/f32 [0,4194304] 0 2024-05-09T06:29:29.810 INFO:tasks.workunit.client.1.smithi079.stdout:8/148: mkdir d1/d5/d36 0 2024-05-09T06:29:29.816 INFO:tasks.workunit.client.1.smithi079.stdout:8/149: dread d1/d3/f6 [0,4194304] 0 2024-05-09T06:29:29.818 INFO:tasks.workunit.client.1.smithi079.stdout:8/150: symlink d1/db/l37 0 2024-05-09T06:29:29.819 INFO:tasks.workunit.client.1.smithi079.stdout:8/151: read - d1/d18/f35 zero size 2024-05-09T06:29:29.819 INFO:tasks.workunit.client.1.smithi079.stdout:8/152: chown d1/db/c1e 66 1 2024-05-09T06:29:29.819 INFO:tasks.workunit.client.1.smithi079.stdout:8/153: readlink d1/l2 0 2024-05-09T06:29:29.820 INFO:tasks.workunit.client.1.smithi079.stdout:8/154: mknod d1/d18/c38 0 2024-05-09T06:29:29.822 INFO:tasks.workunit.client.1.smithi079.stdout:8/155: dread d1/d5/dc/f1d [0,4194304] 0 2024-05-09T06:29:29.823 INFO:tasks.workunit.client.1.smithi079.stdout:8/156: creat d1/d18/f39 x:0 0 0 2024-05-09T06:29:29.826 INFO:tasks.workunit.client.1.smithi079.stdout:8/157: mknod d1/d5/c3a 0 2024-05-09T06:29:29.835 INFO:tasks.workunit.client.1.smithi079.stdout:3/139: rmdir d1a 39 2024-05-09T06:29:29.840 INFO:tasks.workunit.client.1.smithi079.stdout:3/140: unlink f8 0 2024-05-09T06:29:29.842 INFO:tasks.workunit.client.1.smithi079.stdout:1/177: getdents d0/d12/d16 0 2024-05-09T06:29:29.843 INFO:tasks.workunit.client.1.smithi079.stdout:1/178: dread d0/f5 [0,4194304] 0 2024-05-09T06:29:29.844 INFO:tasks.workunit.client.1.smithi079.stdout:3/141: truncate f3 512675 0 2024-05-09T06:29:29.848 INFO:tasks.workunit.client.1.smithi079.stdout:3/142: mknod d1a/d1c/d22/c2e 0 2024-05-09T06:29:29.848 INFO:tasks.workunit.client.1.smithi079.stdout:3/143: chown fc 22495187 1 2024-05-09T06:29:29.850 INFO:tasks.workunit.client.1.smithi079.stdout:3/144: creat d1a/d1d/f2f x:0 0 0 2024-05-09T06:29:29.852 INFO:tasks.workunit.client.1.smithi079.stdout:1/179: read d0/d7/fc [3872034,125981] 0 2024-05-09T06:29:29.852 INFO:tasks.workunit.client.1.smithi079.stdout:1/180: dread - d0/d7/d11/f2e zero size 2024-05-09T06:29:29.852 INFO:tasks.workunit.client.1.smithi079.stdout:1/181: readlink d0/d12/d16/l3c 0 2024-05-09T06:29:29.854 INFO:tasks.workunit.client.1.smithi079.stdout:3/145: creat d1a/d1c/d22/f30 x:0 0 0 2024-05-09T06:29:29.857 INFO:tasks.workunit.client.1.smithi079.stdout:1/182: unlink d0/df/f1b 0 2024-05-09T06:29:29.860 INFO:tasks.workunit.client.1.smithi079.stdout:3/146: creat d1a/d1c/d1f/f31 x:0 0 0 2024-05-09T06:29:29.865 INFO:tasks.workunit.client.1.smithi079.stdout:3/147: getdents d1a/d1c/d28 0 2024-05-09T06:29:29.868 INFO:tasks.workunit.client.1.smithi079.stdout:9/360: rename d1/d6/d7 to d1/d33/d28/d36/d4d/d7d 0 2024-05-09T06:29:29.871 INFO:tasks.workunit.client.1.smithi079.stdout:3/148: mknod d1a/d1c/c32 0 2024-05-09T06:29:29.872 INFO:tasks.workunit.client.1.smithi079.stdout:9/361: dread d1/d33/d28/d36/d4d/d7d/d19/f1e [0,4194304] 0 2024-05-09T06:29:29.872 INFO:tasks.workunit.client.1.smithi079.stdout:9/362: dread - d1/d33/d28/d3e/d6d/f73 zero size 2024-05-09T06:29:29.874 INFO:tasks.workunit.client.1.smithi079.stdout:5/206: rename d13/d43/c1d to d13/d2a/c4c 0 2024-05-09T06:29:29.877 INFO:tasks.workunit.client.1.smithi079.stdout:3/149: unlink d1a/f1b 0 2024-05-09T06:29:29.878 INFO:tasks.workunit.client.1.smithi079.stdout:3/150: dread - d1a/d1c/f2d zero size 2024-05-09T06:29:29.881 INFO:tasks.workunit.client.1.smithi079.stdout:3/151: mknod d1a/d1c/d1f/c33 0 2024-05-09T06:29:29.881 INFO:tasks.workunit.client.1.smithi079.stdout:3/152: read - d1a/d1c/f24 zero size 2024-05-09T06:29:29.883 INFO:tasks.workunit.client.1.smithi079.stdout:5/207: dread d13/d43/d26/f33 [0,4194304] 0 2024-05-09T06:29:29.883 INFO:tasks.workunit.client.1.smithi079.stdout:5/208: chown d13/f17 3 1 2024-05-09T06:29:29.883 INFO:tasks.workunit.client.1.smithi079.stdout:9/363: dwrite d1/d5/d5b/f71 [0,4194304] 0 2024-05-09T06:29:29.884 INFO:tasks.workunit.client.1.smithi079.stdout:3/153: mkdir d1a/d1d/d34 0 2024-05-09T06:29:29.886 INFO:tasks.workunit.client.1.smithi079.stdout:5/209: mkdir d13/d4d 0 2024-05-09T06:29:29.886 INFO:tasks.workunit.client.1.smithi079.stdout:5/210: creat d13/d2a/f4e x:0 0 0 2024-05-09T06:29:29.890 INFO:tasks.workunit.client.1.smithi079.stdout:9/364: mkdir d1/d5/d7e 0 2024-05-09T06:29:29.895 INFO:tasks.workunit.client.1.smithi079.stdout:5/211: mkdir d13/d4f 0 2024-05-09T06:29:29.898 INFO:tasks.workunit.client.1.smithi079.stdout:9/365: symlink d1/d33/d28/d36/d38/d3a/d56/l7f 0 2024-05-09T06:29:29.898 INFO:tasks.workunit.client.1.smithi079.stdout:9/366: write d1/f17 [710155,110301] 0 2024-05-09T06:29:29.898 INFO:tasks.workunit.client.1.smithi079.stdout:5/212: dread fc [0,4194304] 0 2024-05-09T06:29:29.898 INFO:tasks.workunit.client.1.smithi079.stdout:3/154: dwrite fb [0,4194304] 0 2024-05-09T06:29:29.902 INFO:tasks.workunit.client.1.smithi079.stdout:9/367: dread d1/d33/d28/d36/d4d/d7d/f22 [0,4194304] 0 2024-05-09T06:29:29.908 INFO:tasks.workunit.client.1.smithi079.stdout:9/368: unlink d1/d6/c6a 0 2024-05-09T06:29:29.921 INFO:tasks.workunit.client.1.smithi079.stdout:5/213: dwrite d13/d43/f2f [0,4194304] 0 2024-05-09T06:29:29.925 INFO:tasks.workunit.client.1.smithi079.stdout:5/214: dread d13/f1a [0,4194304] 0 2024-05-09T06:29:29.925 INFO:tasks.workunit.client.1.smithi079.stdout:9/369: dwrite d1/d33/d28/d36/d38/d3a/f57 [4194304,4194304] 0 2024-05-09T06:29:29.928 INFO:tasks.workunit.client.1.smithi079.stdout:5/215: mknod d13/d43/d3d/d40/c50 0 2024-05-09T06:29:29.929 INFO:tasks.workunit.client.1.smithi079.stdout:9/370: creat d1/d33/d28/d36/d4d/d7d/d19/f80 x:0 0 0 2024-05-09T06:29:29.931 INFO:tasks.workunit.client.1.smithi079.stdout:5/216: mkdir d13/d43/d51 0 2024-05-09T06:29:29.931 INFO:tasks.workunit.client.1.smithi079.stdout:5/217: chown c10 5 1 2024-05-09T06:29:29.931 INFO:tasks.workunit.client.1.smithi079.stdout:5/218: creat d13/f52 x:0 0 0 2024-05-09T06:29:29.931 INFO:tasks.workunit.client.1.smithi079.stdout:5/219: fdatasync d13/d43/f20 0 2024-05-09T06:29:29.932 INFO:tasks.workunit.client.1.smithi079.stdout:9/371: creat d1/f81 x:0 0 0 2024-05-09T06:29:29.948 INFO:tasks.workunit.client.1.smithi079.stdout:6/160: sync 2024-05-09T06:29:29.948 INFO:tasks.workunit.client.1.smithi079.stdout:6/161: fsync d0/f12 0 2024-05-09T06:29:29.948 INFO:tasks.workunit.client.1.smithi079.stdout:6/162: fdatasync d0/d6/d1b/d20/f2f 0 2024-05-09T06:29:29.950 INFO:tasks.workunit.client.1.smithi079.stdout:6/163: getdents d0/d6 0 2024-05-09T06:29:29.951 INFO:tasks.workunit.client.1.smithi079.stdout:6/164: getdents d0/d6/d16/d28 0 2024-05-09T06:29:29.951 INFO:tasks.workunit.client.1.smithi079.stdout:6/165: chown d0/l1d 6599 1 2024-05-09T06:29:29.953 INFO:tasks.workunit.client.1.smithi079.stdout:6/166: symlink d0/d6/d1b/d2d/l34 0 2024-05-09T06:29:29.953 INFO:tasks.workunit.client.1.smithi079.stdout:6/167: stat d0/d6/d16/d28 0 2024-05-09T06:29:29.955 INFO:tasks.workunit.client.1.smithi079.stdout:6/168: creat d0/de/f35 x:0 0 0 2024-05-09T06:29:29.956 INFO:tasks.workunit.client.1.smithi079.stdout:6/169: mkdir d0/d6/d16/d1f/d36 0 2024-05-09T06:29:29.956 INFO:tasks.workunit.client.1.smithi079.stdout:6/170: stat d0 0 2024-05-09T06:29:29.959 INFO:tasks.workunit.client.1.smithi079.stdout:6/171: link d0/d6/c17 d0/d6/d16/d1f/c37 0 2024-05-09T06:29:29.960 INFO:tasks.workunit.client.1.smithi079.stdout:5/220: dwrite d13/f19 [0,4194304] 0 2024-05-09T06:29:29.960 INFO:tasks.workunit.client.1.smithi079.stdout:5/221: chown d13 39075 1 2024-05-09T06:29:29.960 INFO:tasks.workunit.client.1.smithi079.stdout:9/372: dwrite d1/d33/d28/d4c/f70 [0,4194304] 0 2024-05-09T06:29:29.960 INFO:tasks.workunit.client.1.smithi079.stdout:9/373: truncate d1/d5/f58 103028 0 2024-05-09T06:29:29.960 INFO:tasks.workunit.client.1.smithi079.stdout:9/374: fdatasync d1/d33/d28/d4c/f70 0 2024-05-09T06:29:29.962 INFO:tasks.workunit.client.1.smithi079.stdout:5/222: mkdir d13/d43/d3d/d40/d53 0 2024-05-09T06:29:29.973 INFO:tasks.workunit.client.1.smithi079.stdout:5/223: symlink d13/d43/l54 0 2024-05-09T06:29:29.973 INFO:tasks.workunit.client.1.smithi079.stdout:5/224: stat d13/d43/d3d/l46 0 2024-05-09T06:29:29.975 INFO:tasks.workunit.client.1.smithi079.stdout:9/375: unlink d1/d6/l6f 0 2024-05-09T06:29:29.976 INFO:tasks.workunit.client.1.smithi079.stdout:6/172: dwrite d0/f15 [0,4194304] 0 2024-05-09T06:29:29.977 INFO:tasks.workunit.client.1.smithi079.stdout:6/173: creat d0/d6/d1b/d20/f38 x:0 0 0 2024-05-09T06:29:29.977 INFO:tasks.workunit.client.1.smithi079.stdout:5/225: rename d13/d43/d26/l27 to d13/d43/d26/l55 0 2024-05-09T06:29:29.977 INFO:tasks.workunit.client.1.smithi079.stdout:5/226: write d13/f37 [557688,2823] 0 2024-05-09T06:29:29.979 INFO:tasks.workunit.client.1.smithi079.stdout:9/376: rename d1/d33/d28/d4c/f70 to d1/d45/f82 0 2024-05-09T06:29:29.979 INFO:tasks.workunit.client.1.smithi079.stdout:9/377: stat d1/l79 0 2024-05-09T06:29:29.980 INFO:tasks.workunit.client.1.smithi079.stdout:9/378: readlink d1/d33/l4f 0 2024-05-09T06:29:29.980 INFO:tasks.workunit.client.1.smithi079.stdout:9/379: chown d1/d33/d28/d4c/d4e/d2d/l47 169551 1 2024-05-09T06:29:29.981 INFO:tasks.workunit.client.1.smithi079.stdout:5/227: dread d13/d43/d26/f2e [0,4194304] 0 2024-05-09T06:29:29.982 INFO:tasks.workunit.client.1.smithi079.stdout:5/228: write fc [2255453,11346] 0 2024-05-09T06:29:29.987 INFO:tasks.workunit.client.1.smithi079.stdout:6/174: symlink d0/d6/d16/d1f/d36/l39 0 2024-05-09T06:29:29.987 INFO:tasks.workunit.client.1.smithi079.stdout:6/175: fsync d0/d6/f14 0 2024-05-09T06:29:29.987 INFO:tasks.workunit.client.1.smithi079.stdout:6/176: getdents d0/d6/d16/d28 0 2024-05-09T06:29:29.990 INFO:tasks.workunit.client.1.smithi079.stdout:5/229: rmdir d13/d43/d3d/d45 0 2024-05-09T06:29:29.991 INFO:tasks.workunit.client.1.smithi079.stdout:9/380: dread d1/d33/d28/d36/d4d/d7d/f31 [4194304,4194304] 0 2024-05-09T06:29:29.994 INFO:tasks.workunit.client.1.smithi079.stdout:9/381: symlink d1/d33/d28/d36/d4d/l83 0 2024-05-09T06:29:29.995 INFO:tasks.workunit.client.1.smithi079.stdout:6/177: read d0/f12 [1955481,116634] 0 2024-05-09T06:29:29.995 INFO:tasks.workunit.client.1.smithi079.stdout:6/178: fsync d0/d6/d1b/d20/f2f 0 2024-05-09T06:29:29.998 INFO:tasks.workunit.client.1.smithi079.stdout:9/382: mknod d1/d33/d48/c84 0 2024-05-09T06:29:29.998 INFO:tasks.workunit.client.1.smithi079.stdout:9/383: fsync d1/d33/d28/d3e/d6d/f73 0 2024-05-09T06:29:30.008 INFO:tasks.workunit.client.1.smithi079.stdout:9/384: dread d1/d33/d28/d36/d4d/d7d/f7a [0,4194304] 0 2024-05-09T06:29:30.010 INFO:tasks.workunit.client.1.smithi079.stdout:3/155: dwrite f3 [0,4194304] 0 2024-05-09T06:29:30.010 INFO:tasks.workunit.client.1.smithi079.stdout:3/156: chown d1a/l1e 55441838 1 2024-05-09T06:29:30.010 INFO:tasks.workunit.client.1.smithi079.stdout:3/157: dread - d1a/f29 zero size 2024-05-09T06:29:30.015 INFO:tasks.workunit.client.1.smithi079.stdout:3/158: truncate f13 788655 0 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:0/197: sync 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:2/211: sync 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:4/286: sync 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:0/198: chown d3 2671106 1 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:4/287: chown d6/d8/f50 200594 1 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:4/288: chown d6/d15/l3e 3 1 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:4/289: dread - d6/d8/f49 zero size 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:2/212: write d8/db/d11/f45 [951928,39136] 0 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:2/213: chown d8/db/dc/d2c/f31 425673 1 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:2/214: fsync d8/db/d11/f3f 0 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:2/215: creat d8/f4e x:0 0 0 2024-05-09T06:29:30.018 INFO:tasks.workunit.client.1.smithi079.stdout:2/216: fdatasync d8/db/dc/d2c/d2d/f46 0 2024-05-09T06:29:30.021 INFO:tasks.workunit.client.1.smithi079.stdout:3/159: creat d1a/f35 x:0 0 0 2024-05-09T06:29:30.021 INFO:tasks.workunit.client.1.smithi079.stdout:3/160: read - d1a/f35 zero size 2024-05-09T06:29:30.021 INFO:tasks.workunit.client.1.smithi079.stdout:3/161: creat d1a/d1c/d22/f36 x:0 0 0 2024-05-09T06:29:30.022 INFO:tasks.workunit.client.1.smithi079.stdout:3/162: dread f13 [0,4194304] 0 2024-05-09T06:29:30.025 INFO:tasks.workunit.client.1.smithi079.stdout:4/290: link d6/dd/df/f13 d6/d15/f5c 0 2024-05-09T06:29:30.025 INFO:tasks.workunit.client.1.smithi079.stdout:4/291: stat d6/dd/df/f13 0 2024-05-09T06:29:30.027 INFO:tasks.workunit.client.1.smithi079.stdout:4/292: dread d6/d1a/d26/d2a/d54/fc [0,4194304] 0 2024-05-09T06:29:30.029 INFO:tasks.workunit.client.1.smithi079.stdout:4/293: write d6/dd/df/f3b [585210,19285] 0 2024-05-09T06:29:30.029 INFO:tasks.workunit.client.1.smithi079.stdout:4/294: chown d6/l4c 6753656 1 2024-05-09T06:29:30.029 INFO:tasks.workunit.client.1.smithi079.stdout:4/295: fdatasync d6/dd/f36 0 2024-05-09T06:29:30.031 INFO:tasks.workunit.client.1.smithi079.stdout:2/217: rename d8/db/dc/d2c/d2d to d8/db/d4b/d4f 0 2024-05-09T06:29:30.036 INFO:tasks.workunit.client.1.smithi079.stdout:3/163: link f5 d1a/d1d/d34/f37 0 2024-05-09T06:29:30.038 INFO:tasks.workunit.client.1.smithi079.stdout:4/296: write d6/d1a/d26/d2a/d54/f23 [2125136,41842] 0 2024-05-09T06:29:30.040 INFO:tasks.workunit.client.1.smithi079.stdout:2/218: symlink d8/db/d4b/l50 0 2024-05-09T06:29:30.041 INFO:tasks.workunit.client.1.smithi079.stdout:0/199: dwrite d3/d5/d27/f32 [0,4194304] 0 2024-05-09T06:29:30.041 INFO:tasks.workunit.client.1.smithi079.stdout:0/200: stat d3 0 2024-05-09T06:29:30.044 INFO:tasks.workunit.client.1.smithi079.stdout:4/297: symlink d6/d1a/d41/l5d 0 2024-05-09T06:29:30.044 INFO:tasks.workunit.client.1.smithi079.stdout:4/298: write d6/fa [434714,68341] 0 2024-05-09T06:29:30.045 INFO:tasks.workunit.client.1.smithi079.stdout:2/219: mkdir d8/db/d4b/d4f/d51 0 2024-05-09T06:29:30.049 INFO:tasks.workunit.client.1.smithi079.stdout:0/201: link d3/dd/d1f/f29 d3/d5/d27/f44 0 2024-05-09T06:29:30.049 INFO:tasks.workunit.client.1.smithi079.stdout:0/202: readlink d3/lc 0 2024-05-09T06:29:30.051 INFO:tasks.workunit.client.1.smithi079.stdout:3/164: truncate fa 65404 0 2024-05-09T06:29:30.052 INFO:tasks.workunit.client.1.smithi079.stdout:2/220: getdents d8/db 0 2024-05-09T06:29:30.055 INFO:tasks.workunit.client.1.smithi079.stdout:0/203: rename d3/dd/d1f/d1e/d2c/d35/d36/c38 to d3/c45 0 2024-05-09T06:29:30.058 INFO:tasks.workunit.client.1.smithi079.stdout:3/165: link d1a/d1c/d22/f2a d1a/d1d/d34/f38 0 2024-05-09T06:29:30.058 INFO:tasks.workunit.client.1.smithi079.stdout:3/166: dread - d1a/f35 zero size 2024-05-09T06:29:30.063 INFO:tasks.workunit.client.1.smithi079.stdout:2/221: dread f3 [0,4194304] 0 2024-05-09T06:29:30.063 INFO:tasks.workunit.client.1.smithi079.stdout:2/222: stat d8/db/d4b 0 2024-05-09T06:29:30.063 INFO:tasks.workunit.client.1.smithi079.stdout:2/223: write d8/db/d11/f30 [961635,106554] 0 2024-05-09T06:29:30.064 INFO:tasks.workunit.client.1.smithi079.stdout:4/299: dwrite d6/d1a/d26/d2a/d54/f17 [0,4194304] 0 2024-05-09T06:29:30.070 INFO:tasks.workunit.client.1.smithi079.stdout:2/224: unlink d8/db/c1f 0 2024-05-09T06:29:30.070 INFO:tasks.workunit.client.1.smithi079.stdout:2/225: fsync f5 0 2024-05-09T06:29:30.070 INFO:tasks.workunit.client.1.smithi079.stdout:2/226: truncate d8/db/dc/d2c/d2e/f3e 545693 0 2024-05-09T06:29:30.070 INFO:tasks.workunit.client.1.smithi079.stdout:2/227: write d8/db/d11/f2f [1206622,12807] 0 2024-05-09T06:29:30.081 INFO:tasks.workunit.client.1.smithi079.stdout:2/228: creat d8/db/f52 x:0 0 0 2024-05-09T06:29:30.081 INFO:tasks.workunit.client.1.smithi079.stdout:2/229: dread - d8/f49 zero size 2024-05-09T06:29:30.081 INFO:tasks.workunit.client.1.smithi079.stdout:2/230: getdents d8/db/d4b/d4f/d51 0 2024-05-09T06:29:30.087 INFO:tasks.workunit.client.1.smithi079.stdout:2/231: symlink d8/db/d4b/d4f/d51/l53 0 2024-05-09T06:29:30.087 INFO:tasks.workunit.client.1.smithi079.stdout:2/232: readlink d8/l16 0 2024-05-09T06:29:30.097 INFO:tasks.workunit.client.1.smithi079.stdout:2/233: dread d8/db/d11/f24 [0,4194304] 0 2024-05-09T06:29:30.097 INFO:tasks.workunit.client.1.smithi079.stdout:2/234: creat d8/db/dc/d2c/d2e/f54 x:0 0 0 2024-05-09T06:29:30.110 INFO:tasks.workunit.client.1.smithi079.stdout:5/230: getdents d13/d43/d3d/d40 0 2024-05-09T06:29:30.110 INFO:tasks.workunit.client.1.smithi079.stdout:5/231: getdents d13/d43/d3d/d40 0 2024-05-09T06:29:30.112 INFO:tasks.workunit.client.1.smithi079.stdout:5/232: creat d13/d43/d26/d35/f56 x:0 0 0 2024-05-09T06:29:30.112 INFO:tasks.workunit.client.1.smithi079.stdout:5/233: readlink d13/d43/l54 0 2024-05-09T06:29:30.112 INFO:tasks.workunit.client.1.smithi079.stdout:7/272: sync 2024-05-09T06:29:30.114 INFO:tasks.workunit.client.1.smithi079.stdout:5/234: link d13/d43/f20 d13/d43/d26/f57 0 2024-05-09T06:29:30.115 INFO:tasks.workunit.client.1.smithi079.stdout:7/273: link d4/d7/d37/f4a d4/d7/d37/f4d 0 2024-05-09T06:29:30.117 INFO:tasks.workunit.client.1.smithi079.stdout:5/235: creat d13/d43/d39/f58 x:0 0 0 2024-05-09T06:29:30.117 INFO:tasks.workunit.client.1.smithi079.stdout:5/236: dread - d13/d2a/f4e zero size 2024-05-09T06:29:30.120 INFO:tasks.workunit.client.1.smithi079.stdout:5/237: mkdir d13/d59 0 2024-05-09T06:29:30.123 INFO:tasks.workunit.client.1.smithi079.stdout:5/238: stat ce 0 2024-05-09T06:29:30.123 INFO:tasks.workunit.client.1.smithi079.stdout:5/239: creat d13/f5a x:0 0 0 2024-05-09T06:29:30.123 INFO:tasks.workunit.client.1.smithi079.stdout:9/385: getdents d1/d33/d28/d4c 0 2024-05-09T06:29:30.123 INFO:tasks.workunit.client.1.smithi079.stdout:9/386: dread - d1/d33/d28/d36/f67 zero size 2024-05-09T06:29:30.128 INFO:tasks.workunit.client.1.smithi079.stdout:5/240: rename d13/d43/d3d/d40/c50 to d13/d43/c5b 0 2024-05-09T06:29:30.130 INFO:tasks.workunit.client.1.smithi079.stdout:9/387: link d1/d45/f59 d1/d33/d28/d3e/d6d/f85 0 2024-05-09T06:29:30.131 INFO:tasks.workunit.client.1.smithi079.stdout:8/158: sync 2024-05-09T06:29:30.131 INFO:tasks.workunit.client.1.smithi079.stdout:1/183: sync 2024-05-09T06:29:30.131 INFO:tasks.workunit.client.1.smithi079.stdout:7/274: dwrite d4/d30/d31/d34/f3c [0,4194304] 0 2024-05-09T06:29:30.136 INFO:tasks.workunit.client.1.smithi079.stdout:1/184: rename d0/d12/d16/f3f to d0/d12/d31/f41 0 2024-05-09T06:29:30.138 INFO:tasks.workunit.client.1.smithi079.stdout:8/159: mkdir d1/d3/d20/d22/d3b 0 2024-05-09T06:29:30.138 INFO:tasks.workunit.client.1.smithi079.stdout:8/160: chown d1/db/c1e 1447570 1 2024-05-09T06:29:30.141 INFO:tasks.workunit.client.1.smithi079.stdout:9/388: read d1/d6/f1c [3425323,102684] 0 2024-05-09T06:29:30.141 INFO:tasks.workunit.client.1.smithi079.stdout:9/389: write d1/d33/d28/d3e/d75/f77 [255502,73649] 0 2024-05-09T06:29:30.142 INFO:tasks.workunit.client.1.smithi079.stdout:1/185: creat d0/d7/d11/d20/d39/f42 x:0 0 0 2024-05-09T06:29:30.143 INFO:tasks.workunit.client.1.smithi079.stdout:5/241: dwrite d13/d43/f22 [0,4194304] 0 2024-05-09T06:29:30.143 INFO:tasks.workunit.client.1.smithi079.stdout:5/242: chown fc 94 1 2024-05-09T06:29:30.144 INFO:tasks.workunit.client.1.smithi079.stdout:8/161: symlink d1/d3/d20/d22/l3c 0 2024-05-09T06:29:30.144 INFO:tasks.workunit.client.1.smithi079.stdout:8/162: creat d1/d3/d20/f3d x:0 0 0 2024-05-09T06:29:30.144 INFO:tasks.workunit.client.1.smithi079.stdout:8/163: dread - d1/d5/dc/f34 zero size 2024-05-09T06:29:30.147 INFO:tasks.workunit.client.1.smithi079.stdout:9/390: rmdir d1/d5/d7e 0 2024-05-09T06:29:30.149 INFO:tasks.workunit.client.1.smithi079.stdout:1/186: unlink d0/f32 0 2024-05-09T06:29:30.149 INFO:tasks.workunit.client.1.smithi079.stdout:1/187: write d0/d7/f3b [872752,17672] 0 2024-05-09T06:29:30.150 INFO:tasks.workunit.client.1.smithi079.stdout:8/164: dread d1/d3/f6 [0,4194304] 0 2024-05-09T06:29:30.152 INFO:tasks.workunit.client.1.smithi079.stdout:5/243: rename lb to d13/d2a/l5c 0 2024-05-09T06:29:30.158 INFO:tasks.workunit.client.1.smithi079.stdout:8/165: link d1/d3/c21 d1/d5/c3e 0 2024-05-09T06:29:30.160 INFO:tasks.workunit.client.1.smithi079.stdout:9/391: getdents d1 0 2024-05-09T06:29:30.160 INFO:tasks.workunit.client.1.smithi079.stdout:5/244: write d13/d43/f22 [3420587,102634] 0 2024-05-09T06:29:30.161 INFO:tasks.workunit.client.1.smithi079.stdout:2/235: rmdir d8/db/d4b/d4f 39 2024-05-09T06:29:30.163 INFO:tasks.workunit.client.1.smithi079.stdout:2/236: dread d8/db/dc/d2c/d2e/f3e [0,4194304] 0 2024-05-09T06:29:30.163 INFO:tasks.workunit.client.1.smithi079.stdout:2/237: creat d8/db/d11/f55 x:0 0 0 2024-05-09T06:29:30.163 INFO:tasks.workunit.client.1.smithi079.stdout:2/238: creat d8/db/dc/f56 x:0 0 0 2024-05-09T06:29:30.163 INFO:tasks.workunit.client.1.smithi079.stdout:2/239: creat d8/db/d11/f57 x:0 0 0 2024-05-09T06:29:30.163 INFO:tasks.workunit.client.1.smithi079.stdout:2/240: readlink d8/db/d4b/d4f/l41 0 2024-05-09T06:29:30.163 INFO:tasks.workunit.client.1.smithi079.stdout:1/188: truncate d0/d7/f9 2549406 0 2024-05-09T06:29:30.164 INFO:tasks.workunit.client.1.smithi079.stdout:8/166: mkdir d1/d3/d20/d22/d3f 0 2024-05-09T06:29:30.164 INFO:tasks.workunit.client.1.smithi079.stdout:8/167: truncate d1/f8 4379783 0 2024-05-09T06:29:30.166 INFO:tasks.workunit.client.1.smithi079.stdout:9/392: creat d1/d45/f86 x:0 0 0 2024-05-09T06:29:30.166 INFO:tasks.workunit.client.1.smithi079.stdout:9/393: readlink d1/d33/d28/d3e/l43 0 2024-05-09T06:29:30.167 INFO:tasks.workunit.client.1.smithi079.stdout:5/245: mknod d13/d4f/c5d 0 2024-05-09T06:29:30.167 INFO:tasks.workunit.client.1.smithi079.stdout:5/246: creat d13/d43/d26/d35/f5e x:0 0 0 2024-05-09T06:29:30.167 INFO:tasks.workunit.client.1.smithi079.stdout:5/247: creat d13/f5f x:0 0 0 2024-05-09T06:29:30.168 INFO:tasks.workunit.client.1.smithi079.stdout:8/168: dread d1/d3/f6 [0,4194304] 0 2024-05-09T06:29:30.174 INFO:tasks.workunit.client.1.smithi079.stdout:2/241: symlink d8/db/d4b/l58 0 2024-05-09T06:29:30.177 INFO:tasks.workunit.client.1.smithi079.stdout:5/248: read d13/d43/f2f [1366173,62073] 0 2024-05-09T06:29:30.177 INFO:tasks.workunit.client.1.smithi079.stdout:5/249: dread - d13/d43/d39/f58 zero size 2024-05-09T06:29:30.185 INFO:tasks.workunit.client.1.smithi079.stdout:2/242: mkdir d8/db/d59 0 2024-05-09T06:29:30.189 INFO:tasks.workunit.client.1.smithi079.stdout:3/167: fsync d1a/d1c/d22/f2a 0 2024-05-09T06:29:30.191 INFO:tasks.workunit.client.1.smithi079.stdout:5/250: stat d13/c3f 0 2024-05-09T06:29:30.200 INFO:tasks.workunit.client.1.smithi079.stdout:9/394: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:29:30.203 INFO:tasks.workunit.client.1.smithi079.stdout:8/169: dwrite d1/db/f30 [0,4194304] 0 2024-05-09T06:29:30.203 INFO:tasks.workunit.client.1.smithi079.stdout:8/170: truncate d1/d3/f4 1186043 0 2024-05-09T06:29:30.203 INFO:tasks.workunit.client.1.smithi079.stdout:8/171: fsync d1/d3/f4 0 2024-05-09T06:29:30.203 INFO:tasks.workunit.client.1.smithi079.stdout:8/172: read - d1/d3/d20/f3d zero size 2024-05-09T06:29:30.203 INFO:tasks.workunit.client.1.smithi079.stdout:8/173: chown d1/d3/d20/d22/c23 1503052004 1 2024-05-09T06:29:30.203 INFO:tasks.workunit.client.1.smithi079.stdout:0/204: dwrite d3/d5/d27/f32 [4194304,4194304] 0 2024-05-09T06:29:30.203 INFO:tasks.workunit.client.1.smithi079.stdout:9/395: creat d1/d33/f87 x:0 0 0 2024-05-09T06:29:30.204 INFO:tasks.workunit.client.1.smithi079.stdout:0/205: write d3/d5/d27/f44 [114425,105940] 0 2024-05-09T06:29:30.205 INFO:tasks.workunit.client.1.smithi079.stdout:0/206: write d3/d5/f3a [480158,30150] 0 2024-05-09T06:29:30.205 INFO:tasks.workunit.client.1.smithi079.stdout:0/207: write d3/dd/d1f/d1e/d2c/d35/d36/f3d [463860,111307] 0 2024-05-09T06:29:30.207 INFO:tasks.workunit.client.1.smithi079.stdout:0/208: write d3/dd/d1f/f28 [392523,67679] 0 2024-05-09T06:29:30.207 INFO:tasks.workunit.client.1.smithi079.stdout:0/209: write d3/dd/d1f/f28 [999855,38551] 0 2024-05-09T06:29:30.207 INFO:tasks.workunit.client.1.smithi079.stdout:0/210: chown d3/dd/d1f/fa 846 1 2024-05-09T06:29:30.207 INFO:tasks.workunit.client.1.smithi079.stdout:0/211: readlink d3/d5/d27/l3c 0 2024-05-09T06:29:30.211 INFO:tasks.workunit.client.1.smithi079.stdout:2/243: dwrite d8/db/f19 [0,4194304] 0 2024-05-09T06:29:30.212 INFO:tasks.workunit.client.1.smithi079.stdout:3/168: dwrite d1a/d1c/f2d [0,4194304] 0 2024-05-09T06:29:30.212 INFO:tasks.workunit.client.1.smithi079.stdout:3/169: write f5 [1993151,71060] 0 2024-05-09T06:29:30.212 INFO:tasks.workunit.client.1.smithi079.stdout:3/170: write f13 [1642317,59230] 0 2024-05-09T06:29:30.217 INFO:tasks.workunit.client.1.smithi079.stdout:0/212: rmdir d3/dd/d1f/d1e/d2c/d35 39 2024-05-09T06:29:30.227 INFO:tasks.workunit.client.1.smithi079.stdout:0/213: dread d3/dd/d1f/d1e/f2a [0,4194304] 0 2024-05-09T06:29:30.227 INFO:tasks.workunit.client.1.smithi079.stdout:0/214: creat d3/dd/f46 x:0 0 0 2024-05-09T06:29:30.227 INFO:tasks.workunit.client.1.smithi079.stdout:0/215: creat d3/dd/d18/f47 x:0 0 0 2024-05-09T06:29:30.228 INFO:tasks.workunit.client.1.smithi079.stdout:6/179: sync 2024-05-09T06:29:30.231 INFO:tasks.workunit.client.1.smithi079.stdout:3/171: chown fd 1 1 2024-05-09T06:29:30.232 INFO:tasks.workunit.client.1.smithi079.stdout:9/396: rmdir d1/d33/d28/d36/d38/d3a 39 2024-05-09T06:29:30.233 INFO:tasks.workunit.client.1.smithi079.stdout:0/216: dread d3/dd/d1f/f20 [0,4194304] 0 2024-05-09T06:29:30.233 INFO:tasks.workunit.client.1.smithi079.stdout:0/217: creat d3/dd/d1f/d1e/d2c/d35/d36/f48 x:0 0 0 2024-05-09T06:29:30.239 INFO:tasks.workunit.client.1.smithi079.stdout:0/218: dread d3/dd/d1f/f20 [0,4194304] 0 2024-05-09T06:29:30.239 INFO:tasks.workunit.client.1.smithi079.stdout:0/219: fdatasync d3/f39 0 2024-05-09T06:29:30.240 INFO:tasks.workunit.client.1.smithi079.stdout:2/244: link l6 d8/db/d11/l5a 0 2024-05-09T06:29:30.243 INFO:tasks.workunit.client.1.smithi079.stdout:3/172: dwrite f16 [0,4194304] 0 2024-05-09T06:29:30.248 INFO:tasks.workunit.client.1.smithi079.stdout:7/275: rmdir d4/d7/d37 39 2024-05-09T06:29:30.250 INFO:tasks.workunit.client.1.smithi079.stdout:4/300: sync 2024-05-09T06:29:30.250 INFO:tasks.workunit.client.1.smithi079.stdout:3/173: dread fd [0,4194304] 0 2024-05-09T06:29:30.255 INFO:tasks.workunit.client.1.smithi079.stdout:6/180: unlink d0/d6/d1b/f26 0 2024-05-09T06:29:30.256 INFO:tasks.workunit.client.1.smithi079.stdout:9/397: symlink d1/d33/d2b/l88 0 2024-05-09T06:29:30.257 INFO:tasks.workunit.client.1.smithi079.stdout:3/174: dread f3 [0,4194304] 0 2024-05-09T06:29:30.260 INFO:tasks.workunit.client.1.smithi079.stdout:0/220: unlink d3/d5/d27/l17 0 2024-05-09T06:29:30.262 INFO:tasks.workunit.client.1.smithi079.stdout:2/245: mknod d8/c5b 0 2024-05-09T06:29:30.266 INFO:tasks.workunit.client.1.smithi079.stdout:2/246: dread d8/db/d4b/d4f/f36 [0,4194304] 0 2024-05-09T06:29:30.268 INFO:tasks.workunit.client.1.smithi079.stdout:7/276: mknod d4/d7/d22/c4e 0 2024-05-09T06:29:30.268 INFO:tasks.workunit.client.1.smithi079.stdout:0/221: write d3/d5/f21 [1497030,63955] 0 2024-05-09T06:29:30.273 INFO:tasks.workunit.client.1.smithi079.stdout:6/181: unlink d0/d6/d1b/d20/f38 0 2024-05-09T06:29:30.275 INFO:tasks.workunit.client.1.smithi079.stdout:2/247: mkdir d8/db/d5c 0 2024-05-09T06:29:30.275 INFO:tasks.workunit.client.1.smithi079.stdout:2/248: readlink l6 0 2024-05-09T06:29:30.279 INFO:tasks.workunit.client.1.smithi079.stdout:0/222: link d3/d5/d27/f32 d3/d5/d27/f49 0 2024-05-09T06:29:30.280 INFO:tasks.workunit.client.1.smithi079.stdout:9/398: dwrite d1/d45/f60 [0,4194304] 0 2024-05-09T06:29:30.281 INFO:tasks.workunit.client.1.smithi079.stdout:3/175: dwrite d1a/f29 [0,4194304] 0 2024-05-09T06:29:30.281 INFO:tasks.workunit.client.1.smithi079.stdout:4/301: getdents d6/d8/d32 0 2024-05-09T06:29:30.285 INFO:tasks.workunit.client.1.smithi079.stdout:1/189: rename d0/d7/d11 to d0/d12/d27/d43 0 2024-05-09T06:29:30.285 INFO:tasks.workunit.client.1.smithi079.stdout:1/190: dread - d0/d12/d31/f41 zero size 2024-05-09T06:29:30.288 INFO:tasks.workunit.client.1.smithi079.stdout:0/223: symlink d3/dd/d1f/l4a 0 2024-05-09T06:29:30.288 INFO:tasks.workunit.client.1.smithi079.stdout:0/224: readlink d3/d5/d27/l3c 0 2024-05-09T06:29:30.288 INFO:tasks.workunit.client.1.smithi079.stdout:0/225: creat d3/d5/f4b x:0 0 0 2024-05-09T06:29:30.292 INFO:tasks.workunit.client.1.smithi079.stdout:9/399: truncate d1/d5/f21 1125398 0 2024-05-09T06:29:30.292 INFO:tasks.workunit.client.1.smithi079.stdout:9/400: fsync d1/d5/f58 0 2024-05-09T06:29:30.297 INFO:tasks.workunit.client.1.smithi079.stdout:8/174: rmdir d1/d5 39 2024-05-09T06:29:30.299 INFO:tasks.workunit.client.1.smithi079.stdout:3/176: write f10 [684584,53653] 0 2024-05-09T06:29:30.301 INFO:tasks.workunit.client.1.smithi079.stdout:4/302: truncate d6/d8/d27/f2e 424776 0 2024-05-09T06:29:30.305 INFO:tasks.workunit.client.1.smithi079.stdout:2/249: rename d8/db/dc/d2c/l4a to d8/db/d4b/d4f/l5d 0 2024-05-09T06:29:30.308 INFO:tasks.workunit.client.1.smithi079.stdout:1/191: link d0/d12/c1c d0/d12/d27/d43/c44 0 2024-05-09T06:29:30.311 INFO:tasks.workunit.client.1.smithi079.stdout:4/303: dread d6/d1a/d26/d2a/d54/f17 [0,4194304] 0 2024-05-09T06:29:30.312 INFO:tasks.workunit.client.1.smithi079.stdout:0/226: truncate d3/f4 56509 0 2024-05-09T06:29:30.312 INFO:tasks.workunit.client.1.smithi079.stdout:0/227: read d3/dd/d1f/f28 [907335,92884] 0 2024-05-09T06:29:30.314 INFO:tasks.workunit.client.1.smithi079.stdout:9/401: rename d1/d45/f66 to d1/d5/d5b/f89 0 2024-05-09T06:29:30.317 INFO:tasks.workunit.client.1.smithi079.stdout:2/250: link d8/l16 d8/db/d11/l5e 0 2024-05-09T06:29:30.319 INFO:tasks.workunit.client.1.smithi079.stdout:1/192: mknod d0/d12/d27/d43/d20/c45 0 2024-05-09T06:29:30.323 INFO:tasks.workunit.client.1.smithi079.stdout:1/193: truncate d0/d12/f2c 2947453 0 2024-05-09T06:29:30.327 INFO:tasks.workunit.client.1.smithi079.stdout:1/194: dread d0/df/f24 [0,4194304] 0 2024-05-09T06:29:30.330 INFO:tasks.workunit.client.1.smithi079.stdout:2/251: read d8/fa [2048112,57253] 0 2024-05-09T06:29:30.330 INFO:tasks.workunit.client.1.smithi079.stdout:1/195: creat d0/d12/d27/d43/f46 x:0 0 0 2024-05-09T06:29:30.331 INFO:tasks.workunit.client.1.smithi079.stdout:2/252: mkdir d8/db/d11/d5f 0 2024-05-09T06:29:30.334 INFO:tasks.workunit.client.1.smithi079.stdout:1/196: rename d0/d12/d27/f25 to d0/d12/d27/d43/f47 0 2024-05-09T06:29:30.334 INFO:tasks.workunit.client.1.smithi079.stdout:1/197: write d0/d7/fc [845696,73355] 0 2024-05-09T06:29:30.335 INFO:tasks.workunit.client.1.smithi079.stdout:2/253: symlink d8/db/d59/l60 0 2024-05-09T06:29:30.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/254: rename d8/db/d4b/d4f/l48 to d8/db/dc/d2c/l61 0 2024-05-09T06:29:30.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/255: creat d8/db/f62 x:0 0 0 2024-05-09T06:29:30.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/256: creat d8/db/dc/d2c/f63 x:0 0 0 2024-05-09T06:29:30.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/257: chown d8 122668497 1 2024-05-09T06:29:30.342 INFO:tasks.workunit.client.1.smithi079.stdout:3/177: dwrite d1a/d1c/d22/f2a [0,4194304] 0 2024-05-09T06:29:30.343 INFO:tasks.workunit.client.1.smithi079.stdout:9/402: dwrite d1/d33/d28/d36/f67 [0,4194304] 0 2024-05-09T06:29:30.343 INFO:tasks.workunit.client.1.smithi079.stdout:9/403: dread - d1/d33/d28/d36/d4d/d7d/d19/f80 zero size 2024-05-09T06:29:30.343 INFO:tasks.workunit.client.1.smithi079.stdout:4/304: dwrite d6/d8/d27/f46 [4194304,4194304] 0 2024-05-09T06:29:30.343 INFO:tasks.workunit.client.1.smithi079.stdout:4/305: stat d6/d8/f4f 0 2024-05-09T06:29:30.344 INFO:tasks.workunit.client.1.smithi079.stdout:8/175: dwrite d1/f1a [4194304,4194304] 0 2024-05-09T06:29:30.346 INFO:tasks.workunit.client.1.smithi079.stdout:4/306: write d6/d1a/d26/d2a/d54/f17 [696763,98727] 0 2024-05-09T06:29:30.347 INFO:tasks.workunit.client.1.smithi079.stdout:4/307: stat d6/d8/c4d 0 2024-05-09T06:29:30.347 INFO:tasks.workunit.client.1.smithi079.stdout:4/308: dread - d6/d8/f49 zero size 2024-05-09T06:29:30.347 INFO:tasks.workunit.client.1.smithi079.stdout:2/258: rename d8/db/f52 to d8/db/d11/d5f/f64 0 2024-05-09T06:29:30.347 INFO:tasks.workunit.client.1.smithi079.stdout:2/259: chown d8/db/d11/l14 118755 1 2024-05-09T06:29:30.347 INFO:tasks.workunit.client.1.smithi079.stdout:2/260: read - d8/db/d11/f55 zero size 2024-05-09T06:29:30.347 INFO:tasks.workunit.client.1.smithi079.stdout:2/261: write f3 [4709759,42354] 0 2024-05-09T06:29:30.351 INFO:tasks.workunit.client.1.smithi079.stdout:3/178: link f16 d1a/d21/f39 0 2024-05-09T06:29:30.352 INFO:tasks.workunit.client.1.smithi079.stdout:2/262: dread f3 [0,4194304] 0 2024-05-09T06:29:30.355 INFO:tasks.workunit.client.1.smithi079.stdout:9/404: rmdir d1 39 2024-05-09T06:29:30.358 INFO:tasks.workunit.client.1.smithi079.stdout:1/198: dwrite d0/d12/d16/f2f [0,4194304] 0 2024-05-09T06:29:30.358 INFO:tasks.workunit.client.1.smithi079.stdout:1/199: chown d0/d12/d27/d43/d20/d39/l40 316115 1 2024-05-09T06:29:30.362 INFO:tasks.workunit.client.1.smithi079.stdout:4/309: rmdir d6/d1a/d26/d2a/d54 39 2024-05-09T06:29:30.362 INFO:tasks.workunit.client.1.smithi079.stdout:4/310: fdatasync d6/d8/d27/d3d/f58 0 2024-05-09T06:29:30.362 INFO:tasks.workunit.client.1.smithi079.stdout:2/263: write f5 [3822409,104919] 0 2024-05-09T06:29:30.362 INFO:tasks.workunit.client.1.smithi079.stdout:2/264: stat d8/db/c20 0 2024-05-09T06:29:30.365 INFO:tasks.workunit.client.1.smithi079.stdout:2/265: fdatasync f3 0 2024-05-09T06:29:30.366 INFO:tasks.workunit.client.1.smithi079.stdout:2/266: creat d8/db/f65 x:0 0 0 2024-05-09T06:29:30.366 INFO:tasks.workunit.client.1.smithi079.stdout:3/179: mkdir d1a/d1d/d3a 0 2024-05-09T06:29:30.367 INFO:tasks.workunit.client.1.smithi079.stdout:9/405: creat d1/d33/d28/d36/d4d/f8a x:0 0 0 2024-05-09T06:29:30.367 INFO:tasks.workunit.client.1.smithi079.stdout:4/311: dread d6/d15/f31 [0,4194304] 0 2024-05-09T06:29:30.372 INFO:tasks.workunit.client.1.smithi079.stdout:1/200: mkdir d0/d12/d48 0 2024-05-09T06:29:30.372 INFO:tasks.workunit.client.1.smithi079.stdout:1/201: fdatasync d0/d12/d16/f35 0 2024-05-09T06:29:30.380 INFO:tasks.workunit.client.1.smithi079.stdout:8/176: rmdir d1 39 2024-05-09T06:29:30.380 INFO:tasks.workunit.client.1.smithi079.stdout:8/177: dread - d1/d5/dc/f34 zero size 2024-05-09T06:29:30.381 INFO:tasks.workunit.client.1.smithi079.stdout:8/178: chown d1/db/f30 196 1 2024-05-09T06:29:30.387 INFO:tasks.workunit.client.1.smithi079.stdout:2/267: getdents d8/db/d4b 0 2024-05-09T06:29:30.391 INFO:tasks.workunit.client.1.smithi079.stdout:3/180: rename d1a/d1c/f2d to d1a/d1d/d34/f3b 0 2024-05-09T06:29:30.391 INFO:tasks.workunit.client.1.smithi079.stdout:3/181: stat fa 0 2024-05-09T06:29:30.391 INFO:tasks.workunit.client.1.smithi079.stdout:3/182: creat d1a/d1d/f3c x:0 0 0 2024-05-09T06:29:30.392 INFO:tasks.workunit.client.1.smithi079.stdout:8/179: mkdir d1/d3/d20/d22/d3f/d40 0 2024-05-09T06:29:30.394 INFO:tasks.workunit.client.1.smithi079.stdout:3/183: write f3 [3586288,44771] 0 2024-05-09T06:29:30.394 INFO:tasks.workunit.client.1.smithi079.stdout:3/184: fdatasync d1a/d1c/d1f/f31 0 2024-05-09T06:29:30.395 INFO:tasks.workunit.client.1.smithi079.stdout:2/268: creat d8/db/d4b/f66 x:0 0 0 2024-05-09T06:29:30.397 INFO:tasks.workunit.client.1.smithi079.stdout:8/180: symlink d1/d3/d20/d22/d3f/l41 0 2024-05-09T06:29:30.398 INFO:tasks.workunit.client.1.smithi079.stdout:8/181: chown d1/d3/d20/d22/c26 11062 1 2024-05-09T06:29:30.401 INFO:tasks.workunit.client.1.smithi079.stdout:2/269: mkdir d8/db/d59/d67 0 2024-05-09T06:29:30.404 INFO:tasks.workunit.client.1.smithi079.stdout:2/270: chown d8/db/d4b/d4f/l5d 274 1 2024-05-09T06:29:30.406 INFO:tasks.workunit.client.1.smithi079.stdout:2/271: creat d8/db/d4b/f68 x:0 0 0 2024-05-09T06:29:30.406 INFO:tasks.workunit.client.1.smithi079.stdout:3/185: dread d1a/d1d/d34/f38 [0,4194304] 0 2024-05-09T06:29:30.407 INFO:tasks.workunit.client.1.smithi079.stdout:4/312: dwrite d6/dd/df/f35 [0,4194304] 0 2024-05-09T06:29:30.408 INFO:tasks.workunit.client.1.smithi079.stdout:1/202: dwrite d0/d12/d27/d43/d20/d39/f42 [0,4194304] 0 2024-05-09T06:29:30.408 INFO:tasks.workunit.client.1.smithi079.stdout:9/406: dwrite d1/d33/d28/d36/f7b [0,4194304] 0 2024-05-09T06:29:30.414 INFO:tasks.workunit.client.1.smithi079.stdout:4/313: rename d6/d1a/d26/d2a/c5a to d6/d15/c5e 0 2024-05-09T06:29:30.419 INFO:tasks.workunit.client.1.smithi079.stdout:5/251: sync 2024-05-09T06:29:30.419 INFO:tasks.workunit.client.1.smithi079.stdout:5/252: dread - d13/f52 zero size 2024-05-09T06:29:30.419 INFO:tasks.workunit.client.1.smithi079.stdout:5/253: creat d13/d43/d39/f60 x:0 0 0 2024-05-09T06:29:30.420 INFO:tasks.workunit.client.1.smithi079.stdout:3/186: dwrite d1a/d1c/d1f/f31 [0,4194304] 0 2024-05-09T06:29:30.420 INFO:tasks.workunit.client.1.smithi079.stdout:3/187: write f11 [726648,113466] 0 2024-05-09T06:29:30.424 INFO:tasks.workunit.client.1.smithi079.stdout:3/188: write fd [3854536,54492] 0 2024-05-09T06:29:30.426 INFO:tasks.workunit.client.1.smithi079.stdout:9/407: mkdir d1/d33/d28/d4c/d8b 0 2024-05-09T06:29:30.428 INFO:tasks.workunit.client.1.smithi079.stdout:4/314: dwrite f2 [0,4194304] 0 2024-05-09T06:29:30.428 INFO:tasks.workunit.client.1.smithi079.stdout:4/315: fsync d6/d8/f10 0 2024-05-09T06:29:30.428 INFO:tasks.workunit.client.1.smithi079.stdout:4/316: truncate d6/d8/d32/f51 82279 0 2024-05-09T06:29:30.429 INFO:tasks.workunit.client.1.smithi079.stdout:2/272: truncate d8/f10 1770991 0 2024-05-09T06:29:30.429 INFO:tasks.workunit.client.1.smithi079.stdout:2/273: truncate d8/db/dc/d2c/f33 927880 0 2024-05-09T06:29:30.437 INFO:tasks.workunit.client.1.smithi079.stdout:5/254: mkdir d13/d43/d39/d61 0 2024-05-09T06:29:30.439 INFO:tasks.workunit.client.1.smithi079.stdout:1/203: getdents d0/d12/d27/d26 0 2024-05-09T06:29:30.447 INFO:tasks.workunit.client.1.smithi079.stdout:3/189: dwrite d1a/f35 [0,4194304] 0 2024-05-09T06:29:30.447 INFO:tasks.workunit.client.1.smithi079.stdout:3/190: chown d1a/d1c/d22/l25 8154 1 2024-05-09T06:29:30.447 INFO:tasks.workunit.client.1.smithi079.stdout:3/191: creat d1a/f3d x:0 0 0 2024-05-09T06:29:30.450 INFO:tasks.workunit.client.1.smithi079.stdout:4/317: creat d6/d15/f5f x:0 0 0 2024-05-09T06:29:30.450 INFO:tasks.workunit.client.1.smithi079.stdout:4/318: creat d6/dd/d34/f60 x:0 0 0 2024-05-09T06:29:30.450 INFO:tasks.workunit.client.1.smithi079.stdout:9/408: write d1/d6/f20 [1714447,33927] 0 2024-05-09T06:29:30.451 INFO:tasks.workunit.client.1.smithi079.stdout:4/319: write d6/fa [933480,5103] 0 2024-05-09T06:29:30.451 INFO:tasks.workunit.client.1.smithi079.stdout:4/320: write d6/dd/d34/f52 [635321,86295] 0 2024-05-09T06:29:30.456 INFO:tasks.workunit.client.1.smithi079.stdout:2/274: rename d8/db/d11/l5e to d8/db/d4b/d4f/d51/l69 0 2024-05-09T06:29:30.456 INFO:tasks.workunit.client.1.smithi079.stdout:2/275: creat d8/db/dc/f6a x:0 0 0 2024-05-09T06:29:30.458 INFO:tasks.workunit.client.1.smithi079.stdout:5/255: truncate d13/f16 781385 0 2024-05-09T06:29:30.461 INFO:tasks.workunit.client.1.smithi079.stdout:1/204: symlink d0/d12/d31/l49 0 2024-05-09T06:29:30.462 INFO:tasks.workunit.client.1.smithi079.stdout:4/321: read d6/dd/df/f21 [4285083,128893] 0 2024-05-09T06:29:30.462 INFO:tasks.workunit.client.1.smithi079.stdout:4/322: truncate d6/d8/d27/d3d/f58 497940 0 2024-05-09T06:29:30.465 INFO:tasks.workunit.client.1.smithi079.stdout:3/192: dwrite f11 [0,4194304] 0 2024-05-09T06:29:30.465 INFO:tasks.workunit.client.1.smithi079.stdout:3/193: creat d1a/d1d/f3e x:0 0 0 2024-05-09T06:29:30.475 INFO:tasks.workunit.client.1.smithi079.stdout:2/276: mkdir d8/db/d5c/d6b 0 2024-05-09T06:29:30.475 INFO:tasks.workunit.client.1.smithi079.stdout:2/277: read d8/db/d4b/d4f/f36 [3726355,91290] 0 2024-05-09T06:29:30.475 INFO:tasks.workunit.client.1.smithi079.stdout:2/278: chown d8/f4e 73928839 1 2024-05-09T06:29:30.477 INFO:tasks.workunit.client.1.smithi079.stdout:3/194: dwrite d1a/f2c [0,4194304] 0 2024-05-09T06:29:30.477 INFO:tasks.workunit.client.1.smithi079.stdout:5/256: rename d13/f37 to d13/d43/d39/d61/f62 0 2024-05-09T06:29:30.477 INFO:tasks.workunit.client.1.smithi079.stdout:5/257: write d13/d43/d26/f3e [1350618,59550] 0 2024-05-09T06:29:30.479 INFO:tasks.workunit.client.1.smithi079.stdout:1/205: creat d0/f4a x:0 0 0 2024-05-09T06:29:30.483 INFO:tasks.workunit.client.1.smithi079.stdout:1/206: write d0/d12/f18 [1535950,23600] 0 2024-05-09T06:29:30.485 INFO:tasks.workunit.client.1.smithi079.stdout:5/258: dread d13/d43/f28 [0,4194304] 0 2024-05-09T06:29:30.490 INFO:tasks.workunit.client.1.smithi079.stdout:3/195: unlink d1a/f29 0 2024-05-09T06:29:30.491 INFO:tasks.workunit.client.1.smithi079.stdout:3/196: chown d1a/d1d/d34 953 1 2024-05-09T06:29:30.491 INFO:tasks.workunit.client.1.smithi079.stdout:3/197: dread - d1a/d1c/d22/f36 zero size 2024-05-09T06:29:30.495 INFO:tasks.workunit.client.1.smithi079.stdout:1/207: symlink d0/d12/d27/d43/d20/d39/l4b 0 2024-05-09T06:29:30.499 INFO:tasks.workunit.client.1.smithi079.stdout:3/198: write d1a/f35 [1257981,91664] 0 2024-05-09T06:29:30.499 INFO:tasks.workunit.client.1.smithi079.stdout:2/279: rmdir d8/db/dc/d2c 39 2024-05-09T06:29:30.500 INFO:tasks.workunit.client.1.smithi079.stdout:2/280: creat d8/db/dc/f6c x:0 0 0 2024-05-09T06:29:30.500 INFO:tasks.workunit.client.1.smithi079.stdout:2/281: chown d8/db/c1e 12657 1 2024-05-09T06:29:30.501 INFO:tasks.workunit.client.1.smithi079.stdout:5/259: mkdir d13/d43/d3d/d40/d63 0 2024-05-09T06:29:30.507 INFO:tasks.workunit.client.1.smithi079.stdout:3/199: read f15 [4086674,37767] 0 2024-05-09T06:29:30.508 INFO:tasks.workunit.client.1.smithi079.stdout:1/208: mknod d0/d12/d27/c4c 0 2024-05-09T06:29:30.512 INFO:tasks.workunit.client.1.smithi079.stdout:3/200: dread f13 [0,4194304] 0 2024-05-09T06:29:30.513 INFO:tasks.workunit.client.1.smithi079.stdout:2/282: mkdir d8/db/d4b/d4f/d51/d6d 0 2024-05-09T06:29:30.515 INFO:tasks.workunit.client.1.smithi079.stdout:5/260: dwrite d13/f1e [0,4194304] 0 2024-05-09T06:29:30.515 INFO:tasks.workunit.client.1.smithi079.stdout:5/261: creat d13/d43/d26/d35/f64 x:0 0 0 2024-05-09T06:29:30.516 INFO:tasks.workunit.client.1.smithi079.stdout:1/209: symlink d0/d12/d48/l4d 0 2024-05-09T06:29:30.522 INFO:tasks.workunit.client.1.smithi079.stdout:5/262: symlink d13/d2a/l65 0 2024-05-09T06:29:30.526 INFO:tasks.workunit.client.1.smithi079.stdout:1/210: getdents d0/d12 0 2024-05-09T06:29:30.530 INFO:tasks.workunit.client.1.smithi079.stdout:1/211: mkdir d0/d7/d4e 0 2024-05-09T06:29:30.531 INFO:tasks.workunit.client.1.smithi079.stdout:2/283: dwrite d8/db/d11/f35 [0,4194304] 0 2024-05-09T06:29:30.531 INFO:tasks.workunit.client.1.smithi079.stdout:2/284: chown d8/db/dc/c25 7807942 1 2024-05-09T06:29:30.532 INFO:tasks.workunit.client.1.smithi079.stdout:2/285: chown d8/d3c/l47 141658 1 2024-05-09T06:29:30.533 INFO:tasks.workunit.client.1.smithi079.stdout:1/212: creat d0/d12/d27/d43/d20/f4f x:0 0 0 2024-05-09T06:29:30.535 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:30 smithi079 ceph-mon[35268]: pgmap v244: 65 pgs: 65 active+clean; 380 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 9.7 MiB/s rd, 18 MiB/s wr, 616 op/s 2024-05-09T06:29:30.535 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:30 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:30.535 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:30 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:29:30.535 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:30 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:29:30.535 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:30 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:29:30.538 INFO:tasks.workunit.client.1.smithi079.stdout:2/286: stat d8/l18 0 2024-05-09T06:29:30.538 INFO:tasks.workunit.client.1.smithi079.stdout:2/287: readlink d8/db/l29 0 2024-05-09T06:29:30.538 INFO:tasks.workunit.client.1.smithi079.stdout:2/288: write d8/db/d4b/d4f/f46 [213771,68393] 0 2024-05-09T06:29:30.538 INFO:tasks.workunit.client.1.smithi079.stdout:2/289: fdatasync d8/db/d11/f45 0 2024-05-09T06:29:30.539 INFO:tasks.workunit.client.1.smithi079.stdout:1/213: rmdir d0/d12/d27 39 2024-05-09T06:29:30.541 INFO:tasks.workunit.client.1.smithi079.stdout:2/290: link d8/db/d11/f3f d8/db/d4b/d4f/d51/d6d/f6e 0 2024-05-09T06:29:30.541 INFO:tasks.workunit.client.1.smithi079.stdout:3/201: dwrite fe [0,4194304] 0 2024-05-09T06:29:30.542 INFO:tasks.workunit.client.1.smithi079.stdout:5/263: dwrite fc [0,4194304] 0 2024-05-09T06:29:30.545 INFO:tasks.workunit.client.1.smithi079.stdout:4/323: truncate f2 412208 0 2024-05-09T06:29:30.545 INFO:tasks.workunit.client.1.smithi079.stdout:4/324: chown f2 5483290 1 2024-05-09T06:29:30.545 INFO:tasks.workunit.client.1.smithi079.stdout:4/325: write d6/d8/d27/d3d/f58 [533999,130784] 0 2024-05-09T06:29:30.546 INFO:tasks.workunit.client.1.smithi079.stdout:2/291: mkdir d8/db/d4b/d4f/d51/d6f 0 2024-05-09T06:29:30.546 INFO:tasks.workunit.client.1.smithi079.stdout:2/292: dread - d8/db/dc/f56 zero size 2024-05-09T06:29:30.546 INFO:tasks.workunit.client.1.smithi079.stdout:2/293: chown d8/db/d59/l60 8 1 2024-05-09T06:29:30.546 INFO:tasks.workunit.client.1.smithi079.stdout:2/294: readlink d8/db/d11/l15 0 2024-05-09T06:29:30.553 INFO:tasks.workunit.client.1.smithi079.stdout:3/202: mkdir d1a/d1c/d1f/d3f 0 2024-05-09T06:29:30.558 INFO:tasks.workunit.client.1.smithi079.stdout:5/264: mknod d13/d43/d3d/d40/d63/c66 0 2024-05-09T06:29:30.563 INFO:tasks.workunit.client.1.smithi079.stdout:2/295: symlink d8/db/dc/d2c/l70 0 2024-05-09T06:29:30.567 INFO:tasks.workunit.client.1.smithi079.stdout:3/203: unlink d1a/d1d/d34/f37 0 2024-05-09T06:29:30.567 INFO:tasks.workunit.client.1.smithi079.stdout:3/204: fdatasync d1a/d1d/f2f 0 2024-05-09T06:29:30.567 INFO:tasks.workunit.client.1.smithi079.stdout:3/205: write d1a/d1c/f24 [975789,92151] 0 2024-05-09T06:29:30.568 INFO:tasks.workunit.client.1.smithi079.stdout:5/265: truncate d13/d43/d26/f57 2448534 0 2024-05-09T06:29:30.570 INFO:tasks.workunit.client.1.smithi079.stdout:2/296: symlink d8/db/d4b/d4f/l71 0 2024-05-09T06:29:30.570 INFO:tasks.workunit.client.1.smithi079.stdout:2/297: creat d8/db/d11/f72 x:0 0 0 2024-05-09T06:29:30.575 INFO:tasks.workunit.client.1.smithi079.stdout:3/206: unlink d1a/d1c/d22/f2a 0 2024-05-09T06:29:30.575 INFO:tasks.workunit.client.1.smithi079.stdout:3/207: write d1a/d1d/f2f [56534,80447] 0 2024-05-09T06:29:30.575 INFO:tasks.workunit.client.1.smithi079.stdout:3/208: dread - d1a/d1d/f3e zero size 2024-05-09T06:29:30.575 INFO:tasks.workunit.client.1.smithi079.stdout:3/209: dread - d1a/d1d/f3c zero size 2024-05-09T06:29:30.576 INFO:tasks.workunit.client.1.smithi079.stdout:5/266: rename d13/d43/f38 to d13/d2a/f67 0 2024-05-09T06:29:30.580 INFO:tasks.workunit.client.1.smithi079.stdout:2/298: creat d8/db/d4b/d4f/d51/d6f/f73 x:0 0 0 2024-05-09T06:29:30.580 INFO:tasks.workunit.client.1.smithi079.stdout:2/299: chown d8/db/d11/l14 370070 1 2024-05-09T06:29:30.582 INFO:tasks.workunit.client.1.smithi079.stdout:3/210: write f16 [2822924,37569] 0 2024-05-09T06:29:30.585 INFO:tasks.workunit.client.1.smithi079.stdout:5/267: write d13/f18 [2899592,86725] 0 2024-05-09T06:29:30.585 INFO:tasks.workunit.client.1.smithi079.stdout:5/268: dread - d13/d43/d26/d35/f5e zero size 2024-05-09T06:29:30.604 INFO:tasks.workunit.client.1.smithi079.stdout:3/211: dwrite d1a/f35 [0,4194304] 0 2024-05-09T06:29:30.604 INFO:tasks.workunit.client.1.smithi079.stdout:3/212: chown d1a/d1c 12186 1 2024-05-09T06:29:30.606 INFO:tasks.workunit.client.1.smithi079.stdout:5/269: dwrite d13/f5a [0,4194304] 0 2024-05-09T06:29:30.608 INFO:tasks.workunit.client.1.smithi079.stdout:3/213: unlink f10 0 2024-05-09T06:29:30.608 INFO:tasks.workunit.client.1.smithi079.stdout:3/214: fdatasync d1a/d1d/d34/f3b 0 2024-05-09T06:29:30.614 INFO:tasks.workunit.client.1.smithi079.stdout:3/215: creat d1a/d21/f40 x:0 0 0 2024-05-09T06:29:30.614 INFO:tasks.workunit.client.1.smithi079.stdout:3/216: stat fb 0 2024-05-09T06:29:30.615 INFO:tasks.workunit.client.1.smithi079.stdout:3/217: creat d1a/d1d/f41 x:0 0 0 2024-05-09T06:29:30.616 INFO:tasks.workunit.client.1.smithi079.stdout:1/214: rmdir d0 39 2024-05-09T06:29:30.620 INFO:tasks.workunit.client.1.smithi079.stdout:3/218: mkdir d1a/d1d/d34/d42 0 2024-05-09T06:29:30.620 INFO:tasks.workunit.client.1.smithi079.stdout:3/219: write f16 [1354174,84118] 0 2024-05-09T06:29:30.622 INFO:tasks.workunit.client.1.smithi079.stdout:1/215: link d0/d12/d27/d26/f38 d0/d12/d16/f50 0 2024-05-09T06:29:30.626 INFO:tasks.workunit.client.1.smithi079.stdout:5/270: dwrite d13/f21 [0,4194304] 0 2024-05-09T06:29:30.628 INFO:tasks.workunit.client.1.smithi079.stdout:1/216: write d0/d12/f2c [240386,42336] 0 2024-05-09T06:29:30.628 INFO:tasks.workunit.client.1.smithi079.stdout:3/220: dread d1a/d1d/d34/f38 [0,4194304] 0 2024-05-09T06:29:30.629 INFO:tasks.workunit.client.1.smithi079.stdout:3/221: stat d1a/d1c/d22/f26 0 2024-05-09T06:29:30.629 INFO:tasks.workunit.client.1.smithi079.stdout:3/222: write fa [490752,62349] 0 2024-05-09T06:29:30.630 INFO:tasks.workunit.client.1.smithi079.stdout:7/277: sync 2024-05-09T06:29:30.630 INFO:tasks.workunit.client.1.smithi079.stdout:7/278: fdatasync d4/d7/d22/f23 0 2024-05-09T06:29:30.630 INFO:tasks.workunit.client.1.smithi079.stdout:7/279: read d4/d7/dd/f21 [421412,48225] 0 2024-05-09T06:29:30.632 INFO:tasks.workunit.client.1.smithi079.stdout:7/280: dread d4/d30/d32/f3b [0,4194304] 0 2024-05-09T06:29:30.633 INFO:tasks.workunit.client.1.smithi079.stdout:7/281: dread d4/d7/dd/f21 [0,4194304] 0 2024-05-09T06:29:30.633 INFO:tasks.workunit.client.1.smithi079.stdout:7/282: fdatasync d4/d30/d31/d34/f3c 0 2024-05-09T06:29:30.634 INFO:tasks.workunit.client.1.smithi079.stdout:5/271: creat d13/d4f/f68 x:0 0 0 2024-05-09T06:29:30.639 INFO:tasks.workunit.client.1.smithi079.stdout:3/223: creat d1a/d1c/d28/f43 x:0 0 0 2024-05-09T06:29:30.642 INFO:tasks.workunit.client.1.smithi079.stdout:5/272: mknod d13/d43/d3d/d40/d63/c69 0 2024-05-09T06:29:30.642 INFO:tasks.workunit.client.1.smithi079.stdout:5/273: write d13/d43/d26/d35/f5e [858701,72809] 0 2024-05-09T06:29:30.642 INFO:tasks.workunit.client.1.smithi079.stdout:5/274: chown d13/d43/d3d/l46 76473514 1 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:3/224: rename d1a/l1e to d1a/d1c/d1f/d3f/l44 0 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:9/409: sync 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:8/182: sync 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:6/182: sync 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:0/228: sync 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:6/183: fdatasync d0/d6/d16/d1f/f25 0 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:6/184: creat d0/de/f3a x:0 0 0 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:0/229: creat d3/dd/d1f/d1e/d2c/d35/d36/f4c x:0 0 0 2024-05-09T06:29:30.649 INFO:tasks.workunit.client.1.smithi079.stdout:0/230: dread - d3/d5/f4b zero size 2024-05-09T06:29:30.651 INFO:tasks.workunit.client.1.smithi079.stdout:1/217: dwrite d0/d7/fb [0,4194304] 0 2024-05-09T06:29:30.651 INFO:tasks.workunit.client.1.smithi079.stdout:1/218: dread - d0/d12/d27/d26/f38 zero size 2024-05-09T06:29:30.651 INFO:tasks.workunit.client.1.smithi079.stdout:1/219: write d0/d12/f2c [157035,6422] 0 2024-05-09T06:29:30.652 INFO:tasks.workunit.client.1.smithi079.stdout:8/183: truncate d1/db/f30 3148329 0 2024-05-09T06:29:30.654 INFO:tasks.workunit.client.1.smithi079.stdout:9/410: symlink d1/d33/d28/d36/d38/d3a/l8c 0 2024-05-09T06:29:30.654 INFO:tasks.workunit.client.1.smithi079.stdout:9/411: creat d1/d5/f8d x:0 0 0 2024-05-09T06:29:30.660 INFO:tasks.workunit.client.1.smithi079.stdout:3/225: dread f11 [0,4194304] 0 2024-05-09T06:29:30.660 INFO:tasks.workunit.client.1.smithi079.stdout:3/226: fsync d1a/f35 0 2024-05-09T06:29:30.661 INFO:tasks.workunit.client.1.smithi079.stdout:6/185: unlink d0/d6/d16/d1f/f27 0 2024-05-09T06:29:30.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:30 smithi062 ceph-mon[26920]: pgmap v244: 65 pgs: 65 active+clean; 380 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 9.7 MiB/s rd, 18 MiB/s wr, 616 op/s 2024-05-09T06:29:30.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:30 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:30.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:30 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:29:30.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:30 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:29:30.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:30 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:29:30.663 INFO:tasks.workunit.client.1.smithi079.stdout:0/231: unlink d3/d5/f40 0 2024-05-09T06:29:30.663 INFO:tasks.workunit.client.1.smithi079.stdout:0/232: fdatasync d3/dd/d1f/fa 0 2024-05-09T06:29:30.663 INFO:tasks.workunit.client.1.smithi079.stdout:0/233: write d3/d5/d27/f24 [1363452,116164] 0 2024-05-09T06:29:30.666 INFO:tasks.workunit.client.1.smithi079.stdout:1/220: symlink d0/d12/d27/d43/d20/d39/l51 0 2024-05-09T06:29:30.667 INFO:tasks.workunit.client.1.smithi079.stdout:1/221: write d0/df/f14 [2668121,69084] 0 2024-05-09T06:29:30.667 INFO:tasks.workunit.client.1.smithi079.stdout:1/222: chown d0/d7/f9 7496381 1 2024-05-09T06:29:30.667 INFO:tasks.workunit.client.1.smithi079.stdout:5/275: dwrite d13/f48 [0,4194304] 0 2024-05-09T06:29:30.671 INFO:tasks.workunit.client.1.smithi079.stdout:2/300: rmdir d8 39 2024-05-09T06:29:30.677 INFO:tasks.workunit.client.1.smithi079.stdout:6/186: dwrite d0/de/f1c [0,4194304] 0 2024-05-09T06:29:30.677 INFO:tasks.workunit.client.1.smithi079.stdout:6/187: creat d0/d6/d16/f3b x:0 0 0 2024-05-09T06:29:30.679 INFO:tasks.workunit.client.1.smithi079.stdout:8/184: link d1/d5/dc/c2c d1/d5/c42 0 2024-05-09T06:29:30.684 INFO:tasks.workunit.client.1.smithi079.stdout:3/227: creat d1a/d1c/f45 x:0 0 0 2024-05-09T06:29:30.686 INFO:tasks.workunit.client.1.smithi079.stdout:0/234: truncate d3/d5/ff 4093273 0 2024-05-09T06:29:30.686 INFO:tasks.workunit.client.1.smithi079.stdout:0/235: chown d3/d5/d27/l3c 32497243 1 2024-05-09T06:29:30.686 INFO:tasks.workunit.client.1.smithi079.stdout:0/236: write d3/dd/d1f/f29 [1175290,40600] 0 2024-05-09T06:29:30.689 INFO:tasks.workunit.client.1.smithi079.stdout:1/223: symlink d0/d12/d48/l52 0 2024-05-09T06:29:30.695 INFO:tasks.workunit.client.1.smithi079.stdout:5/276: symlink d13/d4f/l6a 0 2024-05-09T06:29:30.697 INFO:tasks.workunit.client.1.smithi079.stdout:2/301: unlink d8/db/d4b/d4f/f46 0 2024-05-09T06:29:30.700 INFO:tasks.workunit.client.1.smithi079.stdout:6/188: mknod d0/d6/d1b/d20/c3c 0 2024-05-09T06:29:30.702 INFO:tasks.workunit.client.1.smithi079.stdout:8/185: symlink d1/d3/d20/d22/d3b/l43 0 2024-05-09T06:29:30.702 INFO:tasks.workunit.client.1.smithi079.stdout:8/186: write d1/d3/f17 [1232032,23812] 0 2024-05-09T06:29:30.702 INFO:tasks.workunit.client.1.smithi079.stdout:8/187: truncate d1/d3/fa 1873268 0 2024-05-09T06:29:30.702 INFO:tasks.workunit.client.1.smithi079.stdout:8/188: write d1/d18/f39 [994846,122364] 0 2024-05-09T06:29:30.702 INFO:tasks.workunit.client.1.smithi079.stdout:8/189: truncate d1/d18/f39 2012369 0 2024-05-09T06:29:30.703 INFO:tasks.workunit.client.1.smithi079.stdout:9/412: getdents d1/d33/d28/d36/d4d 0 2024-05-09T06:29:30.706 INFO:tasks.workunit.client.1.smithi079.stdout:9/413: dread d1/f17 [0,4194304] 0 2024-05-09T06:29:30.706 INFO:tasks.workunit.client.1.smithi079.stdout:9/414: fsync d1/d5/ff 0 2024-05-09T06:29:30.707 INFO:tasks.workunit.client.1.smithi079.stdout:0/237: creat d3/d5/d27/d2d/f4d x:0 0 0 2024-05-09T06:29:30.709 INFO:tasks.workunit.client.1.smithi079.stdout:1/224: mkdir d0/d12/d31/d53 0 2024-05-09T06:29:30.709 INFO:tasks.workunit.client.1.smithi079.stdout:1/225: write d0/d12/d27/d43/f2e [197831,111086] 0 2024-05-09T06:29:30.709 INFO:tasks.workunit.client.1.smithi079.stdout:1/226: write d0/d12/d16/f35 [730409,72093] 0 2024-05-09T06:29:30.712 INFO:tasks.workunit.client.1.smithi079.stdout:5/277: creat d13/d43/d26/f6b x:0 0 0 2024-05-09T06:29:30.712 INFO:tasks.workunit.client.1.smithi079.stdout:5/278: readlink l8 0 2024-05-09T06:29:30.714 INFO:tasks.workunit.client.1.smithi079.stdout:6/189: dwrite d0/de/f1e [0,4194304] 0 2024-05-09T06:29:30.717 INFO:tasks.workunit.client.1.smithi079.stdout:2/302: creat d8/db/d4b/d4f/d51/d6d/f74 x:0 0 0 2024-05-09T06:29:30.719 INFO:tasks.workunit.client.1.smithi079.stdout:8/190: rename d1/d18 to d1/d3/d20/d22/d44 0 2024-05-09T06:29:30.719 INFO:tasks.workunit.client.1.smithi079.stdout:8/191: dread - d1/d3/d20/f3d zero size 2024-05-09T06:29:30.722 INFO:tasks.workunit.client.1.smithi079.stdout:9/415: rmdir d1/d33/d28/d4c/d4e 39 2024-05-09T06:29:30.722 INFO:tasks.workunit.client.1.smithi079.stdout:9/416: chown d1/d33/d28/d36/d4d/d7d/f31 14088369 1 2024-05-09T06:29:30.724 INFO:tasks.workunit.client.1.smithi079.stdout:1/227: getdents d0/d12/d27 0 2024-05-09T06:29:30.724 INFO:tasks.workunit.client.1.smithi079.stdout:1/228: chown d0/d12/d27/d43/d20/c45 1 1 2024-05-09T06:29:30.724 INFO:tasks.workunit.client.1.smithi079.stdout:0/238: dwrite d3/dd/d1f/f20 [4194304,4194304] 0 2024-05-09T06:29:30.727 INFO:tasks.workunit.client.1.smithi079.stdout:0/239: fsync d3/d5/d27/f44 0 2024-05-09T06:29:30.727 INFO:tasks.workunit.client.1.smithi079.stdout:5/279: rmdir d13/d43/d39/d61 39 2024-05-09T06:29:30.730 INFO:tasks.workunit.client.1.smithi079.stdout:5/280: dread d13/d43/d26/f2e [0,4194304] 0 2024-05-09T06:29:30.732 INFO:tasks.workunit.client.1.smithi079.stdout:2/303: creat d8/db/d11/d5f/f75 x:0 0 0 2024-05-09T06:29:30.734 INFO:tasks.workunit.client.1.smithi079.stdout:6/190: rename d0/d6/d1b/d20/f33 to d0/d6/d1b/f3d 0 2024-05-09T06:29:30.735 INFO:tasks.workunit.client.1.smithi079.stdout:1/229: dread d0/d7/fb [0,4194304] 0 2024-05-09T06:29:30.737 INFO:tasks.workunit.client.1.smithi079.stdout:9/417: link d1/d5/d5b/f71 d1/f8e 0 2024-05-09T06:29:30.740 INFO:tasks.workunit.client.1.smithi079.stdout:5/281: dread d13/d2a/f2b [0,4194304] 0 2024-05-09T06:29:30.745 INFO:tasks.workunit.client.1.smithi079.stdout:0/240: symlink d3/dd/d1f/d1e/d2c/d35/l4e 0 2024-05-09T06:29:30.750 INFO:tasks.workunit.client.1.smithi079.stdout:6/191: getdents d0 0 2024-05-09T06:29:30.753 INFO:tasks.workunit.client.1.smithi079.stdout:8/192: rename d1/d3/d20/f3d to d1/d3/d20/d29/f45 0 2024-05-09T06:29:30.754 INFO:tasks.workunit.client.1.smithi079.stdout:1/230: dwrite d0/d12/d27/d26/f38 [0,4194304] 0 2024-05-09T06:29:30.755 INFO:tasks.workunit.client.1.smithi079.stdout:5/282: link fa d13/d43/d3d/d40/f6c 0 2024-05-09T06:29:30.758 INFO:tasks.workunit.client.1.smithi079.stdout:6/192: rename d0/d6/d1b/d20/l32 to d0/d6/d1b/d20/l3e 0 2024-05-09T06:29:30.760 INFO:tasks.workunit.client.1.smithi079.stdout:0/241: rename d3/c45 to d3/d5/d27/c4f 0 2024-05-09T06:29:30.760 INFO:tasks.workunit.client.1.smithi079.stdout:0/242: chown d3/d5/d27/c4f 150228 1 2024-05-09T06:29:30.761 INFO:tasks.workunit.client.1.smithi079.stdout:9/418: dwrite d1/d33/d28/d36/d4d/d7d/f7a [4194304,4194304] 0 2024-05-09T06:29:30.763 INFO:tasks.workunit.client.1.smithi079.stdout:8/193: creat d1/d3/d20/d22/d3b/f46 x:0 0 0 2024-05-09T06:29:30.764 INFO:tasks.workunit.client.1.smithi079.stdout:8/194: fsync d1/d3/f14 0 2024-05-09T06:29:30.765 INFO:tasks.workunit.client.1.smithi079.stdout:6/193: write d0/fc [7742270,77665] 0 2024-05-09T06:29:30.765 INFO:tasks.workunit.client.1.smithi079.stdout:6/194: chown d0/l1d 7 1 2024-05-09T06:29:30.766 INFO:tasks.workunit.client.1.smithi079.stdout:5/283: dread d13/d43/f25 [0,4194304] 0 2024-05-09T06:29:30.766 INFO:tasks.workunit.client.1.smithi079.stdout:8/195: dread d1/d3/f4 [0,4194304] 0 2024-05-09T06:29:30.769 INFO:tasks.workunit.client.1.smithi079.stdout:1/231: creat d0/d12/d27/f54 x:0 0 0 2024-05-09T06:29:30.769 INFO:tasks.workunit.client.1.smithi079.stdout:1/232: fdatasync d0/d12/d27/d43/f47 0 2024-05-09T06:29:30.773 INFO:tasks.workunit.client.1.smithi079.stdout:9/419: creat d1/f8f x:0 0 0 2024-05-09T06:29:30.773 INFO:tasks.workunit.client.1.smithi079.stdout:9/420: readlink d1/d33/d28/d36/d38/d3a/d56/l7f 0 2024-05-09T06:29:30.774 INFO:tasks.workunit.client.1.smithi079.stdout:6/195: write d0/de/f1e [2066597,130915] 0 2024-05-09T06:29:30.774 INFO:tasks.workunit.client.1.smithi079.stdout:6/196: write d0/d6/d16/d1f/f25 [320376,74742] 0 2024-05-09T06:29:30.777 INFO:tasks.workunit.client.1.smithi079.stdout:5/284: rmdir d13/d43/d3d/d40 39 2024-05-09T06:29:30.777 INFO:tasks.workunit.client.1.smithi079.stdout:5/285: write d13/d43/d26/d35/f64 [1040715,95252] 0 2024-05-09T06:29:30.778 INFO:tasks.workunit.client.1.smithi079.stdout:3/228: getdents d1a/d1c 0 2024-05-09T06:29:30.779 INFO:tasks.workunit.client.1.smithi079.stdout:3/229: chown d1a/d21/f40 0 1 2024-05-09T06:29:30.782 INFO:tasks.workunit.client.1.smithi079.stdout:8/196: link d1/db/c24 d1/d3/d20/d29/d33/c47 0 2024-05-09T06:29:30.784 INFO:tasks.workunit.client.1.smithi079.stdout:1/233: creat d0/d12/d27/d26/f55 x:0 0 0 2024-05-09T06:29:30.790 INFO:tasks.workunit.client.1.smithi079.stdout:0/243: dread d3/d5/ff [0,4194304] 0 2024-05-09T06:29:30.793 INFO:tasks.workunit.client.1.smithi079.stdout:0/244: dread d3/dd/d1f/f28 [0,4194304] 0 2024-05-09T06:29:30.795 INFO:tasks.workunit.client.1.smithi079.stdout:1/234: write d0/d12/d16/f2f [539290,31099] 0 2024-05-09T06:29:30.795 INFO:tasks.workunit.client.1.smithi079.stdout:1/235: read - d0/f4a zero size 2024-05-09T06:29:30.798 INFO:tasks.workunit.client.1.smithi079.stdout:0/245: dread d3/d5/d27/f24 [0,4194304] 0 2024-05-09T06:29:30.799 INFO:tasks.workunit.client.1.smithi079.stdout:0/246: truncate d3/d5/f4b 540488 0 2024-05-09T06:29:30.804 INFO:tasks.workunit.client.1.smithi079.stdout:6/197: creat d0/f3f x:0 0 0 2024-05-09T06:29:30.808 INFO:tasks.workunit.client.1.smithi079.stdout:2/304: rmdir d8/db/d4b/d4f/d51/d6d 39 2024-05-09T06:29:30.808 INFO:tasks.workunit.client.1.smithi079.stdout:2/305: write d8/db/dc/f6c [985156,119637] 0 2024-05-09T06:29:30.809 INFO:tasks.workunit.client.1.smithi079.stdout:2/306: write d8/db/d11/f3d [651653,25541] 0 2024-05-09T06:29:30.810 INFO:tasks.workunit.client.1.smithi079.stdout:3/230: link f16 d1a/d1d/d3a/f46 0 2024-05-09T06:29:30.814 INFO:tasks.workunit.client.1.smithi079.stdout:8/197: symlink d1/d3/d20/d22/l48 0 2024-05-09T06:29:30.819 INFO:tasks.workunit.client.1.smithi079.stdout:1/236: mknod d0/df/c56 0 2024-05-09T06:29:30.819 INFO:tasks.workunit.client.1.smithi079.stdout:1/237: chown d0/f4a 1072679513 1 2024-05-09T06:29:30.819 INFO:tasks.workunit.client.1.smithi079.stdout:9/421: dwrite d1/d6/f18 [0,4194304] 0 2024-05-09T06:29:30.821 INFO:tasks.workunit.client.1.smithi079.stdout:0/247: link d3/dd/d1f/d1e/d2c/d35/d36/l3f d3/dd/l50 0 2024-05-09T06:29:30.824 INFO:tasks.workunit.client.1.smithi079.stdout:5/286: rmdir d13/d2a 39 2024-05-09T06:29:30.824 INFO:tasks.workunit.client.1.smithi079.stdout:5/287: truncate d13/f1e 5109698 0 2024-05-09T06:29:30.824 INFO:tasks.workunit.client.1.smithi079.stdout:5/288: creat d13/d43/d26/d35/f6d x:0 0 0 2024-05-09T06:29:30.824 INFO:tasks.workunit.client.1.smithi079.stdout:5/289: truncate d13/d43/d26/f6b 33725 0 2024-05-09T06:29:30.825 INFO:tasks.workunit.client.1.smithi079.stdout:2/307: rename d8/db/d11/f57 to d8/db/d11/d5f/f76 0 2024-05-09T06:29:30.828 INFO:tasks.workunit.client.1.smithi079.stdout:9/422: dread d1/d33/d28/d36/f67 [0,4194304] 0 2024-05-09T06:29:30.828 INFO:tasks.workunit.client.1.smithi079.stdout:8/198: mknod d1/d3/d20/d29/d33/c49 0 2024-05-09T06:29:30.831 INFO:tasks.workunit.client.1.smithi079.stdout:1/238: mknod d0/d12/d27/d43/d20/c57 0 2024-05-09T06:29:30.831 INFO:tasks.workunit.client.1.smithi079.stdout:1/239: write d0/d12/d27/d26/f55 [175078,33642] 0 2024-05-09T06:29:30.831 INFO:tasks.workunit.client.1.smithi079.stdout:1/240: chown d0/f4a 40614 1 2024-05-09T06:29:30.841 INFO:tasks.workunit.client.1.smithi079.stdout:9/423: dread d1/d5/d5b/f89 [0,4194304] 0 2024-05-09T06:29:30.843 INFO:tasks.workunit.client.1.smithi079.stdout:0/248: mkdir d3/d5/d51 0 2024-05-09T06:29:30.849 INFO:tasks.workunit.client.1.smithi079.stdout:5/290: symlink d13/d4d/l6e 0 2024-05-09T06:29:30.849 INFO:tasks.workunit.client.1.smithi079.stdout:5/291: write d13/d43/f20 [3216747,113973] 0 2024-05-09T06:29:30.851 INFO:tasks.workunit.client.1.smithi079.stdout:2/308: symlink d8/l77 0 2024-05-09T06:29:30.854 INFO:tasks.workunit.client.1.smithi079.stdout:8/199: creat d1/db/f4a x:0 0 0 2024-05-09T06:29:30.856 INFO:tasks.workunit.client.1.smithi079.stdout:1/241: link d0/d12/f18 d0/f58 0 2024-05-09T06:29:30.866 INFO:tasks.workunit.client.1.smithi079.stdout:5/292: symlink d13/d2a/l6f 0 2024-05-09T06:29:30.866 INFO:tasks.workunit.client.1.smithi079.stdout:5/293: write d13/d43/d26/d35/f56 [398198,63476] 0 2024-05-09T06:29:30.866 INFO:tasks.workunit.client.1.smithi079.stdout:5/294: chown l4 27654 1 2024-05-09T06:29:30.866 INFO:tasks.workunit.client.1.smithi079.stdout:5/295: chown d13/d4f/c5d 0 1 2024-05-09T06:29:30.867 INFO:tasks.workunit.client.1.smithi079.stdout:4/326: sync 2024-05-09T06:29:30.867 INFO:tasks.workunit.client.1.smithi079.stdout:7/283: sync 2024-05-09T06:29:30.867 INFO:tasks.workunit.client.1.smithi079.stdout:7/284: truncate d4/d7/d22/f40 693800 0 2024-05-09T06:29:30.868 INFO:tasks.workunit.client.1.smithi079.stdout:2/309: mkdir d8/db/dc/d2c/d78 0 2024-05-09T06:29:30.868 INFO:tasks.workunit.client.1.smithi079.stdout:2/310: write d8/db/dc/d2c/d2e/f3e [1411733,124717] 0 2024-05-09T06:29:30.869 INFO:tasks.workunit.client.1.smithi079.stdout:2/311: truncate d8/f4e 742999 0 2024-05-09T06:29:30.869 INFO:tasks.workunit.client.1.smithi079.stdout:2/312: chown d8/d3c 6715172 1 2024-05-09T06:29:30.871 INFO:tasks.workunit.client.1.smithi079.stdout:8/200: mknod d1/d3/d20/d29/d33/c4b 0 2024-05-09T06:29:30.871 INFO:tasks.workunit.client.1.smithi079.stdout:8/201: chown d1/db/f4a 10 1 2024-05-09T06:29:30.873 INFO:tasks.workunit.client.1.smithi079.stdout:1/242: mknod d0/d12/d27/d43/c59 0 2024-05-09T06:29:30.876 INFO:tasks.workunit.client.1.smithi079.stdout:9/424: unlink d1/d33/d28/d36/d4d/d7d/f7a 0 2024-05-09T06:29:30.876 INFO:tasks.workunit.client.1.smithi079.stdout:9/425: stat d1/d33/d28/d36/d4d/d7d/l72 0 2024-05-09T06:29:30.878 INFO:tasks.workunit.client.1.smithi079.stdout:5/296: symlink d13/d4f/l70 0 2024-05-09T06:29:30.883 INFO:tasks.workunit.client.1.smithi079.stdout:2/313: dwrite d8/db/dc/d2c/f63 [0,4194304] 0 2024-05-09T06:29:30.883 INFO:tasks.workunit.client.1.smithi079.stdout:7/285: creat d4/d20/f4f x:0 0 0 2024-05-09T06:29:30.886 INFO:tasks.workunit.client.1.smithi079.stdout:8/202: link d1/d3/d20/d22/d3b/f46 d1/d3/d20/d22/d44/f4c 0 2024-05-09T06:29:30.888 INFO:tasks.workunit.client.1.smithi079.stdout:9/426: dread d1/f29 [0,4194304] 0 2024-05-09T06:29:30.888 INFO:tasks.workunit.client.1.smithi079.stdout:1/243: rename d0/d12/d27/d26/f38 to d0/d12/d27/d43/d20/d39/f5a 0 2024-05-09T06:29:30.893 INFO:tasks.workunit.client.1.smithi079.stdout:4/327: rmdir d6/dd/df 39 2024-05-09T06:29:30.897 INFO:tasks.workunit.client.1.smithi079.stdout:2/314: mkdir d8/db/d11/d79 0 2024-05-09T06:29:30.899 INFO:tasks.workunit.client.1.smithi079.stdout:8/203: creat d1/d3/f4d x:0 0 0 2024-05-09T06:29:30.899 INFO:tasks.workunit.client.1.smithi079.stdout:5/297: dwrite d13/d2a/f4e [0,4194304] 0 2024-05-09T06:29:30.900 INFO:tasks.workunit.client.1.smithi079.stdout:8/204: dread d1/f1f [0,4194304] 0 2024-05-09T06:29:30.901 INFO:tasks.workunit.client.1.smithi079.stdout:8/205: fdatasync d1/f1a 0 2024-05-09T06:29:30.901 INFO:tasks.workunit.client.1.smithi079.stdout:9/427: creat d1/d45/f90 x:0 0 0 2024-05-09T06:29:30.901 INFO:tasks.workunit.client.1.smithi079.stdout:9/428: chown d1/d5/f8d 0 1 2024-05-09T06:29:30.901 INFO:tasks.workunit.client.1.smithi079.stdout:6/198: truncate d0/d6/d16/d1f/f25 95292 0 2024-05-09T06:29:30.903 INFO:tasks.workunit.client.1.smithi079.stdout:1/244: symlink d0/df/l5b 0 2024-05-09T06:29:30.903 INFO:tasks.workunit.client.1.smithi079.stdout:1/245: truncate d0/d12/d27/f54 981400 0 2024-05-09T06:29:30.910 INFO:tasks.workunit.client.1.smithi079.stdout:6/199: dread d0/fc [0,4194304] 0 2024-05-09T06:29:30.910 INFO:tasks.workunit.client.1.smithi079.stdout:6/200: read - d0/f3f zero size 2024-05-09T06:29:30.914 INFO:tasks.workunit.client.1.smithi079.stdout:4/328: rename d6/d1a/d26/d2a/d54/fc to d6/f61 0 2024-05-09T06:29:30.915 INFO:tasks.workunit.client.1.smithi079.stdout:2/315: readlink d8/db/d4b/l58 0 2024-05-09T06:29:30.921 INFO:tasks.workunit.client.1.smithi079.stdout:5/298: symlink d13/d43/d26/l71 0 2024-05-09T06:29:30.924 INFO:tasks.workunit.client.1.smithi079.stdout:1/246: symlink d0/d12/d27/d43/d20/d39/l5c 0 2024-05-09T06:29:30.924 INFO:tasks.workunit.client.1.smithi079.stdout:1/247: fdatasync d0/d12/f18 0 2024-05-09T06:29:30.926 INFO:tasks.workunit.client.1.smithi079.stdout:6/201: truncate d0/f12 373619 0 2024-05-09T06:29:30.928 INFO:tasks.workunit.client.1.smithi079.stdout:8/206: rename d1/d3/f14 to d1/d3/d20/d29/f4e 0 2024-05-09T06:29:30.928 INFO:tasks.workunit.client.1.smithi079.stdout:8/207: creat d1/db/f4f x:0 0 0 2024-05-09T06:29:30.930 INFO:tasks.workunit.client.1.smithi079.stdout:4/329: readlink d6/d8/d27/l44 0 2024-05-09T06:29:30.930 INFO:tasks.workunit.client.1.smithi079.stdout:9/429: dread d1/d45/f82 [4194304,4194304] 0 2024-05-09T06:29:30.931 INFO:tasks.workunit.client.1.smithi079.stdout:9/430: fdatasync d1/d33/d28/d3e/f44 0 2024-05-09T06:29:30.931 INFO:tasks.workunit.client.1.smithi079.stdout:9/431: readlink d1/d33/d28/d36/d38/d3a/d56/l7f 0 2024-05-09T06:29:30.932 INFO:tasks.workunit.client.1.smithi079.stdout:2/316: unlink l4 0 2024-05-09T06:29:30.935 INFO:tasks.workunit.client.1.smithi079.stdout:5/299: mkdir d13/d43/d39/d61/d72 0 2024-05-09T06:29:30.935 INFO:tasks.workunit.client.1.smithi079.stdout:5/300: chown d13/d43/d26/l55 27 1 2024-05-09T06:29:30.935 INFO:tasks.workunit.client.1.smithi079.stdout:5/301: truncate d13/d43/d26/d35/f56 488387 0 2024-05-09T06:29:30.936 INFO:tasks.workunit.client.1.smithi079.stdout:5/302: readlink l8 0 2024-05-09T06:29:30.936 INFO:tasks.workunit.client.1.smithi079.stdout:9/432: dread d1/d6/f20 [0,4194304] 0 2024-05-09T06:29:30.938 INFO:tasks.workunit.client.1.smithi079.stdout:1/248: creat d0/d7/d4e/f5d x:0 0 0 2024-05-09T06:29:30.943 INFO:tasks.workunit.client.1.smithi079.stdout:8/208: mkdir d1/d3/d20/d22/d50 0 2024-05-09T06:29:30.943 INFO:tasks.workunit.client.1.smithi079.stdout:8/209: write d1/d3/fa [982849,61545] 0 2024-05-09T06:29:30.943 INFO:tasks.workunit.client.1.smithi079.stdout:8/210: chown d1/db/f4a 0 1 2024-05-09T06:29:30.945 INFO:tasks.workunit.client.1.smithi079.stdout:6/202: dwrite d0/d6/d1b/d20/f2f [0,4194304] 0 2024-05-09T06:29:30.946 INFO:tasks.workunit.client.1.smithi079.stdout:9/433: mkdir d1/d5/d91 0 2024-05-09T06:29:30.949 INFO:tasks.workunit.client.1.smithi079.stdout:1/249: truncate d0/d12/d16/f50 2051051 0 2024-05-09T06:29:30.953 INFO:tasks.workunit.client.1.smithi079.stdout:8/211: mknod d1/c51 0 2024-05-09T06:29:30.953 INFO:tasks.workunit.client.1.smithi079.stdout:8/212: dread - d1/db/f4a zero size 2024-05-09T06:29:30.954 INFO:tasks.workunit.client.1.smithi079.stdout:8/213: fsync d1/d3/d20/d29/f45 0 2024-05-09T06:29:30.964 INFO:tasks.workunit.client.1.smithi079.stdout:4/330: dwrite d6/d8/d32/f4a [0,4194304] 0 2024-05-09T06:29:30.964 INFO:tasks.workunit.client.1.smithi079.stdout:5/303: dwrite d13/f52 [0,4194304] 0 2024-05-09T06:29:30.964 INFO:tasks.workunit.client.1.smithi079.stdout:5/304: chown d13/d43/l54 72564 1 2024-05-09T06:29:30.964 INFO:tasks.workunit.client.1.smithi079.stdout:6/203: mknod d0/d6/d16/c40 0 2024-05-09T06:29:30.965 INFO:tasks.workunit.client.1.smithi079.stdout:9/434: dwrite d1/d33/f87 [0,4194304] 0 2024-05-09T06:29:30.965 INFO:tasks.workunit.client.1.smithi079.stdout:2/317: dwrite d8/db/f62 [0,4194304] 0 2024-05-09T06:29:30.965 INFO:tasks.workunit.client.1.smithi079.stdout:2/318: chown d8/db/dc/d2c/f33 33549211 1 2024-05-09T06:29:30.966 INFO:tasks.workunit.client.1.smithi079.stdout:1/250: mkdir d0/d12/d31/d53/d5e 0 2024-05-09T06:29:30.966 INFO:tasks.workunit.client.1.smithi079.stdout:1/251: stat d0/d7/fb 0 2024-05-09T06:29:30.972 INFO:tasks.workunit.client.1.smithi079.stdout:8/214: unlink d1/db/l37 0 2024-05-09T06:29:30.973 INFO:tasks.workunit.client.1.smithi079.stdout:8/215: creat d1/d3/d20/d22/d3b/f52 x:0 0 0 2024-05-09T06:29:30.973 INFO:tasks.workunit.client.1.smithi079.stdout:8/216: dread - d1/d5/dc/f34 zero size 2024-05-09T06:29:30.973 INFO:tasks.workunit.client.1.smithi079.stdout:8/217: read d1/d3/d20/d29/f4e [1493809,63132] 0 2024-05-09T06:29:30.981 INFO:tasks.workunit.client.1.smithi079.stdout:3/231: sync 2024-05-09T06:29:30.981 INFO:tasks.workunit.client.1.smithi079.stdout:3/232: read fa [127886,88538] 0 2024-05-09T06:29:30.983 INFO:tasks.workunit.client.1.smithi079.stdout:6/204: link d0/d6/d16/d1f/f23 d0/d6/d16/d1f/f41 0 2024-05-09T06:29:30.983 INFO:tasks.workunit.client.1.smithi079.stdout:6/205: fsync d0/f15 0 2024-05-09T06:29:30.983 INFO:tasks.workunit.client.1.smithi079.stdout:6/206: readlink d0/d6/d16/l24 0 2024-05-09T06:29:30.985 INFO:tasks.workunit.client.1.smithi079.stdout:4/331: dwrite d6/dd/f2f [0,4194304] 0 2024-05-09T06:29:30.990 INFO:tasks.workunit.client.1.smithi079.stdout:9/435: unlink d1/d5/l40 0 2024-05-09T06:29:30.991 INFO:tasks.workunit.client.1.smithi079.stdout:4/332: dread d6/dd/df/f13 [4194304,4194304] 0 2024-05-09T06:29:30.994 INFO:tasks.workunit.client.1.smithi079.stdout:1/252: getdents d0/d12/d48 0 2024-05-09T06:29:31.001 INFO:tasks.workunit.client.1.smithi079.stdout:8/218: creat d1/d3/d20/d29/d33/f53 x:0 0 0 2024-05-09T06:29:31.003 INFO:tasks.workunit.client.1.smithi079.stdout:3/233: truncate fc 4518584 0 2024-05-09T06:29:31.005 INFO:tasks.workunit.client.1.smithi079.stdout:6/207: rmdir d0/d6/d16/d28 39 2024-05-09T06:29:31.005 INFO:tasks.workunit.client.1.smithi079.stdout:6/208: chown d0/d6/d16/l24 218 1 2024-05-09T06:29:31.005 INFO:tasks.workunit.client.1.smithi079.stdout:6/209: stat d0/de/f1c 0 2024-05-09T06:29:31.005 INFO:tasks.workunit.client.1.smithi079.stdout:6/210: chown d0/de/l1a 1464400 1 2024-05-09T06:29:31.006 INFO:tasks.workunit.client.1.smithi079.stdout:3/234: dread f15 [0,4194304] 0 2024-05-09T06:29:31.007 INFO:tasks.workunit.client.1.smithi079.stdout:3/235: dread - d1a/d1c/d28/f2b zero size 2024-05-09T06:29:31.007 INFO:tasks.workunit.client.1.smithi079.stdout:3/236: fdatasync fc 0 2024-05-09T06:29:31.010 INFO:tasks.workunit.client.1.smithi079.stdout:9/436: symlink d1/d33/d28/d3e/l92 0 2024-05-09T06:29:31.013 INFO:tasks.workunit.client.1.smithi079.stdout:1/253: creat d0/d12/d27/d43/d20/f5f x:0 0 0 2024-05-09T06:29:31.013 INFO:tasks.workunit.client.1.smithi079.stdout:0/249: sync 2024-05-09T06:29:31.014 INFO:tasks.workunit.client.1.smithi079.stdout:8/219: mkdir d1/d3/d20/d22/d3f/d54 0 2024-05-09T06:29:31.014 INFO:tasks.workunit.client.1.smithi079.stdout:8/220: write d1/d3/f4 [1268597,113842] 0 2024-05-09T06:29:31.015 INFO:tasks.workunit.client.1.smithi079.stdout:8/221: stat d1 0 2024-05-09T06:29:31.015 INFO:tasks.workunit.client.1.smithi079.stdout:8/222: readlink d1/d3/l16 0 2024-05-09T06:29:31.019 INFO:tasks.workunit.client.1.smithi079.stdout:6/211: symlink d0/d6/d1b/l42 0 2024-05-09T06:29:31.019 INFO:tasks.workunit.client.1.smithi079.stdout:6/212: creat d0/de/f43 x:0 0 0 2024-05-09T06:29:31.023 INFO:tasks.workunit.client.1.smithi079.stdout:9/437: mknod d1/d33/d28/d3e/d6d/c93 0 2024-05-09T06:29:31.023 INFO:tasks.workunit.client.1.smithi079.stdout:9/438: creat d1/d33/d28/d3e/d75/f94 x:0 0 0 2024-05-09T06:29:31.025 INFO:tasks.workunit.client.1.smithi079.stdout:4/333: rename d6/d8/d32 to d6/d8/d27/d62 0 2024-05-09T06:29:31.028 INFO:tasks.workunit.client.1.smithi079.stdout:1/254: link d0/d12/d27/d43/l28 d0/d12/d27/d43/d20/l60 0 2024-05-09T06:29:31.028 INFO:tasks.workunit.client.1.smithi079.stdout:1/255: creat d0/d12/d27/d26/f61 x:0 0 0 2024-05-09T06:29:31.028 INFO:tasks.workunit.client.1.smithi079.stdout:0/250: dwrite d3/dd/d1f/f13 [0,4194304] 0 2024-05-09T06:29:31.035 INFO:tasks.workunit.client.1.smithi079.stdout:6/213: creat d0/d6/d1b/d2d/f44 x:0 0 0 2024-05-09T06:29:31.038 INFO:tasks.workunit.client.1.smithi079.stdout:4/334: dread d6/d8/d27/d62/f4a [0,4194304] 0 2024-05-09T06:29:31.039 INFO:tasks.workunit.client.1.smithi079.stdout:7/286: sync 2024-05-09T06:29:31.045 INFO:tasks.workunit.client.1.smithi079.stdout:1/256: link d0/d7/f9 d0/df/f62 0 2024-05-09T06:29:31.045 INFO:tasks.workunit.client.1.smithi079.stdout:1/257: chown d0/d12/d27/d26/f61 3151 1 2024-05-09T06:29:31.051 INFO:tasks.workunit.client.1.smithi079.stdout:1/258: dread d0/f58 [0,4194304] 0 2024-05-09T06:29:31.051 INFO:tasks.workunit.client.1.smithi079.stdout:1/259: write d0/d12/d27/d43/f47 [1491114,104514] 0 2024-05-09T06:29:31.052 INFO:tasks.workunit.client.1.smithi079.stdout:1/260: creat d0/d7/d4e/f63 x:0 0 0 2024-05-09T06:29:31.057 INFO:tasks.workunit.client.1.smithi079.stdout:8/223: rmdir d1/db 39 2024-05-09T06:29:31.057 INFO:tasks.workunit.client.1.smithi079.stdout:8/224: chown d1/d3/d20/d22/d44/f35 1 1 2024-05-09T06:29:31.060 INFO:tasks.workunit.client.1.smithi079.stdout:9/439: mkdir d1/d33/d28/d36/d4d/d7d/d19/d95 0 2024-05-09T06:29:31.062 INFO:tasks.workunit.client.1.smithi079.stdout:3/237: rename d1a/d1d/d34/f3b to d1a/d1d/d34/d42/f47 0 2024-05-09T06:29:31.068 INFO:tasks.workunit.client.1.smithi079.stdout:6/214: dwrite d0/de/f1e [0,4194304] 0 2024-05-09T06:29:31.070 INFO:tasks.workunit.client.1.smithi079.stdout:0/251: getdents d3/d5/d27 0 2024-05-09T06:29:31.070 INFO:tasks.workunit.client.1.smithi079.stdout:0/252: stat d3/d5/d27/c4f 0 2024-05-09T06:29:31.070 INFO:tasks.workunit.client.1.smithi079.stdout:0/253: write d3/dd/f3e [676296,52011] 0 2024-05-09T06:29:31.070 INFO:tasks.workunit.client.1.smithi079.stdout:0/254: truncate d3/dd/d1f/d1e/f42 818171 0 2024-05-09T06:29:31.070 INFO:tasks.workunit.client.1.smithi079.stdout:0/255: read - d3/dd/d18/f47 zero size 2024-05-09T06:29:31.074 INFO:tasks.workunit.client.1.smithi079.stdout:3/238: write fe [636791,32804] 0 2024-05-09T06:29:31.077 INFO:tasks.workunit.client.1.smithi079.stdout:8/225: rmdir d1/d3/d20/d22/d3f/d40 0 2024-05-09T06:29:31.078 INFO:tasks.workunit.client.1.smithi079.stdout:4/335: dwrite d6/dd/f4e [0,4194304] 0 2024-05-09T06:29:31.078 INFO:tasks.workunit.client.1.smithi079.stdout:4/336: write d6/d8/d27/d3d/f58 [645205,73212] 0 2024-05-09T06:29:31.078 INFO:tasks.workunit.client.1.smithi079.stdout:7/287: dwrite d4/d7/f13 [0,4194304] 0 2024-05-09T06:29:31.081 INFO:tasks.workunit.client.1.smithi079.stdout:8/226: dread d1/d3/d20/d22/d44/f39 [0,4194304] 0 2024-05-09T06:29:31.088 INFO:tasks.workunit.client.1.smithi079.stdout:4/337: write d6/d8/f50 [395907,37269] 0 2024-05-09T06:29:31.088 INFO:tasks.workunit.client.1.smithi079.stdout:4/338: chown d6/dd/df/f21 4924 1 2024-05-09T06:29:31.088 INFO:tasks.workunit.client.1.smithi079.stdout:4/339: chown d6/d1a 565510986 1 2024-05-09T06:29:31.090 INFO:tasks.workunit.client.1.smithi079.stdout:1/261: rename d0/d12/d27/d26/f61 to d0/d12/d48/f64 0 2024-05-09T06:29:31.095 INFO:tasks.workunit.client.1.smithi079.stdout:4/340: dread d6/f61 [0,4194304] 0 2024-05-09T06:29:31.096 INFO:tasks.workunit.client.1.smithi079.stdout:7/288: mkdir d4/d7/d22/d28/d50 0 2024-05-09T06:29:31.096 INFO:tasks.workunit.client.1.smithi079.stdout:7/289: chown d4/d30/d32 778675386 1 2024-05-09T06:29:31.097 INFO:tasks.workunit.client.1.smithi079.stdout:3/239: dwrite f5 [0,4194304] 0 2024-05-09T06:29:31.105 INFO:tasks.workunit.client.1.smithi079.stdout:8/227: mknod d1/d3/d20/d22/c55 0 2024-05-09T06:29:31.112 INFO:tasks.workunit.client.1.smithi079.stdout:6/215: rename d0/d6/cd to d0/d6/d1b/c45 0 2024-05-09T06:29:31.118 INFO:tasks.workunit.client.1.smithi079.stdout:7/290: symlink d4/d7/d22/d28/l51 0 2024-05-09T06:29:31.126 INFO:tasks.workunit.client.1.smithi079.stdout:6/216: creat d0/d6/d16/d28/f46 x:0 0 0 2024-05-09T06:29:31.126 INFO:tasks.workunit.client.1.smithi079.stdout:6/217: creat d0/d6/d1b/d20/f47 x:0 0 0 2024-05-09T06:29:31.126 INFO:tasks.workunit.client.1.smithi079.stdout:6/218: fdatasync d0/d6/d16/d1f/f23 0 2024-05-09T06:29:31.126 INFO:tasks.workunit.client.1.smithi079.stdout:6/219: chown d0/d6/d1b/d20/l3e 2012809 1 2024-05-09T06:29:31.126 INFO:tasks.workunit.client.1.smithi079.stdout:4/341: rmdir d6/dd/d34 39 2024-05-09T06:29:31.127 INFO:tasks.workunit.client.1.smithi079.stdout:3/240: dread d1a/d1d/d34/f38 [0,4194304] 0 2024-05-09T06:29:31.128 INFO:tasks.workunit.client.1.smithi079.stdout:7/291: symlink d4/d7/dd/l52 0 2024-05-09T06:29:31.131 INFO:tasks.workunit.client.1.smithi079.stdout:9/440: link d1/d45/f60 d1/d33/d28/d36/d4d/d7d/d19/f96 0 2024-05-09T06:29:31.136 INFO:tasks.workunit.client.1.smithi079.stdout:6/220: rename d0/f12 to d0/de/f48 0 2024-05-09T06:29:31.136 INFO:tasks.workunit.client.1.smithi079.stdout:6/221: write d0/de/f1e [4737124,92722] 0 2024-05-09T06:29:31.137 INFO:tasks.workunit.client.1.smithi079.stdout:3/241: rmdir d1a/d1d/d3a 39 2024-05-09T06:29:31.138 INFO:tasks.workunit.client.1.smithi079.stdout:3/242: chown d1a/d1d/d34/f38 60621142 1 2024-05-09T06:29:31.139 INFO:tasks.workunit.client.1.smithi079.stdout:7/292: mknod d4/d7/d22/d28/c53 0 2024-05-09T06:29:31.139 INFO:tasks.workunit.client.1.smithi079.stdout:7/293: chown d4/d7/dd/c27 24186 1 2024-05-09T06:29:31.142 INFO:tasks.workunit.client.1.smithi079.stdout:9/441: rename d1/d33/d28/d36/d4d/d7d/d19/d95 to d1/d33/d28/d4c/d97 0 2024-05-09T06:29:31.143 INFO:tasks.workunit.client.1.smithi079.stdout:4/342: dwrite d6/dd/d34/f52 [0,4194304] 0 2024-05-09T06:29:31.144 INFO:tasks.workunit.client.1.smithi079.stdout:4/343: write d6/d8/d27/f2e [1257257,60834] 0 2024-05-09T06:29:31.145 INFO:tasks.workunit.client.1.smithi079.stdout:3/243: creat d1a/d1d/d34/d42/f48 x:0 0 0 2024-05-09T06:29:31.147 INFO:tasks.workunit.client.1.smithi079.stdout:7/294: symlink d4/l54 0 2024-05-09T06:29:31.147 INFO:tasks.workunit.client.1.smithi079.stdout:7/295: write d4/d7/d37/f46 [815212,88426] 0 2024-05-09T06:29:31.154 INFO:tasks.workunit.client.1.smithi079.stdout:3/244: write d1a/f35 [202292,40080] 0 2024-05-09T06:29:31.155 INFO:tasks.workunit.client.1.smithi079.stdout:7/296: mknod d4/d7/d22/d28/c55 0 2024-05-09T06:29:31.160 INFO:tasks.workunit.client.1.smithi079.stdout:9/442: dread d1/d33/f37 [0,4194304] 0 2024-05-09T06:29:31.160 INFO:tasks.workunit.client.1.smithi079.stdout:7/297: mkdir d4/d7/dd/d47/d56 0 2024-05-09T06:29:31.163 INFO:tasks.workunit.client.1.smithi079.stdout:6/222: link d0/de/f48 d0/d6/d16/d1f/f49 0 2024-05-09T06:29:31.163 INFO:tasks.workunit.client.1.smithi079.stdout:6/223: readlink d0/l10 0 2024-05-09T06:29:31.163 INFO:tasks.workunit.client.1.smithi079.stdout:6/224: write d0/f3f [595085,63630] 0 2024-05-09T06:29:31.163 INFO:tasks.workunit.client.1.smithi079.stdout:6/225: creat d0/d6/d1b/d2d/f4a x:0 0 0 2024-05-09T06:29:31.163 INFO:tasks.workunit.client.1.smithi079.stdout:6/226: fsync d0/fc 0 2024-05-09T06:29:31.163 INFO:tasks.workunit.client.1.smithi079.stdout:3/245: rmdir d1a/d1c/d22 39 2024-05-09T06:29:31.164 INFO:tasks.workunit.client.1.smithi079.stdout:4/344: dwrite d6/d1a/d26/d2a/d54/f17 [0,4194304] 0 2024-05-09T06:29:31.164 INFO:tasks.workunit.client.1.smithi079.stdout:4/345: chown d6/d1a/d26/d2a 733 1 2024-05-09T06:29:31.165 INFO:tasks.workunit.client.1.smithi079.stdout:9/443: unlink d1/d5/f10 0 2024-05-09T06:29:31.167 INFO:tasks.workunit.client.1.smithi079.stdout:7/298: creat d4/d7/d37/f57 x:0 0 0 2024-05-09T06:29:31.171 INFO:tasks.workunit.client.1.smithi079.stdout:3/246: rename d1a/d1c/d22/f26 to d1a/f49 0 2024-05-09T06:29:31.174 INFO:tasks.workunit.client.1.smithi079.stdout:4/346: unlink d6/dd/d34/f60 0 2024-05-09T06:29:31.174 INFO:tasks.workunit.client.1.smithi079.stdout:4/347: truncate d6/d8/d27/d62/f51 245786 0 2024-05-09T06:29:31.175 INFO:tasks.workunit.client.1.smithi079.stdout:6/227: dwrite d0/d6/d16/f30 [0,4194304] 0 2024-05-09T06:29:31.175 INFO:tasks.workunit.client.1.smithi079.stdout:6/228: readlink d0/d6/d1b/d2d/l34 0 2024-05-09T06:29:31.175 INFO:tasks.workunit.client.1.smithi079.stdout:6/229: fsync d0/f15 0 2024-05-09T06:29:31.175 INFO:tasks.workunit.client.1.smithi079.stdout:6/230: chown d0/d6 792 1 2024-05-09T06:29:31.179 INFO:tasks.workunit.client.1.smithi079.stdout:7/299: mknod d4/d7/dd/c58 0 2024-05-09T06:29:31.179 INFO:tasks.workunit.client.1.smithi079.stdout:7/300: fsync d4/d7/f25 0 2024-05-09T06:29:31.179 INFO:tasks.workunit.client.1.smithi079.stdout:7/301: chown d4/d20/l43 1362166 1 2024-05-09T06:29:31.180 INFO:tasks.workunit.client.1.smithi079.stdout:3/247: mknod d1a/d1c/c4a 0 2024-05-09T06:29:31.180 INFO:tasks.workunit.client.1.smithi079.stdout:3/248: dread - d1a/d1c/d28/f43 zero size 2024-05-09T06:29:31.180 INFO:tasks.workunit.client.1.smithi079.stdout:3/249: creat d1a/d1c/d28/f4b x:0 0 0 2024-05-09T06:29:31.188 INFO:tasks.workunit.client.1.smithi079.stdout:9/444: mknod d1/d33/d2b/c98 0 2024-05-09T06:29:31.190 INFO:tasks.workunit.client.1.smithi079.stdout:7/302: rename d4/d7/d22/d28/f3e to d4/d7/d22/f59 0 2024-05-09T06:29:31.190 INFO:tasks.workunit.client.1.smithi079.stdout:7/303: dread - d4/d7/f49 zero size 2024-05-09T06:29:31.192 INFO:tasks.workunit.client.1.smithi079.stdout:3/250: symlink d1a/d1c/d1f/d3f/l4c 0 2024-05-09T06:29:31.195 INFO:tasks.workunit.client.1.smithi079.stdout:4/348: dwrite d6/dd/df/f13 [0,4194304] 0 2024-05-09T06:29:31.195 INFO:tasks.workunit.client.1.smithi079.stdout:4/349: fdatasync d6/dd/df/f3b 0 2024-05-09T06:29:31.198 INFO:tasks.workunit.client.1.smithi079.stdout:7/304: rmdir d4/d30/d31/d34 39 2024-05-09T06:29:31.198 INFO:tasks.workunit.client.1.smithi079.stdout:3/251: rename f15 to d1a/d1c/d1f/f4d 0 2024-05-09T06:29:31.205 INFO:tasks.workunit.client.1.smithi079.stdout:6/231: rmdir d0/d6/d1b 39 2024-05-09T06:29:31.205 INFO:tasks.workunit.client.1.smithi079.stdout:6/232: fsync d0/f15 0 2024-05-09T06:29:31.206 INFO:tasks.workunit.client.1.smithi079.stdout:6/233: write d0/de/f1e [4233408,80520] 0 2024-05-09T06:29:31.206 INFO:tasks.workunit.client.1.smithi079.stdout:6/234: write d0/d6/d1b/d20/f2b [554330,120015] 0 2024-05-09T06:29:31.206 INFO:tasks.workunit.client.1.smithi079.stdout:7/305: dread d4/d30/f3a [0,4194304] 0 2024-05-09T06:29:31.211 INFO:tasks.workunit.client.1.smithi079.stdout:3/252: dwrite d1a/d1d/f3e [0,4194304] 0 2024-05-09T06:29:31.221 INFO:tasks.workunit.client.1.smithi079.stdout:9/445: mkdir d1/d33/d28/d4c/d4e/d2d/d99 0 2024-05-09T06:29:31.221 INFO:tasks.workunit.client.1.smithi079.stdout:9/446: read - d1/d33/d28/d3e/d75/f94 zero size 2024-05-09T06:29:31.221 INFO:tasks.workunit.client.1.smithi079.stdout:9/447: chown d1/d33/d28/d36/d4d/d7d/d19/f1e 17495 1 2024-05-09T06:29:31.224 INFO:tasks.workunit.client.1.smithi079.stdout:6/235: rename d0/d6/d1b/d20/f47 to d0/d6/d1b/f4b 0 2024-05-09T06:29:31.225 INFO:tasks.workunit.client.1.smithi079.stdout:7/306: truncate d4/d7/d22/f23 3770614 0 2024-05-09T06:29:31.231 INFO:tasks.workunit.client.1.smithi079.stdout:3/253: truncate fe 1867392 0 2024-05-09T06:29:31.233 INFO:tasks.workunit.client.1.smithi079.stdout:4/350: rmdir d6/d15 39 2024-05-09T06:29:31.234 INFO:tasks.workunit.client.1.smithi079.stdout:7/307: symlink d4/d30/l5a 0 2024-05-09T06:29:31.235 INFO:tasks.workunit.client.1.smithi079.stdout:7/308: chown d4/d30/c38 321 1 2024-05-09T06:29:31.236 INFO:tasks.workunit.client.1.smithi079.stdout:3/254: mkdir d1a/d1c/d28/d4e 0 2024-05-09T06:29:31.237 INFO:tasks.workunit.client.1.smithi079.stdout:4/351: dread d6/f24 [0,4194304] 0 2024-05-09T06:29:31.237 INFO:tasks.workunit.client.1.smithi079.stdout:4/352: chown d6/d1a/d26/f30 2917708 1 2024-05-09T06:29:31.237 INFO:tasks.workunit.client.1.smithi079.stdout:4/353: chown d6/d1a/d26/d2a/d54/f23 189249 1 2024-05-09T06:29:31.237 INFO:tasks.workunit.client.1.smithi079.stdout:4/354: fsync d6/d8/d27/d3d/f58 0 2024-05-09T06:29:31.240 INFO:tasks.workunit.client.1.smithi079.stdout:4/355: creat d6/d1a/d26/d2a/d54/f63 x:0 0 0 2024-05-09T06:29:31.240 INFO:tasks.workunit.client.1.smithi079.stdout:4/356: creat d6/d8/d27/d3d/f64 x:0 0 0 2024-05-09T06:29:31.243 INFO:tasks.workunit.client.1.smithi079.stdout:9/448: dwrite d1/d33/f37 [0,4194304] 0 2024-05-09T06:29:31.243 INFO:tasks.workunit.client.1.smithi079.stdout:4/357: mknod d6/d8/d27/d3d/d5b/c65 0 2024-05-09T06:29:31.244 INFO:tasks.workunit.client.1.smithi079.stdout:6/236: dwrite d0/d6/d16/d28/f46 [0,4194304] 0 2024-05-09T06:29:31.246 INFO:tasks.workunit.client.1.smithi079.stdout:0/256: sync 2024-05-09T06:29:31.246 INFO:tasks.workunit.client.1.smithi079.stdout:2/319: sync 2024-05-09T06:29:31.246 INFO:tasks.workunit.client.1.smithi079.stdout:1/262: sync 2024-05-09T06:29:31.246 INFO:tasks.workunit.client.1.smithi079.stdout:5/305: sync 2024-05-09T06:29:31.246 INFO:tasks.workunit.client.1.smithi079.stdout:5/306: truncate d13/f5f 519065 0 2024-05-09T06:29:31.246 INFO:tasks.workunit.client.1.smithi079.stdout:2/320: write f3 [7182392,56132] 0 2024-05-09T06:29:31.246 INFO:tasks.workunit.client.1.smithi079.stdout:8/228: sync 2024-05-09T06:29:31.247 INFO:tasks.workunit.client.1.smithi079.stdout:4/358: stat d6/dd/l1d 0 2024-05-09T06:29:31.254 INFO:tasks.workunit.client.1.smithi079.stdout:1/263: dread d0/d12/f2c [0,4194304] 0 2024-05-09T06:29:31.256 INFO:tasks.workunit.client.1.smithi079.stdout:6/237: creat d0/d6/d1b/d2d/f4c x:0 0 0 2024-05-09T06:29:31.256 INFO:tasks.workunit.client.1.smithi079.stdout:6/238: chown d0/d6/c9 144079258 1 2024-05-09T06:29:31.256 INFO:tasks.workunit.client.1.smithi079.stdout:2/321: dread d8/db/dc/d2c/f63 [0,4194304] 0 2024-05-09T06:29:31.258 INFO:tasks.workunit.client.1.smithi079.stdout:5/307: symlink d13/d2a/l73 0 2024-05-09T06:29:31.260 INFO:tasks.workunit.client.1.smithi079.stdout:8/229: rmdir d1/d5/dc/d2b 0 2024-05-09T06:29:31.260 INFO:tasks.workunit.client.1.smithi079.stdout:8/230: write d1/d3/d20/d29/d33/f53 [2511,75860] 0 2024-05-09T06:29:31.264 INFO:tasks.workunit.client.1.smithi079.stdout:9/449: dwrite d1/d33/d28/d36/d4d/d7d/d19/f1e [4194304,4194304] 0 2024-05-09T06:29:31.264 INFO:tasks.workunit.client.1.smithi079.stdout:9/450: write d1/d33/d28/d36/d4d/d7d/d19/f80 [816058,84375] 0 2024-05-09T06:29:31.264 INFO:tasks.workunit.client.1.smithi079.stdout:7/309: rename d4/d30 to d4/d7/dd/d5b 0 2024-05-09T06:29:31.270 INFO:tasks.workunit.client.1.smithi079.stdout:1/264: rmdir d0 39 2024-05-09T06:29:31.272 INFO:tasks.workunit.client.1.smithi079.stdout:6/239: link d0/de/f48 d0/d6/f4d 0 2024-05-09T06:29:31.272 INFO:tasks.workunit.client.1.smithi079.stdout:6/240: creat d0/d6/d1b/d2d/f4e x:0 0 0 2024-05-09T06:29:31.272 INFO:tasks.workunit.client.1.smithi079.stdout:6/241: write d0/d6/d1b/d20/f2b [562161,123626] 0 2024-05-09T06:29:31.274 INFO:tasks.workunit.client.1.smithi079.stdout:2/322: unlink d8/db/dc/l17 0 2024-05-09T06:29:31.275 INFO:tasks.workunit.client.1.smithi079.stdout:4/359: getdents d6/d8/d27/d3d 0 2024-05-09T06:29:31.278 INFO:tasks.workunit.client.1.smithi079.stdout:8/231: dwrite d1/d3/d20/d22/d3b/f46 [0,4194304] 0 2024-05-09T06:29:31.282 INFO:tasks.workunit.client.1.smithi079.stdout:2/323: dread d8/db/d11/f35 [0,4194304] 0 2024-05-09T06:29:31.288 INFO:tasks.workunit.client.1.smithi079.stdout:7/310: mkdir d4/d7/d22/d28/d50/d5c 0 2024-05-09T06:29:31.292 INFO:tasks.workunit.client.1.smithi079.stdout:1/265: getdents d0/d12/d48 0 2024-05-09T06:29:31.292 INFO:tasks.workunit.client.1.smithi079.stdout:1/266: read - d0/d12/d27/d26/f29 zero size 2024-05-09T06:29:31.296 INFO:tasks.workunit.client.1.smithi079.stdout:4/360: mknod d6/d8/c66 0 2024-05-09T06:29:31.297 INFO:tasks.workunit.client.1.smithi079.stdout:6/242: dwrite d0/f19 [0,4194304] 0 2024-05-09T06:29:31.297 INFO:tasks.workunit.client.1.smithi079.stdout:6/243: dread - d0/de/f43 zero size 2024-05-09T06:29:31.299 INFO:tasks.workunit.client.1.smithi079.stdout:2/324: dwrite d8/db/dc/d2c/f31 [0,4194304] 0 2024-05-09T06:29:31.301 INFO:tasks.workunit.client.1.smithi079.stdout:8/232: rmdir d1/db 39 2024-05-09T06:29:31.301 INFO:tasks.workunit.client.1.smithi079.stdout:8/233: readlink d1/d3/d20/d22/d3f/l41 0 2024-05-09T06:29:31.301 INFO:tasks.workunit.client.1.smithi079.stdout:8/234: chown d1/d5/dc/f1d 199385 1 2024-05-09T06:29:31.303 INFO:tasks.workunit.client.1.smithi079.stdout:3/255: rename d1a/d1d/d34/d42/f48 to d1a/d1d/d34/f4f 0 2024-05-09T06:29:31.303 INFO:tasks.workunit.client.1.smithi079.stdout:3/256: creat d1a/d1d/d34/d42/f50 x:0 0 0 2024-05-09T06:29:31.303 INFO:tasks.workunit.client.1.smithi079.stdout:3/257: chown d1a/d1c/d28/d4e 24777382 1 2024-05-09T06:29:31.304 INFO:tasks.workunit.client.1.smithi079.stdout:1/267: mknod d0/d12/c65 0 2024-05-09T06:29:31.308 INFO:tasks.workunit.client.1.smithi079.stdout:4/361: symlink d6/d1a/d26/d2a/l67 0 2024-05-09T06:29:31.308 INFO:tasks.workunit.client.1.smithi079.stdout:4/362: write d6/d8/d27/d62/f51 [411492,38876] 0 2024-05-09T06:29:31.308 INFO:tasks.workunit.client.1.smithi079.stdout:4/363: truncate d6/d15/f5f 618200 0 2024-05-09T06:29:31.308 INFO:tasks.workunit.client.1.smithi079.stdout:8/235: dread d1/d3/d20/f32 [0,4194304] 0 2024-05-09T06:29:31.311 INFO:tasks.workunit.client.1.smithi079.stdout:3/258: write d1a/d1c/d1f/f31 [1264368,1562] 0 2024-05-09T06:29:31.311 INFO:tasks.workunit.client.1.smithi079.stdout:3/259: chown d1a/d1c/c32 3355 1 2024-05-09T06:29:31.311 INFO:tasks.workunit.client.1.smithi079.stdout:3/260: readlink d1a/d1c/d1f/d3f/l44 0 2024-05-09T06:29:31.311 INFO:tasks.workunit.client.1.smithi079.stdout:3/261: stat d1a/d1c/c23 0 2024-05-09T06:29:31.311 INFO:tasks.workunit.client.1.smithi079.stdout:3/262: fsync d1a/f3d 0 2024-05-09T06:29:31.315 INFO:tasks.workunit.client.1.smithi079.stdout:8/236: dread d1/db/f30 [0,4194304] 0 2024-05-09T06:29:31.318 INFO:tasks.workunit.client.1.smithi079.stdout:2/325: symlink d8/db/dc/d2c/d2e/l7a 0 2024-05-09T06:29:31.323 INFO:tasks.workunit.client.1.smithi079.stdout:1/268: mknod d0/d12/c66 0 2024-05-09T06:29:31.323 INFO:tasks.workunit.client.1.smithi079.stdout:1/269: chown d0/d12/d27/d43/d20 4742 1 2024-05-09T06:29:31.324 INFO:tasks.workunit.client.1.smithi079.stdout:3/263: dwrite d1a/d1d/f41 [0,4194304] 0 2024-05-09T06:29:31.324 INFO:tasks.workunit.client.1.smithi079.stdout:3/264: creat d1a/d21/f51 x:0 0 0 2024-05-09T06:29:31.324 INFO:tasks.workunit.client.1.smithi079.stdout:3/265: chown d1a/d1c/l20 3 1 2024-05-09T06:29:31.328 INFO:tasks.workunit.client.1.smithi079.stdout:6/244: truncate d0/de/f1e 1683358 0 2024-05-09T06:29:31.330 INFO:tasks.workunit.client.1.smithi079.stdout:8/237: mkdir d1/d56 0 2024-05-09T06:29:31.331 INFO:tasks.workunit.client.1.smithi079.stdout:3/266: dread d1a/f49 [0,4194304] 0 2024-05-09T06:29:31.331 INFO:tasks.workunit.client.1.smithi079.stdout:1/270: write d0/d7/fb [2747265,91269] 0 2024-05-09T06:29:31.334 INFO:tasks.workunit.client.1.smithi079.stdout:3/267: dread d1a/d1d/d3a/f46 [0,4194304] 0 2024-05-09T06:29:31.337 INFO:tasks.workunit.client.1.smithi079.stdout:1/271: dread d0/d12/d16/f2f [0,4194304] 0 2024-05-09T06:29:31.337 INFO:tasks.workunit.client.1.smithi079.stdout:6/245: mknod d0/de/c4f 0 2024-05-09T06:29:31.338 INFO:tasks.workunit.client.1.smithi079.stdout:1/272: fsync d0/d12/d16/f2f 0 2024-05-09T06:29:31.338 INFO:tasks.workunit.client.1.smithi079.stdout:1/273: fdatasync d0/f4a 0 2024-05-09T06:29:31.339 INFO:tasks.workunit.client.1.smithi079.stdout:9/451: rename d1/d33/d28/d3e/d6d to d1/d5/d9a 0 2024-05-09T06:29:31.340 INFO:tasks.workunit.client.1.smithi079.stdout:1/274: dread d0/d7/f9 [0,4194304] 0 2024-05-09T06:29:31.340 INFO:tasks.workunit.client.1.smithi079.stdout:1/275: write d0/d7/f9 [1449069,117009] 0 2024-05-09T06:29:31.341 INFO:tasks.workunit.client.1.smithi079.stdout:6/246: creat d0/d6/d1b/f50 x:0 0 0 2024-05-09T06:29:31.341 INFO:tasks.workunit.client.1.smithi079.stdout:6/247: read - d0/de/f3a zero size 2024-05-09T06:29:31.343 INFO:tasks.workunit.client.1.smithi079.stdout:8/238: rename d1/d3/d20/d29/c31 to d1/d3/d20/d22/d50/c57 0 2024-05-09T06:29:31.345 INFO:tasks.workunit.client.1.smithi079.stdout:9/452: symlink d1/d33/d28/d36/d4d/d51/l9b 0 2024-05-09T06:29:31.345 INFO:tasks.workunit.client.1.smithi079.stdout:9/453: chown d1/d5/f21 965987879 1 2024-05-09T06:29:31.346 INFO:tasks.workunit.client.1.smithi079.stdout:3/268: dwrite d1a/d1c/f45 [0,4194304] 0 2024-05-09T06:29:31.349 INFO:tasks.workunit.client.1.smithi079.stdout:1/276: rename d0/d12/d31 to d0/d12/d67 0 2024-05-09T06:29:31.349 INFO:tasks.workunit.client.1.smithi079.stdout:1/277: stat d0/d12/d67 0 2024-05-09T06:29:31.354 INFO:tasks.workunit.client.1.smithi079.stdout:8/239: rmdir d1/d3/d20/d22/d44 39 2024-05-09T06:29:31.355 INFO:tasks.workunit.client.1.smithi079.stdout:1/278: dread d0/d7/f9 [0,4194304] 0 2024-05-09T06:29:31.361 INFO:tasks.workunit.client.1.smithi079.stdout:3/269: mknod d1a/d1c/d22/c52 0 2024-05-09T06:29:31.361 INFO:tasks.workunit.client.1.smithi079.stdout:1/279: dread d0/d12/d16/f2f [0,4194304] 0 2024-05-09T06:29:31.361 INFO:tasks.workunit.client.1.smithi079.stdout:3/270: read - d1a/f3d zero size 2024-05-09T06:29:31.361 INFO:tasks.workunit.client.1.smithi079.stdout:1/280: chown d0/d12/d16/l1e 215 1 2024-05-09T06:29:31.362 INFO:tasks.workunit.client.1.smithi079.stdout:6/248: rmdir d0/d6/d1b/d2d 39 2024-05-09T06:29:31.366 INFO:tasks.workunit.client.1.smithi079.stdout:9/454: symlink d1/d33/d48/d64/l9c 0 2024-05-09T06:29:31.369 INFO:tasks.workunit.client.1.smithi079.stdout:1/281: mknod d0/d12/d48/c68 0 2024-05-09T06:29:31.370 INFO:tasks.workunit.client.1.smithi079.stdout:6/249: symlink d0/d6/d1b/d20/l51 0 2024-05-09T06:29:31.372 INFO:tasks.workunit.client.1.smithi079.stdout:8/240: link d1/l2 d1/d3/l58 0 2024-05-09T06:29:31.375 INFO:tasks.workunit.client.1.smithi079.stdout:9/455: write d1/d33/f87 [4783549,128481] 0 2024-05-09T06:29:31.375 INFO:tasks.workunit.client.1.smithi079.stdout:9/456: write d1/d5/f8d [56697,100718] 0 2024-05-09T06:29:31.375 INFO:tasks.workunit.client.1.smithi079.stdout:1/282: read d0/d12/f1a [6592354,103995] 0 2024-05-09T06:29:31.379 INFO:tasks.workunit.client.1.smithi079.stdout:6/250: symlink d0/l52 0 2024-05-09T06:29:31.379 INFO:tasks.workunit.client.1.smithi079.stdout:6/251: write d0/de/f3a [993553,89546] 0 2024-05-09T06:29:31.379 INFO:tasks.workunit.client.1.smithi079.stdout:6/252: chown d0/d6/d1b/d20 1584227559 1 2024-05-09T06:29:31.379 INFO:tasks.workunit.client.1.smithi079.stdout:6/253: readlink d0/de/l1a 0 2024-05-09T06:29:31.379 INFO:tasks.workunit.client.1.smithi079.stdout:6/254: fsync d0/d6/f4d 0 2024-05-09T06:29:31.379 INFO:tasks.workunit.client.1.smithi079.stdout:6/255: write d0/f3f [957694,74476] 0 2024-05-09T06:29:31.379 INFO:tasks.workunit.client.1.smithi079.stdout:1/283: dread d0/d12/f1a [4194304,4194304] 0 2024-05-09T06:29:31.381 INFO:tasks.workunit.client.1.smithi079.stdout:9/457: mknod d1/d33/d28/d3e/d75/c9d 0 2024-05-09T06:29:31.382 INFO:tasks.workunit.client.1.smithi079.stdout:9/458: stat d1/d33/d28/d36/d4d/d51/l9b 0 2024-05-09T06:29:31.382 INFO:tasks.workunit.client.1.smithi079.stdout:9/459: truncate d1/d5/f21 1314666 0 2024-05-09T06:29:31.383 INFO:tasks.workunit.client.1.smithi079.stdout:3/271: rename d1a/d1c/d28 to d1a/d1c/d22/d53 0 2024-05-09T06:29:31.383 INFO:tasks.workunit.client.1.smithi079.stdout:3/272: chown d1a/d1d/d34/f4f 31253 1 2024-05-09T06:29:31.383 INFO:tasks.workunit.client.1.smithi079.stdout:3/273: read - d1a/d1d/d34/f4f zero size 2024-05-09T06:29:31.384 INFO:tasks.workunit.client.1.smithi079.stdout:1/284: getdents d0 0 2024-05-09T06:29:31.384 INFO:tasks.workunit.client.1.smithi079.stdout:1/285: getdents d0 0 2024-05-09T06:29:31.385 INFO:tasks.workunit.client.1.smithi079.stdout:9/460: mknod d1/d5/d5b/c9e 0 2024-05-09T06:29:31.387 INFO:tasks.workunit.client.1.smithi079.stdout:9/461: read d1/f17 [481066,78909] 0 2024-05-09T06:29:31.387 INFO:tasks.workunit.client.1.smithi079.stdout:3/274: mkdir d1a/d1d/d3a/d54 0 2024-05-09T06:29:31.387 INFO:tasks.workunit.client.1.smithi079.stdout:3/275: readlink d1a/l27 0 2024-05-09T06:29:31.388 INFO:tasks.workunit.client.1.smithi079.stdout:8/241: dwrite d1/d3/d20/f32 [0,4194304] 0 2024-05-09T06:29:31.388 INFO:tasks.workunit.client.1.smithi079.stdout:8/242: creat d1/d3/d20/d22/d3b/f59 x:0 0 0 2024-05-09T06:29:31.389 INFO:tasks.workunit.client.1.smithi079.stdout:1/286: unlink d0/l23 0 2024-05-09T06:29:31.397 INFO:tasks.workunit.client.1.smithi079.stdout:3/276: dread fc [0,4194304] 0 2024-05-09T06:29:31.397 INFO:tasks.workunit.client.1.smithi079.stdout:3/277: readlink d1a/d1c/d1f/d3f/l44 0 2024-05-09T06:29:31.400 INFO:tasks.workunit.client.1.smithi079.stdout:8/243: mknod d1/d3/d20/d22/c5a 0 2024-05-09T06:29:31.402 INFO:tasks.workunit.client.1.smithi079.stdout:1/287: creat d0/d12/d27/f69 x:0 0 0 2024-05-09T06:29:31.406 INFO:tasks.workunit.client.1.smithi079.stdout:8/244: dread d1/d5/f11 [0,4194304] 0 2024-05-09T06:29:31.407 INFO:tasks.workunit.client.1.smithi079.stdout:1/288: creat d0/d12/d67/d53/f6a x:0 0 0 2024-05-09T06:29:31.409 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:31 smithi079 ceph-mon[35268]: Upgrade: Updating mgr.smithi079.genyri 2024-05-09T06:29:31.409 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:31 smithi079 ceph-mon[35268]: Deploying daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:29:31.409 INFO:tasks.workunit.client.1.smithi079.stdout:8/245: creat d1/d3/d20/d22/d50/f5b x:0 0 0 2024-05-09T06:29:31.410 INFO:tasks.workunit.client.1.smithi079.stdout:1/289: creat d0/d7/d4e/f6b x:0 0 0 2024-05-09T06:29:31.410 INFO:tasks.workunit.client.1.smithi079.stdout:1/290: creat d0/d7/d4e/f6c x:0 0 0 2024-05-09T06:29:31.410 INFO:tasks.workunit.client.1.smithi079.stdout:1/291: truncate d0/d12/d67/d53/f6a 856483 0 2024-05-09T06:29:31.413 INFO:tasks.workunit.client.1.smithi079.stdout:8/246: mkdir d1/d3/d20/d22/d50/d5c 0 2024-05-09T06:29:31.418 INFO:tasks.workunit.client.1.smithi079.stdout:8/247: mkdir d1/d3/d20/d29/d33/d5d 0 2024-05-09T06:29:31.418 INFO:tasks.workunit.client.1.smithi079.stdout:8/248: write d1/d5/dc/f1b [192443,16809] 0 2024-05-09T06:29:31.421 INFO:tasks.workunit.client.1.smithi079.stdout:8/249: stat d1/d3/d20/d22/d50/c57 0 2024-05-09T06:29:31.421 INFO:tasks.workunit.client.1.smithi079.stdout:8/250: write d1/d3/d20/d22/d50/f5b [869111,104295] 0 2024-05-09T06:29:31.424 INFO:tasks.workunit.client.1.smithi079.stdout:8/251: link d1/d5/c2e d1/d3/d20/d29/d33/d5d/c5e 0 2024-05-09T06:29:31.424 INFO:tasks.workunit.client.1.smithi079.stdout:8/252: write d1/db/f27 [1025113,5550] 0 2024-05-09T06:29:31.427 INFO:tasks.workunit.client.1.smithi079.stdout:8/253: creat d1/d5/f5f x:0 0 0 2024-05-09T06:29:31.427 INFO:tasks.workunit.client.1.smithi079.stdout:8/254: chown d1/f1a 1641435 1 2024-05-09T06:29:31.436 INFO:tasks.workunit.client.1.smithi079.stdout:8/255: dread d1/d3/d20/d22/d44/f4c [0,4194304] 0 2024-05-09T06:29:31.452 INFO:tasks.workunit.client.1.smithi079.stdout:1/292: dwrite d0/d12/f2c [0,4194304] 0 2024-05-09T06:29:31.454 INFO:tasks.workunit.client.1.smithi079.stdout:8/256: dwrite d1/db/f4a [0,4194304] 0 2024-05-09T06:29:31.459 INFO:tasks.workunit.client.1.smithi079.stdout:1/293: mkdir d0/d12/d67/d53/d6d 0 2024-05-09T06:29:31.462 INFO:tasks.workunit.client.1.smithi079.stdout:8/257: mknod d1/d3/d20/d22/d3f/d54/c60 0 2024-05-09T06:29:31.463 INFO:tasks.workunit.client.1.smithi079.stdout:1/294: fsync d0/df/f24 0 2024-05-09T06:29:31.467 INFO:tasks.workunit.client.1.smithi079.stdout:1/295: mkdir d0/d6e 0 2024-05-09T06:29:31.469 INFO:tasks.workunit.client.1.smithi079.stdout:1/296: symlink d0/d12/d67/d53/l6f 0 2024-05-09T06:29:31.471 INFO:tasks.workunit.client.1.smithi079.stdout:1/297: mkdir d0/d12/d27/d43/d70 0 2024-05-09T06:29:31.480 INFO:tasks.workunit.client.1.smithi079.stdout:1/298: dread d0/d12/d16/f2f [0,4194304] 0 2024-05-09T06:29:31.492 INFO:tasks.workunit.client.1.smithi079.stdout:8/258: dwrite d1/d3/d20/d29/f45 [0,4194304] 0 2024-05-09T06:29:31.493 INFO:tasks.workunit.client.1.smithi079.stdout:1/299: dwrite d0/d12/d67/f41 [0,4194304] 0 2024-05-09T06:29:31.503 INFO:tasks.workunit.client.1.smithi079.stdout:8/259: mkdir d1/d3/d20/d22/d50/d61 0 2024-05-09T06:29:31.503 INFO:tasks.workunit.client.1.smithi079.stdout:8/260: chown d1/d3/d20/d29/d33/d5d 65219895 1 2024-05-09T06:29:31.507 INFO:tasks.workunit.client.1.smithi079.stdout:8/261: creat d1/db/f62 x:0 0 0 2024-05-09T06:29:31.509 INFO:tasks.workunit.client.1.smithi079.stdout:8/262: symlink d1/l63 0 2024-05-09T06:29:31.511 INFO:tasks.workunit.client.1.smithi079.stdout:8/263: mkdir d1/d64 0 2024-05-09T06:29:31.513 INFO:tasks.workunit.client.1.smithi079.stdout:8/264: symlink d1/d3/d20/d29/d33/d5d/l65 0 2024-05-09T06:29:31.515 INFO:tasks.workunit.client.1.smithi079.stdout:8/265: mkdir d1/d3/d20/d22/d50/d61/d66 0 2024-05-09T06:29:31.515 INFO:tasks.workunit.client.1.smithi079.stdout:8/266: dread - d1/d3/d20/d22/d44/f35 zero size 2024-05-09T06:29:31.515 INFO:tasks.workunit.client.1.smithi079.stdout:1/300: dwrite d0/d7/d4e/f6b [0,4194304] 0 2024-05-09T06:29:31.519 INFO:tasks.workunit.client.1.smithi079.stdout:5/308: sync 2024-05-09T06:29:31.519 INFO:tasks.workunit.client.1.smithi079.stdout:0/257: sync 2024-05-09T06:29:31.519 INFO:tasks.workunit.client.1.smithi079.stdout:0/258: truncate d3/dd/f1c 3635338 0 2024-05-09T06:29:31.519 INFO:tasks.workunit.client.1.smithi079.stdout:0/259: write d3/dd/f46 [831664,123527] 0 2024-05-09T06:29:31.520 INFO:tasks.workunit.client.1.smithi079.stdout:8/267: getdents d1/d3/d20/d22/d3f/d54 0 2024-05-09T06:29:31.523 INFO:tasks.workunit.client.1.smithi079.stdout:8/268: dread d1/db/f30 [0,4194304] 0 2024-05-09T06:29:31.527 INFO:tasks.workunit.client.1.smithi079.stdout:1/301: symlink d0/d6e/l71 0 2024-05-09T06:29:31.531 INFO:tasks.workunit.client.1.smithi079.stdout:0/260: symlink d3/dd/d1f/d1e/d2c/d35/d36/l52 0 2024-05-09T06:29:31.531 INFO:tasks.workunit.client.1.smithi079.stdout:0/261: dread - d3/dd/d1f/d1e/d2c/d35/d36/f48 zero size 2024-05-09T06:29:31.533 INFO:tasks.workunit.client.1.smithi079.stdout:8/269: mkdir d1/d67 0 2024-05-09T06:29:31.534 INFO:tasks.workunit.client.1.smithi079.stdout:5/309: rmdir d13/d43/d39 39 2024-05-09T06:29:31.539 INFO:tasks.workunit.client.1.smithi079.stdout:8/270: mknod d1/d64/c68 0 2024-05-09T06:29:31.539 INFO:tasks.workunit.client.1.smithi079.stdout:8/271: chown d1/d3/f4 36 1 2024-05-09T06:29:31.542 INFO:tasks.workunit.client.1.smithi079.stdout:8/272: creat d1/d3/d20/d22/d3f/f69 x:0 0 0 2024-05-09T06:29:31.546 INFO:tasks.workunit.client.1.smithi079.stdout:1/302: dwrite d0/d12/d27/d43/f15 [4194304,4194304] 0 2024-05-09T06:29:31.546 INFO:tasks.workunit.client.1.smithi079.stdout:1/303: creat d0/d7/d4e/f72 x:0 0 0 2024-05-09T06:29:31.547 INFO:tasks.workunit.client.1.smithi079.stdout:8/273: creat d1/d5/dc/f6a x:0 0 0 2024-05-09T06:29:31.547 INFO:tasks.workunit.client.1.smithi079.stdout:8/274: chown d1/d3/d20/d29/d33/c47 599131081 1 2024-05-09T06:29:31.551 INFO:tasks.workunit.client.1.smithi079.stdout:8/275: mkdir d1/d3/d20/d22/d3f/d54/d6b 0 2024-05-09T06:29:31.552 INFO:tasks.workunit.client.1.smithi079.stdout:8/276: write d1/d3/d20/d22/d3b/f52 [189998,625] 0 2024-05-09T06:29:31.552 INFO:tasks.workunit.client.1.smithi079.stdout:8/277: read - d1/db/f62 zero size 2024-05-09T06:29:31.552 INFO:tasks.workunit.client.1.smithi079.stdout:8/278: stat d1/d3/d20/d22/d50 0 2024-05-09T06:29:31.556 INFO:tasks.workunit.client.1.smithi079.stdout:1/304: write d0/d12/d67/f41 [1463497,125824] 0 2024-05-09T06:29:31.558 INFO:tasks.workunit.client.1.smithi079.stdout:5/310: dwrite d13/d43/d26/d35/f6d [0,4194304] 0 2024-05-09T06:29:31.559 INFO:tasks.workunit.client.1.smithi079.stdout:5/311: chown d13/d43/d26/l71 3 1 2024-05-09T06:29:31.559 INFO:tasks.workunit.client.1.smithi079.stdout:0/262: dwrite d3/d5/d27/d2d/f4d [0,4194304] 0 2024-05-09T06:29:31.563 INFO:tasks.workunit.client.1.smithi079.stdout:1/305: rename d0/d12/d48/f64 to d0/d12/d27/d43/d70/f73 0 2024-05-09T06:29:31.563 INFO:tasks.workunit.client.1.smithi079.stdout:1/306: truncate d0/d12/d27/d26/f29 512267 0 2024-05-09T06:29:31.563 INFO:tasks.workunit.client.1.smithi079.stdout:1/307: readlink d0/d12/d27/d43/d20/l2a 0 2024-05-09T06:29:31.563 INFO:tasks.workunit.client.1.smithi079.stdout:1/308: fsync d0/d7/d4e/f5d 0 2024-05-09T06:29:31.563 INFO:tasks.workunit.client.1.smithi079.stdout:1/309: dread - d0/d12/d27/d43/f46 zero size 2024-05-09T06:29:31.563 INFO:tasks.workunit.client.1.smithi079.stdout:1/310: read - d0/d7/d4e/f6c zero size 2024-05-09T06:29:31.574 INFO:tasks.workunit.client.1.smithi079.stdout:5/312: link d13/d43/c5b d13/d43/d39/d61/d72/c74 0 2024-05-09T06:29:31.576 INFO:tasks.workunit.client.1.smithi079.stdout:8/279: dwrite d1/d3/d20/d22/d44/f35 [0,4194304] 0 2024-05-09T06:29:31.576 INFO:tasks.workunit.client.1.smithi079.stdout:8/280: readlink d1/d3/d20/d22/d3f/l41 0 2024-05-09T06:29:31.580 INFO:tasks.workunit.client.1.smithi079.stdout:5/313: dread d13/d43/d26/d35/f5e [0,4194304] 0 2024-05-09T06:29:31.581 INFO:tasks.workunit.client.1.smithi079.stdout:0/263: truncate d3/d5/d27/f49 4675912 0 2024-05-09T06:29:31.583 INFO:tasks.workunit.client.1.smithi079.stdout:5/314: dread d13/d43/d26/f3e [0,4194304] 0 2024-05-09T06:29:31.585 INFO:tasks.workunit.client.1.smithi079.stdout:1/311: creat d0/d7/f74 x:0 0 0 2024-05-09T06:29:31.585 INFO:tasks.workunit.client.1.smithi079.stdout:1/312: write d0/d12/f18 [3311214,19573] 0 2024-05-09T06:29:31.591 INFO:tasks.workunit.client.1.smithi079.stdout:0/264: dread d3/d5/fe [0,4194304] 0 2024-05-09T06:29:31.591 INFO:tasks.workunit.client.1.smithi079.stdout:4/364: sync 2024-05-09T06:29:31.591 INFO:tasks.workunit.client.1.smithi079.stdout:7/311: sync 2024-05-09T06:29:31.591 INFO:tasks.workunit.client.1.smithi079.stdout:0/265: chown d3/d5/d27/f44 2041160733 1 2024-05-09T06:29:31.592 INFO:tasks.workunit.client.1.smithi079.stdout:0/266: write d3/d5/d27/d2d/f2e [935113,12227] 0 2024-05-09T06:29:31.592 INFO:tasks.workunit.client.1.smithi079.stdout:0/267: creat d3/dd/f53 x:0 0 0 2024-05-09T06:29:31.592 INFO:tasks.workunit.client.1.smithi079.stdout:0/268: write d3/dd/f1c [123288,102825] 0 2024-05-09T06:29:31.592 INFO:tasks.workunit.client.1.smithi079.stdout:8/281: dwrite d1/db/f4a [0,4194304] 0 2024-05-09T06:29:31.592 INFO:tasks.workunit.client.1.smithi079.stdout:8/282: chown d1/d3/d20 62 1 2024-05-09T06:29:31.593 INFO:tasks.workunit.client.1.smithi079.stdout:8/283: read - d1/d3/d20/d22/d3f/f69 zero size 2024-05-09T06:29:31.593 INFO:tasks.workunit.client.1.smithi079.stdout:8/284: readlink d1/d3/d20/d22/l48 0 2024-05-09T06:29:31.601 INFO:tasks.workunit.client.1.smithi079.stdout:4/365: write d6/d1a/d26/d2a/d54/f17 [1968185,126109] 0 2024-05-09T06:29:31.601 INFO:tasks.workunit.client.1.smithi079.stdout:4/366: stat d6/d8/l1e 0 2024-05-09T06:29:31.603 INFO:tasks.workunit.client.1.smithi079.stdout:0/269: write d3/dd/d1f/d1e/f2a [3412270,2523] 0 2024-05-09T06:29:31.605 INFO:tasks.workunit.client.1.smithi079.stdout:5/315: unlink d13/d43/d39/c4a 0 2024-05-09T06:29:31.609 INFO:tasks.workunit.client.1.smithi079.stdout:7/312: unlink d4/d7/d37/f4d 0 2024-05-09T06:29:31.615 INFO:tasks.workunit.client.1.smithi079.stdout:4/367: mkdir d6/d1a/d41/d68 0 2024-05-09T06:29:31.617 INFO:tasks.workunit.client.1.smithi079.stdout:0/270: creat d3/dd/d1f/d1e/d2c/d35/f54 x:0 0 0 2024-05-09T06:29:31.621 INFO:tasks.workunit.client.1.smithi079.stdout:7/313: dread d4/d7/f25 [0,4194304] 0 2024-05-09T06:29:31.624 INFO:tasks.workunit.client.1.smithi079.stdout:7/314: truncate d4/d7/dd/f42 464825 0 2024-05-09T06:29:31.629 INFO:tasks.workunit.client.1.smithi079.stdout:7/315: unlink d4/d7/f25 0 2024-05-09T06:29:31.629 INFO:tasks.workunit.client.1.smithi079.stdout:7/316: read - d4/d7/d37/f57 zero size 2024-05-09T06:29:31.631 INFO:tasks.workunit.client.1.smithi079.stdout:7/317: creat d4/d7/dd/d5b/f5d x:0 0 0 2024-05-09T06:29:31.635 INFO:tasks.workunit.client.1.smithi079.stdout:8/285: dwrite d1/d5/dc/f6a [0,4194304] 0 2024-05-09T06:29:31.636 INFO:tasks.workunit.client.1.smithi079.stdout:5/316: dwrite d13/d43/d3d/d40/f42 [0,4194304] 0 2024-05-09T06:29:31.636 INFO:tasks.workunit.client.1.smithi079.stdout:4/368: dwrite d6/d1a/d26/d2a/d54/f45 [0,4194304] 0 2024-05-09T06:29:31.638 INFO:tasks.workunit.client.1.smithi079.stdout:8/286: dread d1/d3/d20/d22/d44/f39 [0,4194304] 0 2024-05-09T06:29:31.644 INFO:tasks.workunit.client.1.smithi079.stdout:7/318: dwrite d4/d7/dd/f21 [0,4194304] 0 2024-05-09T06:29:31.651 INFO:tasks.workunit.client.1.smithi079.stdout:4/369: link d6/c47 d6/d15/c69 0 2024-05-09T06:29:31.651 INFO:tasks.workunit.client.1.smithi079.stdout:4/370: write d6/dd/df/f35 [1875213,50118] 0 2024-05-09T06:29:31.651 INFO:tasks.workunit.client.1.smithi079.stdout:4/371: creat d6/dd/f6a x:0 0 0 2024-05-09T06:29:31.652 INFO:tasks.workunit.client.1.smithi079.stdout:4/372: dread - d6/d8/d27/d3d/f64 zero size 2024-05-09T06:29:31.654 INFO:tasks.workunit.client.1.smithi079.stdout:1/313: rename d0/d12/d27 to d0/d12/d48/d75 0 2024-05-09T06:29:31.660 INFO:tasks.workunit.client.1.smithi079.stdout:8/287: dwrite d1/d3/d20/d22/d3b/f52 [0,4194304] 0 2024-05-09T06:29:31.661 INFO:tasks.workunit.client.1.smithi079.stdout:7/319: creat d4/d7/dd/d47/f5e x:0 0 0 2024-05-09T06:29:31.661 INFO:tasks.workunit.client.1.smithi079.stdout:7/320: creat d4/d7/f5f x:0 0 0 2024-05-09T06:29:31.661 INFO:tasks.workunit.client.1.smithi079.stdout:7/321: stat d4/d7/dd/d5b/c38 0 2024-05-09T06:29:31.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:31 smithi062 ceph-mon[26920]: Upgrade: Updating mgr.smithi079.genyri 2024-05-09T06:29:31.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:31 smithi062 ceph-mon[26920]: Deploying daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:29:31.666 INFO:tasks.workunit.client.1.smithi079.stdout:4/373: mkdir d6/d1a/d41/d68/d6b 0 2024-05-09T06:29:31.666 INFO:tasks.workunit.client.1.smithi079.stdout:4/374: fdatasync d6/d15/f5f 0 2024-05-09T06:29:31.667 INFO:tasks.workunit.client.1.smithi079.stdout:3/278: sync 2024-05-09T06:29:31.667 INFO:tasks.workunit.client.1.smithi079.stdout:2/326: sync 2024-05-09T06:29:31.667 INFO:tasks.workunit.client.1.smithi079.stdout:9/462: sync 2024-05-09T06:29:31.667 INFO:tasks.workunit.client.1.smithi079.stdout:6/256: sync 2024-05-09T06:29:31.667 INFO:tasks.workunit.client.1.smithi079.stdout:2/327: chown d8/fa 208280999 1 2024-05-09T06:29:31.667 INFO:tasks.workunit.client.1.smithi079.stdout:3/279: truncate d1a/f49 4265087 0 2024-05-09T06:29:31.667 INFO:tasks.workunit.client.1.smithi079.stdout:4/375: write d6/d15/f31 [2802044,89963] 0 2024-05-09T06:29:31.668 INFO:tasks.workunit.client.1.smithi079.stdout:1/314: creat d0/d12/d48/d75/d26/f76 x:0 0 0 2024-05-09T06:29:31.674 INFO:tasks.workunit.client.1.smithi079.stdout:9/463: readlink d1/d33/l4f 0 2024-05-09T06:29:31.675 INFO:tasks.workunit.client.1.smithi079.stdout:9/464: creat d1/f9f x:0 0 0 2024-05-09T06:29:31.678 INFO:tasks.workunit.client.1.smithi079.stdout:3/280: mkdir d1a/d1d/d3a/d54/d55 0 2024-05-09T06:29:31.678 INFO:tasks.workunit.client.1.smithi079.stdout:3/281: creat d1a/d1c/d1f/f56 x:0 0 0 2024-05-09T06:29:31.680 INFO:tasks.workunit.client.1.smithi079.stdout:4/376: symlink d6/d8/d27/d3d/l6c 0 2024-05-09T06:29:31.682 INFO:tasks.workunit.client.1.smithi079.stdout:1/315: creat d0/d12/d48/d75/d43/f77 x:0 0 0 2024-05-09T06:29:31.683 INFO:tasks.workunit.client.1.smithi079.stdout:4/377: dread f2 [0,4194304] 0 2024-05-09T06:29:31.683 INFO:tasks.workunit.client.1.smithi079.stdout:1/316: dread d0/d12/d48/d75/d26/f29 [0,4194304] 0 2024-05-09T06:29:31.683 INFO:tasks.workunit.client.1.smithi079.stdout:1/317: fdatasync d0/df/f24 0 2024-05-09T06:29:31.683 INFO:tasks.workunit.client.1.smithi079.stdout:0/271: rmdir d3/dd/d1f/d1e/d2c 39 2024-05-09T06:29:31.689 INFO:tasks.workunit.client.1.smithi079.stdout:8/288: rmdir d1/d3 39 2024-05-09T06:29:31.694 INFO:tasks.workunit.client.1.smithi079.stdout:3/282: dwrite f3 [0,4194304] 0 2024-05-09T06:29:31.694 INFO:tasks.workunit.client.1.smithi079.stdout:6/257: rmdir d0/de 39 2024-05-09T06:29:31.696 INFO:tasks.workunit.client.1.smithi079.stdout:2/328: creat d8/db/d4b/d4f/d51/d6f/f7b x:0 0 0 2024-05-09T06:29:31.696 INFO:tasks.workunit.client.1.smithi079.stdout:2/329: write d8/f9 [4345548,129899] 0 2024-05-09T06:29:31.699 INFO:tasks.workunit.client.1.smithi079.stdout:4/378: rename f2 to d6/d1a/d26/d2a/d54/d59/f6d 0 2024-05-09T06:29:31.699 INFO:tasks.workunit.client.1.smithi079.stdout:4/379: readlink d6/d8/d27/d62/l3f 0 2024-05-09T06:29:31.701 INFO:tasks.workunit.client.1.smithi079.stdout:1/318: truncate d0/d12/f1a 3391247 0 2024-05-09T06:29:31.701 INFO:tasks.workunit.client.1.smithi079.stdout:3/283: dread d1a/f35 [0,4194304] 0 2024-05-09T06:29:31.701 INFO:tasks.workunit.client.1.smithi079.stdout:6/258: dread d0/de/f1e [0,4194304] 0 2024-05-09T06:29:31.703 INFO:tasks.workunit.client.1.smithi079.stdout:6/259: write d0/d6/f14 [4724084,21739] 0 2024-05-09T06:29:31.703 INFO:tasks.workunit.client.1.smithi079.stdout:6/260: dread - d0/d6/d1b/d2d/f4c zero size 2024-05-09T06:29:31.703 INFO:tasks.workunit.client.1.smithi079.stdout:6/261: truncate d0/d6/f29 931412 0 2024-05-09T06:29:31.703 INFO:tasks.workunit.client.1.smithi079.stdout:9/465: dread d1/d45/f59 [4194304,4194304] 0 2024-05-09T06:29:31.710 INFO:tasks.workunit.client.1.smithi079.stdout:2/330: unlink d8/db/c39 0 2024-05-09T06:29:31.716 INFO:tasks.workunit.client.1.smithi079.stdout:8/289: rename d1/d3/d20/d22/d3f/d54 to d1/d3/d20/d22/d50/d61/d66/d6c 0 2024-05-09T06:29:31.716 INFO:tasks.workunit.client.1.smithi079.stdout:9/466: dwrite d1/d33/d28/d36/d38/d3a/f57 [0,4194304] 0 2024-05-09T06:29:31.719 INFO:tasks.workunit.client.1.smithi079.stdout:1/319: creat d0/d12/d48/d75/d43/d20/d39/f78 x:0 0 0 2024-05-09T06:29:31.719 INFO:tasks.workunit.client.1.smithi079.stdout:1/320: chown d0/d12/d48/d75/d43/d20/l2a 195 1 2024-05-09T06:29:31.723 INFO:tasks.workunit.client.1.smithi079.stdout:3/284: unlink d1a/d1d/f3c 0 2024-05-09T06:29:31.725 INFO:tasks.workunit.client.1.smithi079.stdout:0/272: getdents d3/d5/d27/d2d 0 2024-05-09T06:29:31.728 INFO:tasks.workunit.client.1.smithi079.stdout:6/262: mknod d0/d6/d1b/d2d/c53 0 2024-05-09T06:29:31.729 INFO:tasks.workunit.client.1.smithi079.stdout:6/263: write d0/de/f35 [704110,112196] 0 2024-05-09T06:29:31.729 INFO:tasks.workunit.client.1.smithi079.stdout:6/264: fsync d0/d6/d16/d1f/f41 0 2024-05-09T06:29:31.729 INFO:tasks.workunit.client.1.smithi079.stdout:6/265: fsync d0/de/f43 0 2024-05-09T06:29:31.729 INFO:tasks.workunit.client.1.smithi079.stdout:6/266: write d0/d6/d16/d1f/f25 [156142,28221] 0 2024-05-09T06:29:31.730 INFO:tasks.workunit.client.1.smithi079.stdout:2/331: mknod d8/db/d4b/d4f/d51/c7c 0 2024-05-09T06:29:31.735 INFO:tasks.workunit.client.1.smithi079.stdout:4/380: rename d6/dd/df/f35 to d6/d1a/f6e 0 2024-05-09T06:29:31.738 INFO:tasks.workunit.client.1.smithi079.stdout:8/290: mkdir d1/d3/d20/d29/d33/d5d/d6d 0 2024-05-09T06:29:31.743 INFO:tasks.workunit.client.1.smithi079.stdout:9/467: symlink d1/d33/d28/d36/d4d/d51/la0 0 2024-05-09T06:29:31.744 INFO:tasks.workunit.client.1.smithi079.stdout:9/468: dread d1/d5/f58 [0,4194304] 0 2024-05-09T06:29:31.745 INFO:tasks.workunit.client.1.smithi079.stdout:1/321: mkdir d0/d12/d48/d75/d43/d20/d79 0 2024-05-09T06:29:31.746 INFO:tasks.workunit.client.1.smithi079.stdout:1/322: truncate d0/d7/f3b 1416201 0 2024-05-09T06:29:31.748 INFO:tasks.workunit.client.1.smithi079.stdout:3/285: rmdir d1a/d1c/d1f/d3f 39 2024-05-09T06:29:31.748 INFO:tasks.workunit.client.1.smithi079.stdout:3/286: write d1a/d1d/f3e [4483332,48447] 0 2024-05-09T06:29:31.750 INFO:tasks.workunit.client.1.smithi079.stdout:0/273: symlink d3/dd/d1f/d1e/d2c/d35/l55 0 2024-05-09T06:29:31.750 INFO:tasks.workunit.client.1.smithi079.stdout:0/274: write d3/dd/f53 [997653,65439] 0 2024-05-09T06:29:31.751 INFO:tasks.workunit.client.1.smithi079.stdout:6/267: rmdir d0/d6/d1b/d2d 39 2024-05-09T06:29:31.751 INFO:tasks.workunit.client.1.smithi079.stdout:6/268: chown d0/d6/d1b/d2d/c53 6180376 1 2024-05-09T06:29:31.752 INFO:tasks.workunit.client.1.smithi079.stdout:4/381: dwrite d6/d1a/d26/d2a/d54/f23 [0,4194304] 0 2024-05-09T06:29:31.763 INFO:tasks.workunit.client.1.smithi079.stdout:2/332: rename d8/db/f65 to d8/db/d11/d5f/f7d 0 2024-05-09T06:29:31.764 INFO:tasks.workunit.client.1.smithi079.stdout:4/382: dread d6/dd/f4e [0,4194304] 0 2024-05-09T06:29:31.764 INFO:tasks.workunit.client.1.smithi079.stdout:9/469: creat d1/d33/d28/d4c/fa1 x:0 0 0 2024-05-09T06:29:31.765 INFO:tasks.workunit.client.1.smithi079.stdout:9/470: fsync d1/d33/d28/d36/d38/d3a/f57 0 2024-05-09T06:29:31.766 INFO:tasks.workunit.client.1.smithi079.stdout:1/323: unlink d0/d12/d48/d75/d43/d70/f73 0 2024-05-09T06:29:31.767 INFO:tasks.workunit.client.1.smithi079.stdout:1/324: chown d0/d12/d16/l30 66459 1 2024-05-09T06:29:31.767 INFO:tasks.workunit.client.1.smithi079.stdout:1/325: creat d0/d12/d67/d53/f7a x:0 0 0 2024-05-09T06:29:31.767 INFO:tasks.workunit.client.1.smithi079.stdout:1/326: creat d0/d7/f7b x:0 0 0 2024-05-09T06:29:31.769 INFO:tasks.workunit.client.1.smithi079.stdout:0/275: rename d3/d5/d27/f44 to d3/d5/d27/f56 0 2024-05-09T06:29:31.770 INFO:tasks.workunit.client.1.smithi079.stdout:0/276: chown d3/lc 11975430 1 2024-05-09T06:29:31.770 INFO:tasks.workunit.client.1.smithi079.stdout:4/383: write d6/d8/f10 [3820762,67491] 0 2024-05-09T06:29:31.771 INFO:tasks.workunit.client.1.smithi079.stdout:6/269: truncate d0/de/f1c 970627 0 2024-05-09T06:29:31.772 INFO:tasks.workunit.client.1.smithi079.stdout:6/270: read d0/d6/f4d [366162,56372] 0 2024-05-09T06:29:31.775 INFO:tasks.workunit.client.1.smithi079.stdout:8/291: rename d1/d3/l58 to d1/d64/l6e 0 2024-05-09T06:29:31.778 INFO:tasks.workunit.client.1.smithi079.stdout:2/333: mknod d8/db/d59/c7e 0 2024-05-09T06:29:31.780 INFO:tasks.workunit.client.1.smithi079.stdout:9/471: truncate d1/d33/f76 93698 0 2024-05-09T06:29:31.780 INFO:tasks.workunit.client.1.smithi079.stdout:9/472: write d1/d33/d28/d3e/d75/f77 [1022873,111084] 0 2024-05-09T06:29:31.784 INFO:tasks.workunit.client.1.smithi079.stdout:1/327: truncate d0/df/f14 768555 0 2024-05-09T06:29:31.784 INFO:tasks.workunit.client.1.smithi079.stdout:1/328: write d0/d7/d4e/f63 [525763,26500] 0 2024-05-09T06:29:31.786 INFO:tasks.workunit.client.1.smithi079.stdout:4/384: link d6/d1a/d41/l5d d6/dd/l6f 0 2024-05-09T06:29:31.788 INFO:tasks.workunit.client.1.smithi079.stdout:6/271: link d0/d6/f4d d0/d6/d16/d1f/d36/f54 0 2024-05-09T06:29:31.788 INFO:tasks.workunit.client.1.smithi079.stdout:6/272: creat d0/d6/d1b/f55 x:0 0 0 2024-05-09T06:29:31.792 INFO:tasks.workunit.client.1.smithi079.stdout:2/334: mkdir d8/db/d59/d67/d7f 0 2024-05-09T06:29:31.792 INFO:tasks.workunit.client.1.smithi079.stdout:2/335: chown d8/db/d11/c21 8 1 2024-05-09T06:29:31.796 INFO:tasks.workunit.client.1.smithi079.stdout:9/473: creat d1/d33/d28/d36/d4d/fa2 x:0 0 0 2024-05-09T06:29:31.796 INFO:tasks.workunit.client.1.smithi079.stdout:9/474: readlink d1/d33/d28/d36/d4d/d51/la0 0 2024-05-09T06:29:31.796 INFO:tasks.workunit.client.1.smithi079.stdout:0/277: dwrite d3/d5/d27/d2d/f2e [0,4194304] 0 2024-05-09T06:29:31.797 INFO:tasks.workunit.client.1.smithi079.stdout:1/329: creat d0/d6e/f7c x:0 0 0 2024-05-09T06:29:31.799 INFO:tasks.workunit.client.1.smithi079.stdout:4/385: getdents d6/d8/d27/d3d 0 2024-05-09T06:29:31.799 INFO:tasks.workunit.client.1.smithi079.stdout:4/386: truncate d6/dd/f36 5139069 0 2024-05-09T06:29:31.805 INFO:tasks.workunit.client.1.smithi079.stdout:3/287: rename c4 to d1a/d1d/d3a/d54/c57 0 2024-05-09T06:29:31.808 INFO:tasks.workunit.client.1.smithi079.stdout:0/278: write d3/d5/d27/d2d/f2e [3636727,81578] 0 2024-05-09T06:29:31.808 INFO:tasks.workunit.client.1.smithi079.stdout:0/279: truncate d3/dd/d18/f47 478382 0 2024-05-09T06:29:31.808 INFO:tasks.workunit.client.1.smithi079.stdout:0/280: fsync d3/dd/d1f/d1e/d2c/d35/d36/f4c 0 2024-05-09T06:29:31.808 INFO:tasks.workunit.client.1.smithi079.stdout:0/281: fsync d3/d5/f3a 0 2024-05-09T06:29:31.808 INFO:tasks.workunit.client.1.smithi079.stdout:0/282: write d3/d5/d27/f24 [1399332,66142] 0 2024-05-09T06:29:31.810 INFO:tasks.workunit.client.1.smithi079.stdout:4/387: write d6/d15/f5c [4092758,24543] 0 2024-05-09T06:29:31.810 INFO:tasks.workunit.client.1.smithi079.stdout:4/388: write d6/d8/d27/d3d/f64 [111100,127365] 0 2024-05-09T06:29:31.810 INFO:tasks.workunit.client.1.smithi079.stdout:4/389: stat d6/f33 0 2024-05-09T06:29:31.817 INFO:tasks.workunit.client.1.smithi079.stdout:1/330: write d0/f4a [40642,128681] 0 2024-05-09T06:29:31.820 INFO:tasks.workunit.client.1.smithi079.stdout:2/336: rename d8/db/d11/f30 to d8/d3c/f80 0 2024-05-09T06:29:31.821 INFO:tasks.workunit.client.1.smithi079.stdout:7/322: sync 2024-05-09T06:29:31.821 INFO:tasks.workunit.client.1.smithi079.stdout:5/317: sync 2024-05-09T06:29:31.821 INFO:tasks.workunit.client.1.smithi079.stdout:7/323: fsync d4/d7/dd/d5b/d32/f35 0 2024-05-09T06:29:31.822 INFO:tasks.workunit.client.1.smithi079.stdout:7/324: write d4/d7/d22/f40 [378104,83547] 0 2024-05-09T06:29:31.823 INFO:tasks.workunit.client.1.smithi079.stdout:3/288: mkdir d1a/d1d/d3a/d58 0 2024-05-09T06:29:31.823 INFO:tasks.workunit.client.1.smithi079.stdout:3/289: fsync d1a/d1c/d1f/f56 0 2024-05-09T06:29:31.823 INFO:tasks.workunit.client.1.smithi079.stdout:3/290: readlink d1a/d1c/d22/l25 0 2024-05-09T06:29:31.823 INFO:tasks.workunit.client.1.smithi079.stdout:3/291: write fe [791747,15358] 0 2024-05-09T06:29:31.824 INFO:tasks.workunit.client.1.smithi079.stdout:9/475: rename d1/d33/d28/d36/d4d/d7d/d19/f30 to d1/d33/d28/d36/d4d/d7d/d19/fa3 0 2024-05-09T06:29:31.827 INFO:tasks.workunit.client.1.smithi079.stdout:4/390: unlink d6/d8/c38 0 2024-05-09T06:29:31.829 INFO:tasks.workunit.client.1.smithi079.stdout:1/331: mkdir d0/d7/d4e/d7d 0 2024-05-09T06:29:31.831 INFO:tasks.workunit.client.1.smithi079.stdout:2/337: link d8/db/d11/f72 d8/db/d5c/f81 0 2024-05-09T06:29:31.833 INFO:tasks.workunit.client.1.smithi079.stdout:5/318: getdents d13/d4d 0 2024-05-09T06:29:31.837 INFO:tasks.workunit.client.1.smithi079.stdout:3/292: unlink d1a/d1c/f45 0 2024-05-09T06:29:31.838 INFO:tasks.workunit.client.1.smithi079.stdout:9/476: creat d1/d5/d5b/fa4 x:0 0 0 2024-05-09T06:29:31.838 INFO:tasks.workunit.client.1.smithi079.stdout:9/477: write d1/f8f [858536,78611] 0 2024-05-09T06:29:31.839 INFO:tasks.workunit.client.1.smithi079.stdout:4/391: rename d6/d15/f53 to d6/d1a/d26/d2a/d54/f70 0 2024-05-09T06:29:31.840 INFO:tasks.workunit.client.1.smithi079.stdout:1/332: mknod d0/d12/d67/d53/c7e 0 2024-05-09T06:29:31.843 INFO:tasks.workunit.client.1.smithi079.stdout:9/478: creat d1/d5/d91/fa5 x:0 0 0 2024-05-09T06:29:31.844 INFO:tasks.workunit.client.1.smithi079.stdout:5/319: rename d13/d43/c5b to d13/d43/d26/c75 0 2024-05-09T06:29:31.844 INFO:tasks.workunit.client.1.smithi079.stdout:5/320: fdatasync d13/d2a/f4b 0 2024-05-09T06:29:31.845 INFO:tasks.workunit.client.1.smithi079.stdout:1/333: symlink d0/d7/d4e/d7d/l7f 0 2024-05-09T06:29:31.845 INFO:tasks.workunit.client.1.smithi079.stdout:1/334: truncate d0/d12/d48/d75/d43/d20/f5f 260865 0 2024-05-09T06:29:31.846 INFO:tasks.workunit.client.1.smithi079.stdout:2/338: getdents d8/db/dc 0 2024-05-09T06:29:31.849 INFO:tasks.workunit.client.1.smithi079.stdout:1/335: dread d0/d12/d48/d75/d26/f55 [0,4194304] 0 2024-05-09T06:29:31.849 INFO:tasks.workunit.client.1.smithi079.stdout:1/336: write d0/d7/fc [142343,26066] 0 2024-05-09T06:29:31.850 INFO:tasks.workunit.client.1.smithi079.stdout:3/293: mkdir d1a/d1d/d34/d59 0 2024-05-09T06:29:31.850 INFO:tasks.workunit.client.1.smithi079.stdout:9/479: truncate d1/d33/d28/d3e/f44 2002242 0 2024-05-09T06:29:31.852 INFO:tasks.workunit.client.1.smithi079.stdout:5/321: write d13/d43/f20 [719788,11860] 0 2024-05-09T06:29:31.852 INFO:tasks.workunit.client.1.smithi079.stdout:1/337: creat d0/d12/d67/d53/d6d/f80 x:0 0 0 2024-05-09T06:29:31.854 INFO:tasks.workunit.client.1.smithi079.stdout:9/480: creat d1/d33/d28/d36/d4d/d7d/d19/fa6 x:0 0 0 2024-05-09T06:29:31.855 INFO:tasks.workunit.client.1.smithi079.stdout:3/294: symlink d1a/d1d/d3a/d54/d55/l5a 0 2024-05-09T06:29:31.859 INFO:tasks.workunit.client.1.smithi079.stdout:1/338: rmdir d0/d12/d48/d75/d43/d20/d79 0 2024-05-09T06:29:31.860 INFO:tasks.workunit.client.1.smithi079.stdout:9/481: mknod d1/d33/d28/d4c/ca7 0 2024-05-09T06:29:31.862 INFO:tasks.workunit.client.1.smithi079.stdout:3/295: creat d1a/d1c/d22/d53/d4e/f5b x:0 0 0 2024-05-09T06:29:31.862 INFO:tasks.workunit.client.1.smithi079.stdout:3/296: fsync d1a/d1d/d34/f4f 0 2024-05-09T06:29:31.862 INFO:tasks.workunit.client.1.smithi079.stdout:1/339: mknod d0/d7/c81 0 2024-05-09T06:29:31.863 INFO:tasks.workunit.client.1.smithi079.stdout:9/482: truncate d1/d33/d2b/f53 874318 0 2024-05-09T06:29:31.865 INFO:tasks.workunit.client.1.smithi079.stdout:5/322: dread d13/d43/f2f [0,4194304] 0 2024-05-09T06:29:31.865 INFO:tasks.workunit.client.1.smithi079.stdout:3/297: link d1a/d1d/d3a/d54/d55/l5a d1a/d1c/d22/d53/l5c 0 2024-05-09T06:29:31.869 INFO:tasks.workunit.client.1.smithi079.stdout:5/323: creat d13/d43/d39/d61/f76 x:0 0 0 2024-05-09T06:29:31.871 INFO:tasks.workunit.client.1.smithi079.stdout:5/324: truncate d13/d43/d3d/d40/f42 2560093 0 2024-05-09T06:29:31.873 INFO:tasks.workunit.client.1.smithi079.stdout:3/298: dread d1a/f2c [0,4194304] 0 2024-05-09T06:29:31.873 INFO:tasks.workunit.client.1.smithi079.stdout:5/325: mkdir d13/d4d/d77 0 2024-05-09T06:29:31.877 INFO:tasks.workunit.client.1.smithi079.stdout:5/326: rename d13/f16 to d13/d4f/f78 0 2024-05-09T06:29:31.882 INFO:tasks.workunit.client.1.smithi079.stdout:5/327: symlink d13/d4d/l79 0 2024-05-09T06:29:31.882 INFO:tasks.workunit.client.1.smithi079.stdout:5/328: dread - d13/d4f/f68 zero size 2024-05-09T06:29:31.883 INFO:tasks.workunit.client.1.smithi079.stdout:3/299: dread d1a/f35 [0,4194304] 0 2024-05-09T06:29:31.883 INFO:tasks.workunit.client.1.smithi079.stdout:3/300: truncate d1a/d1c/d1f/f56 337415 0 2024-05-09T06:29:31.885 INFO:tasks.workunit.client.1.smithi079.stdout:0/283: dwrite d3/d5/f4b [0,4194304] 0 2024-05-09T06:29:31.885 INFO:tasks.workunit.client.1.smithi079.stdout:0/284: chown d3/d5/fe 0 1 2024-05-09T06:29:31.887 INFO:tasks.workunit.client.1.smithi079.stdout:4/392: dwrite d6/d8/d27/d62/f4a [0,4194304] 0 2024-05-09T06:29:31.891 INFO:tasks.workunit.client.1.smithi079.stdout:7/325: dwrite d4/d7/dd/f42 [0,4194304] 0 2024-05-09T06:29:31.895 INFO:tasks.workunit.client.1.smithi079.stdout:5/329: creat d13/d43/d3d/f7a x:0 0 0 2024-05-09T06:29:31.896 INFO:tasks.workunit.client.1.smithi079.stdout:1/340: fsync d0/d6e/f7c 0 2024-05-09T06:29:31.897 INFO:tasks.workunit.client.1.smithi079.stdout:0/285: write d3/d5/d27/f49 [1194112,85829] 0 2024-05-09T06:29:31.897 INFO:tasks.workunit.client.1.smithi079.stdout:3/301: link d1a/d1d/f41 d1a/d21/f5d 0 2024-05-09T06:29:31.902 INFO:tasks.workunit.client.1.smithi079.stdout:0/286: dread d3/dd/f1c [0,4194304] 0 2024-05-09T06:29:31.903 INFO:tasks.workunit.client.1.smithi079.stdout:0/287: dread d3/dd/f46 [0,4194304] 0 2024-05-09T06:29:31.905 INFO:tasks.workunit.client.1.smithi079.stdout:4/393: link d6/d1a/d26/f30 d6/d1a/d26/f71 0 2024-05-09T06:29:31.905 INFO:tasks.workunit.client.1.smithi079.stdout:4/394: readlink d6/dd/l37 0 2024-05-09T06:29:31.911 INFO:tasks.workunit.client.1.smithi079.stdout:7/326: symlink d4/d7/d22/d28/d50/l60 0 2024-05-09T06:29:31.913 INFO:tasks.workunit.client.1.smithi079.stdout:3/302: dwrite d1a/d1c/d22/d53/f4b [0,4194304] 0 2024-05-09T06:29:31.913 INFO:tasks.workunit.client.1.smithi079.stdout:3/303: chown d1a/d1c/c23 838747 1 2024-05-09T06:29:31.915 INFO:tasks.workunit.client.1.smithi079.stdout:0/288: symlink d3/dd/d1f/l57 0 2024-05-09T06:29:31.919 INFO:tasks.workunit.client.1.smithi079.stdout:1/341: link d0/d12/d48/d75/d43/d20/d39/l4b d0/d7/l82 0 2024-05-09T06:29:31.930 INFO:tasks.workunit.client.1.smithi079.stdout:0/289: unlink d3/d5/f4b 0 2024-05-09T06:29:31.931 INFO:tasks.workunit.client.1.smithi079.stdout:7/327: dwrite d4/d7/dd/d5b/f5d [0,4194304] 0 2024-05-09T06:29:31.931 INFO:tasks.workunit.client.1.smithi079.stdout:7/328: truncate d4/d7/dd/d5b/f3a 5027571 0 2024-05-09T06:29:31.931 INFO:tasks.workunit.client.1.smithi079.stdout:7/329: readlink d4/d7/dd/d5b/l5a 0 2024-05-09T06:29:31.931 INFO:tasks.workunit.client.1.smithi079.stdout:7/330: readlink d4/d20/l2c 0 2024-05-09T06:29:31.934 INFO:tasks.workunit.client.1.smithi079.stdout:1/342: unlink d0/d7/d4e/d7d/l7f 0 2024-05-09T06:29:31.934 INFO:tasks.workunit.client.1.smithi079.stdout:1/343: dread - d0/d7/d4e/f72 zero size 2024-05-09T06:29:31.937 INFO:tasks.workunit.client.1.smithi079.stdout:0/290: unlink d3/dd/d1f/d1e/d2c/f31 0 2024-05-09T06:29:31.937 INFO:tasks.workunit.client.1.smithi079.stdout:0/291: truncate d3/dd/d1f/d1e/d2c/d35/d36/f4c 508579 0 2024-05-09T06:29:31.942 INFO:tasks.workunit.client.1.smithi079.stdout:7/331: symlink d4/d7/d22/d28/d50/l61 0 2024-05-09T06:29:31.943 INFO:tasks.workunit.client.1.smithi079.stdout:1/344: symlink d0/d12/d16/l83 0 2024-05-09T06:29:31.943 INFO:tasks.workunit.client.1.smithi079.stdout:1/345: write d0/d12/d16/f35 [1665958,51971] 0 2024-05-09T06:29:31.943 INFO:tasks.workunit.client.1.smithi079.stdout:1/346: truncate d0/d6e/f7c 730538 0 2024-05-09T06:29:31.945 INFO:tasks.workunit.client.1.smithi079.stdout:0/292: mkdir d3/d5/d58 0 2024-05-09T06:29:31.945 INFO:tasks.workunit.client.1.smithi079.stdout:0/293: fsync d3/d5/fe 0 2024-05-09T06:29:31.945 INFO:tasks.workunit.client.1.smithi079.stdout:0/294: write d3/dd/d1f/d1e/d2c/d35/d36/f3d [974224,39788] 0 2024-05-09T06:29:31.947 INFO:tasks.workunit.client.1.smithi079.stdout:1/347: write d0/d12/d16/f50 [704147,48126] 0 2024-05-09T06:29:31.947 INFO:tasks.workunit.client.1.smithi079.stdout:1/348: write d0/d12/d48/d75/f69 [917857,37951] 0 2024-05-09T06:29:31.947 INFO:tasks.workunit.client.1.smithi079.stdout:1/349: read d0/df/f14 [106005,110305] 0 2024-05-09T06:29:31.948 INFO:tasks.workunit.client.1.smithi079.stdout:1/350: dread d0/d12/d48/d75/f54 [0,4194304] 0 2024-05-09T06:29:31.950 INFO:tasks.workunit.client.1.smithi079.stdout:7/332: creat d4/d7/dd/d47/d56/f62 x:0 0 0 2024-05-09T06:29:31.951 INFO:tasks.workunit.client.1.smithi079.stdout:1/351: dread d0/d12/d48/d75/d43/f47 [0,4194304] 0 2024-05-09T06:29:31.952 INFO:tasks.workunit.client.1.smithi079.stdout:1/352: dread - d0/d12/d48/d75/d26/f76 zero size 2024-05-09T06:29:31.952 INFO:tasks.workunit.client.1.smithi079.stdout:1/353: chown d0/d12/d67/d53/f7a 62 1 2024-05-09T06:29:31.956 INFO:tasks.workunit.client.1.smithi079.stdout:0/295: dread d3/d5/d27/d2d/f2e [0,4194304] 0 2024-05-09T06:29:31.956 INFO:tasks.workunit.client.1.smithi079.stdout:0/296: dread - d3/f39 zero size 2024-05-09T06:29:31.956 INFO:tasks.workunit.client.1.smithi079.stdout:1/354: creat d0/d12/d16/f84 x:0 0 0 2024-05-09T06:29:31.959 INFO:tasks.workunit.client.1.smithi079.stdout:0/297: unlink d3/dd/d1f/d1e/d2c/c43 0 2024-05-09T06:29:31.961 INFO:tasks.workunit.client.1.smithi079.stdout:0/298: symlink d3/dd/d1f/d1e/l59 0 2024-05-09T06:29:31.963 INFO:tasks.workunit.client.1.smithi079.stdout:1/355: dread d0/df/f24 [0,4194304] 0 2024-05-09T06:29:31.963 INFO:tasks.workunit.client.1.smithi079.stdout:0/299: rmdir d3/dd/d1f/d1e/d2c/d35 39 2024-05-09T06:29:31.964 INFO:tasks.workunit.client.1.smithi079.stdout:0/300: write d3/dd/d1f/d1e/d2c/d35/d36/f48 [733080,82388] 0 2024-05-09T06:29:31.965 INFO:tasks.workunit.client.1.smithi079.stdout:0/301: creat d3/d5/d58/f5a x:0 0 0 2024-05-09T06:29:31.965 INFO:tasks.workunit.client.1.smithi079.stdout:0/302: stat d3/d5/d27/d2d/f2e 0 2024-05-09T06:29:31.971 INFO:tasks.workunit.client.1.smithi079.stdout:7/333: dwrite d4/d7/f1b [0,4194304] 0 2024-05-09T06:29:31.978 INFO:tasks.workunit.client.1.smithi079.stdout:1/356: dwrite d0/df/f62 [0,4194304] 0 2024-05-09T06:29:31.978 INFO:tasks.workunit.client.1.smithi079.stdout:1/357: read d0/f4a [154327,10310] 0 2024-05-09T06:29:31.983 INFO:tasks.workunit.client.1.smithi079.stdout:7/334: dread d4/d7/d22/f2a [0,4194304] 0 2024-05-09T06:29:31.990 INFO:tasks.workunit.client.1.smithi079.stdout:0/303: truncate d3/d5/d27/d2d/f2e 3066276 0 2024-05-09T06:29:31.990 INFO:tasks.workunit.client.1.smithi079.stdout:0/304: write d3/dd/d1f/d1e/d2c/d35/d36/f3d [1221432,4570] 0 2024-05-09T06:29:31.990 INFO:tasks.workunit.client.1.smithi079.stdout:0/305: creat d3/dd/f5b x:0 0 0 2024-05-09T06:29:31.990 INFO:tasks.workunit.client.1.smithi079.stdout:0/306: dread d3/dd/d1f/d1e/f42 [0,4194304] 0 2024-05-09T06:29:31.991 INFO:tasks.workunit.client.1.smithi079.stdout:0/307: readlink d3/dd/d1f/d1e/l59 0 2024-05-09T06:29:31.995 INFO:tasks.workunit.client.1.smithi079.stdout:1/358: mknod d0/d12/d48/d75/d43/d70/c85 0 2024-05-09T06:29:31.997 INFO:tasks.workunit.client.1.smithi079.stdout:7/335: symlink d4/d7/d22/d28/l63 0 2024-05-09T06:29:32.000 INFO:tasks.workunit.client.1.smithi079.stdout:0/308: mknod d3/dd/d1f/c5c 0 2024-05-09T06:29:32.001 INFO:tasks.workunit.client.1.smithi079.stdout:7/336: creat d4/f64 x:0 0 0 2024-05-09T06:29:32.001 INFO:tasks.workunit.client.1.smithi079.stdout:7/337: dread - d4/d7/f49 zero size 2024-05-09T06:29:32.002 INFO:tasks.workunit.client.1.smithi079.stdout:0/309: symlink d3/dd/d18/l5d 0 2024-05-09T06:29:32.005 INFO:tasks.workunit.client.1.smithi079.stdout:0/310: rmdir d3/d5/d51 0 2024-05-09T06:29:32.007 INFO:tasks.workunit.client.1.smithi079.stdout:3/304: rmdir d1a/d21 39 2024-05-09T06:29:32.010 INFO:tasks.workunit.client.1.smithi079.stdout:7/338: write d4/d7/dd/f21 [3651125,24817] 0 2024-05-09T06:29:32.010 INFO:tasks.workunit.client.1.smithi079.stdout:7/339: chown d4/d7/dd/f1e 3786543 1 2024-05-09T06:29:32.012 INFO:tasks.workunit.client.1.smithi079.stdout:1/359: dwrite d0/d12/d16/f50 [0,4194304] 0 2024-05-09T06:29:32.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/305: dwrite fa [0,4194304] 0 2024-05-09T06:29:32.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/306: readlink d1a/d1c/d22/d53/l5c 0 2024-05-09T06:29:32.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/307: chown f3 96 1 2024-05-09T06:29:32.030 INFO:tasks.workunit.client.1.smithi079.stdout:7/340: dread d4/d7/f13 [0,4194304] 0 2024-05-09T06:29:32.035 INFO:tasks.workunit.client.1.smithi079.stdout:3/308: write d1a/d1d/f41 [3266329,82803] 0 2024-05-09T06:29:32.036 INFO:tasks.workunit.client.1.smithi079.stdout:3/309: truncate d1a/d1c/d1f/f4d 4050269 0 2024-05-09T06:29:32.039 INFO:tasks.workunit.client.1.smithi079.stdout:3/310: mkdir d1a/d1d/d3a/d54/d5e 0 2024-05-09T06:29:32.040 INFO:tasks.workunit.client.1.smithi079.stdout:1/360: dwrite d0/d7/d4e/f6b [0,4194304] 0 2024-05-09T06:29:32.041 INFO:tasks.workunit.client.1.smithi079.stdout:3/311: link d1a/d1c/d22/l25 d1a/l5f 0 2024-05-09T06:29:32.043 INFO:tasks.workunit.client.1.smithi079.stdout:1/361: creat d0/d12/d48/d75/d43/d70/f86 x:0 0 0 2024-05-09T06:29:32.046 INFO:tasks.workunit.client.1.smithi079.stdout:3/312: dread f11 [0,4194304] 0 2024-05-09T06:29:32.048 INFO:tasks.workunit.client.1.smithi079.stdout:3/313: read - f19 zero size 2024-05-09T06:29:32.052 INFO:tasks.workunit.client.1.smithi079.stdout:3/314: creat d1a/d1d/d34/d59/f60 x:0 0 0 2024-05-09T06:29:32.062 INFO:tasks.workunit.client.1.smithi079.stdout:0/311: rename d3/d5/d58 to d3/dd/d18/d5e 0 2024-05-09T06:29:32.063 INFO:tasks.workunit.client.1.smithi079.stdout:1/362: dwrite d0/d12/d48/d75/d43/f2e [0,4194304] 0 2024-05-09T06:29:32.063 INFO:tasks.workunit.client.1.smithi079.stdout:3/315: dread d1a/d1d/d34/f38 [0,4194304] 0 2024-05-09T06:29:32.064 INFO:tasks.workunit.client.1.smithi079.stdout:7/341: rename d4/d20/l2c to d4/d7/d22/l65 0 2024-05-09T06:29:32.074 INFO:tasks.workunit.client.1.smithi079.stdout:3/316: mkdir d1a/d1d/d3a/d61 0 2024-05-09T06:29:32.079 INFO:tasks.workunit.client.1.smithi079.stdout:7/342: dwrite d4/d7/f18 [4194304,4194304] 0 2024-05-09T06:29:32.082 INFO:tasks.workunit.client.1.smithi079.stdout:7/343: write d4/d7/d22/f2a [1146584,70212] 0 2024-05-09T06:29:32.084 INFO:tasks.workunit.client.1.smithi079.stdout:1/363: symlink d0/l87 0 2024-05-09T06:29:32.086 INFO:tasks.workunit.client.1.smithi079.stdout:3/317: creat d1a/d21/f62 x:0 0 0 2024-05-09T06:29:32.089 INFO:tasks.workunit.client.1.smithi079.stdout:5/330: sync 2024-05-09T06:29:32.089 INFO:tasks.workunit.client.1.smithi079.stdout:5/331: chown fc 28 1 2024-05-09T06:29:32.089 INFO:tasks.workunit.client.1.smithi079.stdout:4/395: sync 2024-05-09T06:29:32.090 INFO:tasks.workunit.client.1.smithi079.stdout:8/292: sync 2024-05-09T06:29:32.090 INFO:tasks.workunit.client.1.smithi079.stdout:9/483: sync 2024-05-09T06:29:32.090 INFO:tasks.workunit.client.1.smithi079.stdout:8/293: dread - d1/d5/dc/f34 zero size 2024-05-09T06:29:32.090 INFO:tasks.workunit.client.1.smithi079.stdout:9/484: write d1/d5/d5b/fa4 [659183,71267] 0 2024-05-09T06:29:32.090 INFO:tasks.workunit.client.1.smithi079.stdout:2/339: sync 2024-05-09T06:29:32.090 INFO:tasks.workunit.client.1.smithi079.stdout:6/273: sync 2024-05-09T06:29:32.094 INFO:tasks.workunit.client.1.smithi079.stdout:7/344: symlink d4/d7/d22/d28/d50/d5c/l66 0 2024-05-09T06:29:32.096 INFO:tasks.workunit.client.1.smithi079.stdout:1/364: truncate d0/f5 673758 0 2024-05-09T06:29:32.096 INFO:tasks.workunit.client.1.smithi079.stdout:4/396: truncate d6/d1a/d26/d2a/d54/f23 439587 0 2024-05-09T06:29:32.100 INFO:tasks.workunit.client.1.smithi079.stdout:8/294: rmdir d1/d3/d20/d22/d50/d5c 0 2024-05-09T06:29:32.101 INFO:tasks.workunit.client.1.smithi079.stdout:9/485: fsync d1/d45/f86 0 2024-05-09T06:29:32.101 INFO:tasks.workunit.client.1.smithi079.stdout:9/486: chown d1/d33/d28/d36/d4d/fa2 12614069 1 2024-05-09T06:29:32.103 INFO:tasks.workunit.client.1.smithi079.stdout:2/340: mknod d8/db/dc/c82 0 2024-05-09T06:29:32.114 INFO:tasks.workunit.client.1.smithi079.stdout:4/397: rename d6/dd/f36 to d6/d1a/d26/d2a/f72 0 2024-05-09T06:29:32.116 INFO:tasks.workunit.client.1.smithi079.stdout:8/295: link d1/d3/d20/d29/f4e d1/d5/f6f 0 2024-05-09T06:29:32.121 INFO:tasks.workunit.client.1.smithi079.stdout:2/341: creat d8/db/d4b/d4f/d51/f83 x:0 0 0 2024-05-09T06:29:32.135 INFO:tasks.workunit.client.1.smithi079.stdout:5/332: dwrite d13/d2a/f4b [0,4194304] 0 2024-05-09T06:29:32.140 INFO:tasks.workunit.client.1.smithi079.stdout:9/487: write d1/f3 [7569195,57714] 0 2024-05-09T06:29:32.142 INFO:tasks.workunit.client.1.smithi079.stdout:5/333: creat d13/d43/d3d/d40/d63/f7b x:0 0 0 2024-05-09T06:29:32.142 INFO:tasks.workunit.client.1.smithi079.stdout:5/334: getdents d13/d4d/d77 0 2024-05-09T06:29:32.142 INFO:tasks.workunit.client.1.smithi079.stdout:5/335: chown d13/d43/d26/f57 126 1 2024-05-09T06:29:32.158 INFO:tasks.workunit.client.1.smithi079.stdout:6/274: dwrite d0/fc [4194304,4194304] 0 2024-05-09T06:29:32.158 INFO:tasks.workunit.client.1.smithi079.stdout:7/345: dwrite d4/f64 [0,4194304] 0 2024-05-09T06:29:32.158 INFO:tasks.workunit.client.1.smithi079.stdout:6/275: truncate d0/d6/d16/d1f/f25 719411 0 2024-05-09T06:29:32.159 INFO:tasks.workunit.client.1.smithi079.stdout:6/276: write d0/d6/d1b/f55 [158452,85801] 0 2024-05-09T06:29:32.159 INFO:tasks.workunit.client.1.smithi079.stdout:1/365: dwrite d0/f58 [0,4194304] 0 2024-05-09T06:29:32.163 INFO:tasks.workunit.client.1.smithi079.stdout:5/336: dwrite d13/d43/f36 [0,4194304] 0 2024-05-09T06:29:32.163 INFO:tasks.workunit.client.1.smithi079.stdout:6/277: dread d0/d6/f4d [0,4194304] 0 2024-05-09T06:29:32.164 INFO:tasks.workunit.client.1.smithi079.stdout:6/278: truncate d0/d6/d16/f3b 577121 0 2024-05-09T06:29:32.164 INFO:tasks.workunit.client.1.smithi079.stdout:0/312: rmdir d3/dd 39 2024-05-09T06:29:32.167 INFO:tasks.workunit.client.1.smithi079.stdout:7/346: mkdir d4/d7/d37/d67 0 2024-05-09T06:29:32.167 INFO:tasks.workunit.client.1.smithi079.stdout:4/398: dwrite d6/dd/f4e [0,4194304] 0 2024-05-09T06:29:32.167 INFO:tasks.workunit.client.1.smithi079.stdout:7/347: creat d4/d7/d37/f68 x:0 0 0 2024-05-09T06:29:32.167 INFO:tasks.workunit.client.1.smithi079.stdout:4/399: readlink d6/dd/d34/l3a 0 2024-05-09T06:29:32.167 INFO:tasks.workunit.client.1.smithi079.stdout:8/296: dwrite d1/d3/d20/d22/d44/f35 [0,4194304] 0 2024-05-09T06:29:32.167 INFO:tasks.workunit.client.1.smithi079.stdout:2/342: dwrite d8/db/dc/d2c/f63 [0,4194304] 0 2024-05-09T06:29:32.167 INFO:tasks.workunit.client.1.smithi079.stdout:2/343: write d8/db/d11/d5f/f64 [163168,25427] 0 2024-05-09T06:29:32.167 INFO:tasks.workunit.client.1.smithi079.stdout:2/344: stat d8 0 2024-05-09T06:29:32.170 INFO:tasks.workunit.client.1.smithi079.stdout:9/488: dwrite d1/d33/d28/d36/d4d/d7d/f31 [0,4194304] 0 2024-05-09T06:29:32.170 INFO:tasks.workunit.client.1.smithi079.stdout:9/489: fdatasync d1/d33/d48/d64/f7c 0 2024-05-09T06:29:32.171 INFO:tasks.workunit.client.1.smithi079.stdout:8/297: dread d1/d3/d20/d22/d50/f5b [0,4194304] 0 2024-05-09T06:29:32.173 INFO:tasks.workunit.client.1.smithi079.stdout:6/279: dread d0/d6/d1b/f55 [0,4194304] 0 2024-05-09T06:29:32.174 INFO:tasks.workunit.client.1.smithi079.stdout:5/337: mknod d13/d43/c7c 0 2024-05-09T06:29:32.178 INFO:tasks.workunit.client.1.smithi079.stdout:7/348: dread d4/d20/f48 [0,4194304] 0 2024-05-09T06:29:32.178 INFO:tasks.workunit.client.1.smithi079.stdout:7/349: creat d4/d7/dd/d5b/f69 x:0 0 0 2024-05-09T06:29:32.180 INFO:tasks.workunit.client.1.smithi079.stdout:4/400: creat d6/d1a/d41/f73 x:0 0 0 2024-05-09T06:29:32.185 INFO:tasks.workunit.client.1.smithi079.stdout:2/345: mknod d8/db/dc/c84 0 2024-05-09T06:29:32.185 INFO:tasks.workunit.client.1.smithi079.stdout:2/346: write d8/db/d5c/f81 [52521,68840] 0 2024-05-09T06:29:32.190 INFO:tasks.workunit.client.1.smithi079.stdout:4/401: write d6/d8/f4f [916667,30630] 0 2024-05-09T06:29:32.192 INFO:tasks.workunit.client.1.smithi079.stdout:8/298: truncate d1/d3/d20/f32 2883943 0 2024-05-09T06:29:32.194 INFO:tasks.workunit.client.1.smithi079.stdout:7/350: dread d4/d7/f18 [4194304,4194304] 0 2024-05-09T06:29:32.194 INFO:tasks.workunit.client.1.smithi079.stdout:7/351: chown d4/d7/d22/f2a 2 1 2024-05-09T06:29:32.205 INFO:tasks.workunit.client.1.smithi079.stdout:7/352: dread d4/d7/dd/f1e [0,4194304] 0 2024-05-09T06:29:32.205 INFO:tasks.workunit.client.1.smithi079.stdout:7/353: chown d4/d7/d22/d28 1100960049 1 2024-05-09T06:29:32.206 INFO:tasks.workunit.client.1.smithi079.stdout:9/490: dwrite d1/d5/d5b/f71 [0,4194304] 0 2024-05-09T06:29:32.209 INFO:tasks.workunit.client.1.smithi079.stdout:6/280: dwrite d0/d6/d16/d1f/f41 [4194304,4194304] 0 2024-05-09T06:29:32.210 INFO:tasks.workunit.client.1.smithi079.stdout:2/347: dwrite d8/db/d4b/d4f/d51/f83 [0,4194304] 0 2024-05-09T06:29:32.210 INFO:tasks.workunit.client.1.smithi079.stdout:4/402: rmdir d6/d1a/d26 39 2024-05-09T06:29:32.211 INFO:tasks.workunit.client.1.smithi079.stdout:5/338: dwrite fc [4194304,4194304] 0 2024-05-09T06:29:32.211 INFO:tasks.workunit.client.1.smithi079.stdout:5/339: creat d13/d43/d39/d61/f7d x:0 0 0 2024-05-09T06:29:32.211 INFO:tasks.workunit.client.1.smithi079.stdout:5/340: stat fa 0 2024-05-09T06:29:32.211 INFO:tasks.workunit.client.1.smithi079.stdout:4/403: dread d6/d15/f5f [0,4194304] 0 2024-05-09T06:29:32.212 INFO:tasks.workunit.client.1.smithi079.stdout:4/404: chown d6/dd/l28 243283 1 2024-05-09T06:29:32.212 INFO:tasks.workunit.client.1.smithi079.stdout:8/299: unlink d1/d3/d20/d29/d33/c4b 0 2024-05-09T06:29:32.213 INFO:tasks.workunit.client.1.smithi079.stdout:8/300: truncate d1/d3/f17 2286543 0 2024-05-09T06:29:32.213 INFO:tasks.workunit.client.1.smithi079.stdout:8/301: read - d1/d5/dc/f34 zero size 2024-05-09T06:29:32.213 INFO:tasks.workunit.client.1.smithi079.stdout:8/302: chown d1/d3/d20/d22/l48 46411853 1 2024-05-09T06:29:32.214 INFO:tasks.workunit.client.1.smithi079.stdout:7/354: link d4/d7/d22/c2e d4/d7/d37/c6a 0 2024-05-09T06:29:32.214 INFO:tasks.workunit.client.1.smithi079.stdout:7/355: write d4/d7/dd/d5b/d32/f35 [169617,109138] 0 2024-05-09T06:29:32.222 INFO:tasks.workunit.client.1.smithi079.stdout:9/491: symlink d1/d33/d28/d36/d38/d3a/la8 0 2024-05-09T06:29:32.222 INFO:tasks.workunit.client.1.smithi079.stdout:9/492: fsync d1/d33/f76 0 2024-05-09T06:29:32.225 INFO:tasks.workunit.client.1.smithi079.stdout:2/348: creat d8/db/d4b/f85 x:0 0 0 2024-05-09T06:29:32.230 INFO:tasks.workunit.client.1.smithi079.stdout:5/341: rename d13/d43/d26/f3e to d13/d2a/f7e 0 2024-05-09T06:29:32.232 INFO:tasks.workunit.client.1.smithi079.stdout:4/405: link d6/fa d6/d8/d55/f74 0 2024-05-09T06:29:32.232 INFO:tasks.workunit.client.1.smithi079.stdout:4/406: truncate d6/d8/d27/d3d/f58 1001824 0 2024-05-09T06:29:32.232 INFO:tasks.workunit.client.1.smithi079.stdout:4/407: chown d6/dd/c1f 614 1 2024-05-09T06:29:32.232 INFO:tasks.workunit.client.1.smithi079.stdout:4/408: dread - d6/dd/f6a zero size 2024-05-09T06:29:32.233 INFO:tasks.workunit.client.1.smithi079.stdout:4/409: creat d6/d1a/f75 x:0 0 0 2024-05-09T06:29:32.233 INFO:tasks.workunit.client.1.smithi079.stdout:8/303: creat d1/d5/d36/f70 x:0 0 0 2024-05-09T06:29:32.233 INFO:tasks.workunit.client.1.smithi079.stdout:8/304: readlink d1/l2 0 2024-05-09T06:29:32.234 INFO:tasks.workunit.client.1.smithi079.stdout:9/493: getdents d1/d33/d28/d36/d38/d3a/d56 0 2024-05-09T06:29:32.234 INFO:tasks.workunit.client.1.smithi079.stdout:9/494: readlink d1/d33/d28/d4c/d4e/d2d/l47 0 2024-05-09T06:29:32.235 INFO:tasks.workunit.client.1.smithi079.stdout:2/349: mkdir d8/db/d59/d67/d86 0 2024-05-09T06:29:32.238 INFO:tasks.workunit.client.1.smithi079.stdout:8/305: write d1/d3/d20/d22/d3b/f46 [3279479,107727] 0 2024-05-09T06:29:32.239 INFO:tasks.workunit.client.1.smithi079.stdout:4/410: rename d6/dd/c1f to d6/c76 0 2024-05-09T06:29:32.241 INFO:tasks.workunit.client.1.smithi079.stdout:9/495: unlink d1/d33/d28/d4c/d4e/d2d/c49 0 2024-05-09T06:29:32.242 INFO:tasks.workunit.client.1.smithi079.stdout:2/350: rmdir d8/db/d4b/d4f/d51/d6d 39 2024-05-09T06:29:32.242 INFO:tasks.workunit.client.1.smithi079.stdout:2/351: stat d8/db/dc/f6c 0 2024-05-09T06:29:32.245 INFO:tasks.workunit.client.1.smithi079.stdout:6/281: dwrite d0/de/f3a [0,4194304] 0 2024-05-09T06:29:32.245 INFO:tasks.workunit.client.1.smithi079.stdout:7/356: dwrite d4/d7/dd/d5b/d32/f3b [0,4194304] 0 2024-05-09T06:29:32.246 INFO:tasks.workunit.client.1.smithi079.stdout:8/306: rename d1/d5/c28 to d1/d3/d20/d22/d3b/c71 0 2024-05-09T06:29:32.246 INFO:tasks.workunit.client.1.smithi079.stdout:2/352: rename d8/db to d8/db/d11/d79/d87 22 2024-05-09T06:29:32.246 INFO:tasks.workunit.client.1.smithi079.stdout:8/307: fsync d1/d5/f11 0 2024-05-09T06:29:32.246 INFO:tasks.workunit.client.1.smithi079.stdout:2/353: dread - d8/db/d11/f55 zero size 2024-05-09T06:29:32.246 INFO:tasks.workunit.client.1.smithi079.stdout:5/342: dwrite d13/d43/d39/d61/f76 [0,4194304] 0 2024-05-09T06:29:32.246 INFO:tasks.workunit.client.1.smithi079.stdout:6/282: dread d0/d6/d16/d1f/d36/f54 [0,4194304] 0 2024-05-09T06:29:32.248 INFO:tasks.workunit.client.1.smithi079.stdout:4/411: mknod d6/d1a/d41/d68/c77 0 2024-05-09T06:29:32.248 INFO:tasks.workunit.client.1.smithi079.stdout:4/412: getdents d6/d8/d27/d3d 0 2024-05-09T06:29:32.248 INFO:tasks.workunit.client.1.smithi079.stdout:4/413: read d6/d8/d27/d3d/f58 [622899,116333] 0 2024-05-09T06:29:32.255 INFO:tasks.workunit.client.1.smithi079.stdout:7/357: dread d4/d7/dd/d5b/d31/d34/f45 [0,4194304] 0 2024-05-09T06:29:32.255 INFO:tasks.workunit.client.1.smithi079.stdout:6/283: dread d0/d6/d1b/d20/f2f [0,4194304] 0 2024-05-09T06:29:32.255 INFO:tasks.workunit.client.1.smithi079.stdout:7/358: readlink d4/d7/d22/l2d 0 2024-05-09T06:29:32.257 INFO:tasks.workunit.client.1.smithi079.stdout:6/284: dread d0/f3f [0,4194304] 0 2024-05-09T06:29:32.271 INFO:tasks.workunit.client.1.smithi079.stdout:2/354: mkdir d8/db/d11/d79/d88 0 2024-05-09T06:29:32.274 INFO:tasks.workunit.client.1.smithi079.stdout:6/285: dwrite d0/d6/d16/d1f/f23 [0,4194304] 0 2024-05-09T06:29:32.276 INFO:tasks.workunit.client.1.smithi079.stdout:8/308: unlink d1/d3/d20/d22/d44/f39 0 2024-05-09T06:29:32.278 INFO:tasks.workunit.client.1.smithi079.stdout:5/343: rename d13/f52 to d13/d43/d39/f7f 0 2024-05-09T06:29:32.278 INFO:tasks.workunit.client.1.smithi079.stdout:5/344: fsync d13/d2a/f4b 0 2024-05-09T06:29:32.280 INFO:tasks.workunit.client.1.smithi079.stdout:4/414: symlink d6/d1a/d26/d2a/d54/d59/l78 0 2024-05-09T06:29:32.280 INFO:tasks.workunit.client.1.smithi079.stdout:4/415: chown d6/d8/f50 50258201 1 2024-05-09T06:29:32.281 INFO:tasks.workunit.client.1.smithi079.stdout:4/416: dread - d6/d8/f49 zero size 2024-05-09T06:29:32.283 INFO:tasks.workunit.client.1.smithi079.stdout:9/496: unlink d1/d45/f82 0 2024-05-09T06:29:32.283 INFO:tasks.workunit.client.1.smithi079.stdout:9/497: chown d1/d33/d28/d3e/f44 322836564 1 2024-05-09T06:29:32.283 INFO:tasks.workunit.client.1.smithi079.stdout:9/498: chown d1/d33/d28/d36/d6c 3 1 2024-05-09T06:29:32.284 INFO:tasks.workunit.client.1.smithi079.stdout:7/359: dread - d4/d7/d37/f4a zero size 2024-05-09T06:29:32.284 INFO:tasks.workunit.client.1.smithi079.stdout:6/286: read d0/de/f3a [2674976,2233] 0 2024-05-09T06:29:32.284 INFO:tasks.workunit.client.1.smithi079.stdout:7/360: read d4/d7/dd/d5b/d32/f35 [148545,71852] 0 2024-05-09T06:29:32.285 INFO:tasks.workunit.client.1.smithi079.stdout:2/355: getdents d8/db/dc/d2c/d2e 0 2024-05-09T06:29:32.288 INFO:tasks.workunit.client.1.smithi079.stdout:8/309: symlink d1/d3/d20/d22/d50/d61/d66/d6c/d6b/l72 0 2024-05-09T06:29:32.288 INFO:tasks.workunit.client.1.smithi079.stdout:8/310: readlink d1/l2a 0 2024-05-09T06:29:32.290 INFO:tasks.workunit.client.1.smithi079.stdout:5/345: mkdir d13/d4f/d80 0 2024-05-09T06:29:32.290 INFO:tasks.workunit.client.1.smithi079.stdout:5/346: chown d13/d43/d26/f2e 5 1 2024-05-09T06:29:32.293 INFO:tasks.workunit.client.1.smithi079.stdout:4/417: link d6/d1a/d41/d68/c77 d6/d15/c79 0 2024-05-09T06:29:32.295 INFO:tasks.workunit.client.1.smithi079.stdout:6/287: link d0/d6/d1b/d2d/f44 d0/d6/d16/f56 0 2024-05-09T06:29:32.299 INFO:tasks.workunit.client.1.smithi079.stdout:4/418: symlink d6/d1a/d26/d2a/l7a 0 2024-05-09T06:29:32.301 INFO:tasks.workunit.client.1.smithi079.stdout:6/288: symlink d0/d6/d1b/d2d/l57 0 2024-05-09T06:29:32.301 INFO:tasks.workunit.client.1.smithi079.stdout:6/289: chown d0/c11 15 1 2024-05-09T06:29:32.303 INFO:tasks.workunit.client.1.smithi079.stdout:7/361: getdents d4/d7 0 2024-05-09T06:29:32.303 INFO:tasks.workunit.client.1.smithi079.stdout:7/362: fsync d4/d7/dd/d5b/f5d 0 2024-05-09T06:29:32.303 INFO:tasks.workunit.client.1.smithi079.stdout:5/347: dread d13/d43/d26/d35/f6d [0,4194304] 0 2024-05-09T06:29:32.306 INFO:tasks.workunit.client.1.smithi079.stdout:7/363: mknod d4/d7/d22/c6b 0 2024-05-09T06:29:32.307 INFO:tasks.workunit.client.1.smithi079.stdout:5/348: truncate d13/d43/d39/f7f 3610793 0 2024-05-09T06:29:32.311 INFO:tasks.workunit.client.1.smithi079.stdout:5/349: creat d13/d43/f81 x:0 0 0 2024-05-09T06:29:32.311 INFO:tasks.workunit.client.1.smithi079.stdout:5/350: write d13/d43/d26/f3c [578794,69027] 0 2024-05-09T06:29:32.312 INFO:tasks.workunit.client.1.smithi079.stdout:5/351: read d13/d43/d39/d61/f62 [481245,70886] 0 2024-05-09T06:29:32.312 INFO:tasks.workunit.client.1.smithi079.stdout:5/352: stat d13/d43 0 2024-05-09T06:29:32.313 INFO:tasks.workunit.client.1.smithi079.stdout:4/419: write d6/d1a/d26/f71 [2595550,49346] 0 2024-05-09T06:29:32.314 INFO:tasks.workunit.client.1.smithi079.stdout:2/356: dwrite d8/db/f62 [0,4194304] 0 2024-05-09T06:29:32.314 INFO:tasks.workunit.client.1.smithi079.stdout:2/357: chown d8/db/d4b/d4f/d51/d6d 7728405 1 2024-05-09T06:29:32.316 INFO:tasks.workunit.client.1.smithi079.stdout:5/353: mkdir d13/d43/d82 0 2024-05-09T06:29:32.316 INFO:tasks.workunit.client.1.smithi079.stdout:5/354: creat d13/d43/d26/f83 x:0 0 0 2024-05-09T06:29:32.316 INFO:tasks.workunit.client.1.smithi079.stdout:8/311: dwrite d1/d5/f5f [0,4194304] 0 2024-05-09T06:29:32.317 INFO:tasks.workunit.client.1.smithi079.stdout:9/499: dwrite d1/d33/f76 [0,4194304] 0 2024-05-09T06:29:32.318 INFO:tasks.workunit.client.1.smithi079.stdout:6/290: dread d0/f15 [0,4194304] 0 2024-05-09T06:29:32.322 INFO:tasks.workunit.client.1.smithi079.stdout:2/358: rename d8/l18 to d8/db/d59/l89 0 2024-05-09T06:29:32.327 INFO:tasks.workunit.client.1.smithi079.stdout:5/355: link d13/d43/l54 d13/d43/d82/l84 0 2024-05-09T06:29:32.327 INFO:tasks.workunit.client.1.smithi079.stdout:5/356: write d13/d43/d26/f2e [1630211,49757] 0 2024-05-09T06:29:32.329 INFO:tasks.workunit.client.1.smithi079.stdout:8/312: dread d1/d3/d20/d22/d44/f35 [0,4194304] 0 2024-05-09T06:29:32.330 INFO:tasks.workunit.client.1.smithi079.stdout:5/357: write d13/d43/d26/d35/f5e [336285,113564] 0 2024-05-09T06:29:32.335 INFO:tasks.workunit.client.1.smithi079.stdout:6/291: unlink d0/f3f 0 2024-05-09T06:29:32.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/359: creat d8/db/d11/d79/f8a x:0 0 0 2024-05-09T06:29:32.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/360: chown d8/db/dc/c44 12 1 2024-05-09T06:29:32.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/361: chown d8/db/d11/l15 1892268 1 2024-05-09T06:29:32.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/362: chown d8/db/dc/c82 28483 1 2024-05-09T06:29:32.339 INFO:tasks.workunit.client.1.smithi079.stdout:5/358: dread d13/f48 [0,4194304] 0 2024-05-09T06:29:32.345 INFO:tasks.workunit.client.1.smithi079.stdout:6/292: link d0/d6/f29 d0/d6/d16/d28/f58 0 2024-05-09T06:29:32.345 INFO:tasks.workunit.client.1.smithi079.stdout:6/293: fdatasync d0/d6/f14 0 2024-05-09T06:29:32.348 INFO:tasks.workunit.client.1.smithi079.stdout:2/363: symlink d8/db/d4b/d4f/d51/l8b 0 2024-05-09T06:29:32.349 INFO:tasks.workunit.client.1.smithi079.stdout:2/364: write d8/db/d4b/f85 [825616,78729] 0 2024-05-09T06:29:32.349 INFO:tasks.workunit.client.1.smithi079.stdout:2/365: dread - d8/db/d4b/f68 zero size 2024-05-09T06:29:32.350 INFO:tasks.workunit.client.1.smithi079.stdout:5/359: link d13/d2a/f4e d13/d43/d3d/f85 0 2024-05-09T06:29:32.352 INFO:tasks.workunit.client.1.smithi079.stdout:7/364: dwrite d4/d7/dd/d5b/d31/f33 [0,4194304] 0 2024-05-09T06:29:32.353 INFO:tasks.workunit.client.1.smithi079.stdout:5/360: creat d13/d43/d39/f86 x:0 0 0 2024-05-09T06:29:32.353 INFO:tasks.workunit.client.1.smithi079.stdout:5/361: chown d13/d43/d39/l47 34074 1 2024-05-09T06:29:32.357 INFO:tasks.workunit.client.1.smithi079.stdout:7/365: link d4/d7/dd/d5b/d32/f35 d4/d7/dd/f6c 0 2024-05-09T06:29:32.358 INFO:tasks.workunit.client.1.smithi079.stdout:5/362: symlink d13/d43/d3d/d40/d53/l87 0 2024-05-09T06:29:32.359 INFO:tasks.workunit.client.1.smithi079.stdout:9/500: dwrite d1/d5/d5b/fa4 [0,4194304] 0 2024-05-09T06:29:32.359 INFO:tasks.workunit.client.1.smithi079.stdout:9/501: write d1/d5/ff [1623998,119022] 0 2024-05-09T06:29:32.359 INFO:tasks.workunit.client.1.smithi079.stdout:7/366: rmdir d4/d7/d22/d28/d50 39 2024-05-09T06:29:32.364 INFO:tasks.workunit.client.1.smithi079.stdout:5/363: mknod d13/d4f/d80/c88 0 2024-05-09T06:29:32.367 INFO:tasks.workunit.client.1.smithi079.stdout:7/367: rmdir d4/d7 39 2024-05-09T06:29:32.367 INFO:tasks.workunit.client.1.smithi079.stdout:7/368: fdatasync d4/d7/dd/d47/d56/f62 0 2024-05-09T06:29:32.369 INFO:tasks.workunit.client.1.smithi079.stdout:3/318: sync 2024-05-09T06:29:32.369 INFO:tasks.workunit.client.1.smithi079.stdout:0/313: sync 2024-05-09T06:29:32.369 INFO:tasks.workunit.client.1.smithi079.stdout:1/366: sync 2024-05-09T06:29:32.369 INFO:tasks.workunit.client.1.smithi079.stdout:1/367: readlink d0/df/l5b 0 2024-05-09T06:29:32.369 INFO:tasks.workunit.client.1.smithi079.stdout:0/314: chown d3/dd/d1f/d1e/f42 375742486 1 2024-05-09T06:29:32.369 INFO:tasks.workunit.client.1.smithi079.stdout:3/319: creat d1a/d1d/f63 x:0 0 0 2024-05-09T06:29:32.370 INFO:tasks.workunit.client.1.smithi079.stdout:5/364: link d13/d43/d39/d61/d72/c74 d13/d4f/c89 0 2024-05-09T06:29:32.372 INFO:tasks.workunit.client.1.smithi079.stdout:9/502: mkdir d1/d33/d28/d4c/d4e/da9 0 2024-05-09T06:29:32.372 INFO:tasks.workunit.client.1.smithi079.stdout:9/503: truncate d1/d33/d48/d64/f7c 513226 0 2024-05-09T06:29:32.376 INFO:tasks.workunit.client.1.smithi079.stdout:7/369: rename d4/d7/dd/d5b/d31/d34/f45 to d4/d7/dd/f6d 0 2024-05-09T06:29:32.376 INFO:tasks.workunit.client.1.smithi079.stdout:7/370: stat d4/d7/dd/d5b/f5d 0 2024-05-09T06:29:32.380 INFO:tasks.workunit.client.1.smithi079.stdout:3/320: mknod d1a/d1d/c64 0 2024-05-09T06:29:32.383 INFO:tasks.workunit.client.1.smithi079.stdout:5/365: unlink d13/d43/d26/f6b 0 2024-05-09T06:29:32.383 INFO:tasks.workunit.client.1.smithi079.stdout:5/366: write d13/d43/d39/d61/f62 [477152,68657] 0 2024-05-09T06:29:32.385 INFO:tasks.workunit.client.1.smithi079.stdout:7/371: link d4/d7/d37/f4a d4/d7/f6e 0 2024-05-09T06:29:32.387 INFO:tasks.workunit.client.1.smithi079.stdout:9/504: rename d1/f8f to d1/d5/faa 0 2024-05-09T06:29:32.389 INFO:tasks.workunit.client.1.smithi079.stdout:3/321: symlink d1a/d1c/d1f/l65 0 2024-05-09T06:29:32.390 INFO:tasks.workunit.client.1.smithi079.stdout:5/367: creat d13/d4d/d77/f8a x:0 0 0 2024-05-09T06:29:32.392 INFO:tasks.workunit.client.1.smithi079.stdout:5/368: dread d13/d43/d26/d35/f64 [0,4194304] 0 2024-05-09T06:29:32.397 INFO:tasks.workunit.client.1.smithi079.stdout:3/322: link f5 d1a/d1c/d22/d53/f66 0 2024-05-09T06:29:32.397 INFO:tasks.workunit.client.1.smithi079.stdout:3/323: readlink d1a/l27 0 2024-05-09T06:29:32.398 INFO:tasks.workunit.client.1.smithi079.stdout:9/505: dread d1/d6/f13 [0,4194304] 0 2024-05-09T06:29:32.399 INFO:tasks.workunit.client.1.smithi079.stdout:5/369: mkdir d13/d43/d82/d8b 0 2024-05-09T06:29:32.402 INFO:tasks.workunit.client.1.smithi079.stdout:3/324: mkdir d1a/d1d/d67 0 2024-05-09T06:29:32.406 INFO:tasks.workunit.client.1.smithi079.stdout:7/372: rename d4/d7/dd/d47/d56 to d4/d7/dd/d5b/d6f 0 2024-05-09T06:29:32.409 INFO:tasks.workunit.client.1.smithi079.stdout:3/325: truncate d1a/d1c/d1f/f4d 2563000 0 2024-05-09T06:29:32.409 INFO:tasks.workunit.client.1.smithi079.stdout:3/326: chown d1a/d21/f40 15245 1 2024-05-09T06:29:32.411 INFO:tasks.workunit.client.1.smithi079.stdout:9/506: mkdir d1/d45/dab 0 2024-05-09T06:29:32.411 INFO:tasks.workunit.client.1.smithi079.stdout:9/507: chown d1/d33/d28/d36/d4d/d7d/d19/f55 1 1 2024-05-09T06:29:32.411 INFO:tasks.workunit.client.1.smithi079.stdout:9/508: fdatasync d1/d5/f58 0 2024-05-09T06:29:32.417 INFO:tasks.workunit.client.1.smithi079.stdout:3/327: write d1a/d1d/f3e [280854,59199] 0 2024-05-09T06:29:32.417 INFO:tasks.workunit.client.1.smithi079.stdout:3/328: creat d1a/d1c/d1f/f68 x:0 0 0 2024-05-09T06:29:32.419 INFO:tasks.workunit.client.1.smithi079.stdout:9/509: write d1/d5/f24 [2012160,29899] 0 2024-05-09T06:29:32.421 INFO:tasks.workunit.client.1.smithi079.stdout:3/329: stat d1a/l5f 0 2024-05-09T06:29:32.422 INFO:tasks.workunit.client.1.smithi079.stdout:3/330: dread d1a/d1c/d1f/f56 [0,4194304] 0 2024-05-09T06:29:32.426 INFO:tasks.workunit.client.1.smithi079.stdout:3/331: creat d1a/d21/f69 x:0 0 0 2024-05-09T06:29:32.426 INFO:tasks.workunit.client.1.smithi079.stdout:9/510: rename d1/d33/d28/d4c/fa1 to d1/d33/d2b/fac 0 2024-05-09T06:29:32.432 INFO:tasks.workunit.client.1.smithi079.stdout:9/511: unlink d1/d33/d2b/c98 0 2024-05-09T06:29:32.435 INFO:tasks.workunit.client.1.smithi079.stdout:3/332: symlink d1a/d1d/d34/l6a 0 2024-05-09T06:29:32.435 INFO:tasks.workunit.client.1.smithi079.stdout:3/333: fdatasync d1a/d1c/d1f/f68 0 2024-05-09T06:29:32.435 INFO:tasks.workunit.client.1.smithi079.stdout:6/294: dwrite d0/de/f1e [0,4194304] 0 2024-05-09T06:29:32.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/315: dread d3/d5/d27/f32 [4194304,4194304] 0 2024-05-09T06:29:32.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/316: chown d3/dd/d1f/d1e/d2c/d35 313 1 2024-05-09T06:29:32.437 INFO:tasks.workunit.client.1.smithi079.stdout:9/512: mknod d1/d33/d28/d4c/cad 0 2024-05-09T06:29:32.438 INFO:tasks.workunit.client.1.smithi079.stdout:9/513: chown d1/d33/d28/d3e/d75/f94 3699098 1 2024-05-09T06:29:32.442 INFO:tasks.workunit.client.1.smithi079.stdout:3/334: mkdir d1a/d1c/d6b 0 2024-05-09T06:29:32.445 INFO:tasks.workunit.client.1.smithi079.stdout:9/514: mkdir d1/d6/dae 0 2024-05-09T06:29:32.450 INFO:tasks.workunit.client.1.smithi079.stdout:3/335: link fe d1a/d1d/d34/f6c 0 2024-05-09T06:29:32.452 INFO:tasks.workunit.client.1.smithi079.stdout:2/366: dwrite d8/db/d11/f35 [0,4194304] 0 2024-05-09T06:29:32.452 INFO:tasks.workunit.client.1.smithi079.stdout:2/367: chown d8/d3c/f80 929190 1 2024-05-09T06:29:32.454 INFO:tasks.workunit.client.1.smithi079.stdout:3/336: symlink d1a/d1d/d3a/l6d 0 2024-05-09T06:29:32.455 INFO:tasks.workunit.client.1.smithi079.stdout:3/337: chown d1a/d1c/d1f/f31 368909 1 2024-05-09T06:29:32.455 INFO:tasks.workunit.client.1.smithi079.stdout:3/338: write d1a/d1d/d34/f38 [4821909,122053] 0 2024-05-09T06:29:32.455 INFO:tasks.workunit.client.1.smithi079.stdout:3/339: chown d1a/d1c/d6b 1 1 2024-05-09T06:29:32.456 INFO:tasks.workunit.client.1.smithi079.stdout:3/340: write d1a/d21/f5d [407562,54984] 0 2024-05-09T06:29:32.480 INFO:tasks.workunit.client.1.smithi079.stdout:1/368: dwrite d0/d12/d67/d53/d6d/f80 [0,4194304] 0 2024-05-09T06:29:32.480 INFO:tasks.workunit.client.1.smithi079.stdout:5/370: dwrite d13/d2a/f4b [0,4194304] 0 2024-05-09T06:29:32.480 INFO:tasks.workunit.client.1.smithi079.stdout:1/369: chown d0/d12/d16/l1e 1 1 2024-05-09T06:29:32.480 INFO:tasks.workunit.client.1.smithi079.stdout:5/371: creat d13/d43/d3d/d40/d63/f8c x:0 0 0 2024-05-09T06:29:32.480 INFO:tasks.workunit.client.1.smithi079.stdout:6/295: dwrite d0/d6/d1b/f50 [0,4194304] 0 2024-05-09T06:29:32.480 INFO:tasks.workunit.client.1.smithi079.stdout:9/515: dwrite d1/f9f [0,4194304] 0 2024-05-09T06:29:32.480 INFO:tasks.workunit.client.1.smithi079.stdout:9/516: stat d1/d33/d28/d36/d38/d3a/l8c 0 2024-05-09T06:29:32.481 INFO:tasks.workunit.client.1.smithi079.stdout:1/370: write d0/d7/f3b [270651,117881] 0 2024-05-09T06:29:32.483 INFO:tasks.workunit.client.1.smithi079.stdout:3/341: dwrite fb [0,4194304] 0 2024-05-09T06:29:32.483 INFO:tasks.workunit.client.1.smithi079.stdout:3/342: fdatasync d1a/f3d 0 2024-05-09T06:29:32.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/368: dwrite d8/db/d4b/d4f/d51/d6f/f7b [0,4194304] 0 2024-05-09T06:29:32.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/369: chown d8/db/c22 5295 1 2024-05-09T06:29:32.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/370: read - d8/db/d4b/f68 zero size 2024-05-09T06:29:32.494 INFO:tasks.workunit.client.1.smithi079.stdout:1/371: write d0/f58 [108418,125209] 0 2024-05-09T06:29:32.497 INFO:tasks.workunit.client.1.smithi079.stdout:6/296: creat d0/de/f59 x:0 0 0 2024-05-09T06:29:32.506 INFO:tasks.workunit.client.1.smithi079.stdout:5/372: dwrite d13/d4f/f78 [0,4194304] 0 2024-05-09T06:29:32.507 INFO:tasks.workunit.client.1.smithi079.stdout:5/373: write d13/d43/f20 [1320880,1640] 0 2024-05-09T06:29:32.509 INFO:tasks.workunit.client.1.smithi079.stdout:3/343: dwrite d1a/d1d/d34/d42/f50 [0,4194304] 0 2024-05-09T06:29:32.509 INFO:tasks.workunit.client.1.smithi079.stdout:9/517: dwrite d1/d33/f37 [0,4194304] 0 2024-05-09T06:29:32.514 INFO:tasks.workunit.client.1.smithi079.stdout:2/371: symlink d8/db/d4b/d4f/d51/d6d/l8c 0 2024-05-09T06:29:32.515 INFO:tasks.workunit.client.1.smithi079.stdout:5/374: read d13/f19 [1276940,127802] 0 2024-05-09T06:29:32.515 INFO:tasks.workunit.client.1.smithi079.stdout:5/375: write d13/d43/d3d/d40/f6c [240777,54907] 0 2024-05-09T06:29:32.520 INFO:tasks.workunit.client.1.smithi079.stdout:6/297: creat d0/d6/d1b/d20/f5a x:0 0 0 2024-05-09T06:29:32.528 INFO:tasks.workunit.client.1.smithi079.stdout:3/344: link d1a/d1c/d22/l25 d1a/d1d/d34/d59/l6e 0 2024-05-09T06:29:32.534 INFO:tasks.workunit.client.1.smithi079.stdout:9/518: unlink d1/d5/f8d 0 2024-05-09T06:29:32.535 INFO:tasks.workunit.client.1.smithi079.stdout:5/376: dwrite d13/d43/d39/d61/f76 [0,4194304] 0 2024-05-09T06:29:32.536 INFO:tasks.workunit.client.1.smithi079.stdout:2/372: creat d8/db/dc/f8d x:0 0 0 2024-05-09T06:29:32.536 INFO:tasks.workunit.client.1.smithi079.stdout:6/298: dwrite d0/d6/d16/d28/f46 [0,4194304] 0 2024-05-09T06:29:32.539 INFO:tasks.workunit.client.1.smithi079.stdout:1/372: rename d0/d12/d48/d75/d43/d20/d39/l51 to d0/d7/d4e/d7d/l88 0 2024-05-09T06:29:32.539 INFO:tasks.workunit.client.1.smithi079.stdout:1/373: write d0/d12/d48/d75/d43/f46 [421689,114169] 0 2024-05-09T06:29:32.540 INFO:tasks.workunit.client.1.smithi079.stdout:3/345: mknod d1a/d1c/c6f 0 2024-05-09T06:29:32.540 INFO:tasks.workunit.client.1.smithi079.stdout:3/346: readlink d1a/d1c/l20 0 2024-05-09T06:29:32.542 INFO:tasks.workunit.client.1.smithi079.stdout:5/377: mknod d13/d43/d82/c8d 0 2024-05-09T06:29:32.542 INFO:tasks.workunit.client.1.smithi079.stdout:5/378: dread - d13/d43/d3d/f7a zero size 2024-05-09T06:29:32.547 INFO:tasks.workunit.client.1.smithi079.stdout:6/299: link d0/de/f1e d0/f5b 0 2024-05-09T06:29:32.548 INFO:tasks.workunit.client.1.smithi079.stdout:1/374: mkdir d0/d6e/d89 0 2024-05-09T06:29:32.550 INFO:tasks.workunit.client.1.smithi079.stdout:5/379: mkdir d13/d43/d8e 0 2024-05-09T06:29:32.551 INFO:tasks.workunit.client.1.smithi079.stdout:2/373: dwrite d8/db/dc/f56 [0,4194304] 0 2024-05-09T06:29:32.551 INFO:tasks.workunit.client.1.smithi079.stdout:6/300: mknod d0/d6/d16/c5c 0 2024-05-09T06:29:32.552 INFO:tasks.workunit.client.1.smithi079.stdout:3/347: dread f16 [0,4194304] 0 2024-05-09T06:29:32.552 INFO:tasks.workunit.client.1.smithi079.stdout:3/348: creat d1a/d21/f70 x:0 0 0 2024-05-09T06:29:32.552 INFO:tasks.workunit.client.1.smithi079.stdout:3/349: write d1a/d1d/f2f [316085,12788] 0 2024-05-09T06:29:32.553 INFO:tasks.workunit.client.1.smithi079.stdout:5/380: dread d13/d43/d26/d35/f5e [0,4194304] 0 2024-05-09T06:29:32.553 INFO:tasks.workunit.client.1.smithi079.stdout:5/381: chown d13/f1e 201523 1 2024-05-09T06:29:32.553 INFO:tasks.workunit.client.1.smithi079.stdout:5/382: fdatasync d13/d43/f25 0 2024-05-09T06:29:32.557 INFO:tasks.workunit.client.1.smithi079.stdout:2/374: readlink d8/db/d4b/d4f/l41 0 2024-05-09T06:29:32.562 INFO:tasks.workunit.client.1.smithi079.stdout:5/383: mknod d13/d43/d3d/d40/c8f 0 2024-05-09T06:29:32.563 INFO:tasks.workunit.client.1.smithi079.stdout:5/384: read - d13/d43/d39/f86 zero size 2024-05-09T06:29:32.563 INFO:tasks.workunit.client.1.smithi079.stdout:2/375: creat d8/db/d11/f8e x:0 0 0 2024-05-09T06:29:32.566 INFO:tasks.workunit.client.1.smithi079.stdout:2/376: dread d8/db/d11/f3d [0,4194304] 0 2024-05-09T06:29:32.567 INFO:tasks.workunit.client.1.smithi079.stdout:2/377: chown d8/db/dc/d2c/d2e/f54 21859 1 2024-05-09T06:29:32.567 INFO:tasks.workunit.client.1.smithi079.stdout:2/378: chown d8/db/d11/d5f/f76 2 1 2024-05-09T06:29:32.569 INFO:tasks.workunit.client.1.smithi079.stdout:2/379: creat d8/db/d59/d67/d86/f8f x:0 0 0 2024-05-09T06:29:32.570 INFO:tasks.workunit.client.1.smithi079.stdout:3/350: dwrite d1a/f3d [0,4194304] 0 2024-05-09T06:29:32.570 INFO:tasks.workunit.client.1.smithi079.stdout:3/351: chown d1a/d1c/d1f/f4d 16877460 1 2024-05-09T06:29:32.571 INFO:tasks.workunit.client.1.smithi079.stdout:2/380: creat d8/db/d4b/d4f/f90 x:0 0 0 2024-05-09T06:29:32.571 INFO:tasks.workunit.client.1.smithi079.stdout:2/381: chown d8/db/dc/le 726 1 2024-05-09T06:29:32.575 INFO:tasks.workunit.client.1.smithi079.stdout:3/352: mknod d1a/d1d/d3a/c71 0 2024-05-09T06:29:32.575 INFO:tasks.workunit.client.1.smithi079.stdout:3/353: write d1a/d1d/f41 [113355,38658] 0 2024-05-09T06:29:32.575 INFO:tasks.workunit.client.1.smithi079.stdout:3/354: fdatasync d1a/d1d/d34/d42/f50 0 2024-05-09T06:29:32.577 INFO:tasks.workunit.client.1.smithi079.stdout:6/301: dwrite d0/d6/d1b/f3d [0,4194304] 0 2024-05-09T06:29:32.577 INFO:tasks.workunit.client.1.smithi079.stdout:3/355: unlink fe 0 2024-05-09T06:29:32.581 INFO:tasks.workunit.client.1.smithi079.stdout:3/356: symlink d1a/d1c/d1f/l72 0 2024-05-09T06:29:32.583 INFO:tasks.workunit.client.1.smithi079.stdout:2/382: read d8/f9 [2959303,16771] 0 2024-05-09T06:29:32.585 INFO:tasks.workunit.client.1.smithi079.stdout:3/357: symlink d1a/d1d/d34/l73 0 2024-05-09T06:29:32.590 INFO:tasks.workunit.client.1.smithi079.stdout:3/358: link d1a/f35 d1a/d1d/d34/d59/f74 0 2024-05-09T06:29:32.590 INFO:tasks.workunit.client.1.smithi079.stdout:3/359: dread - d1a/d21/f40 zero size 2024-05-09T06:29:32.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:32 smithi079 ceph-mon[35268]: pgmap v245: 65 pgs: 65 active+clean; 503 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 17 MiB/s rd, 25 MiB/s wr, 638 op/s 2024-05-09T06:29:32.594 INFO:tasks.workunit.client.1.smithi079.stdout:6/302: getdents d0/d6/d1b/d20 0 2024-05-09T06:29:32.596 INFO:tasks.workunit.client.1.smithi079.stdout:6/303: write d0/de/f35 [454662,1355] 0 2024-05-09T06:29:32.596 INFO:tasks.workunit.client.1.smithi079.stdout:6/304: chown d0/de/f48 89 1 2024-05-09T06:29:32.596 INFO:tasks.workunit.client.1.smithi079.stdout:6/305: fdatasync d0/fc 0 2024-05-09T06:29:32.596 INFO:tasks.workunit.client.1.smithi079.stdout:5/385: truncate d13/d43/d26/f57 1817999 0 2024-05-09T06:29:32.600 INFO:tasks.workunit.client.1.smithi079.stdout:6/306: mknod d0/d6/d16/d1f/d36/c5d 0 2024-05-09T06:29:32.608 INFO:tasks.workunit.client.1.smithi079.stdout:2/383: dwrite d8/d3c/f80 [0,4194304] 0 2024-05-09T06:29:32.608 INFO:tasks.workunit.client.1.smithi079.stdout:5/386: dread d13/d43/f2f [0,4194304] 0 2024-05-09T06:29:32.609 INFO:tasks.workunit.client.1.smithi079.stdout:5/387: creat d13/d43/d3d/f90 x:0 0 0 2024-05-09T06:29:32.614 INFO:tasks.workunit.client.1.smithi079.stdout:3/360: dread d1a/d1d/d34/d42/f47 [0,4194304] 0 2024-05-09T06:29:32.614 INFO:tasks.workunit.client.1.smithi079.stdout:3/361: read - d1a/d1d/d34/f4f zero size 2024-05-09T06:29:32.616 INFO:tasks.workunit.client.1.smithi079.stdout:2/384: rename d8/f10 to d8/db/d4b/d4f/d51/d6f/f91 0 2024-05-09T06:29:32.619 INFO:tasks.workunit.client.1.smithi079.stdout:5/388: symlink d13/d4f/l91 0 2024-05-09T06:29:32.619 INFO:tasks.workunit.client.1.smithi079.stdout:5/389: chown d13/d43/f36 425417257 1 2024-05-09T06:29:32.619 INFO:tasks.workunit.client.1.smithi079.stdout:5/390: chown d13/d43/d26/f57 34473418 1 2024-05-09T06:29:32.620 INFO:tasks.workunit.client.1.smithi079.stdout:2/385: dread d8/db/d11/f72 [0,4194304] 0 2024-05-09T06:29:32.620 INFO:tasks.workunit.client.1.smithi079.stdout:2/386: write d8/db/d11/f3f [782697,64266] 0 2024-05-09T06:29:32.621 INFO:tasks.workunit.client.1.smithi079.stdout:6/307: dwrite d0/d6/d16/f3b [0,4194304] 0 2024-05-09T06:29:32.621 INFO:tasks.workunit.client.1.smithi079.stdout:5/391: truncate d13/d4f/f78 1161287 0 2024-05-09T06:29:32.623 INFO:tasks.workunit.client.1.smithi079.stdout:2/387: mknod d8/db/d5c/c92 0 2024-05-09T06:29:32.628 INFO:tasks.workunit.client.1.smithi079.stdout:6/308: mkdir d0/d6/d5e 0 2024-05-09T06:29:32.630 INFO:tasks.workunit.client.1.smithi079.stdout:3/362: dwrite d1a/d1d/d3a/f46 [0,4194304] 0 2024-05-09T06:29:32.630 INFO:tasks.workunit.client.1.smithi079.stdout:3/363: fdatasync d1a/f3d 0 2024-05-09T06:29:32.630 INFO:tasks.workunit.client.1.smithi079.stdout:3/364: truncate d1a/d1d/d34/f4f 674846 0 2024-05-09T06:29:32.630 INFO:tasks.workunit.client.1.smithi079.stdout:6/309: dread d0/d6/d16/d1f/f49 [0,4194304] 0 2024-05-09T06:29:32.630 INFO:tasks.workunit.client.1.smithi079.stdout:2/388: mkdir d8/db/d59/d93 0 2024-05-09T06:29:32.631 INFO:tasks.workunit.client.1.smithi079.stdout:2/389: truncate d8/db/d4b/d4f/d51/d6d/f74 69713 0 2024-05-09T06:29:32.631 INFO:tasks.workunit.client.1.smithi079.stdout:2/390: write d8/db/d4b/d4f/f90 [966210,63883] 0 2024-05-09T06:29:32.631 INFO:tasks.workunit.client.1.smithi079.stdout:6/310: dread d0/d6/d16/d28/f58 [0,4194304] 0 2024-05-09T06:29:32.644 INFO:tasks.workunit.client.1.smithi079.stdout:2/391: mknod d8/db/dc/d2c/d78/c94 0 2024-05-09T06:29:32.646 INFO:tasks.workunit.client.1.smithi079.stdout:5/392: dwrite d13/f18 [0,4194304] 0 2024-05-09T06:29:32.646 INFO:tasks.workunit.client.1.smithi079.stdout:5/393: stat fc 0 2024-05-09T06:29:32.649 INFO:tasks.workunit.client.1.smithi079.stdout:5/394: mkdir d13/d92 0 2024-05-09T06:29:32.649 INFO:tasks.workunit.client.1.smithi079.stdout:5/395: getdents d13/d92 0 2024-05-09T06:29:32.649 INFO:tasks.workunit.client.1.smithi079.stdout:5/396: stat ce 0 2024-05-09T06:29:32.651 INFO:tasks.workunit.client.1.smithi079.stdout:2/392: rename d8/db/d4b/d4f/c3a to d8/db/dc/c95 0 2024-05-09T06:29:32.653 INFO:tasks.workunit.client.1.smithi079.stdout:3/365: dwrite d1a/d1c/d1f/f4d [0,4194304] 0 2024-05-09T06:29:32.653 INFO:tasks.workunit.client.1.smithi079.stdout:6/311: dwrite d0/de/f59 [0,4194304] 0 2024-05-09T06:29:32.653 INFO:tasks.workunit.client.1.smithi079.stdout:6/312: creat d0/de/f5f x:0 0 0 2024-05-09T06:29:32.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:32 smithi062 ceph-mon[26920]: pgmap v245: 65 pgs: 65 active+clean; 503 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 17 MiB/s rd, 25 MiB/s wr, 638 op/s 2024-05-09T06:29:32.666 INFO:tasks.workunit.client.1.smithi079.stdout:3/366: stat d1a/d1d/d3a/d54/c57 0 2024-05-09T06:29:32.669 INFO:tasks.workunit.client.1.smithi079.stdout:5/397: dwrite d13/d43/d3d/d40/d63/f7b [0,4194304] 0 2024-05-09T06:29:32.669 INFO:tasks.workunit.client.1.smithi079.stdout:2/393: dwrite d8/db/d11/f8e [0,4194304] 0 2024-05-09T06:29:32.669 INFO:tasks.workunit.client.1.smithi079.stdout:6/313: rmdir d0/d6/d1b/d2d 39 2024-05-09T06:29:32.674 INFO:tasks.workunit.client.1.smithi079.stdout:3/367: unlink d1a/d1c/d22/f36 0 2024-05-09T06:29:32.674 INFO:tasks.workunit.client.1.smithi079.stdout:4/420: sync 2024-05-09T06:29:32.682 INFO:tasks.workunit.client.1.smithi079.stdout:6/314: dwrite d0/d6/d1b/d20/f5a [0,4194304] 0 2024-05-09T06:29:32.685 INFO:tasks.workunit.client.1.smithi079.stdout:4/421: unlink d6/d8/f50 0 2024-05-09T06:29:32.687 INFO:tasks.workunit.client.1.smithi079.stdout:5/398: getdents d13/d43/d39/d61 0 2024-05-09T06:29:32.687 INFO:tasks.workunit.client.1.smithi079.stdout:5/399: fsync d13/d43/d39/d61/f76 0 2024-05-09T06:29:32.689 INFO:tasks.workunit.client.1.smithi079.stdout:5/400: dread d13/d2a/f7e [0,4194304] 0 2024-05-09T06:29:32.693 INFO:tasks.workunit.client.1.smithi079.stdout:4/422: write d6/fa [2910433,1557] 0 2024-05-09T06:29:32.694 INFO:tasks.workunit.client.1.smithi079.stdout:5/401: mknod d13/d4d/c93 0 2024-05-09T06:29:32.694 INFO:tasks.workunit.client.1.smithi079.stdout:5/402: chown d13/d2a/f7e 36916313 1 2024-05-09T06:29:32.698 INFO:tasks.workunit.client.1.smithi079.stdout:5/403: creat d13/d43/d39/d61/f94 x:0 0 0 2024-05-09T06:29:32.699 INFO:tasks.workunit.client.1.smithi079.stdout:4/423: rmdir d6/d1a/d41 39 2024-05-09T06:29:32.702 INFO:tasks.workunit.client.1.smithi079.stdout:4/424: mknod d6/d8/d27/d3d/c7b 0 2024-05-09T06:29:32.704 INFO:tasks.workunit.client.1.smithi079.stdout:6/315: dwrite d0/d6/f14 [4194304,4194304] 0 2024-05-09T06:29:32.705 INFO:tasks.workunit.client.1.smithi079.stdout:2/394: dwrite d8/db/d4b/d4f/f36 [0,4194304] 0 2024-05-09T06:29:32.706 INFO:tasks.workunit.client.1.smithi079.stdout:4/425: creat d6/d8/d55/f7c x:0 0 0 2024-05-09T06:29:32.706 INFO:tasks.workunit.client.1.smithi079.stdout:4/426: chown d6/d8/d27/f2e 992835 1 2024-05-09T06:29:32.706 INFO:tasks.workunit.client.1.smithi079.stdout:4/427: readlink d6/dd/d34/l3a 0 2024-05-09T06:29:32.707 INFO:tasks.workunit.client.1.smithi079.stdout:4/428: dread d6/d1a/d26/d2a/d54/d59/f6d [0,4194304] 0 2024-05-09T06:29:32.710 INFO:tasks.workunit.client.1.smithi079.stdout:6/316: mkdir d0/d60 0 2024-05-09T06:29:32.710 INFO:tasks.workunit.client.1.smithi079.stdout:6/317: fsync d0/d6/d1b/f3d 0 2024-05-09T06:29:32.710 INFO:tasks.workunit.client.1.smithi079.stdout:6/318: stat d0/d6/f4d 0 2024-05-09T06:29:32.713 INFO:tasks.workunit.client.1.smithi079.stdout:4/429: symlink d6/d15/l7d 0 2024-05-09T06:29:32.715 INFO:tasks.workunit.client.1.smithi079.stdout:6/319: mknod d0/d6/d1b/d20/c61 0 2024-05-09T06:29:32.715 INFO:tasks.workunit.client.1.smithi079.stdout:6/320: chown d0/d6/d1b/d20/l2c 12809 1 2024-05-09T06:29:32.716 INFO:tasks.workunit.client.1.smithi079.stdout:6/321: read - d0/d6/d1b/d2d/f44 zero size 2024-05-09T06:29:32.716 INFO:tasks.workunit.client.1.smithi079.stdout:6/322: creat d0/d6/d1b/f62 x:0 0 0 2024-05-09T06:29:32.716 INFO:tasks.workunit.client.1.smithi079.stdout:4/430: symlink d6/d1a/l7e 0 2024-05-09T06:29:32.721 INFO:tasks.workunit.client.1.smithi079.stdout:8/313: sync 2024-05-09T06:29:32.721 INFO:tasks.workunit.client.1.smithi079.stdout:0/317: sync 2024-05-09T06:29:32.721 INFO:tasks.workunit.client.1.smithi079.stdout:0/318: fdatasync d3/dd/d1f/d1e/f42 0 2024-05-09T06:29:32.721 INFO:tasks.workunit.client.1.smithi079.stdout:7/373: sync 2024-05-09T06:29:32.721 INFO:tasks.workunit.client.1.smithi079.stdout:9/519: sync 2024-05-09T06:29:32.721 INFO:tasks.workunit.client.1.smithi079.stdout:0/319: read d3/d5/f21 [2459188,45950] 0 2024-05-09T06:29:32.722 INFO:tasks.workunit.client.1.smithi079.stdout:6/323: truncate d0/f5b 2435402 0 2024-05-09T06:29:32.725 INFO:tasks.workunit.client.1.smithi079.stdout:8/314: mknod d1/d3/d20/d22/d50/d61/d66/c73 0 2024-05-09T06:29:32.726 INFO:tasks.workunit.client.1.smithi079.stdout:4/431: dread d6/d8/d27/f46 [0,4194304] 0 2024-05-09T06:29:32.726 INFO:tasks.workunit.client.1.smithi079.stdout:8/315: symlink d1/d3/d20/d29/d33/l74 0 2024-05-09T06:29:32.726 INFO:tasks.workunit.client.1.smithi079.stdout:8/316: readlink d1/ld 0 2024-05-09T06:29:32.727 INFO:tasks.workunit.client.1.smithi079.stdout:8/317: dread - d1/d3/f4d zero size 2024-05-09T06:29:32.727 INFO:tasks.workunit.client.1.smithi079.stdout:5/404: dwrite d13/f5a [0,4194304] 0 2024-05-09T06:29:32.727 INFO:tasks.workunit.client.1.smithi079.stdout:5/405: fsync d13/d2a/f4e 0 2024-05-09T06:29:32.728 INFO:tasks.workunit.client.1.smithi079.stdout:4/432: symlink d6/d1a/d41/d68/d6b/l7f 0 2024-05-09T06:29:32.728 INFO:tasks.workunit.client.1.smithi079.stdout:2/395: dwrite d8/db/d4b/f85 [0,4194304] 0 2024-05-09T06:29:32.730 INFO:tasks.workunit.client.1.smithi079.stdout:8/318: mknod d1/d3/d20/d22/d3b/c75 0 2024-05-09T06:29:32.730 INFO:tasks.workunit.client.1.smithi079.stdout:8/319: chown d1/d3/f4 231 1 2024-05-09T06:29:32.730 INFO:tasks.workunit.client.1.smithi079.stdout:1/375: sync 2024-05-09T06:29:32.731 INFO:tasks.workunit.client.1.smithi079.stdout:1/376: write d0/f5 [1161275,50706] 0 2024-05-09T06:29:32.736 INFO:tasks.workunit.client.1.smithi079.stdout:5/406: link l8 d13/d43/d26/l95 0 2024-05-09T06:29:32.736 INFO:tasks.workunit.client.1.smithi079.stdout:5/407: write d13/d43/d26/d35/f56 [1485219,64034] 0 2024-05-09T06:29:32.744 INFO:tasks.workunit.client.1.smithi079.stdout:3/368: unlink d1a/d1d/d34/f38 0 2024-05-09T06:29:32.744 INFO:tasks.workunit.client.1.smithi079.stdout:3/369: creat d1a/d1c/d1f/f75 x:0 0 0 2024-05-09T06:29:32.744 INFO:tasks.workunit.client.1.smithi079.stdout:3/370: write d1a/d1c/d1f/f75 [756049,120186] 0 2024-05-09T06:29:32.746 INFO:tasks.workunit.client.1.smithi079.stdout:8/320: truncate d1/db/f4a 2125174 0 2024-05-09T06:29:32.746 INFO:tasks.workunit.client.1.smithi079.stdout:8/321: stat d1/d3/d20/d22/l48 0 2024-05-09T06:29:32.748 INFO:tasks.workunit.client.1.smithi079.stdout:1/377: mkdir d0/d6e/d8a 0 2024-05-09T06:29:32.748 INFO:tasks.workunit.client.1.smithi079.stdout:1/378: chown d0/d12/d16/c33 60955298 1 2024-05-09T06:29:32.750 INFO:tasks.workunit.client.1.smithi079.stdout:5/408: mknod d13/d43/d82/d8b/c96 0 2024-05-09T06:29:32.753 INFO:tasks.workunit.client.1.smithi079.stdout:3/371: mkdir d1a/d1c/d1f/d76 0 2024-05-09T06:29:32.754 INFO:tasks.workunit.client.1.smithi079.stdout:4/433: getdents d6/d8 0 2024-05-09T06:29:32.754 INFO:tasks.workunit.client.1.smithi079.stdout:6/324: dwrite d0/d6/d16/f3b [0,4194304] 0 2024-05-09T06:29:32.755 INFO:tasks.workunit.client.1.smithi079.stdout:9/520: dwrite d1/d33/d28/d36/d4d/d7d/f14 [0,4194304] 0 2024-05-09T06:29:32.757 INFO:tasks.workunit.client.1.smithi079.stdout:9/521: write d1/d33/d28/d36/d4d/d7d/d19/fa3 [1576947,12351] 0 2024-05-09T06:29:32.757 INFO:tasks.workunit.client.1.smithi079.stdout:8/322: mknod d1/d3/d20/d22/d50/d61/d66/d6c/c76 0 2024-05-09T06:29:32.759 INFO:tasks.workunit.client.1.smithi079.stdout:1/379: rename d0/d12/d48/d75/d43/f46 to d0/d12/f8b 0 2024-05-09T06:29:32.762 INFO:tasks.workunit.client.1.smithi079.stdout:4/434: mkdir d6/d8/d80 0 2024-05-09T06:29:32.764 INFO:tasks.workunit.client.1.smithi079.stdout:6/325: creat d0/d6/d5e/f63 x:0 0 0 2024-05-09T06:29:32.768 INFO:tasks.workunit.client.1.smithi079.stdout:8/323: truncate d1/d3/d20/d29/f45 2191248 0 2024-05-09T06:29:32.771 INFO:tasks.workunit.client.1.smithi079.stdout:1/380: mknod d0/d12/c8c 0 2024-05-09T06:29:32.773 INFO:tasks.workunit.client.1.smithi079.stdout:4/435: rename d6/d1a/d26/d2a/d54/d59/f6d to d6/d1a/d41/d68/d6b/f81 0 2024-05-09T06:29:32.774 INFO:tasks.workunit.client.1.smithi079.stdout:1/381: truncate d0/d12/d48/d75/d43/d20/f5f 252648 0 2024-05-09T06:29:32.774 INFO:tasks.workunit.client.1.smithi079.stdout:1/382: fdatasync d0/d12/d48/d75/d26/f55 0 2024-05-09T06:29:32.776 INFO:tasks.workunit.client.1.smithi079.stdout:8/324: rename d1/d3/l16 to d1/d3/d20/d22/d3f/l77 0 2024-05-09T06:29:32.776 INFO:tasks.workunit.client.1.smithi079.stdout:8/325: creat d1/db/f78 x:0 0 0 2024-05-09T06:29:32.777 INFO:tasks.workunit.client.1.smithi079.stdout:1/383: dread d0/d12/d48/d75/f69 [0,4194304] 0 2024-05-09T06:29:32.777 INFO:tasks.workunit.client.1.smithi079.stdout:1/384: truncate d0/d12/d67/d53/f7a 355299 0 2024-05-09T06:29:32.777 INFO:tasks.workunit.client.1.smithi079.stdout:1/385: creat d0/d7/f8d x:0 0 0 2024-05-09T06:29:32.777 INFO:tasks.workunit.client.1.smithi079.stdout:1/386: write d0/d7/d4e/f5d [772947,66586] 0 2024-05-09T06:29:32.777 INFO:tasks.workunit.client.1.smithi079.stdout:4/436: creat d6/d1a/d26/d2a/d54/d59/f82 x:0 0 0 2024-05-09T06:29:32.780 INFO:tasks.workunit.client.1.smithi079.stdout:4/437: unlink d6/dd/df/c39 0 2024-05-09T06:29:32.781 INFO:tasks.workunit.client.1.smithi079.stdout:4/438: chown d6/d1a/d26/d2a/f2d 0 1 2024-05-09T06:29:32.784 INFO:tasks.workunit.client.1.smithi079.stdout:4/439: dread d6/d1a/d26/d2a/d54/f17 [0,4194304] 0 2024-05-09T06:29:32.785 INFO:tasks.workunit.client.1.smithi079.stdout:4/440: chown d6/d1a/d41/f73 19333 1 2024-05-09T06:29:32.785 INFO:tasks.workunit.client.1.smithi079.stdout:4/441: write d6/dd/f4e [4870655,130805] 0 2024-05-09T06:29:32.787 INFO:tasks.workunit.client.1.smithi079.stdout:8/326: write d1/f8 [2131387,113342] 0 2024-05-09T06:29:32.787 INFO:tasks.workunit.client.1.smithi079.stdout:6/326: dwrite d0/d6/d16/f30 [0,4194304] 0 2024-05-09T06:29:32.788 INFO:tasks.workunit.client.1.smithi079.stdout:4/442: creat d6/d8/f83 x:0 0 0 2024-05-09T06:29:32.790 INFO:tasks.workunit.client.1.smithi079.stdout:6/327: mkdir d0/d6/d16/d28/d64 0 2024-05-09T06:29:32.790 INFO:tasks.workunit.client.1.smithi079.stdout:6/328: truncate d0/de/f48 856011 0 2024-05-09T06:29:32.791 INFO:tasks.workunit.client.1.smithi079.stdout:4/443: mknod d6/d1a/d41/c84 0 2024-05-09T06:29:32.791 INFO:tasks.workunit.client.1.smithi079.stdout:4/444: truncate d6/d8/f83 254500 0 2024-05-09T06:29:32.791 INFO:tasks.workunit.client.1.smithi079.stdout:4/445: dread - d6/d1a/d26/d2a/d54/d59/f82 zero size 2024-05-09T06:29:32.792 INFO:tasks.workunit.client.1.smithi079.stdout:6/329: rename d0/d6/d1b/d2d/f44 to d0/f65 0 2024-05-09T06:29:32.795 INFO:tasks.workunit.client.1.smithi079.stdout:6/330: truncate d0/d6/d1b/d20/f2f 781817 0 2024-05-09T06:29:32.798 INFO:tasks.workunit.client.1.smithi079.stdout:4/446: creat d6/d8/d27/f85 x:0 0 0 2024-05-09T06:29:32.798 INFO:tasks.workunit.client.1.smithi079.stdout:4/447: write d6/f33 [173113,24042] 0 2024-05-09T06:29:32.798 INFO:tasks.workunit.client.1.smithi079.stdout:4/448: creat d6/d1a/d26/d2a/d54/d59/f86 x:0 0 0 2024-05-09T06:29:32.798 INFO:tasks.workunit.client.1.smithi079.stdout:4/449: dread - d6/d8/d27/d62/f40 zero size 2024-05-09T06:29:32.799 INFO:tasks.workunit.client.1.smithi079.stdout:2/396: dwrite d8/db/d11/d5f/f75 [0,4194304] 0 2024-05-09T06:29:32.801 INFO:tasks.workunit.client.1.smithi079.stdout:6/331: rename d0/d6/d16/d1f/c37 to d0/d6/d16/d1f/d36/c66 0 2024-05-09T06:29:32.801 INFO:tasks.workunit.client.1.smithi079.stdout:8/327: dread d1/d3/d20/d22/d3b/f52 [0,4194304] 0 2024-05-09T06:29:32.804 INFO:tasks.workunit.client.1.smithi079.stdout:5/409: dread d13/f18 [0,4194304] 0 2024-05-09T06:29:32.804 INFO:tasks.workunit.client.1.smithi079.stdout:5/410: creat d13/d4f/f97 x:0 0 0 2024-05-09T06:29:32.804 INFO:tasks.workunit.client.1.smithi079.stdout:4/450: link d6/d1a/d26/d2a/f72 d6/d8/d27/d3d/d5b/f87 0 2024-05-09T06:29:32.806 INFO:tasks.workunit.client.1.smithi079.stdout:2/397: creat d8/db/d4b/d4f/d51/d6d/f96 x:0 0 0 2024-05-09T06:29:32.807 INFO:tasks.workunit.client.1.smithi079.stdout:6/332: rename d0/f19 to d0/d6/d16/d28/f67 0 2024-05-09T06:29:32.808 INFO:tasks.workunit.client.1.smithi079.stdout:8/328: symlink d1/d3/d20/d22/d3b/l79 0 2024-05-09T06:29:32.810 INFO:tasks.workunit.client.1.smithi079.stdout:4/451: mknod d6/d1a/d26/c88 0 2024-05-09T06:29:32.811 INFO:tasks.workunit.client.1.smithi079.stdout:6/333: rmdir d0/d6 39 2024-05-09T06:29:32.812 INFO:tasks.workunit.client.1.smithi079.stdout:9/522: dread d1/d33/f87 [0,4194304] 0 2024-05-09T06:29:32.813 INFO:tasks.workunit.client.1.smithi079.stdout:8/329: dread d1/db/f30 [0,4194304] 0 2024-05-09T06:29:32.813 INFO:tasks.workunit.client.1.smithi079.stdout:8/330: write d1/d3/d20/d29/d33/f53 [1066426,75946] 0 2024-05-09T06:29:32.813 INFO:tasks.workunit.client.1.smithi079.stdout:4/452: symlink d6/d1a/d41/l89 0 2024-05-09T06:29:32.815 INFO:tasks.workunit.client.1.smithi079.stdout:6/334: unlink d0/l1d 0 2024-05-09T06:29:32.816 INFO:tasks.workunit.client.1.smithi079.stdout:2/398: write d8/db/d4b/f85 [313527,69823] 0 2024-05-09T06:29:32.816 INFO:tasks.workunit.client.1.smithi079.stdout:2/399: write d8/db/d4b/d4f/d51/d6d/f74 [248210,79723] 0 2024-05-09T06:29:32.816 INFO:tasks.workunit.client.1.smithi079.stdout:9/523: truncate d1/d33/f87 3015816 0 2024-05-09T06:29:32.817 INFO:tasks.workunit.client.1.smithi079.stdout:5/411: write d13/f1e [3560294,96035] 0 2024-05-09T06:29:32.818 INFO:tasks.workunit.client.1.smithi079.stdout:1/387: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:29:32.819 INFO:tasks.workunit.client.1.smithi079.stdout:1/388: fsync d0/d12/d16/f50 0 2024-05-09T06:29:32.819 INFO:tasks.workunit.client.1.smithi079.stdout:3/372: dwrite d1a/d21/f70 [0,4194304] 0 2024-05-09T06:29:32.820 INFO:tasks.workunit.client.1.smithi079.stdout:8/331: mkdir d1/d3/d20/d22/d50/d61/d66/d6c/d6b/d7a 0 2024-05-09T06:29:32.820 INFO:tasks.workunit.client.1.smithi079.stdout:8/332: readlink d1/d3/d20/d22/d3b/l43 0 2024-05-09T06:29:32.821 INFO:tasks.workunit.client.1.smithi079.stdout:9/524: dread d1/d33/d28/d36/d4d/d7d/d19/fa3 [0,4194304] 0 2024-05-09T06:29:32.822 INFO:tasks.workunit.client.1.smithi079.stdout:4/453: truncate d6/dd/df/f21 8020447 0 2024-05-09T06:29:32.822 INFO:tasks.workunit.client.1.smithi079.stdout:4/454: write d6/d8/d27/f85 [559681,107182] 0 2024-05-09T06:29:32.825 INFO:tasks.workunit.client.1.smithi079.stdout:6/335: mknod d0/d6/d16/c68 0 2024-05-09T06:29:32.829 INFO:tasks.workunit.client.1.smithi079.stdout:4/455: dread d6/d8/d27/f85 [0,4194304] 0 2024-05-09T06:29:32.829 INFO:tasks.workunit.client.1.smithi079.stdout:4/456: creat d6/d1a/d26/d2a/d54/d59/f8a x:0 0 0 2024-05-09T06:29:32.829 INFO:tasks.workunit.client.1.smithi079.stdout:4/457: write d6/d8/d27/d3d/f64 [615970,124206] 0 2024-05-09T06:29:32.835 INFO:tasks.workunit.client.1.smithi079.stdout:2/400: mknod d8/db/d5c/d6b/c97 0 2024-05-09T06:29:32.835 INFO:tasks.workunit.client.1.smithi079.stdout:2/401: chown d8/db/d11/l14 2301583 1 2024-05-09T06:29:32.835 INFO:tasks.workunit.client.1.smithi079.stdout:5/412: creat d13/d4d/f98 x:0 0 0 2024-05-09T06:29:32.843 INFO:tasks.workunit.client.1.smithi079.stdout:3/373: dwrite fc [0,4194304] 0 2024-05-09T06:29:32.845 INFO:tasks.workunit.client.1.smithi079.stdout:5/413: dread d13/d2a/f2b [0,4194304] 0 2024-05-09T06:29:32.852 INFO:tasks.workunit.client.1.smithi079.stdout:3/374: read fa [3978142,14144] 0 2024-05-09T06:29:32.853 INFO:tasks.workunit.client.1.smithi079.stdout:3/375: dread f13 [0,4194304] 0 2024-05-09T06:29:32.863 INFO:tasks.workunit.client.1.smithi079.stdout:8/333: creat d1/d3/d20/f7b x:0 0 0 2024-05-09T06:29:32.863 INFO:tasks.workunit.client.1.smithi079.stdout:8/334: chown d1/d3/d20/d22/c5a 110583 1 2024-05-09T06:29:32.864 INFO:tasks.workunit.client.1.smithi079.stdout:9/525: symlink d1/d45/dab/laf 0 2024-05-09T06:29:32.866 INFO:tasks.workunit.client.1.smithi079.stdout:6/336: mkdir d0/d6/d16/d1f/d36/d69 0 2024-05-09T06:29:32.869 INFO:tasks.workunit.client.1.smithi079.stdout:4/458: mkdir d6/d1a/d26/d2a/d54/d59/d8b 0 2024-05-09T06:29:32.869 INFO:tasks.workunit.client.1.smithi079.stdout:4/459: chown d6/d8/d27/d3d 192766589 1 2024-05-09T06:29:32.871 INFO:tasks.workunit.client.1.smithi079.stdout:2/402: mknod d8/db/d4b/d4f/d51/d6d/c98 0 2024-05-09T06:29:32.876 INFO:tasks.workunit.client.1.smithi079.stdout:9/526: dwrite d1/d33/d28/d36/d4d/d7d/d19/f96 [0,4194304] 0 2024-05-09T06:29:32.878 INFO:tasks.workunit.client.1.smithi079.stdout:3/376: mknod d1a/d1c/c77 0 2024-05-09T06:29:32.878 INFO:tasks.workunit.client.1.smithi079.stdout:3/377: chown d1a/d21/f62 42 1 2024-05-09T06:29:32.879 INFO:tasks.workunit.client.1.smithi079.stdout:1/389: getdents d0/d12/d16 0 2024-05-09T06:29:32.879 INFO:tasks.workunit.client.1.smithi079.stdout:1/390: chown d0/d12/d67/d53/d6d/f80 175100629 1 2024-05-09T06:29:32.881 INFO:tasks.workunit.client.1.smithi079.stdout:8/335: rename d1/d3/d20/d22/d50/d61/d66/d6c/d6b/d7a to d1/d56/d7c 0 2024-05-09T06:29:32.883 INFO:tasks.workunit.client.1.smithi079.stdout:6/337: unlink d0/d6/d16/c40 0 2024-05-09T06:29:32.883 INFO:tasks.workunit.client.1.smithi079.stdout:6/338: creat d0/d6/d16/d28/f6a x:0 0 0 2024-05-09T06:29:32.885 INFO:tasks.workunit.client.1.smithi079.stdout:4/460: creat d6/d1a/d26/d2a/f8c x:0 0 0 2024-05-09T06:29:32.887 INFO:tasks.workunit.client.1.smithi079.stdout:2/403: symlink d8/db/d5c/l99 0 2024-05-09T06:29:32.890 INFO:tasks.workunit.client.1.smithi079.stdout:9/527: mkdir d1/d6/dae/db0 0 2024-05-09T06:29:32.893 INFO:tasks.workunit.client.1.smithi079.stdout:3/378: mknod d1a/d1c/d1f/d3f/c78 0 2024-05-09T06:29:32.893 INFO:tasks.workunit.client.1.smithi079.stdout:3/379: dread - f19 zero size 2024-05-09T06:29:32.895 INFO:tasks.workunit.client.1.smithi079.stdout:3/380: dread d1a/d1c/d1f/f75 [0,4194304] 0 2024-05-09T06:29:32.900 INFO:tasks.workunit.client.1.smithi079.stdout:8/336: unlink d1/d64/c68 0 2024-05-09T06:29:32.904 INFO:tasks.workunit.client.1.smithi079.stdout:6/339: link d0/d6/d1b/d2d/l2e d0/d6/d1b/l6b 0 2024-05-09T06:29:32.907 INFO:tasks.workunit.client.1.smithi079.stdout:4/461: mknod d6/d1a/d26/d2a/d54/c8d 0 2024-05-09T06:29:32.907 INFO:tasks.workunit.client.1.smithi079.stdout:4/462: truncate d6/d1a/d26/d2a/d54/f23 725732 0 2024-05-09T06:29:32.910 INFO:tasks.workunit.client.1.smithi079.stdout:2/404: unlink d8/db/dc/d2c/l61 0 2024-05-09T06:29:32.910 INFO:tasks.workunit.client.1.smithi079.stdout:2/405: creat d8/db/d4b/d4f/d51/d6f/f9a x:0 0 0 2024-05-09T06:29:32.910 INFO:tasks.workunit.client.1.smithi079.stdout:2/406: getdents d8/db/dc/d2c/d2e 0 2024-05-09T06:29:32.912 INFO:tasks.workunit.client.1.smithi079.stdout:1/391: dwrite d0/d12/d48/d75/d43/d20/d39/f42 [0,4194304] 0 2024-05-09T06:29:32.912 INFO:tasks.workunit.client.1.smithi079.stdout:1/392: write d0/d7/f9 [4916858,92076] 0 2024-05-09T06:29:32.912 INFO:tasks.workunit.client.1.smithi079.stdout:9/528: link d1/d5/d5b/f89 d1/d5/d91/fb1 0 2024-05-09T06:29:32.914 INFO:tasks.workunit.client.1.smithi079.stdout:3/381: fsync d1a/d1d/d34/d59/f60 0 2024-05-09T06:29:32.916 INFO:tasks.workunit.client.1.smithi079.stdout:8/337: rename d1/l63 to d1/d3/d20/d29/d33/l7d 0 2024-05-09T06:29:32.916 INFO:tasks.workunit.client.1.smithi079.stdout:8/338: fsync d1/d3/f4d 0 2024-05-09T06:29:32.918 INFO:tasks.workunit.client.1.smithi079.stdout:6/340: creat d0/d60/f6c x:0 0 0 2024-05-09T06:29:32.919 INFO:tasks.workunit.client.1.smithi079.stdout:6/341: write d0/d6/d1b/d20/f2b [219876,82283] 0 2024-05-09T06:29:32.919 INFO:tasks.workunit.client.1.smithi079.stdout:6/342: chown d0/d6/d16/d1f/d36/l39 234303332 1 2024-05-09T06:29:32.919 INFO:tasks.workunit.client.1.smithi079.stdout:6/343: fdatasync d0/de/f59 0 2024-05-09T06:29:32.919 INFO:tasks.workunit.client.1.smithi079.stdout:6/344: chown d0/de/f3a 95815 1 2024-05-09T06:29:32.920 INFO:tasks.workunit.client.1.smithi079.stdout:4/463: mkdir d6/dd/df/d8e 0 2024-05-09T06:29:32.920 INFO:tasks.workunit.client.1.smithi079.stdout:6/345: dread d0/de/f48 [0,4194304] 0 2024-05-09T06:29:32.923 INFO:tasks.workunit.client.1.smithi079.stdout:2/407: dwrite d8/db/d4b/d4f/d51/d6d/f96 [0,4194304] 0 2024-05-09T06:29:32.923 INFO:tasks.workunit.client.1.smithi079.stdout:2/408: write d8/db/d11/f55 [610287,29787] 0 2024-05-09T06:29:32.925 INFO:tasks.workunit.client.1.smithi079.stdout:8/339: write d1/d5/dc/f6a [2880053,45626] 0 2024-05-09T06:29:32.926 INFO:tasks.workunit.client.1.smithi079.stdout:1/393: link d0/d7/d4e/d7d/l88 d0/d12/d48/d75/l8e 0 2024-05-09T06:29:32.926 INFO:tasks.workunit.client.1.smithi079.stdout:1/394: fdatasync d0/d12/d48/d75/d43/d20/d39/f78 0 2024-05-09T06:29:32.926 INFO:tasks.workunit.client.1.smithi079.stdout:1/395: write d0/d7/d4e/f63 [1508748,119578] 0 2024-05-09T06:29:32.931 INFO:tasks.workunit.client.1.smithi079.stdout:4/464: truncate d6/d1a/d26/d2a/d54/f45 2201107 0 2024-05-09T06:29:32.933 INFO:tasks.workunit.client.1.smithi079.stdout:6/346: symlink d0/d6/d16/d1f/d36/d69/l6d 0 2024-05-09T06:29:32.933 INFO:tasks.workunit.client.1.smithi079.stdout:6/347: getdents d0/d6/d16/d28/d64 0 2024-05-09T06:29:32.943 INFO:tasks.workunit.client.1.smithi079.stdout:8/340: creat d1/d3/d20/d22/d50/d61/f7e x:0 0 0 2024-05-09T06:29:32.943 INFO:tasks.workunit.client.1.smithi079.stdout:1/396: dwrite d0/d6e/f7c [0,4194304] 0 2024-05-09T06:29:32.946 INFO:tasks.workunit.client.1.smithi079.stdout:3/382: getdents d1a/d1c/d1f 0 2024-05-09T06:29:32.946 INFO:tasks.workunit.client.1.smithi079.stdout:3/383: chown d1a/d1d/f2f 9355 1 2024-05-09T06:29:32.946 INFO:tasks.workunit.client.1.smithi079.stdout:3/384: fdatasync d1a/d1c/d1f/f68 0 2024-05-09T06:29:32.949 INFO:tasks.workunit.client.1.smithi079.stdout:6/348: rename d0/d6/d16/d28/d64 to d0/d6/d16/d28/d6e 0 2024-05-09T06:29:32.955 INFO:tasks.workunit.client.1.smithi079.stdout:3/385: unlink d1a/d1d/d34/d59/f60 0 2024-05-09T06:29:32.956 INFO:tasks.workunit.client.1.smithi079.stdout:3/386: creat d1a/d1d/f79 x:0 0 0 2024-05-09T06:29:32.958 INFO:tasks.workunit.client.1.smithi079.stdout:4/465: link d6/d1a/d41/d68/d6b/f81 d6/d8/d27/f8f 0 2024-05-09T06:29:32.961 INFO:tasks.workunit.client.1.smithi079.stdout:6/349: mkdir d0/d6/d16/d1f/d6f 0 2024-05-09T06:29:32.966 INFO:tasks.workunit.client.1.smithi079.stdout:3/387: mkdir d1a/d1d/d67/d7a 0 2024-05-09T06:29:32.967 INFO:tasks.workunit.client.1.smithi079.stdout:4/466: mkdir d6/d90 0 2024-05-09T06:29:32.969 INFO:tasks.workunit.client.1.smithi079.stdout:6/350: mknod d0/d6/c70 0 2024-05-09T06:29:32.970 INFO:tasks.workunit.client.1.smithi079.stdout:1/397: dread d0/df/f62 [0,4194304] 0 2024-05-09T06:29:33.008 INFO:tasks.workunit.client.1.smithi079.stdout:4/467: dwrite d6/d15/f31 [4194304,4194304] 0 2024-05-09T06:29:33.008 INFO:tasks.workunit.client.1.smithi079.stdout:6/351: dwrite d0/d6/d16/d1f/f23 [0,4194304] 0 2024-05-09T06:29:33.008 INFO:tasks.workunit.client.1.smithi079.stdout:6/352: fsync d0/de/f35 0 2024-05-09T06:29:33.008 INFO:tasks.workunit.client.1.smithi079.stdout:6/353: getdents d0/d6/d16/d1f/d6f 0 2024-05-09T06:29:33.008 INFO:tasks.workunit.client.1.smithi079.stdout:6/354: creat d0/d6/d5e/f71 x:0 0 0 2024-05-09T06:29:33.008 INFO:tasks.workunit.client.1.smithi079.stdout:6/355: creat d0/d6/d16/d28/f72 x:0 0 0 2024-05-09T06:29:33.008 INFO:tasks.workunit.client.1.smithi079.stdout:6/356: write d0/d6/d16/d1f/d36/f54 [1233303,49457] 0 2024-05-09T06:29:33.008 INFO:tasks.workunit.client.1.smithi079.stdout:6/357: dread - d0/d6/d1b/d2d/f4a zero size 2024-05-09T06:29:33.009 INFO:tasks.workunit.client.1.smithi079.stdout:6/358: write d0/de/f48 [245532,6076] 0 2024-05-09T06:29:33.009 INFO:tasks.workunit.client.1.smithi079.stdout:6/359: truncate d0/f65 34860 0 2024-05-09T06:29:33.009 INFO:tasks.workunit.client.1.smithi079.stdout:6/360: creat d0/d6/d16/d28/f73 x:0 0 0 2024-05-09T06:29:33.009 INFO:tasks.workunit.client.1.smithi079.stdout:6/361: read - d0/d6/d5e/f63 zero size 2024-05-09T06:29:33.009 INFO:tasks.workunit.client.1.smithi079.stdout:6/362: getdents d0/d6/d16/d28/d6e 0 2024-05-09T06:29:33.009 INFO:tasks.workunit.client.1.smithi079.stdout:3/388: dwrite d1a/d1d/d34/d42/f47 [0,4194304] 0 2024-05-09T06:29:33.009 INFO:tasks.workunit.client.1.smithi079.stdout:4/468: truncate d6/d1a/d26/d2a/d54/f17 679263 0 2024-05-09T06:29:33.011 INFO:tasks.workunit.client.1.smithi079.stdout:8/341: rename d1/d3/d20/d29 to d1/d3/d20/d7f 0 2024-05-09T06:29:33.016 INFO:tasks.workunit.client.1.smithi079.stdout:6/363: creat d0/d6/f74 x:0 0 0 2024-05-09T06:29:33.016 INFO:tasks.workunit.client.1.smithi079.stdout:6/364: chown d0/d6/d1b/f50 1893 1 2024-05-09T06:29:33.019 INFO:tasks.workunit.client.1.smithi079.stdout:3/389: rename d1a/d1d/d34/d42/f50 to d1a/d1c/d22/d53/f7b 0 2024-05-09T06:29:33.020 INFO:tasks.workunit.client.1.smithi079.stdout:3/390: read d1a/d1c/d1f/f56 [33416,483] 0 2024-05-09T06:29:33.020 INFO:tasks.workunit.client.1.smithi079.stdout:4/469: rmdir d6/d8/d27/d3d 39 2024-05-09T06:29:33.020 INFO:tasks.workunit.client.1.smithi079.stdout:4/470: truncate d6/d1a/d26/d2a/f56 865655 0 2024-05-09T06:29:33.021 INFO:tasks.workunit.client.1.smithi079.stdout:4/471: stat d6/d15/f31 0 2024-05-09T06:29:33.021 INFO:tasks.workunit.client.1.smithi079.stdout:4/472: stat d6/dd/df/f13 0 2024-05-09T06:29:33.022 INFO:tasks.workunit.client.1.smithi079.stdout:8/342: symlink d1/d3/d20/l80 0 2024-05-09T06:29:33.025 INFO:tasks.workunit.client.1.smithi079.stdout:4/473: rename d6/c76 to d6/d8/d80/c91 0 2024-05-09T06:29:33.027 INFO:tasks.workunit.client.1.smithi079.stdout:8/343: creat d1/d56/f81 x:0 0 0 2024-05-09T06:29:33.027 INFO:tasks.workunit.client.1.smithi079.stdout:8/344: read - d1/d5/d36/f70 zero size 2024-05-09T06:29:33.027 INFO:tasks.workunit.client.1.smithi079.stdout:7/374: sync 2024-05-09T06:29:33.027 INFO:tasks.workunit.client.1.smithi079.stdout:0/320: sync 2024-05-09T06:29:33.027 INFO:tasks.workunit.client.1.smithi079.stdout:5/414: sync 2024-05-09T06:29:33.027 INFO:tasks.workunit.client.1.smithi079.stdout:5/415: fsync d13/d4f/f97 0 2024-05-09T06:29:33.027 INFO:tasks.workunit.client.1.smithi079.stdout:0/321: dread - d3/dd/f5b zero size 2024-05-09T06:29:33.027 INFO:tasks.workunit.client.1.smithi079.stdout:5/416: creat d13/f99 x:0 0 0 2024-05-09T06:29:33.033 INFO:tasks.workunit.client.1.smithi079.stdout:4/474: mkdir d6/d8/d27/d3d/d92 0 2024-05-09T06:29:33.035 INFO:tasks.workunit.client.1.smithi079.stdout:8/345: mkdir d1/d3/d20/d22/d82 0 2024-05-09T06:29:33.038 INFO:tasks.workunit.client.1.smithi079.stdout:7/375: symlink d4/d7/dd/d5b/l70 0 2024-05-09T06:29:33.039 INFO:tasks.workunit.client.1.smithi079.stdout:0/322: unlink d3/dd/d1f/d1e/d2c/d35/f54 0 2024-05-09T06:29:33.042 INFO:tasks.workunit.client.1.smithi079.stdout:5/417: mkdir d13/d43/d3d/d40/d9a 0 2024-05-09T06:29:33.044 INFO:tasks.workunit.client.1.smithi079.stdout:8/346: mknod d1/d67/c83 0 2024-05-09T06:29:33.045 INFO:tasks.workunit.client.1.smithi079.stdout:8/347: stat d1/d3/d20/d22/d3f 0 2024-05-09T06:29:33.047 INFO:tasks.workunit.client.1.smithi079.stdout:7/376: rename d4/d7/d37/c6a to d4/d7/dd/d5b/c71 0 2024-05-09T06:29:33.049 INFO:tasks.workunit.client.1.smithi079.stdout:0/323: symlink d3/d5/d27/d2d/l5f 0 2024-05-09T06:29:33.050 INFO:tasks.workunit.client.1.smithi079.stdout:0/324: truncate d3/f39 347717 0 2024-05-09T06:29:33.050 INFO:tasks.workunit.client.1.smithi079.stdout:0/325: stat d3/dd/d18/d5e 0 2024-05-09T06:29:33.050 INFO:tasks.workunit.client.1.smithi079.stdout:4/475: symlink d6/d8/l93 0 2024-05-09T06:29:33.052 INFO:tasks.workunit.client.1.smithi079.stdout:8/348: creat d1/d3/f84 x:0 0 0 2024-05-09T06:29:33.052 INFO:tasks.workunit.client.1.smithi079.stdout:8/349: write d1/f1a [8830485,121465] 0 2024-05-09T06:29:33.052 INFO:tasks.workunit.client.1.smithi079.stdout:8/350: fdatasync d1/d3/d20/d22/d3b/f59 0 2024-05-09T06:29:33.052 INFO:tasks.workunit.client.1.smithi079.stdout:8/351: chown d1/d56/f81 3444 1 2024-05-09T06:29:33.052 INFO:tasks.workunit.client.1.smithi079.stdout:8/352: write d1/db/f4f [732075,47262] 0 2024-05-09T06:29:33.053 INFO:tasks.workunit.client.1.smithi079.stdout:0/326: creat d3/dd/d1f/d1e/d2c/d35/f60 x:0 0 0 2024-05-09T06:29:33.053 INFO:tasks.workunit.client.1.smithi079.stdout:5/418: read d13/d2a/f4b [2250752,106373] 0 2024-05-09T06:29:33.054 INFO:tasks.workunit.client.1.smithi079.stdout:0/327: read d3/d5/d27/f56 [708372,88167] 0 2024-05-09T06:29:33.055 INFO:tasks.workunit.client.1.smithi079.stdout:4/476: creat d6/dd/d34/f94 x:0 0 0 2024-05-09T06:29:33.056 INFO:tasks.workunit.client.1.smithi079.stdout:4/477: creat d6/d1a/d26/d2a/d54/d59/f95 x:0 0 0 2024-05-09T06:29:33.063 INFO:tasks.workunit.client.1.smithi079.stdout:5/419: unlink d13/d43/f22 0 2024-05-09T06:29:33.063 INFO:tasks.workunit.client.1.smithi079.stdout:5/420: chown d13/d43/d3d/d40 11 1 2024-05-09T06:29:33.063 INFO:tasks.workunit.client.1.smithi079.stdout:5/421: write d13/d43/d3d/f7a [911735,51862] 0 2024-05-09T06:29:33.063 INFO:tasks.workunit.client.1.smithi079.stdout:5/422: fdatasync d13/f48 0 2024-05-09T06:29:33.067 INFO:tasks.workunit.client.1.smithi079.stdout:4/478: creat d6/d1a/d41/d68/d6b/f96 x:0 0 0 2024-05-09T06:29:33.070 INFO:tasks.workunit.client.1.smithi079.stdout:5/423: mkdir d13/d92/d9b 0 2024-05-09T06:29:33.070 INFO:tasks.workunit.client.1.smithi079.stdout:5/424: write d13/d4d/f98 [781631,29065] 0 2024-05-09T06:29:33.070 INFO:tasks.workunit.client.1.smithi079.stdout:5/425: dread - d13/d4f/f97 zero size 2024-05-09T06:29:33.072 INFO:tasks.workunit.client.1.smithi079.stdout:7/377: dwrite d4/d7/d37/f4a [0,4194304] 0 2024-05-09T06:29:33.072 INFO:tasks.workunit.client.1.smithi079.stdout:8/353: dwrite d1/db/f4a [0,4194304] 0 2024-05-09T06:29:33.072 INFO:tasks.workunit.client.1.smithi079.stdout:8/354: write d1/d3/d20/d22/d50/d61/f7e [231107,81618] 0 2024-05-09T06:29:33.077 INFO:tasks.workunit.client.1.smithi079.stdout:4/479: rename d6/d8/d27/f8f to d6/d1a/d41/d68/f97 0 2024-05-09T06:29:33.087 INFO:tasks.workunit.client.1.smithi079.stdout:7/378: creat d4/d7/dd/d5b/d6f/f72 x:0 0 0 2024-05-09T06:29:33.092 INFO:tasks.workunit.client.1.smithi079.stdout:8/355: mknod d1/d3/d20/c85 0 2024-05-09T06:29:33.092 INFO:tasks.workunit.client.1.smithi079.stdout:8/356: truncate d1/d3/d20/d7f/f4e 5106548 0 2024-05-09T06:29:33.092 INFO:tasks.workunit.client.1.smithi079.stdout:8/357: write d1/d5/f6f [2978730,94592] 0 2024-05-09T06:29:33.092 INFO:tasks.workunit.client.1.smithi079.stdout:8/358: fdatasync d1/d5/f5f 0 2024-05-09T06:29:33.092 INFO:tasks.workunit.client.1.smithi079.stdout:8/359: readlink d1/d3/d20/d22/l48 0 2024-05-09T06:29:33.093 INFO:tasks.workunit.client.1.smithi079.stdout:5/426: dwrite d13/d2a/f4b [0,4194304] 0 2024-05-09T06:29:33.094 INFO:tasks.workunit.client.1.smithi079.stdout:4/480: mkdir d6/d1a/d26/d2a/d98 0 2024-05-09T06:29:33.094 INFO:tasks.workunit.client.1.smithi079.stdout:4/481: dread - d6/d1a/d41/f73 zero size 2024-05-09T06:29:33.095 INFO:tasks.workunit.client.1.smithi079.stdout:8/360: creat d1/d67/f86 x:0 0 0 2024-05-09T06:29:33.102 INFO:tasks.workunit.client.1.smithi079.stdout:5/427: creat d13/d43/d82/f9c x:0 0 0 2024-05-09T06:29:33.102 INFO:tasks.workunit.client.1.smithi079.stdout:5/428: creat d13/d43/d26/f9d x:0 0 0 2024-05-09T06:29:33.105 INFO:tasks.workunit.client.1.smithi079.stdout:8/361: symlink d1/d3/d20/d7f/l87 0 2024-05-09T06:29:33.105 INFO:tasks.workunit.client.1.smithi079.stdout:8/362: read - d1/d5/dc/f34 zero size 2024-05-09T06:29:33.107 INFO:tasks.workunit.client.1.smithi079.stdout:8/363: write d1/d3/d20/d7f/d33/f53 [669895,2476] 0 2024-05-09T06:29:33.110 INFO:tasks.workunit.client.1.smithi079.stdout:4/482: dread d6/d1a/f6e [0,4194304] 0 2024-05-09T06:29:33.110 INFO:tasks.workunit.client.1.smithi079.stdout:4/483: chown d6/d1a/d26/d2a/d54/f63 13 1 2024-05-09T06:29:33.111 INFO:tasks.workunit.client.1.smithi079.stdout:8/364: creat d1/d3/d20/d7f/d33/d5d/d6d/f88 x:0 0 0 2024-05-09T06:29:33.111 INFO:tasks.workunit.client.1.smithi079.stdout:5/429: write d13/d43/d3d/f85 [3965941,75145] 0 2024-05-09T06:29:33.112 INFO:tasks.workunit.client.1.smithi079.stdout:4/484: mknod d6/d1a/d41/d68/d6b/c99 0 2024-05-09T06:29:33.114 INFO:tasks.workunit.client.1.smithi079.stdout:8/365: creat d1/d56/d7c/f89 x:0 0 0 2024-05-09T06:29:33.116 INFO:tasks.workunit.client.1.smithi079.stdout:5/430: mkdir d13/d43/d9e 0 2024-05-09T06:29:33.119 INFO:tasks.workunit.client.1.smithi079.stdout:8/366: symlink d1/d5/l8a 0 2024-05-09T06:29:33.119 INFO:tasks.workunit.client.1.smithi079.stdout:8/367: dread - d1/d56/d7c/f89 zero size 2024-05-09T06:29:33.120 INFO:tasks.workunit.client.1.smithi079.stdout:5/431: mknod d13/d4f/c9f 0 2024-05-09T06:29:33.123 INFO:tasks.workunit.client.1.smithi079.stdout:8/368: getdents d1/d3/d20/d22/d3b 0 2024-05-09T06:29:33.123 INFO:tasks.workunit.client.1.smithi079.stdout:8/369: chown d1/d64/l6e 15 1 2024-05-09T06:29:33.123 INFO:tasks.workunit.client.1.smithi079.stdout:8/370: write d1/f1f [285073,128948] 0 2024-05-09T06:29:33.123 INFO:tasks.workunit.client.1.smithi079.stdout:8/371: stat d1/d3/f4 0 2024-05-09T06:29:33.124 INFO:tasks.workunit.client.1.smithi079.stdout:8/372: write d1/db/f30 [3470710,49161] 0 2024-05-09T06:29:33.124 INFO:tasks.workunit.client.1.smithi079.stdout:8/373: write d1/d5/dc/f1b [1553142,74196] 0 2024-05-09T06:29:33.131 INFO:tasks.workunit.client.1.smithi079.stdout:8/374: link d1/d3/d20/d22/l48 d1/d3/d20/d22/d3b/l8b 0 2024-05-09T06:29:33.134 INFO:tasks.workunit.client.1.smithi079.stdout:8/375: dread d1/d3/f6 [0,4194304] 0 2024-05-09T06:29:33.134 INFO:tasks.workunit.client.1.smithi079.stdout:5/432: dwrite d13/d2a/f7e [0,4194304] 0 2024-05-09T06:29:33.138 INFO:tasks.workunit.client.1.smithi079.stdout:5/433: write d13/f17 [404592,88292] 0 2024-05-09T06:29:33.138 INFO:tasks.workunit.client.1.smithi079.stdout:5/434: readlink ld 0 2024-05-09T06:29:33.140 INFO:tasks.workunit.client.1.smithi079.stdout:8/376: mkdir d1/d3/d20/d22/d44/d8c 0 2024-05-09T06:29:33.141 INFO:tasks.workunit.client.1.smithi079.stdout:8/377: write d1/db/f78 [80324,44008] 0 2024-05-09T06:29:33.142 INFO:tasks.workunit.client.1.smithi079.stdout:5/435: truncate d13/d43/d39/d61/f62 389570 0 2024-05-09T06:29:33.142 INFO:tasks.workunit.client.1.smithi079.stdout:5/436: readlink d13/d43/d26/l55 0 2024-05-09T06:29:33.143 INFO:tasks.workunit.client.1.smithi079.stdout:0/328: rmdir d3 39 2024-05-09T06:29:33.147 INFO:tasks.workunit.client.1.smithi079.stdout:5/437: dread d13/d43/d26/d35/f56 [0,4194304] 0 2024-05-09T06:29:33.158 INFO:tasks.workunit.client.1.smithi079.stdout:4/485: rename d6/d1a/d26/d2a/d54/d59 to d6/d8/d27/d3d/d5b/d9a 0 2024-05-09T06:29:33.160 INFO:tasks.workunit.client.1.smithi079.stdout:4/486: truncate d6/dd/df/f21 7176947 0 2024-05-09T06:29:33.162 INFO:tasks.workunit.client.1.smithi079.stdout:4/487: symlink d6/d8/d27/d3d/d5b/l9b 0 2024-05-09T06:29:33.163 INFO:tasks.workunit.client.1.smithi079.stdout:8/378: dwrite d1/d3/fa [0,4194304] 0 2024-05-09T06:29:33.163 INFO:tasks.workunit.client.1.smithi079.stdout:8/379: write d1/d5/dc/f34 [988625,102911] 0 2024-05-09T06:29:33.164 INFO:tasks.workunit.client.1.smithi079.stdout:5/438: dwrite d13/d2a/f67 [0,4194304] 0 2024-05-09T06:29:33.164 INFO:tasks.workunit.client.1.smithi079.stdout:5/439: write d13/d43/d39/f60 [138196,43171] 0 2024-05-09T06:29:33.164 INFO:tasks.workunit.client.1.smithi079.stdout:5/440: readlink d13/d4d/l6e 0 2024-05-09T06:29:33.165 INFO:tasks.workunit.client.1.smithi079.stdout:4/488: creat d6/d8/d27/d3d/d5b/d9a/d8b/f9c x:0 0 0 2024-05-09T06:29:33.165 INFO:tasks.workunit.client.1.smithi079.stdout:4/489: chown d6/dd/df/f21 499 1 2024-05-09T06:29:33.165 INFO:tasks.workunit.client.1.smithi079.stdout:4/490: chown d6/d1a/d26/d2a/d54/f70 1025906681 1 2024-05-09T06:29:33.168 INFO:tasks.workunit.client.1.smithi079.stdout:9/529: sync 2024-05-09T06:29:33.168 INFO:tasks.workunit.client.1.smithi079.stdout:2/409: sync 2024-05-09T06:29:33.173 INFO:tasks.workunit.client.1.smithi079.stdout:5/441: creat d13/d92/d9b/fa0 x:0 0 0 2024-05-09T06:29:33.174 INFO:tasks.workunit.client.1.smithi079.stdout:4/491: symlink d6/d8/d27/d3d/l9d 0 2024-05-09T06:29:33.176 INFO:tasks.workunit.client.1.smithi079.stdout:2/410: rename d8/db/f19 to d8/db/dc/f9b 0 2024-05-09T06:29:33.178 INFO:tasks.workunit.client.1.smithi079.stdout:8/380: dwrite d1/db/f62 [0,4194304] 0 2024-05-09T06:29:33.178 INFO:tasks.workunit.client.1.smithi079.stdout:9/530: symlink d1/d6/dae/db0/lb2 0 2024-05-09T06:29:33.181 INFO:tasks.workunit.client.1.smithi079.stdout:4/492: mkdir d6/d1a/d26/d2a/d54/d9e 0 2024-05-09T06:29:33.181 INFO:tasks.workunit.client.1.smithi079.stdout:4/493: fdatasync d6/d8/d27/d3d/d5b/d9a/f82 0 2024-05-09T06:29:33.183 INFO:tasks.workunit.client.1.smithi079.stdout:2/411: truncate d8/db/d4b/d4f/d51/d6d/f74 48561 0 2024-05-09T06:29:33.186 INFO:tasks.workunit.client.1.smithi079.stdout:5/442: dread fc [0,4194304] 0 2024-05-09T06:29:33.187 INFO:tasks.workunit.client.1.smithi079.stdout:5/443: dread - d13/d4f/f97 zero size 2024-05-09T06:29:33.187 INFO:tasks.workunit.client.1.smithi079.stdout:1/398: sync 2024-05-09T06:29:33.187 INFO:tasks.workunit.client.1.smithi079.stdout:6/365: sync 2024-05-09T06:29:33.187 INFO:tasks.workunit.client.1.smithi079.stdout:6/366: fsync d0/d6/d16/f30 0 2024-05-09T06:29:33.187 INFO:tasks.workunit.client.1.smithi079.stdout:6/367: dread - d0/d6/d5e/f71 zero size 2024-05-09T06:29:33.188 INFO:tasks.workunit.client.1.smithi079.stdout:8/381: mknod d1/d3/d20/d7f/d33/d5d/d6d/c8d 0 2024-05-09T06:29:33.189 INFO:tasks.workunit.client.1.smithi079.stdout:8/382: read d1/db/f78 [66940,81065] 0 2024-05-09T06:29:33.189 INFO:tasks.workunit.client.1.smithi079.stdout:8/383: fsync d1/d3/d20/f7b 0 2024-05-09T06:29:33.190 INFO:tasks.workunit.client.1.smithi079.stdout:9/531: creat d1/d33/d28/d4c/d4e/fb3 x:0 0 0 2024-05-09T06:29:33.192 INFO:tasks.workunit.client.1.smithi079.stdout:6/368: link d0/d6/cb d0/d6/c75 0 2024-05-09T06:29:33.192 INFO:tasks.workunit.client.1.smithi079.stdout:6/369: dread - d0/d6/d1b/d2d/f4c zero size 2024-05-09T06:29:33.192 INFO:tasks.workunit.client.1.smithi079.stdout:6/370: fdatasync d0/d6/d16/f56 0 2024-05-09T06:29:33.192 INFO:tasks.workunit.client.1.smithi079.stdout:6/371: stat d0/d6/d16/d28/f72 0 2024-05-09T06:29:33.192 INFO:tasks.workunit.client.1.smithi079.stdout:3/391: sync 2024-05-09T06:29:33.194 INFO:tasks.workunit.client.1.smithi079.stdout:8/384: link d1/d3/d20/d22/d44/f4c d1/d3/d20/d22/f8e 0 2024-05-09T06:29:33.194 INFO:tasks.workunit.client.1.smithi079.stdout:8/385: getdents d1/d3/d20/d22/d44/d8c 0 2024-05-09T06:29:33.197 INFO:tasks.workunit.client.1.smithi079.stdout:1/399: dread d0/d12/d48/d75/d43/f15 [0,4194304] 0 2024-05-09T06:29:33.198 INFO:tasks.workunit.client.1.smithi079.stdout:4/494: dwrite d6/d1a/d26/f71 [0,4194304] 0 2024-05-09T06:29:33.200 INFO:tasks.workunit.client.1.smithi079.stdout:9/532: write d1/d33/d28/d4c/d4e/f54 [4842410,67454] 0 2024-05-09T06:29:33.208 INFO:tasks.workunit.client.1.smithi079.stdout:3/392: rmdir d1a/d1d/d3a/d58 0 2024-05-09T06:29:33.212 INFO:tasks.workunit.client.1.smithi079.stdout:4/495: rename d6/dd/l16 to d6/d1a/d41/d68/d6b/l9f 0 2024-05-09T06:29:33.215 INFO:tasks.workunit.client.1.smithi079.stdout:9/533: mknod d1/d33/d28/d36/d38/d3a/cb4 0 2024-05-09T06:29:33.216 INFO:tasks.workunit.client.1.smithi079.stdout:6/372: rmdir d0/d6/d1b 39 2024-05-09T06:29:33.216 INFO:tasks.workunit.client.1.smithi079.stdout:6/373: write d0/d6/d16/d28/f46 [5184160,3956] 0 2024-05-09T06:29:33.217 INFO:tasks.workunit.client.1.smithi079.stdout:6/374: truncate d0/de/f43 278272 0 2024-05-09T06:29:33.217 INFO:tasks.workunit.client.1.smithi079.stdout:6/375: creat d0/d6/f76 x:0 0 0 2024-05-09T06:29:33.217 INFO:tasks.workunit.client.1.smithi079.stdout:6/376: chown d0/d6/d1b/l6b 564798 1 2024-05-09T06:29:33.217 INFO:tasks.workunit.client.1.smithi079.stdout:6/377: truncate d0/de/f48 1993843 0 2024-05-09T06:29:33.219 INFO:tasks.workunit.client.1.smithi079.stdout:9/534: mkdir d1/d33/d28/d36/db5 0 2024-05-09T06:29:33.220 INFO:tasks.workunit.client.1.smithi079.stdout:4/496: dread d6/d8/f4f [4194304,4194304] 0 2024-05-09T06:29:33.222 INFO:tasks.workunit.client.1.smithi079.stdout:8/386: dwrite d1/db/f30 [0,4194304] 0 2024-05-09T06:29:33.224 INFO:tasks.workunit.client.1.smithi079.stdout:6/378: creat d0/d6/d16/d1f/d6f/f77 x:0 0 0 2024-05-09T06:29:33.225 INFO:tasks.workunit.client.1.smithi079.stdout:6/379: write d0/d6/d16/d28/f67 [4709571,126838] 0 2024-05-09T06:29:33.225 INFO:tasks.workunit.client.1.smithi079.stdout:1/400: dwrite d0/d7/fb [0,4194304] 0 2024-05-09T06:29:33.228 INFO:tasks.workunit.client.1.smithi079.stdout:3/393: dwrite d1a/d1c/d1f/f75 [0,4194304] 0 2024-05-09T06:29:33.229 INFO:tasks.workunit.client.1.smithi079.stdout:9/535: symlink d1/d33/d28/d4c/d8b/lb6 0 2024-05-09T06:29:33.229 INFO:tasks.workunit.client.1.smithi079.stdout:9/536: getdents d1/d33/d28/d4c/d97 0 2024-05-09T06:29:33.232 INFO:tasks.workunit.client.1.smithi079.stdout:4/497: write d6/dd/df/f13 [7447208,12266] 0 2024-05-09T06:29:33.235 INFO:tasks.workunit.client.1.smithi079.stdout:1/401: creat d0/df/f8f x:0 0 0 2024-05-09T06:29:33.235 INFO:tasks.workunit.client.1.smithi079.stdout:1/402: fdatasync d0/df/f14 0 2024-05-09T06:29:33.235 INFO:tasks.workunit.client.1.smithi079.stdout:1/403: chown d0/df/f14 1113 1 2024-05-09T06:29:33.235 INFO:tasks.workunit.client.1.smithi079.stdout:1/404: write d0/d12/d48/d75/d43/d20/f4f [396748,86937] 0 2024-05-09T06:29:33.242 INFO:tasks.workunit.client.1.smithi079.stdout:3/394: unlink d1a/l5f 0 2024-05-09T06:29:33.242 INFO:tasks.workunit.client.1.smithi079.stdout:9/537: symlink d1/d5/lb7 0 2024-05-09T06:29:33.245 INFO:tasks.workunit.client.1.smithi079.stdout:8/387: truncate d1/d3/d20/d22/d3b/f52 3981908 0 2024-05-09T06:29:33.245 INFO:tasks.workunit.client.1.smithi079.stdout:8/388: chown d1/d5/c42 0 1 2024-05-09T06:29:33.252 INFO:tasks.workunit.client.1.smithi079.stdout:6/380: dwrite d0/d6/d1b/f3d [0,4194304] 0 2024-05-09T06:29:33.252 INFO:tasks.workunit.client.1.smithi079.stdout:6/381: readlink d0/d6/d1b/d2d/l34 0 2024-05-09T06:29:33.252 INFO:tasks.workunit.client.1.smithi079.stdout:6/382: write d0/de/f3a [2631113,11951] 0 2024-05-09T06:29:33.253 INFO:tasks.workunit.client.1.smithi079.stdout:1/405: dwrite d0/d12/d16/f84 [0,4194304] 0 2024-05-09T06:29:33.253 INFO:tasks.workunit.client.1.smithi079.stdout:3/395: mkdir d1a/d1d/d3a/d7c 0 2024-05-09T06:29:33.256 INFO:tasks.workunit.client.1.smithi079.stdout:8/389: mkdir d1/d56/d7c/d8f 0 2024-05-09T06:29:33.257 INFO:tasks.workunit.client.1.smithi079.stdout:8/390: read d1/db/f4f [568327,118989] 0 2024-05-09T06:29:33.258 INFO:tasks.workunit.client.1.smithi079.stdout:6/383: write d0/fc [2930691,26117] 0 2024-05-09T06:29:33.258 INFO:tasks.workunit.client.1.smithi079.stdout:6/384: readlink d0/d6/d16/l24 0 2024-05-09T06:29:33.264 INFO:tasks.workunit.client.1.smithi079.stdout:1/406: link d0/d12/d48/d75/d43/c44 d0/d7/c90 0 2024-05-09T06:29:33.264 INFO:tasks.workunit.client.1.smithi079.stdout:1/407: fsync d0/d12/d48/d75/d43/d70/f86 0 2024-05-09T06:29:33.266 INFO:tasks.workunit.client.1.smithi079.stdout:3/396: rmdir d1a/d1c/d6b 0 2024-05-09T06:29:33.268 INFO:tasks.workunit.client.1.smithi079.stdout:1/408: dread d0/f58 [0,4194304] 0 2024-05-09T06:29:33.268 INFO:tasks.workunit.client.1.smithi079.stdout:8/391: creat d1/d3/d20/d22/d3b/f90 x:0 0 0 2024-05-09T06:29:33.273 INFO:tasks.workunit.client.1.smithi079.stdout:1/409: creat d0/d12/d48/d75/d43/d20/f91 x:0 0 0 2024-05-09T06:29:33.273 INFO:tasks.workunit.client.1.smithi079.stdout:1/410: write d0/d12/d48/d75/d26/f76 [324935,66803] 0 2024-05-09T06:29:33.278 INFO:tasks.workunit.client.1.smithi079.stdout:4/498: rmdir d6/d1a/d26/d2a/d54 39 2024-05-09T06:29:33.314 INFO:tasks.workunit.client.1.smithi079.stdout:3/397: dwrite f11 [0,4194304] 0 2024-05-09T06:29:33.314 INFO:tasks.workunit.client.1.smithi079.stdout:8/392: dwrite d1/d3/d20/d22/f8e [0,4194304] 0 2024-05-09T06:29:33.314 INFO:tasks.workunit.client.1.smithi079.stdout:1/411: dwrite d0/d12/d67/d53/f7a [0,4194304] 0 2024-05-09T06:29:33.314 INFO:tasks.workunit.client.1.smithi079.stdout:2/412: dwrite d8/db/d4b/d4f/d51/d6d/f74 [0,4194304] 0 2024-05-09T06:29:33.315 INFO:tasks.workunit.client.1.smithi079.stdout:4/499: dwrite d6/dd/f4e [4194304,4194304] 0 2024-05-09T06:29:33.323 INFO:tasks.workunit.client.1.smithi079.stdout:3/398: truncate d1a/d1d/d3a/f46 2211912 0 2024-05-09T06:29:33.338 INFO:tasks.workunit.client.1.smithi079.stdout:3/399: dwrite d1a/d1c/d1f/f4d [0,4194304] 0 2024-05-09T06:29:33.338 INFO:tasks.workunit.client.1.smithi079.stdout:3/400: stat d1a/d1d/d3a/d54/d5e 0 2024-05-09T06:29:33.338 INFO:tasks.workunit.client.1.smithi079.stdout:3/401: dread - d1a/d1d/f79 zero size 2024-05-09T06:29:33.339 INFO:tasks.workunit.client.1.smithi079.stdout:3/402: chown d1a/d1d/d3a/d54/d5e 181905736 1 2024-05-09T06:29:33.339 INFO:tasks.workunit.client.1.smithi079.stdout:3/403: chown d1a/d1d/d3a/d54/d55/l5a 911093 1 2024-05-09T06:29:33.339 INFO:tasks.workunit.client.1.smithi079.stdout:3/404: fdatasync d1a/d1d/d34/d42/f47 0 2024-05-09T06:29:33.339 INFO:tasks.workunit.client.1.smithi079.stdout:8/393: truncate d1/f1a 2233968 0 2024-05-09T06:29:33.339 INFO:tasks.workunit.client.1.smithi079.stdout:8/394: truncate d1/d3/d20/d22/d50/f5b 1170625 0 2024-05-09T06:29:33.341 INFO:tasks.workunit.client.1.smithi079.stdout:1/412: mkdir d0/d12/d92 0 2024-05-09T06:29:33.358 INFO:tasks.workunit.client.1.smithi079.stdout:2/413: mknod d8/db/d11/d79/c9c 0 2024-05-09T06:29:33.360 INFO:tasks.workunit.client.1.smithi079.stdout:3/405: dwrite f13 [0,4194304] 0 2024-05-09T06:29:33.360 INFO:tasks.workunit.client.1.smithi079.stdout:3/406: chown d1a/d1c/d1f/f68 261805542 1 2024-05-09T06:29:33.361 INFO:tasks.workunit.client.1.smithi079.stdout:2/414: write d8/db/dc/d2c/d2e/f3e [454210,124668] 0 2024-05-09T06:29:33.361 INFO:tasks.workunit.client.1.smithi079.stdout:2/415: chown d8/db/d11/d79/d88 31148232 1 2024-05-09T06:29:33.366 INFO:tasks.workunit.client.1.smithi079.stdout:4/500: symlink d6/d1a/la0 0 2024-05-09T06:29:33.366 INFO:tasks.workunit.client.1.smithi079.stdout:4/501: stat d6/d8/d27/f85 0 2024-05-09T06:29:33.367 INFO:tasks.workunit.client.1.smithi079.stdout:1/413: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:29:33.369 INFO:tasks.workunit.client.1.smithi079.stdout:2/416: dread d8/db/d4b/d4f/d51/d6d/f6e [0,4194304] 0 2024-05-09T06:29:33.376 INFO:tasks.workunit.client.1.smithi079.stdout:1/414: dread d0/d12/d16/f50 [0,4194304] 0 2024-05-09T06:29:33.376 INFO:tasks.workunit.client.1.smithi079.stdout:1/415: fsync d0/d12/d16/f19 0 2024-05-09T06:29:33.382 INFO:tasks.workunit.client.1.smithi079.stdout:3/407: dwrite d1a/d1c/d22/d53/f66 [0,4194304] 0 2024-05-09T06:29:33.382 INFO:tasks.workunit.client.1.smithi079.stdout:3/408: chown d1a/d1c/d22 749 1 2024-05-09T06:29:33.383 INFO:tasks.workunit.client.1.smithi079.stdout:8/395: creat d1/f91 x:0 0 0 2024-05-09T06:29:33.383 INFO:tasks.workunit.client.1.smithi079.stdout:8/396: write d1/d56/f81 [448336,56710] 0 2024-05-09T06:29:33.383 INFO:tasks.workunit.client.1.smithi079.stdout:8/397: dread - d1/d3/d20/f7b zero size 2024-05-09T06:29:33.390 INFO:tasks.workunit.client.1.smithi079.stdout:3/409: read d1a/d21/f70 [4022348,5852] 0 2024-05-09T06:29:33.391 INFO:tasks.workunit.client.1.smithi079.stdout:4/502: mkdir d6/d1a/d41/d68/da1 0 2024-05-09T06:29:33.391 INFO:tasks.workunit.client.1.smithi079.stdout:4/503: creat d6/dd/fa2 x:0 0 0 2024-05-09T06:29:33.399 INFO:tasks.workunit.client.1.smithi079.stdout:2/417: mkdir d8/db/d9d 0 2024-05-09T06:29:33.399 INFO:tasks.workunit.client.1.smithi079.stdout:2/418: fsync d8/db/d11/f8e 0 2024-05-09T06:29:33.399 INFO:tasks.workunit.client.1.smithi079.stdout:2/419: creat d8/db/d59/d67/d86/f9e x:0 0 0 2024-05-09T06:29:33.400 INFO:tasks.workunit.client.1.smithi079.stdout:2/420: fsync d8/db/d4b/d4f/d51/d6d/f6e 0 2024-05-09T06:29:33.410 INFO:tasks.workunit.client.1.smithi079.stdout:3/410: mknod d1a/d1d/d34/d59/c7d 0 2024-05-09T06:29:33.424 INFO:tasks.workunit.client.1.smithi079.stdout:2/421: mknod d8/db/d59/c9f 0 2024-05-09T06:29:33.427 INFO:tasks.workunit.client.1.smithi079.stdout:3/411: truncate d1a/f49 3535422 0 2024-05-09T06:29:33.431 INFO:tasks.workunit.client.1.smithi079.stdout:4/504: truncate d6/d8/d55/f74 2052244 0 2024-05-09T06:29:33.431 INFO:tasks.workunit.client.1.smithi079.stdout:4/505: write d6/dd/df/f3b [2306461,64796] 0 2024-05-09T06:29:33.437 INFO:tasks.workunit.client.1.smithi079.stdout:4/506: link d6/dd/d34/f94 d6/d1a/d26/d2a/d98/fa3 0 2024-05-09T06:29:33.437 INFO:tasks.workunit.client.1.smithi079.stdout:4/507: write d6/d1a/d26/d2a/d54/f45 [2709066,72103] 0 2024-05-09T06:29:33.440 INFO:tasks.workunit.client.1.smithi079.stdout:2/422: mknod d8/db/d4b/d4f/ca0 0 2024-05-09T06:29:33.443 INFO:tasks.workunit.client.1.smithi079.stdout:3/412: dwrite fa [0,4194304] 0 2024-05-09T06:29:33.443 INFO:tasks.workunit.client.1.smithi079.stdout:3/413: creat d1a/d1c/d22/d53/d4e/f7e x:0 0 0 2024-05-09T06:29:33.443 INFO:tasks.workunit.client.1.smithi079.stdout:3/414: chown d1a/d1c/d22/c52 8 1 2024-05-09T06:29:33.446 INFO:tasks.workunit.client.1.smithi079.stdout:4/508: symlink d6/dd/df/la4 0 2024-05-09T06:29:33.447 INFO:tasks.workunit.client.1.smithi079.stdout:4/509: readlink d6/l57 0 2024-05-09T06:29:33.447 INFO:tasks.workunit.client.1.smithi079.stdout:4/510: fdatasync d6/d8/d27/d3d/d5b/d9a/d8b/f9c 0 2024-05-09T06:29:33.447 INFO:tasks.workunit.client.1.smithi079.stdout:2/423: dread d8/db/dc/d2c/d2e/f3e [0,4194304] 0 2024-05-09T06:29:33.454 INFO:tasks.workunit.client.1.smithi079.stdout:3/415: dread d1a/d1c/d1f/f75 [0,4194304] 0 2024-05-09T06:29:33.456 INFO:tasks.workunit.client.1.smithi079.stdout:2/424: dread d8/db/f62 [0,4194304] 0 2024-05-09T06:29:33.458 INFO:tasks.workunit.client.1.smithi079.stdout:2/425: symlink d8/db/d5c/d6b/la1 0 2024-05-09T06:29:33.460 INFO:tasks.workunit.client.1.smithi079.stdout:3/416: write d1a/f3d [1091327,39311] 0 2024-05-09T06:29:33.460 INFO:tasks.workunit.client.1.smithi079.stdout:3/417: creat d1a/f7f x:0 0 0 2024-05-09T06:29:33.462 INFO:tasks.workunit.client.1.smithi079.stdout:2/426: write d8/db/f62 [4175187,36957] 0 2024-05-09T06:29:33.482 INFO:tasks.workunit.client.1.smithi079.stdout:2/427: rename d8/db/d4b/d4f/d51/f83 to d8/db/d4b/d4f/d51/d6f/fa2 0 2024-05-09T06:29:33.495 INFO:tasks.workunit.client.1.smithi079.stdout:0/329: sync 2024-05-09T06:29:33.495 INFO:tasks.workunit.client.1.smithi079.stdout:7/379: sync 2024-05-09T06:29:33.495 INFO:tasks.workunit.client.1.smithi079.stdout:0/330: chown d3/dd/l50 18859159 1 2024-05-09T06:29:33.495 INFO:tasks.workunit.client.1.smithi079.stdout:7/380: fsync d4/d7/dd/f16 0 2024-05-09T06:29:33.496 INFO:tasks.workunit.client.1.smithi079.stdout:7/381: mknod d4/d7/dd/d5b/d31/c73 0 2024-05-09T06:29:33.496 INFO:tasks.workunit.client.1.smithi079.stdout:7/382: write d4/d7/dd/d5b/f3a [5239872,63645] 0 2024-05-09T06:29:33.497 INFO:tasks.workunit.client.1.smithi079.stdout:8/398: dread d1/f1a [0,4194304] 0 2024-05-09T06:29:33.497 INFO:tasks.workunit.client.1.smithi079.stdout:8/399: dread - d1/d67/f86 zero size 2024-05-09T06:29:33.498 INFO:tasks.workunit.client.1.smithi079.stdout:7/383: truncate d4/d7/d37/f46 438131 0 2024-05-09T06:29:33.498 INFO:tasks.workunit.client.1.smithi079.stdout:7/384: dread - d4/d7/f49 zero size 2024-05-09T06:29:33.499 INFO:tasks.workunit.client.1.smithi079.stdout:8/400: dread d1/d3/d20/d22/d50/d61/f7e [0,4194304] 0 2024-05-09T06:29:33.499 INFO:tasks.workunit.client.1.smithi079.stdout:8/401: fdatasync d1/d56/f81 0 2024-05-09T06:29:33.501 INFO:tasks.workunit.client.1.smithi079.stdout:8/402: mknod d1/d3/d20/d22/d50/d61/d66/d6c/d6b/c92 0 2024-05-09T06:29:33.501 INFO:tasks.workunit.client.1.smithi079.stdout:8/403: creat d1/f93 x:0 0 0 2024-05-09T06:29:33.501 INFO:tasks.workunit.client.1.smithi079.stdout:9/538: sync 2024-05-09T06:29:33.501 INFO:tasks.workunit.client.1.smithi079.stdout:5/444: sync 2024-05-09T06:29:33.501 INFO:tasks.workunit.client.1.smithi079.stdout:9/539: read - d1/d33/d28/d4c/d4e/fb3 zero size 2024-05-09T06:29:33.501 INFO:tasks.workunit.client.1.smithi079.stdout:9/540: chown d1/d33/d28/d36/d4d/d7d/f31 2 1 2024-05-09T06:29:33.502 INFO:tasks.workunit.client.1.smithi079.stdout:8/404: symlink d1/d3/d20/d7f/d33/l94 0 2024-05-09T06:29:33.502 INFO:tasks.workunit.client.1.smithi079.stdout:0/331: dread d3/d5/fe [0,4194304] 0 2024-05-09T06:29:33.504 INFO:tasks.workunit.client.1.smithi079.stdout:5/445: stat d13/d43/d39/d61/d72/c74 0 2024-05-09T06:29:33.510 INFO:tasks.workunit.client.1.smithi079.stdout:0/332: mknod d3/dd/d1f/d1e/c61 0 2024-05-09T06:29:33.510 INFO:tasks.workunit.client.1.smithi079.stdout:9/541: write d1/d33/d28/d36/d4d/d7d/f14 [323424,106942] 0 2024-05-09T06:29:33.510 INFO:tasks.workunit.client.1.smithi079.stdout:9/542: chown d1/d5/lb7 875130 1 2024-05-09T06:29:33.511 INFO:tasks.workunit.client.1.smithi079.stdout:5/446: truncate d13/f48 1792665 0 2024-05-09T06:29:33.514 INFO:tasks.workunit.client.1.smithi079.stdout:5/447: rename d13/d43/d26/f83 to d13/d43/d82/d8b/fa1 0 2024-05-09T06:29:33.515 INFO:tasks.workunit.client.1.smithi079.stdout:9/543: mkdir d1/d33/d28/d36/d4d/d7d/d19/db8 0 2024-05-09T06:29:33.515 INFO:tasks.workunit.client.1.smithi079.stdout:9/544: chown d1/f17 32458553 1 2024-05-09T06:29:33.517 INFO:tasks.workunit.client.1.smithi079.stdout:9/545: mknod d1/d33/d28/d36/d6c/cb9 0 2024-05-09T06:29:33.517 INFO:tasks.workunit.client.1.smithi079.stdout:9/546: fsync d1/d5/d91/fa5 0 2024-05-09T06:29:33.521 INFO:tasks.workunit.client.1.smithi079.stdout:8/405: read d1/d3/d20/d22/d3b/f46 [1913232,70266] 0 2024-05-09T06:29:33.521 INFO:tasks.workunit.client.1.smithi079.stdout:7/385: dwrite d4/d7/dd/d5b/d32/f3b [0,4194304] 0 2024-05-09T06:29:33.521 INFO:tasks.workunit.client.1.smithi079.stdout:7/386: chown d4 124 1 2024-05-09T06:29:33.521 INFO:tasks.workunit.client.1.smithi079.stdout:7/387: chown d4/d7/f1b 18122 1 2024-05-09T06:29:33.521 INFO:tasks.workunit.client.1.smithi079.stdout:7/388: chown d4/d7/d22/d28 945291756 1 2024-05-09T06:29:33.525 INFO:tasks.workunit.client.1.smithi079.stdout:0/333: dread d3/d5/d27/d2d/f2e [0,4194304] 0 2024-05-09T06:29:33.525 INFO:tasks.workunit.client.1.smithi079.stdout:0/334: fsync d3/dd/d1f/d1e/d2c/d35/d36/f4c 0 2024-05-09T06:29:33.526 INFO:tasks.workunit.client.1.smithi079.stdout:9/547: dread d1/d33/d28/d36/f7b [0,4194304] 0 2024-05-09T06:29:33.526 INFO:tasks.workunit.client.1.smithi079.stdout:0/335: link d3/dd/d1f/d1e/d2c/d35/l4e d3/dd/d1f/d1e/d2c/d35/l62 0 2024-05-09T06:29:33.527 INFO:tasks.workunit.client.1.smithi079.stdout:6/385: sync 2024-05-09T06:29:33.527 INFO:tasks.workunit.client.1.smithi079.stdout:6/386: chown d0/de/f35 684305 1 2024-05-09T06:29:33.527 INFO:tasks.workunit.client.1.smithi079.stdout:6/387: chown d0/d6/cb 1 1 2024-05-09T06:29:33.529 INFO:tasks.workunit.client.1.smithi079.stdout:0/336: link d3/dd/d1f/d1e/d2c/d35/f60 d3/dd/d1f/d1e/d2c/d35/d36/f63 0 2024-05-09T06:29:33.532 INFO:tasks.workunit.client.1.smithi079.stdout:6/388: symlink d0/d6/d16/d28/l78 0 2024-05-09T06:29:33.533 INFO:tasks.workunit.client.1.smithi079.stdout:6/389: write d0/d6/d16/d1f/f25 [263232,27274] 0 2024-05-09T06:29:33.533 INFO:tasks.workunit.client.1.smithi079.stdout:6/390: chown d0/d6/d16/d1f/d36/f54 823333 1 2024-05-09T06:29:33.533 INFO:tasks.workunit.client.1.smithi079.stdout:9/548: getdents d1/d33/d2b 0 2024-05-09T06:29:33.534 INFO:tasks.workunit.client.1.smithi079.stdout:6/391: creat d0/d60/f79 x:0 0 0 2024-05-09T06:29:33.534 INFO:tasks.workunit.client.1.smithi079.stdout:6/392: creat d0/f7a x:0 0 0 2024-05-09T06:29:33.539 INFO:tasks.workunit.client.1.smithi079.stdout:6/393: getdents d0/d6/d16/d1f/d36 0 2024-05-09T06:29:33.547 INFO:tasks.workunit.client.1.smithi079.stdout:9/549: dread d1/d33/d28/d4c/d4e/f2e [0,4194304] 0 2024-05-09T06:29:33.548 INFO:tasks.workunit.client.1.smithi079.stdout:3/418: truncate d1a/f49 4084507 0 2024-05-09T06:29:33.549 INFO:tasks.workunit.client.1.smithi079.stdout:9/550: mkdir d1/d5/dba 0 2024-05-09T06:29:33.549 INFO:tasks.workunit.client.1.smithi079.stdout:9/551: truncate d1/f3 9360786 0 2024-05-09T06:29:33.550 INFO:tasks.workunit.client.1.smithi079.stdout:9/552: readlink d1/d33/d28/d4c/d8b/lb6 0 2024-05-09T06:29:33.551 INFO:tasks.workunit.client.1.smithi079.stdout:3/419: getdents d1a/d1d/d34/d42 0 2024-05-09T06:29:33.554 INFO:tasks.workunit.client.1.smithi079.stdout:7/389: dwrite d4/d7/dd/f6c [0,4194304] 0 2024-05-09T06:29:33.554 INFO:tasks.workunit.client.1.smithi079.stdout:0/337: dwrite d3/d5/f21 [0,4194304] 0 2024-05-09T06:29:33.556 INFO:tasks.workunit.client.1.smithi079.stdout:8/406: dwrite d1/d3/f4 [0,4194304] 0 2024-05-09T06:29:33.556 INFO:tasks.workunit.client.1.smithi079.stdout:8/407: fsync d1/d3/d20/d22/d50/d61/f7e 0 2024-05-09T06:29:33.556 INFO:tasks.workunit.client.1.smithi079.stdout:8/408: write d1/d56/d7c/f89 [45666,101326] 0 2024-05-09T06:29:33.558 INFO:tasks.workunit.client.1.smithi079.stdout:4/511: rmdir d6/d1a/d26/d2a 39 2024-05-09T06:29:33.558 INFO:tasks.workunit.client.1.smithi079.stdout:4/512: creat d6/d1a/fa5 x:0 0 0 2024-05-09T06:29:33.564 INFO:tasks.workunit.client.1.smithi079.stdout:0/338: creat d3/dd/d1f/f64 x:0 0 0 2024-05-09T06:29:33.568 INFO:tasks.workunit.client.1.smithi079.stdout:8/409: symlink d1/d5/dc/l95 0 2024-05-09T06:29:33.569 INFO:tasks.workunit.client.1.smithi079.stdout:7/390: write d4/f26 [2645404,29713] 0 2024-05-09T06:29:33.573 INFO:tasks.workunit.client.1.smithi079.stdout:7/391: dread d4/d7/f18 [4194304,4194304] 0 2024-05-09T06:29:33.575 INFO:tasks.workunit.client.1.smithi079.stdout:0/339: mkdir d3/dd/d1f/d1e/d2c/d65 0 2024-05-09T06:29:33.576 INFO:tasks.workunit.client.1.smithi079.stdout:3/420: dwrite d1a/d1d/d34/f4f [0,4194304] 0 2024-05-09T06:29:33.577 INFO:tasks.workunit.client.1.smithi079.stdout:8/410: symlink d1/l96 0 2024-05-09T06:29:33.578 INFO:tasks.workunit.client.1.smithi079.stdout:7/392: mkdir d4/d7/d22/d28/d74 0 2024-05-09T06:29:33.579 INFO:tasks.workunit.client.1.smithi079.stdout:0/340: mkdir d3/dd/d66 0 2024-05-09T06:29:33.581 INFO:tasks.workunit.client.1.smithi079.stdout:9/553: dwrite d1/d33/d2b/f32 [0,4194304] 0 2024-05-09T06:29:33.582 INFO:tasks.workunit.client.1.smithi079.stdout:4/513: dwrite d6/f24 [0,4194304] 0 2024-05-09T06:29:33.582 INFO:tasks.workunit.client.1.smithi079.stdout:4/514: read - d6/dd/f6a zero size 2024-05-09T06:29:33.582 INFO:tasks.workunit.client.1.smithi079.stdout:8/411: mkdir d1/d3/d20/d22/d50/d61/d66/d97 0 2024-05-09T06:29:33.583 INFO:tasks.workunit.client.1.smithi079.stdout:7/393: truncate d4/d7/d37/f4a 689278 0 2024-05-09T06:29:33.588 INFO:tasks.workunit.client.1.smithi079.stdout:3/421: dread d1a/d1d/d34/d42/f47 [0,4194304] 0 2024-05-09T06:29:33.588 INFO:tasks.workunit.client.1.smithi079.stdout:3/422: chown d1a/d1d/d3a/d54 1959 1 2024-05-09T06:29:33.591 INFO:tasks.workunit.client.1.smithi079.stdout:3/423: mkdir d1a/d1d/d80 0 2024-05-09T06:29:33.598 INFO:tasks.workunit.client.1.smithi079.stdout:7/394: write d4/f64 [3320723,126997] 0 2024-05-09T06:29:33.604 INFO:tasks.workunit.client.1.smithi079.stdout:3/424: read f3 [3913648,82379] 0 2024-05-09T06:29:33.604 INFO:tasks.workunit.client.1.smithi079.stdout:3/425: write d1a/d21/f51 [643232,19225] 0 2024-05-09T06:29:33.604 INFO:tasks.workunit.client.1.smithi079.stdout:3/426: fsync f19 0 2024-05-09T06:29:33.604 INFO:tasks.workunit.client.1.smithi079.stdout:3/427: stat d1a/d1d/d3a/f46 0 2024-05-09T06:29:33.605 INFO:tasks.workunit.client.1.smithi079.stdout:8/412: dwrite d1/d3/d20/d7f/d33/d5d/d6d/f88 [0,4194304] 0 2024-05-09T06:29:33.605 INFO:tasks.workunit.client.1.smithi079.stdout:4/515: dwrite d6/dd/fa2 [0,4194304] 0 2024-05-09T06:29:33.606 INFO:tasks.workunit.client.1.smithi079.stdout:4/516: fdatasync d6/d8/f83 0 2024-05-09T06:29:33.606 INFO:tasks.workunit.client.1.smithi079.stdout:4/517: write d6/d8/d27/d3d/d5b/d9a/f8a [137525,3502] 0 2024-05-09T06:29:33.606 INFO:tasks.workunit.client.1.smithi079.stdout:4/518: write d6/d1a/d26/d2a/f2d [917430,119642] 0 2024-05-09T06:29:33.606 INFO:tasks.workunit.client.1.smithi079.stdout:3/428: unlink fa 0 2024-05-09T06:29:33.613 INFO:tasks.workunit.client.1.smithi079.stdout:4/519: mkdir d6/d8/d80/da6 0 2024-05-09T06:29:33.614 INFO:tasks.workunit.client.1.smithi079.stdout:3/429: creat d1a/d1d/d34/d42/f81 x:0 0 0 2024-05-09T06:29:33.615 INFO:tasks.workunit.client.1.smithi079.stdout:7/395: dwrite d4/d7/dd/d5b/d31/d34/f3c [0,4194304] 0 2024-05-09T06:29:33.616 INFO:tasks.workunit.client.1.smithi079.stdout:5/448: rename d13/d43/d82 to d13/d43/d3d/d40/d63/da2 0 2024-05-09T06:29:33.619 INFO:tasks.workunit.client.1.smithi079.stdout:3/430: rmdir d1a/d1d/d80 0 2024-05-09T06:29:33.622 INFO:tasks.workunit.client.1.smithi079.stdout:3/431: dread d1a/f3d [0,4194304] 0 2024-05-09T06:29:33.622 INFO:tasks.workunit.client.1.smithi079.stdout:3/432: write d1a/d1c/d22/d53/f43 [655409,116555] 0 2024-05-09T06:29:33.625 INFO:tasks.workunit.client.1.smithi079.stdout:6/394: rename d0/d6/d1b/f4b to d0/d6/d16/d1f/d36/d69/f7b 0 2024-05-09T06:29:33.625 INFO:tasks.workunit.client.1.smithi079.stdout:6/395: getdents d0/d6/d16/d1f/d36 0 2024-05-09T06:29:33.625 INFO:tasks.workunit.client.1.smithi079.stdout:6/396: fdatasync d0/d6/d16/d28/f72 0 2024-05-09T06:29:33.626 INFO:tasks.workunit.client.1.smithi079.stdout:5/449: creat d13/d92/fa3 x:0 0 0 2024-05-09T06:29:33.630 INFO:tasks.workunit.client.1.smithi079.stdout:3/433: dread d1a/f2c [0,4194304] 0 2024-05-09T06:29:33.630 INFO:tasks.workunit.client.1.smithi079.stdout:3/434: fsync f19 0 2024-05-09T06:29:33.630 INFO:tasks.workunit.client.1.smithi079.stdout:6/397: dread d0/d6/d1b/d20/f2b [0,4194304] 0 2024-05-09T06:29:33.631 INFO:tasks.workunit.client.1.smithi079.stdout:0/341: rename d3/dd/f46 to d3/d5/d27/f67 0 2024-05-09T06:29:33.632 INFO:tasks.workunit.client.1.smithi079.stdout:3/435: rmdir d1a/d1d/d3a/d61 0 2024-05-09T06:29:33.634 INFO:tasks.workunit.client.1.smithi079.stdout:0/342: truncate d3/dd/d1f/d1e/f42 349839 0 2024-05-09T06:29:33.636 INFO:tasks.workunit.client.1.smithi079.stdout:8/413: rename d1/d3/d20/d22/d3b/f59 to d1/d3/d20/d22/d50/d61/d66/d6c/d6b/f98 0 2024-05-09T06:29:33.636 INFO:tasks.workunit.client.1.smithi079.stdout:3/436: getdents d1a/d1c/d22/d53/d4e 0 2024-05-09T06:29:33.638 INFO:tasks.workunit.client.1.smithi079.stdout:6/398: rename d0/d6/cb to d0/d60/c7c 0 2024-05-09T06:29:33.639 INFO:tasks.workunit.client.1.smithi079.stdout:6/399: write d0/d6/d16/d28/f58 [646438,113615] 0 2024-05-09T06:29:33.640 INFO:tasks.workunit.client.1.smithi079.stdout:8/414: symlink d1/d3/d20/d22/l99 0 2024-05-09T06:29:33.640 INFO:tasks.workunit.client.1.smithi079.stdout:8/415: creat d1/d3/d20/d7f/d33/d5d/d6d/f9a x:0 0 0 2024-05-09T06:29:33.640 INFO:tasks.workunit.client.1.smithi079.stdout:4/520: dwrite d6/d8/d27/d3d/d5b/d9a/f86 [0,4194304] 0 2024-05-09T06:29:33.640 INFO:tasks.workunit.client.1.smithi079.stdout:4/521: readlink d6/dd/d34/l3a 0 2024-05-09T06:29:33.641 INFO:tasks.workunit.client.1.smithi079.stdout:3/437: readlink d1a/d1d/d34/l6a 0 2024-05-09T06:29:33.642 INFO:tasks.workunit.client.1.smithi079.stdout:7/396: dwrite d4/d7/dd/f6c [0,4194304] 0 2024-05-09T06:29:33.644 INFO:tasks.workunit.client.1.smithi079.stdout:6/400: rename d0/d6/d16/d1f/c2a to d0/c7d 0 2024-05-09T06:29:33.644 INFO:tasks.workunit.client.1.smithi079.stdout:6/401: write d0/d6/f74 [701177,49363] 0 2024-05-09T06:29:33.644 INFO:tasks.workunit.client.1.smithi079.stdout:6/402: write d0/d6/f76 [121167,30676] 0 2024-05-09T06:29:33.646 INFO:tasks.workunit.client.1.smithi079.stdout:4/522: mknod d6/dd/df/d8e/ca7 0 2024-05-09T06:29:33.646 INFO:tasks.workunit.client.1.smithi079.stdout:4/523: stat d6/dd/df/la4 0 2024-05-09T06:29:33.647 INFO:tasks.workunit.client.1.smithi079.stdout:4/524: write d6/f61 [200115,1893] 0 2024-05-09T06:29:33.648 INFO:tasks.workunit.client.1.smithi079.stdout:0/343: dread d3/d5/d27/f49 [0,4194304] 0 2024-05-09T06:29:33.648 INFO:tasks.workunit.client.1.smithi079.stdout:0/344: write d3/d5/d27/f49 [2302163,111008] 0 2024-05-09T06:29:33.651 INFO:tasks.workunit.client.1.smithi079.stdout:7/397: creat d4/d7/dd/d5b/d31/f75 x:0 0 0 2024-05-09T06:29:33.653 INFO:tasks.workunit.client.1.smithi079.stdout:4/525: mknod d6/d1a/d26/ca8 0 2024-05-09T06:29:33.654 INFO:tasks.workunit.client.1.smithi079.stdout:4/526: dread d6/d15/f5f [0,4194304] 0 2024-05-09T06:29:33.655 INFO:tasks.workunit.client.1.smithi079.stdout:0/345: rmdir d3 39 2024-05-09T06:29:33.656 INFO:tasks.workunit.client.1.smithi079.stdout:7/398: creat d4/d7/d22/d28/d74/f76 x:0 0 0 2024-05-09T06:29:33.657 INFO:tasks.workunit.client.1.smithi079.stdout:6/403: getdents d0/d6/d16/d1f/d6f 0 2024-05-09T06:29:33.658 INFO:tasks.workunit.client.1.smithi079.stdout:4/527: rmdir d6/d1a/d26/d2a/d98 39 2024-05-09T06:29:33.660 INFO:tasks.workunit.client.1.smithi079.stdout:0/346: rename d3/dd/d1f/d1e/d2c/d35/l55 to d3/dd/d1f/d1e/l68 0 2024-05-09T06:29:33.661 INFO:tasks.workunit.client.1.smithi079.stdout:0/347: write d3/dd/d18/d5e/f5a [1002705,115450] 0 2024-05-09T06:29:33.661 INFO:tasks.workunit.client.1.smithi079.stdout:4/528: creat d6/d1a/d41/d68/da1/fa9 x:0 0 0 2024-05-09T06:29:33.662 INFO:tasks.workunit.client.1.smithi079.stdout:7/399: rename d4/d7/d22/c3f to d4/d7/d22/d28/c77 0 2024-05-09T06:29:33.663 INFO:tasks.workunit.client.1.smithi079.stdout:0/348: mkdir d3/dd/d18/d5e/d69 0 2024-05-09T06:29:33.664 INFO:tasks.workunit.client.1.smithi079.stdout:4/529: mkdir d6/d8/d27/d3d/d5b/d9a/d8b/daa 0 2024-05-09T06:29:33.665 INFO:tasks.workunit.client.1.smithi079.stdout:7/400: mkdir d4/d7/d78 0 2024-05-09T06:29:33.665 INFO:tasks.workunit.client.1.smithi079.stdout:7/401: creat d4/d7/dd/d47/f79 x:0 0 0 2024-05-09T06:29:33.665 INFO:tasks.workunit.client.1.smithi079.stdout:0/349: symlink d3/l6a 0 2024-05-09T06:29:33.668 INFO:tasks.workunit.client.1.smithi079.stdout:4/530: unlink d6/l4c 0 2024-05-09T06:29:33.669 INFO:tasks.workunit.client.1.smithi079.stdout:0/350: dread d3/dd/d1f/d1e/d2c/d35/d36/f3d [0,4194304] 0 2024-05-09T06:29:33.671 INFO:tasks.workunit.client.1.smithi079.stdout:4/531: symlink d6/d90/lab 0 2024-05-09T06:29:33.671 INFO:tasks.workunit.client.1.smithi079.stdout:4/532: chown d6/d1a/d41/c84 154811936 1 2024-05-09T06:29:33.672 INFO:tasks.workunit.client.1.smithi079.stdout:6/404: dread d0/de/f59 [0,4194304] 0 2024-05-09T06:29:33.673 INFO:tasks.workunit.client.1.smithi079.stdout:8/416: dwrite d1/f1a [0,4194304] 0 2024-05-09T06:29:33.673 INFO:tasks.workunit.client.1.smithi079.stdout:3/438: dwrite d1a/d1c/d1f/f56 [0,4194304] 0 2024-05-09T06:29:33.673 INFO:tasks.workunit.client.1.smithi079.stdout:7/402: write d4/d7/dd/d5b/f44 [470884,164] 0 2024-05-09T06:29:33.673 INFO:tasks.workunit.client.1.smithi079.stdout:7/403: write d4/d7/d37/f57 [548514,116931] 0 2024-05-09T06:29:33.674 INFO:tasks.workunit.client.1.smithi079.stdout:7/404: write d4/d7/dd/d5b/d31/f75 [392877,42747] 0 2024-05-09T06:29:33.674 INFO:tasks.workunit.client.1.smithi079.stdout:7/405: chown d4/d7/dd/d5b/l39 586 1 2024-05-09T06:29:33.674 INFO:tasks.workunit.client.1.smithi079.stdout:8/417: read d1/d56/f81 [173670,100040] 0 2024-05-09T06:29:33.674 INFO:tasks.workunit.client.1.smithi079.stdout:4/533: creat d6/d1a/d26/d2a/d98/fac x:0 0 0 2024-05-09T06:29:33.675 INFO:tasks.workunit.client.1.smithi079.stdout:7/406: fdatasync d4/d7/dd/d5b/d31/f75 0 2024-05-09T06:29:33.677 INFO:tasks.workunit.client.1.smithi079.stdout:6/405: unlink d0/d6/d1b/d20/f2b 0 2024-05-09T06:29:33.684 INFO:tasks.workunit.client.1.smithi079.stdout:7/407: write d4/d7/dd/d5b/f3a [2816638,41739] 0 2024-05-09T06:29:33.684 INFO:tasks.workunit.client.1.smithi079.stdout:7/408: write d4/d7/d37/f68 [858994,2322] 0 2024-05-09T06:29:33.686 INFO:tasks.workunit.client.1.smithi079.stdout:3/439: mkdir d1a/d82 0 2024-05-09T06:29:33.691 INFO:tasks.workunit.client.1.smithi079.stdout:6/406: symlink d0/l7e 0 2024-05-09T06:29:33.695 INFO:tasks.workunit.client.1.smithi079.stdout:7/409: creat d4/d7/dd/d5b/d31/d34/f7a x:0 0 0 2024-05-09T06:29:33.697 INFO:tasks.workunit.client.1.smithi079.stdout:8/418: symlink d1/d3/l9b 0 2024-05-09T06:29:33.700 INFO:tasks.workunit.client.1.smithi079.stdout:1/416: sync 2024-05-09T06:29:33.701 INFO:tasks.workunit.client.1.smithi079.stdout:9/554: dwrite d1/d33/d28/d36/d4d/d7d/f22 [0,4194304] 0 2024-05-09T06:29:33.702 INFO:tasks.workunit.client.1.smithi079.stdout:4/534: dwrite d6/d1a/d26/d2a/f8c [0,4194304] 0 2024-05-09T06:29:33.702 INFO:tasks.workunit.client.1.smithi079.stdout:0/351: dwrite d3/f39 [0,4194304] 0 2024-05-09T06:29:33.703 INFO:tasks.workunit.client.1.smithi079.stdout:7/410: rename d4/d7/d22/d28/l51 to d4/d7/dd/d5b/d32/l7b 0 2024-05-09T06:29:33.703 INFO:tasks.workunit.client.1.smithi079.stdout:7/411: readlink d4/d7/dd/d5b/l5a 0 2024-05-09T06:29:33.703 INFO:tasks.workunit.client.1.smithi079.stdout:7/412: write d4/d7/dd/d5b/f3a [1571309,14167] 0 2024-05-09T06:29:33.705 INFO:tasks.workunit.client.1.smithi079.stdout:1/417: mkdir d0/d12/d67/d93 0 2024-05-09T06:29:33.705 INFO:tasks.workunit.client.1.smithi079.stdout:1/418: write d0/d12/f18 [3594626,103749] 0 2024-05-09T06:29:33.705 INFO:tasks.workunit.client.1.smithi079.stdout:1/419: read d0/f4a [56836,66602] 0 2024-05-09T06:29:33.705 INFO:tasks.workunit.client.1.smithi079.stdout:3/440: dwrite d1a/d1d/f2f [0,4194304] 0 2024-05-09T06:29:33.705 INFO:tasks.workunit.client.1.smithi079.stdout:3/441: truncate f3 4280489 0 2024-05-09T06:29:33.706 INFO:tasks.workunit.client.1.smithi079.stdout:2/428: sync 2024-05-09T06:29:33.716 INFO:tasks.workunit.client.1.smithi079.stdout:4/535: mkdir d6/d1a/d41/d68/da1/dad 0 2024-05-09T06:29:33.717 INFO:tasks.workunit.client.1.smithi079.stdout:4/536: write d6/d8/d27/f46 [9134911,71536] 0 2024-05-09T06:29:33.717 INFO:tasks.workunit.client.1.smithi079.stdout:7/413: write d4/d7/dd/d5b/d32/f3b [3124587,42555] 0 2024-05-09T06:29:33.722 INFO:tasks.workunit.client.1.smithi079.stdout:0/352: symlink d3/dd/d18/d5e/l6b 0 2024-05-09T06:29:33.726 INFO:tasks.workunit.client.1.smithi079.stdout:9/555: rename d1/d33/f76 to d1/d6/dae/fbb 0 2024-05-09T06:29:33.734 INFO:tasks.workunit.client.1.smithi079.stdout:2/429: link d8/db/dc/d2c/d2e/f3e d8/db/dc/d2c/d2e/fa3 0 2024-05-09T06:29:33.736 INFO:tasks.workunit.client.1.smithi079.stdout:6/407: dwrite d0/fc [0,4194304] 0 2024-05-09T06:29:33.736 INFO:tasks.workunit.client.1.smithi079.stdout:4/537: mknod d6/d8/d27/d3d/d5b/d9a/d8b/daa/cae 0 2024-05-09T06:29:33.737 INFO:tasks.workunit.client.1.smithi079.stdout:8/419: dwrite d1/d3/f84 [0,4194304] 0 2024-05-09T06:29:33.737 INFO:tasks.workunit.client.1.smithi079.stdout:1/420: dwrite d0/d12/d16/f19 [0,4194304] 0 2024-05-09T06:29:33.738 INFO:tasks.workunit.client.1.smithi079.stdout:7/414: dwrite d4/d7/d22/f40 [0,4194304] 0 2024-05-09T06:29:33.738 INFO:tasks.workunit.client.1.smithi079.stdout:7/415: fsync d4/d7/f6e 0 2024-05-09T06:29:33.739 INFO:tasks.workunit.client.1.smithi079.stdout:4/538: write d6/dd/df/f3b [1829233,73314] 0 2024-05-09T06:29:33.745 INFO:tasks.workunit.client.1.smithi079.stdout:9/556: mknod d1/d33/d28/d36/d4d/d7d/d19/db8/cbc 0 2024-05-09T06:29:33.750 INFO:tasks.workunit.client.1.smithi079.stdout:0/353: dwrite d3/dd/f53 [0,4194304] 0 2024-05-09T06:29:33.753 INFO:tasks.workunit.client.1.smithi079.stdout:1/421: mkdir d0/d7/d4e/d7d/d94 0 2024-05-09T06:29:33.753 INFO:tasks.workunit.client.1.smithi079.stdout:1/422: write d0/d12/d48/d75/d43/d20/f91 [223728,118804] 0 2024-05-09T06:29:33.753 INFO:tasks.workunit.client.1.smithi079.stdout:1/423: readlink d0/d12/d48/d75/d43/d20/l2a 0 2024-05-09T06:29:33.758 INFO:tasks.workunit.client.1.smithi079.stdout:7/416: mkdir d4/d7/d37/d7c 0 2024-05-09T06:29:33.759 INFO:tasks.workunit.client.1.smithi079.stdout:7/417: chown d4/d7/dd/d5b 11636169 1 2024-05-09T06:29:33.759 INFO:tasks.workunit.client.1.smithi079.stdout:9/557: dwrite d1/d33/d28/d36/d4d/d7d/f22 [0,4194304] 0 2024-05-09T06:29:33.759 INFO:tasks.workunit.client.1.smithi079.stdout:9/558: chown d1/d5/d9a/f73 16391381 1 2024-05-09T06:29:33.772 INFO:tasks.workunit.client.1.smithi079.stdout:3/442: rename d1a/d1d/c64 to d1a/d1d/d34/c83 0 2024-05-09T06:29:33.792 INFO:tasks.workunit.client.1.smithi079.stdout:0/354: creat d3/dd/d18/d5e/d69/f6c x:0 0 0 2024-05-09T06:29:33.792 INFO:tasks.workunit.client.1.smithi079.stdout:0/355: write d3/dd/d18/f34 [523246,128090] 0 2024-05-09T06:29:33.794 INFO:tasks.workunit.client.1.smithi079.stdout:7/418: symlink d4/d7/l7d 0 2024-05-09T06:29:33.794 INFO:tasks.workunit.client.1.smithi079.stdout:7/419: fdatasync d4/d7/dd/f42 0 2024-05-09T06:29:33.801 INFO:tasks.workunit.client.1.smithi079.stdout:4/539: getdents d6/d1a/d41/d68/da1 0 2024-05-09T06:29:33.803 INFO:tasks.workunit.client.1.smithi079.stdout:2/430: rename d8/db/d11/d79/f8a to d8/db/d4b/d4f/d51/fa4 0 2024-05-09T06:29:33.804 INFO:tasks.workunit.client.1.smithi079.stdout:2/431: dread d8/db/d5c/f81 [0,4194304] 0 2024-05-09T06:29:33.805 INFO:tasks.workunit.client.1.smithi079.stdout:0/356: unlink d3/d5/ff 0 2024-05-09T06:29:33.805 INFO:tasks.workunit.client.1.smithi079.stdout:0/357: chown d3/d5/d27/f32 17844 1 2024-05-09T06:29:33.807 INFO:tasks.workunit.client.1.smithi079.stdout:7/420: mknod d4/d7/c7e 0 2024-05-09T06:29:33.807 INFO:tasks.workunit.client.1.smithi079.stdout:7/421: stat d4/d7/f18 0 2024-05-09T06:29:33.807 INFO:tasks.workunit.client.1.smithi079.stdout:7/422: truncate d4/d7/dd/f24 963315 0 2024-05-09T06:29:33.807 INFO:tasks.workunit.client.1.smithi079.stdout:0/358: dread d3/dd/d1f/f29 [0,4194304] 0 2024-05-09T06:29:33.809 INFO:tasks.workunit.client.1.smithi079.stdout:9/559: getdents d1/d33/d28/d4c/d4e/d2d 0 2024-05-09T06:29:33.812 INFO:tasks.workunit.client.1.smithi079.stdout:4/540: unlink d6/d1a/d26/d2a/d98/fa3 0 2024-05-09T06:29:33.815 INFO:tasks.workunit.client.1.smithi079.stdout:6/408: rename d0/de/l1a to d0/d6/d16/d1f/d6f/l7f 0 2024-05-09T06:29:33.817 INFO:tasks.workunit.client.1.smithi079.stdout:2/432: rmdir d8/db/d59/d67 39 2024-05-09T06:29:33.819 INFO:tasks.workunit.client.1.smithi079.stdout:7/423: mknod d4/d7/d22/d28/c7f 0 2024-05-09T06:29:33.819 INFO:tasks.workunit.client.1.smithi079.stdout:7/424: creat d4/d7/dd/d5b/d6f/f80 x:0 0 0 2024-05-09T06:29:33.820 INFO:tasks.workunit.client.1.smithi079.stdout:4/541: rmdir d6/d8/d27/d3d 39 2024-05-09T06:29:33.820 INFO:tasks.workunit.client.1.smithi079.stdout:4/542: write d6/d1a/d26/d2a/f2d [748663,69953] 0 2024-05-09T06:29:33.823 INFO:tasks.workunit.client.1.smithi079.stdout:6/409: symlink d0/de/l80 0 2024-05-09T06:29:33.824 INFO:tasks.workunit.client.1.smithi079.stdout:7/425: dread d4/d7/dd/d5b/f44 [0,4194304] 0 2024-05-09T06:29:33.824 INFO:tasks.workunit.client.1.smithi079.stdout:7/426: creat d4/d7/dd/d5b/d31/f81 x:0 0 0 2024-05-09T06:29:33.824 INFO:tasks.workunit.client.1.smithi079.stdout:6/410: dread d0/f65 [0,4194304] 0 2024-05-09T06:29:33.827 INFO:tasks.workunit.client.1.smithi079.stdout:9/560: rename d1/d33/d2b/f32 to d1/d33/d28/d4c/d4e/fbd 0 2024-05-09T06:29:33.828 INFO:tasks.workunit.client.1.smithi079.stdout:9/561: dread - d1/d33/d28/d36/d4d/fa2 zero size 2024-05-09T06:29:33.828 INFO:tasks.workunit.client.1.smithi079.stdout:9/562: readlink d1/d33/d28/d36/d38/d3a/l8c 0 2024-05-09T06:29:33.828 INFO:tasks.workunit.client.1.smithi079.stdout:4/543: dread d6/d8/d27/d3d/d5b/f87 [0,4194304] 0 2024-05-09T06:29:33.831 INFO:tasks.workunit.client.1.smithi079.stdout:6/411: stat d0/d6/c75 0 2024-05-09T06:29:33.831 INFO:tasks.workunit.client.1.smithi079.stdout:6/412: dread - d0/d6/d16/d28/f72 zero size 2024-05-09T06:29:33.831 INFO:tasks.workunit.client.1.smithi079.stdout:0/359: dwrite d3/dd/f53 [0,4194304] 0 2024-05-09T06:29:33.832 INFO:tasks.workunit.client.1.smithi079.stdout:9/563: mkdir d1/d33/d28/d36/dbe 0 2024-05-09T06:29:33.833 INFO:tasks.workunit.client.1.smithi079.stdout:9/564: stat d1/d33/d28/d36/d4d/f8a 0 2024-05-09T06:29:33.834 INFO:tasks.workunit.client.1.smithi079.stdout:7/427: truncate d4/d7/dd/d5b/f3a 2597682 0 2024-05-09T06:29:33.838 INFO:tasks.workunit.client.1.smithi079.stdout:0/360: mkdir d3/dd/d66/d6d 0 2024-05-09T06:29:33.844 INFO:tasks.workunit.client.1.smithi079.stdout:0/361: symlink d3/dd/d1f/d1e/l6e 0 2024-05-09T06:29:33.846 INFO:tasks.workunit.client.1.smithi079.stdout:7/428: getdents d4/d7/d37 0 2024-05-09T06:29:33.847 INFO:tasks.workunit.client.1.smithi079.stdout:7/429: readlink d4/d7/d22/l65 0 2024-05-09T06:29:33.847 INFO:tasks.workunit.client.1.smithi079.stdout:7/430: write d4/d7/d22/f2f [568016,41171] 0 2024-05-09T06:29:33.847 INFO:tasks.workunit.client.1.smithi079.stdout:7/431: chown d4/d7/d22/d28/d50/d5c 1872382798 1 2024-05-09T06:29:33.848 INFO:tasks.workunit.client.1.smithi079.stdout:4/544: dwrite d6/d1a/d41/d68/d6b/f96 [0,4194304] 0 2024-05-09T06:29:33.849 INFO:tasks.workunit.client.1.smithi079.stdout:4/545: write d6/d8/f4f [2489788,113123] 0 2024-05-09T06:29:33.849 INFO:tasks.workunit.client.1.smithi079.stdout:0/362: dread d3/dd/d18/f34 [0,4194304] 0 2024-05-09T06:29:33.849 INFO:tasks.workunit.client.1.smithi079.stdout:7/432: unlink d4/d7/d22/f40 0 2024-05-09T06:29:33.850 INFO:tasks.workunit.client.1.smithi079.stdout:6/413: dwrite d0/f65 [0,4194304] 0 2024-05-09T06:29:33.858 INFO:tasks.workunit.client.1.smithi079.stdout:4/546: symlink d6/d1a/d26/d2a/d54/laf 0 2024-05-09T06:29:33.858 INFO:tasks.workunit.client.1.smithi079.stdout:7/433: mknod d4/d7/d78/c82 0 2024-05-09T06:29:33.865 INFO:tasks.workunit.client.1.smithi079.stdout:6/414: mkdir d0/d60/d81 0 2024-05-09T06:29:33.874 INFO:tasks.workunit.client.1.smithi079.stdout:4/547: symlink d6/d8/d27/d3d/lb0 0 2024-05-09T06:29:33.878 INFO:tasks.workunit.client.1.smithi079.stdout:4/548: rename d6/d15/f31 to d6/d1a/d41/d68/da1/fb1 0 2024-05-09T06:29:33.879 INFO:tasks.workunit.client.1.smithi079.stdout:9/565: dwrite d1/d33/d28/d36/d4d/d7d/d19/fa3 [0,4194304] 0 2024-05-09T06:29:33.879 INFO:tasks.workunit.client.1.smithi079.stdout:9/566: chown d1/d33/d28/d36/d38/d3a/la8 34803 1 2024-05-09T06:29:33.879 INFO:tasks.workunit.client.1.smithi079.stdout:0/363: dwrite d3/dd/d1f/d1e/d2c/d35/d36/f3d [0,4194304] 0 2024-05-09T06:29:33.880 INFO:tasks.workunit.client.1.smithi079.stdout:7/434: dwrite d4/d7/dd/d5b/d31/d34/f7a [0,4194304] 0 2024-05-09T06:29:33.881 INFO:tasks.workunit.client.1.smithi079.stdout:4/549: creat d6/d8/d27/fb2 x:0 0 0 2024-05-09T06:29:33.888 INFO:tasks.workunit.client.1.smithi079.stdout:6/415: dwrite d0/d6/d16/d28/f67 [0,4194304] 0 2024-05-09T06:29:33.888 INFO:tasks.workunit.client.1.smithi079.stdout:6/416: dread - d0/d6/d1b/d2d/f4c zero size 2024-05-09T06:29:33.891 INFO:tasks.workunit.client.1.smithi079.stdout:9/567: dread d1/d5/ff [0,4194304] 0 2024-05-09T06:29:33.896 INFO:tasks.workunit.client.1.smithi079.stdout:7/435: rename d4/d7/d22/c2e to d4/d7/dd/d47/c83 0 2024-05-09T06:29:33.898 INFO:tasks.workunit.client.1.smithi079.stdout:4/550: symlink d6/dd/df/d8e/lb3 0 2024-05-09T06:29:33.902 INFO:tasks.workunit.client.1.smithi079.stdout:6/417: dwrite d0/d6/d1b/d2d/f4c [0,4194304] 0 2024-05-09T06:29:33.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/568: rename d1/d6/dae/db0 to d1/d33/d48/dbf 0 2024-05-09T06:29:33.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/569: read d1/d45/f59 [869119,89537] 0 2024-05-09T06:29:33.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/570: stat d1/d5/lb7 0 2024-05-09T06:29:33.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/571: rename d1/d33/d28/d4c/d4e to d1/d33/d28/d4c/d4e/d2d/d99/dc0 22 2024-05-09T06:29:33.906 INFO:tasks.workunit.client.1.smithi079.stdout:7/436: mkdir d4/d7/d22/d28/d50/d5c/d84 0 2024-05-09T06:29:33.907 INFO:tasks.workunit.client.1.smithi079.stdout:4/551: rmdir d6/d15 39 2024-05-09T06:29:33.912 INFO:tasks.workunit.client.1.smithi079.stdout:9/572: write d1/d33/f37 [3939899,51359] 0 2024-05-09T06:29:33.912 INFO:tasks.workunit.client.1.smithi079.stdout:9/573: fsync d1/d5/d9a/f73 0 2024-05-09T06:29:33.912 INFO:tasks.workunit.client.1.smithi079.stdout:9/574: write d1/d33/d28/d36/d4d/d7d/d19/f1e [4312590,41044] 0 2024-05-09T06:29:33.912 INFO:tasks.workunit.client.1.smithi079.stdout:6/418: mknod d0/d60/d81/c82 0 2024-05-09T06:29:33.912 INFO:tasks.workunit.client.1.smithi079.stdout:6/419: creat d0/d6/f83 x:0 0 0 2024-05-09T06:29:33.913 INFO:tasks.workunit.client.1.smithi079.stdout:4/552: mkdir d6/d8/d27/d3d/d5b/db4 0 2024-05-09T06:29:33.914 INFO:tasks.workunit.client.1.smithi079.stdout:4/553: chown d6/d8/d27/d62/l3f 1266672 1 2024-05-09T06:29:33.918 INFO:tasks.workunit.client.1.smithi079.stdout:6/420: stat d0/d6/d1b/d2d/l2e 0 2024-05-09T06:29:33.918 INFO:tasks.workunit.client.1.smithi079.stdout:6/421: getdents d0/d6/d16/d1f/d36 0 2024-05-09T06:29:33.920 INFO:tasks.workunit.client.1.smithi079.stdout:4/554: truncate d6/d1a/d26/d2a/f8c 2795143 0 2024-05-09T06:29:33.922 INFO:tasks.workunit.client.1.smithi079.stdout:9/575: mknod d1/d33/d28/d4c/d4e/cc1 0 2024-05-09T06:29:33.922 INFO:tasks.workunit.client.1.smithi079.stdout:9/576: dread - d1/d45/f86 zero size 2024-05-09T06:29:33.922 INFO:tasks.workunit.client.1.smithi079.stdout:9/577: write d1/d33/d28/d3e/d75/f77 [1904768,102335] 0 2024-05-09T06:29:33.922 INFO:tasks.workunit.client.1.smithi079.stdout:9/578: write d1/d33/d28/d36/d4d/d7d/d19/f55 [1142643,66694] 0 2024-05-09T06:29:33.923 INFO:tasks.workunit.client.1.smithi079.stdout:6/422: mkdir d0/d6/d16/d1f/d36/d69/d84 0 2024-05-09T06:29:33.923 INFO:tasks.workunit.client.1.smithi079.stdout:6/423: truncate d0/de/f43 1075957 0 2024-05-09T06:29:33.923 INFO:tasks.workunit.client.1.smithi079.stdout:6/424: creat d0/de/f85 x:0 0 0 2024-05-09T06:29:33.925 INFO:tasks.workunit.client.1.smithi079.stdout:4/555: mknod d6/d8/d27/d3d/d5b/d9a/cb5 0 2024-05-09T06:29:33.927 INFO:tasks.workunit.client.1.smithi079.stdout:9/579: mknod d1/d33/d28/d36/d38/d3a/d56/cc2 0 2024-05-09T06:29:33.927 INFO:tasks.workunit.client.1.smithi079.stdout:9/580: getdents d1/d33/d28/d4c/d4e/d2d/d99 0 2024-05-09T06:29:33.927 INFO:tasks.workunit.client.1.smithi079.stdout:9/581: stat d1/d33/d28/d4c/d4e/fb3 0 2024-05-09T06:29:33.927 INFO:tasks.workunit.client.1.smithi079.stdout:9/582: write d1/d5/f58 [640255,86777] 0 2024-05-09T06:29:33.927 INFO:tasks.workunit.client.1.smithi079.stdout:9/583: chown d1/d33/d28/d36 3107672 1 2024-05-09T06:29:33.927 INFO:tasks.workunit.client.1.smithi079.stdout:9/584: creat d1/d33/d28/d3e/d75/fc3 x:0 0 0 2024-05-09T06:29:33.928 INFO:tasks.workunit.client.1.smithi079.stdout:6/425: rmdir d0/d60/d81 39 2024-05-09T06:29:33.930 INFO:tasks.workunit.client.1.smithi079.stdout:9/585: write d1/f29 [230945,69517] 0 2024-05-09T06:29:33.930 INFO:tasks.workunit.client.1.smithi079.stdout:9/586: chown d1/f29 0 1 2024-05-09T06:29:33.931 INFO:tasks.workunit.client.1.smithi079.stdout:9/587: fsync d1/d5/d5b/f71 0 2024-05-09T06:29:33.935 INFO:tasks.workunit.client.1.smithi079.stdout:6/426: mknod d0/d6/d16/d1f/c86 0 2024-05-09T06:29:33.937 INFO:tasks.workunit.client.1.smithi079.stdout:8/420: sync 2024-05-09T06:29:33.937 INFO:tasks.workunit.client.1.smithi079.stdout:5/450: sync 2024-05-09T06:29:33.937 INFO:tasks.workunit.client.1.smithi079.stdout:5/451: dread - d13/d43/d39/d61/f94 zero size 2024-05-09T06:29:33.937 INFO:tasks.workunit.client.1.smithi079.stdout:8/421: write d1/d3/fa [4342713,9170] 0 2024-05-09T06:29:33.937 INFO:tasks.workunit.client.1.smithi079.stdout:5/452: write d13/d92/fa3 [934452,4652] 0 2024-05-09T06:29:33.937 INFO:tasks.workunit.client.1.smithi079.stdout:4/556: dwrite d6/d8/d27/f2e [0,4194304] 0 2024-05-09T06:29:33.940 INFO:tasks.workunit.client.1.smithi079.stdout:5/453: link d13/d2a/f7e d13/d43/d9e/fa4 0 2024-05-09T06:29:33.945 INFO:tasks.workunit.client.1.smithi079.stdout:8/422: creat d1/d3/d20/d22/f9c x:0 0 0 2024-05-09T06:29:33.950 INFO:tasks.workunit.client.1.smithi079.stdout:8/423: dread d1/d5/dc/f1d [0,4194304] 0 2024-05-09T06:29:33.950 INFO:tasks.workunit.client.1.smithi079.stdout:8/424: fdatasync d1/f91 0 2024-05-09T06:29:33.958 INFO:tasks.workunit.client.1.smithi079.stdout:6/427: dwrite d0/de/f48 [0,4194304] 0 2024-05-09T06:29:33.960 INFO:tasks.workunit.client.1.smithi079.stdout:5/454: dwrite d13/f17 [0,4194304] 0 2024-05-09T06:29:33.960 INFO:tasks.workunit.client.1.smithi079.stdout:8/425: rmdir d1/d3/d20/d22/d44/d8c 0 2024-05-09T06:29:33.961 INFO:tasks.workunit.client.1.smithi079.stdout:8/426: write d1/d3/f17 [2025615,104524] 0 2024-05-09T06:29:33.962 INFO:tasks.workunit.client.1.smithi079.stdout:8/427: read d1/db/f4f [417488,101743] 0 2024-05-09T06:29:33.962 INFO:tasks.workunit.client.1.smithi079.stdout:8/428: fsync d1/d5/dc/f1b 0 2024-05-09T06:29:33.962 INFO:tasks.workunit.client.1.smithi079.stdout:8/429: creat d1/d3/d20/d22/d50/d61/f9d x:0 0 0 2024-05-09T06:29:33.962 INFO:tasks.workunit.client.1.smithi079.stdout:6/428: link d0/d6/d1b/d20/l2c d0/d6/d16/d1f/l87 0 2024-05-09T06:29:33.965 INFO:tasks.workunit.client.1.smithi079.stdout:9/588: rmdir d1/d33/d28/d4c/d4e 39 2024-05-09T06:29:33.969 INFO:tasks.workunit.client.1.smithi079.stdout:9/589: dread d1/d33/d28/d36/f7b [0,4194304] 0 2024-05-09T06:29:33.971 INFO:tasks.workunit.client.1.smithi079.stdout:4/557: dread d6/d1a/d26/d2a/f8c [0,4194304] 0 2024-05-09T06:29:33.978 INFO:tasks.workunit.client.1.smithi079.stdout:6/429: dwrite d0/d6/d16/d1f/f41 [0,4194304] 0 2024-05-09T06:29:33.979 INFO:tasks.workunit.client.1.smithi079.stdout:5/455: rmdir d13/d59 0 2024-05-09T06:29:33.979 INFO:tasks.workunit.client.1.smithi079.stdout:5/456: fdatasync d13/d43/d26/d35/f5e 0 2024-05-09T06:29:33.979 INFO:tasks.workunit.client.1.smithi079.stdout:5/457: write d13/f1a [5342849,109012] 0 2024-05-09T06:29:33.987 INFO:tasks.workunit.client.1.smithi079.stdout:9/590: creat d1/d33/d28/d36/d4d/d7d/fc4 x:0 0 0 2024-05-09T06:29:33.989 INFO:tasks.workunit.client.1.smithi079.stdout:4/558: rename d6/d8/d27/d3d/d5b/d9a/f95 to d6/d8/d27/d3d/d5b/db4/fb6 0 2024-05-09T06:29:33.989 INFO:tasks.workunit.client.1.smithi079.stdout:4/559: write d6/fa [1690984,118098] 0 2024-05-09T06:29:33.991 INFO:tasks.workunit.client.1.smithi079.stdout:6/430: unlink d0/d6/d1b/f62 0 2024-05-09T06:29:33.993 INFO:tasks.workunit.client.1.smithi079.stdout:5/458: truncate d13/d43/d3d/f85 684169 0 2024-05-09T06:29:33.996 INFO:tasks.workunit.client.1.smithi079.stdout:8/430: link d1/d3/d20/d22/d3f/l77 d1/d3/d20/d22/d3b/l9e 0 2024-05-09T06:29:33.996 INFO:tasks.workunit.client.1.smithi079.stdout:8/431: chown d1/f8 12748201 1 2024-05-09T06:29:33.996 INFO:tasks.workunit.client.1.smithi079.stdout:8/432: creat d1/d3/d20/d22/f9f x:0 0 0 2024-05-09T06:29:33.996 INFO:tasks.workunit.client.1.smithi079.stdout:8/433: stat d1/db 0 2024-05-09T06:29:34.005 INFO:tasks.workunit.client.1.smithi079.stdout:6/431: mknod d0/d6/c88 0 2024-05-09T06:29:34.009 INFO:tasks.workunit.client.1.smithi079.stdout:9/591: dwrite d1/f9f [0,4194304] 0 2024-05-09T06:29:34.010 INFO:tasks.workunit.client.1.smithi079.stdout:4/560: dwrite d6/d1a/f75 [0,4194304] 0 2024-05-09T06:29:34.011 INFO:tasks.workunit.client.1.smithi079.stdout:8/434: rename d1/d3/d20/d22/d50/d61/d66/d97 to d1/d5/d36/da0 0 2024-05-09T06:29:34.013 INFO:tasks.workunit.client.1.smithi079.stdout:6/432: mknod d0/d6/d16/d28/c89 0 2024-05-09T06:29:34.016 INFO:tasks.workunit.client.1.smithi079.stdout:3/443: sync 2024-05-09T06:29:34.016 INFO:tasks.workunit.client.1.smithi079.stdout:1/424: sync 2024-05-09T06:29:34.027 INFO:tasks.workunit.client.1.smithi079.stdout:5/459: rmdir d13/d43 39 2024-05-09T06:29:34.036 INFO:tasks.workunit.client.1.smithi079.stdout:4/561: mkdir d6/d1a/d41/d68/da1/dad/db7 0 2024-05-09T06:29:34.038 INFO:tasks.workunit.client.1.smithi079.stdout:4/562: write d6/d8/d27/d3d/f64 [351622,11279] 0 2024-05-09T06:29:34.038 INFO:tasks.workunit.client.1.smithi079.stdout:8/435: stat d1/l2 0 2024-05-09T06:29:34.038 INFO:tasks.workunit.client.1.smithi079.stdout:8/436: chown d1/d3/d20/d22/d50/d61/d66/d6c/c76 569 1 2024-05-09T06:29:34.041 INFO:tasks.workunit.client.1.smithi079.stdout:6/433: creat d0/d6/d1b/d20/f8a x:0 0 0 2024-05-09T06:29:34.041 INFO:tasks.workunit.client.1.smithi079.stdout:6/434: stat d0/d6/d16/d28 0 2024-05-09T06:29:34.041 INFO:tasks.workunit.client.1.smithi079.stdout:6/435: readlink d0/de/l80 0 2024-05-09T06:29:34.041 INFO:tasks.workunit.client.1.smithi079.stdout:6/436: read - d0/de/f85 zero size 2024-05-09T06:29:34.043 INFO:tasks.workunit.client.1.smithi079.stdout:2/433: sync 2024-05-09T06:29:34.043 INFO:tasks.workunit.client.1.smithi079.stdout:0/364: sync 2024-05-09T06:29:34.047 INFO:tasks.workunit.client.1.smithi079.stdout:3/444: symlink d1a/d1c/d1f/d3f/l84 0 2024-05-09T06:29:34.049 INFO:tasks.workunit.client.1.smithi079.stdout:1/425: symlink d0/d7/d4e/d7d/d94/l95 0 2024-05-09T06:29:34.049 INFO:tasks.workunit.client.1.smithi079.stdout:1/426: dread - d0/d7/f7b zero size 2024-05-09T06:29:34.049 INFO:tasks.workunit.client.1.smithi079.stdout:1/427: chown d0/d12/d67/d93 10362 1 2024-05-09T06:29:34.049 INFO:tasks.workunit.client.1.smithi079.stdout:1/428: chown d0/d12/d67/f41 343 1 2024-05-09T06:29:34.050 INFO:tasks.workunit.client.1.smithi079.stdout:5/460: dwrite d13/d43/d39/f86 [0,4194304] 0 2024-05-09T06:29:34.052 INFO:tasks.workunit.client.1.smithi079.stdout:9/592: rename d1/d33/d28/d3e/l43 to d1/d6/lc5 0 2024-05-09T06:29:34.052 INFO:tasks.workunit.client.1.smithi079.stdout:9/593: chown d1/d33/d2b/f53 149501 1 2024-05-09T06:29:34.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/437: symlink d1/la1 0 2024-05-09T06:29:34.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/438: fsync d1/d3/d20/d22/d50/d61/f7e 0 2024-05-09T06:29:34.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/439: stat d1/d3/d20/l80 0 2024-05-09T06:29:34.055 INFO:tasks.workunit.client.1.smithi079.stdout:6/437: dread d0/d6/d1b/f3d [0,4194304] 0 2024-05-09T06:29:34.059 INFO:tasks.workunit.client.1.smithi079.stdout:0/365: mkdir d3/dd/d1f/d1e/d2c/d6f 0 2024-05-09T06:29:34.059 INFO:tasks.workunit.client.1.smithi079.stdout:0/366: readlink d3/d5/d27/l12 0 2024-05-09T06:29:34.060 INFO:tasks.workunit.client.1.smithi079.stdout:0/367: fsync d3/dd/d18/f34 0 2024-05-09T06:29:34.060 INFO:tasks.workunit.client.1.smithi079.stdout:1/429: read d0/d12/f2c [2626799,92734] 0 2024-05-09T06:29:34.060 INFO:tasks.workunit.client.1.smithi079.stdout:1/430: truncate d0/d12/d48/d75/f54 1992514 0 2024-05-09T06:29:34.060 INFO:tasks.workunit.client.1.smithi079.stdout:1/431: write d0/d7/f7b [665441,34486] 0 2024-05-09T06:29:34.062 INFO:tasks.workunit.client.1.smithi079.stdout:3/445: write d1a/d1d/f2f [3830466,51187] 0 2024-05-09T06:29:34.062 INFO:tasks.workunit.client.1.smithi079.stdout:3/446: stat d1a/d1d/d3a/d54/d5e 0 2024-05-09T06:29:34.062 INFO:tasks.workunit.client.1.smithi079.stdout:3/447: write d1a/d1d/f63 [669844,67163] 0 2024-05-09T06:29:34.062 INFO:tasks.workunit.client.1.smithi079.stdout:3/448: stat d1a/d1c/d22/d53/d4e/f5b 0 2024-05-09T06:29:34.063 INFO:tasks.workunit.client.1.smithi079.stdout:2/434: dread d8/db/d4b/d4f/d51/d6f/f91 [0,4194304] 0 2024-05-09T06:29:34.067 INFO:tasks.workunit.client.1.smithi079.stdout:8/440: readlink d1/d3/d20/d22/d3b/l43 0 2024-05-09T06:29:34.067 INFO:tasks.workunit.client.1.smithi079.stdout:8/441: write d1/d3/d20/f7b [535019,104890] 0 2024-05-09T06:29:34.067 INFO:tasks.workunit.client.1.smithi079.stdout:8/442: chown d1/d67/c83 3 1 2024-05-09T06:29:34.067 INFO:tasks.workunit.client.1.smithi079.stdout:6/438: write d0/de/f59 [1322875,20015] 0 2024-05-09T06:29:34.067 INFO:tasks.workunit.client.1.smithi079.stdout:4/563: dwrite d6/d8/d27/f2e [4194304,4194304] 0 2024-05-09T06:29:34.068 INFO:tasks.workunit.client.1.smithi079.stdout:4/564: dread - d6/d1a/d41/f73 zero size 2024-05-09T06:29:34.068 INFO:tasks.workunit.client.1.smithi079.stdout:7/437: sync 2024-05-09T06:29:34.068 INFO:tasks.workunit.client.1.smithi079.stdout:7/438: write d4/d7/dd/d5b/d31/f81 [83897,45282] 0 2024-05-09T06:29:34.069 INFO:tasks.workunit.client.1.smithi079.stdout:7/439: write d4/d7/dd/d5b/f69 [660686,32410] 0 2024-05-09T06:29:34.069 INFO:tasks.workunit.client.1.smithi079.stdout:7/440: stat d4/d7/d22/d28/d50/d5c/l66 0 2024-05-09T06:29:34.069 INFO:tasks.workunit.client.1.smithi079.stdout:0/368: rmdir d3/dd/d1f/d1e/d2c/d6f 0 2024-05-09T06:29:34.071 INFO:tasks.workunit.client.1.smithi079.stdout:1/432: link d0/d12/d48/d75/l37 d0/d7/d4e/d7d/l96 0 2024-05-09T06:29:34.074 INFO:tasks.workunit.client.1.smithi079.stdout:5/461: dwrite d13/d43/d39/f7f [0,4194304] 0 2024-05-09T06:29:34.075 INFO:tasks.workunit.client.1.smithi079.stdout:3/449: chown d1a/d1d/d34/f6c 4086694 1 2024-05-09T06:29:34.076 INFO:tasks.workunit.client.1.smithi079.stdout:0/369: dread d3/dd/d1f/fa [4194304,4194304] 0 2024-05-09T06:29:34.078 INFO:tasks.workunit.client.1.smithi079.stdout:2/435: rename d8/db/dc/c44 to d8/db/d9d/ca5 0 2024-05-09T06:29:34.079 INFO:tasks.workunit.client.1.smithi079.stdout:2/436: fdatasync d8/db/d4b/d4f/d51/d6f/f9a 0 2024-05-09T06:29:34.079 INFO:tasks.workunit.client.1.smithi079.stdout:1/433: dread d0/d12/d67/f41 [0,4194304] 0 2024-05-09T06:29:34.079 INFO:tasks.workunit.client.1.smithi079.stdout:1/434: stat d0/d7/c1f 0 2024-05-09T06:29:34.080 INFO:tasks.workunit.client.1.smithi079.stdout:9/594: mkdir d1/d45/dc6 0 2024-05-09T06:29:34.080 INFO:tasks.workunit.client.1.smithi079.stdout:4/565: write d6/f24 [2518571,7884] 0 2024-05-09T06:29:34.084 INFO:tasks.workunit.client.1.smithi079.stdout:6/439: link d0/de/f5f d0/f8b 0 2024-05-09T06:29:34.087 INFO:tasks.workunit.client.1.smithi079.stdout:7/441: mkdir d4/d7/d22/d28/d50/d5c/d85 0 2024-05-09T06:29:34.090 INFO:tasks.workunit.client.1.smithi079.stdout:5/462: mkdir d13/da5 0 2024-05-09T06:29:34.092 INFO:tasks.workunit.client.1.smithi079.stdout:3/450: symlink d1a/d1d/d3a/d54/d5e/l85 0 2024-05-09T06:29:34.094 INFO:tasks.workunit.client.1.smithi079.stdout:0/370: creat d3/d5/d27/d2d/f70 x:0 0 0 2024-05-09T06:29:34.097 INFO:tasks.workunit.client.1.smithi079.stdout:2/437: rename d8/db/d4b/d4f/d51/d6f/f91 to d8/db/dc/d2c/fa6 0 2024-05-09T06:29:34.099 INFO:tasks.workunit.client.1.smithi079.stdout:1/435: mkdir d0/d12/d48/d75/d97 0 2024-05-09T06:29:34.100 INFO:tasks.workunit.client.1.smithi079.stdout:9/595: unlink d1/d6/dae/fbb 0 2024-05-09T06:29:34.101 INFO:tasks.workunit.client.1.smithi079.stdout:9/596: creat d1/d33/d28/d3e/d75/fc7 x:0 0 0 2024-05-09T06:29:34.103 INFO:tasks.workunit.client.1.smithi079.stdout:4/566: mknod d6/d8/d27/d3d/d5b/db4/cb8 0 2024-05-09T06:29:34.104 INFO:tasks.workunit.client.1.smithi079.stdout:8/443: rmdir d1/d56 39 2024-05-09T06:29:34.107 INFO:tasks.workunit.client.1.smithi079.stdout:6/440: mkdir d0/d6/d16/d1f/d6f/d8c 0 2024-05-09T06:29:34.108 INFO:tasks.workunit.client.1.smithi079.stdout:7/442: mkdir d4/d7/dd/d5b/d32/d86 0 2024-05-09T06:29:34.110 INFO:tasks.workunit.client.1.smithi079.stdout:5/463: creat d13/d43/d39/d61/fa6 x:0 0 0 2024-05-09T06:29:34.111 INFO:tasks.workunit.client.1.smithi079.stdout:3/451: creat d1a/d1c/d22/d53/f86 x:0 0 0 2024-05-09T06:29:34.111 INFO:tasks.workunit.client.1.smithi079.stdout:3/452: fdatasync d1a/d1c/d22/d53/d4e/f5b 0 2024-05-09T06:29:34.114 INFO:tasks.workunit.client.1.smithi079.stdout:0/371: mkdir d3/dd/d71 0 2024-05-09T06:29:34.116 INFO:tasks.workunit.client.1.smithi079.stdout:2/438: stat d8/db/d4b/l50 0 2024-05-09T06:29:34.116 INFO:tasks.workunit.client.1.smithi079.stdout:2/439: creat d8/db/d4b/d4f/d51/d6d/fa7 x:0 0 0 2024-05-09T06:29:34.116 INFO:tasks.workunit.client.1.smithi079.stdout:2/440: write d8/db/d4b/f68 [322625,71065] 0 2024-05-09T06:29:34.118 INFO:tasks.workunit.client.1.smithi079.stdout:9/597: mknod d1/d45/dc6/cc8 0 2024-05-09T06:29:34.118 INFO:tasks.workunit.client.1.smithi079.stdout:9/598: dread - d1/d5/d9a/f73 zero size 2024-05-09T06:29:34.121 INFO:tasks.workunit.client.1.smithi079.stdout:4/567: rename d6/d1a/d41/d68/d6b/f96 to d6/d8/d27/d3d/d5b/d9a/d8b/fb9 0 2024-05-09T06:29:34.123 INFO:tasks.workunit.client.1.smithi079.stdout:8/444: mkdir d1/d3/d20/d22/d44/da2 0 2024-05-09T06:29:34.123 INFO:tasks.workunit.client.1.smithi079.stdout:8/445: write d1/d5/dc/f1d [1928758,121378] 0 2024-05-09T06:29:34.123 INFO:tasks.workunit.client.1.smithi079.stdout:1/436: dwrite d0/d12/d48/d75/d43/d20/f5f [0,4194304] 0 2024-05-09T06:29:34.123 INFO:tasks.workunit.client.1.smithi079.stdout:3/453: getdents d1a/d1d/d3a/d54 0 2024-05-09T06:29:34.124 INFO:tasks.workunit.client.1.smithi079.stdout:3/454: write d1a/d1c/d1f/f68 [865021,47773] 0 2024-05-09T06:29:34.125 INFO:tasks.workunit.client.1.smithi079.stdout:0/372: link d3/d5/d27/f49 d3/dd/d66/f72 0 2024-05-09T06:29:34.125 INFO:tasks.workunit.client.1.smithi079.stdout:0/373: chown d3/dd/c22 158 1 2024-05-09T06:29:34.128 INFO:tasks.workunit.client.1.smithi079.stdout:2/441: mknod d8/d3c/ca8 0 2024-05-09T06:29:34.128 INFO:tasks.workunit.client.1.smithi079.stdout:2/442: fdatasync d8/db/d4b/d4f/f36 0 2024-05-09T06:29:34.130 INFO:tasks.workunit.client.1.smithi079.stdout:7/443: rename d4/d7/f1b to d4/d7/dd/d5b/d31/d34/f87 0 2024-05-09T06:29:34.130 INFO:tasks.workunit.client.1.smithi079.stdout:7/444: stat d4/d7/d22/f23 0 2024-05-09T06:29:34.132 INFO:tasks.workunit.client.1.smithi079.stdout:4/568: unlink d6/d1a/d26/d2a/d54/f63 0 2024-05-09T06:29:34.132 INFO:tasks.workunit.client.1.smithi079.stdout:6/441: dwrite d0/d6/d1b/d20/f8a [0,4194304] 0 2024-05-09T06:29:34.132 INFO:tasks.workunit.client.1.smithi079.stdout:5/464: dwrite d13/d43/d39/f7f [4194304,4194304] 0 2024-05-09T06:29:34.133 INFO:tasks.workunit.client.1.smithi079.stdout:5/465: chown d13/d43/d39/f60 164816635 1 2024-05-09T06:29:34.133 INFO:tasks.workunit.client.1.smithi079.stdout:8/446: symlink d1/d3/d20/d22/d82/la3 0 2024-05-09T06:29:34.137 INFO:tasks.workunit.client.1.smithi079.stdout:3/455: mkdir d1a/d82/d87 0 2024-05-09T06:29:34.141 INFO:tasks.workunit.client.1.smithi079.stdout:9/599: rmdir d1/d33/d48/d64 39 2024-05-09T06:29:34.145 INFO:tasks.workunit.client.1.smithi079.stdout:1/437: rename d0/d12/d48/d75/d43/f2e to d0/d12/d48/d75/d43/d20/f98 0 2024-05-09T06:29:34.155 INFO:tasks.workunit.client.1.smithi079.stdout:7/445: dwrite d4/d7/dd/d5b/d31/d34/f7a [0,4194304] 0 2024-05-09T06:29:34.157 INFO:tasks.workunit.client.1.smithi079.stdout:6/442: mknod d0/d6/c8d 0 2024-05-09T06:29:34.159 INFO:tasks.workunit.client.1.smithi079.stdout:2/443: rmdir d8/db/d4b/d4f/d51/d6f 39 2024-05-09T06:29:34.164 INFO:tasks.workunit.client.1.smithi079.stdout:0/374: rename d3/dd/c1a to d3/d5/d27/c73 0 2024-05-09T06:29:34.164 INFO:tasks.workunit.client.1.smithi079.stdout:0/375: write d3/dd/f5b [180174,9063] 0 2024-05-09T06:29:34.168 INFO:tasks.workunit.client.1.smithi079.stdout:7/446: mkdir d4/d7/dd/d88 0 2024-05-09T06:29:34.168 INFO:tasks.workunit.client.1.smithi079.stdout:7/447: truncate d4/d7/dd/d47/f5e 864773 0 2024-05-09T06:29:34.170 INFO:tasks.workunit.client.1.smithi079.stdout:6/443: mkdir d0/d60/d8e 0 2024-05-09T06:29:34.173 INFO:tasks.workunit.client.1.smithi079.stdout:4/569: rename d6/d8/f83 to d6/d1a/d26/fba 0 2024-05-09T06:29:34.173 INFO:tasks.workunit.client.1.smithi079.stdout:4/570: fsync d6/d1a/d26/d2a/d54/f17 0 2024-05-09T06:29:34.176 INFO:tasks.workunit.client.1.smithi079.stdout:0/376: unlink d3/c37 0 2024-05-09T06:29:34.178 INFO:tasks.workunit.client.1.smithi079.stdout:7/448: rmdir d4/d7/dd/d5b/d32 39 2024-05-09T06:29:34.181 INFO:tasks.workunit.client.1.smithi079.stdout:9/600: rename d1/d33/d28/d4c/d4e to d1/d45/dc6/dc9 0 2024-05-09T06:29:34.182 INFO:tasks.workunit.client.1.smithi079.stdout:9/601: chown d1/d33 3 1 2024-05-09T06:29:34.183 INFO:tasks.workunit.client.1.smithi079.stdout:4/571: mknod d6/cbb 0 2024-05-09T06:29:34.185 INFO:tasks.workunit.client.1.smithi079.stdout:6/444: dread d0/d6/d16/f3b [0,4194304] 0 2024-05-09T06:29:34.186 INFO:tasks.workunit.client.1.smithi079.stdout:7/449: mknod d4/d7/d22/d28/c89 0 2024-05-09T06:29:34.187 INFO:tasks.workunit.client.1.smithi079.stdout:4/572: creat d6/d8/d80/da6/fbc x:0 0 0 2024-05-09T06:29:34.190 INFO:tasks.workunit.client.1.smithi079.stdout:7/450: unlink d4/l54 0 2024-05-09T06:29:34.190 INFO:tasks.workunit.client.1.smithi079.stdout:0/377: dread d3/dd/d1f/fa [0,4194304] 0 2024-05-09T06:29:34.191 INFO:tasks.workunit.client.1.smithi079.stdout:8/447: dwrite d1/d5/dc/f1d [0,4194304] 0 2024-05-09T06:29:34.192 INFO:tasks.workunit.client.1.smithi079.stdout:2/444: dwrite d8/db/d11/d5f/f76 [0,4194304] 0 2024-05-09T06:29:34.192 INFO:tasks.workunit.client.1.smithi079.stdout:5/466: dwrite d13/d2a/f67 [0,4194304] 0 2024-05-09T06:29:34.192 INFO:tasks.workunit.client.1.smithi079.stdout:3/456: dwrite d1a/d1c/d1f/f56 [4194304,4194304] 0 2024-05-09T06:29:34.193 INFO:tasks.workunit.client.1.smithi079.stdout:4/573: mknod d6/d1a/d26/d2a/d98/cbd 0 2024-05-09T06:29:34.193 INFO:tasks.workunit.client.1.smithi079.stdout:4/574: chown d6/d1a/d26/d2a/d54/f45 10077 1 2024-05-09T06:29:34.193 INFO:tasks.workunit.client.1.smithi079.stdout:4/575: fsync d6/dd/f6a 0 2024-05-09T06:29:34.194 INFO:tasks.workunit.client.1.smithi079.stdout:1/438: dwrite d0/d12/d67/d53/f7a [0,4194304] 0 2024-05-09T06:29:34.194 INFO:tasks.workunit.client.1.smithi079.stdout:1/439: write d0/d12/d48/d75/d43/d70/f86 [573462,93725] 0 2024-05-09T06:29:34.197 INFO:tasks.workunit.client.1.smithi079.stdout:0/378: mkdir d3/dd/d66/d6d/d74 0 2024-05-09T06:29:34.197 INFO:tasks.workunit.client.1.smithi079.stdout:0/379: chown d3/dd/d18/l26 46979 1 2024-05-09T06:29:34.198 INFO:tasks.workunit.client.1.smithi079.stdout:0/380: creat d3/dd/d18/d5e/d69/f75 x:0 0 0 2024-05-09T06:29:34.203 INFO:tasks.workunit.client.1.smithi079.stdout:8/448: mkdir d1/d3/d20/d22/d44/da4 0 2024-05-09T06:29:34.203 INFO:tasks.workunit.client.1.smithi079.stdout:8/449: truncate d1/d3/d20/d7f/f4e 5680116 0 2024-05-09T06:29:34.209 INFO:tasks.workunit.client.1.smithi079.stdout:9/602: dwrite d1/d33/d28/d36/f67 [0,4194304] 0 2024-05-09T06:29:34.213 INFO:tasks.workunit.client.1.smithi079.stdout:2/445: link d8/db/d11/f3f d8/db/d11/d79/fa9 0 2024-05-09T06:29:34.215 INFO:tasks.workunit.client.1.smithi079.stdout:3/457: mknod d1a/d1d/d67/d7a/c88 0 2024-05-09T06:29:34.216 INFO:tasks.workunit.client.1.smithi079.stdout:9/603: dread d1/d33/d28/d36/d4d/d7d/f14 [0,4194304] 0 2024-05-09T06:29:34.219 INFO:tasks.workunit.client.1.smithi079.stdout:1/440: link d0/d7/d4e/d7d/l88 d0/d12/d48/d75/l99 0 2024-05-09T06:29:34.219 INFO:tasks.workunit.client.1.smithi079.stdout:1/441: dread - d0/df/f8f zero size 2024-05-09T06:29:34.220 INFO:tasks.workunit.client.1.smithi079.stdout:6/445: dwrite d0/de/f85 [0,4194304] 0 2024-05-09T06:29:34.220 INFO:tasks.workunit.client.1.smithi079.stdout:6/446: dread - d0/d6/d1b/d2d/f4e zero size 2024-05-09T06:29:34.220 INFO:tasks.workunit.client.1.smithi079.stdout:6/447: truncate d0/d6/d5e/f63 237484 0 2024-05-09T06:29:34.221 INFO:tasks.workunit.client.1.smithi079.stdout:7/451: dwrite d4/d20/f4f [0,4194304] 0 2024-05-09T06:29:34.221 INFO:tasks.workunit.client.1.smithi079.stdout:4/576: dwrite d6/d1a/d26/d2a/d54/f17 [0,4194304] 0 2024-05-09T06:29:34.223 INFO:tasks.workunit.client.1.smithi079.stdout:0/381: mkdir d3/d5/d27/d76 0 2024-05-09T06:29:34.228 INFO:tasks.workunit.client.1.smithi079.stdout:8/450: creat d1/d5/d36/da0/fa5 x:0 0 0 2024-05-09T06:29:34.236 INFO:tasks.workunit.client.1.smithi079.stdout:2/446: creat d8/db/dc/d2c/d2e/faa x:0 0 0 2024-05-09T06:29:34.236 INFO:tasks.workunit.client.1.smithi079.stdout:2/447: write f3 [4091813,8899] 0 2024-05-09T06:29:34.238 INFO:tasks.workunit.client.1.smithi079.stdout:3/458: link f11 d1a/d82/f89 0 2024-05-09T06:29:34.242 INFO:tasks.workunit.client.1.smithi079.stdout:9/604: link d1/d33/d48/dbf/lb2 d1/d33/d28/d36/d38/d3a/d56/lca 0 2024-05-09T06:29:34.244 INFO:tasks.workunit.client.1.smithi079.stdout:1/442: creat d0/d12/d92/f9a x:0 0 0 2024-05-09T06:29:34.247 INFO:tasks.workunit.client.1.smithi079.stdout:6/448: dwrite d0/de/f35 [0,4194304] 0 2024-05-09T06:29:34.247 INFO:tasks.workunit.client.1.smithi079.stdout:6/449: creat d0/f8f x:0 0 0 2024-05-09T06:29:34.247 INFO:tasks.workunit.client.1.smithi079.stdout:6/450: chown d0/de/f1c 4183977 1 2024-05-09T06:29:34.248 INFO:tasks.workunit.client.1.smithi079.stdout:4/577: dwrite d6/dd/fa2 [0,4194304] 0 2024-05-09T06:29:34.248 INFO:tasks.workunit.client.1.smithi079.stdout:8/451: dwrite d1/d3/d20/d22/d50/f5b [0,4194304] 0 2024-05-09T06:29:34.266 INFO:tasks.workunit.client.1.smithi079.stdout:4/578: dwrite d6/d8/d27/d3d/d5b/d9a/f82 [0,4194304] 0 2024-05-09T06:29:34.267 INFO:tasks.workunit.client.1.smithi079.stdout:4/579: write d6/d15/f5f [836208,42004] 0 2024-05-09T06:29:34.267 INFO:tasks.workunit.client.1.smithi079.stdout:4/580: fsync d6/dd/df/f21 0 2024-05-09T06:29:34.267 INFO:tasks.workunit.client.1.smithi079.stdout:7/452: creat d4/d7/dd/d88/f8a x:0 0 0 2024-05-09T06:29:34.267 INFO:tasks.workunit.client.1.smithi079.stdout:7/453: write d4/d7/dd/d5b/d6f/f80 [859582,100631] 0 2024-05-09T06:29:34.267 INFO:tasks.workunit.client.1.smithi079.stdout:7/454: read d4/d7/d22/f2f [317587,66588] 0 2024-05-09T06:29:34.270 INFO:tasks.workunit.client.1.smithi079.stdout:0/382: creat d3/dd/d18/f77 x:0 0 0 2024-05-09T06:29:34.270 INFO:tasks.workunit.client.1.smithi079.stdout:0/383: readlink d3/dd/d18/d5e/l6b 0 2024-05-09T06:29:34.270 INFO:tasks.workunit.client.1.smithi079.stdout:0/384: chown d3/d5/d27/d2d/l33 7200216 1 2024-05-09T06:29:34.274 INFO:tasks.workunit.client.1.smithi079.stdout:9/605: mknod d1/d33/d28/d36/d38/d3a/d56/d6b/ccb 0 2024-05-09T06:29:34.276 INFO:tasks.workunit.client.1.smithi079.stdout:1/443: link d0/d6e/l71 d0/d7/d4e/l9b 0 2024-05-09T06:29:34.284 INFO:tasks.workunit.client.1.smithi079.stdout:6/451: creat d0/d6/d16/d1f/f90 x:0 0 0 2024-05-09T06:29:34.315 INFO:tasks.workunit.client.1.smithi079.stdout:4/581: mkdir d6/d1a/d41/d68/da1/dbe 0 2024-05-09T06:29:34.316 INFO:tasks.workunit.client.1.smithi079.stdout:7/455: creat d4/d7/dd/d5b/d32/f8b x:0 0 0 2024-05-09T06:29:34.321 INFO:tasks.workunit.client.1.smithi079.stdout:0/385: mknod d3/dd/d66/d6d/c78 0 2024-05-09T06:29:34.324 INFO:tasks.workunit.client.1.smithi079.stdout:3/459: link d1a/d1d/d34/l73 d1a/d1c/d1f/d76/l8a 0 2024-05-09T06:29:34.327 INFO:tasks.workunit.client.1.smithi079.stdout:9/606: truncate d1/d45/f60 2959609 0 2024-05-09T06:29:34.331 INFO:tasks.workunit.client.1.smithi079.stdout:1/444: creat d0/d12/d48/f9c x:0 0 0 2024-05-09T06:29:34.331 INFO:tasks.workunit.client.1.smithi079.stdout:1/445: creat d0/d12/d48/d75/d43/d20/f9d x:0 0 0 2024-05-09T06:29:34.331 INFO:tasks.workunit.client.1.smithi079.stdout:7/456: dwrite d4/d7/dd/d5b/d31/d34/f7a [0,4194304] 0 2024-05-09T06:29:34.332 INFO:tasks.workunit.client.1.smithi079.stdout:3/460: dread d1a/d1d/d34/d59/f74 [0,4194304] 0 2024-05-09T06:29:34.333 INFO:tasks.workunit.client.1.smithi079.stdout:6/452: creat d0/d6/d16/d1f/d36/d69/d84/f91 x:0 0 0 2024-05-09T06:29:34.333 INFO:tasks.workunit.client.1.smithi079.stdout:6/453: creat d0/d6/d16/f92 x:0 0 0 2024-05-09T06:29:34.334 INFO:tasks.workunit.client.1.smithi079.stdout:4/582: getdents d6/d90 0 2024-05-09T06:29:34.337 INFO:tasks.workunit.client.1.smithi079.stdout:0/386: unlink d3/d5/d27/f24 0 2024-05-09T06:29:34.342 INFO:tasks.workunit.client.1.smithi079.stdout:9/607: dwrite d1/d33/d28/d36/d4d/d7d/d19/fa6 [0,4194304] 0 2024-05-09T06:29:34.343 INFO:tasks.workunit.client.1.smithi079.stdout:7/457: dread d4/d7/dd/d5b/d31/f33 [0,4194304] 0 2024-05-09T06:29:34.346 INFO:tasks.workunit.client.1.smithi079.stdout:1/446: mknod d0/d12/d48/d75/d43/d20/c9e 0 2024-05-09T06:29:34.350 INFO:tasks.workunit.client.1.smithi079.stdout:3/461: symlink d1a/d1c/d1f/d76/l8b 0 2024-05-09T06:29:34.350 INFO:tasks.workunit.client.1.smithi079.stdout:3/462: write d1a/d1c/d1f/f68 [1489589,91432] 0 2024-05-09T06:29:34.354 INFO:tasks.workunit.client.1.smithi079.stdout:6/454: mkdir d0/d6/d16/d1f/d6f/d8c/d93 0 2024-05-09T06:29:34.354 INFO:tasks.workunit.client.1.smithi079.stdout:6/455: creat d0/d6/d16/d1f/d36/d69/d84/f94 x:0 0 0 2024-05-09T06:29:34.354 INFO:tasks.workunit.client.1.smithi079.stdout:6/456: fdatasync d0/d6/d16/d28/f6a 0 2024-05-09T06:29:34.354 INFO:tasks.workunit.client.1.smithi079.stdout:6/457: stat d0/d6/d16/d1f/d36/d69 0 2024-05-09T06:29:34.358 INFO:tasks.workunit.client.1.smithi079.stdout:4/583: dwrite d6/d8/d27/d3d/d5b/db4/fb6 [0,4194304] 0 2024-05-09T06:29:34.358 INFO:tasks.workunit.client.1.smithi079.stdout:4/584: write d6/d1a/d26/d2a/f56 [1295008,35931] 0 2024-05-09T06:29:34.358 INFO:tasks.workunit.client.1.smithi079.stdout:4/585: dread - d6/d1a/fa5 zero size 2024-05-09T06:29:34.361 INFO:tasks.workunit.client.1.smithi079.stdout:0/387: dwrite d3/f4 [0,4194304] 0 2024-05-09T06:29:34.361 INFO:tasks.workunit.client.1.smithi079.stdout:9/608: link d1/d33/d28/d36/d4d/d7d/l72 d1/d6/dae/lcc 0 2024-05-09T06:29:34.363 INFO:tasks.workunit.client.1.smithi079.stdout:9/609: dread d1/d33/d28/d36/d4d/d7d/d19/f80 [0,4194304] 0 2024-05-09T06:29:34.363 INFO:tasks.workunit.client.1.smithi079.stdout:7/458: mknod d4/d7/d78/c8c 0 2024-05-09T06:29:34.365 INFO:tasks.workunit.client.1.smithi079.stdout:1/447: link d0/d7/f3b d0/d6e/d8a/f9f 0 2024-05-09T06:29:34.367 INFO:tasks.workunit.client.1.smithi079.stdout:1/448: dread d0/d12/d48/d75/f54 [0,4194304] 0 2024-05-09T06:29:34.367 INFO:tasks.workunit.client.1.smithi079.stdout:1/449: write d0/d7/f8d [1001456,67712] 0 2024-05-09T06:29:34.374 INFO:tasks.workunit.client.1.smithi079.stdout:4/586: truncate d6/d1a/d26/d2a/d54/f17 2281552 0 2024-05-09T06:29:34.374 INFO:tasks.workunit.client.1.smithi079.stdout:4/587: write d6/d8/d27/d3d/d5b/d9a/d8b/fb9 [4341625,51681] 0 2024-05-09T06:29:34.374 INFO:tasks.workunit.client.1.smithi079.stdout:4/588: chown d6/d8/d27/d3d/d5b/d9a/d8b/f9c 80033 1 2024-05-09T06:29:34.374 INFO:tasks.workunit.client.1.smithi079.stdout:4/589: write d6/d1a/d26/d2a/d98/fac [153304,87621] 0 2024-05-09T06:29:34.376 INFO:tasks.workunit.client.1.smithi079.stdout:0/388: unlink d3/dd/d18/f77 0 2024-05-09T06:29:34.379 INFO:tasks.workunit.client.1.smithi079.stdout:7/459: symlink d4/d7/dd/d5b/d31/l8d 0 2024-05-09T06:29:34.382 INFO:tasks.workunit.client.1.smithi079.stdout:1/450: mknod d0/d12/ca0 0 2024-05-09T06:29:34.384 INFO:tasks.workunit.client.1.smithi079.stdout:3/463: rename d1a/d1c/l20 to d1a/d1d/d34/l8c 0 2024-05-09T06:29:34.388 INFO:tasks.workunit.client.1.smithi079.stdout:0/389: symlink d3/d5/d27/d76/l79 0 2024-05-09T06:29:34.388 INFO:tasks.workunit.client.1.smithi079.stdout:0/390: creat d3/dd/d18/f7a x:0 0 0 2024-05-09T06:29:34.389 INFO:tasks.workunit.client.1.smithi079.stdout:9/610: read d1/d33/d28/d36/d4d/d7d/d19/f96 [795578,4799] 0 2024-05-09T06:29:34.391 INFO:tasks.workunit.client.1.smithi079.stdout:7/460: mkdir d4/d7/d37/d7c/d8e 0 2024-05-09T06:29:34.393 INFO:tasks.workunit.client.1.smithi079.stdout:6/458: rename d0/d6/d1b/d20/f2f to d0/d6/d16/d1f/d36/f95 0 2024-05-09T06:29:34.396 INFO:tasks.workunit.client.1.smithi079.stdout:3/464: creat d1a/d82/d87/f8d x:0 0 0 2024-05-09T06:29:34.399 INFO:tasks.workunit.client.1.smithi079.stdout:4/590: unlink d6/d8/f10 0 2024-05-09T06:29:34.399 INFO:tasks.workunit.client.1.smithi079.stdout:4/591: dread - d6/d8/d27/d62/f40 zero size 2024-05-09T06:29:34.403 INFO:tasks.workunit.client.1.smithi079.stdout:9/611: mkdir d1/d33/d28/d36/dcd 0 2024-05-09T06:29:34.404 INFO:tasks.workunit.client.1.smithi079.stdout:9/612: write d1/d5/d9a/f73 [407939,87839] 0 2024-05-09T06:29:34.404 INFO:tasks.workunit.client.1.smithi079.stdout:7/461: creat d4/d7/d37/d7c/f8f x:0 0 0 2024-05-09T06:29:34.406 INFO:tasks.workunit.client.1.smithi079.stdout:1/451: rename d0/d7/d4e/f6b to d0/d12/d67/d93/fa1 0 2024-05-09T06:29:34.409 INFO:tasks.workunit.client.1.smithi079.stdout:5/467: sync 2024-05-09T06:29:34.409 INFO:tasks.workunit.client.1.smithi079.stdout:5/468: chown ce 1494 1 2024-05-09T06:29:34.409 INFO:tasks.workunit.client.1.smithi079.stdout:6/459: unlink d0/f5b 0 2024-05-09T06:29:34.409 INFO:tasks.workunit.client.1.smithi079.stdout:5/469: dread - d13/d4f/f97 zero size 2024-05-09T06:29:34.409 INFO:tasks.workunit.client.1.smithi079.stdout:2/448: sync 2024-05-09T06:29:34.409 INFO:tasks.workunit.client.1.smithi079.stdout:8/452: sync 2024-05-09T06:29:34.411 INFO:tasks.workunit.client.1.smithi079.stdout:4/592: creat d6/d1a/d41/d68/da1/dbe/fbf x:0 0 0 2024-05-09T06:29:34.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:34 smithi062 ceph-mon[26920]: pgmap v246: 65 pgs: 65 active+clean; 865 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 56 MiB/s rd, 80 MiB/s wr, 676 op/s 2024-05-09T06:29:34.414 INFO:tasks.workunit.client.1.smithi079.stdout:7/462: mkdir d4/d7/d37/d90 0 2024-05-09T06:29:34.414 INFO:tasks.workunit.client.1.smithi079.stdout:7/463: read d4/f6 [991072,108861] 0 2024-05-09T06:29:34.418 INFO:tasks.workunit.client.1.smithi079.stdout:7/464: dread d4/d7/d22/f59 [0,4194304] 0 2024-05-09T06:29:34.418 INFO:tasks.workunit.client.1.smithi079.stdout:7/465: write d4/d7/d22/f2a [4898277,62231] 0 2024-05-09T06:29:34.418 INFO:tasks.workunit.client.1.smithi079.stdout:1/452: unlink d0/d7/d4e/l9b 0 2024-05-09T06:29:34.418 INFO:tasks.workunit.client.1.smithi079.stdout:1/453: chown d0/d12/d16/f2f 107 1 2024-05-09T06:29:34.418 INFO:tasks.workunit.client.1.smithi079.stdout:1/454: creat d0/d12/d67/d53/fa2 x:0 0 0 2024-05-09T06:29:34.420 INFO:tasks.workunit.client.1.smithi079.stdout:5/470: mkdir d13/d43/d39/da7 0 2024-05-09T06:29:34.420 INFO:tasks.workunit.client.1.smithi079.stdout:5/471: read - d13/d4f/f68 zero size 2024-05-09T06:29:34.421 INFO:tasks.workunit.client.1.smithi079.stdout:6/460: creat d0/d6/d16/d1f/d6f/d8c/d93/f96 x:0 0 0 2024-05-09T06:29:34.422 INFO:tasks.workunit.client.1.smithi079.stdout:6/461: chown d0/l7e 942 1 2024-05-09T06:29:34.422 INFO:tasks.workunit.client.1.smithi079.stdout:6/462: creat d0/d6/d16/d1f/d6f/d8c/d93/f97 x:0 0 0 2024-05-09T06:29:34.422 INFO:tasks.workunit.client.1.smithi079.stdout:1/455: dread d0/d7/f3b [0,4194304] 0 2024-05-09T06:29:34.422 INFO:tasks.workunit.client.1.smithi079.stdout:1/456: chown d0/d12/d16/f50 35 1 2024-05-09T06:29:34.422 INFO:tasks.workunit.client.1.smithi079.stdout:1/457: dread - d0/d7/d4e/f6c zero size 2024-05-09T06:29:34.423 INFO:tasks.workunit.client.1.smithi079.stdout:2/449: creat d8/db/dc/d2c/d78/fab x:0 0 0 2024-05-09T06:29:34.423 INFO:tasks.workunit.client.1.smithi079.stdout:2/450: chown d8/db/d5c/d6b/c97 7443857 1 2024-05-09T06:29:34.424 INFO:tasks.workunit.client.1.smithi079.stdout:2/451: write d8/db/dc/f34 [1378394,21503] 0 2024-05-09T06:29:34.426 INFO:tasks.workunit.client.1.smithi079.stdout:3/465: dwrite d1a/d1c/d22/d53/f4b [4194304,4194304] 0 2024-05-09T06:29:34.427 INFO:tasks.workunit.client.1.smithi079.stdout:9/613: dwrite d1/f81 [0,4194304] 0 2024-05-09T06:29:34.427 INFO:tasks.workunit.client.1.smithi079.stdout:0/391: dwrite d3/dd/d1f/f64 [0,4194304] 0 2024-05-09T06:29:34.427 INFO:tasks.workunit.client.1.smithi079.stdout:9/614: write d1/d33/d28/d3e/d75/fc3 [257807,85391] 0 2024-05-09T06:29:34.427 INFO:tasks.workunit.client.1.smithi079.stdout:9/615: write d1/d33/d28/d36/d4d/d7d/f14 [614883,121060] 0 2024-05-09T06:29:34.427 INFO:tasks.workunit.client.1.smithi079.stdout:8/453: rename d1/d5/dc/l95 to d1/d5/d36/da0/la6 0 2024-05-09T06:29:34.431 INFO:tasks.workunit.client.1.smithi079.stdout:1/458: dread d0/d12/d48/d75/d43/d20/d39/f42 [0,4194304] 0 2024-05-09T06:29:34.431 INFO:tasks.workunit.client.1.smithi079.stdout:4/593: creat d6/d1a/d26/d2a/d54/d9e/fc0 x:0 0 0 2024-05-09T06:29:34.431 INFO:tasks.workunit.client.1.smithi079.stdout:4/594: truncate d6/dd/df/f21 7523202 0 2024-05-09T06:29:34.437 INFO:tasks.workunit.client.1.smithi079.stdout:7/466: link d4/d7/dd/d5b/d31/f33 d4/d7/d22/d28/d50/d5c/d85/f91 0 2024-05-09T06:29:34.440 INFO:tasks.workunit.client.1.smithi079.stdout:5/472: mknod d13/d4f/d80/ca8 0 2024-05-09T06:29:34.445 INFO:tasks.workunit.client.1.smithi079.stdout:8/454: dwrite d1/d3/d20/d7f/d33/d5d/d6d/f9a [0,4194304] 0 2024-05-09T06:29:34.445 INFO:tasks.workunit.client.1.smithi079.stdout:8/455: chown d1/d3/d20/d22/d50 709578483 1 2024-05-09T06:29:34.470 INFO:tasks.workunit.client.1.smithi079.stdout:5/473: dwrite d13/d2a/f4e [0,4194304] 0 2024-05-09T06:29:34.470 INFO:tasks.workunit.client.1.smithi079.stdout:5/474: dread - d13/d4d/d77/f8a zero size 2024-05-09T06:29:34.473 INFO:tasks.workunit.client.1.smithi079.stdout:8/456: dwrite d1/d3/d20/d7f/f45 [0,4194304] 0 2024-05-09T06:29:34.481 INFO:tasks.workunit.client.1.smithi079.stdout:2/452: mkdir d8/db/d59/d67/d7f/dac 0 2024-05-09T06:29:34.482 INFO:tasks.workunit.client.1.smithi079.stdout:2/453: truncate d8/db/d4b/d4f/d51/fa4 787244 0 2024-05-09T06:29:34.497 INFO:tasks.workunit.client.1.smithi079.stdout:0/392: creat d3/dd/d66/f7b x:0 0 0 2024-05-09T06:29:34.497 INFO:tasks.workunit.client.1.smithi079.stdout:0/393: creat d3/dd/d18/d5e/d69/f7c x:0 0 0 2024-05-09T06:29:34.504 INFO:tasks.workunit.client.1.smithi079.stdout:1/459: mkdir d0/d7/d4e/d7d/d94/da3 0 2024-05-09T06:29:34.507 INFO:tasks.workunit.client.1.smithi079.stdout:4/595: rename d6/d1a/d41/f73 to d6/dd/df/d8e/fc1 0 2024-05-09T06:29:34.568 INFO:tasks.workunit.client.1.smithi079.stdout:5/475: creat d13/d43/d39/da7/fa9 x:0 0 0 2024-05-09T06:29:34.582 INFO:tasks.workunit.client.1.smithi079.stdout:5/476: dwrite d13/d43/d9e/fa4 [0,4194304] 0 2024-05-09T06:29:34.582 INFO:tasks.workunit.client.1.smithi079.stdout:5/477: write d13/d4d/d77/f8a [723896,125503] 0 2024-05-09T06:29:34.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:34 smithi079 ceph-mon[35268]: pgmap v246: 65 pgs: 65 active+clean; 865 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 56 MiB/s rd, 80 MiB/s wr, 676 op/s 2024-05-09T06:29:34.590 INFO:tasks.workunit.client.1.smithi079.stdout:8/457: getdents d1/d3/d20/d7f/d33/d5d 0 2024-05-09T06:29:34.601 INFO:tasks.workunit.client.1.smithi079.stdout:8/458: dread d1/d5/dc/f1b [0,4194304] 0 2024-05-09T06:29:34.625 INFO:tasks.workunit.client.1.smithi079.stdout:2/454: symlink d8/d3c/lad 0 2024-05-09T06:29:34.625 INFO:tasks.workunit.client.1.smithi079.stdout:2/455: readlink d8/db/d11/l28 0 2024-05-09T06:29:34.625 INFO:tasks.workunit.client.1.smithi079.stdout:2/456: creat d8/db/d11/d5f/fae x:0 0 0 2024-05-09T06:29:34.626 INFO:tasks.workunit.client.1.smithi079.stdout:2/457: read d8/db/d11/f55 [474970,87370] 0 2024-05-09T06:29:34.626 INFO:tasks.workunit.client.1.smithi079.stdout:3/466: symlink d1a/d1d/d34/l8e 0 2024-05-09T06:29:34.626 INFO:tasks.workunit.client.1.smithi079.stdout:3/467: chown d1a/d1c/d1f/f4d 856 1 2024-05-09T06:29:34.626 INFO:tasks.workunit.client.1.smithi079.stdout:3/468: creat d1a/d1d/f8f x:0 0 0 2024-05-09T06:29:34.629 INFO:tasks.workunit.client.1.smithi079.stdout:0/394: getdents d3/dd/d1f 0 2024-05-09T06:29:34.630 INFO:tasks.workunit.client.1.smithi079.stdout:1/460: symlink d0/d7/d4e/d7d/la4 0 2024-05-09T06:29:34.633 INFO:tasks.workunit.client.1.smithi079.stdout:2/458: dread d8/db/d4b/d4f/f36 [0,4194304] 0 2024-05-09T06:29:34.633 INFO:tasks.workunit.client.1.smithi079.stdout:2/459: chown d8/db/dc/d2c 1875873 1 2024-05-09T06:29:34.642 INFO:tasks.workunit.client.1.smithi079.stdout:5/478: mkdir d13/d43/d3d/d40/d63/da2/daa 0 2024-05-09T06:29:34.643 INFO:tasks.workunit.client.1.smithi079.stdout:5/479: dread - d13/d43/d39/d61/f94 zero size 2024-05-09T06:29:34.644 INFO:tasks.workunit.client.1.smithi079.stdout:8/459: symlink d1/d3/d20/d22/d82/la7 0 2024-05-09T06:29:34.645 INFO:tasks.workunit.client.1.smithi079.stdout:8/460: read d1/d3/d20/f7b [188693,93903] 0 2024-05-09T06:29:34.649 INFO:tasks.workunit.client.1.smithi079.stdout:0/395: link d3/d5/d27/f56 d3/dd/d1f/d1e/d2c/d35/f7d 0 2024-05-09T06:29:34.649 INFO:tasks.workunit.client.1.smithi079.stdout:0/396: chown d3 28 1 2024-05-09T06:29:34.664 INFO:tasks.workunit.client.1.smithi079.stdout:1/461: dwrite d0/d12/d67/d53/f7a [4194304,4194304] 0 2024-05-09T06:29:34.665 INFO:tasks.workunit.client.1.smithi079.stdout:1/462: chown d0/d12/f8b 3112015 1 2024-05-09T06:29:34.665 INFO:tasks.workunit.client.1.smithi079.stdout:8/461: dwrite d1/d3/d20/f7b [0,4194304] 0 2024-05-09T06:29:34.665 INFO:tasks.workunit.client.1.smithi079.stdout:8/462: chown d1/d3/d20/d22/d44/da4 56360 1 2024-05-09T06:29:34.666 INFO:tasks.workunit.client.1.smithi079.stdout:1/463: read d0/d12/d48/d75/d43/f47 [297320,27803] 0 2024-05-09T06:29:34.674 INFO:tasks.workunit.client.1.smithi079.stdout:8/463: creat d1/d56/d7c/d8f/fa8 x:0 0 0 2024-05-09T06:29:34.674 INFO:tasks.workunit.client.1.smithi079.stdout:8/464: read - d1/d3/d20/d22/d3b/f90 zero size 2024-05-09T06:29:34.674 INFO:tasks.workunit.client.1.smithi079.stdout:8/465: creat d1/db/fa9 x:0 0 0 2024-05-09T06:29:34.675 INFO:tasks.workunit.client.1.smithi079.stdout:8/466: mknod d1/d3/d20/d22/d3f/caa 0 2024-05-09T06:29:34.676 INFO:tasks.workunit.client.1.smithi079.stdout:1/464: dread d0/d12/d48/d75/d43/d20/f5f [0,4194304] 0 2024-05-09T06:29:34.679 INFO:tasks.workunit.client.1.smithi079.stdout:1/465: symlink d0/d7/d4e/d7d/la5 0 2024-05-09T06:29:34.682 INFO:tasks.workunit.client.1.smithi079.stdout:1/466: symlink d0/d12/d67/d53/d5e/la6 0 2024-05-09T06:29:34.687 INFO:tasks.workunit.client.1.smithi079.stdout:8/467: dread d1/d3/d20/d7f/f45 [0,4194304] 0 2024-05-09T06:29:34.688 INFO:tasks.workunit.client.1.smithi079.stdout:1/467: write d0/d7/f9 [2801471,57689] 0 2024-05-09T06:29:34.689 INFO:tasks.workunit.client.1.smithi079.stdout:8/468: creat d1/d3/d20/d22/d3b/fab x:0 0 0 2024-05-09T06:29:34.690 INFO:tasks.workunit.client.1.smithi079.stdout:1/468: creat d0/d12/d48/d75/d26/fa7 x:0 0 0 2024-05-09T06:29:34.694 INFO:tasks.workunit.client.1.smithi079.stdout:1/469: unlink d0/d12/c65 0 2024-05-09T06:29:34.741 INFO:tasks.workunit.client.1.smithi079.stdout:6/463: rmdir d0/d6/d1b/d2d 39 2024-05-09T06:29:34.741 INFO:tasks.workunit.client.1.smithi079.stdout:6/464: fdatasync d0/fc 0 2024-05-09T06:29:34.741 INFO:tasks.workunit.client.1.smithi079.stdout:6/465: write d0/d6/f29 [1495936,32732] 0 2024-05-09T06:29:34.743 INFO:tasks.workunit.client.1.smithi079.stdout:6/466: creat d0/d6/d16/d28/d6e/f98 x:0 0 0 2024-05-09T06:29:34.745 INFO:tasks.workunit.client.1.smithi079.stdout:6/467: getdents d0/d6/d1b 0 2024-05-09T06:29:34.747 INFO:tasks.workunit.client.1.smithi079.stdout:6/468: dread d0/d6/d16/d1f/f25 [0,4194304] 0 2024-05-09T06:29:34.755 INFO:tasks.workunit.client.1.smithi079.stdout:5/480: unlink d13/d43/f20 0 2024-05-09T06:29:34.755 INFO:tasks.workunit.client.1.smithi079.stdout:5/481: creat d13/d43/d39/da7/fab x:0 0 0 2024-05-09T06:29:34.761 INFO:tasks.workunit.client.1.smithi079.stdout:6/469: dwrite d0/d6/d16/d1f/f25 [0,4194304] 0 2024-05-09T06:29:34.761 INFO:tasks.workunit.client.1.smithi079.stdout:6/470: fdatasync d0/d6/d16/d1f/f49 0 2024-05-09T06:29:34.762 INFO:tasks.workunit.client.1.smithi079.stdout:5/482: mkdir d13/d43/d26/dac 0 2024-05-09T06:29:34.768 INFO:tasks.workunit.client.1.smithi079.stdout:5/483: mkdir d13/d43/d3d/d40/d53/dad 0 2024-05-09T06:29:34.771 INFO:tasks.workunit.client.1.smithi079.stdout:5/484: dread d13/d43/d26/f2e [0,4194304] 0 2024-05-09T06:29:34.772 INFO:tasks.workunit.client.1.smithi079.stdout:5/485: write d13/d4d/f98 [70806,60043] 0 2024-05-09T06:29:34.774 INFO:tasks.workunit.client.1.smithi079.stdout:5/486: mknod d13/d92/d9b/cae 0 2024-05-09T06:29:34.775 INFO:tasks.workunit.client.1.smithi079.stdout:5/487: getdents d13/d43/d3d/d40/d63/da2/daa 0 2024-05-09T06:29:34.790 INFO:tasks.workunit.client.1.smithi079.stdout:7/467: rename d4/d7/d78/c82 to d4/c92 0 2024-05-09T06:29:34.792 INFO:tasks.workunit.client.1.smithi079.stdout:7/468: mkdir d4/d7/dd/d93 0 2024-05-09T06:29:34.792 INFO:tasks.workunit.client.1.smithi079.stdout:7/469: fsync d4/f64 0 2024-05-09T06:29:34.793 INFO:tasks.workunit.client.1.smithi079.stdout:4/596: rename d6/d1a/d26/f71 to d6/d1a/d41/d68/da1/fc2 0 2024-05-09T06:29:34.794 INFO:tasks.workunit.client.1.smithi079.stdout:2/460: mknod d8/db/caf 0 2024-05-09T06:29:34.796 INFO:tasks.workunit.client.1.smithi079.stdout:7/470: mknod d4/d7/dd/d47/c94 0 2024-05-09T06:29:34.796 INFO:tasks.workunit.client.1.smithi079.stdout:7/471: truncate d4/d7/dd/f6d 4306720 0 2024-05-09T06:29:34.796 INFO:tasks.workunit.client.1.smithi079.stdout:7/472: truncate d4/d7/dd/d5b/d6f/f80 1006480 0 2024-05-09T06:29:34.796 INFO:tasks.workunit.client.1.smithi079.stdout:2/461: dread d8/db/d11/f55 [0,4194304] 0 2024-05-09T06:29:34.796 INFO:tasks.workunit.client.1.smithi079.stdout:2/462: readlink d8/db/l29 0 2024-05-09T06:29:34.798 INFO:tasks.workunit.client.1.smithi079.stdout:3/469: rename d1a/d1c/d1f/d3f to d1a/d1c/d22/d90 0 2024-05-09T06:29:34.800 INFO:tasks.workunit.client.1.smithi079.stdout:2/463: unlink d8/db/d4b/d4f/l41 0 2024-05-09T06:29:34.803 INFO:tasks.workunit.client.1.smithi079.stdout:3/470: creat d1a/d1d/d3a/f91 x:0 0 0 2024-05-09T06:29:34.805 INFO:tasks.workunit.client.1.smithi079.stdout:2/464: creat d8/db/fb0 x:0 0 0 2024-05-09T06:29:34.806 INFO:tasks.workunit.client.1.smithi079.stdout:7/473: read d4/d7/dd/d5b/d31/d34/f7a [1583224,7019] 0 2024-05-09T06:29:34.809 INFO:tasks.workunit.client.1.smithi079.stdout:2/465: symlink d8/db/lb1 0 2024-05-09T06:29:34.812 INFO:tasks.workunit.client.1.smithi079.stdout:7/474: symlink d4/d7/dd/d5b/d32/l95 0 2024-05-09T06:29:34.812 INFO:tasks.workunit.client.1.smithi079.stdout:7/475: write d4/d7/dd/d5b/d31/f75 [1299034,106225] 0 2024-05-09T06:29:34.813 INFO:tasks.workunit.client.1.smithi079.stdout:2/466: mknod d8/db/d5c/d6b/cb2 0 2024-05-09T06:29:34.820 INFO:tasks.workunit.client.1.smithi079.stdout:3/471: dwrite d1a/d1c/d22/d53/f43 [0,4194304] 0 2024-05-09T06:29:34.821 INFO:tasks.workunit.client.1.smithi079.stdout:3/472: readlink d1a/d1c/d22/d90/l44 0 2024-05-09T06:29:34.824 INFO:tasks.workunit.client.1.smithi079.stdout:7/476: write d4/d7/dd/f42 [768399,16708] 0 2024-05-09T06:29:34.824 INFO:tasks.workunit.client.1.smithi079.stdout:7/477: chown d4/d7/dd/d5b/f44 778 1 2024-05-09T06:29:34.825 INFO:tasks.workunit.client.1.smithi079.stdout:4/597: dwrite d6/dd/f2f [0,4194304] 0 2024-05-09T06:29:34.825 INFO:tasks.workunit.client.1.smithi079.stdout:7/478: fsync d4/d20/f4f 0 2024-05-09T06:29:34.825 INFO:tasks.workunit.client.1.smithi079.stdout:4/598: write d6/d8/d27/fb2 [622946,74753] 0 2024-05-09T06:29:34.825 INFO:tasks.workunit.client.1.smithi079.stdout:4/599: chown d6/dd/l2c 5 1 2024-05-09T06:29:34.826 INFO:tasks.workunit.client.1.smithi079.stdout:2/467: dwrite d8/db/d11/f72 [0,4194304] 0 2024-05-09T06:29:34.827 INFO:tasks.workunit.client.1.smithi079.stdout:2/468: read - d8/d3c/f4c zero size 2024-05-09T06:29:34.828 INFO:tasks.workunit.client.1.smithi079.stdout:3/473: creat d1a/d1d/d67/d7a/f92 x:0 0 0 2024-05-09T06:29:34.829 INFO:tasks.workunit.client.1.smithi079.stdout:4/600: read d6/d1a/d26/d2a/d54/f23 [6180,129845] 0 2024-05-09T06:29:34.836 INFO:tasks.workunit.client.1.smithi079.stdout:3/474: symlink d1a/d1c/d22/l93 0 2024-05-09T06:29:34.836 INFO:tasks.workunit.client.1.smithi079.stdout:3/475: creat d1a/d1d/d67/d7a/f94 x:0 0 0 2024-05-09T06:29:34.837 INFO:tasks.workunit.client.1.smithi079.stdout:4/601: mkdir d6/d8/d27/d3d/d5b/db4/dc3 0 2024-05-09T06:29:34.837 INFO:tasks.workunit.client.1.smithi079.stdout:2/469: write d8/db/d11/f24 [377848,65653] 0 2024-05-09T06:29:34.840 INFO:tasks.workunit.client.1.smithi079.stdout:3/476: mkdir d1a/d1d/d3a/d95 0 2024-05-09T06:29:34.841 INFO:tasks.workunit.client.1.smithi079.stdout:3/477: creat d1a/d1c/d22/d53/f96 x:0 0 0 2024-05-09T06:29:34.842 INFO:tasks.workunit.client.1.smithi079.stdout:4/602: symlink d6/d8/d27/d3d/d5b/db4/dc3/lc4 0 2024-05-09T06:29:34.845 INFO:tasks.workunit.client.1.smithi079.stdout:2/470: link d8/db/d4b/f66 d8/db/dc/d2c/d2e/fb3 0 2024-05-09T06:29:34.848 INFO:tasks.workunit.client.1.smithi079.stdout:3/478: dread d1a/d1c/d22/d53/f43 [0,4194304] 0 2024-05-09T06:29:34.848 INFO:tasks.workunit.client.1.smithi079.stdout:3/479: chown d1a/d1c/d1f/l65 108019658 1 2024-05-09T06:29:34.848 INFO:tasks.workunit.client.1.smithi079.stdout:3/480: creat d1a/d1d/d67/d7a/f97 x:0 0 0 2024-05-09T06:29:34.848 INFO:tasks.workunit.client.1.smithi079.stdout:3/481: dread - d1a/d1d/d34/d42/f81 zero size 2024-05-09T06:29:34.848 INFO:tasks.workunit.client.1.smithi079.stdout:3/482: creat d1a/d21/f98 x:0 0 0 2024-05-09T06:29:34.849 INFO:tasks.workunit.client.1.smithi079.stdout:4/603: mkdir d6/dd/dc5 0 2024-05-09T06:29:34.851 INFO:tasks.workunit.client.1.smithi079.stdout:6/471: mknod d0/c99 0 2024-05-09T06:29:34.851 INFO:tasks.workunit.client.1.smithi079.stdout:6/472: readlink d0/d6/d1b/l6b 0 2024-05-09T06:29:34.851 INFO:tasks.workunit.client.1.smithi079.stdout:6/473: fdatasync d0/d6/d5e/f63 0 2024-05-09T06:29:34.851 INFO:tasks.workunit.client.1.smithi079.stdout:6/474: dread - d0/d6/d5e/f71 zero size 2024-05-09T06:29:34.855 INFO:tasks.workunit.client.1.smithi079.stdout:4/604: dread d6/d8/d27/d3d/d5b/f87 [0,4194304] 0 2024-05-09T06:29:34.855 INFO:tasks.workunit.client.1.smithi079.stdout:4/605: chown d6/c47 12548605 1 2024-05-09T06:29:34.855 INFO:tasks.workunit.client.1.smithi079.stdout:4/606: dread - d6/d8/d27/d62/f40 zero size 2024-05-09T06:29:34.856 INFO:tasks.workunit.client.1.smithi079.stdout:3/483: read f5 [4178483,93850] 0 2024-05-09T06:29:34.858 INFO:tasks.workunit.client.1.smithi079.stdout:4/607: symlink d6/d1a/d26/d2a/d98/lc6 0 2024-05-09T06:29:34.859 INFO:tasks.workunit.client.1.smithi079.stdout:3/484: creat d1a/d1c/d22/d90/f99 x:0 0 0 2024-05-09T06:29:34.861 INFO:tasks.workunit.client.1.smithi079.stdout:6/475: write d0/d6/d16/d1f/f49 [3159727,23894] 0 2024-05-09T06:29:34.862 INFO:tasks.workunit.client.1.smithi079.stdout:6/476: creat d0/d6/d5e/f9a x:0 0 0 2024-05-09T06:29:34.862 INFO:tasks.workunit.client.1.smithi079.stdout:3/485: creat d1a/d1c/d22/d53/d4e/f9a x:0 0 0 2024-05-09T06:29:34.862 INFO:tasks.workunit.client.1.smithi079.stdout:3/486: write d1a/d1c/d22/f30 [858811,3733] 0 2024-05-09T06:29:34.867 INFO:tasks.workunit.client.1.smithi079.stdout:6/477: link d0/d6/d16/l24 d0/d6/d16/d1f/d6f/l9b 0 2024-05-09T06:29:34.874 INFO:tasks.workunit.client.1.smithi079.stdout:0/397: rename d3/dd/d1f/c5c to d3/dd/d18/d5e/d69/c7e 0 2024-05-09T06:29:34.878 INFO:tasks.workunit.client.1.smithi079.stdout:6/478: getdents d0/d6/d16 0 2024-05-09T06:29:34.878 INFO:tasks.workunit.client.1.smithi079.stdout:6/479: fsync d0/d6/d16/d1f/d6f/d8c/d93/f97 0 2024-05-09T06:29:34.878 INFO:tasks.workunit.client.1.smithi079.stdout:6/480: chown d0/de/l80 3 1 2024-05-09T06:29:34.879 INFO:tasks.workunit.client.1.smithi079.stdout:8/469: rename d1/d5/l8a to d1/d3/d20/d22/d44/da2/lac 0 2024-05-09T06:29:34.879 INFO:tasks.workunit.client.1.smithi079.stdout:8/470: readlink d1/d3/d20/d22/d3f/l77 0 2024-05-09T06:29:34.879 INFO:tasks.workunit.client.1.smithi079.stdout:0/398: mkdir d3/dd/d1f/d1e/d2c/d7f 0 2024-05-09T06:29:34.881 INFO:tasks.workunit.client.1.smithi079.stdout:6/481: mkdir d0/d6/d16/d28/d6e/d9c 0 2024-05-09T06:29:34.886 INFO:tasks.workunit.client.1.smithi079.stdout:2/471: rename d8/db/d5c/d6b/c97 to d8/db/dc/d2c/d2e/cb4 0 2024-05-09T06:29:34.886 INFO:tasks.workunit.client.1.smithi079.stdout:2/472: fdatasync d8/db/d11/f8e 0 2024-05-09T06:29:34.887 INFO:tasks.workunit.client.1.smithi079.stdout:8/471: mknod d1/d3/d20/d22/d3f/cad 0 2024-05-09T06:29:34.891 INFO:tasks.workunit.client.1.smithi079.stdout:6/482: mknod d0/d6/d16/d1f/c9d 0 2024-05-09T06:29:34.892 INFO:tasks.workunit.client.1.smithi079.stdout:6/483: creat d0/d6/d16/d1f/d6f/d8c/d93/f9e x:0 0 0 2024-05-09T06:29:34.892 INFO:tasks.workunit.client.1.smithi079.stdout:6/484: write d0/d6/d16/d28/f58 [532490,22496] 0 2024-05-09T06:29:34.892 INFO:tasks.workunit.client.1.smithi079.stdout:6/485: fdatasync d0/de/f35 0 2024-05-09T06:29:34.892 INFO:tasks.workunit.client.1.smithi079.stdout:6/486: write d0/d6/d5e/f71 [939490,83142] 0 2024-05-09T06:29:34.895 INFO:tasks.workunit.client.1.smithi079.stdout:8/472: mkdir d1/d5/d36/dae 0 2024-05-09T06:29:34.895 INFO:tasks.workunit.client.1.smithi079.stdout:8/473: chown d1/l2a 0 1 2024-05-09T06:29:34.900 INFO:tasks.workunit.client.1.smithi079.stdout:6/487: symlink d0/d6/d16/d1f/d36/d69/l9f 0 2024-05-09T06:29:34.901 INFO:tasks.workunit.client.1.smithi079.stdout:4/608: dwrite d6/dd/df/f21 [0,4194304] 0 2024-05-09T06:29:34.911 INFO:tasks.workunit.client.1.smithi079.stdout:8/474: dwrite d1/d3/f4d [0,4194304] 0 2024-05-09T06:29:34.913 INFO:tasks.workunit.client.1.smithi079.stdout:3/487: creat d1a/f9b x:0 0 0 2024-05-09T06:29:34.915 INFO:tasks.workunit.client.1.smithi079.stdout:6/488: creat d0/d6/d1b/fa0 x:0 0 0 2024-05-09T06:29:34.918 INFO:tasks.workunit.client.1.smithi079.stdout:4/609: mknod d6/d90/cc7 0 2024-05-09T06:29:34.921 INFO:tasks.workunit.client.1.smithi079.stdout:2/473: rename d8/db/dc/d2c/d78 to d8/db/d5c/d6b/db5 0 2024-05-09T06:29:34.921 INFO:tasks.workunit.client.1.smithi079.stdout:2/474: chown d8/db/dc/d2c/d2e/cb4 1 1 2024-05-09T06:29:34.927 INFO:tasks.workunit.client.1.smithi079.stdout:4/610: truncate d6/d8/d27/d3d/d5b/d9a/f86 808669 0 2024-05-09T06:29:34.927 INFO:tasks.workunit.client.1.smithi079.stdout:3/488: dwrite d1a/d1c/d22/d53/f43 [0,4194304] 0 2024-05-09T06:29:34.930 INFO:tasks.workunit.client.1.smithi079.stdout:2/475: symlink d8/db/dc/d2c/lb6 0 2024-05-09T06:29:34.935 INFO:tasks.workunit.client.1.smithi079.stdout:4/611: mkdir d6/d1a/d26/d2a/d54/dc8 0 2024-05-09T06:29:34.936 INFO:tasks.workunit.client.1.smithi079.stdout:3/489: write d1a/d1c/d1f/f56 [6957549,834] 0 2024-05-09T06:29:34.943 INFO:tasks.workunit.client.1.smithi079.stdout:2/476: mknod d8/db/d59/d67/cb7 0 2024-05-09T06:29:34.947 INFO:tasks.workunit.client.1.smithi079.stdout:4/612: rmdir d6/d1a/d41/d68/da1/dad/db7 0 2024-05-09T06:29:34.949 INFO:tasks.workunit.client.1.smithi079.stdout:8/475: rename d1/d3/d20/d22/d50/d61 to d1/db/daf 0 2024-05-09T06:29:34.955 INFO:tasks.workunit.client.1.smithi079.stdout:6/489: rename d0/d6/d1b/f55 to d0/d60/d8e/fa1 0 2024-05-09T06:29:34.957 INFO:tasks.workunit.client.1.smithi079.stdout:3/490: dwrite d1a/d1c/d22/d53/d4e/f7e [0,4194304] 0 2024-05-09T06:29:34.957 INFO:tasks.workunit.client.1.smithi079.stdout:3/491: write d1a/d1c/d1f/f31 [1368397,54400] 0 2024-05-09T06:29:34.959 INFO:tasks.workunit.client.1.smithi079.stdout:4/613: rename d6/d1a/d26/d2a/d54/laf to d6/d90/lc9 0 2024-05-09T06:29:34.961 INFO:tasks.workunit.client.1.smithi079.stdout:6/490: mkdir d0/da2 0 2024-05-09T06:29:34.970 INFO:tasks.workunit.client.1.smithi079.stdout:9/616: sync 2024-05-09T06:29:34.970 INFO:tasks.workunit.client.1.smithi079.stdout:9/617: chown d1/d5/dba 0 1 2024-05-09T06:29:34.972 INFO:tasks.workunit.client.1.smithi079.stdout:6/491: mknod d0/d6/d16/d28/d6e/ca3 0 2024-05-09T06:29:34.972 INFO:tasks.workunit.client.1.smithi079.stdout:2/477: dwrite d8/db/d4b/d4f/d51/d6d/f6e [4194304,4194304] 0 2024-05-09T06:29:34.972 INFO:tasks.workunit.client.1.smithi079.stdout:6/492: creat d0/d6/d16/d28/d6e/fa4 x:0 0 0 2024-05-09T06:29:34.972 INFO:tasks.workunit.client.1.smithi079.stdout:6/493: write d0/de/f3a [4391204,113925] 0 2024-05-09T06:29:34.972 INFO:tasks.workunit.client.1.smithi079.stdout:6/494: write d0/d6/d16/f92 [616285,73138] 0 2024-05-09T06:29:34.975 INFO:tasks.workunit.client.1.smithi079.stdout:4/614: read d6/dd/df/f21 [328376,21935] 0 2024-05-09T06:29:34.981 INFO:tasks.workunit.client.1.smithi079.stdout:6/495: dread d0/d6/d16/f56 [0,4194304] 0 2024-05-09T06:29:34.981 INFO:tasks.workunit.client.1.smithi079.stdout:8/476: dwrite d1/f91 [0,4194304] 0 2024-05-09T06:29:34.983 INFO:tasks.workunit.client.1.smithi079.stdout:3/492: dwrite d1a/d1c/d22/d53/f86 [0,4194304] 0 2024-05-09T06:29:34.983 INFO:tasks.workunit.client.1.smithi079.stdout:2/478: creat d8/db/d4b/fb8 x:0 0 0 2024-05-09T06:29:34.988 INFO:tasks.workunit.client.1.smithi079.stdout:4/615: mknod d6/d8/d27/d3d/d5b/d9a/d8b/daa/cca 0 2024-05-09T06:29:34.993 INFO:tasks.workunit.client.1.smithi079.stdout:9/618: dwrite d1/d5/faa [0,4194304] 0 2024-05-09T06:29:34.993 INFO:tasks.workunit.client.1.smithi079.stdout:9/619: dread - d1/d45/f86 zero size 2024-05-09T06:29:34.993 INFO:tasks.workunit.client.1.smithi079.stdout:9/620: fsync d1/d5/d5b/f89 0 2024-05-09T06:29:34.998 INFO:tasks.workunit.client.1.smithi079.stdout:8/477: link d1/d3/d20/d7f/d33/l7d d1/d3/d20/d22/d3f/lb0 0 2024-05-09T06:29:35.010 INFO:tasks.workunit.client.1.smithi079.stdout:3/493: creat d1a/d1d/d34/f9c x:0 0 0 2024-05-09T06:29:35.012 INFO:tasks.workunit.client.1.smithi079.stdout:2/479: truncate d8/db/dc/d2c/f63 3478114 0 2024-05-09T06:29:35.013 INFO:tasks.workunit.client.1.smithi079.stdout:4/616: readlink d6/d8/l1e 0 2024-05-09T06:29:35.015 INFO:tasks.workunit.client.1.smithi079.stdout:2/480: dread d8/db/d11/f3f [0,4194304] 0 2024-05-09T06:29:35.018 INFO:tasks.workunit.client.1.smithi079.stdout:3/494: dread d1a/f49 [0,4194304] 0 2024-05-09T06:29:35.019 INFO:tasks.workunit.client.1.smithi079.stdout:3/495: fdatasync d1a/d1d/d34/f6c 0 2024-05-09T06:29:35.020 INFO:tasks.workunit.client.1.smithi079.stdout:8/478: dwrite d1/d3/d20/d22/d50/f5b [0,4194304] 0 2024-05-09T06:29:35.022 INFO:tasks.workunit.client.1.smithi079.stdout:9/621: rmdir d1/d33/d28/d36/d38 39 2024-05-09T06:29:35.022 INFO:tasks.workunit.client.1.smithi079.stdout:9/622: chown d1/d33/d28/d36/d4d/d7d/f14 128183250 1 2024-05-09T06:29:35.025 INFO:tasks.workunit.client.1.smithi079.stdout:4/617: creat d6/d8/d27/d3d/d5b/db4/dc3/fcb x:0 0 0 2024-05-09T06:29:35.025 INFO:tasks.workunit.client.1.smithi079.stdout:4/618: chown d6/d8/d80 25341958 1 2024-05-09T06:29:35.025 INFO:tasks.workunit.client.1.smithi079.stdout:4/619: chown d6/d1a/d26/c88 255 1 2024-05-09T06:29:35.025 INFO:tasks.workunit.client.1.smithi079.stdout:2/481: dread d8/db/d11/d5f/f75 [0,4194304] 0 2024-05-09T06:29:35.025 INFO:tasks.workunit.client.1.smithi079.stdout:2/482: fsync d8/db/d11/d5f/f75 0 2024-05-09T06:29:35.031 INFO:tasks.workunit.client.1.smithi079.stdout:9/623: creat d1/d6/dae/fce x:0 0 0 2024-05-09T06:29:35.033 INFO:tasks.workunit.client.1.smithi079.stdout:2/483: mkdir d8/db/d59/d67/d7f/db9 0 2024-05-09T06:29:35.036 INFO:tasks.workunit.client.1.smithi079.stdout:8/479: dwrite d1/d3/d20/d22/d3f/f69 [0,4194304] 0 2024-05-09T06:29:35.036 INFO:tasks.workunit.client.1.smithi079.stdout:8/480: dread - d1/d5/d36/f70 zero size 2024-05-09T06:29:35.040 INFO:tasks.workunit.client.1.smithi079.stdout:9/624: link d1/d33/d28/d36/d4d/d7d/d19/fa6 d1/d33/d28/d36/d38/d3a/d56/d6b/fcf 0 2024-05-09T06:29:35.040 INFO:tasks.workunit.client.1.smithi079.stdout:9/625: getdents d1/d33/d28/d36/dbe 0 2024-05-09T06:29:35.040 INFO:tasks.workunit.client.1.smithi079.stdout:9/626: fdatasync d1/f9f 0 2024-05-09T06:29:35.044 INFO:tasks.workunit.client.1.smithi079.stdout:2/484: dread d8/db/dc/d2c/f31 [0,4194304] 0 2024-05-09T06:29:35.044 INFO:tasks.workunit.client.1.smithi079.stdout:8/481: truncate d1/d3/d20/d22/d44/f4c 692431 0 2024-05-09T06:29:35.045 INFO:tasks.workunit.client.1.smithi079.stdout:3/496: rmdir d1a/d1c/d22 39 2024-05-09T06:29:35.047 INFO:tasks.workunit.client.1.smithi079.stdout:9/627: creat d1/d45/dc6/dc9/fd0 x:0 0 0 2024-05-09T06:29:35.050 INFO:tasks.workunit.client.1.smithi079.stdout:8/482: link d1/d5/f6f d1/d3/d20/d7f/d33/fb1 0 2024-05-09T06:29:35.050 INFO:tasks.workunit.client.1.smithi079.stdout:8/483: write d1/db/fa9 [268579,88397] 0 2024-05-09T06:29:35.050 INFO:tasks.workunit.client.1.smithi079.stdout:8/484: write d1/d3/f6 [150034,24532] 0 2024-05-09T06:29:35.050 INFO:tasks.workunit.client.1.smithi079.stdout:8/485: fdatasync d1/d3/d20/f32 0 2024-05-09T06:29:35.050 INFO:tasks.workunit.client.1.smithi079.stdout:8/486: fsync d1/d5/dc/f34 0 2024-05-09T06:29:35.050 INFO:tasks.workunit.client.1.smithi079.stdout:8/487: write d1/d56/d7c/d8f/fa8 [617811,48851] 0 2024-05-09T06:29:35.051 INFO:tasks.workunit.client.1.smithi079.stdout:3/497: read d1a/f2c [3836539,45110] 0 2024-05-09T06:29:35.052 INFO:tasks.workunit.client.1.smithi079.stdout:9/628: unlink d1/d33/d28/d36/d38/d3a/l8c 0 2024-05-09T06:29:35.052 INFO:tasks.workunit.client.1.smithi079.stdout:2/485: dread d8/d3c/f80 [0,4194304] 0 2024-05-09T06:29:35.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/488: mkdir d1/d3/d20/d7f/d33/db2 0 2024-05-09T06:29:35.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/489: fdatasync d1/d3/d20/d22/d44/f4c 0 2024-05-09T06:29:35.055 INFO:tasks.workunit.client.1.smithi079.stdout:3/498: creat d1a/d1d/d3a/d7c/f9d x:0 0 0 2024-05-09T06:29:35.058 INFO:tasks.workunit.client.1.smithi079.stdout:2/486: symlink d8/db/d11/d79/lba 0 2024-05-09T06:29:35.058 INFO:tasks.workunit.client.1.smithi079.stdout:2/487: readlink d8/db/d4b/l50 0 2024-05-09T06:29:35.058 INFO:tasks.workunit.client.1.smithi079.stdout:2/488: stat d8/db/dc/f9b 0 2024-05-09T06:29:35.059 INFO:tasks.workunit.client.1.smithi079.stdout:8/490: creat d1/d5/d36/da0/fb3 x:0 0 0 2024-05-09T06:29:35.059 INFO:tasks.workunit.client.1.smithi079.stdout:9/629: write d1/d6/f18 [3149281,72681] 0 2024-05-09T06:29:35.060 INFO:tasks.workunit.client.1.smithi079.stdout:8/491: dread d1/db/f78 [0,4194304] 0 2024-05-09T06:29:35.061 INFO:tasks.workunit.client.1.smithi079.stdout:3/499: mknod d1a/d1d/d34/d42/c9e 0 2024-05-09T06:29:35.062 INFO:tasks.workunit.client.1.smithi079.stdout:8/492: dread d1/d56/d7c/d8f/fa8 [0,4194304] 0 2024-05-09T06:29:35.062 INFO:tasks.workunit.client.1.smithi079.stdout:8/493: chown d1/d3/d20/d7f/d33/l74 1812 1 2024-05-09T06:29:35.067 INFO:tasks.workunit.client.1.smithi079.stdout:9/630: dread d1/f9f [0,4194304] 0 2024-05-09T06:29:35.067 INFO:tasks.workunit.client.1.smithi079.stdout:9/631: readlink d1/d33/d28/d36/d38/d3a/d56/l7f 0 2024-05-09T06:29:35.067 INFO:tasks.workunit.client.1.smithi079.stdout:9/632: write d1/d45/dc6/dc9/fd0 [552770,1932] 0 2024-05-09T06:29:35.071 INFO:tasks.workunit.client.1.smithi079.stdout:2/489: mknod d8/db/d9d/cbb 0 2024-05-09T06:29:35.075 INFO:tasks.workunit.client.1.smithi079.stdout:9/633: link d1/d33/d28/d36/d38/l5a d1/d33/d28/d36/d38/ld1 0 2024-05-09T06:29:35.078 INFO:tasks.workunit.client.1.smithi079.stdout:2/490: truncate d8/db/f62 3917431 0 2024-05-09T06:29:35.078 INFO:tasks.workunit.client.1.smithi079.stdout:2/491: write d8/db/d11/f2f [1908614,71310] 0 2024-05-09T06:29:35.078 INFO:tasks.workunit.client.1.smithi079.stdout:2/492: fsync d8/db/dc/d2c/d2e/fb3 0 2024-05-09T06:29:35.078 INFO:tasks.workunit.client.1.smithi079.stdout:2/493: creat d8/db/d11/d5f/fbc x:0 0 0 2024-05-09T06:29:35.086 INFO:tasks.workunit.client.1.smithi079.stdout:9/634: write d1/d5/ff [3339438,54166] 0 2024-05-09T06:29:35.086 INFO:tasks.workunit.client.1.smithi079.stdout:9/635: stat d1/d5/d9a 0 2024-05-09T06:29:35.088 INFO:tasks.workunit.client.1.smithi079.stdout:8/494: dwrite d1/d5/f6f [0,4194304] 0 2024-05-09T06:29:35.089 INFO:tasks.workunit.client.1.smithi079.stdout:8/495: symlink d1/d3/d20/d22/d44/da4/lb4 0 2024-05-09T06:29:35.092 INFO:tasks.workunit.client.1.smithi079.stdout:3/500: dwrite d1a/d1d/d34/f6c [0,4194304] 0 2024-05-09T06:29:35.092 INFO:tasks.workunit.client.1.smithi079.stdout:8/496: dread d1/d56/f81 [0,4194304] 0 2024-05-09T06:29:35.093 INFO:tasks.workunit.client.1.smithi079.stdout:2/494: dwrite d8/db/d5c/f81 [4194304,4194304] 0 2024-05-09T06:29:35.093 INFO:tasks.workunit.client.1.smithi079.stdout:8/497: chown d1/d3/d20/d22/d3f/cad 71 1 2024-05-09T06:29:35.093 INFO:tasks.workunit.client.1.smithi079.stdout:3/501: symlink d1a/d1d/d3a/d54/d55/l9f 0 2024-05-09T06:29:35.097 INFO:tasks.workunit.client.1.smithi079.stdout:8/498: truncate d1/d3/d20/d22/d44/f35 3653208 0 2024-05-09T06:29:35.100 INFO:tasks.workunit.client.1.smithi079.stdout:2/495: creat d8/fbd x:0 0 0 2024-05-09T06:29:35.102 INFO:tasks.workunit.client.1.smithi079.stdout:3/502: unlink d1a/d1d/d3a/d54/c57 0 2024-05-09T06:29:35.104 INFO:tasks.workunit.client.1.smithi079.stdout:8/499: truncate d1/d3/f4 3375397 0 2024-05-09T06:29:35.104 INFO:tasks.workunit.client.1.smithi079.stdout:8/500: fdatasync d1/d3/d20/d22/d3b/f46 0 2024-05-09T06:29:35.118 INFO:tasks.workunit.client.1.smithi079.stdout:3/503: dread d1a/d1c/d22/d53/f7b [0,4194304] 0 2024-05-09T06:29:35.120 INFO:tasks.workunit.client.1.smithi079.stdout:3/504: creat d1a/d1c/d22/fa0 x:0 0 0 2024-05-09T06:29:35.130 INFO:tasks.workunit.client.1.smithi079.stdout:8/501: dwrite d1/d3/d20/d7f/f45 [0,4194304] 0 2024-05-09T06:29:35.143 INFO:tasks.workunit.client.1.smithi079.stdout:8/502: mkdir d1/d3/d20/d7f/d33/db5 0 2024-05-09T06:29:35.149 INFO:tasks.workunit.client.1.smithi079.stdout:6/496: rename d0/d6/d16/d28/d6e to d0/d6/d16/da5 0 2024-05-09T06:29:35.150 INFO:tasks.workunit.client.1.smithi079.stdout:9/636: rename d1/d33/d28 to d1/d33/d28/d36/d38/d3a/dd2 22 2024-05-09T06:29:35.150 INFO:tasks.workunit.client.1.smithi079.stdout:6/497: readlink d0/d6/d16/d1f/d6f/l7f 0 2024-05-09T06:29:35.150 INFO:tasks.workunit.client.1.smithi079.stdout:6/498: creat d0/d6/d1b/d20/fa6 x:0 0 0 2024-05-09T06:29:35.150 INFO:tasks.workunit.client.1.smithi079.stdout:6/499: truncate d0/d60/d8e/fa1 499037 0 2024-05-09T06:29:35.154 INFO:tasks.workunit.client.1.smithi079.stdout:2/496: rename d8/db/d4b/d4f/d51/d6d/f74 to d8/db/dc/d2c/fbe 0 2024-05-09T06:29:35.156 INFO:tasks.workunit.client.1.smithi079.stdout:9/637: mkdir d1/d33/d28/d4c/d97/dd3 0 2024-05-09T06:29:35.159 INFO:tasks.workunit.client.1.smithi079.stdout:3/505: rename d1a/d1d/d67/d7a/f92 to d1a/d1d/fa1 0 2024-05-09T06:29:35.162 INFO:tasks.workunit.client.1.smithi079.stdout:8/503: dwrite d1/d5/dc/f1d [4194304,4194304] 0 2024-05-09T06:29:35.162 INFO:tasks.workunit.client.1.smithi079.stdout:8/504: chown d1/db/daf/d66/d6c/c76 73743139 1 2024-05-09T06:29:35.163 INFO:tasks.workunit.client.1.smithi079.stdout:9/638: mkdir d1/d33/d28/d36/d4d/d7d/d19/db8/dd4 0 2024-05-09T06:29:35.166 INFO:tasks.workunit.client.1.smithi079.stdout:6/500: rename d0/d6/d16/f56 to d0/d6/fa7 0 2024-05-09T06:29:35.168 INFO:tasks.workunit.client.1.smithi079.stdout:3/506: creat d1a/d1c/fa2 x:0 0 0 2024-05-09T06:29:35.172 INFO:tasks.workunit.client.1.smithi079.stdout:8/505: unlink d1/d67/f86 0 2024-05-09T06:29:35.177 INFO:tasks.workunit.client.1.smithi079.stdout:6/501: symlink d0/d6/d16/da5/la8 0 2024-05-09T06:29:35.177 INFO:tasks.workunit.client.1.smithi079.stdout:6/502: creat d0/d60/fa9 x:0 0 0 2024-05-09T06:29:35.181 INFO:tasks.workunit.client.1.smithi079.stdout:8/506: creat d1/d3/d20/d22/d44/fb6 x:0 0 0 2024-05-09T06:29:35.181 INFO:tasks.workunit.client.1.smithi079.stdout:8/507: readlink d1/d3/d20/d22/d3b/l9e 0 2024-05-09T06:29:35.186 INFO:tasks.workunit.client.1.smithi079.stdout:6/503: unlink d0/de/f35 0 2024-05-09T06:29:35.188 INFO:tasks.workunit.client.1.smithi079.stdout:3/507: symlink d1a/d1d/d34/la3 0 2024-05-09T06:29:35.189 INFO:tasks.workunit.client.1.smithi079.stdout:6/504: dread d0/d6/fa7 [0,4194304] 0 2024-05-09T06:29:35.192 INFO:tasks.workunit.client.1.smithi079.stdout:3/508: mkdir d1a/d1d/d3a/da4 0 2024-05-09T06:29:35.193 INFO:tasks.workunit.client.1.smithi079.stdout:6/505: symlink d0/d6/laa 0 2024-05-09T06:29:35.194 INFO:tasks.workunit.client.1.smithi079.stdout:8/508: dwrite d1/d56/f81 [0,4194304] 0 2024-05-09T06:29:35.194 INFO:tasks.workunit.client.1.smithi079.stdout:8/509: truncate d1/d5/d36/f70 199899 0 2024-05-09T06:29:35.202 INFO:tasks.workunit.client.1.smithi079.stdout:8/510: creat d1/d3/d20/d22/d3b/fb7 x:0 0 0 2024-05-09T06:29:35.202 INFO:tasks.workunit.client.1.smithi079.stdout:8/511: creat d1/d5/d36/fb8 x:0 0 0 2024-05-09T06:29:35.210 INFO:tasks.workunit.client.1.smithi079.stdout:8/512: dread d1/d5/f6f [0,4194304] 0 2024-05-09T06:29:35.213 INFO:tasks.workunit.client.1.smithi079.stdout:1/470: sync 2024-05-09T06:29:35.224 INFO:tasks.workunit.client.1.smithi079.stdout:9/639: rename d1/d33/d28/d36/d38 to d1/d45/dc6/dc9/d2d/d99/dd5 0 2024-05-09T06:29:35.229 INFO:tasks.workunit.client.1.smithi079.stdout:9/640: creat d1/d33/d28/d36/fd6 x:0 0 0 2024-05-09T06:29:35.231 INFO:tasks.workunit.client.1.smithi079.stdout:2/497: unlink d8/db/f62 0 2024-05-09T06:29:35.231 INFO:tasks.workunit.client.1.smithi079.stdout:2/498: creat d8/db/d59/d67/d86/fbf x:0 0 0 2024-05-09T06:29:35.247 INFO:tasks.workunit.client.1.smithi079.stdout:9/641: dwrite d1/d33/d28/d36/d4d/d7d/d19/f1e [4194304,4194304] 0 2024-05-09T06:29:35.264 INFO:tasks.workunit.client.1.smithi079.stdout:9/642: dwrite d1/d5/f58 [0,4194304] 0 2024-05-09T06:29:35.277 INFO:tasks.workunit.client.1.smithi079.stdout:9/643: dwrite d1/d33/d28/d36/f67 [0,4194304] 0 2024-05-09T06:29:35.280 INFO:tasks.workunit.client.1.smithi079.stdout:9/644: mkdir d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/dd7 0 2024-05-09T06:29:35.281 INFO:tasks.workunit.client.1.smithi079.stdout:9/645: stat d1/d6/f1c 0 2024-05-09T06:29:35.283 INFO:tasks.workunit.client.1.smithi079.stdout:9/646: rmdir d1/d33 39 2024-05-09T06:29:35.283 INFO:tasks.workunit.client.1.smithi079.stdout:9/647: fsync d1/d33/d28/d3e/f44 0 2024-05-09T06:29:35.283 INFO:tasks.workunit.client.1.smithi079.stdout:9/648: dread - d1/d5/d91/fa5 zero size 2024-05-09T06:29:35.286 INFO:tasks.workunit.client.1.smithi079.stdout:9/649: symlink d1/d33/d28/d4c/d97/ld8 0 2024-05-09T06:29:35.288 INFO:tasks.workunit.client.1.smithi079.stdout:9/650: truncate d1/d5/d91/fb1 736316 0 2024-05-09T06:29:35.295 INFO:tasks.workunit.client.1.smithi079.stdout:4/620: sync 2024-05-09T06:29:35.295 INFO:tasks.workunit.client.1.smithi079.stdout:5/488: sync 2024-05-09T06:29:35.295 INFO:tasks.workunit.client.1.smithi079.stdout:7/479: sync 2024-05-09T06:29:35.295 INFO:tasks.workunit.client.1.smithi079.stdout:4/621: chown d6/d8/d27/d3d/d5b 3 1 2024-05-09T06:29:35.295 INFO:tasks.workunit.client.1.smithi079.stdout:0/399: sync 2024-05-09T06:29:35.297 INFO:tasks.workunit.client.1.smithi079.stdout:7/480: stat d4/c92 0 2024-05-09T06:29:35.297 INFO:tasks.workunit.client.1.smithi079.stdout:0/400: dread d3/dd/f3e [0,4194304] 0 2024-05-09T06:29:35.298 INFO:tasks.workunit.client.1.smithi079.stdout:9/651: write d1/d45/dc6/dc9/fbd [1482081,90209] 0 2024-05-09T06:29:35.298 INFO:tasks.workunit.client.1.smithi079.stdout:9/652: truncate d1/d33/d2b/fac 516416 0 2024-05-09T06:29:35.302 INFO:tasks.workunit.client.1.smithi079.stdout:9/653: read d1/d33/d28/d3e/d75/f77 [904566,123478] 0 2024-05-09T06:29:35.302 INFO:tasks.workunit.client.1.smithi079.stdout:9/654: write d1/d33/d28/d36/d4d/d7d/f14 [4347349,6391] 0 2024-05-09T06:29:35.309 INFO:tasks.workunit.client.1.smithi079.stdout:3/509: rename d1a/d1d/d67/d7a to d1a/d1c/d22/d53/da5 0 2024-05-09T06:29:35.312 INFO:tasks.workunit.client.1.smithi079.stdout:9/655: mkdir d1/d33/d28/d36/d4d/d7d/d19/dd9 0 2024-05-09T06:29:35.315 INFO:tasks.workunit.client.1.smithi079.stdout:6/506: rename d0/l52 to d0/d60/lab 0 2024-05-09T06:29:35.319 INFO:tasks.workunit.client.1.smithi079.stdout:2/499: rename d8/l16 to d8/db/dc/lc0 0 2024-05-09T06:29:35.319 INFO:tasks.workunit.client.1.smithi079.stdout:3/510: dread f13 [0,4194304] 0 2024-05-09T06:29:35.319 INFO:tasks.workunit.client.1.smithi079.stdout:3/511: truncate f19 882029 0 2024-05-09T06:29:35.321 INFO:tasks.workunit.client.1.smithi079.stdout:4/622: dwrite d6/d1a/d26/d2a/d54/f45 [0,4194304] 0 2024-05-09T06:29:35.322 INFO:tasks.workunit.client.1.smithi079.stdout:4/623: chown d6/dd/l28 20 1 2024-05-09T06:29:35.322 INFO:tasks.workunit.client.1.smithi079.stdout:5/489: dwrite d13/d43/d26/d35/f5e [0,4194304] 0 2024-05-09T06:29:35.323 INFO:tasks.workunit.client.1.smithi079.stdout:5/490: write d13/d92/fa3 [67293,62594] 0 2024-05-09T06:29:35.323 INFO:tasks.workunit.client.1.smithi079.stdout:5/491: stat d13/f48 0 2024-05-09T06:29:35.324 INFO:tasks.workunit.client.1.smithi079.stdout:7/481: rename d4/d7/d22/c4e to d4/d7/d78/c96 0 2024-05-09T06:29:35.328 INFO:tasks.workunit.client.1.smithi079.stdout:4/624: unlink d6/d1a/d41/d68/d6b/c99 0 2024-05-09T06:29:35.335 INFO:tasks.workunit.client.1.smithi079.stdout:5/492: mknod d13/d4f/d80/caf 0 2024-05-09T06:29:35.341 INFO:tasks.workunit.client.1.smithi079.stdout:4/625: creat d6/d1a/fcc x:0 0 0 2024-05-09T06:29:35.341 INFO:tasks.workunit.client.1.smithi079.stdout:4/626: dread - d6/d1a/d26/d2a/d54/d9e/fc0 zero size 2024-05-09T06:29:35.341 INFO:tasks.workunit.client.1.smithi079.stdout:4/627: creat d6/d1a/d41/d68/da1/dbe/fcd x:0 0 0 2024-05-09T06:29:35.345 INFO:tasks.workunit.client.1.smithi079.stdout:2/500: dwrite d8/db/f12 [0,4194304] 0 2024-05-09T06:29:35.345 INFO:tasks.workunit.client.1.smithi079.stdout:5/493: creat d13/d43/d3d/d40/d53/fb0 x:0 0 0 2024-05-09T06:29:35.345 INFO:tasks.workunit.client.1.smithi079.stdout:5/494: truncate d13/d43/d3d/d40/d63/da2/d8b/fa1 500709 0 2024-05-09T06:29:35.346 INFO:tasks.workunit.client.1.smithi079.stdout:6/507: dwrite d0/d6/d16/d28/f46 [0,4194304] 0 2024-05-09T06:29:35.349 INFO:tasks.workunit.client.1.smithi079.stdout:0/401: rename d3/d5/d27 to d3/dd/d66/d6d/d74/d80 0 2024-05-09T06:29:35.349 INFO:tasks.workunit.client.1.smithi079.stdout:2/501: dread d8/db/dc/d2c/f31 [0,4194304] 0 2024-05-09T06:29:35.354 INFO:tasks.workunit.client.1.smithi079.stdout:5/495: link d13/d43/d3d/d40/d63/c66 d13/d43/d26/d35/cb1 0 2024-05-09T06:29:35.354 INFO:tasks.workunit.client.1.smithi079.stdout:8/513: rmdir d1/d5/d36 39 2024-05-09T06:29:35.356 INFO:tasks.workunit.client.1.smithi079.stdout:4/628: dwrite d6/d1a/d26/d2a/d54/f45 [0,4194304] 0 2024-05-09T06:29:35.359 INFO:tasks.workunit.client.1.smithi079.stdout:6/508: mkdir d0/d6/d1b/d20/dac 0 2024-05-09T06:29:35.363 INFO:tasks.workunit.client.1.smithi079.stdout:9/656: rename d1/d6/f18 to d1/d33/d28/d36/d4d/fda 0 2024-05-09T06:29:35.363 INFO:tasks.workunit.client.1.smithi079.stdout:9/657: getdents d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/dd7 0 2024-05-09T06:29:35.365 INFO:tasks.workunit.client.1.smithi079.stdout:0/402: link d3/dd/d1f/l57 d3/l81 0 2024-05-09T06:29:35.367 INFO:tasks.workunit.client.1.smithi079.stdout:5/496: creat d13/d43/d39/d61/d72/fb2 x:0 0 0 2024-05-09T06:29:35.367 INFO:tasks.workunit.client.1.smithi079.stdout:5/497: dread - d13/d43/d39/d61/fa6 zero size 2024-05-09T06:29:35.367 INFO:tasks.workunit.client.1.smithi079.stdout:5/498: chown d13/d43/f25 956 1 2024-05-09T06:29:35.370 INFO:tasks.workunit.client.1.smithi079.stdout:2/502: dread d8/db/dc/f1d [4194304,4194304] 0 2024-05-09T06:29:35.371 INFO:tasks.workunit.client.1.smithi079.stdout:6/509: mkdir d0/d6/d16/d1f/d36/d69/dad 0 2024-05-09T06:29:35.371 INFO:tasks.workunit.client.1.smithi079.stdout:6/510: dread - d0/d6/d16/d28/f6a zero size 2024-05-09T06:29:35.371 INFO:tasks.workunit.client.1.smithi079.stdout:6/511: fdatasync d0/d6/d5e/f9a 0 2024-05-09T06:29:35.371 INFO:tasks.workunit.client.1.smithi079.stdout:6/512: fdatasync d0/d6/d16/d1f/d36/f54 0 2024-05-09T06:29:35.373 INFO:tasks.workunit.client.1.smithi079.stdout:9/658: unlink d1/d33/d28/d36/d4d/d7d/f31 0 2024-05-09T06:29:35.373 INFO:tasks.workunit.client.1.smithi079.stdout:9/659: readlink d1/d33/d48/dbf/lb2 0 2024-05-09T06:29:35.375 INFO:tasks.workunit.client.1.smithi079.stdout:0/403: mknod d3/dd/d71/c82 0 2024-05-09T06:29:35.377 INFO:tasks.workunit.client.1.smithi079.stdout:5/499: creat d13/d2a/fb3 x:0 0 0 2024-05-09T06:29:35.379 INFO:tasks.workunit.client.1.smithi079.stdout:2/503: link d8/f49 d8/db/d59/d67/fc1 0 2024-05-09T06:29:35.380 INFO:tasks.workunit.client.1.smithi079.stdout:6/513: dread d0/d6/d1b/f50 [0,4194304] 0 2024-05-09T06:29:35.381 INFO:tasks.workunit.client.1.smithi079.stdout:6/514: fdatasync d0/d6/d16/f30 0 2024-05-09T06:29:35.381 INFO:tasks.workunit.client.1.smithi079.stdout:6/515: readlink d0/d6/d1b/d2d/l34 0 2024-05-09T06:29:35.383 INFO:tasks.workunit.client.1.smithi079.stdout:9/660: creat d1/d45/dc6/dc9/da9/fdb x:0 0 0 2024-05-09T06:29:35.386 INFO:tasks.workunit.client.1.smithi079.stdout:2/504: symlink d8/db/lc2 0 2024-05-09T06:29:35.386 INFO:tasks.workunit.client.1.smithi079.stdout:8/514: dwrite d1/db/fa9 [0,4194304] 0 2024-05-09T06:29:35.389 INFO:tasks.workunit.client.1.smithi079.stdout:6/516: rmdir d0/d6/d16 39 2024-05-09T06:29:35.389 INFO:tasks.workunit.client.1.smithi079.stdout:6/517: fsync d0/f8f 0 2024-05-09T06:29:35.391 INFO:tasks.workunit.client.1.smithi079.stdout:9/661: mknod d1/d33/d28/d4c/d8b/cdc 0 2024-05-09T06:29:35.394 INFO:tasks.workunit.client.1.smithi079.stdout:2/505: creat d8/db/d11/d79/d88/fc3 x:0 0 0 2024-05-09T06:29:35.398 INFO:tasks.workunit.client.1.smithi079.stdout:0/404: dwrite d3/dd/d66/f72 [4194304,4194304] 0 2024-05-09T06:29:35.398 INFO:tasks.workunit.client.1.smithi079.stdout:0/405: write d3/dd/d18/d5e/d69/f7c [313040,19331] 0 2024-05-09T06:29:35.398 INFO:tasks.workunit.client.1.smithi079.stdout:0/406: read d3/dd/d1f/d1e/d2c/d35/d36/f48 [760611,39888] 0 2024-05-09T06:29:35.399 INFO:tasks.workunit.client.1.smithi079.stdout:0/407: fdatasync d3/dd/d1f/f29 0 2024-05-09T06:29:35.399 INFO:tasks.workunit.client.1.smithi079.stdout:5/500: dwrite d13/d43/d3d/f90 [0,4194304] 0 2024-05-09T06:29:35.399 INFO:tasks.workunit.client.1.smithi079.stdout:8/515: link d1/d3/d20/d22/d3f/l41 d1/d3/d20/d22/d44/da2/lb9 0 2024-05-09T06:29:35.401 INFO:tasks.workunit.client.1.smithi079.stdout:6/518: link d0/fc d0/d6/d1b/fae 0 2024-05-09T06:29:35.402 INFO:tasks.workunit.client.1.smithi079.stdout:6/519: truncate d0/d60/fa9 673159 0 2024-05-09T06:29:35.402 INFO:tasks.workunit.client.1.smithi079.stdout:9/662: mknod d1/d45/dab/cdd 0 2024-05-09T06:29:35.402 INFO:tasks.workunit.client.1.smithi079.stdout:9/663: chown d1/d45/dc6/dc9/da9/fdb 1339 1 2024-05-09T06:29:35.404 INFO:tasks.workunit.client.1.smithi079.stdout:2/506: truncate d8/db/d4b/d4f/f36 4186417 0 2024-05-09T06:29:35.404 INFO:tasks.workunit.client.1.smithi079.stdout:5/501: dread d13/d43/d9e/fa4 [0,4194304] 0 2024-05-09T06:29:35.406 INFO:tasks.workunit.client.1.smithi079.stdout:0/408: symlink d3/dd/d66/d6d/d74/l83 0 2024-05-09T06:29:35.427 INFO:tasks.workunit.client.1.smithi079.stdout:5/502: dwrite d13/d43/d3d/f85 [0,4194304] 0 2024-05-09T06:29:35.427 INFO:tasks.workunit.client.1.smithi079.stdout:5/503: chown d13/d43/c7c 343641297 1 2024-05-09T06:29:35.428 INFO:tasks.workunit.client.1.smithi079.stdout:8/516: rmdir d1/d3/d20/d7f 39 2024-05-09T06:29:35.431 INFO:tasks.workunit.client.1.smithi079.stdout:6/520: mkdir d0/d60/daf 0 2024-05-09T06:29:35.433 INFO:tasks.workunit.client.1.smithi079.stdout:9/664: creat d1/d33/d28/d4c/d8b/fde x:0 0 0 2024-05-09T06:29:35.437 INFO:tasks.workunit.client.1.smithi079.stdout:2/507: unlink d8/db/d4b/d4f/ca0 0 2024-05-09T06:29:35.438 INFO:tasks.workunit.client.1.smithi079.stdout:0/409: mkdir d3/dd/d66/d6d/d74/d84 0 2024-05-09T06:29:35.438 INFO:tasks.workunit.client.1.smithi079.stdout:6/521: write d0/d6/d1b/d2d/f4c [3810285,68407] 0 2024-05-09T06:29:35.445 INFO:tasks.workunit.client.1.smithi079.stdout:8/517: dwrite d1/f91 [4194304,4194304] 0 2024-05-09T06:29:35.448 INFO:tasks.workunit.client.1.smithi079.stdout:9/665: symlink d1/d33/d28/d36/dbe/ldf 0 2024-05-09T06:29:35.450 INFO:tasks.workunit.client.1.smithi079.stdout:2/508: creat d8/db/d59/d67/fc4 x:0 0 0 2024-05-09T06:29:35.450 INFO:tasks.workunit.client.1.smithi079.stdout:2/509: dread - d8/db/d59/d67/d86/f9e zero size 2024-05-09T06:29:35.450 INFO:tasks.workunit.client.1.smithi079.stdout:2/510: chown d8/db/d4b/d4f/d51/d6d/l8c 423448589 1 2024-05-09T06:29:35.453 INFO:tasks.workunit.client.1.smithi079.stdout:6/522: symlink d0/d6/d16/d1f/d6f/lb0 0 2024-05-09T06:29:35.455 INFO:tasks.workunit.client.1.smithi079.stdout:0/410: dwrite d3/dd/d18/d5e/f5a [0,4194304] 0 2024-05-09T06:29:35.455 INFO:tasks.workunit.client.1.smithi079.stdout:0/411: readlink d3/dd/d18/l5d 0 2024-05-09T06:29:35.457 INFO:tasks.workunit.client.1.smithi079.stdout:5/504: symlink d13/d43/d26/lb4 0 2024-05-09T06:29:35.457 INFO:tasks.workunit.client.1.smithi079.stdout:5/505: readlink d13/d43/d3d/l46 0 2024-05-09T06:29:35.464 INFO:tasks.workunit.client.1.smithi079.stdout:9/666: stat d1/d6/c2a 0 2024-05-09T06:29:35.465 INFO:tasks.workunit.client.1.smithi079.stdout:2/511: symlink d8/db/d59/d93/lc5 0 2024-05-09T06:29:35.470 INFO:tasks.workunit.client.1.smithi079.stdout:6/523: dwrite d0/d6/d16/d1f/f23 [0,4194304] 0 2024-05-09T06:29:35.471 INFO:tasks.workunit.client.1.smithi079.stdout:0/412: unlink d3/dd/d18/l26 0 2024-05-09T06:29:35.471 INFO:tasks.workunit.client.1.smithi079.stdout:0/413: fsync d3/f39 0 2024-05-09T06:29:35.477 INFO:tasks.workunit.client.1.smithi079.stdout:5/506: rename c9 to d13/d4f/d80/cb5 0 2024-05-09T06:29:35.478 INFO:tasks.workunit.client.1.smithi079.stdout:5/507: chown d13/d43/d39/f58 1539254 1 2024-05-09T06:29:35.482 INFO:tasks.workunit.client.1.smithi079.stdout:8/518: rmdir d1/d67 39 2024-05-09T06:29:35.485 INFO:tasks.workunit.client.1.smithi079.stdout:9/667: mkdir d1/d33/d48/d64/de0 0 2024-05-09T06:29:35.491 INFO:tasks.workunit.client.1.smithi079.stdout:5/508: mkdir d13/d43/d3d/d40/d63/da2/db6 0 2024-05-09T06:29:35.491 INFO:tasks.workunit.client.1.smithi079.stdout:5/509: creat d13/d43/d39/d61/fb7 x:0 0 0 2024-05-09T06:29:35.491 INFO:tasks.workunit.client.1.smithi079.stdout:5/510: fsync d13/d43/d39/f7f 0 2024-05-09T06:29:35.491 INFO:tasks.workunit.client.1.smithi079.stdout:5/511: write d13/d43/d39/f58 [230390,1602] 0 2024-05-09T06:29:35.491 INFO:tasks.workunit.client.1.smithi079.stdout:8/519: creat d1/d67/fba x:0 0 0 2024-05-09T06:29:35.494 INFO:tasks.workunit.client.1.smithi079.stdout:8/520: mkdir d1/d3/d20/d22/d44/da2/dbb 0 2024-05-09T06:29:35.494 INFO:tasks.workunit.client.1.smithi079.stdout:9/668: dread d1/d45/f59 [4194304,4194304] 0 2024-05-09T06:29:35.497 INFO:tasks.workunit.client.1.smithi079.stdout:8/521: mknod d1/d3/d20/d22/d44/da4/cbc 0 2024-05-09T06:29:35.497 INFO:tasks.workunit.client.1.smithi079.stdout:8/522: readlink d1/d3/d20/d7f/d33/d5d/l65 0 2024-05-09T06:29:35.499 INFO:tasks.workunit.client.1.smithi079.stdout:6/524: dwrite d0/f8b [0,4194304] 0 2024-05-09T06:29:35.499 INFO:tasks.workunit.client.1.smithi079.stdout:9/669: symlink d1/d45/dc6/dc9/d2d/le1 0 2024-05-09T06:29:35.499 INFO:tasks.workunit.client.1.smithi079.stdout:0/414: dwrite d3/dd/d1f/d1e/d2c/d35/f7d [0,4194304] 0 2024-05-09T06:29:35.499 INFO:tasks.workunit.client.1.smithi079.stdout:7/482: write d4/d7/dd/f24 [1338762,29840] 0 2024-05-09T06:29:35.502 INFO:tasks.workunit.client.1.smithi079.stdout:5/512: dread d13/d43/d26/f33 [0,4194304] 0 2024-05-09T06:29:35.503 INFO:tasks.workunit.client.1.smithi079.stdout:0/415: write d3/dd/f5b [10765,76362] 0 2024-05-09T06:29:35.503 INFO:tasks.workunit.client.1.smithi079.stdout:2/512: dwrite d8/db/d11/f3f [4194304,4194304] 0 2024-05-09T06:29:35.503 INFO:tasks.workunit.client.1.smithi079.stdout:2/513: truncate d8/db/d11/d79/d88/fc3 445403 0 2024-05-09T06:29:35.503 INFO:tasks.workunit.client.1.smithi079.stdout:2/514: fdatasync d8/db/d11/f72 0 2024-05-09T06:29:35.503 INFO:tasks.workunit.client.1.smithi079.stdout:2/515: write d8/db/d59/d67/fc1 [672790,82897] 0 2024-05-09T06:29:35.508 INFO:tasks.workunit.client.1.smithi079.stdout:6/525: symlink d0/d6/lb1 0 2024-05-09T06:29:35.509 INFO:tasks.workunit.client.1.smithi079.stdout:2/516: dread d8/db/d11/f45 [0,4194304] 0 2024-05-09T06:29:35.510 INFO:tasks.workunit.client.1.smithi079.stdout:7/483: dread d4/d7/dd/f16 [0,4194304] 0 2024-05-09T06:29:35.510 INFO:tasks.workunit.client.1.smithi079.stdout:7/484: fdatasync d4/d20/f4f 0 2024-05-09T06:29:35.514 INFO:tasks.workunit.client.1.smithi079.stdout:5/513: fdatasync d13/d43/d26/f2e 0 2024-05-09T06:29:35.516 INFO:tasks.workunit.client.1.smithi079.stdout:0/416: symlink d3/dd/d66/d6d/d74/l85 0 2024-05-09T06:29:35.520 INFO:tasks.workunit.client.1.smithi079.stdout:2/517: write d8/db/f12 [3945215,95987] 0 2024-05-09T06:29:35.525 INFO:tasks.workunit.client.1.smithi079.stdout:9/670: dwrite d1/d5/faa [0,4194304] 0 2024-05-09T06:29:35.527 INFO:tasks.workunit.client.1.smithi079.stdout:2/518: dread f3 [4194304,4194304] 0 2024-05-09T06:29:35.539 INFO:tasks.workunit.client.1.smithi079.stdout:6/526: mkdir d0/da2/db2 0 2024-05-09T06:29:35.541 INFO:tasks.workunit.client.1.smithi079.stdout:7/485: creat d4/d7/d78/f97 x:0 0 0 2024-05-09T06:29:35.541 INFO:tasks.workunit.client.1.smithi079.stdout:7/486: write d4/d7/dd/f42 [3991157,16664] 0 2024-05-09T06:29:35.541 INFO:tasks.workunit.client.1.smithi079.stdout:7/487: readlink d4/d7/dd/d5b/d31/l4c 0 2024-05-09T06:29:35.542 INFO:tasks.workunit.client.1.smithi079.stdout:5/514: rmdir d13/d43/d3d/d40/d63/da2/db6 0 2024-05-09T06:29:35.544 INFO:tasks.workunit.client.1.smithi079.stdout:0/417: creat d3/dd/d1f/d1e/d2c/d65/f86 x:0 0 0 2024-05-09T06:29:35.545 INFO:tasks.workunit.client.1.smithi079.stdout:0/418: write d3/dd/d1f/d1e/d2c/d35/d36/f63 [1035838,4674] 0 2024-05-09T06:29:35.545 INFO:tasks.workunit.client.1.smithi079.stdout:0/419: chown d3/dd/f1c 15864 1 2024-05-09T06:29:35.545 INFO:tasks.workunit.client.1.smithi079.stdout:0/420: read - d3/dd/d18/d5e/d69/f75 zero size 2024-05-09T06:29:35.548 INFO:tasks.workunit.client.1.smithi079.stdout:9/671: creat d1/d33/d28/d4c/d97/dd3/fe2 x:0 0 0 2024-05-09T06:29:35.548 INFO:tasks.workunit.client.1.smithi079.stdout:9/672: readlink d1/l79 0 2024-05-09T06:29:35.548 INFO:tasks.workunit.client.1.smithi079.stdout:9/673: getdents d1/d33/d28/d36/dcd 0 2024-05-09T06:29:35.548 INFO:tasks.workunit.client.1.smithi079.stdout:2/519: creat d8/db/d5c/fc6 x:0 0 0 2024-05-09T06:29:35.548 INFO:tasks.workunit.client.1.smithi079.stdout:2/520: fdatasync d8/db/d11/d5f/f75 0 2024-05-09T06:29:35.553 INFO:tasks.workunit.client.1.smithi079.stdout:6/527: creat d0/d60/daf/fb3 x:0 0 0 2024-05-09T06:29:35.554 INFO:tasks.workunit.client.1.smithi079.stdout:6/528: truncate d0/f7a 686425 0 2024-05-09T06:29:35.554 INFO:tasks.workunit.client.1.smithi079.stdout:9/674: dread d1/d33/d28/d36/f7b [0,4194304] 0 2024-05-09T06:29:35.554 INFO:tasks.workunit.client.1.smithi079.stdout:9/675: fsync d1/d5/f58 0 2024-05-09T06:29:35.558 INFO:tasks.workunit.client.1.smithi079.stdout:7/488: mknod d4/d7/d22/c98 0 2024-05-09T06:29:35.559 INFO:tasks.workunit.client.1.smithi079.stdout:5/515: stat d13/d43/d26/d35/c3b 0 2024-05-09T06:29:35.562 INFO:tasks.workunit.client.1.smithi079.stdout:0/421: mkdir d3/d5/d87 0 2024-05-09T06:29:35.562 INFO:tasks.workunit.client.1.smithi079.stdout:0/422: fdatasync d3/dd/d18/f34 0 2024-05-09T06:29:35.563 INFO:tasks.workunit.client.1.smithi079.stdout:2/521: rmdir d8/db/d59 39 2024-05-09T06:29:35.566 INFO:tasks.workunit.client.1.smithi079.stdout:9/676: stat d1/d6/lc5 0 2024-05-09T06:29:35.567 INFO:tasks.workunit.client.1.smithi079.stdout:9/677: write d1/d33/d28/d36/d4d/f8a [509151,102813] 0 2024-05-09T06:29:35.568 INFO:tasks.workunit.client.1.smithi079.stdout:5/516: symlink d13/da5/lb8 0 2024-05-09T06:29:35.570 INFO:tasks.workunit.client.1.smithi079.stdout:0/423: mkdir d3/dd/d1f/d1e/d2c/d88 0 2024-05-09T06:29:35.572 INFO:tasks.workunit.client.1.smithi079.stdout:6/529: rmdir d0/d6/d16/d1f/d6f/d8c/d93 39 2024-05-09T06:29:35.572 INFO:tasks.workunit.client.1.smithi079.stdout:7/489: dwrite d4/d7/d37/f46 [0,4194304] 0 2024-05-09T06:29:35.572 INFO:tasks.workunit.client.1.smithi079.stdout:7/490: chown d4/d7/dd/d5b/d31/f75 468637366 1 2024-05-09T06:29:35.574 INFO:tasks.workunit.client.1.smithi079.stdout:6/530: dread d0/d6/d5e/f63 [0,4194304] 0 2024-05-09T06:29:35.574 INFO:tasks.workunit.client.1.smithi079.stdout:6/531: chown d0/d6/d16/d28/l31 6986 1 2024-05-09T06:29:35.574 INFO:tasks.workunit.client.1.smithi079.stdout:6/532: creat d0/d6/d1b/fb4 x:0 0 0 2024-05-09T06:29:35.574 INFO:tasks.workunit.client.1.smithi079.stdout:1/471: sync 2024-05-09T06:29:35.575 INFO:tasks.workunit.client.1.smithi079.stdout:2/522: dread d8/db/d4b/d4f/d51/d6d/f96 [0,4194304] 0 2024-05-09T06:29:35.577 INFO:tasks.workunit.client.1.smithi079.stdout:5/517: creat d13/d43/d26/d35/fb9 x:0 0 0 2024-05-09T06:29:35.577 INFO:tasks.workunit.client.1.smithi079.stdout:5/518: creat d13/d92/d9b/fba x:0 0 0 2024-05-09T06:29:35.577 INFO:tasks.workunit.client.1.smithi079.stdout:9/678: read d1/d45/dc6/dc9/f2e [4997171,10108] 0 2024-05-09T06:29:35.578 INFO:tasks.workunit.client.1.smithi079.stdout:9/679: fdatasync d1/d33/d28/d36/d4d/d7d/d19/f1e 0 2024-05-09T06:29:35.578 INFO:tasks.workunit.client.1.smithi079.stdout:9/680: fdatasync d1/d33/d28/d36/d4d/d7d/fc4 0 2024-05-09T06:29:35.580 INFO:tasks.workunit.client.1.smithi079.stdout:6/533: read d0/d6/d1b/f3d [1747570,74675] 0 2024-05-09T06:29:35.580 INFO:tasks.workunit.client.1.smithi079.stdout:6/534: write d0/d6/d16/d1f/d36/d69/d84/f94 [575556,34943] 0 2024-05-09T06:29:35.583 INFO:tasks.workunit.client.1.smithi079.stdout:7/491: creat d4/d7/dd/d5b/f99 x:0 0 0 2024-05-09T06:29:35.583 INFO:tasks.workunit.client.1.smithi079.stdout:7/492: read - d4/d7/f49 zero size 2024-05-09T06:29:35.587 INFO:tasks.workunit.client.1.smithi079.stdout:1/472: stat d0/d12/d48/d75/l37 0 2024-05-09T06:29:35.589 INFO:tasks.workunit.client.1.smithi079.stdout:2/523: mkdir d8/db/d59/d93/dc7 0 2024-05-09T06:29:35.589 INFO:tasks.workunit.client.1.smithi079.stdout:2/524: truncate d8/db/dc/f6a 247231 0 2024-05-09T06:29:35.596 INFO:tasks.workunit.client.1.smithi079.stdout:7/493: mknod d4/d20/c9a 0 2024-05-09T06:29:35.599 INFO:tasks.workunit.client.1.smithi079.stdout:0/424: dwrite d3/dd/d1f/d1e/d2c/d35/d36/f48 [0,4194304] 0 2024-05-09T06:29:35.599 INFO:tasks.workunit.client.1.smithi079.stdout:5/519: dwrite d13/d92/fa3 [0,4194304] 0 2024-05-09T06:29:35.599 INFO:tasks.workunit.client.1.smithi079.stdout:5/520: rename d13/d43 to d13/d43/d3d/d40/d9a/dbb 22 2024-05-09T06:29:35.600 INFO:tasks.workunit.client.1.smithi079.stdout:9/681: creat d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/fe3 x:0 0 0 2024-05-09T06:29:35.602 INFO:tasks.workunit.client.1.smithi079.stdout:6/535: getdents d0/d6/d1b/d20 0 2024-05-09T06:29:35.602 INFO:tasks.workunit.client.1.smithi079.stdout:7/494: dread d4/d7/dd/d5b/d31/f33 [0,4194304] 0 2024-05-09T06:29:35.607 INFO:tasks.workunit.client.1.smithi079.stdout:7/495: dread d4/d7/d37/f4a [0,4194304] 0 2024-05-09T06:29:35.609 INFO:tasks.workunit.client.1.smithi079.stdout:1/473: dwrite d0/f58 [0,4194304] 0 2024-05-09T06:29:35.611 INFO:tasks.workunit.client.1.smithi079.stdout:2/525: dwrite d8/db/d11/f8e [0,4194304] 0 2024-05-09T06:29:35.612 INFO:tasks.workunit.client.1.smithi079.stdout:2/526: write d8/db/dc/d2c/d2e/f3e [555059,73069] 0 2024-05-09T06:29:35.612 INFO:tasks.workunit.client.1.smithi079.stdout:0/425: mkdir d3/dd/d1f/d1e/d2c/d35/d36/d89 0 2024-05-09T06:29:35.616 INFO:tasks.workunit.client.1.smithi079.stdout:9/682: creat d1/d33/d28/d36/db5/fe4 x:0 0 0 2024-05-09T06:29:35.622 INFO:tasks.workunit.client.1.smithi079.stdout:7/496: link d4/d7/d22/f59 d4/d7/d22/d28/d50/f9b 0 2024-05-09T06:29:35.622 INFO:tasks.workunit.client.1.smithi079.stdout:2/527: dread d8/db/d4b/d4f/d51/d6f/fa2 [0,4194304] 0 2024-05-09T06:29:35.622 INFO:tasks.workunit.client.1.smithi079.stdout:2/528: fsync d8/db/d4b/d4f/d51/fa4 0 2024-05-09T06:29:35.622 INFO:tasks.workunit.client.1.smithi079.stdout:2/529: getdents d8/db/d59/d93/dc7 0 2024-05-09T06:29:35.623 INFO:tasks.workunit.client.1.smithi079.stdout:0/426: write d3/dd/d1f/f1d [3907132,34966] 0 2024-05-09T06:29:35.625 INFO:tasks.workunit.client.1.smithi079.stdout:1/474: creat d0/d12/d48/d75/d97/fa8 x:0 0 0 2024-05-09T06:29:35.632 INFO:tasks.workunit.client.1.smithi079.stdout:9/683: dread d1/f29 [4194304,4194304] 0 2024-05-09T06:29:35.632 INFO:tasks.workunit.client.1.smithi079.stdout:7/497: symlink d4/d7/d22/d28/d50/d5c/l9c 0 2024-05-09T06:29:35.634 INFO:tasks.workunit.client.1.smithi079.stdout:0/427: dread d3/dd/d1f/d1e/d2c/d35/f7d [0,4194304] 0 2024-05-09T06:29:35.634 INFO:tasks.workunit.client.1.smithi079.stdout:0/428: truncate d3/dd/d1f/d1e/d2c/d35/f60 1772784 0 2024-05-09T06:29:35.634 INFO:tasks.workunit.client.1.smithi079.stdout:2/530: mknod d8/db/d11/d79/cc8 0 2024-05-09T06:29:35.637 INFO:tasks.workunit.client.1.smithi079.stdout:6/536: dwrite d0/f15 [0,4194304] 0 2024-05-09T06:29:35.638 INFO:tasks.workunit.client.1.smithi079.stdout:5/521: dwrite d13/f21 [0,4194304] 0 2024-05-09T06:29:35.638 INFO:tasks.workunit.client.1.smithi079.stdout:5/522: fsync d13/d43/d26/d35/f6d 0 2024-05-09T06:29:35.638 INFO:tasks.workunit.client.1.smithi079.stdout:5/523: dread - d13/d2a/fb3 zero size 2024-05-09T06:29:35.638 INFO:tasks.workunit.client.1.smithi079.stdout:5/524: dread - d13/f99 zero size 2024-05-09T06:29:35.640 INFO:tasks.workunit.client.1.smithi079.stdout:1/475: creat d0/fa9 x:0 0 0 2024-05-09T06:29:35.640 INFO:tasks.workunit.client.1.smithi079.stdout:1/476: write d0/d12/d48/d75/d43/f77 [207854,86387] 0 2024-05-09T06:29:35.640 INFO:tasks.workunit.client.1.smithi079.stdout:5/525: dread d13/d43/d39/f58 [0,4194304] 0 2024-05-09T06:29:35.641 INFO:tasks.workunit.client.1.smithi079.stdout:9/684: creat d1/d33/d28/d36/d4d/d51/fe5 x:0 0 0 2024-05-09T06:29:35.643 INFO:tasks.workunit.client.1.smithi079.stdout:0/429: mknod d3/dd/d1f/d1e/d2c/d35/d36/c8a 0 2024-05-09T06:29:35.645 INFO:tasks.workunit.client.1.smithi079.stdout:2/531: unlink d8/d3c/f4c 0 2024-05-09T06:29:35.645 INFO:tasks.workunit.client.1.smithi079.stdout:2/532: chown d8/db/d4b/d4f/d51/d6f 99124679 1 2024-05-09T06:29:35.648 INFO:tasks.workunit.client.1.smithi079.stdout:5/526: dread d13/d2a/f4e [0,4194304] 0 2024-05-09T06:29:35.656 INFO:tasks.workunit.client.1.smithi079.stdout:6/537: dwrite d0/de/f43 [0,4194304] 0 2024-05-09T06:29:35.656 INFO:tasks.workunit.client.1.smithi079.stdout:6/538: fdatasync d0/d6/f4d 0 2024-05-09T06:29:35.657 INFO:tasks.workunit.client.1.smithi079.stdout:4/629: sync 2024-05-09T06:29:35.657 INFO:tasks.workunit.client.1.smithi079.stdout:3/512: sync 2024-05-09T06:29:35.657 INFO:tasks.workunit.client.1.smithi079.stdout:4/630: chown d6/d8/d27/d62/l3f 11291483 1 2024-05-09T06:29:35.661 INFO:tasks.workunit.client.1.smithi079.stdout:1/477: symlink d0/d7/laa 0 2024-05-09T06:29:35.662 INFO:tasks.workunit.client.1.smithi079.stdout:9/685: truncate d1/f17 500893 0 2024-05-09T06:29:35.663 INFO:tasks.workunit.client.1.smithi079.stdout:1/478: dread d0/d12/d48/d75/d43/d20/f91 [0,4194304] 0 2024-05-09T06:29:35.665 INFO:tasks.workunit.client.1.smithi079.stdout:0/430: getdents d3/dd/d66/d6d/d74/d80 0 2024-05-09T06:29:35.668 INFO:tasks.workunit.client.1.smithi079.stdout:2/533: mknod d8/db/d4b/d4f/d51/d6d/cc9 0 2024-05-09T06:29:35.669 INFO:tasks.workunit.client.1.smithi079.stdout:1/479: dread d0/d12/f2c [0,4194304] 0 2024-05-09T06:29:35.669 INFO:tasks.workunit.client.1.smithi079.stdout:1/480: stat d0/d12/d48/d75/l37 0 2024-05-09T06:29:35.669 INFO:tasks.workunit.client.1.smithi079.stdout:1/481: chown d0/f5 1425 1 2024-05-09T06:29:35.670 INFO:tasks.workunit.client.1.smithi079.stdout:5/527: mknod d13/d43/d3d/d40/d63/da2/cbc 0 2024-05-09T06:29:35.671 INFO:tasks.workunit.client.1.smithi079.stdout:1/482: read d0/d12/d48/d75/f69 [560622,8478] 0 2024-05-09T06:29:35.679 INFO:tasks.workunit.client.1.smithi079.stdout:3/513: symlink d1a/la6 0 2024-05-09T06:29:35.679 INFO:tasks.workunit.client.1.smithi079.stdout:3/514: write d1a/d1d/f63 [931101,86292] 0 2024-05-09T06:29:35.679 INFO:tasks.workunit.client.1.smithi079.stdout:3/515: dread - d1a/d21/f98 zero size 2024-05-09T06:29:35.681 INFO:tasks.workunit.client.1.smithi079.stdout:4/631: symlink d6/d8/d55/lce 0 2024-05-09T06:29:35.683 INFO:tasks.workunit.client.1.smithi079.stdout:3/516: write f16 [1623777,103209] 0 2024-05-09T06:29:35.684 INFO:tasks.workunit.client.1.smithi079.stdout:9/686: unlink d1/d5/d91/fb1 0 2024-05-09T06:29:35.686 INFO:tasks.workunit.client.1.smithi079.stdout:0/431: creat d3/dd/d1f/d1e/d2c/d88/f8b x:0 0 0 2024-05-09T06:29:35.686 INFO:tasks.workunit.client.1.smithi079.stdout:0/432: write d3/dd/d18/d5e/d69/f75 [901669,77015] 0 2024-05-09T06:29:35.687 INFO:tasks.workunit.client.1.smithi079.stdout:0/433: write d3/dd/d1f/d1e/d2c/d65/f86 [352303,43579] 0 2024-05-09T06:29:35.689 INFO:tasks.workunit.client.1.smithi079.stdout:2/534: truncate d8/db/dc/fd 3788425 0 2024-05-09T06:29:35.694 INFO:tasks.workunit.client.1.smithi079.stdout:5/528: mkdir d13/d43/d39/d61/d72/dbd 0 2024-05-09T06:29:35.695 INFO:tasks.workunit.client.1.smithi079.stdout:1/483: rename d0/d12/d48/d75/d26/fa7 to d0/d7/d4e/d7d/d94/da3/fab 0 2024-05-09T06:29:35.696 INFO:tasks.workunit.client.1.smithi079.stdout:6/539: getdents d0/d6/d16/d1f/d36/d69/d84 0 2024-05-09T06:29:35.696 INFO:tasks.workunit.client.1.smithi079.stdout:0/434: write d3/dd/d18/d5e/f5a [2870881,103519] 0 2024-05-09T06:29:35.699 INFO:tasks.workunit.client.1.smithi079.stdout:3/517: unlink d1a/f35 0 2024-05-09T06:29:35.699 INFO:tasks.workunit.client.1.smithi079.stdout:3/518: write d1a/f3d [4777983,59690] 0 2024-05-09T06:29:35.699 INFO:tasks.workunit.client.1.smithi079.stdout:3/519: read f3 [2310496,80118] 0 2024-05-09T06:29:35.702 INFO:tasks.workunit.client.1.smithi079.stdout:1/484: dread d0/d12/d67/d53/d6d/f80 [0,4194304] 0 2024-05-09T06:29:35.703 INFO:tasks.workunit.client.1.smithi079.stdout:9/687: symlink d1/d33/d28/d36/le6 0 2024-05-09T06:29:35.709 INFO:tasks.workunit.client.1.smithi079.stdout:2/535: mkdir d8/db/d59/d67/d7f/db9/dca 0 2024-05-09T06:29:35.709 INFO:tasks.workunit.client.1.smithi079.stdout:2/536: readlink d8/db/lc2 0 2024-05-09T06:29:35.709 INFO:tasks.workunit.client.1.smithi079.stdout:2/537: creat d8/db/d11/d79/d88/fcb x:0 0 0 2024-05-09T06:29:35.712 INFO:tasks.workunit.client.1.smithi079.stdout:5/529: mknod d13/d43/d39/da7/cbe 0 2024-05-09T06:29:35.716 INFO:tasks.workunit.client.1.smithi079.stdout:6/540: stat d0/d6/d16/d1f/d6f/l7f 0 2024-05-09T06:29:35.720 INFO:tasks.workunit.client.1.smithi079.stdout:1/485: dwrite d0/d7/d4e/f6c [0,4194304] 0 2024-05-09T06:29:35.722 INFO:tasks.workunit.client.1.smithi079.stdout:0/435: truncate d3/dd/d1f/d1e/d2c/d35/d36/f3d 2335121 0 2024-05-09T06:29:35.727 INFO:tasks.workunit.client.1.smithi079.stdout:3/520: unlink d1a/d1c/d22/d53/d4e/f7e 0 2024-05-09T06:29:35.731 INFO:tasks.workunit.client.1.smithi079.stdout:5/530: dwrite d13/d92/d9b/fa0 [0,4194304] 0 2024-05-09T06:29:35.738 INFO:tasks.workunit.client.1.smithi079.stdout:6/541: mkdir d0/d6/d16/d1f/d36/db5 0 2024-05-09T06:29:35.738 INFO:tasks.workunit.client.1.smithi079.stdout:6/542: fsync d0/d6/d1b/f3d 0 2024-05-09T06:29:35.738 INFO:tasks.workunit.client.1.smithi079.stdout:6/543: write d0/f8f [930889,46134] 0 2024-05-09T06:29:35.744 INFO:tasks.workunit.client.1.smithi079.stdout:5/531: read d13/d43/f36 [1130029,16146] 0 2024-05-09T06:29:35.744 INFO:tasks.workunit.client.1.smithi079.stdout:1/486: dwrite d0/df/f24 [0,4194304] 0 2024-05-09T06:29:35.744 INFO:tasks.workunit.client.1.smithi079.stdout:5/532: write fa [3433657,105726] 0 2024-05-09T06:29:35.744 INFO:tasks.workunit.client.1.smithi079.stdout:5/533: fdatasync d13/f5a 0 2024-05-09T06:29:35.744 INFO:tasks.workunit.client.1.smithi079.stdout:5/534: chown d13/d43/d3d/d40/c8f 313853 1 2024-05-09T06:29:35.745 INFO:tasks.workunit.client.1.smithi079.stdout:5/535: creat d13/d2a/fbf x:0 0 0 2024-05-09T06:29:35.745 INFO:tasks.workunit.client.1.smithi079.stdout:5/536: dread - d13/d43/d39/d61/d72/fb2 zero size 2024-05-09T06:29:35.745 INFO:tasks.workunit.client.1.smithi079.stdout:5/537: dread - d13/d43/d39/d61/fb7 zero size 2024-05-09T06:29:35.746 INFO:tasks.workunit.client.1.smithi079.stdout:3/521: symlink d1a/d1c/la7 0 2024-05-09T06:29:35.746 INFO:tasks.workunit.client.1.smithi079.stdout:3/522: chown d1a/d82 0 1 2024-05-09T06:29:35.746 INFO:tasks.workunit.client.1.smithi079.stdout:3/523: creat d1a/d1d/d34/d42/fa8 x:0 0 0 2024-05-09T06:29:35.746 INFO:tasks.workunit.client.1.smithi079.stdout:3/524: creat d1a/d1d/d3a/d7c/fa9 x:0 0 0 2024-05-09T06:29:35.750 INFO:tasks.workunit.client.1.smithi079.stdout:9/688: rename d1/d33/d28/d3e to d1/d33/d28/d36/dcd/de7 0 2024-05-09T06:29:35.750 INFO:tasks.workunit.client.1.smithi079.stdout:9/689: fsync d1/d6/f20 0 2024-05-09T06:29:35.756 INFO:tasks.workunit.client.1.smithi079.stdout:2/538: getdents d8/db/d59/d67/d86 0 2024-05-09T06:29:35.756 INFO:tasks.workunit.client.1.smithi079.stdout:2/539: creat d8/db/d4b/d4f/d51/fcc x:0 0 0 2024-05-09T06:29:35.757 INFO:tasks.workunit.client.1.smithi079.stdout:0/436: dwrite d3/dd/d66/f72 [0,4194304] 0 2024-05-09T06:29:35.760 INFO:tasks.workunit.client.1.smithi079.stdout:5/538: symlink d13/d43/d3d/d40/lc0 0 2024-05-09T06:29:35.761 INFO:tasks.workunit.client.1.smithi079.stdout:6/544: dwrite d0/d60/f6c [0,4194304] 0 2024-05-09T06:29:35.764 INFO:tasks.workunit.client.1.smithi079.stdout:3/525: truncate f11 380928 0 2024-05-09T06:29:35.766 INFO:tasks.workunit.client.1.smithi079.stdout:9/690: creat d1/d33/d28/fe8 x:0 0 0 2024-05-09T06:29:35.771 INFO:tasks.workunit.client.1.smithi079.stdout:2/540: unlink d8/db/dc/d2c/d2e/faa 0 2024-05-09T06:29:35.775 INFO:tasks.workunit.client.1.smithi079.stdout:9/691: dread d1/d33/d28/d36/d4d/d7d/d19/fa3 [0,4194304] 0 2024-05-09T06:29:35.777 INFO:tasks.workunit.client.1.smithi079.stdout:5/539: symlink d13/d43/d26/d35/lc1 0 2024-05-09T06:29:35.784 INFO:tasks.workunit.client.1.smithi079.stdout:8/523: sync 2024-05-09T06:29:35.784 INFO:tasks.workunit.client.1.smithi079.stdout:8/524: chown d1/d3/d20/d22/d3b/f46 63936 1 2024-05-09T06:29:35.784 INFO:tasks.workunit.client.1.smithi079.stdout:8/525: read d1/d3/d20/d22/f8e [145697,55154] 0 2024-05-09T06:29:35.785 INFO:tasks.workunit.client.1.smithi079.stdout:2/541: dwrite d8/db/d11/d79/fa9 [0,4194304] 0 2024-05-09T06:29:35.786 INFO:tasks.workunit.client.1.smithi079.stdout:5/540: dread d13/d43/d3d/d40/d63/f7b [0,4194304] 0 2024-05-09T06:29:35.788 INFO:tasks.workunit.client.1.smithi079.stdout:6/545: mknod d0/de/cb6 0 2024-05-09T06:29:35.791 INFO:tasks.workunit.client.1.smithi079.stdout:3/526: mkdir d1a/d82/daa 0 2024-05-09T06:29:35.794 INFO:tasks.workunit.client.1.smithi079.stdout:9/692: creat d1/d33/d48/d64/de0/fe9 x:0 0 0 2024-05-09T06:29:35.796 INFO:tasks.workunit.client.1.smithi079.stdout:2/542: dread d8/fa [0,4194304] 0 2024-05-09T06:29:35.797 INFO:tasks.workunit.client.1.smithi079.stdout:8/526: mkdir d1/d56/dbd 0 2024-05-09T06:29:35.801 INFO:tasks.workunit.client.1.smithi079.stdout:3/527: mknod d1a/d1c/d1f/cab 0 2024-05-09T06:29:35.803 INFO:tasks.workunit.client.1.smithi079.stdout:5/541: read f11 [3326475,70800] 0 2024-05-09T06:29:35.803 INFO:tasks.workunit.client.1.smithi079.stdout:5/542: stat d13/d4d/f98 0 2024-05-09T06:29:35.803 INFO:tasks.workunit.client.1.smithi079.stdout:2/543: unlink d8/db/dc/d2c/fbe 0 2024-05-09T06:29:35.809 INFO:tasks.workunit.client.1.smithi079.stdout:0/437: rmdir d3/dd/d1f/d1e/d2c/d88 39 2024-05-09T06:29:35.809 INFO:tasks.workunit.client.1.smithi079.stdout:0/438: creat d3/dd/d1f/d1e/d2c/d65/f8c x:0 0 0 2024-05-09T06:29:35.809 INFO:tasks.workunit.client.1.smithi079.stdout:0/439: write d3/dd/d1f/f28 [654293,30653] 0 2024-05-09T06:29:35.810 INFO:tasks.workunit.client.1.smithi079.stdout:6/546: dwrite d0/d6/fa7 [4194304,4194304] 0 2024-05-09T06:29:35.810 INFO:tasks.workunit.client.1.smithi079.stdout:6/547: fdatasync d0/d6/d1b/d2d/f4e 0 2024-05-09T06:29:35.811 INFO:tasks.workunit.client.1.smithi079.stdout:3/528: getdents d1a/d1d/d3a 0 2024-05-09T06:29:35.811 INFO:tasks.workunit.client.1.smithi079.stdout:3/529: chown d1a/d1d/d34/f4f 1 1 2024-05-09T06:29:35.811 INFO:tasks.workunit.client.1.smithi079.stdout:9/693: dwrite d1/d33/d28/fe8 [0,4194304] 0 2024-05-09T06:29:35.813 INFO:tasks.workunit.client.1.smithi079.stdout:2/544: dread d8/db/d4b/d4f/d51/d6f/f7b [0,4194304] 0 2024-05-09T06:29:35.813 INFO:tasks.workunit.client.1.smithi079.stdout:2/545: getdents d8/db/d59/d67/d7f/dac 0 2024-05-09T06:29:35.817 INFO:tasks.workunit.client.1.smithi079.stdout:0/440: rmdir d3/dd/d71 39 2024-05-09T06:29:35.820 INFO:tasks.workunit.client.1.smithi079.stdout:6/548: mknod d0/d6/d16/d1f/d36/d69/cb7 0 2024-05-09T06:29:35.821 INFO:tasks.workunit.client.1.smithi079.stdout:3/530: getdents d1a/d1c/d22/d53/da5 0 2024-05-09T06:29:35.827 INFO:tasks.workunit.client.1.smithi079.stdout:9/694: unlink d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/cc2 0 2024-05-09T06:29:35.835 INFO:tasks.workunit.client.1.smithi079.stdout:3/531: symlink d1a/d1c/d1f/lac 0 2024-05-09T06:29:35.835 INFO:tasks.workunit.client.1.smithi079.stdout:3/532: chown d1a/d1c/d22/d53/f7b 49083 1 2024-05-09T06:29:35.840 INFO:tasks.workunit.client.1.smithi079.stdout:9/695: link d1/d33/d28/l2c d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/dd7/lea 0 2024-05-09T06:29:35.841 INFO:tasks.workunit.client.1.smithi079.stdout:0/441: read d3/dd/d1f/d1e/d2c/d35/d36/f3d [676119,125749] 0 2024-05-09T06:29:35.842 INFO:tasks.workunit.client.1.smithi079.stdout:3/533: dread d1a/d1d/d34/d42/f47 [0,4194304] 0 2024-05-09T06:29:35.843 INFO:tasks.workunit.client.1.smithi079.stdout:2/546: rename d8/db/d4b/d4f/c40 to d8/db/d5c/d6b/db5/ccd 0 2024-05-09T06:29:35.843 INFO:tasks.workunit.client.1.smithi079.stdout:2/547: truncate d8/db/dc/d2c/d2e/fb3 340086 0 2024-05-09T06:29:35.843 INFO:tasks.workunit.client.1.smithi079.stdout:2/548: fdatasync d8/db/d11/d5f/fae 0 2024-05-09T06:29:35.843 INFO:tasks.workunit.client.1.smithi079.stdout:2/549: creat d8/db/d11/d5f/fce x:0 0 0 2024-05-09T06:29:35.845 INFO:tasks.workunit.client.1.smithi079.stdout:9/696: symlink d1/d33/d48/d64/leb 0 2024-05-09T06:29:35.847 INFO:tasks.workunit.client.1.smithi079.stdout:0/442: link d3/dd/d18/f7a d3/dd/d66/d6d/f8d 0 2024-05-09T06:29:35.848 INFO:tasks.workunit.client.1.smithi079.stdout:9/697: dread d1/d45/dc6/dc9/f2e [4194304,4194304] 0 2024-05-09T06:29:35.848 INFO:tasks.workunit.client.1.smithi079.stdout:9/698: chown d1/d33/d28/d36/d4d/d7d/d19 5 1 2024-05-09T06:29:35.848 INFO:tasks.workunit.client.1.smithi079.stdout:9/699: fdatasync d1/d6/f1c 0 2024-05-09T06:29:35.849 INFO:tasks.workunit.client.1.smithi079.stdout:3/534: rename d1a/f3d to d1a/d1c/d22/fad 0 2024-05-09T06:29:35.852 INFO:tasks.workunit.client.1.smithi079.stdout:2/550: mknod d8/db/d11/ccf 0 2024-05-09T06:29:35.852 INFO:tasks.workunit.client.1.smithi079.stdout:2/551: stat d8/db/d4b/d4f/d51/l53 0 2024-05-09T06:29:35.853 INFO:tasks.workunit.client.1.smithi079.stdout:2/552: fdatasync d8/db/dc/d2c/d2e/fb3 0 2024-05-09T06:29:35.853 INFO:tasks.workunit.client.1.smithi079.stdout:3/535: dread d1a/d1c/d1f/f31 [0,4194304] 0 2024-05-09T06:29:35.853 INFO:tasks.workunit.client.1.smithi079.stdout:3/536: dread - d1a/d1c/d22/d53/f2b zero size 2024-05-09T06:29:35.854 INFO:tasks.workunit.client.1.smithi079.stdout:0/443: mkdir d3/dd/d1f/d1e/d2c/d88/d8e 0 2024-05-09T06:29:35.856 INFO:tasks.workunit.client.1.smithi079.stdout:9/700: truncate d1/d5/f24 2289239 0 2024-05-09T06:29:35.860 INFO:tasks.workunit.client.1.smithi079.stdout:2/553: creat d8/db/d59/d67/d86/fd0 x:0 0 0 2024-05-09T06:29:35.862 INFO:tasks.workunit.client.1.smithi079.stdout:3/537: creat d1a/d1d/d67/fae x:0 0 0 2024-05-09T06:29:35.864 INFO:tasks.workunit.client.1.smithi079.stdout:0/444: creat d3/dd/d66/d6d/d74/d80/d2d/f8f x:0 0 0 2024-05-09T06:29:35.864 INFO:tasks.workunit.client.1.smithi079.stdout:0/445: stat d3/dd/d66 0 2024-05-09T06:29:35.866 INFO:tasks.workunit.client.1.smithi079.stdout:2/554: getdents d8/db/d59/d67/d7f/db9 0 2024-05-09T06:29:35.866 INFO:tasks.workunit.client.1.smithi079.stdout:2/555: read - d8/db/d4b/d4f/d51/d6f/f73 zero size 2024-05-09T06:29:35.869 INFO:tasks.workunit.client.1.smithi079.stdout:3/538: mkdir d1a/d1d/d3a/d7c/daf 0 2024-05-09T06:29:35.869 INFO:tasks.workunit.client.1.smithi079.stdout:2/556: dread d8/db/dc/d2c/d2e/fa3 [0,4194304] 0 2024-05-09T06:29:35.872 INFO:tasks.workunit.client.1.smithi079.stdout:0/446: read d3/dd/d66/d6d/d74/d80/f56 [1612370,127456] 0 2024-05-09T06:29:35.872 INFO:tasks.workunit.client.1.smithi079.stdout:3/539: mkdir d1a/d21/db0 0 2024-05-09T06:29:35.872 INFO:tasks.workunit.client.1.smithi079.stdout:9/701: dwrite d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/d6b/fcf [0,4194304] 0 2024-05-09T06:29:35.872 INFO:tasks.workunit.client.1.smithi079.stdout:9/702: write d1/d6/f20 [1111517,19777] 0 2024-05-09T06:29:35.875 INFO:tasks.workunit.client.1.smithi079.stdout:0/447: mkdir d3/dd/d66/d6d/d74/d80/d2d/d90 0 2024-05-09T06:29:35.875 INFO:tasks.workunit.client.1.smithi079.stdout:0/448: chown d3/dd/d1f/d1e/d2c 804706 1 2024-05-09T06:29:35.877 INFO:tasks.workunit.client.1.smithi079.stdout:3/540: link d1a/d1c/d22/d53/f86 d1a/d1c/fb1 0 2024-05-09T06:29:35.881 INFO:tasks.workunit.client.1.smithi079.stdout:0/449: rename d3/dd/d1f/d1e/d2c/d35/d36/d89 to d3/dd/d1f/d1e/d91 0 2024-05-09T06:29:35.881 INFO:tasks.workunit.client.1.smithi079.stdout:0/450: fsync d3/dd/d66/f7b 0 2024-05-09T06:29:35.881 INFO:tasks.workunit.client.1.smithi079.stdout:0/451: stat d3/dd/d1f/d1e/d2c/d7f 0 2024-05-09T06:29:35.881 INFO:tasks.workunit.client.1.smithi079.stdout:0/452: readlink d3/dd/d66/d6d/d74/d80/d76/l79 0 2024-05-09T06:29:35.881 INFO:tasks.workunit.client.1.smithi079.stdout:5/543: getdents d13/d43/d26/d35 0 2024-05-09T06:29:35.881 INFO:tasks.workunit.client.1.smithi079.stdout:5/544: write d13/d4d/d77/f8a [776316,61666] 0 2024-05-09T06:29:35.881 INFO:tasks.workunit.client.1.smithi079.stdout:9/703: read d1/d33/d28/d36/d4d/d7d/d19/fa6 [30490,80051] 0 2024-05-09T06:29:35.881 INFO:tasks.workunit.client.1.smithi079.stdout:9/704: write d1/d5/d9a/f73 [604173,74984] 0 2024-05-09T06:29:35.882 INFO:tasks.workunit.client.1.smithi079.stdout:0/453: write d3/dd/d1f/d1e/d2c/d35/f60 [1237425,54777] 0 2024-05-09T06:29:35.883 INFO:tasks.workunit.client.1.smithi079.stdout:3/541: dread f5 [0,4194304] 0 2024-05-09T06:29:35.883 INFO:tasks.workunit.client.1.smithi079.stdout:3/542: read d1a/d1d/f41 [3141568,67454] 0 2024-05-09T06:29:35.883 INFO:tasks.workunit.client.1.smithi079.stdout:9/705: read d1/d33/d28/d36/d4d/f8a [200619,1669] 0 2024-05-09T06:29:35.884 INFO:tasks.workunit.client.1.smithi079.stdout:5/545: rename d13/d4d/d77/f8a to d13/d43/d3d/d40/d63/da2/fc2 0 2024-05-09T06:29:35.884 INFO:tasks.workunit.client.1.smithi079.stdout:7/498: sync 2024-05-09T06:29:35.887 INFO:tasks.workunit.client.1.smithi079.stdout:0/454: mknod d3/d5/d87/c92 0 2024-05-09T06:29:35.888 INFO:tasks.workunit.client.1.smithi079.stdout:3/543: chown d1a/d1d/d34/d59/c7d 89 1 2024-05-09T06:29:35.891 INFO:tasks.workunit.client.1.smithi079.stdout:7/499: symlink d4/d7/d37/d7c/d8e/l9d 0 2024-05-09T06:29:35.893 INFO:tasks.workunit.client.1.smithi079.stdout:0/455: mkdir d3/dd/d1f/d1e/d2c/d35/d36/d93 0 2024-05-09T06:29:35.893 INFO:tasks.workunit.client.1.smithi079.stdout:5/546: write d13/d2a/f2b [1339098,63032] 0 2024-05-09T06:29:35.895 INFO:tasks.workunit.client.1.smithi079.stdout:7/500: mkdir d4/d9e 0 2024-05-09T06:29:35.898 INFO:tasks.workunit.client.1.smithi079.stdout:0/456: rename d3/dd/d1f/f64 to d3/d5/d87/f94 0 2024-05-09T06:29:35.898 INFO:tasks.workunit.client.1.smithi079.stdout:0/457: fdatasync d3/dd/d18/f34 0 2024-05-09T06:29:35.898 INFO:tasks.workunit.client.1.smithi079.stdout:0/458: fdatasync d3/dd/d66/d6d/d74/d80/f67 0 2024-05-09T06:29:35.899 INFO:tasks.workunit.client.1.smithi079.stdout:0/459: dread - d3/dd/d66/f7b zero size 2024-05-09T06:29:35.899 INFO:tasks.workunit.client.1.smithi079.stdout:3/544: write d1a/d1c/d1f/f4d [3334862,105502] 0 2024-05-09T06:29:35.900 INFO:tasks.workunit.client.1.smithi079.stdout:9/706: dwrite d1/d33/d2b/fac [0,4194304] 0 2024-05-09T06:29:35.900 INFO:tasks.workunit.client.1.smithi079.stdout:9/707: creat d1/d33/d28/fec x:0 0 0 2024-05-09T06:29:35.901 INFO:tasks.workunit.client.1.smithi079.stdout:0/460: stat d3/dd/d1f/d1e/d2c/d35/d36/l3f 0 2024-05-09T06:29:35.902 INFO:tasks.workunit.client.1.smithi079.stdout:3/545: dread d1a/d1c/f24 [0,4194304] 0 2024-05-09T06:29:35.905 INFO:tasks.workunit.client.1.smithi079.stdout:5/547: dread d13/d43/d3d/d40/f6c [0,4194304] 0 2024-05-09T06:29:35.905 INFO:tasks.workunit.client.1.smithi079.stdout:5/548: stat d13/f48 0 2024-05-09T06:29:35.906 INFO:tasks.workunit.client.1.smithi079.stdout:9/708: dread d1/d5/f21 [0,4194304] 0 2024-05-09T06:29:35.920 INFO:tasks.workunit.client.1.smithi079.stdout:3/546: unlink d1a/d1c/d22/d53/f66 0 2024-05-09T06:29:35.920 INFO:tasks.workunit.client.1.smithi079.stdout:3/547: write d1a/d1d/f2f [3254671,35396] 0 2024-05-09T06:29:35.924 INFO:tasks.workunit.client.1.smithi079.stdout:5/549: unlink d13/d43/d26/f9d 0 2024-05-09T06:29:35.929 INFO:tasks.workunit.client.1.smithi079.stdout:0/461: dwrite d3/d5/fe [0,4194304] 0 2024-05-09T06:29:35.929 INFO:tasks.workunit.client.1.smithi079.stdout:9/709: dwrite d1/d45/dc6/dc9/f2e [0,4194304] 0 2024-05-09T06:29:35.929 INFO:tasks.workunit.client.1.smithi079.stdout:0/462: readlink d3/dd/d66/d6d/d74/d80/l12 0 2024-05-09T06:29:35.929 INFO:tasks.workunit.client.1.smithi079.stdout:9/710: chown d1/d33/d28/d36/d4d/d7d/f22 516400169 1 2024-05-09T06:29:35.937 INFO:tasks.workunit.client.1.smithi079.stdout:5/550: rename d13/d4f/c9f to d13/d43/d26/cc3 0 2024-05-09T06:29:35.938 INFO:tasks.workunit.client.1.smithi079.stdout:5/551: dread d13/d43/d39/f58 [0,4194304] 0 2024-05-09T06:29:35.943 INFO:tasks.workunit.client.1.smithi079.stdout:5/552: rename d13/da5/lb8 to d13/d43/d3d/d40/d9a/lc4 0 2024-05-09T06:29:35.948 INFO:tasks.workunit.client.1.smithi079.stdout:5/553: dread d13/d43/d3d/f7a [0,4194304] 0 2024-05-09T06:29:35.948 INFO:tasks.workunit.client.1.smithi079.stdout:5/554: fsync d13/d43/d39/d61/d72/fb2 0 2024-05-09T06:29:35.956 INFO:tasks.workunit.client.1.smithi079.stdout:3/548: dwrite d1a/d1c/d22/d90/f99 [0,4194304] 0 2024-05-09T06:29:35.956 INFO:tasks.workunit.client.1.smithi079.stdout:5/555: dread d13/f18 [0,4194304] 0 2024-05-09T06:29:35.959 INFO:tasks.workunit.client.1.smithi079.stdout:0/463: dwrite d3/dd/d1f/d1e/d2c/d65/f86 [0,4194304] 0 2024-05-09T06:29:35.959 INFO:tasks.workunit.client.1.smithi079.stdout:9/711: dwrite d1/d33/d28/d36/d4d/d51/fe5 [0,4194304] 0 2024-05-09T06:29:35.964 INFO:tasks.workunit.client.1.smithi079.stdout:0/464: dread d3/dd/d1f/f29 [0,4194304] 0 2024-05-09T06:29:35.967 INFO:tasks.workunit.client.1.smithi079.stdout:5/556: getdents d13/d43/d3d 0 2024-05-09T06:29:35.972 INFO:tasks.workunit.client.1.smithi079.stdout:4/632: sync 2024-05-09T06:29:35.972 INFO:tasks.workunit.client.1.smithi079.stdout:4/633: chown d6/d1a/d41/d68/d6b 502583533 1 2024-05-09T06:29:35.978 INFO:tasks.workunit.client.1.smithi079.stdout:3/549: dwrite d1a/d1d/d34/f4f [4194304,4194304] 0 2024-05-09T06:29:35.978 INFO:tasks.workunit.client.1.smithi079.stdout:9/712: dwrite d1/d6/f1c [0,4194304] 0 2024-05-09T06:29:35.980 INFO:tasks.workunit.client.1.smithi079.stdout:0/465: unlink d3/dd/d1f/d1e/d2c/d65/f86 0 2024-05-09T06:29:35.985 INFO:tasks.workunit.client.1.smithi079.stdout:4/634: symlink d6/d1a/d26/d2a/lcf 0 2024-05-09T06:29:35.993 INFO:tasks.workunit.client.1.smithi079.stdout:3/550: unlink d1a/d1d/f3e 0 2024-05-09T06:29:35.993 INFO:tasks.workunit.client.1.smithi079.stdout:3/551: write d1a/d1d/f2f [1544626,120051] 0 2024-05-09T06:29:35.994 INFO:tasks.workunit.client.1.smithi079.stdout:2/557: dwrite d8/db/dc/f6a [0,4194304] 0 2024-05-09T06:29:35.997 INFO:tasks.workunit.client.1.smithi079.stdout:9/713: mkdir d1/d33/d28/d4c/d97/dd3/ded 0 2024-05-09T06:29:36.001 INFO:tasks.workunit.client.1.smithi079.stdout:0/466: dwrite d3/d5/f3a [0,4194304] 0 2024-05-09T06:29:36.001 INFO:tasks.workunit.client.1.smithi079.stdout:3/552: write f5 [2795428,37830] 0 2024-05-09T06:29:36.002 INFO:tasks.workunit.client.1.smithi079.stdout:3/553: write d1a/d21/f69 [104859,28507] 0 2024-05-09T06:29:36.002 INFO:tasks.workunit.client.1.smithi079.stdout:3/554: fsync d1a/d1d/f63 0 2024-05-09T06:29:36.010 INFO:tasks.workunit.client.1.smithi079.stdout:5/557: rmdir d13/d43/d3d/d40/d63/da2/daa 0 2024-05-09T06:29:36.010 INFO:tasks.workunit.client.1.smithi079.stdout:5/558: write d13/d43/f28 [4314561,117687] 0 2024-05-09T06:29:36.015 INFO:tasks.workunit.client.1.smithi079.stdout:5/559: dread d13/d43/d39/f60 [0,4194304] 0 2024-05-09T06:29:36.022 INFO:tasks.workunit.client.1.smithi079.stdout:0/467: dread d3/f4 [0,4194304] 0 2024-05-09T06:29:36.024 INFO:tasks.workunit.client.1.smithi079.stdout:4/635: dwrite d6/dd/df/f21 [0,4194304] 0 2024-05-09T06:29:36.024 INFO:tasks.workunit.client.1.smithi079.stdout:4/636: readlink d6/d8/l93 0 2024-05-09T06:29:36.025 INFO:tasks.workunit.client.1.smithi079.stdout:2/558: dwrite d8/db/d4b/d4f/d51/d6f/f7b [4194304,4194304] 0 2024-05-09T06:29:36.026 INFO:tasks.workunit.client.1.smithi079.stdout:5/560: truncate d13/f21 3507152 0 2024-05-09T06:29:36.027 INFO:tasks.workunit.client.1.smithi079.stdout:5/561: dread d13/d43/d3d/d40/d63/da2/d8b/fa1 [0,4194304] 0 2024-05-09T06:29:36.029 INFO:tasks.workunit.client.1.smithi079.stdout:3/555: dwrite f19 [0,4194304] 0 2024-05-09T06:29:36.029 INFO:tasks.workunit.client.1.smithi079.stdout:9/714: dwrite d1/d33/d28/d36/fd6 [0,4194304] 0 2024-05-09T06:29:36.032 INFO:tasks.workunit.client.1.smithi079.stdout:2/559: dread d8/db/f12 [0,4194304] 0 2024-05-09T06:29:36.039 INFO:tasks.workunit.client.1.smithi079.stdout:5/562: rename fa to d13/d43/d3d/fc5 0 2024-05-09T06:29:36.044 INFO:tasks.workunit.client.1.smithi079.stdout:5/563: read d13/d43/d3d/d40/d63/f7b [2631849,28521] 0 2024-05-09T06:29:36.044 INFO:tasks.workunit.client.1.smithi079.stdout:5/564: chown d13/d2a 1 1 2024-05-09T06:29:36.047 INFO:tasks.workunit.client.1.smithi079.stdout:9/715: creat d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/fee x:0 0 0 2024-05-09T06:29:36.051 INFO:tasks.workunit.client.1.smithi079.stdout:3/556: rename d1a/d1d/d3a/d95 to d1a/d82/d87/db2 0 2024-05-09T06:29:36.051 INFO:tasks.workunit.client.1.smithi079.stdout:3/557: fsync d1a/d1c/fa2 0 2024-05-09T06:29:36.055 INFO:tasks.workunit.client.1.smithi079.stdout:5/565: read d13/d43/d3d/d40/f42 [1528458,90959] 0 2024-05-09T06:29:36.059 INFO:tasks.workunit.client.1.smithi079.stdout:3/558: unlink d1a/d1c/c6f 0 2024-05-09T06:29:36.059 INFO:tasks.workunit.client.1.smithi079.stdout:3/559: stat d1a/d1c/d22/d53/f86 0 2024-05-09T06:29:36.059 INFO:tasks.workunit.client.1.smithi079.stdout:2/560: dwrite d8/db/d59/d67/fc1 [0,4194304] 0 2024-05-09T06:29:36.059 INFO:tasks.workunit.client.1.smithi079.stdout:2/561: chown d8/db/d11/c37 880 1 2024-05-09T06:29:36.059 INFO:tasks.workunit.client.1.smithi079.stdout:4/637: dwrite d6/d8/d27/d62/f40 [0,4194304] 0 2024-05-09T06:29:36.059 INFO:tasks.workunit.client.1.smithi079.stdout:4/638: chown d6/d90/lab 1082801 1 2024-05-09T06:29:36.059 INFO:tasks.workunit.client.1.smithi079.stdout:4/639: write d6/d1a/d26/d2a/d54/f70 [565406,16524] 0 2024-05-09T06:29:36.059 INFO:tasks.workunit.client.1.smithi079.stdout:4/640: chown d6/d8/d27/d3d/l9d 11999837 1 2024-05-09T06:29:36.060 INFO:tasks.workunit.client.1.smithi079.stdout:3/560: symlink d1a/d1c/d22/lb3 0 2024-05-09T06:29:36.061 INFO:tasks.workunit.client.1.smithi079.stdout:1/487: sync 2024-05-09T06:29:36.063 INFO:tasks.workunit.client.1.smithi079.stdout:5/566: dread f11 [0,4194304] 0 2024-05-09T06:29:36.064 INFO:tasks.workunit.client.1.smithi079.stdout:2/562: dread d8/db/d4b/d4f/d51/d6f/fa2 [0,4194304] 0 2024-05-09T06:29:36.065 INFO:tasks.workunit.client.1.smithi079.stdout:2/563: chown d8/d3c/l47 26185460 1 2024-05-09T06:29:36.065 INFO:tasks.workunit.client.1.smithi079.stdout:2/564: chown d8/db/lc2 86839848 1 2024-05-09T06:29:36.065 INFO:tasks.workunit.client.1.smithi079.stdout:4/641: write d6/d8/f49 [852749,79182] 0 2024-05-09T06:29:36.069 INFO:tasks.workunit.client.1.smithi079.stdout:1/488: truncate d0/d12/f2c 292216 0 2024-05-09T06:29:36.069 INFO:tasks.workunit.client.1.smithi079.stdout:1/489: write d0/d12/d48/d75/d43/d20/f9d [468599,117989] 0 2024-05-09T06:29:36.069 INFO:tasks.workunit.client.1.smithi079.stdout:1/490: creat d0/d12/d92/fac x:0 0 0 2024-05-09T06:29:36.070 INFO:tasks.workunit.client.1.smithi079.stdout:1/491: stat d0/l87 0 2024-05-09T06:29:36.071 INFO:tasks.workunit.client.1.smithi079.stdout:2/565: symlink d8/db/d5c/d6b/db5/ld1 0 2024-05-09T06:29:36.071 INFO:tasks.workunit.client.1.smithi079.stdout:2/566: chown d8/db/d59 5094 1 2024-05-09T06:29:36.071 INFO:tasks.workunit.client.1.smithi079.stdout:2/567: truncate d8/db/d5c/d6b/db5/fab 751012 0 2024-05-09T06:29:36.073 INFO:tasks.workunit.client.1.smithi079.stdout:4/642: symlink d6/d1a/ld0 0 2024-05-09T06:29:36.073 INFO:tasks.workunit.client.1.smithi079.stdout:9/716: dwrite d1/d45/f86 [0,4194304] 0 2024-05-09T06:29:36.074 INFO:tasks.workunit.client.1.smithi079.stdout:9/717: chown d1/d33/d28/d36/dcd/de7/l63 0 1 2024-05-09T06:29:36.075 INFO:tasks.workunit.client.1.smithi079.stdout:3/561: unlink c12 0 2024-05-09T06:29:36.080 INFO:tasks.workunit.client.1.smithi079.stdout:1/492: mknod d0/d7/d4e/d7d/cad 0 2024-05-09T06:29:36.080 INFO:tasks.workunit.client.1.smithi079.stdout:1/493: truncate d0/d12/d48/d75/d43/d20/d39/f78 225608 0 2024-05-09T06:29:36.082 INFO:tasks.workunit.client.1.smithi079.stdout:2/568: mknod d8/db/d59/d67/d7f/db9/dca/cd2 0 2024-05-09T06:29:36.085 INFO:tasks.workunit.client.1.smithi079.stdout:4/643: symlink d6/d8/d27/d62/ld1 0 2024-05-09T06:29:36.085 INFO:tasks.workunit.client.1.smithi079.stdout:4/644: fdatasync d6/d1a/d26/d2a/d54/f17 0 2024-05-09T06:29:36.085 INFO:tasks.workunit.client.1.smithi079.stdout:4/645: write d6/d1a/d41/d68/da1/fa9 [366676,75941] 0 2024-05-09T06:29:36.085 INFO:tasks.workunit.client.1.smithi079.stdout:4/646: creat d6/d8/d55/fd2 x:0 0 0 2024-05-09T06:29:36.085 INFO:tasks.workunit.client.1.smithi079.stdout:5/567: dwrite d13/d43/d26/f3c [0,4194304] 0 2024-05-09T06:29:36.085 INFO:tasks.workunit.client.1.smithi079.stdout:5/568: write d13/d43/d3d/d40/f42 [253726,94921] 0 2024-05-09T06:29:36.090 INFO:tasks.workunit.client.1.smithi079.stdout:1/494: creat d0/d7/d4e/d7d/fae x:0 0 0 2024-05-09T06:29:36.091 INFO:tasks.workunit.client.1.smithi079.stdout:1/495: read d0/d7/f8d [677163,49599] 0 2024-05-09T06:29:36.091 INFO:tasks.workunit.client.1.smithi079.stdout:1/496: fsync d0/d12/d48/d75/f54 0 2024-05-09T06:29:36.092 INFO:tasks.workunit.client.1.smithi079.stdout:2/569: unlink d8/c5b 0 2024-05-09T06:29:36.094 INFO:tasks.workunit.client.1.smithi079.stdout:6/549: sync 2024-05-09T06:29:36.094 INFO:tasks.workunit.client.1.smithi079.stdout:8/527: sync 2024-05-09T06:29:36.095 INFO:tasks.workunit.client.1.smithi079.stdout:4/647: mkdir d6/d1a/d26/dd3 0 2024-05-09T06:29:36.095 INFO:tasks.workunit.client.1.smithi079.stdout:9/718: dwrite d1/d33/d28/fe8 [4194304,4194304] 0 2024-05-09T06:29:36.104 INFO:tasks.workunit.client.1.smithi079.stdout:5/569: creat d13/d43/d3d/d40/d9a/fc6 x:0 0 0 2024-05-09T06:29:36.104 INFO:tasks.workunit.client.1.smithi079.stdout:5/570: dread - d13/d2a/fb3 zero size 2024-05-09T06:29:36.106 INFO:tasks.workunit.client.1.smithi079.stdout:7/501: sync 2024-05-09T06:29:36.110 INFO:tasks.workunit.client.1.smithi079.stdout:2/570: mknod d8/db/d59/cd3 0 2024-05-09T06:29:36.112 INFO:tasks.workunit.client.1.smithi079.stdout:6/550: truncate d0/d6/d1b/fae 1788186 0 2024-05-09T06:29:36.112 INFO:tasks.workunit.client.1.smithi079.stdout:6/551: getdents d0/d6/d16/d1f/d36/d69/dad 0 2024-05-09T06:29:36.112 INFO:tasks.workunit.client.1.smithi079.stdout:6/552: read - d0/d60/f79 zero size 2024-05-09T06:29:36.113 INFO:tasks.workunit.client.1.smithi079.stdout:8/528: mkdir d1/d5/d36/dae/dbe 0 2024-05-09T06:29:36.113 INFO:tasks.workunit.client.1.smithi079.stdout:8/529: fdatasync d1/d3/d20/f7b 0 2024-05-09T06:29:36.116 INFO:tasks.workunit.client.1.smithi079.stdout:4/648: mkdir d6/dd/d34/dd4 0 2024-05-09T06:29:36.118 INFO:tasks.workunit.client.1.smithi079.stdout:9/719: mkdir d1/d33/d28/d4c/d97/dd3/ded/def 0 2024-05-09T06:29:36.120 INFO:tasks.workunit.client.1.smithi079.stdout:9/720: dread d1/f17 [0,4194304] 0 2024-05-09T06:29:36.121 INFO:tasks.workunit.client.1.smithi079.stdout:7/502: creat d4/d7/d22/d28/d50/f9f x:0 0 0 2024-05-09T06:29:36.124 INFO:tasks.workunit.client.1.smithi079.stdout:2/571: mknod d8/db/d11/d5f/cd4 0 2024-05-09T06:29:36.127 INFO:tasks.workunit.client.1.smithi079.stdout:6/553: unlink d0/d60/fa9 0 2024-05-09T06:29:36.129 INFO:tasks.workunit.client.1.smithi079.stdout:8/530: getdents d1/d3/d20/d22/d44/da4 0 2024-05-09T06:29:36.129 INFO:tasks.workunit.client.1.smithi079.stdout:4/649: dwrite d6/d8/d27/f2e [0,4194304] 0 2024-05-09T06:29:36.135 INFO:tasks.workunit.client.1.smithi079.stdout:5/571: creat d13/d43/d26/dac/fc7 x:0 0 0 2024-05-09T06:29:36.135 INFO:tasks.workunit.client.1.smithi079.stdout:5/572: chown d13/d43/d3d/d40/d63/da2/c8d 68111739 1 2024-05-09T06:29:36.138 INFO:tasks.workunit.client.1.smithi079.stdout:9/721: mkdir d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/df0 0 2024-05-09T06:29:36.140 INFO:tasks.workunit.client.1.smithi079.stdout:7/503: mkdir d4/d7/dd/d5b/d32/da0 0 2024-05-09T06:29:36.143 INFO:tasks.workunit.client.1.smithi079.stdout:6/554: mkdir d0/d6/d1b/db8 0 2024-05-09T06:29:36.146 INFO:tasks.workunit.client.1.smithi079.stdout:8/531: mkdir d1/db/daf/d66/d6c/dbf 0 2024-05-09T06:29:36.153 INFO:tasks.workunit.client.1.smithi079.stdout:5/573: link d13/d43/d26/f3c d13/d43/d26/d35/fc8 0 2024-05-09T06:29:36.162 INFO:tasks.workunit.client.1.smithi079.stdout:7/504: rmdir d4/d7/dd/d93 0 2024-05-09T06:29:36.162 INFO:tasks.workunit.client.1.smithi079.stdout:7/505: chown d4/d7/f2b 121 1 2024-05-09T06:29:36.168 INFO:tasks.workunit.client.1.smithi079.stdout:9/722: dwrite d1/d45/dc6/dc9/fb3 [0,4194304] 0 2024-05-09T06:29:36.169 INFO:tasks.workunit.client.1.smithi079.stdout:5/574: mkdir d13/d43/d51/dc9 0 2024-05-09T06:29:36.177 INFO:tasks.workunit.client.1.smithi079.stdout:9/723: truncate d1/d5/d5b/f89 1078976 0 2024-05-09T06:29:36.179 INFO:tasks.workunit.client.1.smithi079.stdout:5/575: mknod d13/d43/d3d/d40/cca 0 2024-05-09T06:29:36.179 INFO:tasks.workunit.client.1.smithi079.stdout:5/576: write d13/d43/d39/d61/fa6 [204979,114267] 0 2024-05-09T06:29:36.184 INFO:tasks.workunit.client.1.smithi079.stdout:5/577: unlink d13/d43/d3d/d40/d63/c69 0 2024-05-09T06:29:36.186 INFO:tasks.workunit.client.1.smithi079.stdout:5/578: mknod d13/d4d/ccb 0 2024-05-09T06:29:36.189 INFO:tasks.workunit.client.1.smithi079.stdout:5/579: truncate d13/f18 777463 0 2024-05-09T06:29:36.196 INFO:tasks.workunit.client.1.smithi079.stdout:5/580: dread d13/d43/d39/d61/f76 [0,4194304] 0 2024-05-09T06:29:36.196 INFO:tasks.workunit.client.1.smithi079.stdout:5/581: readlink d13/d4f/l70 0 2024-05-09T06:29:36.201 INFO:tasks.workunit.client.1.smithi079.stdout:4/650: rename d6/dd to d6/d1a/d26/d2a/d54/d9e/dd5 0 2024-05-09T06:29:36.201 INFO:tasks.workunit.client.1.smithi079.stdout:4/651: chown d6/d1a/f75 6 1 2024-05-09T06:29:36.201 INFO:tasks.workunit.client.1.smithi079.stdout:4/652: stat d6/d1a/d26/d2a/d54/dc8 0 2024-05-09T06:29:36.204 INFO:tasks.workunit.client.1.smithi079.stdout:4/653: mkdir d6/d8/d55/dd6 0 2024-05-09T06:29:36.204 INFO:tasks.workunit.client.1.smithi079.stdout:4/654: readlink d6/d1a/d26/d2a/d54/d9e/dd5/df/d8e/lb3 0 2024-05-09T06:29:36.205 INFO:tasks.workunit.client.1.smithi079.stdout:5/582: dread d13/d2a/f4b [0,4194304] 0 2024-05-09T06:29:36.206 INFO:tasks.workunit.client.1.smithi079.stdout:4/655: mknod d6/d1a/d41/d68/da1/cd7 0 2024-05-09T06:29:36.206 INFO:tasks.workunit.client.1.smithi079.stdout:4/656: creat d6/d1a/d26/d2a/d54/d9e/fd8 x:0 0 0 2024-05-09T06:29:36.208 INFO:tasks.workunit.client.1.smithi079.stdout:4/657: write d6/d1a/d41/d68/d6b/f81 [70556,17461] 0 2024-05-09T06:29:36.210 INFO:tasks.workunit.client.1.smithi079.stdout:0/468: sync 2024-05-09T06:29:36.211 INFO:tasks.workunit.client.1.smithi079.stdout:4/658: symlink d6/d1a/d41/d68/d6b/ld9 0 2024-05-09T06:29:36.211 INFO:tasks.workunit.client.1.smithi079.stdout:0/469: write d3/dd/d18/f34 [219447,81857] 0 2024-05-09T06:29:36.214 INFO:tasks.workunit.client.1.smithi079.stdout:4/659: rename d6/d8/d27/d3d/d5b/db4/dc3/lc4 to d6/d1a/d41/d68/da1/dad/lda 0 2024-05-09T06:29:36.217 INFO:tasks.workunit.client.1.smithi079.stdout:0/470: creat d3/dd/d66/d6d/d74/d84/f95 x:0 0 0 2024-05-09T06:29:36.218 INFO:tasks.workunit.client.1.smithi079.stdout:7/506: rmdir d4/d7/dd/d5b/d32 39 2024-05-09T06:29:36.220 INFO:tasks.workunit.client.1.smithi079.stdout:5/583: dwrite d13/d4f/f78 [0,4194304] 0 2024-05-09T06:29:36.222 INFO:tasks.workunit.client.1.smithi079.stdout:6/555: getdents d0/d6/d1b 0 2024-05-09T06:29:36.222 INFO:tasks.workunit.client.1.smithi079.stdout:6/556: creat d0/d60/fb9 x:0 0 0 2024-05-09T06:29:36.224 INFO:tasks.workunit.client.1.smithi079.stdout:7/507: symlink d4/d7/d37/d67/la1 0 2024-05-09T06:29:36.225 INFO:tasks.workunit.client.1.smithi079.stdout:4/660: dread d6/d1a/f75 [0,4194304] 0 2024-05-09T06:29:36.225 INFO:tasks.workunit.client.1.smithi079.stdout:4/661: chown d6/d1a/d26/d2a/d54/d9e/dd5/f6a 10421281 1 2024-05-09T06:29:36.230 INFO:tasks.workunit.client.1.smithi079.stdout:6/557: rename d0/d6/c88 to d0/d6/d1b/d20/dac/cba 0 2024-05-09T06:29:36.231 INFO:tasks.workunit.client.1.smithi079.stdout:5/584: write d13/d43/d26/d35/fc8 [245552,49178] 0 2024-05-09T06:29:36.233 INFO:tasks.workunit.client.1.smithi079.stdout:7/508: symlink d4/d7/d22/d28/d50/d5c/la2 0 2024-05-09T06:29:36.233 INFO:tasks.workunit.client.1.smithi079.stdout:7/509: fsync d4/f11 0 2024-05-09T06:29:36.233 INFO:tasks.workunit.client.1.smithi079.stdout:7/510: write d4/d7/dd/d5b/f5d [4206627,42593] 0 2024-05-09T06:29:36.233 INFO:tasks.workunit.client.1.smithi079.stdout:7/511: write d4/d7/dd/d88/f8a [756962,86971] 0 2024-05-09T06:29:36.233 INFO:tasks.workunit.client.1.smithi079.stdout:7/512: creat d4/d7/d78/fa3 x:0 0 0 2024-05-09T06:29:36.235 INFO:tasks.workunit.client.1.smithi079.stdout:4/662: mknod d6/d1a/d26/d2a/d54/d9e/dd5/dc5/cdb 0 2024-05-09T06:29:36.235 INFO:tasks.workunit.client.1.smithi079.stdout:4/663: truncate d6/d8/d80/da6/fbc 960004 0 2024-05-09T06:29:36.235 INFO:tasks.workunit.client.1.smithi079.stdout:4/664: write d6/d1a/d41/d68/d6b/f81 [22261,93332] 0 2024-05-09T06:29:36.236 INFO:tasks.workunit.client.1.smithi079.stdout:4/665: stat d6/d1a/d26/d2a/d54/f45 0 2024-05-09T06:29:36.236 INFO:tasks.workunit.client.1.smithi079.stdout:4/666: chown d6/d8/l93 2913442 1 2024-05-09T06:29:36.237 INFO:tasks.workunit.client.1.smithi079.stdout:0/471: dwrite d3/dd/d66/d6d/d74/d80/d2d/f8f [0,4194304] 0 2024-05-09T06:29:36.237 INFO:tasks.workunit.client.1.smithi079.stdout:0/472: dread - d3/dd/d66/f7b zero size 2024-05-09T06:29:36.239 INFO:tasks.workunit.client.1.smithi079.stdout:6/558: link d0/c99 d0/d6/d16/d1f/d6f/cbb 0 2024-05-09T06:29:36.242 INFO:tasks.workunit.client.1.smithi079.stdout:5/585: link d13/d43/d39/l47 d13/d4d/d77/lcc 0 2024-05-09T06:29:36.242 INFO:tasks.workunit.client.1.smithi079.stdout:5/586: chown d13/d43/d39/d61/d72/dbd 58 1 2024-05-09T06:29:36.244 INFO:tasks.workunit.client.1.smithi079.stdout:0/473: dread d3/dd/d66/d6d/d74/d80/d2d/f8f [0,4194304] 0 2024-05-09T06:29:36.249 INFO:tasks.workunit.client.1.smithi079.stdout:4/667: rmdir d6/d8/d27/d3d/d5b 39 2024-05-09T06:29:36.252 INFO:tasks.workunit.client.1.smithi079.stdout:4/668: dread d6/d8/d27/d3d/d5b/d9a/f86 [0,4194304] 0 2024-05-09T06:29:36.254 INFO:tasks.workunit.client.1.smithi079.stdout:9/724: write d1/d45/f90 [92793,19455] 0 2024-05-09T06:29:36.255 INFO:tasks.workunit.client.1.smithi079.stdout:9/725: dread - d1/d33/d28/d4c/d8b/fde zero size 2024-05-09T06:29:36.270 INFO:tasks.workunit.client.1.smithi079.stdout:6/559: rmdir d0/d6/d1b/d20 39 2024-05-09T06:29:36.274 INFO:tasks.workunit.client.1.smithi079.stdout:5/587: mkdir d13/d92/dcd 0 2024-05-09T06:29:36.274 INFO:tasks.workunit.client.1.smithi079.stdout:5/588: readlink d13/l23 0 2024-05-09T06:29:36.274 INFO:tasks.workunit.client.1.smithi079.stdout:5/589: write d13/d43/d26/f3c [371275,68430] 0 2024-05-09T06:29:36.276 INFO:tasks.workunit.client.1.smithi079.stdout:4/669: dwrite d6/d8/d27/d3d/d5b/db4/fb6 [0,4194304] 0 2024-05-09T06:29:36.276 INFO:tasks.workunit.client.1.smithi079.stdout:4/670: write d6/d8/d55/fd2 [324723,109015] 0 2024-05-09T06:29:36.284 INFO:tasks.workunit.client.1.smithi079.stdout:7/513: rmdir d4/d7/dd/d5b 39 2024-05-09T06:29:36.286 INFO:tasks.workunit.client.1.smithi079.stdout:6/560: dwrite d0/d6/d1b/d20/fa6 [0,4194304] 0 2024-05-09T06:29:36.286 INFO:tasks.workunit.client.1.smithi079.stdout:6/561: stat d0/f7a 0 2024-05-09T06:29:36.286 INFO:tasks.workunit.client.1.smithi079.stdout:6/562: chown d0/f65 151800989 1 2024-05-09T06:29:36.287 INFO:tasks.workunit.client.1.smithi079.stdout:9/726: symlink d1/d33/d28/d36/lf1 0 2024-05-09T06:29:36.288 INFO:tasks.workunit.client.1.smithi079.stdout:3/562: sync 2024-05-09T06:29:36.293 INFO:tasks.workunit.client.1.smithi079.stdout:7/514: mknod d4/d9e/ca4 0 2024-05-09T06:29:36.293 INFO:tasks.workunit.client.1.smithi079.stdout:7/515: dread - d4/d7/d78/fa3 zero size 2024-05-09T06:29:36.302 INFO:tasks.workunit.client.1.smithi079.stdout:3/563: creat d1a/d1c/d1f/d76/fb4 x:0 0 0 2024-05-09T06:29:36.302 INFO:tasks.workunit.client.1.smithi079.stdout:3/564: chown d1a/d1d/d34/d42/f81 1 1 2024-05-09T06:29:36.304 INFO:tasks.workunit.client.1.smithi079.stdout:3/565: read d1a/d82/f89 [146504,88154] 0 2024-05-09T06:29:36.305 INFO:tasks.workunit.client.1.smithi079.stdout:0/474: rename d3/dd/d1f/d1e/d2c/d65 to d3/dd/d96 0 2024-05-09T06:29:36.306 INFO:tasks.workunit.client.1.smithi079.stdout:0/475: read d3/dd/d18/d5e/d69/f75 [468316,67967] 0 2024-05-09T06:29:36.306 INFO:tasks.workunit.client.1.smithi079.stdout:0/476: chown d3/dd/d66/d6d/f8d 436086410 1 2024-05-09T06:29:36.312 INFO:tasks.workunit.client.1.smithi079.stdout:5/590: dwrite d13/d43/d39/f86 [0,4194304] 0 2024-05-09T06:29:36.312 INFO:tasks.workunit.client.1.smithi079.stdout:9/727: dwrite d1/d33/d2b/fac [0,4194304] 0 2024-05-09T06:29:36.312 INFO:tasks.workunit.client.1.smithi079.stdout:9/728: truncate d1/d33/d28/d36/d4d/fda 4583273 0 2024-05-09T06:29:36.312 INFO:tasks.workunit.client.1.smithi079.stdout:9/729: getdents d1/d33/d28/d4c/d97/dd3/ded/def 0 2024-05-09T06:29:36.312 INFO:tasks.workunit.client.1.smithi079.stdout:0/477: getdents d3/dd/d1f/d1e 0 2024-05-09T06:29:36.315 INFO:tasks.workunit.client.1.smithi079.stdout:9/730: symlink d1/d45/dc6/lf2 0 2024-05-09T06:29:36.317 INFO:tasks.workunit.client.1.smithi079.stdout:5/591: dread d13/d43/d26/d35/f56 [0,4194304] 0 2024-05-09T06:29:36.317 INFO:tasks.workunit.client.1.smithi079.stdout:5/592: chown d13/c49 1313068 1 2024-05-09T06:29:36.317 INFO:tasks.workunit.client.1.smithi079.stdout:3/566: dread d1a/d1c/d22/d53/f7b [0,4194304] 0 2024-05-09T06:29:36.317 INFO:tasks.workunit.client.1.smithi079.stdout:7/516: dwrite d4/f11 [0,4194304] 0 2024-05-09T06:29:36.317 INFO:tasks.workunit.client.1.smithi079.stdout:3/567: write d1a/d82/d87/f8d [11960,39074] 0 2024-05-09T06:29:36.318 INFO:tasks.workunit.client.1.smithi079.stdout:0/478: mknod d3/dd/d1f/d1e/d91/c97 0 2024-05-09T06:29:36.319 INFO:tasks.workunit.client.1.smithi079.stdout:5/593: mknod d13/d43/d3d/d40/d53/cce 0 2024-05-09T06:29:36.322 INFO:tasks.workunit.client.1.smithi079.stdout:3/568: link d1a/d1d/f79 d1a/d1d/fb5 0 2024-05-09T06:29:36.322 INFO:tasks.workunit.client.1.smithi079.stdout:3/569: write d1a/d21/f5d [3055851,28092] 0 2024-05-09T06:29:36.325 INFO:tasks.workunit.client.1.smithi079.stdout:7/517: getdents d4/d7/dd/d88 0 2024-05-09T06:29:36.327 INFO:tasks.workunit.client.1.smithi079.stdout:0/479: dread d3/d5/f21 [0,4194304] 0 2024-05-09T06:29:36.327 INFO:tasks.workunit.client.1.smithi079.stdout:0/480: chown d3/dd/d66/d6d/d74/d80/d2d/d90 932557 1 2024-05-09T06:29:36.329 INFO:tasks.workunit.client.1.smithi079.stdout:3/570: rename d1a/d1d/d3a/d54/d5e/l85 to d1a/d1d/d3a/d54/lb6 0 2024-05-09T06:29:36.329 INFO:tasks.workunit.client.1.smithi079.stdout:3/571: creat d1a/d1c/d1f/d76/fb7 x:0 0 0 2024-05-09T06:29:36.329 INFO:tasks.workunit.client.1.smithi079.stdout:5/594: dread fc [4194304,4194304] 0 2024-05-09T06:29:36.331 INFO:tasks.workunit.client.1.smithi079.stdout:0/481: mknod d3/dd/d66/d6d/d74/c98 0 2024-05-09T06:29:36.332 INFO:tasks.workunit.client.1.smithi079.stdout:9/731: dwrite d1/d33/d28/d4c/d97/dd3/fe2 [0,4194304] 0 2024-05-09T06:29:36.336 INFO:tasks.workunit.client.1.smithi079.stdout:5/595: truncate d13/f18 106739 0 2024-05-09T06:29:36.338 INFO:tasks.workunit.client.1.smithi079.stdout:7/518: dread d4/d7/f18 [0,4194304] 0 2024-05-09T06:29:36.338 INFO:tasks.workunit.client.1.smithi079.stdout:7/519: chown d4/d7/dd/d47/f5e 513006 1 2024-05-09T06:29:36.338 INFO:tasks.workunit.client.1.smithi079.stdout:0/482: symlink d3/dd/d1f/d1e/l99 0 2024-05-09T06:29:36.339 INFO:tasks.workunit.client.1.smithi079.stdout:1/497: sync 2024-05-09T06:29:36.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/572: sync 2024-05-09T06:29:36.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/573: write d8/db/d4b/d4f/d51/d6f/f9a [701560,126484] 0 2024-05-09T06:29:36.340 INFO:tasks.workunit.client.1.smithi079.stdout:2/574: readlink d8/d3c/l47 0 2024-05-09T06:29:36.343 INFO:tasks.workunit.client.1.smithi079.stdout:9/732: getdents d1/d45/dab 0 2024-05-09T06:29:36.345 INFO:tasks.workunit.client.1.smithi079.stdout:3/572: truncate d1a/d1d/d34/d59/f74 441753 0 2024-05-09T06:29:36.345 INFO:tasks.workunit.client.1.smithi079.stdout:3/573: write d1a/d82/d87/f8d [875900,91995] 0 2024-05-09T06:29:36.345 INFO:tasks.workunit.client.1.smithi079.stdout:8/532: sync 2024-05-09T06:29:36.351 INFO:tasks.workunit.client.1.smithi079.stdout:7/520: creat d4/d7/d37/fa5 x:0 0 0 2024-05-09T06:29:36.351 INFO:tasks.workunit.client.1.smithi079.stdout:7/521: readlink d4/d7/d22/d28/d50/l60 0 2024-05-09T06:29:36.353 INFO:tasks.workunit.client.1.smithi079.stdout:0/483: unlink d3/lc 0 2024-05-09T06:29:36.356 INFO:tasks.workunit.client.1.smithi079.stdout:2/575: dwrite d8/db/dc/f8d [0,4194304] 0 2024-05-09T06:29:36.356 INFO:tasks.workunit.client.1.smithi079.stdout:2/576: fsync d8/db/d11/f35 0 2024-05-09T06:29:36.357 INFO:tasks.workunit.client.1.smithi079.stdout:1/498: unlink d0/d12/d67/d53/d5e/la6 0 2024-05-09T06:29:36.357 INFO:tasks.workunit.client.1.smithi079.stdout:9/733: mkdir d1/d33/d28/d36/d4d/d7d/df3 0 2024-05-09T06:29:36.360 INFO:tasks.workunit.client.1.smithi079.stdout:3/574: unlink d1a/d1c/d22/d53/f2b 0 2024-05-09T06:29:36.363 INFO:tasks.workunit.client.1.smithi079.stdout:8/533: mkdir d1/d3/d20/d7f/d33/d5d/d6d/dc0 0 2024-05-09T06:29:36.364 INFO:tasks.workunit.client.1.smithi079.stdout:8/534: write d1/d3/d20/d22/d3b/fb7 [915832,113931] 0 2024-05-09T06:29:36.364 INFO:tasks.workunit.client.1.smithi079.stdout:8/535: read - d1/d5/d36/fb8 zero size 2024-05-09T06:29:36.364 INFO:tasks.workunit.client.1.smithi079.stdout:8/536: stat d1/db/daf/f9d 0 2024-05-09T06:29:36.364 INFO:tasks.workunit.client.1.smithi079.stdout:8/537: fdatasync d1/d3/d20/f7b 0 2024-05-09T06:29:36.364 INFO:tasks.workunit.client.1.smithi079.stdout:8/538: chown d1/d64/l6e 65930 1 2024-05-09T06:29:36.364 INFO:tasks.workunit.client.1.smithi079.stdout:8/539: fsync d1/d3/d20/d7f/d33/d5d/d6d/f9a 0 2024-05-09T06:29:36.364 INFO:tasks.workunit.client.1.smithi079.stdout:8/540: write d1/d3/d20/d22/d3b/f90 [182882,122029] 0 2024-05-09T06:29:36.368 INFO:tasks.workunit.client.1.smithi079.stdout:7/522: unlink d4/d7/d22/f2f 0 2024-05-09T06:29:36.368 INFO:tasks.workunit.client.1.smithi079.stdout:7/523: getdents d4/d7/d22/d28/d50/d5c/d84 0 2024-05-09T06:29:36.370 INFO:tasks.workunit.client.1.smithi079.stdout:8/541: dread d1/d56/f81 [0,4194304] 0 2024-05-09T06:29:36.375 INFO:tasks.workunit.client.1.smithi079.stdout:2/577: unlink d8/db/d11/d79/fa9 0 2024-05-09T06:29:36.375 INFO:tasks.workunit.client.1.smithi079.stdout:2/578: stat d8/db/dc/c82 0 2024-05-09T06:29:36.376 INFO:tasks.workunit.client.1.smithi079.stdout:1/499: mknod d0/d7/d3e/caf 0 2024-05-09T06:29:36.378 INFO:tasks.workunit.client.1.smithi079.stdout:9/734: fdatasync d1/d45/dc6/dc9/f4a 0 2024-05-09T06:29:36.380 INFO:tasks.workunit.client.1.smithi079.stdout:7/524: dwrite d4/d7/dd/d47/f79 [0,4194304] 0 2024-05-09T06:29:36.381 INFO:tasks.workunit.client.1.smithi079.stdout:3/575: mkdir d1a/d1c/d22/d90/db8 0 2024-05-09T06:29:36.381 INFO:tasks.workunit.client.1.smithi079.stdout:3/576: chown d1a/d1c/fa2 25681040 1 2024-05-09T06:29:36.382 INFO:tasks.workunit.client.1.smithi079.stdout:3/577: write d1a/d1d/d34/f9c [405123,99090] 0 2024-05-09T06:29:36.382 INFO:tasks.workunit.client.1.smithi079.stdout:3/578: chown d1a/d1c/d22/d53 9212 1 2024-05-09T06:29:36.382 INFO:tasks.workunit.client.1.smithi079.stdout:3/579: chown d1a/d1c/fa2 6433 1 2024-05-09T06:29:36.382 INFO:tasks.workunit.client.1.smithi079.stdout:3/580: write f3 [968523,25107] 0 2024-05-09T06:29:36.383 INFO:tasks.workunit.client.1.smithi079.stdout:5/596: rename d13/d92/d9b to d13/d92/dcd/dcf 0 2024-05-09T06:29:36.394 INFO:tasks.workunit.client.1.smithi079.stdout:0/484: rename d3/dd/d18/d5e/l6b to d3/dd/d1f/d1e/d2c/d7f/l9a 0 2024-05-09T06:29:36.399 INFO:tasks.workunit.client.1.smithi079.stdout:9/735: dwrite d1/d33/d28/d36/d4d/fa2 [0,4194304] 0 2024-05-09T06:29:36.406 INFO:tasks.workunit.client.1.smithi079.stdout:8/542: rename d1/d3/d20/d7f/d33/d5d/l65 to d1/d56/d7c/lc1 0 2024-05-09T06:29:36.408 INFO:tasks.workunit.client.1.smithi079.stdout:0/485: creat d3/dd/d1f/d1e/d2c/d35/f9b x:0 0 0 2024-05-09T06:29:36.408 INFO:tasks.workunit.client.1.smithi079.stdout:3/581: dwrite d1a/d1c/d22/d53/d4e/f5b [0,4194304] 0 2024-05-09T06:29:36.421 INFO:tasks.workunit.client.1.smithi079.stdout:8/543: creat d1/d5/d36/dae/dbe/fc2 x:0 0 0 2024-05-09T06:29:36.422 INFO:tasks.workunit.client.1.smithi079.stdout:0/486: symlink d3/dd/d66/d6d/d74/d80/d2d/d90/l9c 0 2024-05-09T06:29:36.427 INFO:tasks.workunit.client.1.smithi079.stdout:3/582: creat d1a/d82/fb9 x:0 0 0 2024-05-09T06:29:36.427 INFO:tasks.workunit.client.1.smithi079.stdout:3/583: creat d1a/d1d/fba x:0 0 0 2024-05-09T06:29:36.428 INFO:tasks.workunit.client.1.smithi079.stdout:2/579: truncate d8/db/dc/f8d 1486945 0 2024-05-09T06:29:36.431 INFO:tasks.workunit.client.1.smithi079.stdout:1/500: rename d0/d12/d48/d75/d97/fa8 to d0/d12/d48/d75/d43/d20/d39/fb0 0 2024-05-09T06:29:36.431 INFO:tasks.workunit.client.1.smithi079.stdout:0/487: dread d3/dd/d66/d6d/d74/d80/f32 [0,4194304] 0 2024-05-09T06:29:36.435 INFO:tasks.workunit.client.1.smithi079.stdout:2/580: truncate d8/db/dc/d2c/f63 3344352 0 2024-05-09T06:29:36.438 INFO:tasks.workunit.client.1.smithi079.stdout:0/488: dread d3/dd/d1f/f13 [0,4194304] 0 2024-05-09T06:29:36.440 INFO:tasks.workunit.client.1.smithi079.stdout:7/525: rename d4/d7/dd/f24 to d4/d7/dd/d5b/d31/d34/fa6 0 2024-05-09T06:29:36.441 INFO:tasks.workunit.client.1.smithi079.stdout:2/581: mkdir d8/db/d59/d67/d86/dd5 0 2024-05-09T06:29:36.442 INFO:tasks.workunit.client.1.smithi079.stdout:2/582: dread d8/db/d4b/f66 [0,4194304] 0 2024-05-09T06:29:36.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/489: mknod d3/dd/d66/d6d/d74/c9d 0 2024-05-09T06:29:36.447 INFO:tasks.workunit.client.1.smithi079.stdout:1/501: dwrite d0/d12/d48/d75/d43/d70/f86 [0,4194304] 0 2024-05-09T06:29:36.449 INFO:tasks.workunit.client.1.smithi079.stdout:7/526: rmdir d4/d7/dd/d5b/d6f 39 2024-05-09T06:29:36.449 INFO:tasks.workunit.client.1.smithi079.stdout:7/527: stat d4/d7/dd/d5b/d31/f75 0 2024-05-09T06:29:36.450 INFO:tasks.workunit.client.1.smithi079.stdout:0/490: truncate d3/dd/f1c 567711 0 2024-05-09T06:29:36.466 INFO:tasks.workunit.client.1.smithi079.stdout:7/528: symlink d4/d7/d22/d28/d50/d5c/d85/la7 0 2024-05-09T06:29:36.467 INFO:tasks.workunit.client.1.smithi079.stdout:8/544: rename d1/d3/d20/d22 to d1/d3/d20/d7f/dc3 0 2024-05-09T06:29:36.475 INFO:tasks.workunit.client.1.smithi079.stdout:3/584: rename d1a/d1c/d1f/d76/fb7 to d1a/d21/db0/fbb 0 2024-05-09T06:29:36.475 INFO:tasks.workunit.client.1.smithi079.stdout:3/585: dread - d1a/d1d/fb5 zero size 2024-05-09T06:29:36.475 INFO:tasks.workunit.client.1.smithi079.stdout:3/586: write d1a/d1d/fba [516572,97623] 0 2024-05-09T06:29:36.475 INFO:tasks.workunit.client.1.smithi079.stdout:3/587: fsync d1a/d1c/d22/f30 0 2024-05-09T06:29:36.475 INFO:tasks.workunit.client.1.smithi079.stdout:3/588: creat d1a/d21/fbc x:0 0 0 2024-05-09T06:29:36.475 INFO:tasks.workunit.client.1.smithi079.stdout:3/589: write d1a/d1c/fa2 [1030053,90465] 0 2024-05-09T06:29:36.475 INFO:tasks.workunit.client.1.smithi079.stdout:3/590: fdatasync d1a/d21/f51 0 2024-05-09T06:29:36.476 INFO:tasks.workunit.client.1.smithi079.stdout:2/583: dwrite d8/db/d11/d5f/f7d [0,4194304] 0 2024-05-09T06:29:36.476 INFO:tasks.workunit.client.1.smithi079.stdout:1/502: dwrite d0/d12/d16/f84 [4194304,4194304] 0 2024-05-09T06:29:36.476 INFO:tasks.workunit.client.1.smithi079.stdout:7/529: rmdir d4/d20 39 2024-05-09T06:29:36.476 INFO:tasks.workunit.client.1.smithi079.stdout:0/491: dwrite d3/dd/d66/f72 [0,4194304] 0 2024-05-09T06:29:36.476 INFO:tasks.workunit.client.1.smithi079.stdout:0/492: creat d3/dd/d18/f9e x:0 0 0 2024-05-09T06:29:36.487 INFO:tasks.workunit.client.1.smithi079.stdout:2/584: symlink d8/db/dc/ld6 0 2024-05-09T06:29:36.492 INFO:tasks.workunit.client.1.smithi079.stdout:1/503: creat d0/d12/fb1 x:0 0 0 2024-05-09T06:29:36.492 INFO:tasks.workunit.client.1.smithi079.stdout:0/493: dwrite d3/dd/d66/d6d/f8d [0,4194304] 0 2024-05-09T06:29:36.492 INFO:tasks.workunit.client.1.smithi079.stdout:0/494: truncate d3/dd/d1f/d1e/d2c/d35/f9b 544596 0 2024-05-09T06:29:36.492 INFO:tasks.workunit.client.1.smithi079.stdout:0/495: fdatasync d3/dd/d18/d5e/d69/f75 0 2024-05-09T06:29:36.493 INFO:tasks.workunit.client.1.smithi079.stdout:7/530: mknod d4/d7/d22/d28/d50/ca8 0 2024-05-09T06:29:36.496 INFO:tasks.workunit.client.1.smithi079.stdout:0/496: dread d3/dd/d1f/f13 [0,4194304] 0 2024-05-09T06:29:36.498 INFO:tasks.workunit.client.1.smithi079.stdout:7/531: write d4/d7/dd/d5b/d31/d34/fa6 [28920,103427] 0 2024-05-09T06:29:36.498 INFO:tasks.workunit.client.1.smithi079.stdout:7/532: chown d4/d7/dd/d5b/d6f/f80 4 1 2024-05-09T06:29:36.499 INFO:tasks.workunit.client.1.smithi079.stdout:7/533: dread - d4/d7/dd/d5b/d32/f8b zero size 2024-05-09T06:29:36.501 INFO:tasks.workunit.client.1.smithi079.stdout:1/504: truncate d0/df/f14 554190 0 2024-05-09T06:29:36.501 INFO:tasks.workunit.client.1.smithi079.stdout:2/585: dwrite d8/db/d4b/d4f/d51/d6d/f96 [0,4194304] 0 2024-05-09T06:29:36.501 INFO:tasks.workunit.client.1.smithi079.stdout:2/586: creat d8/db/d11/d79/d88/fd7 x:0 0 0 2024-05-09T06:29:36.504 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:36 smithi079 ceph-mon[35268]: pgmap v247: 65 pgs: 65 active+clean; 1.0 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 76 MiB/s rd, 102 MiB/s wr, 727 op/s 2024-05-09T06:29:36.509 INFO:tasks.workunit.client.1.smithi079.stdout:1/505: creat d0/d7/d4e/d7d/d94/fb2 x:0 0 0 2024-05-09T06:29:36.509 INFO:tasks.workunit.client.1.smithi079.stdout:1/506: truncate d0/f4a 1012043 0 2024-05-09T06:29:36.515 INFO:tasks.workunit.client.1.smithi079.stdout:2/587: rename d8/db/dc/c82 to d8/db/d59/d67/cd8 0 2024-05-09T06:29:36.521 INFO:tasks.workunit.client.1.smithi079.stdout:7/534: rmdir d4/d7/dd/d47 39 2024-05-09T06:29:36.521 INFO:tasks.workunit.client.1.smithi079.stdout:7/535: chown d4/d20 1 1 2024-05-09T06:29:36.522 INFO:tasks.workunit.client.1.smithi079.stdout:1/507: dwrite d0/d7/d4e/f5d [0,4194304] 0 2024-05-09T06:29:36.532 INFO:tasks.workunit.client.1.smithi079.stdout:2/588: dwrite d8/db/d59/d67/fc1 [0,4194304] 0 2024-05-09T06:29:36.532 INFO:tasks.workunit.client.1.smithi079.stdout:3/591: getdents d1a/d21 0 2024-05-09T06:29:36.532 INFO:tasks.workunit.client.1.smithi079.stdout:3/592: dread - d1a/d21/f62 zero size 2024-05-09T06:29:36.535 INFO:tasks.workunit.client.1.smithi079.stdout:1/508: dread d0/d7/fc [0,4194304] 0 2024-05-09T06:29:36.535 INFO:tasks.workunit.client.1.smithi079.stdout:7/536: link d4/d7/dd/d5b/f99 d4/d7/d22/d28/d50/d5c/d85/fa9 0 2024-05-09T06:29:36.541 INFO:tasks.workunit.client.1.smithi079.stdout:2/589: mkdir d8/db/d59/d93/dc7/dd9 0 2024-05-09T06:29:36.543 INFO:tasks.workunit.client.1.smithi079.stdout:3/593: symlink d1a/d1d/d3a/d7c/lbd 0 2024-05-09T06:29:36.543 INFO:tasks.workunit.client.1.smithi079.stdout:3/594: fsync d1a/d1c/d22/d53/f4b 0 2024-05-09T06:29:36.546 INFO:tasks.workunit.client.1.smithi079.stdout:7/537: unlink d4/d20/c4b 0 2024-05-09T06:29:36.548 INFO:tasks.workunit.client.1.smithi079.stdout:2/590: link d8/db/c1e d8/db/d59/d67/d7f/cda 0 2024-05-09T06:29:36.550 INFO:tasks.workunit.client.1.smithi079.stdout:2/591: write d8/db/d11/f45 [481277,63477] 0 2024-05-09T06:29:36.551 INFO:tasks.workunit.client.1.smithi079.stdout:3/595: unlink d1a/d1c/d22/d53/da5/f94 0 2024-05-09T06:29:36.551 INFO:tasks.workunit.client.1.smithi079.stdout:3/596: write d1a/d1c/d22/d53/d4e/f9a [584174,56743] 0 2024-05-09T06:29:36.552 INFO:tasks.workunit.client.1.smithi079.stdout:1/509: getdents d0/d12 0 2024-05-09T06:29:36.555 INFO:tasks.workunit.client.1.smithi079.stdout:7/538: link d4/d7/dd/d5b/d31/d34/f7a d4/d7/dd/faa 0 2024-05-09T06:29:36.555 INFO:tasks.workunit.client.1.smithi079.stdout:7/539: chown d4/d7/d78 28293517 1 2024-05-09T06:29:36.557 INFO:tasks.workunit.client.1.smithi079.stdout:2/592: unlink d8/db/dc/f1d 0 2024-05-09T06:29:36.558 INFO:tasks.workunit.client.1.smithi079.stdout:2/593: creat d8/db/d59/d67/d86/fdb x:0 0 0 2024-05-09T06:29:36.559 INFO:tasks.workunit.client.1.smithi079.stdout:3/597: creat d1a/d1c/d22/d90/fbe x:0 0 0 2024-05-09T06:29:36.559 INFO:tasks.workunit.client.1.smithi079.stdout:3/598: dread - d1a/d1d/fb5 zero size 2024-05-09T06:29:36.566 INFO:tasks.workunit.client.1.smithi079.stdout:0/497: truncate d3/dd/d1f/d1e/d2c/d35/f9b 279196 0 2024-05-09T06:29:36.566 INFO:tasks.workunit.client.1.smithi079.stdout:0/498: fdatasync d3/dd/d66/d6d/d74/d84/f95 0 2024-05-09T06:29:36.566 INFO:tasks.workunit.client.1.smithi079.stdout:0/499: truncate d3/dd/d66/d6d/d74/d84/f95 198103 0 2024-05-09T06:29:36.569 INFO:tasks.workunit.client.1.smithi079.stdout:3/599: link d1a/d21/db0/fbb d1a/d1d/d67/fbf 0 2024-05-09T06:29:36.576 INFO:tasks.workunit.client.1.smithi079.stdout:2/594: write f5 [6173127,27294] 0 2024-05-09T06:29:36.576 INFO:tasks.workunit.client.1.smithi079.stdout:2/595: read - d8/db/d11/d79/d88/fcb zero size 2024-05-09T06:29:36.576 INFO:tasks.workunit.client.1.smithi079.stdout:2/596: creat d8/db/d4b/d4f/d51/fdc x:0 0 0 2024-05-09T06:29:36.576 INFO:tasks.workunit.client.1.smithi079.stdout:2/597: write d8/db/d11/d79/d88/fd7 [929477,87029] 0 2024-05-09T06:29:36.580 INFO:tasks.workunit.client.1.smithi079.stdout:0/500: getdents d3/dd/d1f/d1e/d2c/d35 0 2024-05-09T06:29:36.580 INFO:tasks.workunit.client.1.smithi079.stdout:0/501: chown d3/dd/d66/d6d/f8d 117996 1 2024-05-09T06:29:36.585 INFO:tasks.workunit.client.1.smithi079.stdout:7/540: fsync d4/d7/d22/d28/d50/d5c/d85/fa9 0 2024-05-09T06:29:36.586 INFO:tasks.workunit.client.1.smithi079.stdout:3/600: dwrite d1a/d1c/d22/f30 [0,4194304] 0 2024-05-09T06:29:36.587 INFO:tasks.workunit.client.1.smithi079.stdout:0/502: creat d3/dd/f9f x:0 0 0 2024-05-09T06:29:36.589 INFO:tasks.workunit.client.1.smithi079.stdout:7/541: truncate d4/d7/dd/d5b/d32/f3b 3889431 0 2024-05-09T06:29:36.589 INFO:tasks.workunit.client.1.smithi079.stdout:7/542: truncate d4/d7/dd/d5b/f99 1031739 0 2024-05-09T06:29:36.596 INFO:tasks.workunit.client.1.smithi079.stdout:0/503: dread d3/dd/d66/d6d/d74/d80/f67 [0,4194304] 0 2024-05-09T06:29:36.603 INFO:tasks.workunit.client.1.smithi079.stdout:0/504: dread d3/dd/d18/f34 [0,4194304] 0 2024-05-09T06:29:36.606 INFO:tasks.workunit.client.1.smithi079.stdout:0/505: creat d3/dd/d66/d6d/d74/d80/d76/fa0 x:0 0 0 2024-05-09T06:29:36.617 INFO:tasks.workunit.client.1.smithi079.stdout:7/543: dwrite d4/f6 [0,4194304] 0 2024-05-09T06:29:36.617 INFO:tasks.workunit.client.1.smithi079.stdout:2/598: dwrite d8/db/d11/f3f [0,4194304] 0 2024-05-09T06:29:36.617 INFO:tasks.workunit.client.1.smithi079.stdout:3/601: dwrite d1a/f9b [0,4194304] 0 2024-05-09T06:29:36.617 INFO:tasks.workunit.client.1.smithi079.stdout:3/602: fsync d1a/d1c/d22/d53/f43 0 2024-05-09T06:29:36.618 INFO:tasks.workunit.client.1.smithi079.stdout:3/603: fsync fb 0 2024-05-09T06:29:36.618 INFO:tasks.workunit.client.1.smithi079.stdout:3/604: write d1a/d1c/d22/fa0 [950810,111938] 0 2024-05-09T06:29:36.618 INFO:tasks.workunit.client.1.smithi079.stdout:3/605: write d1a/d1d/d34/f9c [906575,122524] 0 2024-05-09T06:29:36.624 INFO:tasks.workunit.client.1.smithi079.stdout:0/506: dread d3/dd/d1f/f1d [0,4194304] 0 2024-05-09T06:29:36.628 INFO:tasks.workunit.client.1.smithi079.stdout:2/599: symlink d8/db/d5c/d6b/ldd 0 2024-05-09T06:29:36.628 INFO:tasks.workunit.client.1.smithi079.stdout:2/600: stat d8/db/dc/f56 0 2024-05-09T06:29:36.628 INFO:tasks.workunit.client.1.smithi079.stdout:2/601: readlink d8/db/d11/l14 0 2024-05-09T06:29:36.644 INFO:tasks.workunit.client.1.smithi079.stdout:3/606: dwrite d1a/d1d/d34/d59/f74 [0,4194304] 0 2024-05-09T06:29:36.650 INFO:tasks.workunit.client.1.smithi079.stdout:0/507: link d3/dd/d66/d6d/d74/d80/f49 d3/fa1 0 2024-05-09T06:29:36.653 INFO:tasks.workunit.client.1.smithi079.stdout:2/602: symlink d8/db/d11/d79/d88/lde 0 2024-05-09T06:29:36.653 INFO:tasks.workunit.client.1.smithi079.stdout:2/603: write d8/db/d11/d5f/f64 [1164823,120568] 0 2024-05-09T06:29:36.658 INFO:tasks.workunit.client.1.smithi079.stdout:3/607: getdents d1a/d82 0 2024-05-09T06:29:36.661 INFO:tasks.workunit.client.1.smithi079.stdout:3/608: mknod d1a/d1c/cc0 0 2024-05-09T06:29:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:36 smithi062 ceph-mon[26920]: pgmap v247: 65 pgs: 65 active+clean; 1.0 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 76 MiB/s rd, 102 MiB/s wr, 727 op/s 2024-05-09T06:29:36.666 INFO:tasks.workunit.client.1.smithi079.stdout:3/609: unlink d1a/d1c/d22/d53/d4e/f9a 0 2024-05-09T06:29:36.667 INFO:tasks.workunit.client.1.smithi079.stdout:3/610: dread - d1a/d82/fb9 zero size 2024-05-09T06:29:36.670 INFO:tasks.workunit.client.1.smithi079.stdout:0/508: dwrite d3/dd/d1f/d1e/d2c/d35/d36/f48 [4194304,4194304] 0 2024-05-09T06:29:36.670 INFO:tasks.workunit.client.1.smithi079.stdout:0/509: chown d3/dd/d1f/d1e/l68 2018 1 2024-05-09T06:29:36.670 INFO:tasks.workunit.client.1.smithi079.stdout:2/604: dwrite d8/db/dc/f9b [0,4194304] 0 2024-05-09T06:29:36.670 INFO:tasks.workunit.client.1.smithi079.stdout:3/611: rename f3 to d1a/d82/d87/db2/fc1 0 2024-05-09T06:29:36.674 INFO:tasks.workunit.client.1.smithi079.stdout:0/510: rmdir d3/d5 39 2024-05-09T06:29:36.681 INFO:tasks.workunit.client.1.smithi079.stdout:4/671: sync 2024-05-09T06:29:36.682 INFO:tasks.workunit.client.1.smithi079.stdout:5/597: sync 2024-05-09T06:29:36.682 INFO:tasks.workunit.client.1.smithi079.stdout:6/563: sync 2024-05-09T06:29:36.685 INFO:tasks.workunit.client.1.smithi079.stdout:2/605: mknod d8/db/d59/d67/d86/cdf 0 2024-05-09T06:29:36.685 INFO:tasks.workunit.client.1.smithi079.stdout:2/606: chown d8/db/d59/d67 62289 1 2024-05-09T06:29:36.686 INFO:tasks.workunit.client.1.smithi079.stdout:2/607: chown d8/db/d5c/fc6 3666934 1 2024-05-09T06:29:36.687 INFO:tasks.workunit.client.1.smithi079.stdout:5/598: mknod d13/d43/d51/cd0 0 2024-05-09T06:29:36.688 INFO:tasks.workunit.client.1.smithi079.stdout:5/599: creat d13/d43/d39/da7/fd1 x:0 0 0 2024-05-09T06:29:36.690 INFO:tasks.workunit.client.1.smithi079.stdout:6/564: mknod d0/d6/d1b/d20/dac/cbc 0 2024-05-09T06:29:36.690 INFO:tasks.workunit.client.1.smithi079.stdout:3/612: dwrite d1a/d1d/d34/f9c [0,4194304] 0 2024-05-09T06:29:36.691 INFO:tasks.workunit.client.1.smithi079.stdout:2/608: truncate d8/db/d4b/d4f/d51/d6d/f96 506475 0 2024-05-09T06:29:36.691 INFO:tasks.workunit.client.1.smithi079.stdout:2/609: write d8/db/d5c/fc6 [458739,33912] 0 2024-05-09T06:29:36.693 INFO:tasks.workunit.client.1.smithi079.stdout:4/672: getdents d6/d1a/d26/d2a/d54/d9e 0 2024-05-09T06:29:36.698 INFO:tasks.workunit.client.1.smithi079.stdout:5/600: mkdir d13/d43/d3d/d40/d9a/dd2 0 2024-05-09T06:29:36.698 INFO:tasks.workunit.client.1.smithi079.stdout:5/601: fdatasync d13/f5f 0 2024-05-09T06:29:36.698 INFO:tasks.workunit.client.1.smithi079.stdout:5/602: fdatasync d13/d43/d3d/f90 0 2024-05-09T06:29:36.700 INFO:tasks.workunit.client.1.smithi079.stdout:0/511: dwrite d3/dd/d18/f9e [0,4194304] 0 2024-05-09T06:29:36.700 INFO:tasks.workunit.client.1.smithi079.stdout:6/565: symlink d0/d60/d81/lbd 0 2024-05-09T06:29:36.716 INFO:tasks.workunit.client.1.smithi079.stdout:0/512: unlink d3/dd/d1f/f20 0 2024-05-09T06:29:36.716 INFO:tasks.workunit.client.1.smithi079.stdout:0/513: truncate d3/dd/d18/f7a 4645407 0 2024-05-09T06:29:36.717 INFO:tasks.workunit.client.1.smithi079.stdout:6/566: symlink d0/d60/daf/lbe 0 2024-05-09T06:29:36.724 INFO:tasks.workunit.client.1.smithi079.stdout:3/613: rmdir d1a/d1d/d3a/d54/d5e 0 2024-05-09T06:29:36.724 INFO:tasks.workunit.client.1.smithi079.stdout:3/614: chown d1a/d1c/d22/d53/f86 5840997 1 2024-05-09T06:29:36.725 INFO:tasks.workunit.client.1.smithi079.stdout:2/610: dwrite d8/db/d11/d5f/f75 [0,4194304] 0 2024-05-09T06:29:36.725 INFO:tasks.workunit.client.1.smithi079.stdout:4/673: dwrite d6/d1a/d26/d2a/d98/fac [0,4194304] 0 2024-05-09T06:29:36.725 INFO:tasks.workunit.client.1.smithi079.stdout:4/674: truncate d6/d1a/d26/d2a/d54/d9e/fc0 247102 0 2024-05-09T06:29:36.730 INFO:tasks.workunit.client.1.smithi079.stdout:3/615: unlink d1a/f2c 0 2024-05-09T06:29:36.732 INFO:tasks.workunit.client.1.smithi079.stdout:6/567: read d0/d6/d16/d1f/f41 [1593611,31599] 0 2024-05-09T06:29:36.732 INFO:tasks.workunit.client.1.smithi079.stdout:6/568: chown d0/d6/d16/c5c 1799308784 1 2024-05-09T06:29:36.738 INFO:tasks.workunit.client.1.smithi079.stdout:3/616: rename d1a/d1d/d67/fae to d1a/d1d/d3a/d7c/fc2 0 2024-05-09T06:29:36.740 INFO:tasks.workunit.client.1.smithi079.stdout:6/569: mknod d0/d6/d5e/cbf 0 2024-05-09T06:29:36.740 INFO:tasks.workunit.client.1.smithi079.stdout:5/603: dwrite d13/d43/d26/f2e [0,4194304] 0 2024-05-09T06:29:36.741 INFO:tasks.workunit.client.1.smithi079.stdout:0/514: dwrite d3/dd/d18/f7a [4194304,4194304] 0 2024-05-09T06:29:36.741 INFO:tasks.workunit.client.1.smithi079.stdout:0/515: truncate d3/dd/d18/d5e/f5a 5178825 0 2024-05-09T06:29:36.741 INFO:tasks.workunit.client.1.smithi079.stdout:0/516: readlink d3/dd/d1f/l4a 0 2024-05-09T06:29:36.741 INFO:tasks.workunit.client.1.smithi079.stdout:4/675: dwrite d6/d8/d27/f2e [0,4194304] 0 2024-05-09T06:29:36.741 INFO:tasks.workunit.client.1.smithi079.stdout:4/676: fsync d6/d1a/d26/d2a/d54/f70 0 2024-05-09T06:29:36.748 INFO:tasks.workunit.client.1.smithi079.stdout:3/617: rename d1a/d1d/d3a/d7c/daf to d1a/d1c/d22/d53/d4e/dc3 0 2024-05-09T06:29:36.748 INFO:tasks.workunit.client.1.smithi079.stdout:3/618: truncate d1a/d82/f89 1372237 0 2024-05-09T06:29:36.751 INFO:tasks.workunit.client.1.smithi079.stdout:6/570: mknod d0/d6/d16/da5/d9c/cc0 0 2024-05-09T06:29:36.754 INFO:tasks.workunit.client.1.smithi079.stdout:5/604: dwrite d13/d92/dcd/dcf/fba [0,4194304] 0 2024-05-09T06:29:36.758 INFO:tasks.workunit.client.1.smithi079.stdout:0/517: creat d3/dd/d66/d6d/fa2 x:0 0 0 2024-05-09T06:29:36.763 INFO:tasks.workunit.client.1.smithi079.stdout:3/619: creat d1a/d82/daa/fc4 x:0 0 0 2024-05-09T06:29:36.765 INFO:tasks.workunit.client.1.smithi079.stdout:6/571: dwrite d0/d6/d16/d1f/f41 [8388608,4194304] 0 2024-05-09T06:29:36.769 INFO:tasks.workunit.client.1.smithi079.stdout:5/605: creat d13/d43/d39/d61/d72/dbd/fd3 x:0 0 0 2024-05-09T06:29:36.769 INFO:tasks.workunit.client.1.smithi079.stdout:5/606: chown d13/d4d/l79 126072325 1 2024-05-09T06:29:36.769 INFO:tasks.workunit.client.1.smithi079.stdout:9/736: sync 2024-05-09T06:29:36.770 INFO:tasks.workunit.client.1.smithi079.stdout:8/545: sync 2024-05-09T06:29:36.771 INFO:tasks.workunit.client.1.smithi079.stdout:4/677: mknod d6/d8/d27/cdc 0 2024-05-09T06:29:36.772 INFO:tasks.workunit.client.1.smithi079.stdout:3/620: mkdir d1a/d1c/d1f/d76/dc5 0 2024-05-09T06:29:36.776 INFO:tasks.workunit.client.1.smithi079.stdout:4/678: stat d6/d1a/d26/d2a/d54/d9e/dd5/l2c 0 2024-05-09T06:29:36.778 INFO:tasks.workunit.client.1.smithi079.stdout:5/607: write d13/d2a/f67 [1355913,22601] 0 2024-05-09T06:29:36.779 INFO:tasks.workunit.client.1.smithi079.stdout:3/621: mkdir d1a/d1c/d22/d53/dc6 0 2024-05-09T06:29:36.782 INFO:tasks.workunit.client.1.smithi079.stdout:8/546: mkdir d1/d3/dc4 0 2024-05-09T06:29:36.782 INFO:tasks.workunit.client.1.smithi079.stdout:8/547: chown d1/db/daf/d66/d6c/d6b 2483965 1 2024-05-09T06:29:36.784 INFO:tasks.workunit.client.1.smithi079.stdout:3/622: dread f16 [0,4194304] 0 2024-05-09T06:29:36.785 INFO:tasks.workunit.client.1.smithi079.stdout:5/608: dread d13/d43/d3d/d40/d63/f7b [0,4194304] 0 2024-05-09T06:29:36.786 INFO:tasks.workunit.client.1.smithi079.stdout:5/609: stat d13/d43/d3d/d40/lc0 0 2024-05-09T06:29:36.786 INFO:tasks.workunit.client.1.smithi079.stdout:4/679: truncate d6/d8/d27/d3d/d5b/d9a/d8b/fb9 891923 0 2024-05-09T06:29:36.789 INFO:tasks.workunit.client.1.smithi079.stdout:3/623: rename d1a/d1c/d22/fad to d1a/d1c/d22/d53/d4e/dc3/fc7 0 2024-05-09T06:29:36.789 INFO:tasks.workunit.client.1.smithi079.stdout:3/624: fdatasync d1a/d82/d87/f8d 0 2024-05-09T06:29:36.790 INFO:tasks.workunit.client.1.smithi079.stdout:4/680: creat d6/d1a/d41/fdd x:0 0 0 2024-05-09T06:29:36.792 INFO:tasks.workunit.client.1.smithi079.stdout:1/510: sync 2024-05-09T06:29:36.792 INFO:tasks.workunit.client.1.smithi079.stdout:1/511: chown d0/d12/d48/d75/d43/d20/f5f 39886 1 2024-05-09T06:29:36.792 INFO:tasks.workunit.client.1.smithi079.stdout:1/512: fsync d0/d7/f9 0 2024-05-09T06:29:36.792 INFO:tasks.workunit.client.1.smithi079.stdout:1/513: chown d0/df/f8f 181374556 1 2024-05-09T06:29:36.792 INFO:tasks.workunit.client.1.smithi079.stdout:1/514: creat d0/d12/d48/fb3 x:0 0 0 2024-05-09T06:29:36.793 INFO:tasks.workunit.client.1.smithi079.stdout:3/625: link d1a/d21/f40 d1a/d1c/d22/fc8 0 2024-05-09T06:29:36.793 INFO:tasks.workunit.client.1.smithi079.stdout:3/626: chown d1a/d82 1 1 2024-05-09T06:29:36.796 INFO:tasks.workunit.client.1.smithi079.stdout:6/572: dwrite d0/de/f1c [0,4194304] 0 2024-05-09T06:29:36.796 INFO:tasks.workunit.client.1.smithi079.stdout:6/573: chown d0/d6/d16/c68 4089 1 2024-05-09T06:29:36.796 INFO:tasks.workunit.client.1.smithi079.stdout:9/737: dwrite d1/f8e [0,4194304] 0 2024-05-09T06:29:36.799 INFO:tasks.workunit.client.1.smithi079.stdout:4/681: dread d6/f24 [0,4194304] 0 2024-05-09T06:29:36.799 INFO:tasks.workunit.client.1.smithi079.stdout:2/611: rmdir d8/db/d4b 39 2024-05-09T06:29:36.799 INFO:tasks.workunit.client.1.smithi079.stdout:2/612: readlink d8/db/l2b 0 2024-05-09T06:29:36.800 INFO:tasks.workunit.client.1.smithi079.stdout:5/610: dread d13/d92/dcd/dcf/fa0 [0,4194304] 0 2024-05-09T06:29:36.800 INFO:tasks.workunit.client.1.smithi079.stdout:0/518: dwrite d3/fa1 [0,4194304] 0 2024-05-09T06:29:36.800 INFO:tasks.workunit.client.1.smithi079.stdout:0/519: creat d3/dd/d66/d6d/d74/d84/fa3 x:0 0 0 2024-05-09T06:29:36.801 INFO:tasks.workunit.client.1.smithi079.stdout:0/520: chown d3/dd/d66/d6d/c78 6995 1 2024-05-09T06:29:36.806 INFO:tasks.workunit.client.1.smithi079.stdout:9/738: write d1/d5/faa [2846539,128044] 0 2024-05-09T06:29:36.806 INFO:tasks.workunit.client.1.smithi079.stdout:4/682: unlink d6/d1a/d26/d2a/d54/d9e/dd5/df/f21 0 2024-05-09T06:29:36.809 INFO:tasks.workunit.client.1.smithi079.stdout:5/611: write d13/d43/d26/f33 [1379785,120488] 0 2024-05-09T06:29:36.809 INFO:tasks.workunit.client.1.smithi079.stdout:2/613: dread d8/f9 [0,4194304] 0 2024-05-09T06:29:36.811 INFO:tasks.workunit.client.1.smithi079.stdout:0/521: link d3/dd/d66/f72 d3/dd/d66/d6d/d74/fa4 0 2024-05-09T06:29:36.812 INFO:tasks.workunit.client.1.smithi079.stdout:2/614: dread d8/db/d11/d79/d88/fd7 [0,4194304] 0 2024-05-09T06:29:36.813 INFO:tasks.workunit.client.1.smithi079.stdout:6/574: getdents d0/d6/d16/d28 0 2024-05-09T06:29:36.813 INFO:tasks.workunit.client.1.smithi079.stdout:6/575: creat d0/d6/d16/d1f/fc1 x:0 0 0 2024-05-09T06:29:36.818 INFO:tasks.workunit.client.1.smithi079.stdout:9/739: rename d1/d5/dba to d1/d33/d48/d64/df4 0 2024-05-09T06:29:36.824 INFO:tasks.workunit.client.1.smithi079.stdout:7/544: sync 2024-05-09T06:29:36.824 INFO:tasks.workunit.client.1.smithi079.stdout:7/545: write d4/d7/dd/d5b/d32/f8b [809490,53613] 0 2024-05-09T06:29:36.831 INFO:tasks.workunit.client.1.smithi079.stdout:0/522: dwrite d3/dd/d18/d5e/d69/f7c [0,4194304] 0 2024-05-09T06:29:36.833 INFO:tasks.workunit.client.1.smithi079.stdout:6/576: mkdir d0/d6/d1b/d20/dac/dc2 0 2024-05-09T06:29:36.834 INFO:tasks.workunit.client.1.smithi079.stdout:3/627: rmdir d1a/d1d/d67 39 2024-05-09T06:29:36.834 INFO:tasks.workunit.client.1.smithi079.stdout:3/628: creat d1a/d1d/d34/d42/fc9 x:0 0 0 2024-05-09T06:29:36.835 INFO:tasks.workunit.client.1.smithi079.stdout:6/577: dread d0/d6/fa7 [0,4194304] 0 2024-05-09T06:29:36.836 INFO:tasks.workunit.client.1.smithi079.stdout:5/612: rename d13/f48 to d13/d92/dcd/fd4 0 2024-05-09T06:29:36.838 INFO:tasks.workunit.client.1.smithi079.stdout:9/740: symlink d1/d33/d28/d36/d4d/d7d/df3/lf5 0 2024-05-09T06:29:36.840 INFO:tasks.workunit.client.1.smithi079.stdout:7/546: unlink d4/d7/d22/d28/l63 0 2024-05-09T06:29:36.847 INFO:tasks.workunit.client.1.smithi079.stdout:0/523: unlink d3/dd/d66/d6d/d74/fa4 0 2024-05-09T06:29:36.847 INFO:tasks.workunit.client.1.smithi079.stdout:0/524: fsync d3/dd/d66/d6d/d74/d80/f56 0 2024-05-09T06:29:36.851 INFO:tasks.workunit.client.1.smithi079.stdout:3/629: creat d1a/d1d/d34/fca x:0 0 0 2024-05-09T06:29:36.851 INFO:tasks.workunit.client.1.smithi079.stdout:3/630: read d1a/d1d/fba [494065,57837] 0 2024-05-09T06:29:36.852 INFO:tasks.workunit.client.1.smithi079.stdout:2/615: rename d8/db/c1e to d8/db/d59/d67/d7f/db9/dca/ce0 0 2024-05-09T06:29:36.853 INFO:tasks.workunit.client.1.smithi079.stdout:3/631: read d1a/d1c/d22/fa0 [664485,42916] 0 2024-05-09T06:29:36.854 INFO:tasks.workunit.client.1.smithi079.stdout:3/632: truncate d1a/d1c/d22/d53/f96 737481 0 2024-05-09T06:29:36.854 INFO:tasks.workunit.client.1.smithi079.stdout:6/578: dwrite d0/d6/d16/da5/f98 [0,4194304] 0 2024-05-09T06:29:36.854 INFO:tasks.workunit.client.1.smithi079.stdout:6/579: chown d0/d6/d1b/d2d 117 1 2024-05-09T06:29:36.854 INFO:tasks.workunit.client.1.smithi079.stdout:5/613: truncate f11 457665 0 2024-05-09T06:29:36.854 INFO:tasks.workunit.client.1.smithi079.stdout:5/614: write d13/d43/d39/da7/fa9 [525739,85497] 0 2024-05-09T06:29:36.856 INFO:tasks.workunit.client.1.smithi079.stdout:7/547: link d4/d7/dd/d5b/c71 d4/d20/cab 0 2024-05-09T06:29:36.858 INFO:tasks.workunit.client.1.smithi079.stdout:0/525: truncate d3/dd/d1f/fa 5704248 0 2024-05-09T06:29:36.858 INFO:tasks.workunit.client.1.smithi079.stdout:0/526: chown d3/dd/d1f/d1e/l6e 5660 1 2024-05-09T06:29:36.860 INFO:tasks.workunit.client.1.smithi079.stdout:9/741: rename d1/d33/d28/d36/d4d/d7d/d19/c1d to d1/d33/d28/d4c/d8b/cf6 0 2024-05-09T06:29:36.861 INFO:tasks.workunit.client.1.smithi079.stdout:2/616: mkdir d8/db/d59/d67/d7f/db9/de1 0 2024-05-09T06:29:36.863 INFO:tasks.workunit.client.1.smithi079.stdout:9/742: dread d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/d6b/fcf [0,4194304] 0 2024-05-09T06:29:36.863 INFO:tasks.workunit.client.1.smithi079.stdout:3/633: creat d1a/d82/fcb x:0 0 0 2024-05-09T06:29:36.864 INFO:tasks.workunit.client.1.smithi079.stdout:3/634: read d1a/d1c/d1f/f56 [7885706,69183] 0 2024-05-09T06:29:36.864 INFO:tasks.workunit.client.1.smithi079.stdout:3/635: truncate d1a/d1d/d34/f6c 4875285 0 2024-05-09T06:29:36.864 INFO:tasks.workunit.client.1.smithi079.stdout:3/636: write d1a/d1c/d22/d53/d4e/dc3/fc7 [4538275,16438] 0 2024-05-09T06:29:36.868 INFO:tasks.workunit.client.1.smithi079.stdout:6/580: creat d0/d6/d1b/d20/dac/fc3 x:0 0 0 2024-05-09T06:29:36.868 INFO:tasks.workunit.client.1.smithi079.stdout:6/581: dread - d0/d6/d16/d1f/d6f/f77 zero size 2024-05-09T06:29:36.868 INFO:tasks.workunit.client.1.smithi079.stdout:6/582: write d0/d6/d16/d28/f6a [807104,72578] 0 2024-05-09T06:29:36.868 INFO:tasks.workunit.client.1.smithi079.stdout:6/583: chown d0/d6/d1b/d20/dac/cba 4 1 2024-05-09T06:29:36.874 INFO:tasks.workunit.client.1.smithi079.stdout:5/615: mknod d13/d43/d3d/d40/d63/da2/d8b/cd5 0 2024-05-09T06:29:36.874 INFO:tasks.workunit.client.1.smithi079.stdout:5/616: stat lf 0 2024-05-09T06:29:36.874 INFO:tasks.workunit.client.1.smithi079.stdout:5/617: readlink ld 0 2024-05-09T06:29:36.876 INFO:tasks.workunit.client.1.smithi079.stdout:7/548: mknod d4/d7/dd/d5b/d32/da0/cac 0 2024-05-09T06:29:36.880 INFO:tasks.workunit.client.1.smithi079.stdout:0/527: creat d3/dd/d1f/d1e/d2c/d88/d8e/fa5 x:0 0 0 2024-05-09T06:29:36.882 INFO:tasks.workunit.client.1.smithi079.stdout:2/617: creat d8/db/d59/d67/d7f/db9/dca/fe2 x:0 0 0 2024-05-09T06:29:36.882 INFO:tasks.workunit.client.1.smithi079.stdout:2/618: chown d8/db/dc/f34 14 1 2024-05-09T06:29:36.884 INFO:tasks.workunit.client.1.smithi079.stdout:0/528: dread d3/dd/d1f/d1e/d2c/d35/f7d [0,4194304] 0 2024-05-09T06:29:36.884 INFO:tasks.workunit.client.1.smithi079.stdout:0/529: write d3/dd/d1f/d1e/f2a [3538542,68611] 0 2024-05-09T06:29:36.884 INFO:tasks.workunit.client.1.smithi079.stdout:0/530: chown d3/d5/d87 16429423 1 2024-05-09T06:29:36.884 INFO:tasks.workunit.client.1.smithi079.stdout:9/743: creat d1/d33/d48/ff7 x:0 0 0 2024-05-09T06:29:36.889 INFO:tasks.workunit.client.1.smithi079.stdout:3/637: mkdir d1a/dcc 0 2024-05-09T06:29:36.892 INFO:tasks.workunit.client.1.smithi079.stdout:0/531: dread d3/dd/d66/d6d/f8d [4194304,4194304] 0 2024-05-09T06:29:36.893 INFO:tasks.workunit.client.1.smithi079.stdout:6/584: creat d0/d6/d16/d1f/d6f/d8c/d93/fc4 x:0 0 0 2024-05-09T06:29:36.898 INFO:tasks.workunit.client.1.smithi079.stdout:7/549: creat d4/d7/d22/d28/d50/d5c/fad x:0 0 0 2024-05-09T06:29:36.898 INFO:tasks.workunit.client.1.smithi079.stdout:7/550: readlink d4/d7/d22/l65 0 2024-05-09T06:29:36.898 INFO:tasks.workunit.client.1.smithi079.stdout:7/551: write d4/d7/dd/d88/f8a [1224249,100866] 0 2024-05-09T06:29:36.900 INFO:tasks.workunit.client.1.smithi079.stdout:5/618: dread d13/d43/d26/f57 [0,4194304] 0 2024-05-09T06:29:36.902 INFO:tasks.workunit.client.1.smithi079.stdout:9/744: unlink d1/d33/d28/d36/d4d/d7d/d19/f55 0 2024-05-09T06:29:36.904 INFO:tasks.workunit.client.1.smithi079.stdout:6/585: creat d0/d6/d16/d1f/d36/d69/dad/fc5 x:0 0 0 2024-05-09T06:29:36.906 INFO:tasks.workunit.client.1.smithi079.stdout:5/619: dread d13/d43/d39/d61/fa6 [0,4194304] 0 2024-05-09T06:29:36.910 INFO:tasks.workunit.client.1.smithi079.stdout:7/552: truncate d4/d7/dd/f16 1266017 0 2024-05-09T06:29:36.910 INFO:tasks.workunit.client.1.smithi079.stdout:7/553: fsync d4/d7/dd/f42 0 2024-05-09T06:29:36.911 INFO:tasks.workunit.client.1.smithi079.stdout:7/554: readlink d4/d7/dd/d5b/d32/l95 0 2024-05-09T06:29:36.911 INFO:tasks.workunit.client.1.smithi079.stdout:7/555: chown d4/d7/dd/d5b/l39 47114 1 2024-05-09T06:29:36.913 INFO:tasks.workunit.client.1.smithi079.stdout:9/745: mknod d1/d45/dc6/dc9/d2d/d99/cf8 0 2024-05-09T06:29:36.915 INFO:tasks.workunit.client.1.smithi079.stdout:6/586: rename d0/d6/d16/d1f/d36/c5d to d0/d6/d1b/d2d/cc6 0 2024-05-09T06:29:36.915 INFO:tasks.workunit.client.1.smithi079.stdout:6/587: write d0/de/f59 [963995,76413] 0 2024-05-09T06:29:36.918 INFO:tasks.workunit.client.1.smithi079.stdout:2/619: dwrite f3 [4194304,4194304] 0 2024-05-09T06:29:36.918 INFO:tasks.workunit.client.1.smithi079.stdout:2/620: write d8/db/d11/d79/d88/fcb [752911,32394] 0 2024-05-09T06:29:36.918 INFO:tasks.workunit.client.1.smithi079.stdout:7/556: creat d4/d7/dd/d5b/d31/fae x:0 0 0 2024-05-09T06:29:36.918 INFO:tasks.workunit.client.1.smithi079.stdout:3/638: dwrite d1a/d82/daa/fc4 [0,4194304] 0 2024-05-09T06:29:36.922 INFO:tasks.workunit.client.1.smithi079.stdout:9/746: truncate d1/d33/d28/d36/d4d/d7d/d19/fa6 290126 0 2024-05-09T06:29:36.922 INFO:tasks.workunit.client.1.smithi079.stdout:9/747: read - d1/d33/d28/d36/dcd/de7/d75/f94 zero size 2024-05-09T06:29:36.923 INFO:tasks.workunit.client.1.smithi079.stdout:6/588: rename d0/d6/d1b/d20/l3e to d0/d6/d16/da5/lc7 0 2024-05-09T06:29:36.924 INFO:tasks.workunit.client.1.smithi079.stdout:2/621: symlink d8/db/d59/d93/dc7/dd9/le3 0 2024-05-09T06:29:36.924 INFO:tasks.workunit.client.1.smithi079.stdout:2/622: dread - d8/db/d59/d67/d7f/db9/dca/fe2 zero size 2024-05-09T06:29:36.928 INFO:tasks.workunit.client.1.smithi079.stdout:5/620: dwrite d13/f21 [0,4194304] 0 2024-05-09T06:29:36.928 INFO:tasks.workunit.client.1.smithi079.stdout:5/621: fdatasync d13/d43/d3d/f7a 0 2024-05-09T06:29:36.935 INFO:tasks.workunit.client.1.smithi079.stdout:7/557: dwrite d4/d7/dd/d5b/d32/f3b [0,4194304] 0 2024-05-09T06:29:36.940 INFO:tasks.workunit.client.1.smithi079.stdout:3/639: mknod d1a/d82/d87/db2/ccd 0 2024-05-09T06:29:36.940 INFO:tasks.workunit.client.1.smithi079.stdout:3/640: truncate d1a/d1c/d1f/d76/fb4 764153 0 2024-05-09T06:29:36.942 INFO:tasks.workunit.client.1.smithi079.stdout:9/748: creat d1/d33/d28/d36/dbe/ff9 x:0 0 0 2024-05-09T06:29:36.942 INFO:tasks.workunit.client.1.smithi079.stdout:9/749: fdatasync d1/f3 0 2024-05-09T06:29:36.944 INFO:tasks.workunit.client.1.smithi079.stdout:6/589: link d0/d6/d5e/f9a d0/d6/d1b/d20/dac/dc2/fc8 0 2024-05-09T06:29:36.945 INFO:tasks.workunit.client.1.smithi079.stdout:2/623: symlink d8/db/d59/d67/d86/dd5/le4 0 2024-05-09T06:29:36.949 INFO:tasks.workunit.client.1.smithi079.stdout:5/622: unlink d13/d43/d26/d35/fc8 0 2024-05-09T06:29:36.949 INFO:tasks.workunit.client.1.smithi079.stdout:5/623: fdatasync d13/d2a/f4b 0 2024-05-09T06:29:36.949 INFO:tasks.workunit.client.1.smithi079.stdout:5/624: stat d13/d43/d39/d61/d72/dbd/fd3 0 2024-05-09T06:29:36.953 INFO:tasks.workunit.client.1.smithi079.stdout:7/558: link d4/d7/d22/d28/d50/l61 d4/d9e/laf 0 2024-05-09T06:29:36.954 INFO:tasks.workunit.client.1.smithi079.stdout:7/559: readlink d4/d7/dd/d5b/d31/l4c 0 2024-05-09T06:29:36.954 INFO:tasks.workunit.client.1.smithi079.stdout:7/560: read d4/d7/dd/d5b/d31/d34/fa6 [779447,72910] 0 2024-05-09T06:29:36.954 INFO:tasks.workunit.client.1.smithi079.stdout:7/561: chown d4/cb 215 1 2024-05-09T06:29:36.954 INFO:tasks.workunit.client.1.smithi079.stdout:7/562: chown d4/d7/d22/d28/d50/d5c/l66 0 1 2024-05-09T06:29:36.954 INFO:tasks.workunit.client.1.smithi079.stdout:6/590: dread d0/d6/f14 [0,4194304] 0 2024-05-09T06:29:36.955 INFO:tasks.workunit.client.1.smithi079.stdout:6/591: read d0/d60/d8e/fa1 [467398,7194] 0 2024-05-09T06:29:36.955 INFO:tasks.workunit.client.1.smithi079.stdout:6/592: fdatasync d0/d6/d16/d1f/d36/d69/f7b 0 2024-05-09T06:29:36.955 INFO:tasks.workunit.client.1.smithi079.stdout:6/593: readlink d0/d6/d1b/d2d/l2e 0 2024-05-09T06:29:36.955 INFO:tasks.workunit.client.1.smithi079.stdout:3/641: symlink d1a/d1c/d22/lce 0 2024-05-09T06:29:36.955 INFO:tasks.workunit.client.1.smithi079.stdout:3/642: fdatasync d1a/d1c/d22/d90/f99 0 2024-05-09T06:29:36.957 INFO:tasks.workunit.client.1.smithi079.stdout:9/750: symlink d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/df0/lfa 0 2024-05-09T06:29:36.960 INFO:tasks.workunit.client.1.smithi079.stdout:2/624: truncate d8/db/d11/f3f 7216865 0 2024-05-09T06:29:36.960 INFO:tasks.workunit.client.1.smithi079.stdout:2/625: stat d8/db/d4b/d4f/d51/d6d/l8c 0 2024-05-09T06:29:36.960 INFO:tasks.workunit.client.1.smithi079.stdout:2/626: chown d8/db/dc/c84 4078770 1 2024-05-09T06:29:36.960 INFO:tasks.workunit.client.1.smithi079.stdout:7/563: mknod d4/d7/d22/d28/cb0 0 2024-05-09T06:29:36.962 INFO:tasks.workunit.client.1.smithi079.stdout:6/594: symlink d0/d6/d16/d1f/d36/d69/dad/lc9 0 2024-05-09T06:29:36.962 INFO:tasks.workunit.client.1.smithi079.stdout:6/595: creat d0/d6/d16/d1f/fca x:0 0 0 2024-05-09T06:29:36.963 INFO:tasks.workunit.client.1.smithi079.stdout:3/643: getdents d1a/d21/db0 0 2024-05-09T06:29:36.969 INFO:tasks.workunit.client.1.smithi079.stdout:6/596: mknod d0/d6/d1b/ccb 0 2024-05-09T06:29:36.972 INFO:tasks.workunit.client.1.smithi079.stdout:2/627: getdents d8/db/dc/d2c/d2e 0 2024-05-09T06:29:36.972 INFO:tasks.workunit.client.1.smithi079.stdout:2/628: creat d8/db/d11/fe5 x:0 0 0 2024-05-09T06:29:36.972 INFO:tasks.workunit.client.1.smithi079.stdout:2/629: write d8/db/d59/d67/d86/f8f [307017,62515] 0 2024-05-09T06:29:36.972 INFO:tasks.workunit.client.1.smithi079.stdout:2/630: write d8/db/fb0 [474072,55973] 0 2024-05-09T06:29:36.981 INFO:tasks.workunit.client.1.smithi079.stdout:6/597: dread d0/f15 [0,4194304] 0 2024-05-09T06:29:36.981 INFO:tasks.workunit.client.1.smithi079.stdout:6/598: write d0/d6/d1b/fae [2782714,72476] 0 2024-05-09T06:29:36.983 INFO:tasks.workunit.client.1.smithi079.stdout:2/631: creat d8/db/d59/d93/fe6 x:0 0 0 2024-05-09T06:29:36.983 INFO:tasks.workunit.client.1.smithi079.stdout:2/632: dread - d8/db/d4b/fb8 zero size 2024-05-09T06:29:36.985 INFO:tasks.workunit.client.1.smithi079.stdout:3/644: dread f19 [0,4194304] 0 2024-05-09T06:29:36.990 INFO:tasks.workunit.client.1.smithi079.stdout:5/625: dwrite d13/f1a [0,4194304] 0 2024-05-09T06:29:36.990 INFO:tasks.workunit.client.1.smithi079.stdout:7/564: dwrite d4/d7/dd/d5b/f3a [0,4194304] 0 2024-05-09T06:29:36.991 INFO:tasks.workunit.client.1.smithi079.stdout:6/599: mknod d0/d6/d1b/ccc 0 2024-05-09T06:29:36.993 INFO:tasks.workunit.client.1.smithi079.stdout:2/633: truncate d8/db/f12 970664 0 2024-05-09T06:29:36.996 INFO:tasks.workunit.client.1.smithi079.stdout:3/645: unlink d1a/d82/fb9 0 2024-05-09T06:29:36.996 INFO:tasks.workunit.client.1.smithi079.stdout:3/646: stat d1a/d82/d87/f8d 0 2024-05-09T06:29:36.998 INFO:tasks.workunit.client.1.smithi079.stdout:5/626: mknod d13/d43/d3d/d40/d53/dad/cd6 0 2024-05-09T06:29:37.001 INFO:tasks.workunit.client.1.smithi079.stdout:7/565: link d4/d7/dd/d5b/f3a d4/d7/d37/d7c/d8e/fb1 0 2024-05-09T06:29:37.004 INFO:tasks.workunit.client.1.smithi079.stdout:2/634: truncate d8/fa 2761016 0 2024-05-09T06:29:37.006 INFO:tasks.workunit.client.1.smithi079.stdout:5/627: mkdir d13/d43/d39/d61/d72/dd7 0 2024-05-09T06:29:37.006 INFO:tasks.workunit.client.1.smithi079.stdout:5/628: write d13/d43/d3d/d40/d9a/fc6 [436130,77135] 0 2024-05-09T06:29:37.007 INFO:tasks.workunit.client.1.smithi079.stdout:6/600: dwrite d0/d6/fa7 [0,4194304] 0 2024-05-09T06:29:37.008 INFO:tasks.workunit.client.1.smithi079.stdout:7/566: getdents d4 0 2024-05-09T06:29:37.008 INFO:tasks.workunit.client.1.smithi079.stdout:7/567: creat d4/d7/d22/d28/d50/fb2 x:0 0 0 2024-05-09T06:29:37.017 INFO:tasks.workunit.client.1.smithi079.stdout:6/601: read d0/d6/d16/d1f/f41 [10266589,19095] 0 2024-05-09T06:29:37.017 INFO:tasks.workunit.client.1.smithi079.stdout:3/647: dwrite d1a/d82/f89 [0,4194304] 0 2024-05-09T06:29:37.018 INFO:tasks.workunit.client.1.smithi079.stdout:7/568: mknod d4/d7/d37/d7c/d8e/cb3 0 2024-05-09T06:29:37.018 INFO:tasks.workunit.client.1.smithi079.stdout:7/569: dread - d4/d7/d37/d7c/f8f zero size 2024-05-09T06:29:37.022 INFO:tasks.workunit.client.1.smithi079.stdout:7/570: link d4/d7/dd/d5b/d31/d34/f7a d4/d7/d78/fb4 0 2024-05-09T06:29:37.022 INFO:tasks.workunit.client.1.smithi079.stdout:7/571: truncate d4/d7/dd/f6d 4811177 0 2024-05-09T06:29:37.026 INFO:tasks.workunit.client.1.smithi079.stdout:3/648: symlink d1a/d1d/d34/lcf 0 2024-05-09T06:29:37.026 INFO:tasks.workunit.client.1.smithi079.stdout:3/649: chown d1a/d1d/d3a/d54/lb6 362191 1 2024-05-09T06:29:37.028 INFO:tasks.workunit.client.1.smithi079.stdout:2/635: dwrite d8/db/d11/f45 [0,4194304] 0 2024-05-09T06:29:37.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/650: rmdir d1a/d1c/d1f 39 2024-05-09T06:29:37.032 INFO:tasks.workunit.client.1.smithi079.stdout:5/629: dwrite d13/d2a/f7e [0,4194304] 0 2024-05-09T06:29:37.032 INFO:tasks.workunit.client.1.smithi079.stdout:5/630: truncate d13/d43/d39/d61/f7d 874942 0 2024-05-09T06:29:37.032 INFO:tasks.workunit.client.1.smithi079.stdout:5/631: readlink d13/d43/d3d/d40/d53/l87 0 2024-05-09T06:29:37.032 INFO:tasks.workunit.client.1.smithi079.stdout:5/632: write d13/d43/f81 [413371,111872] 0 2024-05-09T06:29:37.035 INFO:tasks.workunit.client.1.smithi079.stdout:3/651: unlink d1a/d21/db0/fbb 0 2024-05-09T06:29:37.035 INFO:tasks.workunit.client.1.smithi079.stdout:3/652: readlink d1a/d1c/d1f/l72 0 2024-05-09T06:29:37.036 INFO:tasks.workunit.client.1.smithi079.stdout:4/683: sync 2024-05-09T06:29:37.038 INFO:tasks.workunit.client.1.smithi079.stdout:1/515: sync 2024-05-09T06:29:37.039 INFO:tasks.workunit.client.1.smithi079.stdout:8/548: sync 2024-05-09T06:29:37.049 INFO:tasks.workunit.client.1.smithi079.stdout:5/633: mknod d13/d43/d51/dc9/cd8 0 2024-05-09T06:29:37.049 INFO:tasks.workunit.client.1.smithi079.stdout:5/634: write d13/d43/d3d/d40/d63/f8c [700741,33543] 0 2024-05-09T06:29:37.049 INFO:tasks.workunit.client.1.smithi079.stdout:5/635: chown d13/d43/d26/dac 3727062 1 2024-05-09T06:29:37.049 INFO:tasks.workunit.client.1.smithi079.stdout:5/636: write d13/d43/d39/d61/f94 [837673,47552] 0 2024-05-09T06:29:37.050 INFO:tasks.workunit.client.1.smithi079.stdout:8/549: dread d1/d5/dc/f1b [0,4194304] 0 2024-05-09T06:29:37.051 INFO:tasks.workunit.client.1.smithi079.stdout:4/684: truncate d6/d1a/d26/d2a/d54/d9e/dd5/df/f3b 313662 0 2024-05-09T06:29:37.052 INFO:tasks.workunit.client.1.smithi079.stdout:4/685: fdatasync d6/d8/d55/fd2 0 2024-05-09T06:29:37.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/550: symlink d1/d56/lc5 0 2024-05-09T06:29:37.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/551: chown d1/d3/d20/d7f/d33/l94 185 1 2024-05-09T06:29:37.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/552: stat d1/d3/l9b 0 2024-05-09T06:29:37.057 INFO:tasks.workunit.client.1.smithi079.stdout:4/686: mkdir d6/d1a/d26/d2a/dde 0 2024-05-09T06:29:37.057 INFO:tasks.workunit.client.1.smithi079.stdout:4/687: stat d6/d1a/d26/f30 0 2024-05-09T06:29:37.059 INFO:tasks.workunit.client.1.smithi079.stdout:5/637: read d13/d43/d26/d35/f6d [202828,127491] 0 2024-05-09T06:29:37.059 INFO:tasks.workunit.client.1.smithi079.stdout:5/638: readlink d13/d4d/l79 0 2024-05-09T06:29:37.061 INFO:tasks.workunit.client.1.smithi079.stdout:5/639: creat d13/d43/d3d/d40/d63/da2/fd9 x:0 0 0 2024-05-09T06:29:37.063 INFO:tasks.workunit.client.1.smithi079.stdout:5/640: mknod d13/d43/d39/cda 0 2024-05-09T06:29:37.066 INFO:tasks.workunit.client.1.smithi079.stdout:5/641: truncate d13/d43/f36 1768977 0 2024-05-09T06:29:37.073 INFO:tasks.workunit.client.1.smithi079.stdout:3/653: dwrite d1a/d1d/d3a/d7c/f9d [0,4194304] 0 2024-05-09T06:29:37.073 INFO:tasks.workunit.client.1.smithi079.stdout:6/602: dwrite d0/de/f3a [0,4194304] 0 2024-05-09T06:29:37.074 INFO:tasks.workunit.client.1.smithi079.stdout:2/636: dwrite d8/db/dc/f56 [0,4194304] 0 2024-05-09T06:29:37.074 INFO:tasks.workunit.client.1.smithi079.stdout:2/637: fsync d8/db/d11/d5f/f75 0 2024-05-09T06:29:37.074 INFO:tasks.workunit.client.1.smithi079.stdout:1/516: dwrite d0/df/f24 [0,4194304] 0 2024-05-09T06:29:37.075 INFO:tasks.workunit.client.1.smithi079.stdout:8/553: dwrite d1/d56/d7c/d8f/fa8 [0,4194304] 0 2024-05-09T06:29:37.075 INFO:tasks.workunit.client.1.smithi079.stdout:8/554: write d1/d3/d20/f32 [3135656,55861] 0 2024-05-09T06:29:37.078 INFO:tasks.workunit.client.1.smithi079.stdout:5/642: dread d13/f21 [0,4194304] 0 2024-05-09T06:29:37.093 INFO:tasks.workunit.client.1.smithi079.stdout:1/517: mknod d0/d12/d48/d75/d43/d70/cb4 0 2024-05-09T06:29:37.102 INFO:tasks.workunit.client.1.smithi079.stdout:8/555: truncate d1/d3/f17 1626133 0 2024-05-09T06:29:37.104 INFO:tasks.workunit.client.1.smithi079.stdout:1/518: dread d0/d12/d16/f2f [0,4194304] 0 2024-05-09T06:29:37.104 INFO:tasks.workunit.client.1.smithi079.stdout:5/643: mkdir d13/d43/ddb 0 2024-05-09T06:29:37.106 INFO:tasks.workunit.client.1.smithi079.stdout:8/556: creat d1/d3/d20/d7f/dc3/d50/fc6 x:0 0 0 2024-05-09T06:29:37.107 INFO:tasks.workunit.client.1.smithi079.stdout:8/557: write d1/db/daf/f7e [261391,13498] 0 2024-05-09T06:29:37.107 INFO:tasks.workunit.client.1.smithi079.stdout:2/638: dwrite d8/fa [0,4194304] 0 2024-05-09T06:29:37.107 INFO:tasks.workunit.client.1.smithi079.stdout:2/639: dread - d8/fbd zero size 2024-05-09T06:29:37.108 INFO:tasks.workunit.client.1.smithi079.stdout:5/644: mkdir d13/ddc 0 2024-05-09T06:29:37.108 INFO:tasks.workunit.client.1.smithi079.stdout:5/645: getdents d13/d43/d39/d61/d72/dd7 0 2024-05-09T06:29:37.108 INFO:tasks.workunit.client.1.smithi079.stdout:5/646: readlink d13/d43/d3d/l46 0 2024-05-09T06:29:37.110 INFO:tasks.workunit.client.1.smithi079.stdout:8/558: link d1/db/fa9 d1/d3/d20/fc7 0 2024-05-09T06:29:37.113 INFO:tasks.workunit.client.1.smithi079.stdout:5/647: unlink d13/d43/d3d/d40/d53/cce 0 2024-05-09T06:29:37.115 INFO:tasks.workunit.client.1.smithi079.stdout:2/640: dread d8/db/dc/d2c/f31 [0,4194304] 0 2024-05-09T06:29:37.115 INFO:tasks.workunit.client.1.smithi079.stdout:2/641: write d8/db/d11/d5f/fae [906279,58710] 0 2024-05-09T06:29:37.116 INFO:tasks.workunit.client.1.smithi079.stdout:5/648: symlink d13/d4f/ldd 0 2024-05-09T06:29:37.119 INFO:tasks.workunit.client.1.smithi079.stdout:8/559: rename d1/d3/d20/d7f/d33/db5 to d1/d3/d20/d7f/dc3/d3b/dc8 0 2024-05-09T06:29:37.121 INFO:tasks.workunit.client.1.smithi079.stdout:2/642: mknod d8/db/d59/d67/d86/dd5/ce7 0 2024-05-09T06:29:37.121 INFO:tasks.workunit.client.1.smithi079.stdout:2/643: dread - d8/db/d59/d67/d86/fbf zero size 2024-05-09T06:29:37.121 INFO:tasks.workunit.client.1.smithi079.stdout:2/644: stat d8/db/d11/c21 0 2024-05-09T06:29:37.121 INFO:tasks.workunit.client.1.smithi079.stdout:2/645: write d8/f9 [1055750,93446] 0 2024-05-09T06:29:37.121 INFO:tasks.workunit.client.1.smithi079.stdout:2/646: creat d8/db/d59/d93/fe8 x:0 0 0 2024-05-09T06:29:37.126 INFO:tasks.workunit.client.1.smithi079.stdout:5/649: write d13/d43/f28 [715120,4304] 0 2024-05-09T06:29:37.126 INFO:tasks.workunit.client.1.smithi079.stdout:5/650: truncate d13/d43/d39/d61/d72/dbd/fd3 388581 0 2024-05-09T06:29:37.127 INFO:tasks.workunit.client.1.smithi079.stdout:5/651: chown d13/d2a/f7e 29384 1 2024-05-09T06:29:37.127 INFO:tasks.workunit.client.1.smithi079.stdout:0/532: sync 2024-05-09T06:29:37.137 INFO:tasks.workunit.client.1.smithi079.stdout:0/533: stat d3/dd/d18/d5e/d69/c7e 0 2024-05-09T06:29:37.143 INFO:tasks.workunit.client.1.smithi079.stdout:0/534: rename d3/dd/d96 to d3/dd/d66/d6d/da6 0 2024-05-09T06:29:37.146 INFO:tasks.workunit.client.1.smithi079.stdout:0/535: mkdir d3/dd/d66/d6d/d74/d80/d2d/da7 0 2024-05-09T06:29:37.148 INFO:tasks.workunit.client.1.smithi079.stdout:8/560: dwrite d1/d67/fba [0,4194304] 0 2024-05-09T06:29:37.148 INFO:tasks.workunit.client.1.smithi079.stdout:8/561: truncate d1/db/daf/f9d 471208 0 2024-05-09T06:29:37.148 INFO:tasks.workunit.client.1.smithi079.stdout:8/562: chown d1/d3/d20/d7f/dc3/d3b 1267919 1 2024-05-09T06:29:37.149 INFO:tasks.workunit.client.1.smithi079.stdout:0/536: creat d3/d5/d87/fa8 x:0 0 0 2024-05-09T06:29:37.150 INFO:tasks.workunit.client.1.smithi079.stdout:2/647: dwrite d8/db/d11/d5f/fbc [0,4194304] 0 2024-05-09T06:29:37.151 INFO:tasks.workunit.client.1.smithi079.stdout:5/652: dwrite d13/d43/d26/d35/fb9 [0,4194304] 0 2024-05-09T06:29:37.151 INFO:tasks.workunit.client.1.smithi079.stdout:5/653: chown d13/d43/d3d/l46 0 1 2024-05-09T06:29:37.158 INFO:tasks.workunit.client.1.smithi079.stdout:8/563: rename d1/d3/d20/d7f/dc3/d44/da2/dbb to d1/db/daf/d66/d6c/dbf/dc9 0 2024-05-09T06:29:37.158 INFO:tasks.workunit.client.1.smithi079.stdout:8/564: fdatasync d1/d3/d20/d7f/dc3/f9c 0 2024-05-09T06:29:37.165 INFO:tasks.workunit.client.1.smithi079.stdout:0/537: dwrite d3/dd/d66/d6d/d74/d80/f56 [4194304,4194304] 0 2024-05-09T06:29:37.165 INFO:tasks.workunit.client.1.smithi079.stdout:0/538: chown d3/dd/d1f/d1e/l59 2324 1 2024-05-09T06:29:37.165 INFO:tasks.workunit.client.1.smithi079.stdout:0/539: fsync d3/dd/d1f/d1e/d2c/d35/d36/f48 0 2024-05-09T06:29:37.166 INFO:tasks.workunit.client.1.smithi079.stdout:2/648: getdents d8/db/d59/d67/d7f/db9 0 2024-05-09T06:29:37.173 INFO:tasks.workunit.client.1.smithi079.stdout:5/654: creat d13/d43/d3d/d40/d63/fde x:0 0 0 2024-05-09T06:29:37.173 INFO:tasks.workunit.client.1.smithi079.stdout:5/655: creat d13/d43/d39/d61/d72/dbd/fdf x:0 0 0 2024-05-09T06:29:37.179 INFO:tasks.workunit.client.1.smithi079.stdout:2/649: dwrite d8/db/d59/d67/d7f/db9/dca/fe2 [0,4194304] 0 2024-05-09T06:29:37.179 INFO:tasks.workunit.client.1.smithi079.stdout:2/650: stat d8/db/caf 0 2024-05-09T06:29:37.182 INFO:tasks.workunit.client.1.smithi079.stdout:9/751: sync 2024-05-09T06:29:37.184 INFO:tasks.workunit.client.1.smithi079.stdout:8/565: mknod d1/d3/d20/d7f/d33/d5d/d6d/cca 0 2024-05-09T06:29:37.188 INFO:tasks.workunit.client.1.smithi079.stdout:2/651: write d8/db/dc/f9b [1459446,95139] 0 2024-05-09T06:29:37.189 INFO:tasks.workunit.client.1.smithi079.stdout:0/540: mknod d3/dd/d66/d6d/d74/d80/d2d/da7/ca9 0 2024-05-09T06:29:37.189 INFO:tasks.workunit.client.1.smithi079.stdout:0/541: truncate d3/dd/d66/d6d/d74/d80/d2d/f2e 4003160 0 2024-05-09T06:29:37.194 INFO:tasks.workunit.client.1.smithi079.stdout:8/566: dread d1/d3/f4 [0,4194304] 0 2024-05-09T06:29:37.194 INFO:tasks.workunit.client.1.smithi079.stdout:2/652: dread d8/db/dc/f8d [0,4194304] 0 2024-05-09T06:29:37.194 INFO:tasks.workunit.client.1.smithi079.stdout:5/656: truncate d13/d43/d39/f86 2029802 0 2024-05-09T06:29:37.201 INFO:tasks.workunit.client.1.smithi079.stdout:0/542: rmdir d3/dd/d1f/d1e/d2c/d7f 39 2024-05-09T06:29:37.203 INFO:tasks.workunit.client.1.smithi079.stdout:2/653: dread d8/db/d4b/d4f/f36 [0,4194304] 0 2024-05-09T06:29:37.203 INFO:tasks.workunit.client.1.smithi079.stdout:9/752: dwrite d1/d33/f87 [0,4194304] 0 2024-05-09T06:29:37.203 INFO:tasks.workunit.client.1.smithi079.stdout:2/654: chown d8/db/d11/d5f/cd4 6692247 1 2024-05-09T06:29:37.203 INFO:tasks.workunit.client.1.smithi079.stdout:9/753: fdatasync d1/d33/d28/d36/d4d/d7d/d19/f80 0 2024-05-09T06:29:37.204 INFO:tasks.workunit.client.1.smithi079.stdout:8/567: mknod d1/d3/d20/d7f/dc3/ccb 0 2024-05-09T06:29:37.204 INFO:tasks.workunit.client.1.smithi079.stdout:8/568: readlink d1/l2 0 2024-05-09T06:29:37.204 INFO:tasks.workunit.client.1.smithi079.stdout:8/569: creat d1/d67/fcc x:0 0 0 2024-05-09T06:29:37.206 INFO:tasks.workunit.client.1.smithi079.stdout:5/657: mknod d13/d4d/d77/ce0 0 2024-05-09T06:29:37.207 INFO:tasks.workunit.client.1.smithi079.stdout:0/543: dread d3/dd/d66/d6d/d74/d80/d2d/f2e [0,4194304] 0 2024-05-09T06:29:37.207 INFO:tasks.workunit.client.1.smithi079.stdout:0/544: write d3/dd/d66/d6d/d74/d80/f56 [1645260,55015] 0 2024-05-09T06:29:37.208 INFO:tasks.workunit.client.1.smithi079.stdout:2/655: dread d8/db/d4b/d4f/f90 [0,4194304] 0 2024-05-09T06:29:37.210 INFO:tasks.workunit.client.1.smithi079.stdout:9/754: symlink d1/d5/lfb 0 2024-05-09T06:29:37.212 INFO:tasks.workunit.client.1.smithi079.stdout:8/570: dread d1/d3/f84 [0,4194304] 0 2024-05-09T06:29:37.215 INFO:tasks.workunit.client.1.smithi079.stdout:5/658: mkdir d13/d43/d39/d61/d72/dbd/de1 0 2024-05-09T06:29:37.215 INFO:tasks.workunit.client.1.smithi079.stdout:5/659: truncate d13/d43/d39/da7/fd1 573248 0 2024-05-09T06:29:37.215 INFO:tasks.workunit.client.1.smithi079.stdout:5/660: write d13/d43/d39/f58 [1188242,101435] 0 2024-05-09T06:29:37.215 INFO:tasks.workunit.client.1.smithi079.stdout:0/545: dread d3/dd/d66/d6d/d74/d80/d2d/f4d [0,4194304] 0 2024-05-09T06:29:37.215 INFO:tasks.workunit.client.1.smithi079.stdout:0/546: read d3/dd/d66/d6d/d74/d80/d2d/f2e [1690798,102792] 0 2024-05-09T06:29:37.216 INFO:tasks.workunit.client.1.smithi079.stdout:2/656: mknod d8/db/d59/d67/d86/dd5/ce9 0 2024-05-09T06:29:37.219 INFO:tasks.workunit.client.1.smithi079.stdout:9/755: rename d1/d33/d28/d36/d4d/d51/l9b to d1/d33/d28/d36/dbe/lfc 0 2024-05-09T06:29:37.227 INFO:tasks.workunit.client.1.smithi079.stdout:5/661: rename d13/d43/d3d/d40/d63/c66 to d13/d43/d51/ce2 0 2024-05-09T06:29:37.231 INFO:tasks.workunit.client.1.smithi079.stdout:9/756: rename d1/d33/l4f to d1/d33/d2b/lfd 0 2024-05-09T06:29:37.232 INFO:tasks.workunit.client.1.smithi079.stdout:2/657: dwrite d8/db/dc/d2c/f33 [0,4194304] 0 2024-05-09T06:29:37.234 INFO:tasks.workunit.client.1.smithi079.stdout:9/757: mkdir d1/d33/d28/d36/d4d/d7d/dfe 0 2024-05-09T06:29:37.234 INFO:tasks.workunit.client.1.smithi079.stdout:9/758: fsync d1/d33/d28/d36/f67 0 2024-05-09T06:29:37.235 INFO:tasks.workunit.client.1.smithi079.stdout:5/662: link d13/f1e d13/d43/d26/dac/fe3 0 2024-05-09T06:29:37.238 INFO:tasks.workunit.client.1.smithi079.stdout:8/571: dwrite d1/d3/d20/d7f/dc3/d3b/fab [0,4194304] 0 2024-05-09T06:29:37.238 INFO:tasks.workunit.client.1.smithi079.stdout:8/572: chown d1/d3/d20/d7f/d33/db2 9 1 2024-05-09T06:29:37.241 INFO:tasks.workunit.client.1.smithi079.stdout:2/658: mknod d8/db/dc/cea 0 2024-05-09T06:29:37.241 INFO:tasks.workunit.client.1.smithi079.stdout:2/659: write d8/db/dc/f34 [2051977,106255] 0 2024-05-09T06:29:37.242 INFO:tasks.workunit.client.1.smithi079.stdout:5/663: mkdir d13/da5/de4 0 2024-05-09T06:29:37.244 INFO:tasks.workunit.client.1.smithi079.stdout:0/547: dwrite d3/dd/d1f/f28 [0,4194304] 0 2024-05-09T06:29:37.244 INFO:tasks.workunit.client.1.smithi079.stdout:5/664: dread d13/d43/d39/d61/f7d [0,4194304] 0 2024-05-09T06:29:37.245 INFO:tasks.workunit.client.1.smithi079.stdout:9/759: dread d1/d33/d28/d4c/d97/dd3/fe2 [0,4194304] 0 2024-05-09T06:29:37.245 INFO:tasks.workunit.client.1.smithi079.stdout:9/760: write d1/f3 [9661318,73851] 0 2024-05-09T06:29:37.245 INFO:tasks.workunit.client.1.smithi079.stdout:9/761: write d1/d33/d28/d36/d4d/d7d/fc4 [462891,110648] 0 2024-05-09T06:29:37.245 INFO:tasks.workunit.client.1.smithi079.stdout:9/762: chown d1/d45/dc6/dc9/f2e 681209721 1 2024-05-09T06:29:37.247 INFO:tasks.workunit.client.1.smithi079.stdout:8/573: symlink d1/d3/d20/d7f/dc3/d44/da4/lcd 0 2024-05-09T06:29:37.248 INFO:tasks.workunit.client.1.smithi079.stdout:9/763: write d1/d33/d28/fe8 [812974,22844] 0 2024-05-09T06:29:37.249 INFO:tasks.workunit.client.1.smithi079.stdout:9/764: truncate d1/d45/dc6/dc9/f4a 8517482 0 2024-05-09T06:29:37.252 INFO:tasks.workunit.client.1.smithi079.stdout:2/660: write d8/db/dc/d2c/f33 [1757002,80829] 0 2024-05-09T06:29:37.252 INFO:tasks.workunit.client.1.smithi079.stdout:5/665: dread d13/d43/f2f [0,4194304] 0 2024-05-09T06:29:37.262 INFO:tasks.workunit.client.1.smithi079.stdout:5/666: write d13/d43/d3d/f90 [428715,45020] 0 2024-05-09T06:29:37.266 INFO:tasks.workunit.client.1.smithi079.stdout:0/548: creat d3/faa x:0 0 0 2024-05-09T06:29:37.266 INFO:tasks.workunit.client.1.smithi079.stdout:0/549: write d3/dd/d1f/d1e/d2c/d35/f9b [869423,58376] 0 2024-05-09T06:29:37.268 INFO:tasks.workunit.client.1.smithi079.stdout:8/574: creat d1/db/daf/d66/fce x:0 0 0 2024-05-09T06:29:37.272 INFO:tasks.workunit.client.1.smithi079.stdout:2/661: getdents d8/db/d5c/d6b 0 2024-05-09T06:29:37.273 INFO:tasks.workunit.client.1.smithi079.stdout:9/765: dwrite d1/d5/d9a/f85 [4194304,4194304] 0 2024-05-09T06:29:37.277 INFO:tasks.workunit.client.1.smithi079.stdout:5/667: mknod d13/d43/d3d/d40/ce5 0 2024-05-09T06:29:37.281 INFO:tasks.workunit.client.1.smithi079.stdout:9/766: dread - d1/d45/dc6/dc9/da9/fdb zero size 2024-05-09T06:29:37.281 INFO:tasks.workunit.client.1.smithi079.stdout:2/662: dread d8/db/dc/f34 [0,4194304] 0 2024-05-09T06:29:37.283 INFO:tasks.workunit.client.1.smithi079.stdout:5/668: chown d13/d43/d26/l95 57659307 1 2024-05-09T06:29:37.283 INFO:tasks.workunit.client.1.smithi079.stdout:5/669: write d13/f1e [3263757,71813] 0 2024-05-09T06:29:37.283 INFO:tasks.workunit.client.1.smithi079.stdout:5/670: write d13/d43/f36 [1367427,101851] 0 2024-05-09T06:29:37.283 INFO:tasks.workunit.client.1.smithi079.stdout:5/671: creat d13/d43/d3d/d40/d63/fe6 x:0 0 0 2024-05-09T06:29:37.284 INFO:tasks.workunit.client.1.smithi079.stdout:8/575: getdents d1/d3/d20/d7f/d33/d5d/d6d 0 2024-05-09T06:29:37.285 INFO:tasks.workunit.client.1.smithi079.stdout:8/576: chown d1/db/f4f 1658 1 2024-05-09T06:29:37.286 INFO:tasks.workunit.client.1.smithi079.stdout:9/767: mknod d1/d33/d28/d36/dcd/de7/cff 0 2024-05-09T06:29:37.289 INFO:tasks.workunit.client.1.smithi079.stdout:0/550: dread d3/dd/d66/d6d/d74/d80/f32 [4194304,4194304] 0 2024-05-09T06:29:37.295 INFO:tasks.workunit.client.1.smithi079.stdout:5/672: creat d13/d43/d26/fe7 x:0 0 0 2024-05-09T06:29:37.296 INFO:tasks.workunit.client.1.smithi079.stdout:8/577: truncate d1/d3/d20/d7f/d33/d5d/d6d/f9a 790930 0 2024-05-09T06:29:37.297 INFO:tasks.workunit.client.1.smithi079.stdout:8/578: chown d1/d5/d36/dae 36354551 1 2024-05-09T06:29:37.297 INFO:tasks.workunit.client.1.smithi079.stdout:9/768: dread d1/f3 [0,4194304] 0 2024-05-09T06:29:37.299 INFO:tasks.workunit.client.1.smithi079.stdout:0/551: rename d3/dd/d1f/d1e/d2c/d35/d36/l3f to d3/dd/d66/d6d/d74/d84/lab 0 2024-05-09T06:29:37.299 INFO:tasks.workunit.client.1.smithi079.stdout:0/552: chown d3/dd/d1f/d1e/d2c/d35/d36/f4c 769 1 2024-05-09T06:29:37.301 INFO:tasks.workunit.client.1.smithi079.stdout:5/673: creat d13/d43/d3d/d40/d63/da2/d8b/fe8 x:0 0 0 2024-05-09T06:29:37.305 INFO:tasks.workunit.client.1.smithi079.stdout:8/579: dread d1/d5/f11 [0,4194304] 0 2024-05-09T06:29:37.305 INFO:tasks.workunit.client.1.smithi079.stdout:2/663: dwrite d8/db/d5c/fc6 [0,4194304] 0 2024-05-09T06:29:37.314 INFO:tasks.workunit.client.1.smithi079.stdout:2/664: dread d8/db/d4b/f85 [0,4194304] 0 2024-05-09T06:29:37.314 INFO:tasks.workunit.client.1.smithi079.stdout:2/665: stat d8/db/dc/f9b 0 2024-05-09T06:29:37.314 INFO:tasks.workunit.client.1.smithi079.stdout:8/580: creat d1/d56/d7c/fcf x:0 0 0 2024-05-09T06:29:37.317 INFO:tasks.workunit.client.1.smithi079.stdout:9/769: rename d1/d33/d28/d36/d4d/d51 to d1/d45/dc6/dc9/da9/d100 0 2024-05-09T06:29:37.318 INFO:tasks.workunit.client.1.smithi079.stdout:2/666: dread d8/db/dc/d2c/f33 [0,4194304] 0 2024-05-09T06:29:37.321 INFO:tasks.workunit.client.1.smithi079.stdout:5/674: write d13/d92/fa3 [1693786,125449] 0 2024-05-09T06:29:37.322 INFO:tasks.workunit.client.1.smithi079.stdout:2/667: mkdir d8/deb 0 2024-05-09T06:29:37.324 INFO:tasks.workunit.client.1.smithi079.stdout:8/581: link d1/d67/fba d1/d3/d20/d7f/dc3/d3b/fd0 0 2024-05-09T06:29:37.324 INFO:tasks.workunit.client.1.smithi079.stdout:8/582: fsync d1/db/f62 0 2024-05-09T06:29:37.330 INFO:tasks.workunit.client.1.smithi079.stdout:5/675: mkdir d13/d43/d3d/d40/d53/de9 0 2024-05-09T06:29:37.330 INFO:tasks.workunit.client.1.smithi079.stdout:9/770: mknod d1/d45/c101 0 2024-05-09T06:29:37.332 INFO:tasks.workunit.client.1.smithi079.stdout:2/668: rmdir d8/db/d4b/d4f/d51 39 2024-05-09T06:29:37.334 INFO:tasks.workunit.client.1.smithi079.stdout:9/771: creat d1/d33/d48/d64/f102 x:0 0 0 2024-05-09T06:29:37.334 INFO:tasks.workunit.client.1.smithi079.stdout:9/772: fdatasync d1/d33/d28/d36/dcd/de7/d75/fc3 0 2024-05-09T06:29:37.334 INFO:tasks.workunit.client.1.smithi079.stdout:2/669: read d8/db/d4b/d4f/f90 [768147,59300] 0 2024-05-09T06:29:37.334 INFO:tasks.workunit.client.1.smithi079.stdout:2/670: write d8/db/d59/d93/fe8 [658237,44210] 0 2024-05-09T06:29:37.336 INFO:tasks.workunit.client.1.smithi079.stdout:9/773: link d1/d33/d28/fe8 d1/d33/d28/d4c/f103 0 2024-05-09T06:29:37.338 INFO:tasks.workunit.client.1.smithi079.stdout:2/671: symlink d8/db/d5c/d6b/lec 0 2024-05-09T06:29:37.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/672: dread d8/db/d4b/d4f/d51/fa4 [0,4194304] 0 2024-05-09T06:29:37.339 INFO:tasks.workunit.client.1.smithi079.stdout:2/673: fsync d8/db/d4b/d4f/d51/fdc 0 2024-05-09T06:29:37.341 INFO:tasks.workunit.client.1.smithi079.stdout:2/674: dread d8/db/dc/f34 [0,4194304] 0 2024-05-09T06:29:37.341 INFO:tasks.workunit.client.1.smithi079.stdout:2/675: dread - d8/db/d4b/d4f/d51/fdc zero size 2024-05-09T06:29:37.343 INFO:tasks.workunit.client.1.smithi079.stdout:2/676: dread d8/db/d11/d79/d88/fd7 [0,4194304] 0 2024-05-09T06:29:37.344 INFO:tasks.workunit.client.1.smithi079.stdout:9/774: write d1/d33/d28/d36/d4d/d7d/d19/f1e [8016425,50421] 0 2024-05-09T06:29:37.344 INFO:tasks.workunit.client.1.smithi079.stdout:9/775: truncate d1/f17 692685 0 2024-05-09T06:29:37.346 INFO:tasks.workunit.client.1.smithi079.stdout:2/677: truncate d8/db/d11/d5f/f76 4105356 0 2024-05-09T06:29:37.348 INFO:tasks.workunit.client.1.smithi079.stdout:8/583: dwrite d1/d3/d20/d7f/dc3/f9c [0,4194304] 0 2024-05-09T06:29:37.351 INFO:tasks.workunit.client.1.smithi079.stdout:9/776: getdents d1/d33/d28/d36/d4d/d7d/df3 0 2024-05-09T06:29:37.351 INFO:tasks.workunit.client.1.smithi079.stdout:5/676: dwrite d13/d43/d26/f57 [0,4194304] 0 2024-05-09T06:29:37.354 INFO:tasks.workunit.client.1.smithi079.stdout:9/777: creat d1/d33/d2b/f104 x:0 0 0 2024-05-09T06:29:37.354 INFO:tasks.workunit.client.1.smithi079.stdout:9/778: fdatasync d1/f81 0 2024-05-09T06:29:37.379 INFO:tasks.workunit.client.1.smithi079.stdout:2/678: dwrite d8/db/d4b/d4f/d51/d6f/f7b [4194304,4194304] 0 2024-05-09T06:29:37.381 INFO:tasks.workunit.client.1.smithi079.stdout:2/679: symlink d8/db/d59/d67/d86/dd5/led 0 2024-05-09T06:29:37.384 INFO:tasks.workunit.client.1.smithi079.stdout:2/680: rmdir d8/db/d59/d93/dc7/dd9 39 2024-05-09T06:29:37.384 INFO:tasks.workunit.client.1.smithi079.stdout:2/681: dread - d8/db/d59/d93/fe6 zero size 2024-05-09T06:29:37.384 INFO:tasks.workunit.client.1.smithi079.stdout:2/682: write d8/db/dc/d2c/d2e/f54 [514148,100674] 0 2024-05-09T06:29:37.384 INFO:tasks.workunit.client.1.smithi079.stdout:2/683: creat d8/db/fee x:0 0 0 2024-05-09T06:29:37.384 INFO:tasks.workunit.client.1.smithi079.stdout:5/677: dwrite d13/d4f/f68 [0,4194304] 0 2024-05-09T06:29:37.384 INFO:tasks.workunit.client.1.smithi079.stdout:9/779: dwrite d1/d6/dae/fce [0,4194304] 0 2024-05-09T06:29:37.386 INFO:tasks.workunit.client.1.smithi079.stdout:8/584: dwrite d1/db/daf/d66/d6c/d6b/f98 [0,4194304] 0 2024-05-09T06:29:37.389 INFO:tasks.workunit.client.1.smithi079.stdout:2/684: rename d8/db/dc/lc0 to d8/db/dc/d2c/d2e/lef 0 2024-05-09T06:29:37.399 INFO:tasks.workunit.client.1.smithi079.stdout:3/654: sync 2024-05-09T06:29:37.399 INFO:tasks.workunit.client.1.smithi079.stdout:4/688: sync 2024-05-09T06:29:37.399 INFO:tasks.workunit.client.1.smithi079.stdout:1/519: sync 2024-05-09T06:29:37.399 INFO:tasks.workunit.client.1.smithi079.stdout:7/572: sync 2024-05-09T06:29:37.399 INFO:tasks.workunit.client.1.smithi079.stdout:6/603: sync 2024-05-09T06:29:37.403 INFO:tasks.workunit.client.1.smithi079.stdout:8/585: symlink d1/d67/ld1 0 2024-05-09T06:29:37.404 INFO:tasks.workunit.client.1.smithi079.stdout:6/604: dread d0/d6/d1b/f3d [0,4194304] 0 2024-05-09T06:29:37.404 INFO:tasks.workunit.client.1.smithi079.stdout:6/605: write d0/d6/d16/d1f/f23 [13480340,62740] 0 2024-05-09T06:29:37.406 INFO:tasks.workunit.client.1.smithi079.stdout:2/685: mknod d8/db/d59/d93/cf0 0 2024-05-09T06:29:37.407 INFO:tasks.workunit.client.1.smithi079.stdout:9/780: dwrite d1/d33/d28/d36/d4d/fa2 [0,4194304] 0 2024-05-09T06:29:37.408 INFO:tasks.workunit.client.1.smithi079.stdout:3/655: creat d1a/d21/fd0 x:0 0 0 2024-05-09T06:29:37.410 INFO:tasks.workunit.client.1.smithi079.stdout:5/678: dwrite d13/d4f/f68 [0,4194304] 0 2024-05-09T06:29:37.410 INFO:tasks.workunit.client.1.smithi079.stdout:5/679: chown d13/d43/f28 45 1 2024-05-09T06:29:37.412 INFO:tasks.workunit.client.1.smithi079.stdout:4/689: rename d6/d1a/d41/d68/da1/cd7 to d6/d8/d27/d3d/d5b/db4/dc3/cdf 0 2024-05-09T06:29:37.412 INFO:tasks.workunit.client.1.smithi079.stdout:4/690: chown d6/d8/d27/d3d/c43 3779 1 2024-05-09T06:29:37.412 INFO:tasks.workunit.client.1.smithi079.stdout:4/691: chown d6/d8/d55/fd2 678937951 1 2024-05-09T06:29:37.415 INFO:tasks.workunit.client.1.smithi079.stdout:1/520: mknod d0/d12/d48/cb5 0 2024-05-09T06:29:37.415 INFO:tasks.workunit.client.1.smithi079.stdout:2/686: dread d8/db/d11/f2f [0,4194304] 0 2024-05-09T06:29:37.416 INFO:tasks.workunit.client.1.smithi079.stdout:6/606: mkdir d0/d6/d16/dcd 0 2024-05-09T06:29:37.420 INFO:tasks.workunit.client.1.smithi079.stdout:9/781: symlink d1/d33/d28/d4c/l105 0 2024-05-09T06:29:37.421 INFO:tasks.workunit.client.1.smithi079.stdout:9/782: write d1/f17 [211223,24730] 0 2024-05-09T06:29:37.422 INFO:tasks.workunit.client.1.smithi079.stdout:3/656: mkdir d1a/d1c/d1f/d76/dc5/dd1 0 2024-05-09T06:29:37.423 INFO:tasks.workunit.client.1.smithi079.stdout:3/657: readlink d1a/la6 0 2024-05-09T06:29:37.423 INFO:tasks.workunit.client.1.smithi079.stdout:3/658: chown d1a/d1d/d34/d42 4108829 1 2024-05-09T06:29:37.423 INFO:tasks.workunit.client.1.smithi079.stdout:3/659: chown d1a/d1c/d1f/d76 6 1 2024-05-09T06:29:37.425 INFO:tasks.workunit.client.1.smithi079.stdout:7/573: dwrite d4/d7/d22/d28/d50/f9f [0,4194304] 0 2024-05-09T06:29:37.427 INFO:tasks.workunit.client.1.smithi079.stdout:5/680: mkdir d13/d43/dea 0 2024-05-09T06:29:37.428 INFO:tasks.workunit.client.1.smithi079.stdout:4/692: read d6/d1a/d26/d2a/d54/d9e/dd5/f4e [7811413,103615] 0 2024-05-09T06:29:37.432 INFO:tasks.workunit.client.1.smithi079.stdout:8/586: dwrite d1/db/fa9 [0,4194304] 0 2024-05-09T06:29:37.433 INFO:tasks.workunit.client.1.smithi079.stdout:4/693: dread d6/d1a/f75 [0,4194304] 0 2024-05-09T06:29:37.434 INFO:tasks.workunit.client.1.smithi079.stdout:4/694: truncate d6/d1a/d26/d2a/d54/d9e/fc0 913933 0 2024-05-09T06:29:37.434 INFO:tasks.workunit.client.1.smithi079.stdout:4/695: stat d6/d1a/d41/d68/da1/dbe 0 2024-05-09T06:29:37.445 INFO:tasks.workunit.client.1.smithi079.stdout:2/687: mkdir d8/db/d59/d67/d7f/db9/de1/df1 0 2024-05-09T06:29:37.450 INFO:tasks.workunit.client.1.smithi079.stdout:7/574: truncate d4/d7/dd/f16 9253 0 2024-05-09T06:29:37.451 INFO:tasks.workunit.client.1.smithi079.stdout:7/575: write d4/d7/dd/d5b/d31/f75 [633933,101545] 0 2024-05-09T06:29:37.453 INFO:tasks.workunit.client.1.smithi079.stdout:5/681: mkdir d13/d92/dcd/deb 0 2024-05-09T06:29:37.453 INFO:tasks.workunit.client.1.smithi079.stdout:5/682: write f11 [15510,39756] 0 2024-05-09T06:29:37.453 INFO:tasks.workunit.client.1.smithi079.stdout:5/683: readlink d13/d2a/l65 0 2024-05-09T06:29:37.453 INFO:tasks.workunit.client.1.smithi079.stdout:5/684: fsync d13/d43/d3d/d40/d63/fe6 0 2024-05-09T06:29:37.454 INFO:tasks.workunit.client.1.smithi079.stdout:6/607: dwrite d0/d6/d1b/fb4 [0,4194304] 0 2024-05-09T06:29:37.454 INFO:tasks.workunit.client.1.smithi079.stdout:9/783: dwrite d1/d45/dc6/dc9/da9/d100/fe5 [4194304,4194304] 0 2024-05-09T06:29:37.456 INFO:tasks.workunit.client.1.smithi079.stdout:4/696: symlink d6/d1a/d26/d2a/d54/dc8/le0 0 2024-05-09T06:29:37.457 INFO:tasks.workunit.client.1.smithi079.stdout:4/697: dread d6/d8/d55/fd2 [0,4194304] 0 2024-05-09T06:29:37.457 INFO:tasks.workunit.client.1.smithi079.stdout:4/698: chown d6/d8/l93 40618581 1 2024-05-09T06:29:37.459 INFO:tasks.workunit.client.1.smithi079.stdout:2/688: creat d8/db/dc/d2c/ff2 x:0 0 0 2024-05-09T06:29:37.459 INFO:tasks.workunit.client.1.smithi079.stdout:2/689: write d8/db/d11/f55 [896142,20081] 0 2024-05-09T06:29:37.462 INFO:tasks.workunit.client.1.smithi079.stdout:7/576: creat d4/d7/dd/d88/fb5 x:0 0 0 2024-05-09T06:29:37.476 INFO:tasks.workunit.client.1.smithi079.stdout:1/521: rename d0/d6e to d0/d12/d67/db6 0 2024-05-09T06:29:37.477 INFO:tasks.workunit.client.1.smithi079.stdout:1/522: dread d0/d12/d48/d75/d43/d20/d39/f78 [0,4194304] 0 2024-05-09T06:29:37.477 INFO:tasks.workunit.client.1.smithi079.stdout:1/523: creat d0/d7/d4e/d7d/fb7 x:0 0 0 2024-05-09T06:29:37.478 INFO:tasks.workunit.client.1.smithi079.stdout:9/784: getdents d1/d33/d2b 0 2024-05-09T06:29:37.478 INFO:tasks.workunit.client.1.smithi079.stdout:9/785: fsync d1/d45/dc6/dc9/f4a 0 2024-05-09T06:29:37.478 INFO:tasks.workunit.client.1.smithi079.stdout:9/786: chown d1/d45/dab/laf 273 1 2024-05-09T06:29:37.479 INFO:tasks.workunit.client.1.smithi079.stdout:4/699: rmdir d6/d8/d80/da6 39 2024-05-09T06:29:37.479 INFO:tasks.workunit.client.1.smithi079.stdout:4/700: chown d6/d1a/d41/l5d 387127470 1 2024-05-09T06:29:37.480 INFO:tasks.workunit.client.1.smithi079.stdout:9/787: dread d1/d45/f90 [0,4194304] 0 2024-05-09T06:29:37.482 INFO:tasks.workunit.client.1.smithi079.stdout:7/577: dwrite d4/d7/dd/d5b/f44 [0,4194304] 0 2024-05-09T06:29:37.482 INFO:tasks.workunit.client.1.smithi079.stdout:3/660: rename f13 to d1a/d1d/d3a/d54/fd2 0 2024-05-09T06:29:37.483 INFO:tasks.workunit.client.1.smithi079.stdout:2/690: dwrite d8/db/d11/d5f/f76 [4194304,4194304] 0 2024-05-09T06:29:37.484 INFO:tasks.workunit.client.1.smithi079.stdout:2/691: chown d8/db/d4b/d4f/d51/d6f/f73 228 1 2024-05-09T06:29:37.485 INFO:tasks.workunit.client.1.smithi079.stdout:1/524: getdents d0/d12/d67/db6 0 2024-05-09T06:29:37.488 INFO:tasks.workunit.client.1.smithi079.stdout:7/578: truncate d4/d7/d22/f2a 941754 0 2024-05-09T06:29:37.490 INFO:tasks.workunit.client.1.smithi079.stdout:5/685: rename d13/f1e to d13/d43/ddb/fec 0 2024-05-09T06:29:37.493 INFO:tasks.workunit.client.1.smithi079.stdout:9/788: dread d1/d33/d2b/fac [0,4194304] 0 2024-05-09T06:29:37.494 INFO:tasks.workunit.client.1.smithi079.stdout:2/692: mknod d8/db/d59/d67/d7f/dac/cf3 0 2024-05-09T06:29:37.500 INFO:tasks.workunit.client.1.smithi079.stdout:7/579: mkdir d4/d7/d22/d28/d50/d5c/d85/db6 0 2024-05-09T06:29:37.504 INFO:tasks.workunit.client.1.smithi079.stdout:6/608: rename d0/d6/d16/da5 to d0/d6/d16/dcd/dce 0 2024-05-09T06:29:37.504 INFO:tasks.workunit.client.1.smithi079.stdout:6/609: dread - d0/d60/fb9 zero size 2024-05-09T06:29:37.504 INFO:tasks.workunit.client.1.smithi079.stdout:9/789: write d1/f81 [1066566,88110] 0 2024-05-09T06:29:37.506 INFO:tasks.workunit.client.1.smithi079.stdout:2/693: link d8/l38 d8/lf4 0 2024-05-09T06:29:37.507 INFO:tasks.workunit.client.1.smithi079.stdout:3/661: dwrite d1a/d21/fbc [0,4194304] 0 2024-05-09T06:29:37.508 INFO:tasks.workunit.client.1.smithi079.stdout:7/580: mknod d4/d7/dd/d5b/d31/d34/cb7 0 2024-05-09T06:29:37.510 INFO:tasks.workunit.client.1.smithi079.stdout:6/610: symlink d0/d60/lcf 0 2024-05-09T06:29:37.514 INFO:tasks.workunit.client.1.smithi079.stdout:2/694: truncate d8/d3c/f80 791799 0 2024-05-09T06:29:37.515 INFO:tasks.workunit.client.1.smithi079.stdout:5/686: dwrite d13/d43/d3d/fc5 [0,4194304] 0 2024-05-09T06:29:37.520 INFO:tasks.workunit.client.1.smithi079.stdout:1/525: dwrite d0/df/f14 [0,4194304] 0 2024-05-09T06:29:37.520 INFO:tasks.workunit.client.1.smithi079.stdout:3/662: creat d1a/d1d/d3a/fd3 x:0 0 0 2024-05-09T06:29:37.520 INFO:tasks.workunit.client.1.smithi079.stdout:7/581: dread d4/d7/f13 [0,4194304] 0 2024-05-09T06:29:37.520 INFO:tasks.workunit.client.1.smithi079.stdout:7/582: write d4/d7/d37/f68 [954079,25240] 0 2024-05-09T06:29:37.521 INFO:tasks.workunit.client.1.smithi079.stdout:1/526: read d0/d12/d48/d75/f54 [1369463,126861] 0 2024-05-09T06:29:37.523 INFO:tasks.workunit.client.1.smithi079.stdout:9/790: dwrite d1/d33/d28/d36/dcd/de7/d75/f77 [0,4194304] 0 2024-05-09T06:29:37.523 INFO:tasks.workunit.client.1.smithi079.stdout:2/695: creat d8/db/d59/d67/d7f/db9/de1/df1/ff5 x:0 0 0 2024-05-09T06:29:37.525 INFO:tasks.workunit.client.1.smithi079.stdout:5/687: creat d13/d43/d51/dc9/fed x:0 0 0 2024-05-09T06:29:37.527 INFO:tasks.workunit.client.1.smithi079.stdout:3/663: unlink d1a/d1c/d1f/d76/l8b 0 2024-05-09T06:29:37.528 INFO:tasks.workunit.client.1.smithi079.stdout:3/664: fsync d1a/d21/fd0 0 2024-05-09T06:29:37.530 INFO:tasks.workunit.client.1.smithi079.stdout:7/583: rename d4/d9e/laf to d4/d7/d22/lb8 0 2024-05-09T06:29:37.531 INFO:tasks.workunit.client.1.smithi079.stdout:7/584: fdatasync d4/d7/d22/d28/d50/fb2 0 2024-05-09T06:29:37.534 INFO:tasks.workunit.client.1.smithi079.stdout:1/527: mkdir d0/df/db8 0 2024-05-09T06:29:37.538 INFO:tasks.workunit.client.1.smithi079.stdout:6/611: rmdir d0/d6/d16/d1f/d6f/d8c/d93 39 2024-05-09T06:29:37.538 INFO:tasks.workunit.client.1.smithi079.stdout:6/612: creat d0/d60/fd0 x:0 0 0 2024-05-09T06:29:37.538 INFO:tasks.workunit.client.1.smithi079.stdout:6/613: fsync d0/d6/d1b/fae 0 2024-05-09T06:29:37.540 INFO:tasks.workunit.client.1.smithi079.stdout:9/791: symlink d1/d33/d28/d36/dcd/l106 0 2024-05-09T06:29:37.540 INFO:tasks.workunit.client.1.smithi079.stdout:9/792: dread - d1/d33/d28/d36/dcd/de7/d75/fc7 zero size 2024-05-09T06:29:37.543 INFO:tasks.workunit.client.1.smithi079.stdout:2/696: mkdir d8/db/d59/d93/dc7/df6 0 2024-05-09T06:29:37.543 INFO:tasks.workunit.client.1.smithi079.stdout:2/697: readlink d8/db/dc/d2c/d2e/lef 0 2024-05-09T06:29:37.543 INFO:tasks.workunit.client.1.smithi079.stdout:2/698: write d8/db/dc/f9b [4723405,104002] 0 2024-05-09T06:29:37.543 INFO:tasks.workunit.client.1.smithi079.stdout:2/699: write d8/db/d4b/f68 [1171959,34315] 0 2024-05-09T06:29:37.543 INFO:tasks.workunit.client.1.smithi079.stdout:6/614: read d0/f8b [1422293,128456] 0 2024-05-09T06:29:37.544 INFO:tasks.workunit.client.1.smithi079.stdout:5/688: stat d13/d43/c2d 0 2024-05-09T06:29:37.544 INFO:tasks.workunit.client.1.smithi079.stdout:5/689: dread - d13/d43/d51/dc9/fed zero size 2024-05-09T06:29:37.545 INFO:tasks.workunit.client.1.smithi079.stdout:3/665: unlink d1a/d21/f69 0 2024-05-09T06:29:37.545 INFO:tasks.workunit.client.1.smithi079.stdout:3/666: stat d1a/la6 0 2024-05-09T06:29:37.547 INFO:tasks.workunit.client.1.smithi079.stdout:7/585: mkdir d4/d7/dd/d5b/d6f/db9 0 2024-05-09T06:29:37.550 INFO:tasks.workunit.client.1.smithi079.stdout:5/690: dread d13/d4f/f68 [0,4194304] 0 2024-05-09T06:29:37.558 INFO:tasks.workunit.client.1.smithi079.stdout:1/528: creat d0/d12/d67/db6/d8a/fb9 x:0 0 0 2024-05-09T06:29:37.561 INFO:tasks.workunit.client.1.smithi079.stdout:9/793: mknod d1/d33/d48/dbf/c107 0 2024-05-09T06:29:37.565 INFO:tasks.workunit.client.1.smithi079.stdout:6/615: link d0/c99 d0/da2/cd1 0 2024-05-09T06:29:37.567 INFO:tasks.workunit.client.1.smithi079.stdout:3/667: truncate d1a/d21/f39 737860 0 2024-05-09T06:29:37.567 INFO:tasks.workunit.client.1.smithi079.stdout:3/668: chown d1a/d1c/la7 773 1 2024-05-09T06:29:37.568 INFO:tasks.workunit.client.1.smithi079.stdout:7/586: symlink d4/d7/d22/d28/d50/d5c/d84/lba 0 2024-05-09T06:29:37.571 INFO:tasks.workunit.client.1.smithi079.stdout:5/691: symlink d13/d43/d39/lee 0 2024-05-09T06:29:37.571 INFO:tasks.workunit.client.1.smithi079.stdout:5/692: stat d13/d43/d51/dc9/fed 0 2024-05-09T06:29:37.571 INFO:tasks.workunit.client.1.smithi079.stdout:5/693: write d13/f99 [765624,20444] 0 2024-05-09T06:29:37.573 INFO:tasks.workunit.client.1.smithi079.stdout:1/529: mkdir d0/df/db8/dba 0 2024-05-09T06:29:37.573 INFO:tasks.workunit.client.1.smithi079.stdout:1/530: creat d0/d12/d67/d53/d6d/fbb x:0 0 0 2024-05-09T06:29:37.573 INFO:tasks.workunit.client.1.smithi079.stdout:1/531: stat d0/d12/d48/d75/d43/f77 0 2024-05-09T06:29:37.575 INFO:tasks.workunit.client.1.smithi079.stdout:9/794: mknod d1/d33/d28/d36/d4d/d7d/dfe/c108 0 2024-05-09T06:29:37.575 INFO:tasks.workunit.client.1.smithi079.stdout:9/795: chown d1/d33/d28/d36/d4d/d7d 121 1 2024-05-09T06:29:37.579 INFO:tasks.workunit.client.1.smithi079.stdout:5/694: truncate d13/d43/d26/d35/f56 52876 0 2024-05-09T06:29:37.580 INFO:tasks.workunit.client.1.smithi079.stdout:6/616: dwrite d0/d6/f76 [0,4194304] 0 2024-05-09T06:29:37.586 INFO:tasks.workunit.client.1.smithi079.stdout:1/532: symlink d0/d7/d4e/d7d/d94/lbc 0 2024-05-09T06:29:37.588 INFO:tasks.workunit.client.1.smithi079.stdout:9/796: mknod d1/d45/dc6/dc9/da9/c109 0 2024-05-09T06:29:37.590 INFO:tasks.workunit.client.1.smithi079.stdout:2/700: rename d8/d3c to d8/df7 0 2024-05-09T06:29:37.604 INFO:tasks.workunit.client.1.smithi079.stdout:9/797: dwrite d1/d33/f87 [0,4194304] 0 2024-05-09T06:29:37.607 INFO:tasks.workunit.client.1.smithi079.stdout:6/617: symlink d0/da2/ld2 0 2024-05-09T06:29:37.607 INFO:tasks.workunit.client.1.smithi079.stdout:6/618: dread - d0/d6/d1b/fa0 zero size 2024-05-09T06:29:37.611 INFO:tasks.workunit.client.1.smithi079.stdout:1/533: mkdir d0/d12/d48/d75/d43/dbd 0 2024-05-09T06:29:37.611 INFO:tasks.workunit.client.1.smithi079.stdout:1/534: fdatasync d0/d12/d67/d53/d6d/fbb 0 2024-05-09T06:29:37.611 INFO:tasks.workunit.client.1.smithi079.stdout:1/535: fsync d0/d12/d48/d75/f54 0 2024-05-09T06:29:37.611 INFO:tasks.workunit.client.1.smithi079.stdout:1/536: creat d0/d12/d92/fbe x:0 0 0 2024-05-09T06:29:37.611 INFO:tasks.workunit.client.1.smithi079.stdout:1/537: chown d0/d12/f8b 258972 1 2024-05-09T06:29:37.611 INFO:tasks.workunit.client.1.smithi079.stdout:1/538: truncate d0/df/f8f 617 0 2024-05-09T06:29:37.613 INFO:tasks.workunit.client.1.smithi079.stdout:2/701: mkdir d8/db/d59/d93/dc7/df8 0 2024-05-09T06:29:37.614 INFO:tasks.workunit.client.1.smithi079.stdout:2/702: readlink d8/db/d59/d67/d86/dd5/le4 0 2024-05-09T06:29:37.614 INFO:tasks.workunit.client.1.smithi079.stdout:2/703: fsync d8/db/d11/d79/d88/fd7 0 2024-05-09T06:29:37.614 INFO:tasks.workunit.client.1.smithi079.stdout:2/704: write d8/db/d11/d5f/f64 [2241479,44388] 0 2024-05-09T06:29:37.614 INFO:tasks.workunit.client.1.smithi079.stdout:2/705: fsync d8/fbd 0 2024-05-09T06:29:37.616 INFO:tasks.workunit.client.1.smithi079.stdout:3/669: rename d1a/d1d to d1a/d21/db0/dd4 0 2024-05-09T06:29:37.616 INFO:tasks.workunit.client.1.smithi079.stdout:3/670: fdatasync d1a/d1c/fa2 0 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:9/798: dwrite d1/d33/d28/d36/d4d/d7d/d19/fa6 [0,4194304] 0 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/619: rmdir d0/d6 39 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/620: dread - d0/d6/d16/d1f/d6f/f77 zero size 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/621: fsync d0/d6/d16/d1f/f23 0 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/622: stat d0/d6/d1b/f3d 0 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/623: chown d0/de/c4f 409 1 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/624: dread - d0/d6/d1b/fa0 zero size 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/625: truncate d0/d60/fd0 531898 0 2024-05-09T06:29:37.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/626: dread - d0/d6/d16/d1f/d36/d69/d84/f91 zero size 2024-05-09T06:29:37.623 INFO:tasks.workunit.client.1.smithi079.stdout:1/539: unlink d0/d12/d48/d75/d43/d20/d39/f42 0 2024-05-09T06:29:37.629 INFO:tasks.workunit.client.1.smithi079.stdout:2/706: creat d8/db/d4b/d4f/ff9 x:0 0 0 2024-05-09T06:29:37.629 INFO:tasks.workunit.client.1.smithi079.stdout:2/707: chown d8/db/d5c/d6b/db5/ccd 42004 1 2024-05-09T06:29:37.634 INFO:tasks.workunit.client.1.smithi079.stdout:5/695: rename d13/d2a/f7e to d13/d43/d9e/fef 0 2024-05-09T06:29:37.639 INFO:tasks.workunit.client.1.smithi079.stdout:9/799: symlink d1/d45/dc6/dc9/da9/d100/l10a 0 2024-05-09T06:29:37.641 INFO:tasks.workunit.client.1.smithi079.stdout:2/708: mkdir d8/db/d59/d93/dc7/df8/dfa 0 2024-05-09T06:29:37.643 INFO:tasks.workunit.client.1.smithi079.stdout:5/696: mknod d13/d43/d3d/d40/d63/cf0 0 2024-05-09T06:29:37.643 INFO:tasks.workunit.client.1.smithi079.stdout:5/697: truncate d13/d43/d3d/d40/d63/fe6 421954 0 2024-05-09T06:29:37.643 INFO:tasks.workunit.client.1.smithi079.stdout:5/698: write d13/d43/d26/d35/f56 [828681,20661] 0 2024-05-09T06:29:37.645 INFO:tasks.workunit.client.1.smithi079.stdout:6/627: dwrite d0/f15 [0,4194304] 0 2024-05-09T06:29:37.645 INFO:tasks.workunit.client.1.smithi079.stdout:6/628: chown d0/d6/d16/d28/f58 30 1 2024-05-09T06:29:37.645 INFO:tasks.workunit.client.1.smithi079.stdout:1/540: dwrite d0/d12/d48/d75/d43/f47 [0,4194304] 0 2024-05-09T06:29:37.648 INFO:tasks.workunit.client.1.smithi079.stdout:2/709: creat d8/db/d5c/d6b/ffb x:0 0 0 2024-05-09T06:29:37.653 INFO:tasks.workunit.client.1.smithi079.stdout:6/629: symlink d0/d6/d1b/d20/ld3 0 2024-05-09T06:29:37.653 INFO:tasks.workunit.client.1.smithi079.stdout:6/630: fsync d0/f15 0 2024-05-09T06:29:37.653 INFO:tasks.workunit.client.1.smithi079.stdout:6/631: readlink d0/d6/d1b/d20/ld3 0 2024-05-09T06:29:37.657 INFO:tasks.workunit.client.1.smithi079.stdout:5/699: read d13/d43/d26/d35/f5e [639545,69305] 0 2024-05-09T06:29:37.657 INFO:tasks.workunit.client.1.smithi079.stdout:5/700: write d13/d43/d26/fe7 [639537,37051] 0 2024-05-09T06:29:37.657 INFO:tasks.workunit.client.1.smithi079.stdout:5/701: read d13/d92/fa3 [3709580,105385] 0 2024-05-09T06:29:37.658 INFO:tasks.workunit.client.1.smithi079.stdout:1/541: getdents d0/d12/d67 0 2024-05-09T06:29:37.660 INFO:tasks.workunit.client.1.smithi079.stdout:2/710: rename d8/db/d11/d5f/cd4 to d8/df7/cfc 0 2024-05-09T06:29:37.662 INFO:tasks.workunit.client.1.smithi079.stdout:6/632: write d0/d6/d1b/d20/fa6 [3225457,55358] 0 2024-05-09T06:29:37.662 INFO:tasks.workunit.client.1.smithi079.stdout:9/800: dwrite d1/d33/d28/d36/db5/fe4 [0,4194304] 0 2024-05-09T06:29:37.664 INFO:tasks.workunit.client.1.smithi079.stdout:1/542: mkdir d0/d12/d67/d53/dbf 0 2024-05-09T06:29:37.664 INFO:tasks.workunit.client.1.smithi079.stdout:1/543: readlink d0/l87 0 2024-05-09T06:29:37.664 INFO:tasks.workunit.client.1.smithi079.stdout:1/544: chown d0/d12/d48/d75/d43/d20/f98 71537 1 2024-05-09T06:29:37.667 INFO:tasks.workunit.client.1.smithi079.stdout:6/633: creat d0/d6/d1b/fd4 x:0 0 0 2024-05-09T06:29:37.670 INFO:tasks.workunit.client.1.smithi079.stdout:3/671: getdents d1a/d21/db0 0 2024-05-09T06:29:37.671 INFO:tasks.workunit.client.1.smithi079.stdout:3/672: chown d1a/d21/db0/dd4/d3a/d54/lb6 16 1 2024-05-09T06:29:37.671 INFO:tasks.workunit.client.1.smithi079.stdout:3/673: fdatasync d1a/d21/db0/dd4/d3a/f91 0 2024-05-09T06:29:37.676 INFO:tasks.workunit.client.1.smithi079.stdout:3/674: dread d1a/d1c/d1f/f75 [0,4194304] 0 2024-05-09T06:29:37.687 INFO:tasks.workunit.client.1.smithi079.stdout:9/801: link d1/d45/dc6/dc9/d2d/d99/dd5/d3a/f57 d1/d5/d9a/f10b 0 2024-05-09T06:29:37.688 INFO:tasks.workunit.client.1.smithi079.stdout:5/702: rmdir d13/d43/d3d/d40/d63/da2/d8b 39 2024-05-09T06:29:37.688 INFO:tasks.workunit.client.1.smithi079.stdout:5/703: readlink d13/d43/l31 0 2024-05-09T06:29:37.688 INFO:tasks.workunit.client.1.smithi079.stdout:5/704: fsync d13/d43/d3d/f85 0 2024-05-09T06:29:37.690 INFO:tasks.workunit.client.1.smithi079.stdout:1/545: mkdir d0/d12/dc0 0 2024-05-09T06:29:37.692 INFO:tasks.workunit.client.1.smithi079.stdout:6/634: mkdir d0/d6/d16/d1f/d36/d69/dad/dd5 0 2024-05-09T06:29:37.692 INFO:tasks.workunit.client.1.smithi079.stdout:6/635: read d0/d6/d16/d1f/f49 [853734,31999] 0 2024-05-09T06:29:37.693 INFO:tasks.workunit.client.1.smithi079.stdout:3/675: creat d1a/d21/db0/fd5 x:0 0 0 2024-05-09T06:29:37.696 INFO:tasks.workunit.client.1.smithi079.stdout:9/802: symlink d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/dd7/l10c 0 2024-05-09T06:29:37.698 INFO:tasks.workunit.client.1.smithi079.stdout:5/705: rename d13/d43/d3d/f90 to d13/d43/d26/d35/ff1 0 2024-05-09T06:29:37.700 INFO:tasks.workunit.client.1.smithi079.stdout:1/546: symlink d0/d12/d48/d75/lc1 0 2024-05-09T06:29:37.700 INFO:tasks.workunit.client.1.smithi079.stdout:1/547: write d0/d7/d4e/d7d/fb7 [841196,33073] 0 2024-05-09T06:29:37.702 INFO:tasks.workunit.client.1.smithi079.stdout:6/636: symlink d0/d6/d16/dcd/dce/ld6 0 2024-05-09T06:29:37.702 INFO:tasks.workunit.client.1.smithi079.stdout:6/637: fsync d0/d6/d5e/f71 0 2024-05-09T06:29:37.703 INFO:tasks.workunit.client.1.smithi079.stdout:9/803: creat d1/d5/d9a/f10d x:0 0 0 2024-05-09T06:29:37.707 INFO:tasks.workunit.client.1.smithi079.stdout:5/706: rename d13/c15 to d13/d43/d39/d61/cf2 0 2024-05-09T06:29:37.707 INFO:tasks.workunit.client.1.smithi079.stdout:5/707: read d13/d43/f28 [2794204,36784] 0 2024-05-09T06:29:37.707 INFO:tasks.workunit.client.1.smithi079.stdout:1/548: write d0/df/f14 [3455697,10990] 0 2024-05-09T06:29:37.707 INFO:tasks.workunit.client.1.smithi079.stdout:1/549: chown d0/d12/d48/d75/l99 5 1 2024-05-09T06:29:37.709 INFO:tasks.workunit.client.1.smithi079.stdout:6/638: mkdir d0/d6/d16/dcd/dd7 0 2024-05-09T06:29:37.709 INFO:tasks.workunit.client.1.smithi079.stdout:6/639: getdents d0/d6/d16/d1f/d36/db5 0 2024-05-09T06:29:37.709 INFO:tasks.workunit.client.1.smithi079.stdout:6/640: dread - d0/d6/d1b/d2d/f4e zero size 2024-05-09T06:29:37.712 INFO:tasks.workunit.client.1.smithi079.stdout:5/708: truncate d13/d2a/f2b 505485 0 2024-05-09T06:29:37.714 INFO:tasks.workunit.client.1.smithi079.stdout:1/550: creat d0/df/fc2 x:0 0 0 2024-05-09T06:29:37.715 INFO:tasks.workunit.client.1.smithi079.stdout:5/709: mknod d13/d92/dcd/dcf/cf3 0 2024-05-09T06:29:37.717 INFO:tasks.workunit.client.1.smithi079.stdout:5/710: mkdir d13/d43/d3d/d40/d63/da2/d8b/df4 0 2024-05-09T06:29:37.717 INFO:tasks.workunit.client.1.smithi079.stdout:6/641: write d0/d6/fa7 [4302858,4817] 0 2024-05-09T06:29:37.718 INFO:tasks.workunit.client.1.smithi079.stdout:6/642: creat d0/d60/daf/fd8 x:0 0 0 2024-05-09T06:29:37.718 INFO:tasks.workunit.client.1.smithi079.stdout:9/804: dread d1/d45/dc6/dc9/f54 [0,4194304] 0 2024-05-09T06:29:37.719 INFO:tasks.workunit.client.1.smithi079.stdout:0/553: sync 2024-05-09T06:29:37.723 INFO:tasks.workunit.client.1.smithi079.stdout:1/551: write d0/d12/d16/f84 [1114882,32462] 0 2024-05-09T06:29:37.726 INFO:tasks.workunit.client.1.smithi079.stdout:6/643: creat d0/d6/d16/d1f/d6f/fd9 x:0 0 0 2024-05-09T06:29:37.726 INFO:tasks.workunit.client.1.smithi079.stdout:6/644: write d0/d6/d1b/fd4 [841411,74800] 0 2024-05-09T06:29:37.727 INFO:tasks.workunit.client.1.smithi079.stdout:6/645: dread d0/d60/fd0 [0,4194304] 0 2024-05-09T06:29:37.729 INFO:tasks.workunit.client.1.smithi079.stdout:0/554: write d3/d5/d87/f94 [3578801,8668] 0 2024-05-09T06:29:37.729 INFO:tasks.workunit.client.1.smithi079.stdout:9/805: mkdir d1/d33/d28/d36/dcd/de7/d10e 0 2024-05-09T06:29:37.732 INFO:tasks.workunit.client.1.smithi079.stdout:5/711: getdents d13/d43/d3d/d40/d63 0 2024-05-09T06:29:37.739 INFO:tasks.workunit.client.1.smithi079.stdout:1/552: mkdir d0/d12/d67/db6/d8a/dc3 0 2024-05-09T06:29:37.739 INFO:tasks.workunit.client.1.smithi079.stdout:0/555: mkdir d3/dd/d66/d6d/da6/dac 0 2024-05-09T06:29:37.739 INFO:tasks.workunit.client.1.smithi079.stdout:9/806: dread d1/d33/d28/d36/db5/fe4 [0,4194304] 0 2024-05-09T06:29:37.739 INFO:tasks.workunit.client.1.smithi079.stdout:0/556: chown d3/d5/f3a 2233966 1 2024-05-09T06:29:37.739 INFO:tasks.workunit.client.1.smithi079.stdout:1/553: write d0/d12/d48/d75/f69 [1224521,47738] 0 2024-05-09T06:29:37.740 INFO:tasks.workunit.client.1.smithi079.stdout:0/557: fsync d3/dd/d1f/d1e/d2c/d35/f60 0 2024-05-09T06:29:37.740 INFO:tasks.workunit.client.1.smithi079.stdout:9/807: write d1/d33/d28/d36/d4d/d7d/f14 [2403822,30096] 0 2024-05-09T06:29:37.740 INFO:tasks.workunit.client.1.smithi079.stdout:0/558: write d3/d5/d87/fa8 [427590,129970] 0 2024-05-09T06:29:37.740 INFO:tasks.workunit.client.1.smithi079.stdout:0/559: fdatasync d3/dd/d18/f7a 0 2024-05-09T06:29:37.740 INFO:tasks.workunit.client.1.smithi079.stdout:0/560: creat d3/dd/d18/fad x:0 0 0 2024-05-09T06:29:37.740 INFO:tasks.workunit.client.1.smithi079.stdout:5/712: creat d13/d43/d26/d35/ff5 x:0 0 0 2024-05-09T06:29:37.740 INFO:tasks.workunit.client.1.smithi079.stdout:5/713: chown d13/d43/d26/d35/ff1 1781 1 2024-05-09T06:29:37.742 INFO:tasks.workunit.client.1.smithi079.stdout:1/554: link d0/d12/d67/d53/l6f d0/d12/d67/d53/d6d/lc4 0 2024-05-09T06:29:37.747 INFO:tasks.workunit.client.1.smithi079.stdout:9/808: symlink d1/d33/d28/d36/d4d/d7d/d19/dd9/l10f 0 2024-05-09T06:29:37.753 INFO:tasks.workunit.client.1.smithi079.stdout:0/561: unlink d3/dd/d1f/f29 0 2024-05-09T06:29:37.753 INFO:tasks.workunit.client.1.smithi079.stdout:6/646: dwrite d0/fc [0,4194304] 0 2024-05-09T06:29:37.754 INFO:tasks.workunit.client.1.smithi079.stdout:0/562: creat d3/dd/d66/d6d/fae x:0 0 0 2024-05-09T06:29:37.759 INFO:tasks.workunit.client.1.smithi079.stdout:1/555: creat d0/d12/d16/fc5 x:0 0 0 2024-05-09T06:29:37.771 INFO:tasks.workunit.client.1.smithi079.stdout:0/563: dwrite d3/dd/d66/d6d/d74/d84/fa3 [0,4194304] 0 2024-05-09T06:29:37.772 INFO:tasks.workunit.client.1.smithi079.stdout:0/564: write d3/dd/d1f/d1e/f2a [2409149,13303] 0 2024-05-09T06:29:37.778 INFO:tasks.workunit.client.1.smithi079.stdout:6/647: creat d0/d6/d1b/db8/fda x:0 0 0 2024-05-09T06:29:37.779 INFO:tasks.workunit.client.1.smithi079.stdout:5/714: rmdir d13/d43/d3d/d40/d63/da2 39 2024-05-09T06:29:37.780 INFO:tasks.workunit.client.1.smithi079.stdout:5/715: fdatasync d13/d92/dcd/dcf/fa0 0 2024-05-09T06:29:37.783 INFO:tasks.workunit.client.1.smithi079.stdout:9/809: dwrite d1/d45/dc6/dc9/fbd [4194304,4194304] 0 2024-05-09T06:29:37.783 INFO:tasks.workunit.client.1.smithi079.stdout:1/556: unlink d0/d12/d48/cb5 0 2024-05-09T06:29:37.783 INFO:tasks.workunit.client.1.smithi079.stdout:1/557: chown d0/d7/f9 3276124 1 2024-05-09T06:29:37.783 INFO:tasks.workunit.client.1.smithi079.stdout:1/558: chown d0/df/c56 0 1 2024-05-09T06:29:37.783 INFO:tasks.workunit.client.1.smithi079.stdout:1/559: creat d0/d12/d48/d75/d97/fc6 x:0 0 0 2024-05-09T06:29:37.783 INFO:tasks.workunit.client.1.smithi079.stdout:1/560: readlink d0/d12/d67/db6/l71 0 2024-05-09T06:29:37.784 INFO:tasks.workunit.client.1.smithi079.stdout:5/716: dread fc [0,4194304] 0 2024-05-09T06:29:37.789 INFO:tasks.workunit.client.1.smithi079.stdout:0/565: mknod d3/dd/d66/d6d/d74/d80/d76/caf 0 2024-05-09T06:29:37.793 INFO:tasks.workunit.client.1.smithi079.stdout:6/648: symlink d0/d6/d16/dcd/dce/ldb 0 2024-05-09T06:29:37.798 INFO:tasks.workunit.client.1.smithi079.stdout:9/810: symlink d1/d33/d28/d36/dcd/de7/d75/l110 0 2024-05-09T06:29:37.803 INFO:tasks.workunit.client.1.smithi079.stdout:5/717: dwrite d13/d43/d3d/d40/d63/da2/d8b/fe8 [0,4194304] 0 2024-05-09T06:29:37.803 INFO:tasks.workunit.client.1.smithi079.stdout:5/718: chown d13/d4f/d80/c88 0 1 2024-05-09T06:29:37.803 INFO:tasks.workunit.client.1.smithi079.stdout:5/719: chown d13/d43/d26/d35/f5e 0 1 2024-05-09T06:29:37.803 INFO:tasks.workunit.client.1.smithi079.stdout:0/566: link d3/dd/f53 d3/dd/fb0 0 2024-05-09T06:29:37.805 INFO:tasks.workunit.client.1.smithi079.stdout:6/649: rename d0/d6/d16/d1f/d6f/d8c/d93/f96 to d0/d6/d16/d1f/d6f/d8c/d93/fdc 0 2024-05-09T06:29:37.805 INFO:tasks.workunit.client.1.smithi079.stdout:6/650: creat d0/d6/d1b/db8/fdd x:0 0 0 2024-05-09T06:29:37.812 INFO:tasks.workunit.client.1.smithi079.stdout:5/720: creat d13/d43/d3d/d40/d63/da2/d8b/ff6 x:0 0 0 2024-05-09T06:29:37.812 INFO:tasks.workunit.client.1.smithi079.stdout:5/721: truncate d13/d43/d39/f60 901836 0 2024-05-09T06:29:37.812 INFO:tasks.workunit.client.1.smithi079.stdout:4/701: sync 2024-05-09T06:29:37.813 INFO:tasks.workunit.client.1.smithi079.stdout:8/587: sync 2024-05-09T06:29:37.815 INFO:tasks.workunit.client.1.smithi079.stdout:1/561: dwrite d0/d12/d48/d75/d43/f77 [0,4194304] 0 2024-05-09T06:29:37.817 INFO:tasks.workunit.client.1.smithi079.stdout:1/562: write d0/d12/d48/d75/d43/d20/f9d [310867,73400] 0 2024-05-09T06:29:37.818 INFO:tasks.workunit.client.1.smithi079.stdout:1/563: write d0/d12/d16/f84 [2211576,15927] 0 2024-05-09T06:29:37.820 INFO:tasks.workunit.client.1.smithi079.stdout:0/567: mknod d3/dd/d1f/d1e/d2c/d35/d36/cb1 0 2024-05-09T06:29:37.820 INFO:tasks.workunit.client.1.smithi079.stdout:8/588: symlink d1/db/daf/d66/d6c/dbf/dc9/ld2 0 2024-05-09T06:29:37.821 INFO:tasks.workunit.client.1.smithi079.stdout:6/651: rmdir d0/d6/d16/dcd/dce/d9c 39 2024-05-09T06:29:37.821 INFO:tasks.workunit.client.1.smithi079.stdout:6/652: readlink d0/d6/d1b/l42 0 2024-05-09T06:29:37.821 INFO:tasks.workunit.client.1.smithi079.stdout:6/653: write d0/f8b [14996,128319] 0 2024-05-09T06:29:37.821 INFO:tasks.workunit.client.1.smithi079.stdout:6/654: chown d0/d6/d16/d1f/d6f/d8c/d93 115596 1 2024-05-09T06:29:37.821 INFO:tasks.workunit.client.1.smithi079.stdout:6/655: creat d0/d6/d1b/fde x:0 0 0 2024-05-09T06:29:37.827 INFO:tasks.workunit.client.1.smithi079.stdout:1/564: mknod d0/d7/d4e/d7d/d94/cc7 0 2024-05-09T06:29:37.827 INFO:tasks.workunit.client.1.smithi079.stdout:1/565: chown d0/d7/c81 211 1 2024-05-09T06:29:37.829 INFO:tasks.workunit.client.1.smithi079.stdout:0/568: mknod d3/dd/d66/cb2 0 2024-05-09T06:29:37.831 INFO:tasks.workunit.client.1.smithi079.stdout:8/589: rename d1/d64/l6e to d1/d3/d20/d7f/d33/d5d/ld3 0 2024-05-09T06:29:37.831 INFO:tasks.workunit.client.1.smithi079.stdout:8/590: truncate d1/db/f78 844123 0 2024-05-09T06:29:37.831 INFO:tasks.workunit.client.1.smithi079.stdout:8/591: fsync d1/d5/dc/f6a 0 2024-05-09T06:29:37.835 INFO:tasks.workunit.client.1.smithi079.stdout:8/592: dread d1/d3/f6 [0,4194304] 0 2024-05-09T06:29:37.837 INFO:tasks.workunit.client.1.smithi079.stdout:1/566: symlink d0/d12/d48/d75/d26/lc8 0 2024-05-09T06:29:37.838 INFO:tasks.workunit.client.1.smithi079.stdout:0/569: dread - d3/dd/d66/d6d/d74/d80/d2d/f70 zero size 2024-05-09T06:29:37.838 INFO:tasks.workunit.client.1.smithi079.stdout:0/570: truncate d3/dd/d1f/d1e/d2c/d35/f60 2700308 0 2024-05-09T06:29:37.840 INFO:tasks.workunit.client.1.smithi079.stdout:8/593: rename d1/d3/d20/d7f/d33/db2 to d1/d3/d20/d7f/d33/d5d/d6d/dc0/dd4 0 2024-05-09T06:29:37.842 INFO:tasks.workunit.client.1.smithi079.stdout:0/571: symlink d3/dd/d66/lb3 0 2024-05-09T06:29:37.847 INFO:tasks.workunit.client.1.smithi079.stdout:1/567: dread d0/df/f24 [0,4194304] 0 2024-05-09T06:29:37.848 INFO:tasks.workunit.client.1.smithi079.stdout:1/568: creat d0/d12/d16/fc9 x:0 0 0 2024-05-09T06:29:37.892 INFO:tasks.workunit.client.1.smithi079.stdout:7/587: sync 2024-05-09T06:29:37.892 INFO:tasks.workunit.client.1.smithi079.stdout:2/711: sync 2024-05-09T06:29:37.901 INFO:tasks.workunit.client.1.smithi079.stdout:0/572: dwrite d3/dd/d18/fad [0,4194304] 0 2024-05-09T06:29:37.901 INFO:tasks.workunit.client.1.smithi079.stdout:1/569: write d0/d12/d48/d75/d43/f77 [1665512,70238] 0 2024-05-09T06:29:37.901 INFO:tasks.workunit.client.1.smithi079.stdout:7/588: truncate d4/d7/f18 431440 0 2024-05-09T06:29:37.901 INFO:tasks.workunit.client.1.smithi079.stdout:7/589: fsync d4/d7/dd/d5b/f69 0 2024-05-09T06:29:37.904 INFO:tasks.workunit.client.1.smithi079.stdout:2/712: creat d8/db/d59/d67/d7f/db9/de1/ffd x:0 0 0 2024-05-09T06:29:37.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/811: dwrite d1/d33/d28/d36/dcd/de7/d75/f77 [0,4194304] 0 2024-05-09T06:29:37.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/812: write d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/fee [855255,11458] 0 2024-05-09T06:29:37.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/813: stat d1/d45/dc6/dc9/f2e 0 2024-05-09T06:29:37.907 INFO:tasks.workunit.client.1.smithi079.stdout:2/713: dread d8/db/dc/f6c [0,4194304] 0 2024-05-09T06:29:37.912 INFO:tasks.workunit.client.1.smithi079.stdout:0/573: mkdir d3/dd/d71/db4 0 2024-05-09T06:29:37.913 INFO:tasks.workunit.client.1.smithi079.stdout:0/574: creat d3/fb5 x:0 0 0 2024-05-09T06:29:37.914 INFO:tasks.workunit.client.1.smithi079.stdout:1/570: mknod d0/d7/d4e/d7d/cca 0 2024-05-09T06:29:37.916 INFO:tasks.workunit.client.1.smithi079.stdout:8/594: dwrite d1/d5/dc/f1b [0,4194304] 0 2024-05-09T06:29:37.917 INFO:tasks.workunit.client.1.smithi079.stdout:7/590: rename d4/d7/dd/d5b/d32/f35 to d4/d7/d22/d28/d50/d5c/d85/db6/fbb 0 2024-05-09T06:29:37.917 INFO:tasks.workunit.client.1.smithi079.stdout:7/591: readlink d4/d7/d22/d28/d50/d5c/d85/la7 0 2024-05-09T06:29:37.917 INFO:tasks.workunit.client.1.smithi079.stdout:9/814: read d1/d45/dc6/dc9/da9/d100/fe5 [5748194,75632] 0 2024-05-09T06:29:37.917 INFO:tasks.workunit.client.1.smithi079.stdout:4/702: dwrite d6/d8/d27/f85 [0,4194304] 0 2024-05-09T06:29:37.918 INFO:tasks.workunit.client.1.smithi079.stdout:5/722: dwrite d13/d43/f25 [0,4194304] 0 2024-05-09T06:29:37.918 INFO:tasks.workunit.client.1.smithi079.stdout:5/723: write d13/d2a/fbf [180172,59259] 0 2024-05-09T06:29:37.931 INFO:tasks.workunit.client.1.smithi079.stdout:2/714: getdents d8/df7 0 2024-05-09T06:29:37.933 INFO:tasks.workunit.client.1.smithi079.stdout:9/815: dwrite d1/d33/d28/d36/d4d/d7d/d19/fa3 [4194304,4194304] 0 2024-05-09T06:29:37.935 INFO:tasks.workunit.client.1.smithi079.stdout:0/575: creat d3/dd/d1f/d1e/fb6 x:0 0 0 2024-05-09T06:29:37.936 INFO:tasks.workunit.client.1.smithi079.stdout:1/571: mknod d0/df/ccb 0 2024-05-09T06:29:37.943 INFO:tasks.workunit.client.1.smithi079.stdout:8/595: creat d1/d3/d20/d7f/dc3/d44/da4/fd5 x:0 0 0 2024-05-09T06:29:37.943 INFO:tasks.workunit.client.1.smithi079.stdout:7/592: unlink d4/d7/d22/d28/d50/d5c/d84/lba 0 2024-05-09T06:29:37.949 INFO:tasks.workunit.client.1.smithi079.stdout:5/724: mknod d13/d43/cf7 0 2024-05-09T06:29:37.949 INFO:tasks.workunit.client.1.smithi079.stdout:3/676: sync 2024-05-09T06:29:37.950 INFO:tasks.workunit.client.1.smithi079.stdout:2/715: creat d8/db/d4b/d4f/ffe x:0 0 0 2024-05-09T06:29:37.950 INFO:tasks.workunit.client.1.smithi079.stdout:2/716: chown d8/db/d5c/d6b/db5 160532887 1 2024-05-09T06:29:37.950 INFO:tasks.workunit.client.1.smithi079.stdout:2/717: stat d8/db/d59/d67/d7f/db9/dca 0 2024-05-09T06:29:37.955 INFO:tasks.workunit.client.1.smithi079.stdout:0/576: stat d3/dd/d66/d6d/d74/d80/f32 0 2024-05-09T06:29:37.958 INFO:tasks.workunit.client.1.smithi079.stdout:1/572: mknod d0/d7/d4e/d7d/d94/ccc 0 2024-05-09T06:29:37.958 INFO:tasks.workunit.client.1.smithi079.stdout:3/677: dread d1a/d1c/d22/d53/d4e/dc3/fc7 [0,4194304] 0 2024-05-09T06:29:37.959 INFO:tasks.workunit.client.1.smithi079.stdout:8/596: symlink d1/db/daf/d66/d6c/ld6 0 2024-05-09T06:29:37.963 INFO:tasks.workunit.client.1.smithi079.stdout:7/593: symlink d4/d7/lbc 0 2024-05-09T06:29:38.303 INFO:tasks.workunit.client.1.smithi079.stdout:7/594: readlink d4/d7/d37/d7c/d8e/l9d 0 2024-05-09T06:29:38.319 INFO:tasks.workunit.client.1.smithi079.stdout:4/703: link d6/d8/d27/d3d/d5b/d9a/d8b/daa/cae d6/d8/ce1 0 2024-05-09T06:29:38.319 INFO:tasks.workunit.client.1.smithi079.stdout:5/725: mkdir d13/d43/d3d/d40/d9a/df8 0 2024-05-09T06:29:38.319 INFO:tasks.workunit.client.1.smithi079.stdout:9/816: rename d1/d6/cb to d1/d45/dc6/dc9/d2d/d99/dd5/c111 0 2024-05-09T06:29:38.319 INFO:tasks.workunit.client.1.smithi079.stdout:0/577: mkdir d3/dd/d66/d6d/d74/d84/db7 0 2024-05-09T06:29:38.319 INFO:tasks.workunit.client.1.smithi079.stdout:1/573: mkdir d0/d7/d3e/dcd 0 2024-05-09T06:29:38.319 INFO:tasks.workunit.client.1.smithi079.stdout:8/597: mkdir d1/d3/d20/d7f/dc3/d50/dd7 0 2024-05-09T06:29:38.319 INFO:tasks.workunit.client.1.smithi079.stdout:8/598: dread - d1/db/daf/d66/fce zero size 2024-05-09T06:29:38.319 INFO:tasks.workunit.client.1.smithi079.stdout:4/704: mkdir d6/d1a/d26/d2a/d54/dc8/de2 0 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:7/595: rename d4/d7/d22/d28/d50/d5c/l9c to d4/d7/dd/d88/lbd 0 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:9/817: truncate d1/d45/dc6/dc9/da9/d100/fe5 548748 0 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:4/705: dread d6/d8/f4f [4194304,4194304] 0 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:3/678: mkdir d1a/d21/db0/dd4/d34/d59/dd6 0 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:8/599: dread d1/d3/d20/d7f/dc3/d3b/fab [0,4194304] 0 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:8/600: truncate d1/d3/d20/d7f/dc3/d50/fc6 358215 0 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:8/601: chown d1/db/c24 2280638 1 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:5/726: rename d13/d43/ddb/fec to d13/d2a/ff9 0 2024-05-09T06:29:38.320 INFO:tasks.workunit.client.1.smithi079.stdout:0/578: dwrite d3/dd/d1f/f1d [0,4194304] 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:0/579: fsync d3/faa 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:0/580: fdatasync d3/dd/f1c 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:6/656: sync 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:9/818: creat d1/d33/d48/d64/df4/f112 x:0 0 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:1/574: getdents d0/d12/d16 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:1/575: write d0/d12/d16/f2f [501528,41801] 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:1/576: creat d0/d12/d67/d53/fce x:0 0 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:3/679: truncate d1a/d82/d87/db2/fc1 3246871 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:8/602: link d1/d5/d36/f70 d1/d3/d20/d7f/dc3/d50/dd7/fd8 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:8/603: chown d1/d3/d20/d7f/dc3/d3b/fd0 794460 1 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:5/727: rmdir d13/d43/d3d/d40/d53/dad 39 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:7/596: rename d4/d7/d22/d28/d50/l61 to d4/d7/dd/d88/lbe 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:5/728: dread d13/d43/d3d/d40/d63/f8c [0,4194304] 0 2024-05-09T06:29:38.321 INFO:tasks.workunit.client.1.smithi079.stdout:7/597: dread d4/d7/d22/d28/d50/f9b [0,4194304] 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:0/581: rmdir d3/dd/d66/d6d/d74/d80 39 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:0/582: truncate d3/faa 577578 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:6/657: rmdir d0/d6/d16/d1f/d36/d69/d84 39 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:6/658: stat d0/d6/d1b/d20/l51 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:1/577: dwrite d0/df/f14 [0,4194304] 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:3/680: creat d1a/d1c/d22/d90/db8/fd7 x:0 0 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:3/681: dread - d1a/d1c/d22/d90/fbe zero size 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:3/682: write d1a/d82/fcb [646292,67413] 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:9/819: dwrite d1/d45/f86 [0,4194304] 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:8/604: rename d1/d3/d20/d7f/dc3/d3b/fab to d1/db/daf/d66/d6c/dbf/dc9/fd9 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:5/729: symlink d13/da5/lfa 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:5/730: readlink d13/d43/d39/lee 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:7/598: symlink d4/d7/dd/d5b/d32/da0/lbf 0 2024-05-09T06:29:38.322 INFO:tasks.workunit.client.1.smithi079.stdout:9/820: dread d1/d33/d28/d4c/d97/dd3/fe2 [0,4194304] 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:9/821: stat d1/d33/d48/c84 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:0/583: creat d3/dd/d1f/d1e/d91/fb8 x:0 0 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:6/659: creat d0/d6/d16/d1f/d36/fdf x:0 0 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:6/660: stat d0/d6/d16/d1f/d36/d69/f7b 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:1/578: unlink d0/d12/d67/d53/f6a 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:3/683: mkdir d1a/d1c/d22/d53/d4e/dc3/dd8 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:5/731: write d13/d4f/f78 [1333639,110525] 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:8/605: getdents d1/d3/d20/d7f/dc3/d50/dd7 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:7/599: creat d4/d7/dd/d5b/d6f/db9/fc0 x:0 0 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:6/661: creat d0/d6/d16/d1f/d6f/d8c/d93/fe0 x:0 0 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:5/732: write d13/d43/d3d/f85 [1326886,51370] 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:3/684: creat d1a/d1c/d22/d53/d4e/dc3/dd8/fd9 x:0 0 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:8/606: unlink d1/d3/d20/d7f/dc3/l48 0 2024-05-09T06:29:38.323 INFO:tasks.workunit.client.1.smithi079.stdout:7/600: link d4/d7/d37/d7c/f8f d4/d7/dd/d5b/d31/fc1 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:7/601: creat d4/d7/dd/fc2 x:0 0 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:7/602: write d4/d7/dd/d5b/d31/fae [460937,32351] 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:9/822: getdents d1/d5/d91 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:9/823: readlink d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/dd7/l10c 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:0/584: symlink d3/dd/d66/d6d/d74/d80/d76/lb9 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:0/585: write d3/dd/d1f/d1e/fb6 [31557,129069] 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:5/733: rename d13/d43/d3d/d40/d63/da2/fd9 to d13/d43/d9e/ffb 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:5/734: readlink d13/d4d/l6e 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:5/735: write d13/d43/d39/d61/f62 [83627,99768] 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:5/736: dread - d13/d43/d39/d61/fb7 zero size 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:8/607: dread d1/db/daf/d66/d6c/d6b/f98 [0,4194304] 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:9/824: mkdir d1/d33/d28/d36/dcd/d113 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:0/586: symlink d3/dd/d1f/d1e/d2c/d88/d8e/lba 0 2024-05-09T06:29:38.324 INFO:tasks.workunit.client.1.smithi079.stdout:6/662: dwrite d0/f8f [0,4194304] 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:6/663: chown d0/d60/lab 0 1 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:3/685: rename d1a/d21/fbc to d1a/dcc/fda 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:5/737: mknod d13/d4f/d80/cfc 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:5/738: stat d13/d4f/l6a 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:5/739: dread - d13/d43/d39/d61/d72/dbd/fdf zero size 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:5/740: readlink d13/d43/l54 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:6/664: mknod d0/d6/d1b/d20/ce1 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:6/665: dread - d0/d6/d16/d1f/f90 zero size 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:6/666: fdatasync d0/d60/daf/fd8 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:8/608: dwrite d1/d3/d20/d7f/dc3/d44/f4c [0,4194304] 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:0/587: dwrite d3/f39 [0,4194304] 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:3/686: mkdir d1a/d82/d87/db2/ddb 0 2024-05-09T06:29:38.325 INFO:tasks.workunit.client.1.smithi079.stdout:3/687: truncate d1a/d21/db0/dd4/d34/d42/fa8 956747 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:0/588: dread d3/d5/d87/fa8 [0,4194304] 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:0/589: creat d3/fbb x:0 0 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/603: rename d4/d7/dd/faa to d4/d7/dd/d5b/d31/d34/fc3 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/604: chown d4/d7/c7e 98460 1 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/605: write d4/d7/dd/d5b/d6f/db9/fc0 [481894,10033] 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:7/606: write d4/d7/dd/f42 [5081109,95181] 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:5/741: rmdir d13/d43/d39/d61/d72/dbd/de1 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:9/825: mkdir d1/d6/d114 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:6/667: mknod d0/d6/d16/dcd/dce/ce2 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:0/590: dwrite d3/dd/d1f/d1e/d2c/d88/d8e/fa5 [0,4194304] 0 2024-05-09T06:29:38.326 INFO:tasks.workunit.client.1.smithi079.stdout:3/688: mkdir d1a/d21/ddc 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:3/689: chown d1a/d21/db0/dd4/f2f 831320659 1 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:3/690: getdents d1a/d82/d87/db2/ddb 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:6/668: dwrite d0/d6/d5e/f63 [0,4194304] 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:5/742: link d13/d43/d39/d61/f7d d13/d43/d39/ffd 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:9/826: mknod d1/d5/c115 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:6/669: dwrite d0/d6/d16/d1f/d36/fdf [0,4194304] 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:6/670: write d0/f8f [4661438,42285] 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:0/591: mknod d3/dd/d1f/d1e/d2c/d35/cbc 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:3/691: mkdir d1a/d21/db0/dd4/d3a/da4/ddd 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:3/692: write d1a/f7f [328329,103444] 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:3/693: chown d1a/d21/db0/dd4/d3a/d54/d55/l9f 7015 1 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:3/694: stat d1a/d21/db0/dd4/fb5 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:5/743: unlink d13/d43/f2f 0 2024-05-09T06:29:38.327 INFO:tasks.workunit.client.1.smithi079.stdout:5/744: readlink d13/l23 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:5/745: readlink d13/d2a/l65 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:6/671: write d0/de/f1c [2928391,61698] 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:6/672: fdatasync d0/d6/d16/d1f/d36/d69/d84/f94 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:9/827: symlink d1/d33/d48/dbf/l116 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:2/718: sync 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:0/592: mknod d3/dd/d1f/cbd 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:8/609: unlink d1/d3/d20/d7f/dc3/d3b/l8b 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:3/695: link d1a/d1c/d22/d53/f7b d1a/d21/db0/dd4/d34/d42/fde 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:9/828: dwrite d1/d45/dc6/dc9/f4a [0,4194304] 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:5/746: mknod d13/d43/ddb/cfe 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:5/747: stat d13/d43/d26/d35/ff5 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:5/748: stat d13/d43/f25 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:5/749: write d13/d43/d3d/d40/d63/da2/d8b/ff6 [897870,49559] 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:3/696: dread d1a/d1c/d22/d53/d4e/dc3/fc7 [0,4194304] 0 2024-05-09T06:29:38.328 INFO:tasks.workunit.client.1.smithi079.stdout:6/673: unlink d0/f65 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:2/719: unlink f3 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:0/593: truncate d3/dd/d1f/f1d 2087614 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:8/610: mkdir d1/d3/d20/d7f/dc3/d82/dda 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:9/829: mkdir d1/d33/d28/d36/d6c/d117 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:6/674: rename d0/d6/d1b/ccc to d0/d6/d16/d1f/d36/ce3 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:6/675: chown d0/d6/d1b/l42 258392633 1 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:9/830: read d1/d33/d28/d36/f7b [1283414,25510] 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:8/611: dread d1/d3/d20/d7f/d33/d5d/d6d/f88 [0,4194304] 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:9/831: write d1/d33/d28/d36/d4d/d7d/fc4 [224023,126070] 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:2/720: link d8/db/d4b/d4f/d51/d6d/f6e d8/db/d59/d67/d7f/db9/de1/df1/fff 0 2024-05-09T06:29:38.329 INFO:tasks.workunit.client.1.smithi079.stdout:0/594: creat d3/dd/d1f/d1e/d2c/d35/fbe x:0 0 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:3/697: rmdir d1a/d82/d87 39 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:6/676: rename d0/d6/fa7 to d0/d6/d16/fe4 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:8/612: unlink d1/d5/f5f 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:9/832: mknod d1/d5/d5b/c118 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:2/721: mknod d8/db/d59/d67/d7f/c100 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:6/677: dread d0/d6/d5e/f63 [0,4194304] 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:3/698: creat d1a/d82/d87/db2/fdf x:0 0 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:8/613: creat d1/d3/fdb x:0 0 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:8/614: chown d1/d3/d20/d7f/dc3/d3f/cad 781976 1 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:9/833: write d1/d33/d28/d36/f67 [3030172,32356] 0 2024-05-09T06:29:38.330 INFO:tasks.workunit.client.1.smithi079.stdout:9/834: chown d1/d33/d28/d36/db5 31228013 1 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:9/835: dread - d1/d45/dc6/dc9/da9/fdb zero size 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:3/699: symlink d1a/d82/le0 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:6/678: rename d0/d6/d16/d1f/f23 to d0/d6/d1b/db8/fe5 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:8/615: write d1/d3/d20/d7f/dc3/d44/f35 [1204278,48567] 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:8/616: readlink d1/d5/d36/da0/la6 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:9/836: symlink d1/d6/d114/l119 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:4/706: sync 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:4/707: write d6/d15/f5c [4503114,114176] 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:4/708: fsync d6/d1a/d26/d2a/f8c 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:3/700: rename f16 to d1a/d82/d87/fe1 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:3/701: truncate d1a/d21/db0/dd4/d34/fca 319196 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:2/722: dwrite d8/db/d4b/d4f/d51/fa4 [0,4194304] 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:8/617: mknod d1/d3/d20/d7f/dc3/d82/cdc 0 2024-05-09T06:29:38.331 INFO:tasks.workunit.client.1.smithi079.stdout:8/618: truncate d1/d67/fcc 1036324 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:8/619: fsync d1/db/daf/d66/fce 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:9/837: symlink d1/d33/d28/d36/d4d/d7d/dfe/l11a 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:4/709: rmdir d6/d90 39 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:3/702: dwrite d1a/d82/f89 [0,4194304] 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:3/703: truncate d1a/d21/db0/dd4/d3a/fd3 459723 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:2/723: creat d8/db/d59/f101 x:0 0 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:2/724: stat d8/db/dc/f56 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:6/679: rmdir d0/d6/d16/d1f/d6f 39 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:6/680: fdatasync d0/d6/d1b/f3d 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:8/620: symlink d1/db/daf/d66/d6c/d6b/ldd 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:3/704: read d1a/d21/db0/dd4/d34/f6c [45727,55439] 0 2024-05-09T06:29:38.332 INFO:tasks.workunit.client.1.smithi079.stdout:9/838: dwrite d1/d33/d28/d36/d4d/d7d/d19/f1e [4194304,4194304] 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:4/710: creat d6/d8/fe3 x:0 0 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:2/725: unlink d8/db/d4b/f66 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:3/705: symlink d1a/d1c/d1f/d76/le2 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:9/839: symlink d1/d45/dc6/l11b 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:4/711: dwrite d6/d1a/d26/d2a/d54/d9e/dd5/fa2 [0,4194304] 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:4/712: creat d6/d8/d27/d3d/d5b/db4/dc3/fe4 x:0 0 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:6/681: dwrite d0/d6/d16/d1f/f41 [4194304,4194304] 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:2/726: rename d8/db/d11/l4d to d8/l102 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:2/727: stat d8/db/d4b/d4f/d51 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:8/621: rmdir d1/d5 39 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:8/622: dread d1/f1f [0,4194304] 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:3/706: link d1a/d21/db0/dd4/f41 d1a/d1c/d22/d53/d4e/fe3 0 2024-05-09T06:29:38.333 INFO:tasks.workunit.client.1.smithi079.stdout:9/840: mknod d1/d33/d28/d36/c11c 0 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:9/841: chown d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/lca 34371 1 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:1/579: sync 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:7/607: sync 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:1/580: read - d0/df/fc2 zero size 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:4/713: link d6/d8/f4f d6/d8/d27/d3d/d5b/d9a/fe5 0 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:2/728: getdents d8/db/d59/d67/d7f/dac 0 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:8/623: mknod d1/d5/d36/dae/dbe/cde 0 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:8/624: chown d1/d3/d20/d7f/dc3/c23 42 1 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:8/625: write d1/d56/d7c/d8f/fa8 [4761863,122633] 0 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:3/707: mkdir d1a/d1c/d22/d53/d4e/de4 0 2024-05-09T06:29:38.334 INFO:tasks.workunit.client.1.smithi079.stdout:3/708: readlink d1a/d1c/d22/d90/l44 0 2024-05-09T06:29:38.335 INFO:tasks.workunit.client.1.smithi079.stdout:2/729: dwrite d8/db/d59/f101 [0,4194304] 0 2024-05-09T06:29:38.336 INFO:tasks.workunit.client.1.smithi079.stdout:2/730: fsync d8/db/d11/d5f/fce 0 2024-05-09T06:29:38.336 INFO:tasks.workunit.client.1.smithi079.stdout:7/608: creat d4/d7/d22/d28/d50/d5c/d85/db6/fc4 x:0 0 0 2024-05-09T06:29:38.336 INFO:tasks.workunit.client.1.smithi079.stdout:7/609: read d4/d7/dd/d5b/d31/d34/f3c [446165,30287] 0 2024-05-09T06:29:38.336 INFO:tasks.workunit.client.1.smithi079.stdout:7/610: write d4/d7/d37/d7c/f8f [322613,99208] 0 2024-05-09T06:29:38.336 INFO:tasks.workunit.client.1.smithi079.stdout:6/682: getdents d0/d6/d1b/db8 0 2024-05-09T06:29:38.336 INFO:tasks.workunit.client.1.smithi079.stdout:8/626: unlink d1/d3/d20/d7f/dc3/d44/da4/lb4 0 2024-05-09T06:29:38.336 INFO:tasks.workunit.client.1.smithi079.stdout:3/709: mkdir d1a/d21/db0/de5 0 2024-05-09T06:29:38.337 INFO:tasks.workunit.client.1.smithi079.stdout:9/842: rmdir d1/d33/d48 39 2024-05-09T06:29:38.346 INFO:tasks.workunit.client.1.smithi079.stdout:8/627: dwrite d1/d67/fcc [0,4194304] 0 2024-05-09T06:29:38.353 INFO:tasks.workunit.client.1.smithi079.stdout:1/581: rmdir d0 39 2024-05-09T06:29:38.353 INFO:tasks.workunit.client.1.smithi079.stdout:0/595: sync 2024-05-09T06:29:38.353 INFO:tasks.workunit.client.1.smithi079.stdout:5/750: sync 2024-05-09T06:29:38.354 INFO:tasks.workunit.client.1.smithi079.stdout:2/731: creat d8/db/d9d/f103 x:0 0 0 2024-05-09T06:29:38.354 INFO:tasks.workunit.client.1.smithi079.stdout:2/732: creat d8/db/d9d/f104 x:0 0 0 2024-05-09T06:29:38.354 INFO:tasks.workunit.client.1.smithi079.stdout:2/733: dread - d8/db/d59/d67/d7f/db9/de1/ffd zero size 2024-05-09T06:29:38.355 INFO:tasks.workunit.client.1.smithi079.stdout:4/714: mkdir d6/d8/de6 0 2024-05-09T06:29:38.358 INFO:tasks.workunit.client.1.smithi079.stdout:7/611: mkdir d4/d9e/dc5 0 2024-05-09T06:29:38.358 INFO:tasks.workunit.client.1.smithi079.stdout:7/612: read - d4/d7/d78/f97 zero size 2024-05-09T06:29:38.361 INFO:tasks.workunit.client.1.smithi079.stdout:3/710: symlink d1a/d82/le6 0 2024-05-09T06:29:38.363 INFO:tasks.workunit.client.1.smithi079.stdout:9/843: link d1/d45/dc6/dc9/f54 d1/d45/dc6/dc9/d2d/d99/f11d 0 2024-05-09T06:29:38.364 INFO:tasks.workunit.client.1.smithi079.stdout:7/613: dread d4/d7/dd/d5b/d31/fc1 [0,4194304] 0 2024-05-09T06:29:38.370 INFO:tasks.workunit.client.1.smithi079.stdout:0/596: mknod d3/d5/d87/cbf 0 2024-05-09T06:29:38.370 INFO:tasks.workunit.client.1.smithi079.stdout:1/582: dwrite d0/d12/d48/f9c [0,4194304] 0 2024-05-09T06:29:38.370 INFO:tasks.workunit.client.1.smithi079.stdout:1/583: chown d0/d7/d4e/d7d/d94/ccc 16501727 1 2024-05-09T06:29:38.372 INFO:tasks.workunit.client.1.smithi079.stdout:1/584: dread d0/d12/f2c [0,4194304] 0 2024-05-09T06:29:38.373 INFO:tasks.workunit.client.1.smithi079.stdout:5/751: creat d13/da5/fff x:0 0 0 2024-05-09T06:29:38.373 INFO:tasks.workunit.client.1.smithi079.stdout:5/752: fdatasync d13/d43/d3d/d40/d63/f7b 0 2024-05-09T06:29:38.373 INFO:tasks.workunit.client.1.smithi079.stdout:5/753: chown d13/l24 288810070 1 2024-05-09T06:29:38.374 INFO:tasks.workunit.client.1.smithi079.stdout:1/585: dread d0/d12/d67/db6/d8a/f9f [0,4194304] 0 2024-05-09T06:29:38.374 INFO:tasks.workunit.client.1.smithi079.stdout:1/586: chown d0/df/f14 125047 1 2024-05-09T06:29:38.374 INFO:tasks.workunit.client.1.smithi079.stdout:1/587: dread - d0/fa9 zero size 2024-05-09T06:29:38.376 INFO:tasks.workunit.client.1.smithi079.stdout:2/734: mknod d8/db/dc/c105 0 2024-05-09T06:29:38.380 INFO:tasks.workunit.client.1.smithi079.stdout:6/683: link d0/d6/d16/dcd/dce/lc7 d0/d6/d16/d1f/d36/d69/d84/le6 0 2024-05-09T06:29:38.385 INFO:tasks.workunit.client.1.smithi079.stdout:0/597: write d3/dd/d18/f7a [7486616,127705] 0 2024-05-09T06:29:38.387 INFO:tasks.workunit.client.1.smithi079.stdout:7/614: dwrite d4/d7/dd/d5b/d32/f8b [0,4194304] 0 2024-05-09T06:29:38.388 INFO:tasks.workunit.client.1.smithi079.stdout:3/711: dwrite d1a/d21/db0/dd4/f79 [0,4194304] 0 2024-05-09T06:29:38.389 INFO:tasks.workunit.client.1.smithi079.stdout:8/628: rename d1/d5/dc/f34 to d1/d3/d20/d7f/dc3/d3b/fdf 0 2024-05-09T06:29:38.394 INFO:tasks.workunit.client.1.smithi079.stdout:5/754: dwrite d13/d43/d51/dc9/fed [0,4194304] 0 2024-05-09T06:29:38.394 INFO:tasks.workunit.client.1.smithi079.stdout:5/755: creat d13/d43/d26/d35/f100 x:0 0 0 2024-05-09T06:29:38.394 INFO:tasks.workunit.client.1.smithi079.stdout:5/756: fdatasync d13/d43/d3d/d40/d9a/fc6 0 2024-05-09T06:29:38.396 INFO:tasks.workunit.client.1.smithi079.stdout:1/588: link d0/d12/d67/d53/d6d/f80 d0/d12/d67/d53/d5e/fcf 0 2024-05-09T06:29:38.405 INFO:tasks.workunit.client.1.smithi079.stdout:9/844: mknod d1/d33/d28/d36/d4d/d7d/d19/c11e 0 2024-05-09T06:29:38.405 INFO:tasks.workunit.client.1.smithi079.stdout:9/845: truncate d1/d33/d28/d36/d4d/fa2 4685237 0 2024-05-09T06:29:38.406 INFO:tasks.workunit.client.1.smithi079.stdout:7/615: dread d4/d20/f48 [0,4194304] 0 2024-05-09T06:29:38.411 INFO:tasks.workunit.client.1.smithi079.stdout:8/629: creat d1/d3/d20/d7f/dc3/d82/dda/fe0 x:0 0 0 2024-05-09T06:29:38.411 INFO:tasks.workunit.client.1.smithi079.stdout:6/684: dwrite d0/d6/d1b/f50 [0,4194304] 0 2024-05-09T06:29:38.413 INFO:tasks.workunit.client.1.smithi079.stdout:0/598: dwrite d3/dd/d1f/d1e/d2c/d35/f9b [0,4194304] 0 2024-05-09T06:29:38.413 INFO:tasks.workunit.client.1.smithi079.stdout:3/712: dwrite d1a/d1c/d1f/f56 [4194304,4194304] 0 2024-05-09T06:29:38.413 INFO:tasks.workunit.client.1.smithi079.stdout:3/713: readlink d1a/d82/le0 0 2024-05-09T06:29:38.419 INFO:tasks.workunit.client.1.smithi079.stdout:5/757: mkdir d13/da5/de4/d101 0 2024-05-09T06:29:38.424 INFO:tasks.workunit.client.1.smithi079.stdout:1/589: rmdir d0/d12/d67/d53/d6d 39 2024-05-09T06:29:38.424 INFO:tasks.workunit.client.1.smithi079.stdout:1/590: stat d0/df/db8 0 2024-05-09T06:29:38.424 INFO:tasks.workunit.client.1.smithi079.stdout:3/714: dread d1a/d1c/d22/d53/f43 [0,4194304] 0 2024-05-09T06:29:38.427 INFO:tasks.workunit.client.1.smithi079.stdout:9/846: creat d1/d5/d91/f11f x:0 0 0 2024-05-09T06:29:38.428 INFO:tasks.workunit.client.1.smithi079.stdout:7/616: mknod d4/d9e/cc6 0 2024-05-09T06:29:38.429 INFO:tasks.workunit.client.1.smithi079.stdout:8/630: dwrite d1/d3/d20/f32 [0,4194304] 0 2024-05-09T06:29:38.432 INFO:tasks.workunit.client.1.smithi079.stdout:6/685: link d0/d6/d1b/l6b d0/le7 0 2024-05-09T06:29:38.435 INFO:tasks.workunit.client.1.smithi079.stdout:3/715: write fb [649609,14492] 0 2024-05-09T06:29:38.435 INFO:tasks.workunit.client.1.smithi079.stdout:3/716: creat d1a/d1c/d22/d90/db8/fe7 x:0 0 0 2024-05-09T06:29:38.438 INFO:tasks.workunit.client.1.smithi079.stdout:0/599: unlink d3/dd/d66/d6d/d74/l83 0 2024-05-09T06:29:38.438 INFO:tasks.workunit.client.1.smithi079.stdout:0/600: dread - d3/dd/d66/d6d/fae zero size 2024-05-09T06:29:38.441 INFO:tasks.workunit.client.1.smithi079.stdout:1/591: getdents d0/d12/d48 0 2024-05-09T06:29:38.441 INFO:tasks.workunit.client.1.smithi079.stdout:1/592: readlink d0/d7/d4e/d7d/d94/l95 0 2024-05-09T06:29:38.441 INFO:tasks.workunit.client.1.smithi079.stdout:1/593: write d0/d7/f7b [1063193,98863] 0 2024-05-09T06:29:38.443 INFO:tasks.workunit.client.1.smithi079.stdout:9/847: link d1/d45/dc6/dc9/da9/d100/c61 d1/d33/d28/c120 0 2024-05-09T06:29:38.443 INFO:tasks.workunit.client.1.smithi079.stdout:9/848: creat d1/f121 x:0 0 0 2024-05-09T06:29:38.444 INFO:tasks.workunit.client.1.smithi079.stdout:2/735: dwrite d8/db/dc/d2c/fa6 [0,4194304] 0 2024-05-09T06:29:38.445 INFO:tasks.workunit.client.1.smithi079.stdout:7/617: rename d4/d7/d78/c8c to d4/d7/d22/d28/d50/d5c/d85/db6/cc7 0 2024-05-09T06:29:38.454 INFO:tasks.workunit.client.1.smithi079.stdout:3/717: symlink d1a/d21/db0/le8 0 2024-05-09T06:29:38.455 INFO:tasks.workunit.client.1.smithi079.stdout:9/849: dread d1/d45/dc6/dc9/fbd [0,4194304] 0 2024-05-09T06:29:38.455 INFO:tasks.workunit.client.1.smithi079.stdout:9/850: write d1/d5/d9a/f10d [275732,127293] 0 2024-05-09T06:29:38.455 INFO:tasks.workunit.client.1.smithi079.stdout:9/851: chown d1/d45/dc6/dc9/d2d/d99/dd5/ld1 5 1 2024-05-09T06:29:38.455 INFO:tasks.workunit.client.1.smithi079.stdout:9/852: write d1/d33/d28/d36/d4d/f8a [744672,18422] 0 2024-05-09T06:29:38.456 INFO:tasks.workunit.client.1.smithi079.stdout:9/853: write d1/d5/d9a/f73 [1614743,32833] 0 2024-05-09T06:29:38.456 INFO:tasks.workunit.client.1.smithi079.stdout:0/601: mkdir d3/dd/d1f/d1e/d2c/dc0 0 2024-05-09T06:29:38.456 INFO:tasks.workunit.client.1.smithi079.stdout:0/602: creat d3/dd/d66/d6d/d74/d84/fc1 x:0 0 0 2024-05-09T06:29:38.456 INFO:tasks.workunit.client.1.smithi079.stdout:0/603: creat d3/dd/d1f/d1e/d2c/d35/fc2 x:0 0 0 2024-05-09T06:29:38.456 INFO:tasks.workunit.client.1.smithi079.stdout:1/594: rmdir d0/d7/d4e/d7d 39 2024-05-09T06:29:38.457 INFO:tasks.workunit.client.1.smithi079.stdout:1/595: write d0/fa9 [616719,62183] 0 2024-05-09T06:29:38.457 INFO:tasks.workunit.client.1.smithi079.stdout:1/596: chown d0/d12/d48/c68 10435 1 2024-05-09T06:29:38.461 INFO:tasks.workunit.client.1.smithi079.stdout:3/718: dread d1a/d21/db0/dd4/d3a/d7c/f9d [0,4194304] 0 2024-05-09T06:29:38.463 INFO:tasks.workunit.client.1.smithi079.stdout:2/736: mknod d8/db/d5c/c106 0 2024-05-09T06:29:38.463 INFO:tasks.workunit.client.1.smithi079.stdout:2/737: write d8/db/d11/fe5 [386073,57762] 0 2024-05-09T06:29:38.467 INFO:tasks.workunit.client.1.smithi079.stdout:6/686: rename d0/d6/d16/dcd/dce/ca3 to d0/d6/d16/d1f/ce8 0 2024-05-09T06:29:38.468 INFO:tasks.workunit.client.1.smithi079.stdout:7/618: creat d4/d7/dd/d5b/fc8 x:0 0 0 2024-05-09T06:29:38.470 INFO:tasks.workunit.client.1.smithi079.stdout:8/631: rmdir d1/d3/d20/d7f/dc3/d82/dda 39 2024-05-09T06:29:38.476 INFO:tasks.workunit.client.1.smithi079.stdout:0/604: creat d3/dd/d1f/d1e/d2c/dc0/fc3 x:0 0 0 2024-05-09T06:29:38.478 INFO:tasks.workunit.client.1.smithi079.stdout:1/597: creat d0/d12/d16/fd0 x:0 0 0 2024-05-09T06:29:38.480 INFO:tasks.workunit.client.1.smithi079.stdout:3/719: mkdir d1a/d82/d87/db2/ddb/de9 0 2024-05-09T06:29:38.483 INFO:tasks.workunit.client.1.smithi079.stdout:0/605: write d3/dd/d1f/f13 [838466,89873] 0 2024-05-09T06:29:38.488 INFO:tasks.workunit.client.1.smithi079.stdout:6/687: truncate d0/de/f43 1981651 0 2024-05-09T06:29:38.491 INFO:tasks.workunit.client.1.smithi079.stdout:9/854: symlink d1/d6/l122 0 2024-05-09T06:29:38.492 INFO:tasks.workunit.client.1.smithi079.stdout:0/606: rmdir d3/dd/d66/d6d/d74/d80/d2d/da7 39 2024-05-09T06:29:38.493 INFO:tasks.workunit.client.1.smithi079.stdout:8/632: mknod d1/d3/ce1 0 2024-05-09T06:29:38.499 INFO:tasks.workunit.client.1.smithi079.stdout:8/633: truncate d1/db/f27 924318 0 2024-05-09T06:29:38.499 INFO:tasks.workunit.client.1.smithi079.stdout:8/634: fdatasync d1/d5/f11 0 2024-05-09T06:29:38.499 INFO:tasks.workunit.client.1.smithi079.stdout:8/635: chown d1/d5/c3a 103641917 1 2024-05-09T06:29:38.500 INFO:tasks.workunit.client.1.smithi079.stdout:0/607: dread d3/dd/d1f/d1e/d2c/d35/d36/f3d [0,4194304] 0 2024-05-09T06:29:38.500 INFO:tasks.workunit.client.1.smithi079.stdout:1/598: dwrite d0/d12/d92/f9a [0,4194304] 0 2024-05-09T06:29:38.500 INFO:tasks.workunit.client.1.smithi079.stdout:1/599: truncate d0/d12/d48/d75/d43/d70/f86 4738917 0 2024-05-09T06:29:38.500 INFO:tasks.workunit.client.1.smithi079.stdout:8/636: write d1/db/daf/f9d [46123,102545] 0 2024-05-09T06:29:38.500 INFO:tasks.workunit.client.1.smithi079.stdout:8/637: stat d1/db/f4a 0 2024-05-09T06:29:38.500 INFO:tasks.workunit.client.1.smithi079.stdout:8/638: read d1/d5/d36/f70 [188195,94044] 0 2024-05-09T06:29:38.503 INFO:tasks.workunit.client.1.smithi079.stdout:1/600: dread d0/fa9 [0,4194304] 0 2024-05-09T06:29:38.508 INFO:tasks.workunit.client.1.smithi079.stdout:0/608: symlink d3/dd/d66/lc4 0 2024-05-09T06:29:38.508 INFO:tasks.workunit.client.1.smithi079.stdout:0/609: creat d3/dd/d66/d6d/fc5 x:0 0 0 2024-05-09T06:29:38.508 INFO:tasks.workunit.client.1.smithi079.stdout:0/610: write d3/dd/d66/d6d/da6/f8c [864927,52297] 0 2024-05-09T06:29:38.508 INFO:tasks.workunit.client.1.smithi079.stdout:0/611: chown d3/dd/d1f/d1e/d2c/d35/d36/l41 606138 1 2024-05-09T06:29:38.512 INFO:tasks.workunit.client.1.smithi079.stdout:1/601: mknod d0/d12/d48/d75/d43/cd1 0 2024-05-09T06:29:38.518 INFO:tasks.workunit.client.1.smithi079.stdout:6/688: dwrite d0/d6/d5e/f9a [0,4194304] 0 2024-05-09T06:29:38.518 INFO:tasks.workunit.client.1.smithi079.stdout:6/689: chown d0/d6/f74 1 1 2024-05-09T06:29:38.519 INFO:tasks.workunit.client.1.smithi079.stdout:9/855: dwrite d1/d45/dc6/dc9/fbd [8388608,4194304] 0 2024-05-09T06:29:38.519 INFO:tasks.workunit.client.1.smithi079.stdout:9/856: write d1/d33/d28/d36/dcd/de7/d75/f77 [4543098,116374] 0 2024-05-09T06:29:38.519 INFO:tasks.workunit.client.1.smithi079.stdout:9/857: creat d1/f123 x:0 0 0 2024-05-09T06:29:38.519 INFO:tasks.workunit.client.1.smithi079.stdout:9/858: stat d1/d5/f21 0 2024-05-09T06:29:38.525 INFO:tasks.workunit.client.1.smithi079.stdout:8/639: write d1/d3/d20/d7f/dc3/d3b/fd0 [1467052,27773] 0 2024-05-09T06:29:38.525 INFO:tasks.workunit.client.1.smithi079.stdout:8/640: chown d1/d3/d20/d7f/dc3/d3b/fd0 16662 1 2024-05-09T06:29:38.530 INFO:tasks.workunit.client.1.smithi079.stdout:9/859: dread d1/d5/f58 [0,4194304] 0 2024-05-09T06:29:38.533 INFO:tasks.workunit.client.1.smithi079.stdout:6/690: rmdir d0/d6/d5e 39 2024-05-09T06:29:38.535 INFO:tasks.workunit.client.1.smithi079.stdout:1/602: dwrite d0/d12/d48/d75/d43/d20/d39/f5a [0,4194304] 0 2024-05-09T06:29:38.538 INFO:tasks.workunit.client.1.smithi079.stdout:8/641: rmdir d1/d3/d20/d7f/d33/d5d 39 2024-05-09T06:29:38.538 INFO:tasks.workunit.client.1.smithi079.stdout:8/642: write d1/d56/d7c/f89 [606699,69415] 0 2024-05-09T06:29:38.540 INFO:tasks.workunit.client.1.smithi079.stdout:9/860: symlink d1/d33/d28/d36/dcd/l124 0 2024-05-09T06:29:38.540 INFO:tasks.workunit.client.1.smithi079.stdout:9/861: stat d1/d33/d2b/l78 0 2024-05-09T06:29:38.546 INFO:tasks.workunit.client.1.smithi079.stdout:8/643: dread d1/d3/d20/d7f/dc3/d50/f5b [0,4194304] 0 2024-05-09T06:29:38.547 INFO:tasks.workunit.client.1.smithi079.stdout:1/603: rmdir d0/d12/d67/db6 39 2024-05-09T06:29:38.553 INFO:tasks.workunit.client.1.smithi079.stdout:9/862: rename d1/d33/d28/c120 to d1/d6/dae/c125 0 2024-05-09T06:29:38.556 INFO:tasks.workunit.client.1.smithi079.stdout:6/691: link d0/d6/d16/c5c d0/d6/d16/d1f/d36/d69/dad/dd5/ce9 0 2024-05-09T06:29:38.556 INFO:tasks.workunit.client.1.smithi079.stdout:0/612: getdents d3/dd/d66/d6d 0 2024-05-09T06:29:38.560 INFO:tasks.workunit.client.1.smithi079.stdout:8/644: mknod d1/d56/d7c/ce2 0 2024-05-09T06:29:38.562 INFO:tasks.workunit.client.1.smithi079.stdout:9/863: rename d1/d5/d5b/l62 to d1/d33/d28/d36/dcd/de7/d10e/l126 0 2024-05-09T06:29:38.563 INFO:tasks.workunit.client.1.smithi079.stdout:1/604: dwrite d0/d12/d16/f2f [4194304,4194304] 0 2024-05-09T06:29:38.565 INFO:tasks.workunit.client.1.smithi079.stdout:6/692: mknod d0/d6/d16/d1f/d36/d69/cea 0 2024-05-09T06:29:38.565 INFO:tasks.workunit.client.1.smithi079.stdout:6/693: write d0/d6/d16/d1f/fc1 [394598,104141] 0 2024-05-09T06:29:38.568 INFO:tasks.workunit.client.1.smithi079.stdout:0/613: unlink d3/dd/d1f/d1e/d91/c97 0 2024-05-09T06:29:38.568 INFO:tasks.workunit.client.1.smithi079.stdout:0/614: fdatasync d3/dd/d1f/d1e/d2c/d35/f9b 0 2024-05-09T06:29:38.568 INFO:tasks.workunit.client.1.smithi079.stdout:0/615: truncate d3/dd/d1f/d1e/d2c/dc0/fc3 51300 0 2024-05-09T06:29:38.568 INFO:tasks.workunit.client.1.smithi079.stdout:0/616: chown d3/dd/d1f/d1e/f42 12 1 2024-05-09T06:29:38.573 INFO:tasks.workunit.client.1.smithi079.stdout:8/645: rmdir d1/d3/d20/d7f/d33/d5d/d6d/dc0/dd4 0 2024-05-09T06:29:38.577 INFO:tasks.workunit.client.1.smithi079.stdout:9/864: creat d1/d33/d28/d36/dcd/f127 x:0 0 0 2024-05-09T06:29:38.577 INFO:tasks.workunit.client.1.smithi079.stdout:9/865: stat d1/d45/dc6/dc9/da9/d100 0 2024-05-09T06:29:38.581 INFO:tasks.workunit.client.1.smithi079.stdout:9/866: dread d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/fee [0,4194304] 0 2024-05-09T06:29:38.587 INFO:tasks.workunit.client.1.smithi079.stdout:8/646: truncate d1/f1a 2114171 0 2024-05-09T06:29:38.588 INFO:tasks.workunit.client.1.smithi079.stdout:6/694: dwrite d0/d6/d16/d1f/fca [0,4194304] 0 2024-05-09T06:29:38.588 INFO:tasks.workunit.client.1.smithi079.stdout:6/695: stat d0/d6/d16/d1f/d36/fdf 0 2024-05-09T06:29:38.588 INFO:tasks.workunit.client.1.smithi079.stdout:6/696: fsync d0/d6/d16/d1f/d36/d69/d84/f91 0 2024-05-09T06:29:38.588 INFO:tasks.workunit.client.1.smithi079.stdout:6/697: truncate d0/d6/d1b/d2d/f4e 922928 0 2024-05-09T06:29:38.589 INFO:tasks.workunit.client.1.smithi079.stdout:4/715: sync 2024-05-09T06:29:38.589 INFO:tasks.workunit.client.1.smithi079.stdout:9/867: mknod d1/d33/d48/d64/c128 0 2024-05-09T06:29:38.590 INFO:tasks.workunit.client.1.smithi079.stdout:8/647: rmdir d1/db/daf/d66/d6c/dbf/dc9 39 2024-05-09T06:29:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:38 smithi079 ceph-mon[35268]: pgmap v248: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 115 MiB/s rd, 145 MiB/s wr, 768 op/s 2024-05-09T06:29:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:38 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:38.595 INFO:tasks.workunit.client.1.smithi079.stdout:1/605: dwrite d0/d12/d67/d53/d6d/f80 [4194304,4194304] 0 2024-05-09T06:29:38.595 INFO:tasks.workunit.client.1.smithi079.stdout:6/698: link d0/d6/d16/d1f/d6f/d8c/d93/f9e d0/d6/d1b/d2d/feb 0 2024-05-09T06:29:38.598 INFO:tasks.workunit.client.1.smithi079.stdout:4/716: symlink d6/le7 0 2024-05-09T06:29:38.599 INFO:tasks.workunit.client.1.smithi079.stdout:9/868: dread d1/d33/f37 [0,4194304] 0 2024-05-09T06:29:38.600 INFO:tasks.workunit.client.1.smithi079.stdout:8/648: link d1/d5/d36/dae/dbe/fc2 d1/d3/dc4/fe3 0 2024-05-09T06:29:38.604 INFO:tasks.workunit.client.1.smithi079.stdout:1/606: rename d0/d7 to d0/d12/d67/d53/dbf/dd2 0 2024-05-09T06:29:38.606 INFO:tasks.workunit.client.1.smithi079.stdout:6/699: link d0/d6/d16/d1f/d6f/f77 d0/d6/d5e/fec 0 2024-05-09T06:29:38.611 INFO:tasks.workunit.client.1.smithi079.stdout:4/717: rename d6/d1a/d26/d2a/d54/d9e/dd5/df/la4 to d6/d8/d80/da6/le8 0 2024-05-09T06:29:38.612 INFO:tasks.workunit.client.1.smithi079.stdout:1/607: link d0/d12/d67/d53/dbf/dd2/d4e/d7d/cad d0/d12/d67/d53/dbf/dd2/cd3 0 2024-05-09T06:29:38.612 INFO:tasks.workunit.client.1.smithi079.stdout:1/608: chown d0/d12/d16 37026808 1 2024-05-09T06:29:38.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/700: unlink d0/c99 0 2024-05-09T06:29:38.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/701: fsync d0/d6/d16/d1f/d36/d69/f7b 0 2024-05-09T06:29:38.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/702: write d0/d6/d1b/fa0 [1042574,20624] 0 2024-05-09T06:29:38.619 INFO:tasks.workunit.client.1.smithi079.stdout:6/703: write d0/d6/d1b/f3d [4387274,107723] 0 2024-05-09T06:29:38.621 INFO:tasks.workunit.client.1.smithi079.stdout:6/704: dread d0/d6/d16/d1f/d36/d69/d84/f94 [0,4194304] 0 2024-05-09T06:29:38.621 INFO:tasks.workunit.client.1.smithi079.stdout:9/869: rename d1/d45/dab to d1/d45/dc6/dc9/da9/d100/d129 0 2024-05-09T06:29:38.621 INFO:tasks.workunit.client.1.smithi079.stdout:9/870: write d1/d45/f60 [1788528,964] 0 2024-05-09T06:29:38.623 INFO:tasks.workunit.client.1.smithi079.stdout:4/718: mknod d6/d1a/d41/d68/da1/ce9 0 2024-05-09T06:29:38.623 INFO:tasks.workunit.client.1.smithi079.stdout:4/719: write d6/d1a/d41/d68/d6b/f81 [526427,12862] 0 2024-05-09T06:29:38.623 INFO:tasks.workunit.client.1.smithi079.stdout:4/720: chown d6/d1a/d26/d2a/d54/d9e/dd5/df/f13 0 1 2024-05-09T06:29:38.624 INFO:tasks.workunit.client.1.smithi079.stdout:4/721: dread d6/d1a/d26/d2a/d54/d9e/fc0 [0,4194304] 0 2024-05-09T06:29:38.624 INFO:tasks.workunit.client.1.smithi079.stdout:4/722: stat d6/d1a/d26/d2a/d54/d9e/dd5/d34 0 2024-05-09T06:29:38.624 INFO:tasks.workunit.client.1.smithi079.stdout:4/723: chown d6/d1a/d26/d2a/d54/f45 107964073 1 2024-05-09T06:29:38.624 INFO:tasks.workunit.client.1.smithi079.stdout:1/609: unlink d0/d12/d67/f41 0 2024-05-09T06:29:38.629 INFO:tasks.workunit.client.1.smithi079.stdout:6/705: link d0/d6/d16/d1f/d36/d69/dad/dd5/ce9 d0/d60/ced 0 2024-05-09T06:29:38.631 INFO:tasks.workunit.client.1.smithi079.stdout:9/871: symlink d1/d33/d28/d36/d4d/d7d/d19/db8/l12a 0 2024-05-09T06:29:38.631 INFO:tasks.workunit.client.1.smithi079.stdout:9/872: chown d1/d5/d9a 85 1 2024-05-09T06:29:38.634 INFO:tasks.workunit.client.1.smithi079.stdout:4/724: symlink d6/d15/lea 0 2024-05-09T06:29:38.634 INFO:tasks.workunit.client.1.smithi079.stdout:4/725: dread - d6/d1a/d41/d68/da1/dbe/fbf zero size 2024-05-09T06:29:38.634 INFO:tasks.workunit.client.1.smithi079.stdout:4/726: chown d6/d1a/d41/d68/da1/fa9 358983 1 2024-05-09T06:29:38.637 INFO:tasks.workunit.client.1.smithi079.stdout:1/610: mkdir d0/d12/dc0/dd4 0 2024-05-09T06:29:38.639 INFO:tasks.workunit.client.1.smithi079.stdout:6/706: write d0/d6/d1b/d20/dac/dc2/fc8 [845951,5919] 0 2024-05-09T06:29:38.640 INFO:tasks.workunit.client.1.smithi079.stdout:1/611: dread d0/d12/d67/d53/dbf/dd2/f8d [0,4194304] 0 2024-05-09T06:29:38.640 INFO:tasks.workunit.client.1.smithi079.stdout:1/612: readlink d0/d12/d48/d75/d43/d20/l60 0 2024-05-09T06:29:38.640 INFO:tasks.workunit.client.1.smithi079.stdout:1/613: write d0/d12/f8b [1236367,129846] 0 2024-05-09T06:29:38.643 INFO:tasks.workunit.client.1.smithi079.stdout:4/727: dread d6/fa [0,4194304] 0 2024-05-09T06:29:38.643 INFO:tasks.workunit.client.1.smithi079.stdout:4/728: write d6/f61 [4239473,21702] 0 2024-05-09T06:29:38.643 INFO:tasks.workunit.client.1.smithi079.stdout:4/729: readlink d6/d8/d27/d3d/l9d 0 2024-05-09T06:29:38.645 INFO:tasks.workunit.client.1.smithi079.stdout:6/707: mknod d0/d6/d16/dcd/dd7/cee 0 2024-05-09T06:29:38.645 INFO:tasks.workunit.client.1.smithi079.stdout:6/708: write d0/d6/d1b/db8/fdd [319361,13863] 0 2024-05-09T06:29:38.648 INFO:tasks.workunit.client.1.smithi079.stdout:1/614: truncate d0/d12/d67/d53/dbf/dd2/fb 3815805 0 2024-05-09T06:29:38.651 INFO:tasks.workunit.client.1.smithi079.stdout:9/873: rename d1/d33/d28/d36/db5 to d1/d33/d28/d4c/d97/d12b 0 2024-05-09T06:29:38.654 INFO:tasks.workunit.client.1.smithi079.stdout:4/730: symlink d6/d1a/d26/d2a/d54/dc8/leb 0 2024-05-09T06:29:38.656 INFO:tasks.workunit.client.1.smithi079.stdout:6/709: truncate d0/de/f3a 2260226 0 2024-05-09T06:29:38.656 INFO:tasks.workunit.client.1.smithi079.stdout:6/710: fdatasync d0/d6/d16/dcd/dce/f98 0 2024-05-09T06:29:38.660 INFO:tasks.workunit.client.1.smithi079.stdout:1/615: truncate d0/d12/d16/f84 4681793 0 2024-05-09T06:29:38.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:38 smithi062 ceph-mon[26920]: pgmap v248: 65 pgs: 65 active+clean; 1.3 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 115 MiB/s rd, 145 MiB/s wr, 768 op/s 2024-05-09T06:29:38.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:38.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:38.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:38 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:38.662 INFO:tasks.workunit.client.1.smithi079.stdout:9/874: symlink d1/d45/dc6/dc9/d2d/d99/dd5/l12c 0 2024-05-09T06:29:38.668 INFO:tasks.workunit.client.1.smithi079.stdout:4/731: dwrite d6/d1a/d41/fdd [0,4194304] 0 2024-05-09T06:29:38.679 INFO:tasks.workunit.client.1.smithi079.stdout:1/616: dwrite d0/d12/d67/d53/dbf/dd2/f9 [4194304,4194304] 0 2024-05-09T06:29:38.679 INFO:tasks.workunit.client.1.smithi079.stdout:6/711: getdents d0/d6/d16/d28 0 2024-05-09T06:29:38.679 INFO:tasks.workunit.client.1.smithi079.stdout:6/712: read - d0/d60/fb9 zero size 2024-05-09T06:29:38.680 INFO:tasks.workunit.client.1.smithi079.stdout:9/875: mknod d1/d33/d48/c12d 0 2024-05-09T06:29:38.687 INFO:tasks.workunit.client.1.smithi079.stdout:6/713: write d0/d6/d1b/db8/fe5 [5744085,63117] 0 2024-05-09T06:29:38.687 INFO:tasks.workunit.client.1.smithi079.stdout:6/714: dread - d0/d6/d16/d28/f73 zero size 2024-05-09T06:29:38.687 INFO:tasks.workunit.client.1.smithi079.stdout:6/715: chown d0/d6/d16/dcd/dce/ce2 172 1 2024-05-09T06:29:38.691 INFO:tasks.workunit.client.1.smithi079.stdout:4/732: creat d6/d1a/d26/d2a/d54/dc8/fec x:0 0 0 2024-05-09T06:29:38.695 INFO:tasks.workunit.client.1.smithi079.stdout:9/876: rename d1/d33/d28/d36/dcd/de7/d75/fc3 to d1/d6/d114/f12e 0 2024-05-09T06:29:38.698 INFO:tasks.workunit.client.1.smithi079.stdout:6/716: mkdir d0/d6/d16/d1f/d36/d69/def 0 2024-05-09T06:29:38.700 INFO:tasks.workunit.client.1.smithi079.stdout:4/733: link d6/d15/c69 d6/d8/d27/d3d/d5b/d9a/d8b/ced 0 2024-05-09T06:29:38.700 INFO:tasks.workunit.client.1.smithi079.stdout:4/734: stat d6/d8/d27/d3d/l9d 0 2024-05-09T06:29:38.700 INFO:tasks.workunit.client.1.smithi079.stdout:4/735: creat d6/d1a/d41/d68/da1/dbe/fee x:0 0 0 2024-05-09T06:29:38.700 INFO:tasks.workunit.client.1.smithi079.stdout:4/736: truncate d6/d8/d27/d3d/d5b/d9a/f86 1137065 0 2024-05-09T06:29:38.700 INFO:tasks.workunit.client.1.smithi079.stdout:4/737: fdatasync d6/d8/d27/f85 0 2024-05-09T06:29:38.701 INFO:tasks.workunit.client.1.smithi079.stdout:1/617: mknod d0/cd5 0 2024-05-09T06:29:38.703 INFO:tasks.workunit.client.1.smithi079.stdout:9/877: mknod d1/d33/d28/d36/d4d/d7d/d19/dd9/c12f 0 2024-05-09T06:29:38.705 INFO:tasks.workunit.client.1.smithi079.stdout:6/717: symlink d0/da2/db2/lf0 0 2024-05-09T06:29:38.706 INFO:tasks.workunit.client.1.smithi079.stdout:3/720: sync 2024-05-09T06:29:38.706 INFO:tasks.workunit.client.1.smithi079.stdout:0/617: sync 2024-05-09T06:29:38.706 INFO:tasks.workunit.client.1.smithi079.stdout:2/738: sync 2024-05-09T06:29:38.707 INFO:tasks.workunit.client.1.smithi079.stdout:7/619: sync 2024-05-09T06:29:38.707 INFO:tasks.workunit.client.1.smithi079.stdout:0/618: fsync d3/dd/d1f/d1e/d2c/d35/d36/f4c 0 2024-05-09T06:29:38.707 INFO:tasks.workunit.client.1.smithi079.stdout:5/758: sync 2024-05-09T06:29:38.707 INFO:tasks.workunit.client.1.smithi079.stdout:3/721: write f11 [4442910,25237] 0 2024-05-09T06:29:38.707 INFO:tasks.workunit.client.1.smithi079.stdout:3/722: chown d1a/d82/d87/fe1 108756 1 2024-05-09T06:29:38.707 INFO:tasks.workunit.client.1.smithi079.stdout:5/759: truncate d13/d43/d39/da7/fab 811942 0 2024-05-09T06:29:38.707 INFO:tasks.workunit.client.1.smithi079.stdout:5/760: stat d13/d43/d3d/d40/d63/cf0 0 2024-05-09T06:29:38.707 INFO:tasks.workunit.client.1.smithi079.stdout:0/619: write d3/dd/d66/d6d/fa2 [1022653,124374] 0 2024-05-09T06:29:38.708 INFO:tasks.workunit.client.1.smithi079.stdout:1/618: unlink d0/d12/d48/d75/c2d 0 2024-05-09T06:29:38.708 INFO:tasks.workunit.client.1.smithi079.stdout:1/619: fsync d0/d12/d48/d75/d43/d20/f91 0 2024-05-09T06:29:38.709 INFO:tasks.workunit.client.1.smithi079.stdout:1/620: stat d0/df/c56 0 2024-05-09T06:29:38.711 INFO:tasks.workunit.client.1.smithi079.stdout:9/878: creat d1/d33/d48/f130 x:0 0 0 2024-05-09T06:29:38.714 INFO:tasks.workunit.client.1.smithi079.stdout:6/718: rename d0/d6/d16/d28/f6a to d0/da2/db2/ff1 0 2024-05-09T06:29:38.716 INFO:tasks.workunit.client.1.smithi079.stdout:6/719: read d0/d6/f74 [325739,7596] 0 2024-05-09T06:29:38.717 INFO:tasks.workunit.client.1.smithi079.stdout:6/720: fsync d0/de/f85 0 2024-05-09T06:29:38.717 INFO:tasks.workunit.client.1.smithi079.stdout:4/738: dwrite d6/d1a/fa5 [0,4194304] 0 2024-05-09T06:29:38.717 INFO:tasks.workunit.client.1.smithi079.stdout:2/739: mkdir d8/db/dc/d2c/d107 0 2024-05-09T06:29:38.718 INFO:tasks.workunit.client.1.smithi079.stdout:5/761: symlink d13/d43/d3d/d40/d63/l102 0 2024-05-09T06:29:38.719 INFO:tasks.workunit.client.1.smithi079.stdout:0/620: truncate d3/dd/d1f/d1e/d2c/d35/d36/f4c 251984 0 2024-05-09T06:29:38.722 INFO:tasks.workunit.client.1.smithi079.stdout:7/620: getdents d4/d7/d78 0 2024-05-09T06:29:38.722 INFO:tasks.workunit.client.1.smithi079.stdout:7/621: chown d4/d7/d22/d28/d50/d5c/d85/db6/cc7 1 1 2024-05-09T06:29:38.722 INFO:tasks.workunit.client.1.smithi079.stdout:1/621: write d0/d12/d92/f9a [744161,32777] 0 2024-05-09T06:29:38.724 INFO:tasks.workunit.client.1.smithi079.stdout:6/721: mknod d0/d6/d16/d1f/d36/d69/d84/cf2 0 2024-05-09T06:29:38.725 INFO:tasks.workunit.client.1.smithi079.stdout:8/649: sync 2024-05-09T06:29:38.726 INFO:tasks.workunit.client.1.smithi079.stdout:9/879: dwrite d1/d33/d48/d64/de0/fe9 [0,4194304] 0 2024-05-09T06:29:38.731 INFO:tasks.workunit.client.1.smithi079.stdout:0/621: read d3/d5/fe [2732639,44789] 0 2024-05-09T06:29:38.732 INFO:tasks.workunit.client.1.smithi079.stdout:4/739: symlink d6/d8/d27/d3d/d5b/db4/dc3/lef 0 2024-05-09T06:29:38.733 INFO:tasks.workunit.client.1.smithi079.stdout:2/740: symlink d8/db/d59/d93/dc7/l108 0 2024-05-09T06:29:38.735 INFO:tasks.workunit.client.1.smithi079.stdout:4/740: dread d6/d1a/d26/d2a/f56 [0,4194304] 0 2024-05-09T06:29:38.735 INFO:tasks.workunit.client.1.smithi079.stdout:4/741: write d6/d8/fe3 [124147,41355] 0 2024-05-09T06:29:38.737 INFO:tasks.workunit.client.1.smithi079.stdout:5/762: creat d13/d43/d3d/d40/d9a/df8/f103 x:0 0 0 2024-05-09T06:29:38.737 INFO:tasks.workunit.client.1.smithi079.stdout:5/763: fsync d13/d43/d26/d35/f5e 0 2024-05-09T06:29:38.737 INFO:tasks.workunit.client.1.smithi079.stdout:5/764: stat d13/d43/d51/dc9 0 2024-05-09T06:29:38.738 INFO:tasks.workunit.client.1.smithi079.stdout:5/765: write d13/d43/d3d/d40/d63/f8c [1653606,93740] 0 2024-05-09T06:29:38.738 INFO:tasks.workunit.client.1.smithi079.stdout:5/766: readlink d13/d43/d3d/d40/d63/l102 0 2024-05-09T06:29:38.738 INFO:tasks.workunit.client.1.smithi079.stdout:5/767: write d13/d43/f3a [67087,94967] 0 2024-05-09T06:29:38.742 INFO:tasks.workunit.client.1.smithi079.stdout:2/741: dread d8/db/dc/f9b [0,4194304] 0 2024-05-09T06:29:38.742 INFO:tasks.workunit.client.1.smithi079.stdout:2/742: creat d8/db/d59/d67/d7f/db9/dca/f109 x:0 0 0 2024-05-09T06:29:38.744 INFO:tasks.workunit.client.1.smithi079.stdout:1/622: creat d0/d12/d67/d53/d6d/fd6 x:0 0 0 2024-05-09T06:29:38.746 INFO:tasks.workunit.client.1.smithi079.stdout:6/722: mkdir d0/d6/d16/d1f/df3 0 2024-05-09T06:29:38.746 INFO:tasks.workunit.client.1.smithi079.stdout:6/723: write d0/d6/d16/d1f/d36/d69/f7b [181356,99614] 0 2024-05-09T06:29:38.748 INFO:tasks.workunit.client.1.smithi079.stdout:6/724: dread d0/d6/d16/d1f/fc1 [0,4194304] 0 2024-05-09T06:29:38.753 INFO:tasks.workunit.client.1.smithi079.stdout:9/880: rmdir d1/d33/d28/d36/d4d 39 2024-05-09T06:29:38.753 INFO:tasks.workunit.client.1.smithi079.stdout:9/881: write d1/d5/faa [1330574,20081] 0 2024-05-09T06:29:38.756 INFO:tasks.workunit.client.1.smithi079.stdout:0/622: unlink d3/l6a 0 2024-05-09T06:29:38.758 INFO:tasks.workunit.client.1.smithi079.stdout:2/743: dwrite d8/db/dc/d2c/f31 [0,4194304] 0 2024-05-09T06:29:38.765 INFO:tasks.workunit.client.1.smithi079.stdout:4/742: link d6/d8/d27/d3d/l6c d6/d1a/d26/d2a/d54/d9e/dd5/df/lf0 0 2024-05-09T06:29:38.768 INFO:tasks.workunit.client.1.smithi079.stdout:5/768: creat d13/d43/d9e/f104 x:0 0 0 2024-05-09T06:29:38.768 INFO:tasks.workunit.client.1.smithi079.stdout:5/769: stat d13/d43/d39/d61/d72 0 2024-05-09T06:29:38.768 INFO:tasks.workunit.client.1.smithi079.stdout:5/770: creat d13/d43/d39/d61/d72/dbd/f105 x:0 0 0 2024-05-09T06:29:38.769 INFO:tasks.workunit.client.1.smithi079.stdout:3/723: rename d1a/d1c/d1f/d76 to d1a/d1c/d22/d53/d4e/dea 0 2024-05-09T06:29:38.771 INFO:tasks.workunit.client.1.smithi079.stdout:4/743: dread d6/d8/d27/d3d/f64 [0,4194304] 0 2024-05-09T06:29:38.771 INFO:tasks.workunit.client.1.smithi079.stdout:4/744: fdatasync d6/d1a/d26/d2a/f56 0 2024-05-09T06:29:38.772 INFO:tasks.workunit.client.1.smithi079.stdout:4/745: stat d6/d1a/d26/d2a/d98 0 2024-05-09T06:29:38.772 INFO:tasks.workunit.client.1.smithi079.stdout:4/746: fsync d6/d8/d27/d3d/d5b/db4/dc3/fe4 0 2024-05-09T06:29:38.773 INFO:tasks.workunit.client.1.smithi079.stdout:1/623: mkdir d0/d12/d48/dd7 0 2024-05-09T06:29:38.774 INFO:tasks.workunit.client.1.smithi079.stdout:0/623: dwrite d3/dd/d1f/d1e/d2c/d35/fc2 [0,4194304] 0 2024-05-09T06:29:38.775 INFO:tasks.workunit.client.1.smithi079.stdout:9/882: dwrite d1/d33/d48/d64/df4/f112 [0,4194304] 0 2024-05-09T06:29:38.776 INFO:tasks.workunit.client.1.smithi079.stdout:6/725: unlink d0/d6/d16/d1f/c86 0 2024-05-09T06:29:38.781 INFO:tasks.workunit.client.1.smithi079.stdout:2/744: mkdir d8/db/d59/d93/dc7/df8/d10a 0 2024-05-09T06:29:38.781 INFO:tasks.workunit.client.1.smithi079.stdout:2/745: write d8/db/d59/d67/fc1 [4861653,48532] 0 2024-05-09T06:29:38.783 INFO:tasks.workunit.client.1.smithi079.stdout:2/746: dread d8/db/d11/d79/d88/fcb [0,4194304] 0 2024-05-09T06:29:38.783 INFO:tasks.workunit.client.1.smithi079.stdout:2/747: creat d8/db/d11/d79/d88/f10b x:0 0 0 2024-05-09T06:29:38.785 INFO:tasks.workunit.client.1.smithi079.stdout:7/622: rename d4/d7/dd/d5b/d32/d86 to d4/d7/d37/d7c/dc9 0 2024-05-09T06:29:38.787 INFO:tasks.workunit.client.1.smithi079.stdout:3/724: mknod d1a/d1c/d22/d53/ceb 0 2024-05-09T06:29:38.789 INFO:tasks.workunit.client.1.smithi079.stdout:4/747: truncate d6/d1a/d26/d2a/d54/d9e/dd5/d34/f52 3415310 0 2024-05-09T06:29:38.792 INFO:tasks.workunit.client.1.smithi079.stdout:1/624: creat d0/d12/d48/d75/d43/d20/fd8 x:0 0 0 2024-05-09T06:29:38.798 INFO:tasks.workunit.client.1.smithi079.stdout:0/624: symlink d3/dd/d66/d6d/d74/d84/db7/lc6 0 2024-05-09T06:29:38.798 INFO:tasks.workunit.client.1.smithi079.stdout:0/625: dread - d3/dd/d66/d6d/fc5 zero size 2024-05-09T06:29:38.803 INFO:tasks.workunit.client.1.smithi079.stdout:7/623: dwrite d4/d7/d22/d28/d50/d5c/d85/db6/fc4 [0,4194304] 0 2024-05-09T06:29:38.803 INFO:tasks.workunit.client.1.smithi079.stdout:7/624: dread - d4/d7/dd/d5b/d6f/f62 zero size 2024-05-09T06:29:38.803 INFO:tasks.workunit.client.1.smithi079.stdout:7/625: dread - d4/d7/d22/d28/d74/f76 zero size 2024-05-09T06:29:38.810 INFO:tasks.workunit.client.1.smithi079.stdout:9/883: symlink d1/d33/d28/d36/d6c/d117/l131 0 2024-05-09T06:29:38.810 INFO:tasks.workunit.client.1.smithi079.stdout:9/884: truncate d1/d33/d28/fec 819266 0 2024-05-09T06:29:38.812 INFO:tasks.workunit.client.1.smithi079.stdout:0/626: write d3/dd/d18/fad [2253105,106606] 0 2024-05-09T06:29:38.812 INFO:tasks.workunit.client.1.smithi079.stdout:0/627: write d3/faa [744146,44608] 0 2024-05-09T06:29:38.828 INFO:tasks.workunit.client.1.smithi079.stdout:2/748: rmdir d8/db/d59/d93/dc7/df6 0 2024-05-09T06:29:38.828 INFO:tasks.workunit.client.1.smithi079.stdout:2/749: fdatasync d8/db/dc/fd 0 2024-05-09T06:29:38.829 INFO:tasks.workunit.client.1.smithi079.stdout:2/750: chown d8/db/dc/d2c/f63 8539 1 2024-05-09T06:29:38.836 INFO:tasks.workunit.client.1.smithi079.stdout:5/771: rename d13/c30 to d13/d43/ddb/c106 0 2024-05-09T06:29:38.836 INFO:tasks.workunit.client.1.smithi079.stdout:3/725: mkdir d1a/d1c/d22/d53/da5/dec 0 2024-05-09T06:29:38.836 INFO:tasks.workunit.client.1.smithi079.stdout:3/726: getdents d1a/d21/db0/de5 0 2024-05-09T06:29:38.837 INFO:tasks.workunit.client.1.smithi079.stdout:7/626: dwrite d4/d7/dd/fc2 [0,4194304] 0 2024-05-09T06:29:38.838 INFO:tasks.workunit.client.1.smithi079.stdout:4/748: unlink d6/c22 0 2024-05-09T06:29:38.839 INFO:tasks.workunit.client.1.smithi079.stdout:1/625: rmdir d0/d12/d67/d53/dbf/dd2/d4e 39 2024-05-09T06:29:38.839 INFO:tasks.workunit.client.1.smithi079.stdout:1/626: readlink d0/d12/d48/d75/d43/d20/l60 0 2024-05-09T06:29:38.840 INFO:tasks.workunit.client.1.smithi079.stdout:6/726: dread d0/d6/d16/f30 [0,4194304] 0 2024-05-09T06:29:38.840 INFO:tasks.workunit.client.1.smithi079.stdout:9/885: dwrite d1/f9f [4194304,4194304] 0 2024-05-09T06:29:38.849 INFO:tasks.workunit.client.1.smithi079.stdout:3/727: dread d1a/d1c/d1f/f75 [0,4194304] 0 2024-05-09T06:29:38.852 INFO:tasks.workunit.client.1.smithi079.stdout:2/751: mkdir d8/db/d9d/d10c 0 2024-05-09T06:29:38.852 INFO:tasks.workunit.client.1.smithi079.stdout:2/752: fdatasync d8/db/d11/d5f/f75 0 2024-05-09T06:29:38.852 INFO:tasks.workunit.client.1.smithi079.stdout:2/753: dread - d8/db/d9d/f104 zero size 2024-05-09T06:29:38.852 INFO:tasks.workunit.client.1.smithi079.stdout:2/754: stat d8/db/dc/d2c/d107 0 2024-05-09T06:29:38.855 INFO:tasks.workunit.client.1.smithi079.stdout:5/772: dwrite d13/d43/d26/d35/f56 [0,4194304] 0 2024-05-09T06:29:38.858 INFO:tasks.workunit.client.1.smithi079.stdout:7/627: mknod d4/cca 0 2024-05-09T06:29:38.859 INFO:tasks.workunit.client.1.smithi079.stdout:7/628: readlink d4/d7/dd/d5b/l36 0 2024-05-09T06:29:38.860 INFO:tasks.workunit.client.1.smithi079.stdout:4/749: mkdir d6/d1a/d26/d2a/dde/df1 0 2024-05-09T06:29:38.861 INFO:tasks.workunit.client.1.smithi079.stdout:1/627: dwrite d0/d12/d67/d53/f7a [0,4194304] 0 2024-05-09T06:29:38.863 INFO:tasks.workunit.client.1.smithi079.stdout:6/727: truncate d0/fc 1138062 0 2024-05-09T06:29:38.864 INFO:tasks.workunit.client.1.smithi079.stdout:6/728: write d0/d6/d5e/f71 [1105614,52484] 0 2024-05-09T06:29:38.864 INFO:tasks.workunit.client.1.smithi079.stdout:6/729: creat d0/d60/daf/ff4 x:0 0 0 2024-05-09T06:29:38.864 INFO:tasks.workunit.client.1.smithi079.stdout:6/730: readlink d0/d6/d16/dcd/dce/ld6 0 2024-05-09T06:29:38.865 INFO:tasks.workunit.client.1.smithi079.stdout:9/886: rmdir d1/d33/d28/d36/d6c 39 2024-05-09T06:29:38.865 INFO:tasks.workunit.client.1.smithi079.stdout:9/887: fsync d1/f123 0 2024-05-09T06:29:38.865 INFO:tasks.workunit.client.1.smithi079.stdout:9/888: write d1/d33/d28/d36/d4d/d7d/d19/f80 [1340557,34362] 0 2024-05-09T06:29:38.870 INFO:tasks.workunit.client.1.smithi079.stdout:9/889: read d1/d33/d28/d36/dcd/de7/f44 [1556539,9217] 0 2024-05-09T06:29:38.874 INFO:tasks.workunit.client.1.smithi079.stdout:5/773: link d13/d43/d3d/d40/d63/da2/d8b/fe8 d13/d43/d3d/d40/d63/da2/d8b/f107 0 2024-05-09T06:29:38.874 INFO:tasks.workunit.client.1.smithi079.stdout:5/774: write d13/d43/d26/f33 [3143706,8336] 0 2024-05-09T06:29:38.875 INFO:tasks.workunit.client.1.smithi079.stdout:7/629: mknod d4/d7/dd/d5b/d6f/ccb 0 2024-05-09T06:29:38.878 INFO:tasks.workunit.client.1.smithi079.stdout:4/750: creat d6/d1a/d41/d68/ff2 x:0 0 0 2024-05-09T06:29:38.878 INFO:tasks.workunit.client.1.smithi079.stdout:4/751: fsync d6/d1a/d26/d2a/d54/d9e/dd5/f2f 0 2024-05-09T06:29:38.878 INFO:tasks.workunit.client.1.smithi079.stdout:4/752: write d6/d1a/d26/d2a/f2d [714026,17929] 0 2024-05-09T06:29:38.878 INFO:tasks.workunit.client.1.smithi079.stdout:4/753: write d6/d1a/fa5 [4427709,56832] 0 2024-05-09T06:29:38.879 INFO:tasks.workunit.client.1.smithi079.stdout:5/775: write d13/d92/dcd/fd4 [1742546,11131] 0 2024-05-09T06:29:38.879 INFO:tasks.workunit.client.1.smithi079.stdout:5/776: fdatasync d13/d43/d39/da7/fa9 0 2024-05-09T06:29:38.879 INFO:tasks.workunit.client.1.smithi079.stdout:1/628: symlink d0/d12/d48/d75/d43/ld9 0 2024-05-09T06:29:38.879 INFO:tasks.workunit.client.1.smithi079.stdout:1/629: chown d0/d12/f1a 223 1 2024-05-09T06:29:38.883 INFO:tasks.workunit.client.1.smithi079.stdout:6/731: mknod d0/d6/d1b/cf5 0 2024-05-09T06:29:38.887 INFO:tasks.workunit.client.1.smithi079.stdout:3/728: getdents d1a/d1c/d22/d90 0 2024-05-09T06:29:38.887 INFO:tasks.workunit.client.1.smithi079.stdout:3/729: read f5 [3597411,100791] 0 2024-05-09T06:29:38.890 INFO:tasks.workunit.client.1.smithi079.stdout:2/755: mknod d8/db/dc/d2c/d2e/c10d 0 2024-05-09T06:29:38.891 INFO:tasks.workunit.client.1.smithi079.stdout:9/890: mknod d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/dd7/c132 0 2024-05-09T06:29:38.898 INFO:tasks.workunit.client.1.smithi079.stdout:7/630: rename d4/d7/d37/d7c/dc9 to d4/d7/d37/d90/dcc 0 2024-05-09T06:29:38.898 INFO:tasks.workunit.client.1.smithi079.stdout:7/631: fsync d4/d7/d37/f57 0 2024-05-09T06:29:38.899 INFO:tasks.workunit.client.1.smithi079.stdout:4/754: dwrite d6/d8/d27/fb2 [0,4194304] 0 2024-05-09T06:29:38.900 INFO:tasks.workunit.client.1.smithi079.stdout:4/755: stat d6/d1a/d41/d68/da1/fc2 0 2024-05-09T06:29:38.901 INFO:tasks.workunit.client.1.smithi079.stdout:4/756: dread d6/d1a/d41/d68/da1/fa9 [0,4194304] 0 2024-05-09T06:29:38.901 INFO:tasks.workunit.client.1.smithi079.stdout:4/757: fsync d6/d8/f4f 0 2024-05-09T06:29:38.902 INFO:tasks.workunit.client.1.smithi079.stdout:5/777: mknod d13/d43/d3d/d40/d63/c108 0 2024-05-09T06:29:38.903 INFO:tasks.workunit.client.1.smithi079.stdout:1/630: symlink d0/d12/d48/d75/d43/dbd/lda 0 2024-05-09T06:29:38.904 INFO:tasks.workunit.client.1.smithi079.stdout:1/631: read d0/df/f8f [286,58161] 0 2024-05-09T06:29:38.906 INFO:tasks.workunit.client.1.smithi079.stdout:6/732: mkdir d0/d6/d5e/df6 0 2024-05-09T06:29:38.908 INFO:tasks.workunit.client.1.smithi079.stdout:3/730: creat d1a/d1c/d22/d53/d4e/dc3/fed x:0 0 0 2024-05-09T06:29:38.912 INFO:tasks.workunit.client.1.smithi079.stdout:2/756: creat d8/db/d59/d67/d86/dd5/f10e x:0 0 0 2024-05-09T06:29:38.916 INFO:tasks.workunit.client.1.smithi079.stdout:1/632: write d0/d12/d48/d75/d43/f15 [6450371,38931] 0 2024-05-09T06:29:38.916 INFO:tasks.workunit.client.1.smithi079.stdout:6/733: write d0/d6/d16/d28/f67 [2010772,53805] 0 2024-05-09T06:29:38.916 INFO:tasks.workunit.client.1.smithi079.stdout:6/734: write d0/d6/f83 [882041,18154] 0 2024-05-09T06:29:38.916 INFO:tasks.workunit.client.1.smithi079.stdout:7/632: link d4/d7/dd/d5b/d31/d34/fa6 d4/d7/dd/d5b/d32/da0/fcd 0 2024-05-09T06:29:38.917 INFO:tasks.workunit.client.1.smithi079.stdout:7/633: creat d4/d7/dd/d5b/d31/fce x:0 0 0 2024-05-09T06:29:38.917 INFO:tasks.workunit.client.1.smithi079.stdout:7/634: chown d4/d7/d22/d28/d50/d5c 2826 1 2024-05-09T06:29:38.922 INFO:tasks.workunit.client.1.smithi079.stdout:4/758: getdents d6/d1a/d26/d2a/dde 0 2024-05-09T06:29:38.925 INFO:tasks.workunit.client.1.smithi079.stdout:5/778: unlink d13/d43/d26/d35/f5e 0 2024-05-09T06:29:38.925 INFO:tasks.workunit.client.1.smithi079.stdout:5/779: chown d13/d43/d3d/d40/d9a 6629 1 2024-05-09T06:29:38.931 INFO:tasks.workunit.client.1.smithi079.stdout:2/757: dwrite d8/db/d59/d93/fe6 [0,4194304] 0 2024-05-09T06:29:38.931 INFO:tasks.workunit.client.1.smithi079.stdout:2/758: write d8/db/d11/d79/d88/fd7 [1372348,14697] 0 2024-05-09T06:29:38.931 INFO:tasks.workunit.client.1.smithi079.stdout:2/759: read d8/db/d11/d79/d88/fc3 [80215,9954] 0 2024-05-09T06:29:38.938 INFO:tasks.workunit.client.1.smithi079.stdout:9/891: rmdir d1/d33/d28/d36/dcd 39 2024-05-09T06:29:38.939 INFO:tasks.workunit.client.1.smithi079.stdout:4/759: dwrite d6/d1a/d41/d68/d6b/f81 [0,4194304] 0 2024-05-09T06:29:38.943 INFO:tasks.workunit.client.1.smithi079.stdout:1/633: mkdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb 0 2024-05-09T06:29:38.946 INFO:tasks.workunit.client.1.smithi079.stdout:9/892: dread d1/d45/dc6/dc9/f54 [0,4194304] 0 2024-05-09T06:29:38.946 INFO:tasks.workunit.client.1.smithi079.stdout:9/893: readlink d1/d45/dc6/dc9/d2d/d99/dd5/l12c 0 2024-05-09T06:29:38.949 INFO:tasks.workunit.client.1.smithi079.stdout:2/760: dwrite d8/db/d5c/fc6 [4194304,4194304] 0 2024-05-09T06:29:38.951 INFO:tasks.workunit.client.1.smithi079.stdout:7/635: unlink d4/d7/d22/d28/d50/d5c/d85/db6/fbb 0 2024-05-09T06:29:38.951 INFO:tasks.workunit.client.1.smithi079.stdout:7/636: creat d4/d7/d22/d28/d74/fcf x:0 0 0 2024-05-09T06:29:38.952 INFO:tasks.workunit.client.1.smithi079.stdout:5/780: mknod d13/d43/d39/c109 0 2024-05-09T06:29:38.952 INFO:tasks.workunit.client.1.smithi079.stdout:5/781: fsync d13/d4f/f78 0 2024-05-09T06:29:38.957 INFO:tasks.workunit.client.1.smithi079.stdout:4/760: mkdir d6/d1a/d26/d2a/dde/df1/df3 0 2024-05-09T06:29:38.959 INFO:tasks.workunit.client.1.smithi079.stdout:1/634: creat d0/d12/d67/db6/d89/fdc x:0 0 0 2024-05-09T06:29:38.960 INFO:tasks.workunit.client.1.smithi079.stdout:6/735: dwrite d0/d6/d16/d1f/d6f/d8c/d93/f9e [0,4194304] 0 2024-05-09T06:29:38.961 INFO:tasks.workunit.client.1.smithi079.stdout:9/894: symlink d1/d33/d28/d4c/d97/dd3/ded/def/l133 0 2024-05-09T06:29:38.967 INFO:tasks.workunit.client.1.smithi079.stdout:2/761: creat d8/db/dc/d2c/d2e/f10f x:0 0 0 2024-05-09T06:29:38.974 INFO:tasks.workunit.client.1.smithi079.stdout:7/637: link d4/d7/f49 d4/d7/fd0 0 2024-05-09T06:29:38.974 INFO:tasks.workunit.client.1.smithi079.stdout:7/638: write d4/d7/dd/d5b/d31/d34/f7a [1186031,11478] 0 2024-05-09T06:29:38.974 INFO:tasks.workunit.client.1.smithi079.stdout:7/639: fdatasync d4/d7/dd/f16 0 2024-05-09T06:29:38.974 INFO:tasks.workunit.client.1.smithi079.stdout:7/640: read - d4/d7/d22/d28/d50/d5c/fad zero size 2024-05-09T06:29:38.976 INFO:tasks.workunit.client.1.smithi079.stdout:9/895: dwrite d1/d33/d28/d36/d4d/d7d/d19/fa6 [0,4194304] 0 2024-05-09T06:29:38.976 INFO:tasks.workunit.client.1.smithi079.stdout:9/896: dread - d1/d5/d91/f11f zero size 2024-05-09T06:29:38.976 INFO:tasks.workunit.client.1.smithi079.stdout:5/782: rename d13/d92/dcd/fd4 to d13/d4f/d80/f10a 0 2024-05-09T06:29:38.976 INFO:tasks.workunit.client.1.smithi079.stdout:5/783: readlink d13/d2a/l65 0 2024-05-09T06:29:38.977 INFO:tasks.workunit.client.1.smithi079.stdout:5/784: getdents d13/da5/de4/d101 0 2024-05-09T06:29:38.982 INFO:tasks.workunit.client.1.smithi079.stdout:1/635: getdents d0/d12/d67/d53/dbf/dd2/d4e 0 2024-05-09T06:29:38.983 INFO:tasks.workunit.client.1.smithi079.stdout:8/650: sync 2024-05-09T06:29:38.989 INFO:tasks.workunit.client.1.smithi079.stdout:7/641: dread d4/d7/d22/f23 [0,4194304] 0 2024-05-09T06:29:38.998 INFO:tasks.workunit.client.1.smithi079.stdout:6/736: creat d0/d6/d16/dcd/dd7/ff7 x:0 0 0 2024-05-09T06:29:38.999 INFO:tasks.workunit.client.1.smithi079.stdout:5/785: dwrite fc [4194304,4194304] 0 2024-05-09T06:29:38.999 INFO:tasks.workunit.client.1.smithi079.stdout:5/786: creat d13/d4f/f10b x:0 0 0 2024-05-09T06:29:38.999 INFO:tasks.workunit.client.1.smithi079.stdout:5/787: write d13/d43/d39/d61/fa6 [1337027,23183] 0 2024-05-09T06:29:39.000 INFO:tasks.workunit.client.1.smithi079.stdout:2/762: symlink d8/db/d59/d67/d7f/l110 0 2024-05-09T06:29:39.001 INFO:tasks.workunit.client.1.smithi079.stdout:4/761: write d6/d1a/d26/d2a/d54/d9e/dd5/d34/f52 [3919589,61345] 0 2024-05-09T06:29:39.003 INFO:tasks.workunit.client.1.smithi079.stdout:9/897: write d1/d45/dc6/dc9/fd0 [816315,79553] 0 2024-05-09T06:29:39.008 INFO:tasks.workunit.client.1.smithi079.stdout:1/636: creat d0/d12/d48/d75/d97/fdd x:0 0 0 2024-05-09T06:29:39.010 INFO:tasks.workunit.client.1.smithi079.stdout:0/628: sync 2024-05-09T06:29:39.012 INFO:tasks.workunit.client.1.smithi079.stdout:7/642: write d4/d7/dd/fc2 [4614120,107118] 0 2024-05-09T06:29:39.014 INFO:tasks.workunit.client.1.smithi079.stdout:6/737: link d0/d6/d1b/db8/fe5 d0/d6/d16/d1f/d36/d69/def/ff8 0 2024-05-09T06:29:39.014 INFO:tasks.workunit.client.1.smithi079.stdout:6/738: chown d0/d6/d16/d1f/d36/d69/d84/f91 21 1 2024-05-09T06:29:39.014 INFO:tasks.workunit.client.1.smithi079.stdout:6/739: write d0/d6/d16/d1f/d6f/d8c/d93/f97 [745861,85360] 0 2024-05-09T06:29:39.014 INFO:tasks.workunit.client.1.smithi079.stdout:6/740: stat d0/d6/d16/dcd/dce/fa4 0 2024-05-09T06:29:39.014 INFO:tasks.workunit.client.1.smithi079.stdout:6/741: truncate d0/d6/d1b/db8/fda 61013 0 2024-05-09T06:29:39.016 INFO:tasks.workunit.client.1.smithi079.stdout:5/788: dwrite d13/d43/d3d/d40/f42 [0,4194304] 0 2024-05-09T06:29:39.016 INFO:tasks.workunit.client.1.smithi079.stdout:5/789: readlink d13/d43/d26/l95 0 2024-05-09T06:29:39.016 INFO:tasks.workunit.client.1.smithi079.stdout:5/790: chown d13/d43/ddb/c106 13 1 2024-05-09T06:29:39.019 INFO:tasks.workunit.client.1.smithi079.stdout:2/763: link d8/db/d4b/d4f/d51/l53 d8/db/d9d/l111 0 2024-05-09T06:29:39.025 INFO:tasks.workunit.client.1.smithi079.stdout:5/791: dread d13/d43/d39/f86 [0,4194304] 0 2024-05-09T06:29:39.025 INFO:tasks.workunit.client.1.smithi079.stdout:1/637: dread d0/d12/d67/d53/f7a [4194304,4194304] 0 2024-05-09T06:29:39.025 INFO:tasks.workunit.client.1.smithi079.stdout:8/651: write d1/db/f27 [1313478,94775] 0 2024-05-09T06:29:39.026 INFO:tasks.workunit.client.1.smithi079.stdout:9/898: link d1/d33/d28/d36/d4d/fda d1/d5/f134 0 2024-05-09T06:29:39.028 INFO:tasks.workunit.client.1.smithi079.stdout:0/629: fdatasync d3/dd/d66/d6d/d74/d80/f56 0 2024-05-09T06:29:39.033 INFO:tasks.workunit.client.1.smithi079.stdout:6/742: symlink d0/d6/d16/dcd/dce/lf9 0 2024-05-09T06:29:39.033 INFO:tasks.workunit.client.1.smithi079.stdout:6/743: dread - d0/d6/d16/d1f/d6f/d8c/d93/fc4 zero size 2024-05-09T06:29:39.036 INFO:tasks.workunit.client.1.smithi079.stdout:1/638: dread d0/d12/d48/d75/d43/f47 [0,4194304] 0 2024-05-09T06:29:39.036 INFO:tasks.workunit.client.1.smithi079.stdout:2/764: creat d8/db/d4b/d4f/d51/f112 x:0 0 0 2024-05-09T06:29:39.036 INFO:tasks.workunit.client.1.smithi079.stdout:4/762: creat d6/d8/d27/d3d/d5b/ff4 x:0 0 0 2024-05-09T06:29:39.037 INFO:tasks.workunit.client.1.smithi079.stdout:4/763: dread - d6/d8/d27/d3d/d5b/ff4 zero size 2024-05-09T06:29:39.038 INFO:tasks.workunit.client.1.smithi079.stdout:7/643: write d4/d7/dd/d5b/d31/d34/f87 [3022692,75059] 0 2024-05-09T06:29:39.039 INFO:tasks.workunit.client.1.smithi079.stdout:5/792: unlink d13/d43/d39/cda 0 2024-05-09T06:29:39.040 INFO:tasks.workunit.client.1.smithi079.stdout:8/652: creat d1/d3/dc4/fe4 x:0 0 0 2024-05-09T06:29:39.040 INFO:tasks.workunit.client.1.smithi079.stdout:9/899: truncate d1/d33/d48/d64/f7c 443005 0 2024-05-09T06:29:39.049 INFO:tasks.workunit.client.1.smithi079.stdout:8/653: rename d1/d3/d20/c85 to d1/ce5 0 2024-05-09T06:29:39.049 INFO:tasks.workunit.client.1.smithi079.stdout:2/765: dread d8/db/dc/d2c/d2e/f54 [0,4194304] 0 2024-05-09T06:29:39.050 INFO:tasks.workunit.client.1.smithi079.stdout:6/744: rmdir d0/d60 39 2024-05-09T06:29:39.051 INFO:tasks.workunit.client.1.smithi079.stdout:0/630: link d3/dd/d66/d6d/d74/d80/c73 d3/dd/d71/cc7 0 2024-05-09T06:29:39.052 INFO:tasks.workunit.client.1.smithi079.stdout:7/644: write d4/d7/f2b [2517447,43954] 0 2024-05-09T06:29:39.052 INFO:tasks.workunit.client.1.smithi079.stdout:7/645: fdatasync d4/f11 0 2024-05-09T06:29:39.053 INFO:tasks.workunit.client.1.smithi079.stdout:4/764: getdents d6/d1a/d41/d68/da1/dbe 0 2024-05-09T06:29:39.053 INFO:tasks.workunit.client.1.smithi079.stdout:4/765: write d6/d8/d27/d3d/d5b/db4/dc3/fe4 [1047530,13570] 0 2024-05-09T06:29:39.054 INFO:tasks.workunit.client.1.smithi079.stdout:8/654: creat d1/d56/fe6 x:0 0 0 2024-05-09T06:29:39.056 INFO:tasks.workunit.client.1.smithi079.stdout:2/766: truncate d8/db/d59/d67/d7f/db9/dca/fe2 1462920 0 2024-05-09T06:29:39.056 INFO:tasks.workunit.client.1.smithi079.stdout:2/767: truncate d8/df7/f80 1508734 0 2024-05-09T06:29:39.057 INFO:tasks.workunit.client.1.smithi079.stdout:1/639: read d0/d12/f18 [3118237,41399] 0 2024-05-09T06:29:39.057 INFO:tasks.workunit.client.1.smithi079.stdout:1/640: readlink d0/d12/d48/d75/l8e 0 2024-05-09T06:29:39.058 INFO:tasks.workunit.client.1.smithi079.stdout:6/745: unlink d0/d6/c9 0 2024-05-09T06:29:39.058 INFO:tasks.workunit.client.1.smithi079.stdout:6/746: fsync d0/d6/d16/d1f/d36/f54 0 2024-05-09T06:29:39.058 INFO:tasks.workunit.client.1.smithi079.stdout:6/747: chown d0/d6/d16/d1f/d36/d69/d84/f94 0 1 2024-05-09T06:29:39.059 INFO:tasks.workunit.client.1.smithi079.stdout:0/631: unlink d3/dd/d1f/d1e/f42 0 2024-05-09T06:29:39.062 INFO:tasks.workunit.client.1.smithi079.stdout:7/646: creat d4/d7/d22/d28/fd1 x:0 0 0 2024-05-09T06:29:39.062 INFO:tasks.workunit.client.1.smithi079.stdout:7/647: dread - d4/d7/f49 zero size 2024-05-09T06:29:39.062 INFO:tasks.workunit.client.1.smithi079.stdout:7/648: chown d4/d7/l7d 1 1 2024-05-09T06:29:39.064 INFO:tasks.workunit.client.1.smithi079.stdout:8/655: unlink d1/d3/d20/d7f/dc3/d82/cdc 0 2024-05-09T06:29:39.064 INFO:tasks.workunit.client.1.smithi079.stdout:8/656: write d1/db/daf/f9d [651825,28693] 0 2024-05-09T06:29:39.068 INFO:tasks.workunit.client.1.smithi079.stdout:1/641: link d0/d12/d67/d53/dbf/dd2/d4e/d7d/fb7 d0/d12/d67/d53/d5e/fde 0 2024-05-09T06:29:39.070 INFO:tasks.workunit.client.1.smithi079.stdout:6/748: link d0/d60/d81/c82 d0/d6/d16/d1f/d36/db5/cfa 0 2024-05-09T06:29:39.070 INFO:tasks.workunit.client.1.smithi079.stdout:6/749: stat d0/d6/d16/d1f/d36/f54 0 2024-05-09T06:29:39.072 INFO:tasks.workunit.client.1.smithi079.stdout:0/632: mkdir d3/dd/dc8 0 2024-05-09T06:29:39.073 INFO:tasks.workunit.client.1.smithi079.stdout:6/750: write d0/d6/d1b/fa0 [103670,129718] 0 2024-05-09T06:29:39.073 INFO:tasks.workunit.client.1.smithi079.stdout:9/900: dwrite d1/d5/d5b/f89 [0,4194304] 0 2024-05-09T06:29:39.075 INFO:tasks.workunit.client.1.smithi079.stdout:5/793: dwrite d13/d43/f36 [0,4194304] 0 2024-05-09T06:29:39.076 INFO:tasks.workunit.client.1.smithi079.stdout:8/657: mkdir d1/d3/d20/d7f/dc3/d44/de7 0 2024-05-09T06:29:39.080 INFO:tasks.workunit.client.1.smithi079.stdout:1/642: truncate d0/df/f24 395979 0 2024-05-09T06:29:39.080 INFO:tasks.workunit.client.1.smithi079.stdout:0/633: mkdir d3/dd/d1f/d1e/d91/dc9 0 2024-05-09T06:29:39.082 INFO:tasks.workunit.client.1.smithi079.stdout:6/751: mkdir d0/d6/d16/d1f/d36/dfb 0 2024-05-09T06:29:39.082 INFO:tasks.workunit.client.1.smithi079.stdout:6/752: chown d0/d6/c70 1041162698 1 2024-05-09T06:29:39.092 INFO:tasks.workunit.client.1.smithi079.stdout:7/649: dwrite d4/d7/d78/fa3 [0,4194304] 0 2024-05-09T06:29:39.092 INFO:tasks.workunit.client.1.smithi079.stdout:7/650: chown d4/d7/dd/d5b/d31/d34/cb7 394 1 2024-05-09T06:29:39.092 INFO:tasks.workunit.client.1.smithi079.stdout:9/901: rename d1/d33/d28/d36/d4d/fda to d1/d6/d114/f135 0 2024-05-09T06:29:39.093 INFO:tasks.workunit.client.1.smithi079.stdout:9/902: chown d1/d6/lc5 4491248 1 2024-05-09T06:29:39.095 INFO:tasks.workunit.client.1.smithi079.stdout:5/794: creat d13/d43/d51/f10c x:0 0 0 2024-05-09T06:29:39.095 INFO:tasks.workunit.client.1.smithi079.stdout:5/795: write d13/d43/d39/d61/d72/dbd/fd3 [852137,50243] 0 2024-05-09T06:29:39.096 INFO:tasks.workunit.client.1.smithi079.stdout:2/768: dwrite d8/db/dc/d2c/f63 [0,4194304] 0 2024-05-09T06:29:39.097 INFO:tasks.workunit.client.1.smithi079.stdout:8/658: link d1/d3/d20/d7f/dc3/f9f d1/d3/d20/d7f/dc3/d82/fe8 0 2024-05-09T06:29:39.097 INFO:tasks.workunit.client.1.smithi079.stdout:8/659: write d1/f8 [3269673,45698] 0 2024-05-09T06:29:39.099 INFO:tasks.workunit.client.1.smithi079.stdout:1/643: symlink d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ldf 0 2024-05-09T06:29:39.099 INFO:tasks.workunit.client.1.smithi079.stdout:1/644: write d0/d12/d48/d75/d43/d70/f86 [4799688,9235] 0 2024-05-09T06:29:39.099 INFO:tasks.workunit.client.1.smithi079.stdout:1/645: truncate d0/d12/d67/d53/fce 33114 0 2024-05-09T06:29:39.100 INFO:tasks.workunit.client.1.smithi079.stdout:0/634: creat d3/dd/d1f/d1e/d2c/d35/d36/fca x:0 0 0 2024-05-09T06:29:39.102 INFO:tasks.workunit.client.1.smithi079.stdout:6/753: truncate d0/de/f85 2700211 0 2024-05-09T06:29:39.102 INFO:tasks.workunit.client.1.smithi079.stdout:6/754: truncate d0/fc 1210452 0 2024-05-09T06:29:39.107 INFO:tasks.workunit.client.1.smithi079.stdout:7/651: rmdir d4/d7/d37/d90 39 2024-05-09T06:29:39.110 INFO:tasks.workunit.client.1.smithi079.stdout:9/903: mknod d1/d33/d28/d36/dcd/de7/c136 0 2024-05-09T06:29:39.110 INFO:tasks.workunit.client.1.smithi079.stdout:9/904: write d1/d33/d28/d36/dcd/f127 [930714,64827] 0 2024-05-09T06:29:39.110 INFO:tasks.workunit.client.1.smithi079.stdout:9/905: creat d1/d5/d9a/f137 x:0 0 0 2024-05-09T06:29:39.114 INFO:tasks.workunit.client.1.smithi079.stdout:5/796: mknod d13/d43/d51/c10d 0 2024-05-09T06:29:39.127 INFO:tasks.workunit.client.1.smithi079.stdout:2/769: symlink d8/db/d11/d5f/l113 0 2024-05-09T06:29:39.127 INFO:tasks.workunit.client.1.smithi079.stdout:2/770: readlink d8/db/d11/d79/lba 0 2024-05-09T06:29:39.130 INFO:tasks.workunit.client.1.smithi079.stdout:8/660: creat d1/d3/d20/d7f/dc3/d3b/fe9 x:0 0 0 2024-05-09T06:29:39.130 INFO:tasks.workunit.client.1.smithi079.stdout:8/661: readlink d1/d3/d20/d7f/dc3/d44/l2d 0 2024-05-09T06:29:39.132 INFO:tasks.workunit.client.1.smithi079.stdout:1/646: getdents d0 0 2024-05-09T06:29:39.135 INFO:tasks.workunit.client.1.smithi079.stdout:0/635: symlink d3/dd/d1f/d1e/d2c/dc0/lcb 0 2024-05-09T06:29:39.135 INFO:tasks.workunit.client.1.smithi079.stdout:2/771: dread d8/db/d4b/d4f/d51/d6d/f6e [0,4194304] 0 2024-05-09T06:29:39.142 INFO:tasks.workunit.client.1.smithi079.stdout:1/647: write d0/f5 [2788357,50739] 0 2024-05-09T06:29:39.147 INFO:tasks.workunit.client.1.smithi079.stdout:7/652: read d4/d7/dd/f21 [3431815,61730] 0 2024-05-09T06:29:39.151 INFO:tasks.workunit.client.1.smithi079.stdout:7/653: dread d4/d7/f2b [0,4194304] 0 2024-05-09T06:29:39.151 INFO:tasks.workunit.client.1.smithi079.stdout:9/906: creat d1/d33/d28/d4c/d97/dd3/ded/def/f138 x:0 0 0 2024-05-09T06:29:39.154 INFO:tasks.workunit.client.1.smithi079.stdout:5/797: creat d13/da5/de4/d101/f10e x:0 0 0 2024-05-09T06:29:39.154 INFO:tasks.workunit.client.1.smithi079.stdout:5/798: read d13/f19 [3277471,43563] 0 2024-05-09T06:29:39.156 INFO:tasks.workunit.client.1.smithi079.stdout:9/907: dread d1/d33/f37 [0,4194304] 0 2024-05-09T06:29:39.160 INFO:tasks.workunit.client.1.smithi079.stdout:8/662: getdents d1/d5/dc 0 2024-05-09T06:29:39.164 INFO:tasks.workunit.client.1.smithi079.stdout:0/636: mkdir d3/dd/d66/d6d/d74/d80/d76/dcc 0 2024-05-09T06:29:39.170 INFO:tasks.workunit.client.1.smithi079.stdout:2/772: mknod d8/db/d59/d67/d7f/db9/c114 0 2024-05-09T06:29:39.171 INFO:tasks.workunit.client.1.smithi079.stdout:2/773: write d8/db/d11/f3d [864018,2530] 0 2024-05-09T06:29:39.171 INFO:tasks.workunit.client.1.smithi079.stdout:9/908: dread d1/d6/f1c [0,4194304] 0 2024-05-09T06:29:39.172 INFO:tasks.workunit.client.1.smithi079.stdout:6/755: truncate d0/de/f1e 1077162 0 2024-05-09T06:29:39.172 INFO:tasks.workunit.client.1.smithi079.stdout:9/909: dread d1/d33/d2b/f53 [0,4194304] 0 2024-05-09T06:29:39.172 INFO:tasks.workunit.client.1.smithi079.stdout:1/648: symlink d0/d12/d67/d53/d5e/le0 0 2024-05-09T06:29:39.172 INFO:tasks.workunit.client.1.smithi079.stdout:1/649: fdatasync d0/d12/d48/d75/d26/f29 0 2024-05-09T06:29:39.176 INFO:tasks.workunit.client.1.smithi079.stdout:8/663: mknod d1/d3/dc4/cea 0 2024-05-09T06:29:39.179 INFO:tasks.workunit.client.1.smithi079.stdout:5/799: dwrite d13/d43/d39/f86 [0,4194304] 0 2024-05-09T06:29:39.183 INFO:tasks.workunit.client.1.smithi079.stdout:0/637: link d3/f39 d3/dd/d66/d6d/d74/d84/fcd 0 2024-05-09T06:29:39.183 INFO:tasks.workunit.client.1.smithi079.stdout:6/756: mknod d0/d6/d16/d1f/d36/cfc 0 2024-05-09T06:29:39.184 INFO:tasks.workunit.client.1.smithi079.stdout:2/774: dwrite d8/db/d11/d79/d88/fd7 [0,4194304] 0 2024-05-09T06:29:39.185 INFO:tasks.workunit.client.1.smithi079.stdout:9/910: creat d1/d33/d48/dbf/f139 x:0 0 0 2024-05-09T06:29:39.188 INFO:tasks.workunit.client.1.smithi079.stdout:1/650: rename d0/d12/d92/fbe to d0/d12/d48/fe1 0 2024-05-09T06:29:39.188 INFO:tasks.workunit.client.1.smithi079.stdout:6/757: rename d0/d6/d16/d1f/d36 to d0/d6/d16/d1f/d36/dfb/dfd 22 2024-05-09T06:29:39.188 INFO:tasks.workunit.client.1.smithi079.stdout:1/651: dread - d0/df/fc2 zero size 2024-05-09T06:29:39.188 INFO:tasks.workunit.client.1.smithi079.stdout:1/652: fdatasync d0/d12/f8b 0 2024-05-09T06:29:39.190 INFO:tasks.workunit.client.1.smithi079.stdout:8/664: truncate d1/d3/d20/d7f/dc3/d50/f5b 1888189 0 2024-05-09T06:29:39.192 INFO:tasks.workunit.client.1.smithi079.stdout:5/800: symlink d13/d43/d51/dc9/l10f 0 2024-05-09T06:29:39.192 INFO:tasks.workunit.client.1.smithi079.stdout:5/801: readlink d13/d4d/l79 0 2024-05-09T06:29:39.194 INFO:tasks.workunit.client.1.smithi079.stdout:2/775: dread d8/db/dc/d2c/fa6 [0,4194304] 0 2024-05-09T06:29:39.194 INFO:tasks.workunit.client.1.smithi079.stdout:0/638: mkdir d3/dd/d66/d6d/d74/d80/d2d/da7/dce 0 2024-05-09T06:29:39.202 INFO:tasks.workunit.client.1.smithi079.stdout:9/911: link d1/d33/d28/d36/dcd/de7/d75/f77 d1/d33/d28/d4c/d97/dd3/f13a 0 2024-05-09T06:29:39.202 INFO:tasks.workunit.client.1.smithi079.stdout:9/912: chown d1/d33/d28/d36/dcd/de7/c136 24 1 2024-05-09T06:29:39.202 INFO:tasks.workunit.client.1.smithi079.stdout:9/913: dread - d1/d33/d48/f130 zero size 2024-05-09T06:29:39.203 INFO:tasks.workunit.client.1.smithi079.stdout:6/758: rmdir d0/d6/d1b/d2d 39 2024-05-09T06:29:39.203 INFO:tasks.workunit.client.1.smithi079.stdout:6/759: chown d0/d6/d16/d1f/d36/d69/dad/dd5 60793278 1 2024-05-09T06:29:39.205 INFO:tasks.workunit.client.1.smithi079.stdout:1/653: creat d0/d12/d92/fe2 x:0 0 0 2024-05-09T06:29:39.205 INFO:tasks.workunit.client.1.smithi079.stdout:3/731: sync 2024-05-09T06:29:39.207 INFO:tasks.workunit.client.1.smithi079.stdout:3/732: dread d1a/d82/d87/fe1 [0,4194304] 0 2024-05-09T06:29:39.207 INFO:tasks.workunit.client.1.smithi079.stdout:3/733: creat d1a/d1c/fee x:0 0 0 2024-05-09T06:29:39.207 INFO:tasks.workunit.client.1.smithi079.stdout:3/734: fdatasync d1a/d21/db0/dd4/f8f 0 2024-05-09T06:29:39.207 INFO:tasks.workunit.client.1.smithi079.stdout:1/654: dread d0/d12/d67/db6/d8a/f9f [0,4194304] 0 2024-05-09T06:29:39.207 INFO:tasks.workunit.client.1.smithi079.stdout:5/802: mkdir d13/d43/d3d/d40/d63/da2/d8b/d110 0 2024-05-09T06:29:39.209 INFO:tasks.workunit.client.1.smithi079.stdout:8/665: dwrite d1/d3/f84 [4194304,4194304] 0 2024-05-09T06:29:39.209 INFO:tasks.workunit.client.1.smithi079.stdout:6/760: dread d0/d6/d16/d1f/d6f/d8c/d93/f97 [0,4194304] 0 2024-05-09T06:29:39.209 INFO:tasks.workunit.client.1.smithi079.stdout:6/761: stat d0/fc 0 2024-05-09T06:29:39.209 INFO:tasks.workunit.client.1.smithi079.stdout:5/803: write d13/d43/d39/f58 [1010824,54254] 0 2024-05-09T06:29:39.209 INFO:tasks.workunit.client.1.smithi079.stdout:5/804: chown d13/da5/de4/d101/f10e 0 1 2024-05-09T06:29:39.209 INFO:tasks.workunit.client.1.smithi079.stdout:2/776: rename d8/db/d59/d67/d86/f8f to d8/db/dc/d2c/f115 0 2024-05-09T06:29:39.211 INFO:tasks.workunit.client.1.smithi079.stdout:0/639: link d3/dd/d1f/d1e/l59 d3/dd/d1f/lcf 0 2024-05-09T06:29:39.212 INFO:tasks.workunit.client.1.smithi079.stdout:9/914: dread d1/f8e [0,4194304] 0 2024-05-09T06:29:39.214 INFO:tasks.workunit.client.1.smithi079.stdout:1/655: getdents d0/d12/d67/d93 0 2024-05-09T06:29:39.214 INFO:tasks.workunit.client.1.smithi079.stdout:1/656: write d0/d12/d48/d75/d97/fdd [713462,36964] 0 2024-05-09T06:29:39.215 INFO:tasks.workunit.client.1.smithi079.stdout:4/766: sync 2024-05-09T06:29:39.215 INFO:tasks.workunit.client.1.smithi079.stdout:4/767: chown d6/d1a/d26/d2a/d54/d9e/dd5/df/f13 13352220 1 2024-05-09T06:29:39.216 INFO:tasks.workunit.client.1.smithi079.stdout:3/735: mknod d1a/d21/db0/de5/cef 0 2024-05-09T06:29:39.219 INFO:tasks.workunit.client.1.smithi079.stdout:8/666: mknod d1/db/daf/d66/d6c/ceb 0 2024-05-09T06:29:39.226 INFO:tasks.workunit.client.1.smithi079.stdout:5/805: rename d13/d43/d26/fe7 to d13/d43/d3d/d40/d63/f111 0 2024-05-09T06:29:39.227 INFO:tasks.workunit.client.1.smithi079.stdout:4/768: dread d6/d1a/d26/f30 [0,4194304] 0 2024-05-09T06:29:39.228 INFO:tasks.workunit.client.1.smithi079.stdout:4/769: creat d6/d1a/d26/d2a/d98/ff5 x:0 0 0 2024-05-09T06:29:39.230 INFO:tasks.workunit.client.1.smithi079.stdout:4/770: dread d6/d1a/d41/d68/da1/fc2 [0,4194304] 0 2024-05-09T06:29:39.231 INFO:tasks.workunit.client.1.smithi079.stdout:6/762: dwrite d0/d6/d16/dcd/dd7/ff7 [0,4194304] 0 2024-05-09T06:29:39.234 INFO:tasks.workunit.client.1.smithi079.stdout:9/915: mkdir d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/d13b 0 2024-05-09T06:29:39.235 INFO:tasks.workunit.client.1.smithi079.stdout:1/657: mkdir d0/d12/d67/db6/de3 0 2024-05-09T06:29:39.236 INFO:tasks.workunit.client.1.smithi079.stdout:1/658: dread d0/d12/d48/d75/f54 [0,4194304] 0 2024-05-09T06:29:39.237 INFO:tasks.workunit.client.1.smithi079.stdout:8/667: rmdir d1/d5/d36/dae/dbe 39 2024-05-09T06:29:39.242 INFO:tasks.workunit.client.1.smithi079.stdout:5/806: symlink d13/d92/dcd/l112 0 2024-05-09T06:29:39.243 INFO:tasks.workunit.client.1.smithi079.stdout:3/736: dwrite d1a/d21/db0/fd5 [0,4194304] 0 2024-05-09T06:29:39.259 INFO:tasks.workunit.client.1.smithi079.stdout:1/659: dwrite d0/d12/d67/d53/d6d/fd6 [0,4194304] 0 2024-05-09T06:29:39.259 INFO:tasks.workunit.client.1.smithi079.stdout:1/660: chown d0/d12/d48/d75/c4c 257914105 1 2024-05-09T06:29:39.273 INFO:tasks.workunit.client.1.smithi079.stdout:1/661: dwrite d0/d12/d48/d75/d43/d20/d39/f5a [0,4194304] 0 2024-05-09T06:29:39.273 INFO:tasks.workunit.client.1.smithi079.stdout:1/662: fdatasync d0/f5 0 2024-05-09T06:29:39.273 INFO:tasks.workunit.client.1.smithi079.stdout:1/663: write d0/d12/f1a [1993179,36705] 0 2024-05-09T06:29:39.273 INFO:tasks.workunit.client.1.smithi079.stdout:1/664: chown d0/d12/d48/d75/l99 33103811 1 2024-05-09T06:29:39.276 INFO:tasks.workunit.client.1.smithi079.stdout:2/777: rmdir d8/db 39 2024-05-09T06:29:39.279 INFO:tasks.workunit.client.1.smithi079.stdout:4/771: creat d6/d8/d27/d3d/d5b/db4/ff6 x:0 0 0 2024-05-09T06:29:39.279 INFO:tasks.workunit.client.1.smithi079.stdout:4/772: write d6/d1a/d41/d68/ff2 [675085,73948] 0 2024-05-09T06:29:39.283 INFO:tasks.workunit.client.1.smithi079.stdout:6/763: symlink d0/d6/lfe 0 2024-05-09T06:29:39.284 INFO:tasks.workunit.client.1.smithi079.stdout:0/640: getdents d3 0 2024-05-09T06:29:39.287 INFO:tasks.workunit.client.1.smithi079.stdout:9/916: rename d1/d33/d28/d4c/d8b/lb6 to d1/d33/d28/d36/dcd/d113/l13c 0 2024-05-09T06:29:39.287 INFO:tasks.workunit.client.1.smithi079.stdout:8/668: mknod d1/d3/d20/d7f/dc3/d44/da4/cec 0 2024-05-09T06:29:39.290 INFO:tasks.workunit.client.1.smithi079.stdout:5/807: unlink l8 0 2024-05-09T06:29:39.292 INFO:tasks.workunit.client.1.smithi079.stdout:0/641: dread d3/dd/d66/d6d/d74/d80/d2d/f8f [0,4194304] 0 2024-05-09T06:29:39.294 INFO:tasks.workunit.client.1.smithi079.stdout:3/737: mkdir d1a/d21/db0/dd4/d3a/da4/df0 0 2024-05-09T06:29:39.296 INFO:tasks.workunit.client.1.smithi079.stdout:8/669: write d1/d56/d7c/d8f/fa8 [2885729,111564] 0 2024-05-09T06:29:39.304 INFO:tasks.workunit.client.1.smithi079.stdout:8/670: dread d1/d3/d20/d7f/dc3/f9c [0,4194304] 0 2024-05-09T06:29:39.306 INFO:tasks.workunit.client.1.smithi079.stdout:1/665: creat d0/d12/d48/d75/d43/d70/fe4 x:0 0 0 2024-05-09T06:29:39.306 INFO:tasks.workunit.client.1.smithi079.stdout:1/666: chown d0/d12/d67/d53/dbf/dd2/d4e/f6c 182527538 1 2024-05-09T06:29:39.306 INFO:tasks.workunit.client.1.smithi079.stdout:1/667: write d0/d12/f8b [1451283,112426] 0 2024-05-09T06:29:39.312 INFO:tasks.workunit.client.1.smithi079.stdout:5/808: dwrite d13/d43/d3d/d40/d63/f7b [4194304,4194304] 0 2024-05-09T06:29:39.313 INFO:tasks.workunit.client.1.smithi079.stdout:3/738: dwrite d1a/d21/db0/dd4/d34/d42/fc9 [0,4194304] 0 2024-05-09T06:29:39.317 INFO:tasks.workunit.client.1.smithi079.stdout:2/778: creat d8/db/d11/d79/d88/f116 x:0 0 0 2024-05-09T06:29:39.323 INFO:tasks.workunit.client.1.smithi079.stdout:6/764: mkdir d0/d6/d1b/db8/dff 0 2024-05-09T06:29:39.328 INFO:tasks.workunit.client.1.smithi079.stdout:9/917: mknod d1/d45/dc6/dc9/da9/d100/d129/c13d 0 2024-05-09T06:29:39.328 INFO:tasks.workunit.client.1.smithi079.stdout:9/918: chown d1/d33/d28/d36/d4d/d7d/d19/f96 678 1 2024-05-09T06:29:39.328 INFO:tasks.workunit.client.1.smithi079.stdout:2/779: write d8/fa [469026,40927] 0 2024-05-09T06:29:39.329 INFO:tasks.workunit.client.1.smithi079.stdout:0/642: mkdir d3/dd/d71/dd0 0 2024-05-09T06:29:39.332 INFO:tasks.workunit.client.1.smithi079.stdout:8/671: rename d1/d5/dc/c25 to d1/d5/d36/dae/dbe/ced 0 2024-05-09T06:29:39.335 INFO:tasks.workunit.client.1.smithi079.stdout:5/809: dwrite d13/d43/d39/f7f [4194304,4194304] 0 2024-05-09T06:29:39.335 INFO:tasks.workunit.client.1.smithi079.stdout:5/810: stat d13/d43/d39/da7 0 2024-05-09T06:29:39.336 INFO:tasks.workunit.client.1.smithi079.stdout:4/773: dwrite d6/d1a/d26/d2a/d54/d9e/dd5/d34/f94 [0,4194304] 0 2024-05-09T06:29:39.342 INFO:tasks.workunit.client.1.smithi079.stdout:2/780: dwrite d8/db/d4b/d4f/d51/fa4 [0,4194304] 0 2024-05-09T06:29:39.343 INFO:tasks.workunit.client.1.smithi079.stdout:7/654: sync 2024-05-09T06:29:39.343 INFO:tasks.workunit.client.1.smithi079.stdout:7/655: fdatasync d4/d7/d22/d28/d74/fcf 0 2024-05-09T06:29:39.344 INFO:tasks.workunit.client.1.smithi079.stdout:6/765: creat d0/d6/d1b/d20/f100 x:0 0 0 2024-05-09T06:29:39.346 INFO:tasks.workunit.client.1.smithi079.stdout:9/919: link d1/d33/d28/d36/d4d/d7d/fc4 d1/d33/d28/d36/dcd/f13e 0 2024-05-09T06:29:39.354 INFO:tasks.workunit.client.1.smithi079.stdout:0/643: rename d3/dd to d3/dd/d66/d6d/d74/d80/dd1 22 2024-05-09T06:29:39.356 INFO:tasks.workunit.client.1.smithi079.stdout:1/668: mknod d0/d12/d48/d75/d43/d20/d39/ce5 0 2024-05-09T06:29:39.363 INFO:tasks.workunit.client.1.smithi079.stdout:0/644: write d3/f4 [3959766,63129] 0 2024-05-09T06:29:39.363 INFO:tasks.workunit.client.1.smithi079.stdout:0/645: creat d3/dd/d1f/d1e/d2c/d88/d8e/fd2 x:0 0 0 2024-05-09T06:29:39.364 INFO:tasks.workunit.client.1.smithi079.stdout:2/781: unlink d8/db/d59/d67/fc4 0 2024-05-09T06:29:39.367 INFO:tasks.workunit.client.1.smithi079.stdout:7/656: symlink d4/d7/dd/d5b/d32/ld2 0 2024-05-09T06:29:39.368 INFO:tasks.workunit.client.1.smithi079.stdout:6/766: fdatasync d0/d6/d16/f92 0 2024-05-09T06:29:39.370 INFO:tasks.workunit.client.1.smithi079.stdout:8/672: rename d1/db/f30 to d1/d56/d7c/d8f/fee 0 2024-05-09T06:29:39.370 INFO:tasks.workunit.client.1.smithi079.stdout:9/920: rename d1/d45/dc6/dc9 to d1/d45/dc6/dc9/d2d/d99/dd5/d13f 22 2024-05-09T06:29:39.372 INFO:tasks.workunit.client.1.smithi079.stdout:1/669: creat d0/d12/d67/d53/dbf/dd2/d3e/fe6 x:0 0 0 2024-05-09T06:29:39.374 INFO:tasks.workunit.client.1.smithi079.stdout:4/774: link d6/d8/ce d6/d1a/d41/d68/da1/cf7 0 2024-05-09T06:29:39.374 INFO:tasks.workunit.client.1.smithi079.stdout:4/775: dread - d6/d1a/fcc zero size 2024-05-09T06:29:39.374 INFO:tasks.workunit.client.1.smithi079.stdout:4/776: readlink d6/d1a/d26/d2a/d54/d9e/dd5/l37 0 2024-05-09T06:29:39.377 INFO:tasks.workunit.client.1.smithi079.stdout:0/646: creat d3/dd/d66/d6d/fd3 x:0 0 0 2024-05-09T06:29:39.377 INFO:tasks.workunit.client.1.smithi079.stdout:0/647: fdatasync d3/dd/d1f/d1e/d91/fb8 0 2024-05-09T06:29:39.378 INFO:tasks.workunit.client.1.smithi079.stdout:7/657: creat d4/d7/dd/d5b/d31/d34/fd3 x:0 0 0 2024-05-09T06:29:39.379 INFO:tasks.workunit.client.1.smithi079.stdout:6/767: creat d0/d6/d16/d1f/d36/d69/def/f101 x:0 0 0 2024-05-09T06:29:39.381 INFO:tasks.workunit.client.1.smithi079.stdout:8/673: mkdir d1/d3/d20/d7f/def 0 2024-05-09T06:29:39.383 INFO:tasks.workunit.client.1.smithi079.stdout:2/782: rename d8/db/d5c/f81 to d8/db/d4b/d4f/d51/f117 0 2024-05-09T06:29:39.383 INFO:tasks.workunit.client.1.smithi079.stdout:2/783: readlink d8/db/d5c/d6b/la1 0 2024-05-09T06:29:39.384 INFO:tasks.workunit.client.1.smithi079.stdout:9/921: creat d1/d33/d28/d36/d6c/d117/f140 x:0 0 0 2024-05-09T06:29:39.384 INFO:tasks.workunit.client.1.smithi079.stdout:9/922: write d1/f29 [2734007,26282] 0 2024-05-09T06:29:39.385 INFO:tasks.workunit.client.1.smithi079.stdout:4/777: creat d6/d8/d27/d3d/d5b/d9a/ff8 x:0 0 0 2024-05-09T06:29:39.385 INFO:tasks.workunit.client.1.smithi079.stdout:4/778: creat d6/d8/d27/d3d/d5b/ff9 x:0 0 0 2024-05-09T06:29:39.387 INFO:tasks.workunit.client.1.smithi079.stdout:0/648: rmdir d3/dd/d66/d6d/da6 39 2024-05-09T06:29:39.387 INFO:tasks.workunit.client.1.smithi079.stdout:0/649: truncate d3/dd/d1f/d1e/d2c/dc0/fc3 863698 0 2024-05-09T06:29:39.388 INFO:tasks.workunit.client.1.smithi079.stdout:0/650: creat d3/dd/d1f/d1e/d2c/dc0/fd4 x:0 0 0 2024-05-09T06:29:39.389 INFO:tasks.workunit.client.1.smithi079.stdout:7/658: mknod d4/d20/cd4 0 2024-05-09T06:29:39.391 INFO:tasks.workunit.client.1.smithi079.stdout:2/784: mknod d8/db/dc/c118 0 2024-05-09T06:29:39.397 INFO:tasks.workunit.client.1.smithi079.stdout:4/779: write d6/d1a/d26/d2a/d54/d9e/dd5/f2f [228520,24460] 0 2024-05-09T06:29:39.397 INFO:tasks.workunit.client.1.smithi079.stdout:0/651: symlink d3/dd/d66/d6d/d74/d80/d2d/da7/dce/ld5 0 2024-05-09T06:29:39.397 INFO:tasks.workunit.client.1.smithi079.stdout:0/652: stat d3/d5 0 2024-05-09T06:29:39.399 INFO:tasks.workunit.client.1.smithi079.stdout:8/674: write d1/db/fa9 [4188800,33973] 0 2024-05-09T06:29:39.399 INFO:tasks.workunit.client.1.smithi079.stdout:8/675: creat d1/d67/ff0 x:0 0 0 2024-05-09T06:29:39.399 INFO:tasks.workunit.client.1.smithi079.stdout:8/676: chown d1/d3/d20/d7f/d33/fb1 1235378 1 2024-05-09T06:29:39.399 INFO:tasks.workunit.client.1.smithi079.stdout:6/768: dwrite d0/d6/d1b/fa0 [0,4194304] 0 2024-05-09T06:29:39.401 INFO:tasks.workunit.client.1.smithi079.stdout:1/670: rename d0/d12/d16/fc5 to d0/d12/d48/d75/d43/d20/d39/fe7 0 2024-05-09T06:29:39.401 INFO:tasks.workunit.client.1.smithi079.stdout:1/671: truncate d0/d12/d48/d75/d97/fc6 211624 0 2024-05-09T06:29:39.401 INFO:tasks.workunit.client.1.smithi079.stdout:1/672: readlink d0/d12/d67/db6/l71 0 2024-05-09T06:29:39.404 INFO:tasks.workunit.client.1.smithi079.stdout:0/653: creat d3/dd/d66/d6d/d74/d80/d2d/da7/dce/fd6 x:0 0 0 2024-05-09T06:29:39.404 INFO:tasks.workunit.client.1.smithi079.stdout:0/654: dread - d3/dd/d66/f7b zero size 2024-05-09T06:29:39.406 INFO:tasks.workunit.client.1.smithi079.stdout:4/780: dread d6/d8/d27/f46 [4194304,4194304] 0 2024-05-09T06:29:39.406 INFO:tasks.workunit.client.1.smithi079.stdout:4/781: creat d6/d8/d27/d3d/d5b/db4/dc3/ffa x:0 0 0 2024-05-09T06:29:39.406 INFO:tasks.workunit.client.1.smithi079.stdout:4/782: fsync d6/d1a/d26/d2a/f8c 0 2024-05-09T06:29:39.406 INFO:tasks.workunit.client.1.smithi079.stdout:6/769: read d0/de/f85 [89568,23958] 0 2024-05-09T06:29:39.409 INFO:tasks.workunit.client.1.smithi079.stdout:8/677: symlink d1/d56/dbd/lf1 0 2024-05-09T06:29:39.413 INFO:tasks.workunit.client.1.smithi079.stdout:1/673: creat d0/d12/d67/d93/fe8 x:0 0 0 2024-05-09T06:29:39.415 INFO:tasks.workunit.client.1.smithi079.stdout:0/655: truncate d3/dd/d1f/f13 2144911 0 2024-05-09T06:29:39.415 INFO:tasks.workunit.client.1.smithi079.stdout:0/656: stat d3/dd/d66/d6d/d74/d80/d2d/f70 0 2024-05-09T06:29:39.416 INFO:tasks.workunit.client.1.smithi079.stdout:1/674: dread d0/d12/d67/d53/dbf/dd2/f7b [0,4194304] 0 2024-05-09T06:29:39.417 INFO:tasks.workunit.client.1.smithi079.stdout:6/770: unlink d0/d6/d16/dcd/dce/lf9 0 2024-05-09T06:29:39.419 INFO:tasks.workunit.client.1.smithi079.stdout:8/678: mknod d1/d5/cf2 0 2024-05-09T06:29:39.419 INFO:tasks.workunit.client.1.smithi079.stdout:8/679: write d1/d3/d20/d7f/dc3/d82/fe8 [741132,99357] 0 2024-05-09T06:29:39.419 INFO:tasks.workunit.client.1.smithi079.stdout:8/680: chown d1/d3/f84 54 1 2024-05-09T06:29:39.421 INFO:tasks.workunit.client.1.smithi079.stdout:0/657: unlink d3/dd/d1f/d1e/d2c/d35/f60 0 2024-05-09T06:29:39.421 INFO:tasks.workunit.client.1.smithi079.stdout:0/658: chown d3/dd/d1f/d1e/fb6 39 1 2024-05-09T06:29:39.422 INFO:tasks.workunit.client.1.smithi079.stdout:4/783: dread d6/d1a/d26/d2a/d54/d9e/dd5/d34/f52 [0,4194304] 0 2024-05-09T06:29:39.423 INFO:tasks.workunit.client.1.smithi079.stdout:8/681: truncate d1/f1a 263782 0 2024-05-09T06:29:39.426 INFO:tasks.workunit.client.1.smithi079.stdout:0/659: unlink d3/dd/d66/d6d/d74/d80/f49 0 2024-05-09T06:29:39.428 INFO:tasks.workunit.client.1.smithi079.stdout:1/675: write d0/d12/d48/d75/d43/d20/d39/f5a [1364379,80213] 0 2024-05-09T06:29:39.428 INFO:tasks.workunit.client.1.smithi079.stdout:1/676: chown d0/d12/d67/d53/dbf/dd2/d4e 603156001 1 2024-05-09T06:29:39.429 INFO:tasks.workunit.client.1.smithi079.stdout:9/923: dwrite d1/f29 [4194304,4194304] 0 2024-05-09T06:29:39.431 INFO:tasks.workunit.client.1.smithi079.stdout:2/785: dwrite d8/db/d59/d67/d86/fdb [0,4194304] 0 2024-05-09T06:29:39.432 INFO:tasks.workunit.client.1.smithi079.stdout:0/660: rename d3/dd/d1f/d1e/d2c/d35/d36/c8a to d3/dd/d71/cd7 0 2024-05-09T06:29:39.435 INFO:tasks.workunit.client.1.smithi079.stdout:1/677: symlink d0/d12/d67/d53/dbf/le9 0 2024-05-09T06:29:39.441 INFO:tasks.workunit.client.1.smithi079.stdout:6/771: write d0/d6/d1b/fa0 [3802670,9893] 0 2024-05-09T06:29:39.441 INFO:tasks.workunit.client.1.smithi079.stdout:7/659: dwrite d4/d7/d22/f23 [0,4194304] 0 2024-05-09T06:29:39.444 INFO:tasks.workunit.client.1.smithi079.stdout:9/924: dread d1/d5/f58 [0,4194304] 0 2024-05-09T06:29:39.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/661: mknod d3/dd/dc8/cd8 0 2024-05-09T06:29:39.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/662: write d3/fb5 [536966,115328] 0 2024-05-09T06:29:39.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/663: readlink d3/dd/d1f/d1e/d2c/d35/l62 0 2024-05-09T06:29:39.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/664: chown d3/dd/d1f/d1e/l99 261428 1 2024-05-09T06:29:39.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/665: truncate d3/dd/d1f/d1e/d2c/d35/d36/f4c 543959 0 2024-05-09T06:29:39.458 INFO:tasks.workunit.client.1.smithi079.stdout:9/925: write d1/d45/dc6/dc9/f4a [7640368,78013] 0 2024-05-09T06:29:39.458 INFO:tasks.workunit.client.1.smithi079.stdout:4/784: dwrite d6/d1a/d26/d2a/d54/d9e/dd5/f6a [0,4194304] 0 2024-05-09T06:29:39.459 INFO:tasks.workunit.client.1.smithi079.stdout:4/785: chown d6/d1a/fa5 470 1 2024-05-09T06:29:39.460 INFO:tasks.workunit.client.1.smithi079.stdout:2/786: dwrite d8/df7/f80 [0,4194304] 0 2024-05-09T06:29:39.460 INFO:tasks.workunit.client.1.smithi079.stdout:8/682: dwrite d1/d3/d20/d7f/dc3/d82/fe8 [0,4194304] 0 2024-05-09T06:29:39.463 INFO:tasks.workunit.client.1.smithi079.stdout:4/786: dread d6/d1a/d26/d2a/d54/d9e/dd5/f2f [0,4194304] 0 2024-05-09T06:29:39.463 INFO:tasks.workunit.client.1.smithi079.stdout:4/787: chown d6/d90/lc9 48308185 1 2024-05-09T06:29:39.488 INFO:tasks.workunit.client.1.smithi079.stdout:1/678: creat d0/d12/d67/db6/d8a/dc3/fea x:0 0 0 2024-05-09T06:29:39.488 INFO:tasks.workunit.client.1.smithi079.stdout:1/679: write d0/d12/d48/d75/d43/d70/fe4 [757985,80643] 0 2024-05-09T06:29:39.496 INFO:tasks.workunit.client.1.smithi079.stdout:6/772: mkdir d0/d60/d8e/d102 0 2024-05-09T06:29:39.499 INFO:tasks.workunit.client.1.smithi079.stdout:7/660: fsync d4/d7/dd/d47/f5e 0 2024-05-09T06:29:39.499 INFO:tasks.workunit.client.1.smithi079.stdout:7/661: fdatasync d4/d7/d22/d28/d50/f9f 0 2024-05-09T06:29:39.502 INFO:tasks.workunit.client.1.smithi079.stdout:1/680: dwrite d0/d12/d16/fc9 [0,4194304] 0 2024-05-09T06:29:39.502 INFO:tasks.workunit.client.1.smithi079.stdout:0/666: rename d3/dd/d71/dd0 to d3/dd/d66/d6d/d74/d80/d76/dcc/dd9 0 2024-05-09T06:29:39.516 INFO:tasks.workunit.client.1.smithi079.stdout:9/926: truncate d1/f81 2205369 0 2024-05-09T06:29:39.530 INFO:tasks.workunit.client.1.smithi079.stdout:8/683: fsync d1/f1a 0 2024-05-09T06:29:39.538 INFO:tasks.workunit.client.1.smithi079.stdout:2/787: creat d8/db/d5c/d6b/db5/f119 x:0 0 0 2024-05-09T06:29:39.583 INFO:tasks.workunit.client.1.smithi079.stdout:0/667: mknod d3/dd/d1f/d1e/d2c/dc0/cda 0 2024-05-09T06:29:39.583 INFO:tasks.workunit.client.1.smithi079.stdout:9/927: getdents d1/d33/d28/d36/dcd/de7 0 2024-05-09T06:29:39.583 INFO:tasks.workunit.client.1.smithi079.stdout:9/928: stat d1/l79 0 2024-05-09T06:29:39.583 INFO:tasks.workunit.client.1.smithi079.stdout:9/929: chown d1/d33/d2b/l78 237844 1 2024-05-09T06:29:39.583 INFO:tasks.workunit.client.1.smithi079.stdout:8/684: creat d1/d3/d20/d7f/d33/d5d/d6d/dc0/ff3 x:0 0 0 2024-05-09T06:29:39.583 INFO:tasks.workunit.client.1.smithi079.stdout:8/685: read d1/db/daf/f9d [227207,114412] 0 2024-05-09T06:29:39.584 INFO:tasks.workunit.client.1.smithi079.stdout:2/788: mkdir d8/db/d11/d5f/d11a 0 2024-05-09T06:29:39.585 INFO:tasks.workunit.client.1.smithi079.stdout:0/668: getdents d3/dd/d66/d6d/d74/d80/d2d/da7 0 2024-05-09T06:29:39.587 INFO:tasks.workunit.client.1.smithi079.stdout:9/930: link d1/d33/d28/d4c/d97/dd3/fe2 d1/d33/d28/d36/d4d/f141 0 2024-05-09T06:29:39.588 INFO:tasks.workunit.client.1.smithi079.stdout:2/789: unlink d8/db/d59/d67/d7f/c100 0 2024-05-09T06:29:39.590 INFO:tasks.workunit.client.1.smithi079.stdout:6/773: rmdir d0/d6/d16/d1f/d6f/d8c/d93 39 2024-05-09T06:29:39.591 INFO:tasks.workunit.client.1.smithi079.stdout:8/686: write d1/d3/d20/d7f/dc3/f9f [175977,8726] 0 2024-05-09T06:29:39.591 INFO:tasks.workunit.client.1.smithi079.stdout:6/774: read d0/d6/d1b/fd4 [273986,43059] 0 2024-05-09T06:29:39.592 INFO:tasks.workunit.client.1.smithi079.stdout:9/931: creat d1/d33/d28/d36/d6c/f142 x:0 0 0 2024-05-09T06:29:39.592 INFO:tasks.workunit.client.1.smithi079.stdout:2/790: truncate d8/db/d11/d79/d88/fd7 3142222 0 2024-05-09T06:29:39.593 INFO:tasks.workunit.client.1.smithi079.stdout:0/669: mknod d3/dd/d66/d6d/d74/d80/cdb 0 2024-05-09T06:29:39.593 INFO:tasks.workunit.client.1.smithi079.stdout:0/670: readlink d3/dd/d1f/d1e/l68 0 2024-05-09T06:29:39.593 INFO:tasks.workunit.client.1.smithi079.stdout:0/671: chown d3/dd/d71 15 1 2024-05-09T06:29:39.594 INFO:tasks.workunit.client.1.smithi079.stdout:9/932: mkdir d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/d13b/d143 0 2024-05-09T06:29:39.596 INFO:tasks.workunit.client.1.smithi079.stdout:2/791: mknod d8/db/d59/d67/d86/dd5/c11b 0 2024-05-09T06:29:39.597 INFO:tasks.workunit.client.1.smithi079.stdout:2/792: truncate d8/db/dc/fd 3912177 0 2024-05-09T06:29:39.597 INFO:tasks.workunit.client.1.smithi079.stdout:0/672: link d3/dd/c22 d3/dd/d18/d5e/cdc 0 2024-05-09T06:29:39.599 INFO:tasks.workunit.client.1.smithi079.stdout:2/793: link d8/db/d9d/l111 d8/db/d59/d67/d86/l11c 0 2024-05-09T06:29:39.602 INFO:tasks.workunit.client.1.smithi079.stdout:2/794: symlink d8/db/d59/d93/l11d 0 2024-05-09T06:29:39.602 INFO:tasks.workunit.client.1.smithi079.stdout:2/795: fdatasync d8/db/d4b/fb8 0 2024-05-09T06:29:39.603 INFO:tasks.workunit.client.1.smithi079.stdout:2/796: write d8/db/d4b/d4f/d51/d6f/f9a [487478,49510] 0 2024-05-09T06:29:39.606 INFO:tasks.workunit.client.1.smithi079.stdout:2/797: symlink d8/deb/l11e 0 2024-05-09T06:29:39.614 INFO:tasks.workunit.client.1.smithi079.stdout:8/687: dwrite d1/db/f4a [0,4194304] 0 2024-05-09T06:29:39.614 INFO:tasks.workunit.client.1.smithi079.stdout:8/688: stat d1/d3/fa 0 2024-05-09T06:29:39.632 INFO:tasks.workunit.client.1.smithi079.stdout:0/673: dwrite d3/dd/d1f/d1e/d91/fb8 [0,4194304] 0 2024-05-09T06:29:39.632 INFO:tasks.workunit.client.1.smithi079.stdout:6/775: dwrite d0/d6/d1b/fb4 [0,4194304] 0 2024-05-09T06:29:39.633 INFO:tasks.workunit.client.1.smithi079.stdout:0/674: getdents d3/dd/d1f/d1e/d2c/d7f 0 2024-05-09T06:29:39.635 INFO:tasks.workunit.client.1.smithi079.stdout:6/776: symlink d0/d6/d1b/d20/dac/dc2/l103 0 2024-05-09T06:29:39.650 INFO:tasks.workunit.client.1.smithi079.stdout:4/788: rename d6/d1a/d41/d68/da1/dbe to d6/d1a/d26/d2a/d54/d9e/dd5/df/dfb 0 2024-05-09T06:29:39.650 INFO:tasks.workunit.client.1.smithi079.stdout:4/789: write d6/d1a/d26/fba [1244043,79971] 0 2024-05-09T06:29:39.651 INFO:tasks.workunit.client.1.smithi079.stdout:1/681: rename d0/d12/d67/d53/l6f to d0/d12/d48/d75/d43/leb 0 2024-05-09T06:29:39.655 INFO:tasks.workunit.client.1.smithi079.stdout:2/798: link d8/db/d5c/fc6 d8/db/d59/f11f 0 2024-05-09T06:29:39.655 INFO:tasks.workunit.client.1.smithi079.stdout:6/777: dwrite d0/d6/d1b/db8/fe5 [0,4194304] 0 2024-05-09T06:29:39.655 INFO:tasks.workunit.client.1.smithi079.stdout:1/682: mknod d0/df/cec 0 2024-05-09T06:29:39.657 INFO:tasks.workunit.client.1.smithi079.stdout:1/683: symlink d0/d12/dc0/dd4/led 0 2024-05-09T06:29:39.657 INFO:tasks.workunit.client.1.smithi079.stdout:1/684: fsync d0/d12/d92/f9a 0 2024-05-09T06:29:39.657 INFO:tasks.workunit.client.1.smithi079.stdout:1/685: fsync d0/d12/d48/d75/d43/f77 0 2024-05-09T06:29:39.657 INFO:tasks.workunit.client.1.smithi079.stdout:1/686: fsync d0/d12/d48/d75/d43/f77 0 2024-05-09T06:29:39.659 INFO:tasks.workunit.client.1.smithi079.stdout:1/687: symlink d0/df/db8/lee 0 2024-05-09T06:29:39.659 INFO:tasks.workunit.client.1.smithi079.stdout:1/688: chown d0/d12/f18 19643 1 2024-05-09T06:29:39.660 INFO:tasks.workunit.client.1.smithi079.stdout:1/689: creat d0/d12/d67/db6/de3/fef x:0 0 0 2024-05-09T06:29:39.660 INFO:tasks.workunit.client.1.smithi079.stdout:1/690: chown d0/d12/d48/d75/d43/d20/f9d 313 1 2024-05-09T06:29:39.660 INFO:tasks.workunit.client.1.smithi079.stdout:1/691: write d0/d12/d67/db6/d89/fdc [24020,130211] 0 2024-05-09T06:29:39.682 INFO:tasks.workunit.client.1.smithi079.stdout:9/933: rename d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/d13b/d143 to d1/d45/d144 0 2024-05-09T06:29:39.684 INFO:tasks.workunit.client.1.smithi079.stdout:4/790: link d6/d1a/d41/d68/d6b/l9f d6/d8/d27/d3d/d5b/lfc 0 2024-05-09T06:29:39.685 INFO:tasks.workunit.client.1.smithi079.stdout:1/692: dwrite d0/d12/d16/f35 [0,4194304] 0 2024-05-09T06:29:39.685 INFO:tasks.workunit.client.1.smithi079.stdout:2/799: dwrite d8/db/d5c/d6b/db5/fab [0,4194304] 0 2024-05-09T06:29:39.685 INFO:tasks.workunit.client.1.smithi079.stdout:2/800: chown d8/db/d11 21 1 2024-05-09T06:29:39.685 INFO:tasks.workunit.client.1.smithi079.stdout:2/801: dread - d8/db/d4b/d4f/ff9 zero size 2024-05-09T06:29:39.687 INFO:tasks.workunit.client.1.smithi079.stdout:0/675: rename d3/dd/d1f/d1e/d2c/d88/d8e/fa5 to d3/fdd 0 2024-05-09T06:29:39.689 INFO:tasks.workunit.client.1.smithi079.stdout:9/934: creat d1/d33/d28/d4c/d97/d12b/f145 x:0 0 0 2024-05-09T06:29:39.691 INFO:tasks.workunit.client.1.smithi079.stdout:4/791: symlink d6/d1a/d26/d2a/d54/d9e/dd5/df/dfb/lfd 0 2024-05-09T06:29:39.698 INFO:tasks.workunit.client.1.smithi079.stdout:2/802: dwrite d8/db/dc/f6c [0,4194304] 0 2024-05-09T06:29:39.698 INFO:tasks.workunit.client.1.smithi079.stdout:2/803: write d8/db/d4b/f85 [5096395,65972] 0 2024-05-09T06:29:39.699 INFO:tasks.workunit.client.1.smithi079.stdout:1/693: mknod d0/d12/d67/cf0 0 2024-05-09T06:29:39.701 INFO:tasks.workunit.client.1.smithi079.stdout:3/739: sync 2024-05-09T06:29:39.701 INFO:tasks.workunit.client.1.smithi079.stdout:5/811: sync 2024-05-09T06:29:39.701 INFO:tasks.workunit.client.1.smithi079.stdout:3/740: write d1a/d1c/d22/d53/d4e/dc3/fed [218501,24008] 0 2024-05-09T06:29:39.701 INFO:tasks.workunit.client.1.smithi079.stdout:3/741: readlink d1a/d1c/d22/d53/d4e/dea/l8a 0 2024-05-09T06:29:39.708 INFO:tasks.workunit.client.1.smithi079.stdout:6/778: rename d0/d6/d16/d1f/d36/f54 to d0/d6/d1b/d20/dac/f104 0 2024-05-09T06:29:39.710 INFO:tasks.workunit.client.1.smithi079.stdout:0/676: mknod d3/dd/d18/d5e/d69/cde 0 2024-05-09T06:29:39.714 INFO:tasks.workunit.client.1.smithi079.stdout:9/935: mkdir d1/d45/dc6/dc9/da9/d100/d129/d146 0 2024-05-09T06:29:39.716 INFO:tasks.workunit.client.1.smithi079.stdout:5/812: write d13/d43/d39/f7f [6099779,120801] 0 2024-05-09T06:29:39.716 INFO:tasks.workunit.client.1.smithi079.stdout:5/813: fdatasync d13/f21 0 2024-05-09T06:29:39.719 INFO:tasks.workunit.client.1.smithi079.stdout:4/792: dwrite d6/d8/d27/fb2 [0,4194304] 0 2024-05-09T06:29:39.719 INFO:tasks.workunit.client.1.smithi079.stdout:4/793: fdatasync d6/d1a/d26/d2a/f8c 0 2024-05-09T06:29:39.720 INFO:tasks.workunit.client.1.smithi079.stdout:5/814: dread d13/d43/d3d/f7a [0,4194304] 0 2024-05-09T06:29:39.721 INFO:tasks.workunit.client.1.smithi079.stdout:2/804: creat d8/db/d59/d67/d7f/db9/f120 x:0 0 0 2024-05-09T06:29:39.721 INFO:tasks.workunit.client.1.smithi079.stdout:2/805: dread - d8/db/fee zero size 2024-05-09T06:29:39.722 INFO:tasks.workunit.client.1.smithi079.stdout:9/936: write d1/d45/dc6/dc9/f2e [3332554,41425] 0 2024-05-09T06:29:39.722 INFO:tasks.workunit.client.1.smithi079.stdout:9/937: read - d1/f121 zero size 2024-05-09T06:29:39.722 INFO:tasks.workunit.client.1.smithi079.stdout:3/742: dwrite d1a/d82/d87/fe1 [0,4194304] 0 2024-05-09T06:29:39.723 INFO:tasks.workunit.client.1.smithi079.stdout:1/694: rename d0/d12/d67/d53/dbf/dd2/d4e/d7d/l88 to d0/d12/d67/d53/dbf/dd2/d4e/d7d/lf1 0 2024-05-09T06:29:39.726 INFO:tasks.workunit.client.1.smithi079.stdout:6/779: mkdir d0/d6/d1b/db8/d105 0 2024-05-09T06:29:39.726 INFO:tasks.workunit.client.1.smithi079.stdout:6/780: fsync d0/d6/d16/d28/f46 0 2024-05-09T06:29:39.727 INFO:tasks.workunit.client.1.smithi079.stdout:6/781: truncate d0/d6/d1b/d20/f100 246707 0 2024-05-09T06:29:39.729 INFO:tasks.workunit.client.1.smithi079.stdout:0/677: chown d3/dd/d1f/d1e/d2c/d35/d36/f4c 105984 1 2024-05-09T06:29:39.734 INFO:tasks.workunit.client.1.smithi079.stdout:5/815: rmdir d13/d43/d3d/d40/d63/da2 39 2024-05-09T06:29:39.736 INFO:tasks.workunit.client.1.smithi079.stdout:2/806: creat d8/db/dc/f121 x:0 0 0 2024-05-09T06:29:39.739 INFO:tasks.workunit.client.1.smithi079.stdout:9/938: mknod d1/d33/d28/d4c/d97/dd3/c147 0 2024-05-09T06:29:39.742 INFO:tasks.workunit.client.1.smithi079.stdout:1/695: mknod d0/d12/d67/d53/cf2 0 2024-05-09T06:29:39.742 INFO:tasks.workunit.client.1.smithi079.stdout:1/696: dread d0/d12/d48/d75/d43/d20/d39/f78 [0,4194304] 0 2024-05-09T06:29:39.743 INFO:tasks.workunit.client.1.smithi079.stdout:4/794: dwrite d6/d1a/d26/d2a/d54/f23 [0,4194304] 0 2024-05-09T06:29:39.743 INFO:tasks.workunit.client.1.smithi079.stdout:4/795: write d6/d8/d27/d62/f40 [4273257,94439] 0 2024-05-09T06:29:39.744 INFO:tasks.workunit.client.1.smithi079.stdout:3/743: dwrite d1a/d1c/d22/f30 [0,4194304] 0 2024-05-09T06:29:39.745 INFO:tasks.workunit.client.1.smithi079.stdout:0/678: symlink d3/ldf 0 2024-05-09T06:29:39.747 INFO:tasks.workunit.client.1.smithi079.stdout:5/816: write d13/d43/d26/d35/f6d [440765,95928] 0 2024-05-09T06:29:39.748 INFO:tasks.workunit.client.1.smithi079.stdout:5/817: creat d13/d4d/d77/f113 x:0 0 0 2024-05-09T06:29:39.748 INFO:tasks.workunit.client.1.smithi079.stdout:5/818: chown d13/d43/d3d/d40/d9a/fc6 13873571 1 2024-05-09T06:29:39.750 INFO:tasks.workunit.client.1.smithi079.stdout:2/807: mkdir d8/db/d9d/d122 0 2024-05-09T06:29:39.750 INFO:tasks.workunit.client.1.smithi079.stdout:2/808: creat d8/db/d59/d67/d7f/db9/f123 x:0 0 0 2024-05-09T06:29:39.751 INFO:tasks.workunit.client.1.smithi079.stdout:2/809: write d8/db/d4b/f68 [540008,126497] 0 2024-05-09T06:29:39.751 INFO:tasks.workunit.client.1.smithi079.stdout:1/697: write d0/d12/d67/d53/dbf/dd2/d4e/f5d [2062237,55576] 0 2024-05-09T06:29:39.754 INFO:tasks.workunit.client.1.smithi079.stdout:9/939: rename d1/d45/dc6/lf2 to d1/d33/d28/d36/dcd/de7/d10e/l148 0 2024-05-09T06:29:39.754 INFO:tasks.workunit.client.1.smithi079.stdout:9/940: dread - d1/d33/d28/d4c/d97/dd3/ded/def/f138 zero size 2024-05-09T06:29:39.755 INFO:tasks.workunit.client.1.smithi079.stdout:1/698: dread d0/d12/d48/d75/d43/d20/d39/f5a [0,4194304] 0 2024-05-09T06:29:39.755 INFO:tasks.workunit.client.1.smithi079.stdout:1/699: fdatasync d0/df/f8f 0 2024-05-09T06:29:39.758 INFO:tasks.workunit.client.1.smithi079.stdout:6/782: rmdir d0/de 39 2024-05-09T06:29:39.758 INFO:tasks.workunit.client.1.smithi079.stdout:6/783: chown d0/d6/d16/d1f/fca 33010092 1 2024-05-09T06:29:39.763 INFO:tasks.workunit.client.1.smithi079.stdout:4/796: truncate d6/d1a/d41/d68/d6b/f81 581642 0 2024-05-09T06:29:39.768 INFO:tasks.workunit.client.1.smithi079.stdout:3/744: symlink d1a/d1c/d22/d53/d4e/dc3/lf1 0 2024-05-09T06:29:39.768 INFO:tasks.workunit.client.1.smithi079.stdout:3/745: getdents d1a/d1c/d22/d53/d4e/dea/dc5/dd1 0 2024-05-09T06:29:39.771 INFO:tasks.workunit.client.1.smithi079.stdout:0/679: mkdir d3/dd/d1f/d1e/d2c/d7f/de0 0 2024-05-09T06:29:39.778 INFO:tasks.workunit.client.1.smithi079.stdout:4/797: dwrite d6/d1a/d26/d2a/d54/d9e/dd5/df/f3b [0,4194304] 0 2024-05-09T06:29:39.778 INFO:tasks.workunit.client.1.smithi079.stdout:4/798: creat d6/d1a/d26/d2a/d54/dc8/ffe x:0 0 0 2024-05-09T06:29:39.782 INFO:tasks.workunit.client.1.smithi079.stdout:5/819: symlink d13/da5/de4/l114 0 2024-05-09T06:29:39.783 INFO:tasks.workunit.client.1.smithi079.stdout:5/820: truncate d13/d43/d3d/d40/d53/fb0 452978 0 2024-05-09T06:29:39.795 INFO:tasks.workunit.client.1.smithi079.stdout:2/810: rename d8/db/d5c/c92 to d8/db/d59/d67/d7f/db9/de1/c124 0 2024-05-09T06:29:39.795 INFO:tasks.workunit.client.1.smithi079.stdout:0/680: dwrite d3/dd/d1f/f28 [0,4194304] 0 2024-05-09T06:29:39.795 INFO:tasks.workunit.client.1.smithi079.stdout:0/681: chown d3/dd/d71/c82 1764 1 2024-05-09T06:29:39.796 INFO:tasks.workunit.client.1.smithi079.stdout:6/784: rmdir d0/d6/d16/d1f/d36/d69 39 2024-05-09T06:29:39.796 INFO:tasks.workunit.client.1.smithi079.stdout:6/785: creat d0/d6/d1b/f106 x:0 0 0 2024-05-09T06:29:39.798 INFO:tasks.workunit.client.1.smithi079.stdout:3/746: mknod d1a/d21/db0/dd4/d3a/da4/df0/cf2 0 2024-05-09T06:29:39.803 INFO:tasks.workunit.client.1.smithi079.stdout:4/799: mknod d6/d8/d27/d3d/d5b/d9a/d8b/cff 0 2024-05-09T06:29:39.803 INFO:tasks.workunit.client.1.smithi079.stdout:4/800: chown d6/d8/d80/da6/le8 198 1 2024-05-09T06:29:39.806 INFO:tasks.workunit.client.1.smithi079.stdout:5/821: truncate d13/f99 180051 0 2024-05-09T06:29:39.819 INFO:tasks.workunit.client.1.smithi079.stdout:9/941: rename d1/d45/d144 to d1/d5/d5b/d149 0 2024-05-09T06:29:39.821 INFO:tasks.workunit.client.1.smithi079.stdout:2/811: mknod d8/db/d59/c125 0 2024-05-09T06:29:39.821 INFO:tasks.workunit.client.1.smithi079.stdout:2/812: chown d8/db/d11/d5f/f75 3064 1 2024-05-09T06:29:39.822 INFO:tasks.workunit.client.1.smithi079.stdout:2/813: chown d8/db/d11/c21 4165284 1 2024-05-09T06:29:39.822 INFO:tasks.workunit.client.1.smithi079.stdout:2/814: dread - d8/db/d4b/d4f/ffe zero size 2024-05-09T06:29:39.824 INFO:tasks.workunit.client.1.smithi079.stdout:0/682: unlink d3/dd/d1f/f13 0 2024-05-09T06:29:39.829 INFO:tasks.workunit.client.1.smithi079.stdout:5/822: dwrite d13/d43/d3d/d40/d63/fde [0,4194304] 0 2024-05-09T06:29:39.829 INFO:tasks.workunit.client.1.smithi079.stdout:4/801: dwrite d6/d8/d27/d3d/d5b/d9a/d8b/fb9 [0,4194304] 0 2024-05-09T06:29:39.829 INFO:tasks.workunit.client.1.smithi079.stdout:4/802: fsync d6/d8/d55/fd2 0 2024-05-09T06:29:39.829 INFO:tasks.workunit.client.1.smithi079.stdout:6/786: mknod d0/d6/d1b/d20/c107 0 2024-05-09T06:29:39.831 INFO:tasks.workunit.client.1.smithi079.stdout:4/803: dread d6/d1a/d41/d68/f97 [0,4194304] 0 2024-05-09T06:29:39.832 INFO:tasks.workunit.client.1.smithi079.stdout:3/747: mkdir d1a/d21/db0/dd4/d3a/d54/d55/df3 0 2024-05-09T06:29:39.837 INFO:tasks.workunit.client.1.smithi079.stdout:9/942: unlink d1/d5/d5b/c9e 0 2024-05-09T06:29:39.841 INFO:tasks.workunit.client.1.smithi079.stdout:2/815: link d8/db/d11/c37 d8/db/d59/d67/d7f/c126 0 2024-05-09T06:29:39.841 INFO:tasks.workunit.client.1.smithi079.stdout:2/816: stat d8/db/d4b/d4f/ff9 0 2024-05-09T06:29:39.841 INFO:tasks.workunit.client.1.smithi079.stdout:2/817: dread - d8/db/d59/d67/d86/dd5/f10e zero size 2024-05-09T06:29:39.841 INFO:tasks.workunit.client.1.smithi079.stdout:0/683: dwrite d3/dd/d66/d6d/f8d [0,4194304] 0 2024-05-09T06:29:39.845 INFO:tasks.workunit.client.1.smithi079.stdout:7/662: sync 2024-05-09T06:29:39.848 INFO:tasks.workunit.client.1.smithi079.stdout:2/818: dread d8/db/dc/f8d [0,4194304] 0 2024-05-09T06:29:39.852 INFO:tasks.workunit.client.1.smithi079.stdout:5/823: creat d13/d92/dcd/f115 x:0 0 0 2024-05-09T06:29:39.854 INFO:tasks.workunit.client.1.smithi079.stdout:6/787: unlink d0/d6/d16/d1f/d36/d69/cea 0 2024-05-09T06:29:39.856 INFO:tasks.workunit.client.1.smithi079.stdout:3/748: mkdir d1a/d1c/d22/d53/d4e/dea/dc5/df4 0 2024-05-09T06:29:39.856 INFO:tasks.workunit.client.1.smithi079.stdout:3/749: chown d1a/d21/db0/dd4/d34/l73 352951220 1 2024-05-09T06:29:39.860 INFO:tasks.workunit.client.1.smithi079.stdout:8/689: sync 2024-05-09T06:29:39.865 INFO:tasks.workunit.client.1.smithi079.stdout:2/819: mkdir d8/db/d59/d127 0 2024-05-09T06:29:39.865 INFO:tasks.workunit.client.1.smithi079.stdout:2/820: fsync d8/db/dc/f8d 0 2024-05-09T06:29:39.869 INFO:tasks.workunit.client.1.smithi079.stdout:6/788: creat d0/d6/d5e/df6/f108 x:0 0 0 2024-05-09T06:29:39.869 INFO:tasks.workunit.client.1.smithi079.stdout:6/789: fdatasync d0/de/f59 0 2024-05-09T06:29:39.869 INFO:tasks.workunit.client.1.smithi079.stdout:6/790: fsync d0/d6/d5e/f9a 0 2024-05-09T06:29:39.871 INFO:tasks.workunit.client.1.smithi079.stdout:1/700: rename d0/d12/d48/d75/d97 to d0/d12/dc0/dd4/df3 0 2024-05-09T06:29:39.874 INFO:tasks.workunit.client.1.smithi079.stdout:9/943: getdents d1/d33/d28/d4c/d8b 0 2024-05-09T06:29:39.874 INFO:tasks.workunit.client.1.smithi079.stdout:9/944: chown d1/d33/d2b/f104 3951 1 2024-05-09T06:29:39.875 INFO:tasks.workunit.client.1.smithi079.stdout:9/945: fsync d1/d45/f59 0 2024-05-09T06:29:39.878 INFO:tasks.workunit.client.1.smithi079.stdout:8/690: mknod d1/d3/d20/d7f/cf4 0 2024-05-09T06:29:39.881 INFO:tasks.workunit.client.1.smithi079.stdout:2/821: read d8/db/d5c/d6b/db5/fab [396097,103136] 0 2024-05-09T06:29:39.882 INFO:tasks.workunit.client.1.smithi079.stdout:4/804: rename d6/d1a/d26/d2a/d54/d9e/dd5/d34/l3a to d6/d8/d55/dd6/l100 0 2024-05-09T06:29:39.882 INFO:tasks.workunit.client.1.smithi079.stdout:4/805: write d6/d8/d55/f7c [434229,58666] 0 2024-05-09T06:29:39.882 INFO:tasks.workunit.client.1.smithi079.stdout:4/806: dread - d6/d1a/d26/d2a/d54/d9e/dd5/df/dfb/fcd zero size 2024-05-09T06:29:39.883 INFO:tasks.workunit.client.1.smithi079.stdout:4/807: truncate d6/d1a/d26/d2a/d98/fac 4236122 0 2024-05-09T06:29:39.883 INFO:tasks.workunit.client.1.smithi079.stdout:5/824: dread d13/d43/d26/f57 [0,4194304] 0 2024-05-09T06:29:39.883 INFO:tasks.workunit.client.1.smithi079.stdout:5/825: chown d13/d43/d3d/d40/d63/l102 383 1 2024-05-09T06:29:39.884 INFO:tasks.workunit.client.1.smithi079.stdout:6/791: dwrite d0/d6/d16/d28/f46 [0,4194304] 0 2024-05-09T06:29:39.884 INFO:tasks.workunit.client.1.smithi079.stdout:6/792: fsync d0/d6/d16/d1f/d6f/d8c/d93/fdc 0 2024-05-09T06:29:39.885 INFO:tasks.workunit.client.1.smithi079.stdout:1/701: creat d0/d12/d67/d53/ff4 x:0 0 0 2024-05-09T06:29:39.887 INFO:tasks.workunit.client.1.smithi079.stdout:9/946: mkdir d1/d33/d28/d4c/d97/d14a 0 2024-05-09T06:29:39.888 INFO:tasks.workunit.client.1.smithi079.stdout:6/793: dread d0/f8b [0,4194304] 0 2024-05-09T06:29:39.890 INFO:tasks.workunit.client.1.smithi079.stdout:6/794: dread d0/d6/f29 [0,4194304] 0 2024-05-09T06:29:39.894 INFO:tasks.workunit.client.1.smithi079.stdout:5/826: write d13/d43/d39/f86 [1476884,64243] 0 2024-05-09T06:29:39.894 INFO:tasks.workunit.client.1.smithi079.stdout:5/827: truncate d13/d4d/d77/f113 176713 0 2024-05-09T06:29:39.895 INFO:tasks.workunit.client.1.smithi079.stdout:7/663: rename d4/d7/d78/fb4 to d4/d7/d22/fd5 0 2024-05-09T06:29:39.897 INFO:tasks.workunit.client.1.smithi079.stdout:4/808: creat d6/d8/d27/f101 x:0 0 0 2024-05-09T06:29:39.902 INFO:tasks.workunit.client.1.smithi079.stdout:1/702: mknod d0/d12/d67/db6/d8a/dc3/cf5 0 2024-05-09T06:29:39.902 INFO:tasks.workunit.client.1.smithi079.stdout:1/703: chown d0/d12/d67/db6/d8a/dc3/fea 7234897 1 2024-05-09T06:29:39.902 INFO:tasks.workunit.client.1.smithi079.stdout:1/704: dread - d0/d12/d48/d75/d43/d20/fd8 zero size 2024-05-09T06:29:39.903 INFO:tasks.workunit.client.1.smithi079.stdout:1/705: fdatasync d0/d12/d67/d53/d6d/fd6 0 2024-05-09T06:29:39.903 INFO:tasks.workunit.client.1.smithi079.stdout:1/706: write d0/d12/d67/d53/dbf/dd2/f9 [110030,22637] 0 2024-05-09T06:29:39.903 INFO:tasks.workunit.client.1.smithi079.stdout:1/707: fdatasync d0/d12/d48/d75/d43/d20/f98 0 2024-05-09T06:29:39.903 INFO:tasks.workunit.client.1.smithi079.stdout:1/708: chown d0/d12/d16/f35 841862 1 2024-05-09T06:29:39.903 INFO:tasks.workunit.client.1.smithi079.stdout:7/664: dread d4/f26 [0,4194304] 0 2024-05-09T06:29:39.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/947: symlink d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/df0/l14b 0 2024-05-09T06:29:39.905 INFO:tasks.workunit.client.1.smithi079.stdout:9/948: readlink d1/d33/d28/d36/dbe/lfc 0 2024-05-09T06:29:39.906 INFO:tasks.workunit.client.1.smithi079.stdout:1/709: dread d0/d12/d48/d75/d43/d20/d39/f5a [0,4194304] 0 2024-05-09T06:29:39.906 INFO:tasks.workunit.client.1.smithi079.stdout:1/710: chown d0/df/f8f 129 1 2024-05-09T06:29:39.908 INFO:tasks.workunit.client.1.smithi079.stdout:6/795: creat d0/d6/d16/dcd/f109 x:0 0 0 2024-05-09T06:29:39.912 INFO:tasks.workunit.client.1.smithi079.stdout:2/822: link d8/db/dc/d2c/d2e/lef d8/db/d4b/d4f/d51/d6f/l128 0 2024-05-09T06:29:39.916 INFO:tasks.workunit.client.1.smithi079.stdout:4/809: rmdir d6/d1a/d26/d2a/d54/d9e 39 2024-05-09T06:29:39.917 INFO:tasks.workunit.client.1.smithi079.stdout:9/949: creat d1/d33/f14c x:0 0 0 2024-05-09T06:29:39.918 INFO:tasks.workunit.client.1.smithi079.stdout:1/711: getdents d0/d12/d48/d75/d43/dbd 0 2024-05-09T06:29:39.919 INFO:tasks.workunit.client.1.smithi079.stdout:6/796: mkdir d0/d6/d1b/db8/d105/d10a 0 2024-05-09T06:29:39.920 INFO:tasks.workunit.client.1.smithi079.stdout:5/828: rename d13/d43/d26/cc3 to d13/d92/dcd/deb/c116 0 2024-05-09T06:29:39.921 INFO:tasks.workunit.client.1.smithi079.stdout:7/665: dwrite d4/d7/d22/d28/d74/f76 [0,4194304] 0 2024-05-09T06:29:39.922 INFO:tasks.workunit.client.1.smithi079.stdout:4/810: mknod d6/d8/d27/d3d/d5b/db4/c102 0 2024-05-09T06:29:39.923 INFO:tasks.workunit.client.1.smithi079.stdout:9/950: creat d1/d5/f14d x:0 0 0 2024-05-09T06:29:39.924 INFO:tasks.workunit.client.1.smithi079.stdout:1/712: mkdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6 0 2024-05-09T06:29:39.926 INFO:tasks.workunit.client.1.smithi079.stdout:6/797: creat d0/de/f10b x:0 0 0 2024-05-09T06:29:39.926 INFO:tasks.workunit.client.1.smithi079.stdout:6/798: truncate d0/d6/d16/d1f/d36/d69/dad/fc5 611575 0 2024-05-09T06:29:39.926 INFO:tasks.workunit.client.1.smithi079.stdout:2/823: write d8/db/dc/d2c/f31 [3870257,77520] 0 2024-05-09T06:29:39.926 INFO:tasks.workunit.client.1.smithi079.stdout:1/713: write d0/d12/d48/d75/d43/d20/f91 [86598,120502] 0 2024-05-09T06:29:39.926 INFO:tasks.workunit.client.1.smithi079.stdout:1/714: chown d0/d12/d67/db6/d8a/fb9 10555 1 2024-05-09T06:29:39.927 INFO:tasks.workunit.client.1.smithi079.stdout:5/829: rename d13/d43/d3d/d40/f42 to d13/d43/d3d/d40/d9a/dd2/f117 0 2024-05-09T06:29:39.928 INFO:tasks.workunit.client.1.smithi079.stdout:5/830: stat d13/d43/f81 0 2024-05-09T06:29:39.928 INFO:tasks.workunit.client.1.smithi079.stdout:5/831: fdatasync d13/f17 0 2024-05-09T06:29:39.928 INFO:tasks.workunit.client.1.smithi079.stdout:5/832: truncate d13/d43/d3d/d40/d53/fb0 720937 0 2024-05-09T06:29:39.937 INFO:tasks.workunit.client.1.smithi079.stdout:2/824: mkdir d8/df7/d129 0 2024-05-09T06:29:39.937 INFO:tasks.workunit.client.1.smithi079.stdout:7/666: dwrite d4/d7/dd/d5b/d31/f75 [0,4194304] 0 2024-05-09T06:29:39.942 INFO:tasks.workunit.client.1.smithi079.stdout:1/715: mknod d0/d12/d48/d75/d26/cf7 0 2024-05-09T06:29:39.942 INFO:tasks.workunit.client.1.smithi079.stdout:1/716: creat d0/d12/d67/db6/de3/ff8 x:0 0 0 2024-05-09T06:29:39.944 INFO:tasks.workunit.client.1.smithi079.stdout:4/811: rename d6/d8/d55/dd6/l100 to d6/d8/de6/l103 0 2024-05-09T06:29:39.945 INFO:tasks.workunit.client.1.smithi079.stdout:3/750: dwrite d1a/d82/fcb [0,4194304] 0 2024-05-09T06:29:39.946 INFO:tasks.workunit.client.1.smithi079.stdout:5/833: rmdir d13/ddc 0 2024-05-09T06:29:39.948 INFO:tasks.workunit.client.1.smithi079.stdout:9/951: rmdir d1/d33/d28/d36/dbe 39 2024-05-09T06:29:39.948 INFO:tasks.workunit.client.1.smithi079.stdout:9/952: write d1/d6/d114/f135 [2796904,23536] 0 2024-05-09T06:29:39.948 INFO:tasks.workunit.client.1.smithi079.stdout:6/799: dwrite d0/d60/f6c [0,4194304] 0 2024-05-09T06:29:39.953 INFO:tasks.workunit.client.1.smithi079.stdout:7/667: symlink d4/d7/d37/d90/ld6 0 2024-05-09T06:29:39.953 INFO:tasks.workunit.client.1.smithi079.stdout:7/668: fdatasync d4/d7/d22/d28/d50/f9f 0 2024-05-09T06:29:39.956 INFO:tasks.workunit.client.1.smithi079.stdout:1/717: getdents d0/d12/dc0/dd4 0 2024-05-09T06:29:39.961 INFO:tasks.workunit.client.1.smithi079.stdout:4/812: rename d6/d8/d27/d3d/d5b/db4/dc3/fcb to d6/d1a/d41/f104 0 2024-05-09T06:29:39.967 INFO:tasks.workunit.client.1.smithi079.stdout:3/751: creat d1a/d21/db0/dd4/d67/ff5 x:0 0 0 2024-05-09T06:29:39.971 INFO:tasks.workunit.client.1.smithi079.stdout:4/813: write d6/d8/d27/f85 [3549469,49956] 0 2024-05-09T06:29:39.971 INFO:tasks.workunit.client.1.smithi079.stdout:4/814: fsync d6/d8/d80/da6/fbc 0 2024-05-09T06:29:39.972 INFO:tasks.workunit.client.1.smithi079.stdout:1/718: dwrite d0/d12/d48/fe1 [0,4194304] 0 2024-05-09T06:29:39.972 INFO:tasks.workunit.client.1.smithi079.stdout:9/953: dwrite d1/d33/f14c [0,4194304] 0 2024-05-09T06:29:39.972 INFO:tasks.workunit.client.1.smithi079.stdout:9/954: fdatasync d1/d33/d28/d36/d4d/d7d/f22 0 2024-05-09T06:29:39.974 INFO:tasks.workunit.client.1.smithi079.stdout:6/800: creat d0/d6/d1b/db8/d105/f10c x:0 0 0 2024-05-09T06:29:39.979 INFO:tasks.workunit.client.1.smithi079.stdout:5/834: rename d13/d43/d39/da7/fab to d13/d4d/d77/f118 0 2024-05-09T06:29:39.982 INFO:tasks.workunit.client.1.smithi079.stdout:3/752: creat d1a/d21/db0/de5/ff6 x:0 0 0 2024-05-09T06:29:39.986 INFO:tasks.workunit.client.1.smithi079.stdout:6/801: write d0/d6/d1b/db8/fe5 [2667830,128332] 0 2024-05-09T06:29:39.986 INFO:tasks.workunit.client.1.smithi079.stdout:6/802: stat d0/d6/d5e/f71 0 2024-05-09T06:29:39.986 INFO:tasks.workunit.client.1.smithi079.stdout:6/803: chown d0/d6/d16/dcd/dce/fa4 340620161 1 2024-05-09T06:29:39.986 INFO:tasks.workunit.client.1.smithi079.stdout:6/804: stat d0/d6/d1b/d20/l51 0 2024-05-09T06:29:39.988 INFO:tasks.workunit.client.1.smithi079.stdout:4/815: mkdir d6/d1a/d26/d2a/dde/df1/d105 0 2024-05-09T06:29:39.993 INFO:tasks.workunit.client.1.smithi079.stdout:4/816: dread d6/d1a/d26/d2a/d54/f17 [0,4194304] 0 2024-05-09T06:29:39.998 INFO:tasks.workunit.client.1.smithi079.stdout:1/719: dwrite d0/d12/d67/d53/dbf/dd2/d4e/f6c [4194304,4194304] 0 2024-05-09T06:29:39.999 INFO:tasks.workunit.client.1.smithi079.stdout:9/955: dwrite d1/d5/d9a/f73 [0,4194304] 0 2024-05-09T06:29:39.999 INFO:tasks.workunit.client.1.smithi079.stdout:9/956: dread - d1/d45/dc6/dc9/da9/fdb zero size 2024-05-09T06:29:40.000 INFO:tasks.workunit.client.1.smithi079.stdout:1/720: dread d0/d12/d67/db6/d8a/f9f [0,4194304] 0 2024-05-09T06:29:40.000 INFO:tasks.workunit.client.1.smithi079.stdout:7/669: rename d4/d7/dd/d5b/c71 to d4/d9e/dc5/cd7 0 2024-05-09T06:29:40.000 INFO:tasks.workunit.client.1.smithi079.stdout:7/670: chown d4/d7/dd/d5b/f5d 53398171 1 2024-05-09T06:29:40.000 INFO:tasks.workunit.client.1.smithi079.stdout:7/671: read d4/d7/d22/d28/d50/d5c/d85/fa9 [228125,5028] 0 2024-05-09T06:29:40.001 INFO:tasks.workunit.client.1.smithi079.stdout:5/835: mknod d13/d43/d8e/c119 0 2024-05-09T06:29:40.004 INFO:tasks.workunit.client.1.smithi079.stdout:3/753: mknod d1a/d21/db0/de5/cf7 0 2024-05-09T06:29:40.005 INFO:tasks.workunit.client.1.smithi079.stdout:9/957: read d1/d33/d28/d36/d4d/d7d/d19/fa6 [1429625,104457] 0 2024-05-09T06:29:40.005 INFO:tasks.workunit.client.1.smithi079.stdout:9/958: readlink d1/d45/dc6/dc9/d2d/d99/dd5/d3a/la8 0 2024-05-09T06:29:40.008 INFO:tasks.workunit.client.1.smithi079.stdout:6/805: unlink d0/d6/d5e/df6/f108 0 2024-05-09T06:29:40.022 INFO:tasks.workunit.client.1.smithi079.stdout:1/721: rename d0/d12/d67/d53/dbf/dd2/fb to d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6/ff9 0 2024-05-09T06:29:40.024 INFO:tasks.workunit.client.1.smithi079.stdout:7/672: mkdir d4/d7/d37/d7c/d8e/dd8 0 2024-05-09T06:29:40.026 INFO:tasks.workunit.client.1.smithi079.stdout:5/836: mkdir d13/d43/d3d/d40/d9a/dd2/d11a 0 2024-05-09T06:29:40.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/754: symlink d1a/d82/d87/db2/lf8 0 2024-05-09T06:29:40.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/755: chown d1a/d1c/d22/l93 972 1 2024-05-09T06:29:40.031 INFO:tasks.workunit.client.1.smithi079.stdout:9/959: mkdir d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/d13b/d14e 0 2024-05-09T06:29:40.031 INFO:tasks.workunit.client.1.smithi079.stdout:9/960: stat d1/d45/dc6/dc9/f2e 0 2024-05-09T06:29:40.031 INFO:tasks.workunit.client.1.smithi079.stdout:9/961: chown d1/d45/dc6/dc9/d2d/d99 445170 1 2024-05-09T06:29:40.033 INFO:tasks.workunit.client.1.smithi079.stdout:6/806: mkdir d0/d6/d1b/d20/d10d 0 2024-05-09T06:29:40.037 INFO:tasks.workunit.client.1.smithi079.stdout:3/756: mknod d1a/d21/db0/dd4/d3a/d54/cf9 0 2024-05-09T06:29:40.037 INFO:tasks.workunit.client.1.smithi079.stdout:3/757: readlink d1a/d21/db0/dd4/d3a/l6d 0 2024-05-09T06:29:40.037 INFO:tasks.workunit.client.1.smithi079.stdout:3/758: write d1a/d21/db0/dd4/f2f [3578381,55806] 0 2024-05-09T06:29:40.039 INFO:tasks.workunit.client.1.smithi079.stdout:9/962: mknod d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/d13b/c14f 0 2024-05-09T06:29:40.042 INFO:tasks.workunit.client.1.smithi079.stdout:7/673: dwrite d4/d7/d22/f2a [0,4194304] 0 2024-05-09T06:29:40.042 INFO:tasks.workunit.client.1.smithi079.stdout:1/722: dwrite d0/d12/d48/d75/d43/d70/fe4 [0,4194304] 0 2024-05-09T06:29:40.042 INFO:tasks.workunit.client.1.smithi079.stdout:1/723: chown d0/d12 903 1 2024-05-09T06:29:40.042 INFO:tasks.workunit.client.1.smithi079.stdout:7/674: chown d4/d7/d22/d28/d50/d5c/d85/db6/fc4 10 1 2024-05-09T06:29:40.044 INFO:tasks.workunit.client.1.smithi079.stdout:3/759: creat d1a/d21/db0/dd4/d34/ffa x:0 0 0 2024-05-09T06:29:40.047 INFO:tasks.workunit.client.1.smithi079.stdout:9/963: rename d1/d45/dc6/dc9/d2d/l47 to d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/df0/l150 0 2024-05-09T06:29:40.055 INFO:tasks.workunit.client.1.smithi079.stdout:7/675: link d4/d7/dd/f21 d4/d7/d22/d28/fd9 0 2024-05-09T06:29:40.058 INFO:tasks.workunit.client.1.smithi079.stdout:1/724: link d0/d12/d67/d53/dbf/dd2/d3e/fe6 d0/d12/d48/d75/d43/d20/ffa 0 2024-05-09T06:29:40.058 INFO:tasks.workunit.client.1.smithi079.stdout:1/725: creat d0/d12/d67/db6/d89/ffb x:0 0 0 2024-05-09T06:29:40.059 INFO:tasks.workunit.client.1.smithi079.stdout:6/807: dwrite d0/d6/d16/d1f/d6f/d8c/d93/fe0 [0,4194304] 0 2024-05-09T06:29:40.059 INFO:tasks.workunit.client.1.smithi079.stdout:6/808: write d0/d6/d16/d1f/f49 [5160458,121888] 0 2024-05-09T06:29:40.060 INFO:tasks.workunit.client.1.smithi079.stdout:3/760: dwrite fd [0,4194304] 0 2024-05-09T06:29:40.060 INFO:tasks.workunit.client.1.smithi079.stdout:3/761: chown d1a/d82/d87/fe1 862133 1 2024-05-09T06:29:40.060 INFO:tasks.workunit.client.1.smithi079.stdout:3/762: stat f5 0 2024-05-09T06:29:40.062 INFO:tasks.workunit.client.1.smithi079.stdout:7/676: write d4/d7/dd/f16 [311218,81457] 0 2024-05-09T06:29:40.062 INFO:tasks.workunit.client.1.smithi079.stdout:7/677: stat d4/d7/dd/d5b/d31/d34/cb7 0 2024-05-09T06:29:40.063 INFO:tasks.workunit.client.1.smithi079.stdout:7/678: fsync d4/d7/dd/d5b/d31/d34/f7a 0 2024-05-09T06:29:40.064 INFO:tasks.workunit.client.1.smithi079.stdout:1/726: mkdir d0/df/db8/dfc 0 2024-05-09T06:29:40.069 INFO:tasks.workunit.client.1.smithi079.stdout:6/809: creat d0/d6/d16/f10e x:0 0 0 2024-05-09T06:29:40.070 INFO:tasks.workunit.client.1.smithi079.stdout:6/810: chown d0/d6/d16/d1f/d36 69 1 2024-05-09T06:29:40.071 INFO:tasks.workunit.client.1.smithi079.stdout:9/964: mknod d1/d33/c151 0 2024-05-09T06:29:40.071 INFO:tasks.workunit.client.1.smithi079.stdout:9/965: write d1/d33/d28/d4c/d8b/fde [167450,81563] 0 2024-05-09T06:29:40.073 INFO:tasks.workunit.client.1.smithi079.stdout:7/679: write d4/d7/dd/d5b/d31/f75 [2652905,92658] 0 2024-05-09T06:29:40.076 INFO:tasks.workunit.client.1.smithi079.stdout:3/763: unlink d1a/d82/le6 0 2024-05-09T06:29:40.088 INFO:tasks.workunit.client.1.smithi079.stdout:6/811: dwrite d0/d6/d16/dcd/dd7/ff7 [0,4194304] 0 2024-05-09T06:29:40.093 INFO:tasks.workunit.client.1.smithi079.stdout:1/727: symlink d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/lfd 0 2024-05-09T06:29:40.094 INFO:tasks.workunit.client.1.smithi079.stdout:1/728: creat d0/d12/d92/ffe x:0 0 0 2024-05-09T06:29:40.094 INFO:tasks.workunit.client.1.smithi079.stdout:1/729: chown d0/df/c56 58 1 2024-05-09T06:29:40.095 INFO:tasks.workunit.client.1.smithi079.stdout:9/966: creat d1/d33/d48/d64/df4/f152 x:0 0 0 2024-05-09T06:29:40.095 INFO:tasks.workunit.client.1.smithi079.stdout:9/967: readlink d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/dd7/lea 0 2024-05-09T06:29:40.095 INFO:tasks.workunit.client.1.smithi079.stdout:9/968: stat d1/d33/d28/d4c/d97/ld8 0 2024-05-09T06:29:40.099 INFO:tasks.workunit.client.1.smithi079.stdout:7/680: rmdir d4/d7/d22/d28/d50/d5c 39 2024-05-09T06:29:40.108 INFO:tasks.workunit.client.1.smithi079.stdout:9/969: dwrite d1/d33/d28/fe8 [8388608,4194304] 0 2024-05-09T06:29:40.108 INFO:tasks.workunit.client.1.smithi079.stdout:1/730: symlink d0/d12/d48/d75/d43/d20/lff 0 2024-05-09T06:29:40.110 INFO:tasks.workunit.client.1.smithi079.stdout:7/681: truncate d4/d7/f13 3527556 0 2024-05-09T06:29:40.114 INFO:tasks.workunit.client.1.smithi079.stdout:6/812: getdents d0/d6/d1b/d20/dac 0 2024-05-09T06:29:40.121 INFO:tasks.workunit.client.1.smithi079.stdout:9/970: mknod d1/d33/d28/d36/dcd/c153 0 2024-05-09T06:29:40.121 INFO:tasks.workunit.client.1.smithi079.stdout:9/971: write d1/d5/f14d [518341,65618] 0 2024-05-09T06:29:40.122 INFO:tasks.workunit.client.1.smithi079.stdout:3/764: rmdir d1a/d82 39 2024-05-09T06:29:40.123 INFO:tasks.workunit.client.1.smithi079.stdout:1/731: getdents d0/d12/d67/d53/d5e 0 2024-05-09T06:29:40.125 INFO:tasks.workunit.client.1.smithi079.stdout:7/682: mknod d4/d7/dd/d5b/d31/d34/cda 0 2024-05-09T06:29:40.146 INFO:tasks.workunit.client.1.smithi079.stdout:9/972: dwrite d1/d33/d28/fec [0,4194304] 0 2024-05-09T06:29:40.146 INFO:tasks.workunit.client.1.smithi079.stdout:7/683: dwrite d4/f64 [0,4194304] 0 2024-05-09T06:29:40.149 INFO:tasks.workunit.client.1.smithi079.stdout:9/973: dread d1/d5/f21 [0,4194304] 0 2024-05-09T06:29:40.157 INFO:tasks.workunit.client.1.smithi079.stdout:9/974: dread d1/d6/f13 [0,4194304] 0 2024-05-09T06:29:40.158 INFO:tasks.workunit.client.1.smithi079.stdout:9/975: stat d1/f8e 0 2024-05-09T06:29:40.158 INFO:tasks.workunit.client.1.smithi079.stdout:9/976: fsync d1/d45/dc6/dc9/da9/d100/fe5 0 2024-05-09T06:29:40.205 INFO:tasks.workunit.client.1.smithi079.stdout:6/813: creat d0/d6/d1b/d20/d10d/f10f x:0 0 0 2024-05-09T06:29:40.206 INFO:tasks.workunit.client.1.smithi079.stdout:3/765: mkdir d1a/d1c/d22/d90/dfb 0 2024-05-09T06:29:40.206 INFO:tasks.workunit.client.1.smithi079.stdout:3/766: stat d1a/d1c/d22/d53/da5/c88 0 2024-05-09T06:29:40.221 INFO:tasks.workunit.client.1.smithi079.stdout:7/684: unlink d4/d7/dd/d47/c94 0 2024-05-09T06:29:40.225 INFO:tasks.workunit.client.1.smithi079.stdout:1/732: getdents d0/d12/d48/d75/d43/d20 0 2024-05-09T06:29:40.226 INFO:tasks.workunit.client.1.smithi079.stdout:1/733: stat d0/d12/d67/d53/d6d 0 2024-05-09T06:29:40.226 INFO:tasks.workunit.client.1.smithi079.stdout:1/734: truncate d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/fb2 729381 0 2024-05-09T06:29:40.242 INFO:tasks.workunit.client.1.smithi079.stdout:9/977: rename d1/d33/d28/d36/dcd/de7/d75/l110 to d1/d33/d48/dbf/l154 0 2024-05-09T06:29:40.245 INFO:tasks.workunit.client.1.smithi079.stdout:6/814: mkdir d0/de/d110 0 2024-05-09T06:29:40.252 INFO:tasks.workunit.client.1.smithi079.stdout:3/767: creat d1a/d1c/d22/ffc x:0 0 0 2024-05-09T06:29:40.252 INFO:tasks.workunit.client.1.smithi079.stdout:3/768: fsync fc 0 2024-05-09T06:29:40.253 INFO:tasks.workunit.client.1.smithi079.stdout:3/769: chown d1a/d82/daa/fc4 2660590 1 2024-05-09T06:29:40.254 INFO:tasks.workunit.client.1.smithi079.stdout:7/685: unlink d4/d7/f49 0 2024-05-09T06:29:40.254 INFO:tasks.workunit.client.1.smithi079.stdout:7/686: fsync d4/d7/dd/d5b/f5d 0 2024-05-09T06:29:40.260 INFO:tasks.workunit.client.1.smithi079.stdout:1/735: mknod d0/d12/d67/db6/d89/c100 0 2024-05-09T06:29:40.260 INFO:tasks.workunit.client.1.smithi079.stdout:1/736: fdatasync d0/d12/d67/db6/de3/ff8 0 2024-05-09T06:29:40.260 INFO:tasks.workunit.client.1.smithi079.stdout:6/815: mknod d0/d60/d8e/c111 0 2024-05-09T06:29:40.336 INFO:tasks.workunit.client.1.smithi079.stdout:3/770: write d1a/d82/f89 [613500,125086] 0 2024-05-09T06:29:40.336 INFO:tasks.workunit.client.1.smithi079.stdout:3/771: readlink d1a/d82/d87/db2/lf8 0 2024-05-09T06:29:40.353 INFO:tasks.workunit.client.1.smithi079.stdout:1/737: dread d0/d12/d48/d75/d26/f76 [0,4194304] 0 2024-05-09T06:29:40.376 INFO:tasks.workunit.client.1.smithi079.stdout:3/772: dread d1a/d21/db0/dd4/fb5 [0,4194304] 0 2024-05-09T06:29:40.388 INFO:tasks.workunit.client.1.smithi079.stdout:3/773: unlink d1a/d1c/d22/d53/d4e/dea/fb4 0 2024-05-09T06:29:40.425 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:40 smithi079 ceph-mon[35268]: pgmap v249: 65 pgs: 65 active+clean; 1.5 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 147 MiB/s rd, 187 MiB/s wr, 627 op/s 2024-05-09T06:29:40.441 INFO:tasks.workunit.client.1.smithi079.stdout:3/774: dwrite d1a/d21/db0/dd4/d3a/d54/fd2 [4194304,4194304] 0 2024-05-09T06:29:40.447 INFO:tasks.workunit.client.1.smithi079.stdout:3/775: symlink d1a/d82/d87/db2/ddb/de9/lfd 0 2024-05-09T06:29:40.448 INFO:tasks.workunit.client.1.smithi079.stdout:3/776: chown d1a/d21/db0/dd4/d3a/l6d 304723 1 2024-05-09T06:29:40.470 INFO:tasks.workunit.client.1.smithi079.stdout:6/816: dwrite d0/d6/d1b/db8/fe5 [4194304,4194304] 0 2024-05-09T06:29:40.470 INFO:tasks.workunit.client.1.smithi079.stdout:6/817: chown d0/da2/ld2 2988807 1 2024-05-09T06:29:40.474 INFO:tasks.workunit.client.1.smithi079.stdout:6/818: link d0/d6/d16/d28/f67 d0/d60/d81/f112 0 2024-05-09T06:29:40.503 INFO:tasks.workunit.client.1.smithi079.stdout:6/819: read d0/d6/d1b/d2d/feb [1666256,51417] 0 2024-05-09T06:29:40.510 INFO:tasks.workunit.client.1.smithi079.stdout:6/820: write d0/de/f3a [712055,117544] 0 2024-05-09T06:29:40.515 INFO:tasks.workunit.client.1.smithi079.stdout:6/821: rmdir d0/d6/d16/d1f/d36/d69/d84 39 2024-05-09T06:29:40.525 INFO:tasks.workunit.client.1.smithi079.stdout:6/822: unlink d0/d6/d1b/d20/fa6 0 2024-05-09T06:29:40.531 INFO:tasks.workunit.client.1.smithi079.stdout:6/823: link d0/d60/c7c d0/da2/c113 0 2024-05-09T06:29:40.531 INFO:tasks.workunit.client.1.smithi079.stdout:6/824: chown d0/d6/d1b/d20/c3c 0 1 2024-05-09T06:29:40.539 INFO:tasks.workunit.client.1.smithi079.stdout:6/825: creat d0/d6/d16/d1f/d36/d69/f114 x:0 0 0 2024-05-09T06:29:40.545 INFO:tasks.workunit.client.1.smithi079.stdout:6/826: creat d0/d6/d16/d1f/d36/db5/f115 x:0 0 0 2024-05-09T06:29:40.546 INFO:tasks.workunit.client.1.smithi079.stdout:6/827: write d0/d60/daf/fb3 [77390,116083] 0 2024-05-09T06:29:40.549 INFO:tasks.workunit.client.1.smithi079.stdout:6/828: write d0/d6/d5e/f71 [623568,106595] 0 2024-05-09T06:29:40.553 INFO:tasks.workunit.client.1.smithi079.stdout:9/978: dwrite d1/d5/f134 [0,4194304] 0 2024-05-09T06:29:40.553 INFO:tasks.workunit.client.1.smithi079.stdout:3/777: dwrite d1a/d21/db0/dd4/d67/ff5 [0,4194304] 0 2024-05-09T06:29:40.553 INFO:tasks.workunit.client.1.smithi079.stdout:3/778: truncate d1a/d82/d87/db2/fc1 4257042 0 2024-05-09T06:29:40.553 INFO:tasks.workunit.client.1.smithi079.stdout:3/779: truncate d1a/d1c/d22/d53/da5/f97 469849 0 2024-05-09T06:29:40.554 INFO:tasks.workunit.client.1.smithi079.stdout:3/780: fdatasync d1a/d1c/d22/d53/f96 0 2024-05-09T06:29:40.555 INFO:tasks.workunit.client.1.smithi079.stdout:8/691: sync 2024-05-09T06:29:40.555 INFO:tasks.workunit.client.1.smithi079.stdout:5/837: sync 2024-05-09T06:29:40.555 INFO:tasks.workunit.client.1.smithi079.stdout:5/838: chown d13/d43/d39/d61/f62 515 1 2024-05-09T06:29:40.555 INFO:tasks.workunit.client.1.smithi079.stdout:4/817: sync 2024-05-09T06:29:40.555 INFO:tasks.workunit.client.1.smithi079.stdout:2/825: sync 2024-05-09T06:29:40.555 INFO:tasks.workunit.client.1.smithi079.stdout:0/684: sync 2024-05-09T06:29:40.555 INFO:tasks.workunit.client.1.smithi079.stdout:0/685: truncate d3/dd/d66/d6d/d74/d80/d2d/da7/dce/fd6 845058 0 2024-05-09T06:29:40.566 INFO:tasks.workunit.client.1.smithi079.stdout:3/781: write d1a/d1c/d22/d53/f86 [473339,126742] 0 2024-05-09T06:29:40.570 INFO:tasks.workunit.client.1.smithi079.stdout:8/692: creat d1/d56/ff5 x:0 0 0 2024-05-09T06:29:40.571 INFO:tasks.workunit.client.1.smithi079.stdout:9/979: read d1/d45/f86 [3568894,60777] 0 2024-05-09T06:29:40.574 INFO:tasks.workunit.client.1.smithi079.stdout:5/839: mkdir d13/d43/d39/d61/d72/dd7/d11b 0 2024-05-09T06:29:40.575 INFO:tasks.workunit.client.1.smithi079.stdout:6/829: dwrite d0/d6/f74 [0,4194304] 0 2024-05-09T06:29:40.577 INFO:tasks.workunit.client.1.smithi079.stdout:4/818: mknod d6/d8/d27/d62/c106 0 2024-05-09T06:29:40.577 INFO:tasks.workunit.client.1.smithi079.stdout:4/819: dread - d6/d8/d27/d3d/d5b/ff4 zero size 2024-05-09T06:29:40.577 INFO:tasks.workunit.client.1.smithi079.stdout:4/820: read - d6/d1a/d26/d2a/d54/d9e/dd5/df/d8e/fc1 zero size 2024-05-09T06:29:40.581 INFO:tasks.workunit.client.1.smithi079.stdout:2/826: mknod d8/db/d59/d93/dc7/dd9/c12a 0 2024-05-09T06:29:40.581 INFO:tasks.workunit.client.1.smithi079.stdout:2/827: chown d8/db/d5c/d6b/db5/ld1 77205348 1 2024-05-09T06:29:40.581 INFO:tasks.workunit.client.1.smithi079.stdout:2/828: chown d8/db/d59/d67/d86/cdf 16209 1 2024-05-09T06:29:40.583 INFO:tasks.workunit.client.1.smithi079.stdout:0/686: symlink d3/dd/d18/le1 0 2024-05-09T06:29:40.589 INFO:tasks.workunit.client.1.smithi079.stdout:8/693: rename d1/db/f27 to d1/ff6 0 2024-05-09T06:29:40.589 INFO:tasks.workunit.client.1.smithi079.stdout:8/694: dread - d1/d3/d20/d7f/dc3/d3b/fe9 zero size 2024-05-09T06:29:40.591 INFO:tasks.workunit.client.1.smithi079.stdout:5/840: link d13/d43/ddb/cfe d13/da5/de4/c11c 0 2024-05-09T06:29:40.595 INFO:tasks.workunit.client.1.smithi079.stdout:3/782: dwrite d1a/d1c/d22/ffc [0,4194304] 0 2024-05-09T06:29:40.596 INFO:tasks.workunit.client.1.smithi079.stdout:3/783: fdatasync d1a/d1c/d22/f30 0 2024-05-09T06:29:40.596 INFO:tasks.workunit.client.1.smithi079.stdout:9/980: dwrite d1/d33/d28/d36/d4d/d7d/d19/f1f [4194304,4194304] 0 2024-05-09T06:29:40.596 INFO:tasks.workunit.client.1.smithi079.stdout:9/981: chown d1/d5/c115 13717 1 2024-05-09T06:29:40.596 INFO:tasks.workunit.client.1.smithi079.stdout:9/982: write d1/d33/d28/d4c/d8b/fde [206224,32] 0 2024-05-09T06:29:40.596 INFO:tasks.workunit.client.1.smithi079.stdout:7/687: dwrite d4/d7/dd/d5b/d31/fc1 [0,4194304] 0 2024-05-09T06:29:40.597 INFO:tasks.workunit.client.1.smithi079.stdout:0/687: dread d3/dd/d1f/d1e/d2c/d35/fc2 [0,4194304] 0 2024-05-09T06:29:40.599 INFO:tasks.workunit.client.1.smithi079.stdout:6/830: truncate d0/f8b 2933514 0 2024-05-09T06:29:40.608 INFO:tasks.workunit.client.1.smithi079.stdout:4/821: stat d6/d1a/d41/l5d 0 2024-05-09T06:29:40.608 INFO:tasks.workunit.client.1.smithi079.stdout:3/784: dread d1a/d21/db0/dd4/d34/d59/f74 [0,4194304] 0 2024-05-09T06:29:40.608 INFO:tasks.workunit.client.1.smithi079.stdout:3/785: fdatasync d1a/d21/db0/dd4/d34/d42/fa8 0 2024-05-09T06:29:40.608 INFO:tasks.workunit.client.1.smithi079.stdout:3/786: chown d1a/d1c/d22 50 1 2024-05-09T06:29:40.610 INFO:tasks.workunit.client.1.smithi079.stdout:2/829: mknod d8/db/dc/d2c/c12b 0 2024-05-09T06:29:40.614 INFO:tasks.workunit.client.1.smithi079.stdout:8/695: mknod d1/d56/dbd/cf7 0 2024-05-09T06:29:40.615 INFO:tasks.workunit.client.1.smithi079.stdout:0/688: dread d3/dd/d1f/d1e/d91/fb8 [0,4194304] 0 2024-05-09T06:29:40.617 INFO:tasks.workunit.client.1.smithi079.stdout:5/841: creat d13/d43/d3d/d40/d53/de9/f11d x:0 0 0 2024-05-09T06:29:40.618 INFO:tasks.workunit.client.1.smithi079.stdout:2/830: read d8/db/d59/d67/d7f/db9/dca/fe2 [1262564,26639] 0 2024-05-09T06:29:40.618 INFO:tasks.workunit.client.1.smithi079.stdout:2/831: chown d8/db/d11/d5f 0 1 2024-05-09T06:29:40.627 INFO:tasks.workunit.client.1.smithi079.stdout:9/983: unlink d1/d5/d9a/f137 0 2024-05-09T06:29:40.628 INFO:tasks.workunit.client.1.smithi079.stdout:0/689: write d3/dd/f53 [2364177,47637] 0 2024-05-09T06:29:40.628 INFO:tasks.workunit.client.1.smithi079.stdout:0/690: readlink d3/dd/d66/d6d/d74/d80/d76/l79 0 2024-05-09T06:29:40.628 INFO:tasks.workunit.client.1.smithi079.stdout:0/691: write d3/d5/d87/fa8 [1014723,98975] 0 2024-05-09T06:29:40.635 INFO:tasks.workunit.client.1.smithi079.stdout:7/688: dread d4/d7/dd/d5b/d31/f81 [0,4194304] 0 2024-05-09T06:29:40.656 INFO:tasks.workunit.client.1.smithi079.stdout:4/822: rmdir d6/d1a/d26/d2a/d54/d9e/dd5 39 2024-05-09T06:29:40.657 INFO:tasks.workunit.client.1.smithi079.stdout:4/823: write d6/d8/f4f [3761062,53018] 0 2024-05-09T06:29:40.657 INFO:tasks.workunit.client.1.smithi079.stdout:4/824: fsync d6/d8/d27/f46 0 2024-05-09T06:29:40.658 INFO:tasks.workunit.client.1.smithi079.stdout:9/984: dwrite d1/f123 [0,4194304] 0 2024-05-09T06:29:40.658 INFO:tasks.workunit.client.1.smithi079.stdout:9/985: truncate d1/d5/f14d 1344469 0 2024-05-09T06:29:40.659 INFO:tasks.workunit.client.1.smithi079.stdout:2/832: link d8/db/d11/d5f/fce d8/db/d59/d93/dc7/df8/dfa/f12c 0 2024-05-09T06:29:40.659 INFO:tasks.workunit.client.1.smithi079.stdout:2/833: chown d8/db/d11/l5a 323880 1 2024-05-09T06:29:40.661 INFO:tasks.workunit.client.1.smithi079.stdout:0/692: mknod d3/d5/ce2 0 2024-05-09T06:29:40.661 INFO:tasks.workunit.client.1.smithi079.stdout:0/693: dread - d3/dd/d1f/d1e/d2c/d88/f8b zero size 2024-05-09T06:29:40.661 INFO:tasks.workunit.client.1.smithi079.stdout:0/694: readlink d3/dd/d66/d6d/d74/d80/d2d/l33 0 2024-05-09T06:29:40.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:40 smithi062 ceph-mon[26920]: pgmap v249: 65 pgs: 65 active+clean; 1.5 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 147 MiB/s rd, 187 MiB/s wr, 627 op/s 2024-05-09T06:29:40.665 INFO:tasks.workunit.client.1.smithi079.stdout:4/825: creat d6/d1a/d26/d2a/d54/d9e/dd5/d34/f107 x:0 0 0 2024-05-09T06:29:40.671 INFO:tasks.workunit.client.1.smithi079.stdout:3/787: dwrite d1a/d1c/d22/d53/f43 [0,4194304] 0 2024-05-09T06:29:40.671 INFO:tasks.workunit.client.1.smithi079.stdout:3/788: truncate d1a/d1c/d22/d53/d4e/fe3 4970793 0 2024-05-09T06:29:40.673 INFO:tasks.workunit.client.1.smithi079.stdout:6/831: dwrite d0/d6/d1b/f106 [0,4194304] 0 2024-05-09T06:29:40.675 INFO:tasks.workunit.client.1.smithi079.stdout:5/842: dwrite d13/d43/d3d/d40/d63/da2/d8b/fe8 [0,4194304] 0 2024-05-09T06:29:40.676 INFO:tasks.workunit.client.1.smithi079.stdout:3/789: rename d1a/d82/daa/fc4 to d1a/dcc/ffe 0 2024-05-09T06:29:40.676 INFO:tasks.workunit.client.1.smithi079.stdout:3/790: creat d1a/d1c/d22/fff x:0 0 0 2024-05-09T06:29:40.676 INFO:tasks.workunit.client.1.smithi079.stdout:3/791: write d1a/d82/f89 [3464502,3343] 0 2024-05-09T06:29:40.677 INFO:tasks.workunit.client.1.smithi079.stdout:2/834: symlink d8/db/d4b/d4f/l12d 0 2024-05-09T06:29:40.677 INFO:tasks.workunit.client.1.smithi079.stdout:2/835: chown d8/db/d4b/d4f/d51/d6f/f73 22785 1 2024-05-09T06:29:40.684 INFO:tasks.workunit.client.1.smithi079.stdout:6/832: mkdir d0/d60/d8e/d116 0 2024-05-09T06:29:40.684 INFO:tasks.workunit.client.1.smithi079.stdout:6/833: chown d0/d6/d16/d1f/d36/d69/l9f 28916199 1 2024-05-09T06:29:40.687 INFO:tasks.workunit.client.1.smithi079.stdout:5/843: truncate d13/d43/d26/f3c 4893287 0 2024-05-09T06:29:40.691 INFO:tasks.workunit.client.1.smithi079.stdout:4/826: dwrite d6/d1a/d26/d2a/d54/f23 [4194304,4194304] 0 2024-05-09T06:29:40.693 INFO:tasks.workunit.client.1.smithi079.stdout:6/834: unlink d0/d6/d16/d1f/d36/d69/l9f 0 2024-05-09T06:29:40.696 INFO:tasks.workunit.client.1.smithi079.stdout:7/689: dwrite d4/f11 [0,4194304] 0 2024-05-09T06:29:40.698 INFO:tasks.workunit.client.1.smithi079.stdout:4/827: creat d6/d8/d27/d3d/d5b/f108 x:0 0 0 2024-05-09T06:29:40.699 INFO:tasks.workunit.client.1.smithi079.stdout:4/828: write d6/d1a/d41/d68/f97 [757682,89116] 0 2024-05-09T06:29:40.701 INFO:tasks.workunit.client.1.smithi079.stdout:6/835: rename d0/d60/d8e/c111 to d0/d6/d1b/c117 0 2024-05-09T06:29:40.701 INFO:tasks.workunit.client.1.smithi079.stdout:3/792: dwrite d1a/d1c/fa2 [0,4194304] 0 2024-05-09T06:29:40.706 INFO:tasks.workunit.client.1.smithi079.stdout:5/844: dwrite d13/d43/d3d/d40/d63/da2/d8b/fe8 [0,4194304] 0 2024-05-09T06:29:40.716 INFO:tasks.workunit.client.1.smithi079.stdout:4/829: symlink d6/d1a/l109 0 2024-05-09T06:29:40.716 INFO:tasks.workunit.client.1.smithi079.stdout:7/690: dwrite d4/d7/dd/d5b/d31/f33 [0,4194304] 0 2024-05-09T06:29:40.720 INFO:tasks.workunit.client.1.smithi079.stdout:3/793: readlink d1a/d21/db0/dd4/d34/d59/l6e 0 2024-05-09T06:29:40.721 INFO:tasks.workunit.client.1.smithi079.stdout:3/794: chown d1a/dcc/ffe 769 1 2024-05-09T06:29:40.723 INFO:tasks.workunit.client.1.smithi079.stdout:5/845: mknod d13/d92/dcd/deb/c11e 0 2024-05-09T06:29:40.730 INFO:tasks.workunit.client.1.smithi079.stdout:5/846: symlink d13/d43/d3d/d40/d9a/df8/l11f 0 2024-05-09T06:29:40.733 INFO:tasks.workunit.client.1.smithi079.stdout:4/830: creat d6/d8/d27/d3d/d92/f10a x:0 0 0 2024-05-09T06:29:40.734 INFO:tasks.workunit.client.1.smithi079.stdout:5/847: symlink d13/d43/d3d/d40/d9a/dd2/l120 0 2024-05-09T06:29:40.736 INFO:tasks.workunit.client.1.smithi079.stdout:4/831: mkdir d6/d8/d27/d3d/d5b/d9a/d8b/daa/d10b 0 2024-05-09T06:29:40.738 INFO:tasks.workunit.client.1.smithi079.stdout:5/848: rename d13/d43/d3d/d40/ce5 to d13/d4d/d77/c121 0 2024-05-09T06:29:40.741 INFO:tasks.workunit.client.1.smithi079.stdout:5/849: rmdir d13/d43/d3d/d40/d53/dad 39 2024-05-09T06:29:40.741 INFO:tasks.workunit.client.1.smithi079.stdout:5/850: dread - d13/d43/d26/d35/f100 zero size 2024-05-09T06:29:40.742 INFO:tasks.workunit.client.1.smithi079.stdout:3/795: dwrite d1a/d21/db0/de5/ff6 [0,4194304] 0 2024-05-09T06:29:40.744 INFO:tasks.workunit.client.1.smithi079.stdout:5/851: mknod d13/d43/d3d/d40/d9a/dd2/d11a/c122 0 2024-05-09T06:29:40.749 INFO:tasks.workunit.client.1.smithi079.stdout:7/691: dwrite d4/d7/d22/fd5 [0,4194304] 0 2024-05-09T06:29:40.750 INFO:tasks.workunit.client.1.smithi079.stdout:4/832: dwrite d6/d1a/d26/f30 [4194304,4194304] 0 2024-05-09T06:29:40.753 INFO:tasks.workunit.client.1.smithi079.stdout:3/796: rename d1a/d82/fcb to d1a/d21/db0/dd4/d34/d59/f100 0 2024-05-09T06:29:40.758 INFO:tasks.workunit.client.1.smithi079.stdout:4/833: mkdir d6/d8/d27/d3d/d5b/d10c 0 2024-05-09T06:29:40.758 INFO:tasks.workunit.client.1.smithi079.stdout:7/692: write d4/d7/d22/d28/d50/d5c/d85/db6/fc4 [1963191,94481] 0 2024-05-09T06:29:40.758 INFO:tasks.workunit.client.1.smithi079.stdout:7/693: write d4/d7/dd/d47/f79 [4282358,31761] 0 2024-05-09T06:29:40.758 INFO:tasks.workunit.client.1.smithi079.stdout:7/694: stat d4/d7/dd/d5b/d6f/f62 0 2024-05-09T06:29:40.759 INFO:tasks.workunit.client.1.smithi079.stdout:3/797: mknod d1a/d82/d87/db2/ddb/de9/c101 0 2024-05-09T06:29:40.766 INFO:tasks.workunit.client.1.smithi079.stdout:3/798: mknod d1a/d21/db0/dd4/d3a/d54/d55/c102 0 2024-05-09T06:29:40.766 INFO:tasks.workunit.client.1.smithi079.stdout:3/799: read d1a/d82/d87/db2/fc1 [2562154,57348] 0 2024-05-09T06:29:40.768 INFO:tasks.workunit.client.1.smithi079.stdout:7/695: rmdir d4/d7/d37/d67 39 2024-05-09T06:29:40.768 INFO:tasks.workunit.client.1.smithi079.stdout:7/696: truncate d4/d7/d37/f4a 858380 0 2024-05-09T06:29:40.769 INFO:tasks.workunit.client.1.smithi079.stdout:7/697: dread - d4/d7/d22/d28/d50/d5c/fad zero size 2024-05-09T06:29:40.769 INFO:tasks.workunit.client.1.smithi079.stdout:7/698: stat d4/d7/d37/d90 0 2024-05-09T06:29:40.769 INFO:tasks.workunit.client.1.smithi079.stdout:7/699: dread - d4/d7/d37/fa5 zero size 2024-05-09T06:29:40.771 INFO:tasks.workunit.client.1.smithi079.stdout:3/800: mknod d1a/d1c/d22/d53/d4e/dea/dc5/c103 0 2024-05-09T06:29:40.771 INFO:tasks.workunit.client.1.smithi079.stdout:4/834: dwrite d6/d1a/d41/d68/da1/fa9 [0,4194304] 0 2024-05-09T06:29:40.774 INFO:tasks.workunit.client.1.smithi079.stdout:7/700: unlink d4/d7/dd/d5b/f69 0 2024-05-09T06:29:40.780 INFO:tasks.workunit.client.1.smithi079.stdout:3/801: mkdir d1a/d21/ddc/d104 0 2024-05-09T06:29:40.782 INFO:tasks.workunit.client.1.smithi079.stdout:4/835: creat d6/d8/d27/d3d/f10d x:0 0 0 2024-05-09T06:29:40.782 INFO:tasks.workunit.client.1.smithi079.stdout:4/836: truncate d6/d1a/d26/d2a/d54/d9e/fd8 551123 0 2024-05-09T06:29:40.787 INFO:tasks.workunit.client.1.smithi079.stdout:7/701: truncate d4/d7/dd/f42 1610940 0 2024-05-09T06:29:40.787 INFO:tasks.workunit.client.1.smithi079.stdout:7/702: chown d4/d7/dd/d5b/f44 22 1 2024-05-09T06:29:40.788 INFO:tasks.workunit.client.1.smithi079.stdout:7/703: fdatasync d4/d7/dd/d5b/d31/fce 0 2024-05-09T06:29:40.788 INFO:tasks.workunit.client.1.smithi079.stdout:7/704: fsync d4/d7/dd/d5b/fc8 0 2024-05-09T06:29:40.790 INFO:tasks.workunit.client.1.smithi079.stdout:4/837: getdents d6/d1a/d41/d68/d6b 0 2024-05-09T06:29:40.790 INFO:tasks.workunit.client.1.smithi079.stdout:4/838: fdatasync d6/d8/d27/d62/f51 0 2024-05-09T06:29:40.791 INFO:tasks.workunit.client.1.smithi079.stdout:3/802: dread d1a/d1c/d22/f30 [0,4194304] 0 2024-05-09T06:29:40.815 INFO:tasks.workunit.client.1.smithi079.stdout:4/839: dwrite d6/d1a/d41/d68/ff2 [0,4194304] 0 2024-05-09T06:29:40.817 INFO:tasks.workunit.client.1.smithi079.stdout:3/803: dwrite d1a/d1c/d22/d53/f86 [0,4194304] 0 2024-05-09T06:29:40.820 INFO:tasks.workunit.client.1.smithi079.stdout:4/840: rename d6/d1a/f6e to d6/d1a/d41/d68/da1/f10e 0 2024-05-09T06:29:40.824 INFO:tasks.workunit.client.1.smithi079.stdout:3/804: mknod d1a/d1c/d22/d53/d4e/dea/c105 0 2024-05-09T06:29:40.824 INFO:tasks.workunit.client.1.smithi079.stdout:3/805: stat d1a/d1c/d22/f30 0 2024-05-09T06:29:40.827 INFO:tasks.workunit.client.1.smithi079.stdout:3/806: truncate d1a/d21/f70 3235973 0 2024-05-09T06:29:40.831 INFO:tasks.workunit.client.1.smithi079.stdout:3/807: rename d1a/d1c/d22/l25 to d1a/d1c/d22/d90/db8/l106 0 2024-05-09T06:29:40.831 INFO:tasks.workunit.client.1.smithi079.stdout:3/808: readlink d1a/d21/db0/le8 0 2024-05-09T06:29:40.834 INFO:tasks.workunit.client.1.smithi079.stdout:4/841: dwrite d6/f24 [4194304,4194304] 0 2024-05-09T06:29:40.834 INFO:tasks.workunit.client.1.smithi079.stdout:4/842: chown d6/d8/d27/f46 0 1 2024-05-09T06:29:40.834 INFO:tasks.workunit.client.1.smithi079.stdout:3/809: rename d1a/d1c/d1f/l65 to d1a/d21/db0/dd4/d3a/da4/l107 0 2024-05-09T06:29:40.838 INFO:tasks.workunit.client.1.smithi079.stdout:4/843: unlink d6/d8/d27/fb2 0 2024-05-09T06:29:40.840 INFO:tasks.workunit.client.1.smithi079.stdout:3/810: mkdir d1a/d21/db0/dd4/d3a/da4/df0/d108 0 2024-05-09T06:29:40.842 INFO:tasks.workunit.client.1.smithi079.stdout:3/811: symlink d1a/d21/db0/dd4/d3a/da4/l109 0 2024-05-09T06:29:40.842 INFO:tasks.workunit.client.1.smithi079.stdout:3/812: chown d1a/d1c/d22/d90/db8/l106 3900 1 2024-05-09T06:29:40.842 INFO:tasks.workunit.client.1.smithi079.stdout:3/813: fdatasync d1a/d21/fd0 0 2024-05-09T06:29:40.846 INFO:tasks.workunit.client.1.smithi079.stdout:4/844: dread d6/d1a/d41/d68/da1/f10e [0,4194304] 0 2024-05-09T06:29:40.853 INFO:tasks.workunit.client.1.smithi079.stdout:4/845: dread d6/d8/d27/f46 [0,4194304] 0 2024-05-09T06:29:40.974 INFO:tasks.workunit.client.1.smithi079.stdout:1/738: sync 2024-05-09T06:29:40.974 INFO:tasks.workunit.client.1.smithi079.stdout:1/739: truncate d0/d12/dc0/dd4/df3/fdd 953934 0 2024-05-09T06:29:40.974 INFO:tasks.workunit.client.1.smithi079.stdout:1/740: write d0/d12/d48/d75/d43/d20/d39/f78 [373592,18279] 0 2024-05-09T06:29:40.979 INFO:tasks.workunit.client.1.smithi079.stdout:7/705: truncate d4/d7/d22/d28/d50/d5c/d85/f91 1718010 0 2024-05-09T06:29:40.979 INFO:tasks.workunit.client.1.smithi079.stdout:7/706: chown d4/d7/dd/d5b/l36 28 1 2024-05-09T06:29:40.979 INFO:tasks.workunit.client.1.smithi079.stdout:7/707: chown d4/d9e/dc5 428 1 2024-05-09T06:29:40.982 INFO:tasks.workunit.client.1.smithi079.stdout:7/708: getdents d4/d7 0 2024-05-09T06:29:40.985 INFO:tasks.workunit.client.1.smithi079.stdout:7/709: mknod d4/d9e/cdb 0 2024-05-09T06:29:40.985 INFO:tasks.workunit.client.1.smithi079.stdout:7/710: stat d4/d7/d37/d7c/d8e/dd8 0 2024-05-09T06:29:40.990 INFO:tasks.workunit.client.1.smithi079.stdout:1/741: dwrite d0/d12/d48/d75/d26/f55 [0,4194304] 0 2024-05-09T06:29:40.998 INFO:tasks.workunit.client.1.smithi079.stdout:1/742: mkdir d0/d12/d48/dd7/d101 0 2024-05-09T06:29:41.001 INFO:tasks.workunit.client.1.smithi079.stdout:1/743: dread d0/d12/d67/d53/dbf/dd2/d4e/f63 [0,4194304] 0 2024-05-09T06:29:41.007 INFO:tasks.workunit.client.1.smithi079.stdout:7/711: dwrite d4/d7/dd/d5b/fc8 [0,4194304] 0 2024-05-09T06:29:41.007 INFO:tasks.workunit.client.1.smithi079.stdout:7/712: chown d4/d7/d37/f68 100 1 2024-05-09T06:29:41.007 INFO:tasks.workunit.client.1.smithi079.stdout:7/713: readlink d4/d7/dd/d5b/l70 0 2024-05-09T06:29:41.014 INFO:tasks.workunit.client.1.smithi079.stdout:7/714: rename d4/d7/dd/d5b/d32/da0 to d4/d7/d22/d28/d50/d5c/ddc 0 2024-05-09T06:29:41.015 INFO:tasks.workunit.client.1.smithi079.stdout:1/744: dwrite d0/d12/d16/f19 [4194304,4194304] 0 2024-05-09T06:29:41.021 INFO:tasks.workunit.client.1.smithi079.stdout:7/715: read d4/d7/dd/d5b/d32/f8b [2885052,39242] 0 2024-05-09T06:29:41.021 INFO:tasks.workunit.client.1.smithi079.stdout:7/716: write d4/d7/dd/f16 [626760,72174] 0 2024-05-09T06:29:41.038 INFO:tasks.workunit.client.1.smithi079.stdout:1/745: dwrite d0/d12/d48/d75/d43/d20/d39/f78 [0,4194304] 0 2024-05-09T06:29:41.042 INFO:tasks.workunit.client.1.smithi079.stdout:1/746: symlink d0/d12/d48/d75/d26/l102 0 2024-05-09T06:29:41.042 INFO:tasks.workunit.client.1.smithi079.stdout:1/747: chown d0/d12/d48/d75/c3d 275 1 2024-05-09T06:29:41.042 INFO:tasks.workunit.client.1.smithi079.stdout:1/748: creat d0/d12/d67/d53/d6d/f103 x:0 0 0 2024-05-09T06:29:41.043 INFO:tasks.workunit.client.1.smithi079.stdout:1/749: write d0/d12/d48/fb3 [622201,48345] 0 2024-05-09T06:29:41.045 INFO:tasks.workunit.client.1.smithi079.stdout:1/750: getdents d0/d12/d67/d53/dbf/dd2/d4e/d7d 0 2024-05-09T06:29:41.048 INFO:tasks.workunit.client.1.smithi079.stdout:1/751: mkdir d0/d12/d67/db6/d8a/d104 0 2024-05-09T06:29:41.048 INFO:tasks.workunit.client.1.smithi079.stdout:1/752: fdatasync d0/d12/d67/d53/dbf/dd2/f8d 0 2024-05-09T06:29:41.050 INFO:tasks.workunit.client.1.smithi079.stdout:1/753: mknod d0/df/c105 0 2024-05-09T06:29:41.050 INFO:tasks.workunit.client.1.smithi079.stdout:1/754: creat d0/d12/d16/f106 x:0 0 0 2024-05-09T06:29:41.054 INFO:tasks.workunit.client.1.smithi079.stdout:1/755: rename d0/d12/d16/f2f to d0/d12/d67/d53/dbf/dd2/d4e/d7d/f107 0 2024-05-09T06:29:41.055 INFO:tasks.workunit.client.1.smithi079.stdout:1/756: getdents d0/d12/d67/db6 0 2024-05-09T06:29:41.072 INFO:tasks.workunit.client.1.smithi079.stdout:1/757: dwrite d0/d12/d92/ffe [0,4194304] 0 2024-05-09T06:29:41.078 INFO:tasks.workunit.client.1.smithi079.stdout:1/758: mknod d0/d12/d48/d75/d43/d20/c108 0 2024-05-09T06:29:41.085 INFO:tasks.workunit.client.1.smithi079.stdout:1/759: read d0/d12/d48/d75/d43/d70/fe4 [3817478,16419] 0 2024-05-09T06:29:41.085 INFO:tasks.workunit.client.1.smithi079.stdout:1/760: readlink d0/d12/d48/l4d 0 2024-05-09T06:29:41.085 INFO:tasks.workunit.client.1.smithi079.stdout:1/761: chown d0/d12/d67/d53/dbf/dd2/c90 74 1 2024-05-09T06:29:41.087 INFO:tasks.workunit.client.1.smithi079.stdout:1/762: unlink d0/d12/d48/d75/d43/d20/d39/ce5 0 2024-05-09T06:29:41.087 INFO:tasks.workunit.client.1.smithi079.stdout:1/763: readlink d0/d12/d48/l52 0 2024-05-09T06:29:41.090 INFO:tasks.workunit.client.1.smithi079.stdout:1/764: creat d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/f109 x:0 0 0 2024-05-09T06:29:41.090 INFO:tasks.workunit.client.1.smithi079.stdout:1/765: fdatasync d0/d12/d67/d53/f7a 0 2024-05-09T06:29:41.094 INFO:tasks.workunit.client.1.smithi079.stdout:1/766: rmdir d0/d12/d67/d53/dbf/dd2/d3e 39 2024-05-09T06:29:41.096 INFO:tasks.workunit.client.1.smithi079.stdout:1/767: creat d0/df/db8/f10a x:0 0 0 2024-05-09T06:29:41.097 INFO:tasks.workunit.client.1.smithi079.stdout:1/768: readlink d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ldf 0 2024-05-09T06:29:41.097 INFO:tasks.workunit.client.1.smithi079.stdout:1/769: chown d0/d12/d92/f9a 0 1 2024-05-09T06:29:41.097 INFO:tasks.workunit.client.1.smithi079.stdout:1/770: fsync d0/d12/d48/d75/d43/d20/f5f 0 2024-05-09T06:29:41.097 INFO:tasks.workunit.client.1.smithi079.stdout:1/771: dread d0/df/f62 [0,4194304] 0 2024-05-09T06:29:41.101 INFO:tasks.workunit.client.1.smithi079.stdout:1/772: mkdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6/d10b 0 2024-05-09T06:29:41.238 INFO:tasks.workunit.client.1.smithi079.stdout:8/696: sync 2024-05-09T06:29:41.238 INFO:tasks.workunit.client.1.smithi079.stdout:0/695: sync 2024-05-09T06:29:41.238 INFO:tasks.workunit.client.1.smithi079.stdout:2/836: sync 2024-05-09T06:29:41.238 INFO:tasks.workunit.client.1.smithi079.stdout:0/696: chown d3/dd/d1f/d1e/d2c/d88/d8e 7188 1 2024-05-09T06:29:41.238 INFO:tasks.workunit.client.1.smithi079.stdout:4/846: sync 2024-05-09T06:29:41.238 INFO:tasks.workunit.client.1.smithi079.stdout:5/852: sync 2024-05-09T06:29:41.238 INFO:tasks.workunit.client.1.smithi079.stdout:0/697: readlink d3/dd/d1f/d1e/d2c/d7f/l9a 0 2024-05-09T06:29:41.239 INFO:tasks.workunit.client.1.smithi079.stdout:9/986: sync 2024-05-09T06:29:41.239 INFO:tasks.workunit.client.1.smithi079.stdout:5/853: chown c10 8 1 2024-05-09T06:29:41.239 INFO:tasks.workunit.client.1.smithi079.stdout:2/837: dread - d8/db/d59/d67/d7f/db9/de1/ffd zero size 2024-05-09T06:29:41.239 INFO:tasks.workunit.client.1.smithi079.stdout:9/987: dread - d1/d33/d28/d4c/d97/dd3/ded/def/f138 zero size 2024-05-09T06:29:41.242 INFO:tasks.workunit.client.1.smithi079.stdout:4/847: mknod d6/d8/d27/d3d/d92/c10f 0 2024-05-09T06:29:41.243 INFO:tasks.workunit.client.1.smithi079.stdout:0/698: dread d3/dd/d1f/d1e/d2c/d35/d36/f3d [0,4194304] 0 2024-05-09T06:29:41.245 INFO:tasks.workunit.client.1.smithi079.stdout:2/838: creat d8/db/d59/d93/dc7/dd9/f12e x:0 0 0 2024-05-09T06:29:41.245 INFO:tasks.workunit.client.1.smithi079.stdout:4/848: dread d6/f33 [0,4194304] 0 2024-05-09T06:29:41.249 INFO:tasks.workunit.client.1.smithi079.stdout:5/854: mknod d13/d43/d3d/d40/d53/dad/c123 0 2024-05-09T06:29:41.251 INFO:tasks.workunit.client.1.smithi079.stdout:0/699: mkdir d3/dd/d1f/d1e/d2c/d88/d8e/de3 0 2024-05-09T06:29:41.254 INFO:tasks.workunit.client.1.smithi079.stdout:4/849: symlink d6/d1a/d26/d2a/d54/d9e/dd5/df/l110 0 2024-05-09T06:29:41.256 INFO:tasks.workunit.client.1.smithi079.stdout:5/855: mkdir d13/d43/d3d/d40/d63/da2/d8b/d110/d124 0 2024-05-09T06:29:41.256 INFO:tasks.workunit.client.1.smithi079.stdout:5/856: chown d13/d43/dea 8638355 1 2024-05-09T06:29:41.259 INFO:tasks.workunit.client.1.smithi079.stdout:0/700: mknod d3/dd/d18/d5e/d69/ce4 0 2024-05-09T06:29:41.259 INFO:tasks.workunit.client.1.smithi079.stdout:0/701: chown d3/dd/d18/f9e 1022045 1 2024-05-09T06:29:41.259 INFO:tasks.workunit.client.1.smithi079.stdout:0/702: truncate d3/dd/d66/f7b 437620 0 2024-05-09T06:29:41.259 INFO:tasks.workunit.client.1.smithi079.stdout:0/703: write d3/dd/d66/d6d/da6/f8c [1471961,10706] 0 2024-05-09T06:29:41.261 INFO:tasks.workunit.client.1.smithi079.stdout:4/850: symlink d6/d8/d80/da6/l111 0 2024-05-09T06:29:41.264 INFO:tasks.workunit.client.1.smithi079.stdout:5/857: symlink d13/d43/d3d/d40/d63/l125 0 2024-05-09T06:29:41.266 INFO:tasks.workunit.client.1.smithi079.stdout:4/851: mkdir d6/d1a/d26/d2a/d54/d9e/dd5/df/dfb/d112 0 2024-05-09T06:29:41.268 INFO:tasks.workunit.client.1.smithi079.stdout:5/858: mkdir d13/d4f/d126 0 2024-05-09T06:29:41.269 INFO:tasks.workunit.client.1.smithi079.stdout:9/988: dwrite d1/d6/dae/fce [0,4194304] 0 2024-05-09T06:29:41.272 INFO:tasks.workunit.client.1.smithi079.stdout:0/704: rename d3/dd/d66/d6d/d74/d80/f67 to d3/dd/d66/d6d/d74/d84/fe5 0 2024-05-09T06:29:41.274 INFO:tasks.workunit.client.1.smithi079.stdout:4/852: creat d6/d8/d80/f113 x:0 0 0 2024-05-09T06:29:41.278 INFO:tasks.workunit.client.1.smithi079.stdout:5/859: mknod d13/d43/d3d/d40/d63/da2/d8b/c127 0 2024-05-09T06:29:41.280 INFO:tasks.workunit.client.1.smithi079.stdout:5/860: write d13/d43/d3d/d40/d63/da2/fc2 [330552,123304] 0 2024-05-09T06:29:41.280 INFO:tasks.workunit.client.1.smithi079.stdout:5/861: chown d13/d43/d3d/d40/d63/f8c 283 1 2024-05-09T06:29:41.280 INFO:tasks.workunit.client.1.smithi079.stdout:5/862: write d13/d4f/f78 [3835908,94939] 0 2024-05-09T06:29:41.280 INFO:tasks.workunit.client.1.smithi079.stdout:5/863: stat l4 0 2024-05-09T06:29:41.282 INFO:tasks.workunit.client.1.smithi079.stdout:0/705: rename d3/dd/d66/d6d/fd3 to d3/dd/d66/d6d/d74/fe6 0 2024-05-09T06:29:41.286 INFO:tasks.workunit.client.1.smithi079.stdout:9/989: dwrite d1/d33/d28/d36/dbe/ff9 [0,4194304] 0 2024-05-09T06:29:41.287 INFO:tasks.workunit.client.1.smithi079.stdout:5/864: rename d13/d43/c2d to d13/d92/dcd/deb/c128 0 2024-05-09T06:29:41.289 INFO:tasks.workunit.client.1.smithi079.stdout:4/853: mkdir d6/d8/d114 0 2024-05-09T06:29:41.296 INFO:tasks.workunit.client.1.smithi079.stdout:9/990: symlink d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/dd7/l155 0 2024-05-09T06:29:41.298 INFO:tasks.workunit.client.1.smithi079.stdout:0/706: rename d3/dd/c22 to d3/dd/d1f/d1e/d2c/d35/ce7 0 2024-05-09T06:29:41.298 INFO:tasks.workunit.client.1.smithi079.stdout:0/707: truncate d3/dd/d66/d6d/fae 634801 0 2024-05-09T06:29:41.299 INFO:tasks.workunit.client.1.smithi079.stdout:9/991: write d1/d6/f1c [3939234,60429] 0 2024-05-09T06:29:41.300 INFO:tasks.workunit.client.1.smithi079.stdout:9/992: readlink d1/d33/d28/d36/d4d/d7d/d19/db8/dd4/df0/l14b 0 2024-05-09T06:29:41.300 INFO:tasks.workunit.client.1.smithi079.stdout:4/854: unlink d6/d15/l7d 0 2024-05-09T06:29:41.303 INFO:tasks.workunit.client.1.smithi079.stdout:0/708: rmdir d3 39 2024-05-09T06:29:41.307 INFO:tasks.workunit.client.1.smithi079.stdout:4/855: link d6/d1a/d26/fba d6/d8/d55/f115 0 2024-05-09T06:29:41.310 INFO:tasks.workunit.client.1.smithi079.stdout:0/709: write d3/dd/d1f/d1e/d2c/d35/d36/f4c [234036,65366] 0 2024-05-09T06:29:41.310 INFO:tasks.workunit.client.1.smithi079.stdout:4/856: rmdir d6/d1a/d41/d68 39 2024-05-09T06:29:41.310 INFO:tasks.workunit.client.1.smithi079.stdout:5/865: dwrite d13/d4f/d80/f10a [0,4194304] 0 2024-05-09T06:29:41.311 INFO:tasks.workunit.client.1.smithi079.stdout:5/866: write d13/da5/fff [656945,95071] 0 2024-05-09T06:29:41.311 INFO:tasks.workunit.client.1.smithi079.stdout:5/867: fsync d13/d43/d9e/f104 0 2024-05-09T06:29:41.311 INFO:tasks.workunit.client.1.smithi079.stdout:5/868: chown d13/d43/d3d/d40/d63/da2/d8b/ff6 20904 1 2024-05-09T06:29:41.314 INFO:tasks.workunit.client.1.smithi079.stdout:1/773: rmdir d0/d12/d48/d75 39 2024-05-09T06:29:41.314 INFO:tasks.workunit.client.1.smithi079.stdout:1/774: write d0/d12/d67/d53/dbf/dd2/fc [962444,23137] 0 2024-05-09T06:29:41.316 INFO:tasks.workunit.client.1.smithi079.stdout:0/710: creat d3/dd/d66/fe8 x:0 0 0 2024-05-09T06:29:41.316 INFO:tasks.workunit.client.1.smithi079.stdout:0/711: chown d3/dd/d18/f7a 0 1 2024-05-09T06:29:41.318 INFO:tasks.workunit.client.1.smithi079.stdout:9/993: dwrite d1/d6/f20 [0,4194304] 0 2024-05-09T06:29:41.319 INFO:tasks.workunit.client.1.smithi079.stdout:5/869: write d13/d43/d26/f33 [1583116,17871] 0 2024-05-09T06:29:41.319 INFO:tasks.workunit.client.1.smithi079.stdout:5/870: dread - d13/d43/d26/d35/f100 zero size 2024-05-09T06:29:41.322 INFO:tasks.workunit.client.1.smithi079.stdout:1/775: rename d0/f58 to d0/f10c 0 2024-05-09T06:29:41.322 INFO:tasks.workunit.client.1.smithi079.stdout:1/776: chown d0/d12/dc0/dd4/df3/fdd 663674086 1 2024-05-09T06:29:41.323 INFO:tasks.workunit.client.1.smithi079.stdout:4/857: write d6/d1a/d26/d2a/d54/f23 [6206342,32415] 0 2024-05-09T06:29:41.323 INFO:tasks.workunit.client.1.smithi079.stdout:0/712: mkdir d3/dd/d66/de9 0 2024-05-09T06:29:41.327 INFO:tasks.workunit.client.1.smithi079.stdout:9/994: mkdir d1/d45/dc6/dc9/d2d/d99/dd5/d3a/d56/d13b/d156 0 2024-05-09T06:29:41.333 INFO:tasks.workunit.client.1.smithi079.stdout:5/871: rename d13/d43/d3d/d40/d53/de9/f11d to d13/d43/d3d/d40/d9a/dd2/d11a/f129 0 2024-05-09T06:29:41.333 INFO:tasks.workunit.client.1.smithi079.stdout:5/872: creat d13/da5/de4/d101/f12a x:0 0 0 2024-05-09T06:29:41.333 INFO:tasks.workunit.client.1.smithi079.stdout:5/873: write d13/d4f/f97 [396771,91741] 0 2024-05-09T06:29:41.336 INFO:tasks.workunit.client.1.smithi079.stdout:1/777: creat d0/d12/d67/d53/d5e/f10d x:0 0 0 2024-05-09T06:29:41.339 INFO:tasks.workunit.client.1.smithi079.stdout:9/995: unlink d1/d45/dc6/dc9/f4a 0 2024-05-09T06:29:41.342 INFO:tasks.workunit.client.1.smithi079.stdout:4/858: rename d6/d1a/d41/d68/da1/fa9 to d6/d8/d27/d3d/d5b/d9a/f116 0 2024-05-09T06:29:41.345 INFO:tasks.workunit.client.1.smithi079.stdout:5/874: mknod d13/d43/d3d/d40/d63/da2/d8b/d110/c12b 0 2024-05-09T06:29:41.345 INFO:tasks.workunit.client.1.smithi079.stdout:5/875: write d13/d43/d3d/d40/d9a/dd2/d11a/f129 [230532,86286] 0 2024-05-09T06:29:41.347 INFO:tasks.workunit.client.1.smithi079.stdout:1/778: rename d0/d12/d48/d75/d43/d20/f9d to d0/d12/d48/d75/d26/f10e 0 2024-05-09T06:29:41.349 INFO:tasks.workunit.client.1.smithi079.stdout:9/996: dread d1/d5/d5b/fa4 [0,4194304] 0 2024-05-09T06:29:41.350 INFO:tasks.workunit.client.1.smithi079.stdout:5/876: rename d13/c3f to d13/d92/dcd/dcf/c12c 0 2024-05-09T06:29:41.350 INFO:tasks.workunit.client.1.smithi079.stdout:5/877: getdents d13/d43/d39/d61/d72/dd7/d11b 0 2024-05-09T06:29:41.352 INFO:tasks.workunit.client.1.smithi079.stdout:1/779: mkdir d0/d12/dc0/dd4/df3/d10f 0 2024-05-09T06:29:41.353 INFO:tasks.workunit.client.1.smithi079.stdout:9/997: truncate d1/d45/dc6/dc9/d2d/d99/f11d 1470757 0 2024-05-09T06:29:41.355 INFO:tasks.workunit.client.1.smithi079.stdout:5/878: unlink d13/d43/d26/d35/f6d 0 2024-05-09T06:29:41.356 INFO:tasks.workunit.client.1.smithi079.stdout:5/879: creat d13/d43/d39/da7/f12d x:0 0 0 2024-05-09T06:29:41.356 INFO:tasks.workunit.client.1.smithi079.stdout:5/880: stat d13/d2a 0 2024-05-09T06:29:41.357 INFO:tasks.workunit.client.1.smithi079.stdout:1/780: mknod d0/d12/d67/d93/c110 0 2024-05-09T06:29:41.357 INFO:tasks.workunit.client.1.smithi079.stdout:1/781: write d0/d12/d48/d75/f69 [2168777,115009] 0 2024-05-09T06:29:41.357 INFO:tasks.workunit.client.1.smithi079.stdout:1/782: fsync d0/d12/d67/d53/dbf/dd2/d4e/d7d/fb7 0 2024-05-09T06:29:41.357 INFO:tasks.workunit.client.1.smithi079.stdout:1/783: fdatasync d0/d12/d16/fd0 0 2024-05-09T06:29:41.359 INFO:tasks.workunit.client.1.smithi079.stdout:5/881: stat d13/d43/d39/d61/cf2 0 2024-05-09T06:29:41.359 INFO:tasks.workunit.client.1.smithi079.stdout:5/882: fsync d13/d43/d3d/d40/d63/f8c 0 2024-05-09T06:29:41.359 INFO:tasks.workunit.client.1.smithi079.stdout:5/883: truncate d13/da5/de4/d101/f12a 689687 0 2024-05-09T06:29:41.360 INFO:tasks.workunit.client.1.smithi079.stdout:6/836: sync 2024-05-09T06:29:41.360 INFO:tasks.workunit.client.1.smithi079.stdout:3/814: sync 2024-05-09T06:29:41.360 INFO:tasks.workunit.client.1.smithi079.stdout:7/717: sync 2024-05-09T06:29:41.360 INFO:tasks.workunit.client.1.smithi079.stdout:3/815: chown d1a/d21/db0/dd4/d3a/d7c/fa9 3 1 2024-05-09T06:29:41.361 INFO:tasks.workunit.client.1.smithi079.stdout:1/784: creat d0/d12/dc0/dd4/f111 x:0 0 0 2024-05-09T06:29:41.365 INFO:tasks.workunit.client.1.smithi079.stdout:8/697: dwrite d1/d3/d20/d7f/dc3/d3b/fb7 [0,4194304] 0 2024-05-09T06:29:41.365 INFO:tasks.workunit.client.1.smithi079.stdout:8/698: dread - d1/d3/d20/d7f/d33/d5d/d6d/dc0/ff3 zero size 2024-05-09T06:29:41.365 INFO:tasks.workunit.client.1.smithi079.stdout:7/718: dread d4/d7/dd/d5b/d31/f33 [0,4194304] 0 2024-05-09T06:29:41.367 INFO:tasks.workunit.client.1.smithi079.stdout:2/839: dwrite d8/db/d59/d67/d7f/db9/f120 [0,4194304] 0 2024-05-09T06:29:41.369 INFO:tasks.workunit.client.1.smithi079.stdout:1/785: symlink d0/d12/d67/d53/dbf/dd2/d3e/dcd/l112 0 2024-05-09T06:29:41.370 INFO:tasks.workunit.client.1.smithi079.stdout:5/884: creat d13/d43/d26/dac/f12e x:0 0 0 2024-05-09T06:29:41.371 INFO:tasks.workunit.client.1.smithi079.stdout:6/837: truncate d0/de/f1e 1491431 0 2024-05-09T06:29:41.379 INFO:tasks.workunit.client.1.smithi079.stdout:8/699: creat d1/d3/d20/d7f/dc3/d50/dd7/ff8 x:0 0 0 2024-05-09T06:29:41.379 INFO:tasks.workunit.client.1.smithi079.stdout:1/786: write d0/d12/d48/d75/d43/f47 [1223124,103530] 0 2024-05-09T06:29:41.380 INFO:tasks.workunit.client.1.smithi079.stdout:7/719: mknod d4/d7/d22/d28/d50/d5c/d85/db6/cdd 0 2024-05-09T06:29:41.382 INFO:tasks.workunit.client.1.smithi079.stdout:3/816: mkdir d1a/d21/db0/dd4/d67/d10a 0 2024-05-09T06:29:41.383 INFO:tasks.workunit.client.1.smithi079.stdout:8/700: dread d1/d56/d7c/d8f/fa8 [4194304,4194304] 0 2024-05-09T06:29:41.384 INFO:tasks.workunit.client.1.smithi079.stdout:8/701: fsync d1/db/f78 0 2024-05-09T06:29:41.384 INFO:tasks.workunit.client.1.smithi079.stdout:8/702: write d1/d3/d20/d7f/dc3/d3b/fd0 [2676253,22799] 0 2024-05-09T06:29:41.388 INFO:tasks.workunit.client.1.smithi079.stdout:2/840: mkdir d8/d12f 0 2024-05-09T06:29:41.390 INFO:tasks.workunit.client.1.smithi079.stdout:7/720: dread d4/d7/dd/d5b/d31/d34/f87 [0,4194304] 0 2024-05-09T06:29:41.390 INFO:tasks.workunit.client.1.smithi079.stdout:0/713: dwrite d3/f4 [0,4194304] 0 2024-05-09T06:29:41.390 INFO:tasks.workunit.client.1.smithi079.stdout:9/998: dwrite d1/d5/d9a/f85 [8388608,4194304] 0 2024-05-09T06:29:41.390 INFO:tasks.workunit.client.1.smithi079.stdout:4/859: dwrite d6/d1a/d26/d2a/d54/d9e/fc0 [0,4194304] 0 2024-05-09T06:29:41.391 INFO:tasks.workunit.client.1.smithi079.stdout:5/885: unlink d13/d92/fa3 0 2024-05-09T06:29:41.394 INFO:tasks.workunit.client.1.smithi079.stdout:6/838: mkdir d0/d60/d118 0 2024-05-09T06:29:41.397 INFO:tasks.workunit.client.1.smithi079.stdout:0/714: dread d3/dd/d1f/d1e/d2c/d35/d36/f3d [0,4194304] 0 2024-05-09T06:29:41.397 INFO:tasks.workunit.client.1.smithi079.stdout:0/715: chown d3/fa1 14 1 2024-05-09T06:29:41.397 INFO:tasks.workunit.client.1.smithi079.stdout:0/716: fdatasync d3/dd/f53 0 2024-05-09T06:29:41.398 INFO:tasks.workunit.client.1.smithi079.stdout:1/787: rename d0/df/cec to d0/d12/d48/d75/d43/d70/c113 0 2024-05-09T06:29:41.399 INFO:tasks.workunit.client.1.smithi079.stdout:3/817: symlink d1a/d1c/l10b 0 2024-05-09T06:29:41.404 INFO:tasks.workunit.client.1.smithi079.stdout:2/841: dwrite d8/db/d4b/d4f/d51/d6f/f73 [0,4194304] 0 2024-05-09T06:29:41.405 INFO:tasks.workunit.client.1.smithi079.stdout:7/721: symlink d4/d7/lde 0 2024-05-09T06:29:41.407 INFO:tasks.workunit.client.1.smithi079.stdout:9/999: chown d1/d45/dc6/dc9/cc1 6 1 2024-05-09T06:29:41.412 INFO:tasks.workunit.client.1.smithi079.stdout:4/860: getdents d6/d1a/d26/d2a/dde/df1 0 2024-05-09T06:29:41.412 INFO:tasks.workunit.client.1.smithi079.stdout:4/861: dread - d6/d1a/d26/d2a/d54/d9e/dd5/df/d8e/fc1 zero size 2024-05-09T06:29:41.412 INFO:tasks.workunit.client.1.smithi079.stdout:4/862: dread - d6/d8/d27/d3d/f10d zero size 2024-05-09T06:29:41.414 INFO:tasks.workunit.client.1.smithi079.stdout:5/886: creat d13/d92/dcd/deb/f12f x:0 0 0 2024-05-09T06:29:41.416 INFO:tasks.workunit.client.1.smithi079.stdout:6/839: mkdir d0/d6/d1b/db8/d119 0 2024-05-09T06:29:41.419 INFO:tasks.workunit.client.1.smithi079.stdout:7/722: dwrite d4/d7/dd/d5b/d31/d34/f3c [0,4194304] 0 2024-05-09T06:29:41.421 INFO:tasks.workunit.client.1.smithi079.stdout:8/703: rename d1/d3/d20/d7f/dc3/d3b/fd0 to d1/d5/d36/da0/ff9 0 2024-05-09T06:29:41.424 INFO:tasks.workunit.client.1.smithi079.stdout:3/818: link d1a/d1c/d22/d53/ceb d1a/d21/db0/dd4/c10c 0 2024-05-09T06:29:41.448 INFO:tasks.workunit.client.1.smithi079.stdout:6/840: mknod d0/d6/c11a 0 2024-05-09T06:29:41.453 INFO:tasks.workunit.client.1.smithi079.stdout:7/723: symlink d4/d7/d78/ldf 0 2024-05-09T06:29:41.454 INFO:tasks.workunit.client.1.smithi079.stdout:7/724: dread d4/d7/dd/d5b/d31/f81 [0,4194304] 0 2024-05-09T06:29:41.454 INFO:tasks.workunit.client.1.smithi079.stdout:8/704: stat d1/d5/c42 0 2024-05-09T06:29:41.457 INFO:tasks.workunit.client.1.smithi079.stdout:5/887: write d13/d43/d26/f2e [777597,81932] 0 2024-05-09T06:29:41.457 INFO:tasks.workunit.client.1.smithi079.stdout:0/717: rename d3/dd/d18/f34 to d3/dd/d66/d6d/d74/d80/d2d/da7/fea 0 2024-05-09T06:29:41.457 INFO:tasks.workunit.client.1.smithi079.stdout:8/705: dread d1/d3/d20/d7f/d33/d5d/d6d/f9a [0,4194304] 0 2024-05-09T06:29:41.457 INFO:tasks.workunit.client.1.smithi079.stdout:8/706: write d1/db/fa9 [4744363,77486] 0 2024-05-09T06:29:41.458 INFO:tasks.workunit.client.1.smithi079.stdout:3/819: symlink d1a/d21/db0/dd4/d3a/da4/df0/l10d 0 2024-05-09T06:29:41.458 INFO:tasks.workunit.client.1.smithi079.stdout:3/820: fdatasync d1a/d21/db0/dd4/d3a/f91 0 2024-05-09T06:29:41.458 INFO:tasks.workunit.client.1.smithi079.stdout:3/821: chown d1a/d1c/c4a 0 1 2024-05-09T06:29:41.460 INFO:tasks.workunit.client.1.smithi079.stdout:4/863: symlink d6/d8/d27/d3d/l117 0 2024-05-09T06:29:41.462 INFO:tasks.workunit.client.1.smithi079.stdout:6/841: mknod d0/d6/d16/dcd/dce/d9c/c11b 0 2024-05-09T06:29:41.463 INFO:tasks.workunit.client.1.smithi079.stdout:7/725: write d4/f64 [1112183,71818] 0 2024-05-09T06:29:41.468 INFO:tasks.workunit.client.1.smithi079.stdout:5/888: mkdir d13/d43/d39/d61/d130 0 2024-05-09T06:29:41.471 INFO:tasks.workunit.client.1.smithi079.stdout:7/726: dread d4/d7/f2b [0,4194304] 0 2024-05-09T06:29:41.475 INFO:tasks.workunit.client.1.smithi079.stdout:8/707: mknod d1/db/daf/d66/d6c/dbf/dc9/cfa 0 2024-05-09T06:29:41.475 INFO:tasks.workunit.client.1.smithi079.stdout:8/708: write d1/d3/d20/d7f/dc3/d50/dd7/ff8 [257243,116596] 0 2024-05-09T06:29:41.476 INFO:tasks.workunit.client.1.smithi079.stdout:3/822: creat d1a/d1c/d22/d90/dfb/f10e x:0 0 0 2024-05-09T06:29:41.476 INFO:tasks.workunit.client.1.smithi079.stdout:3/823: truncate d1a/d1c/fb1 5026282 0 2024-05-09T06:29:41.478 INFO:tasks.workunit.client.1.smithi079.stdout:6/842: symlink d0/d6/d1b/db8/l11c 0 2024-05-09T06:29:41.478 INFO:tasks.workunit.client.1.smithi079.stdout:6/843: chown d0/d6/d16/dcd/dce/ld6 3100 1 2024-05-09T06:29:41.479 INFO:tasks.workunit.client.1.smithi079.stdout:4/864: dwrite d6/d1a/d26/d2a/d54/d9e/dd5/d34/f107 [0,4194304] 0 2024-05-09T06:29:41.482 INFO:tasks.workunit.client.1.smithi079.stdout:8/709: dread d1/db/f62 [0,4194304] 0 2024-05-09T06:29:41.483 INFO:tasks.workunit.client.1.smithi079.stdout:5/889: creat d13/d43/d3d/d40/d63/da2/d8b/d110/f131 x:0 0 0 2024-05-09T06:29:41.483 INFO:tasks.workunit.client.1.smithi079.stdout:5/890: creat d13/d43/d9e/f132 x:0 0 0 2024-05-09T06:29:41.483 INFO:tasks.workunit.client.1.smithi079.stdout:5/891: fdatasync d13/d92/dcd/f115 0 2024-05-09T06:29:41.484 INFO:tasks.workunit.client.1.smithi079.stdout:7/727: dread d4/d7/d22/d28/d74/f76 [0,4194304] 0 2024-05-09T06:29:41.485 INFO:tasks.workunit.client.1.smithi079.stdout:2/842: rename d8/db/d11/d79 to d8/db/d11/d5f/d130 0 2024-05-09T06:29:41.487 INFO:tasks.workunit.client.1.smithi079.stdout:3/824: link d1a/d1c/d22/d53/d4e/dea/l8a d1a/d1c/d22/d90/l10f 0 2024-05-09T06:29:41.489 INFO:tasks.workunit.client.1.smithi079.stdout:6/844: mknod d0/d6/d16/d1f/d6f/d8c/d93/c11d 0 2024-05-09T06:29:41.489 INFO:tasks.workunit.client.1.smithi079.stdout:6/845: readlink d0/d6/d16/d1f/d36/d69/l6d 0 2024-05-09T06:29:41.491 INFO:tasks.workunit.client.1.smithi079.stdout:8/710: dread d1/d5/dc/f1b [0,4194304] 0 2024-05-09T06:29:41.491 INFO:tasks.workunit.client.1.smithi079.stdout:8/711: write d1/d3/d20/d7f/dc3/d44/da4/fd5 [310063,21478] 0 2024-05-09T06:29:41.492 INFO:tasks.workunit.client.1.smithi079.stdout:5/892: dread d13/d2a/f67 [0,4194304] 0 2024-05-09T06:29:41.493 INFO:tasks.workunit.client.1.smithi079.stdout:8/712: dread d1/d3/d20/d7f/dc3/d50/dd7/fd8 [0,4194304] 0 2024-05-09T06:29:41.495 INFO:tasks.workunit.client.1.smithi079.stdout:2/843: write d8/db/d4b/d4f/d51/d6f/f73 [3835282,35374] 0 2024-05-09T06:29:41.499 INFO:tasks.workunit.client.1.smithi079.stdout:4/865: symlink d6/d1a/d41/l118 0 2024-05-09T06:29:41.501 INFO:tasks.workunit.client.1.smithi079.stdout:8/713: dread d1/db/f4a [0,4194304] 0 2024-05-09T06:29:41.502 INFO:tasks.workunit.client.1.smithi079.stdout:7/728: creat d4/fe0 x:0 0 0 2024-05-09T06:29:41.505 INFO:tasks.workunit.client.1.smithi079.stdout:0/718: rename d3/dd/d66/d6d/fc5 to d3/d5/d87/feb 0 2024-05-09T06:29:41.505 INFO:tasks.workunit.client.1.smithi079.stdout:0/719: truncate d3/fbb 264757 0 2024-05-09T06:29:41.506 INFO:tasks.workunit.client.1.smithi079.stdout:3/825: truncate fb 4141590 0 2024-05-09T06:29:41.506 INFO:tasks.workunit.client.1.smithi079.stdout:3/826: readlink d1a/d1c/d1f/l72 0 2024-05-09T06:29:41.506 INFO:tasks.workunit.client.1.smithi079.stdout:3/827: write d1a/d21/f51 [846101,72479] 0 2024-05-09T06:29:41.506 INFO:tasks.workunit.client.1.smithi079.stdout:3/828: chown d1a/d1c/d22/d53/d4e/dc3/fc7 255 1 2024-05-09T06:29:41.506 INFO:tasks.workunit.client.1.smithi079.stdout:2/844: write d8/db/d11/d5f/f76 [1269047,12802] 0 2024-05-09T06:29:41.508 INFO:tasks.workunit.client.1.smithi079.stdout:5/893: dwrite d13/da5/de4/d101/f10e [0,4194304] 0 2024-05-09T06:29:41.510 INFO:tasks.workunit.client.1.smithi079.stdout:4/866: unlink d6/d8/d27/d3d/d5b/lfc 0 2024-05-09T06:29:41.510 INFO:tasks.workunit.client.1.smithi079.stdout:5/894: dread d13/d43/d3d/d40/d63/fe6 [0,4194304] 0 2024-05-09T06:29:41.511 INFO:tasks.workunit.client.1.smithi079.stdout:5/895: chown d13/d4d/d77/f118 7558663 1 2024-05-09T06:29:41.513 INFO:tasks.workunit.client.1.smithi079.stdout:8/714: creat d1/d5/dc/ffb x:0 0 0 2024-05-09T06:29:41.516 INFO:tasks.workunit.client.1.smithi079.stdout:4/867: write d6/d1a/d41/d68/da1/fc2 [1887555,104625] 0 2024-05-09T06:29:41.516 INFO:tasks.workunit.client.1.smithi079.stdout:4/868: chown d6/d1a/d41/l5d 398669597 1 2024-05-09T06:29:41.516 INFO:tasks.workunit.client.1.smithi079.stdout:4/869: chown d6/d8/d27/d3d/d5b/d9a/d8b/fb9 942 1 2024-05-09T06:29:41.521 INFO:tasks.workunit.client.1.smithi079.stdout:3/829: link d1a/d21/db0/dd4/d34/l8e d1a/l110 0 2024-05-09T06:29:41.522 INFO:tasks.workunit.client.1.smithi079.stdout:2/845: mknod d8/df7/c131 0 2024-05-09T06:29:41.524 INFO:tasks.workunit.client.1.smithi079.stdout:3/830: dread d1a/f7f [0,4194304] 0 2024-05-09T06:29:41.531 INFO:tasks.workunit.client.1.smithi079.stdout:8/715: creat d1/d3/d20/d7f/dc3/d50/ffc x:0 0 0 2024-05-09T06:29:41.531 INFO:tasks.workunit.client.1.smithi079.stdout:8/716: write d1/d3/d20/d7f/dc3/d44/fb6 [364302,94303] 0 2024-05-09T06:29:41.532 INFO:tasks.workunit.client.1.smithi079.stdout:3/831: mkdir d1a/d21/db0/dd4/d34/d59/dd6/d111 0 2024-05-09T06:29:41.534 INFO:tasks.workunit.client.1.smithi079.stdout:8/717: mknod d1/d3/d20/d7f/cfd 0 2024-05-09T06:29:41.535 INFO:tasks.workunit.client.1.smithi079.stdout:2/846: read d8/db/d59/d67/d7f/db9/de1/df1/fff [811878,103338] 0 2024-05-09T06:29:41.535 INFO:tasks.workunit.client.1.smithi079.stdout:2/847: dread - d8/db/d5c/d6b/db5/f119 zero size 2024-05-09T06:29:41.536 INFO:tasks.workunit.client.1.smithi079.stdout:2/848: write d8/db/fee [432380,31981] 0 2024-05-09T06:29:41.537 INFO:tasks.workunit.client.1.smithi079.stdout:3/832: dread d1a/d1c/d22/f30 [0,4194304] 0 2024-05-09T06:29:41.541 INFO:tasks.workunit.client.1.smithi079.stdout:7/729: dwrite d4/d7/d22/d28/d50/d5c/ddc/fcd [0,4194304] 0 2024-05-09T06:29:41.541 INFO:tasks.workunit.client.1.smithi079.stdout:7/730: creat d4/d7/dd/d5b/fe1 x:0 0 0 2024-05-09T06:29:41.542 INFO:tasks.workunit.client.1.smithi079.stdout:0/720: dwrite d3/dd/d1f/d1e/d2c/d35/d36/f4c [0,4194304] 0 2024-05-09T06:29:41.542 INFO:tasks.workunit.client.1.smithi079.stdout:0/721: write d3/d5/fe [3033222,39656] 0 2024-05-09T06:29:41.542 INFO:tasks.workunit.client.1.smithi079.stdout:5/896: dwrite d13/d43/d39/d61/d72/fb2 [0,4194304] 0 2024-05-09T06:29:41.545 INFO:tasks.workunit.client.1.smithi079.stdout:2/849: creat d8/db/d59/d67/f132 x:0 0 0 2024-05-09T06:29:41.549 INFO:tasks.workunit.client.1.smithi079.stdout:3/833: creat d1a/d1c/d22/d53/da5/f112 x:0 0 0 2024-05-09T06:29:41.549 INFO:tasks.workunit.client.1.smithi079.stdout:8/718: dwrite d1/d3/d20/d7f/dc3/d50/dd7/fd8 [0,4194304] 0 2024-05-09T06:29:41.550 INFO:tasks.workunit.client.1.smithi079.stdout:8/719: read d1/d56/d7c/d8f/fa8 [2845335,110553] 0 2024-05-09T06:29:41.550 INFO:tasks.workunit.client.1.smithi079.stdout:8/720: truncate d1/d3/f6 4891026 0 2024-05-09T06:29:41.563 INFO:tasks.workunit.client.1.smithi079.stdout:7/731: mkdir d4/d7/d22/d28/d50/de2 0 2024-05-09T06:29:41.564 INFO:tasks.workunit.client.1.smithi079.stdout:7/732: write d4/d7/f5f [282431,99568] 0 2024-05-09T06:29:41.570 INFO:tasks.workunit.client.1.smithi079.stdout:0/722: mknod d3/dd/d66/d6d/d74/d80/d2d/d90/cec 0 2024-05-09T06:29:41.570 INFO:tasks.workunit.client.1.smithi079.stdout:0/723: chown d3/dd/d66/fe8 124893 1 2024-05-09T06:29:41.570 INFO:tasks.workunit.client.1.smithi079.stdout:0/724: truncate d3/dd/d18/d5e/d69/f75 1158003 0 2024-05-09T06:29:41.575 INFO:tasks.workunit.client.1.smithi079.stdout:3/834: rename d1a/d1c/d22/d90/f99 to d1a/d21/db0/dd4/d3a/d54/d55/f113 0 2024-05-09T06:29:41.577 INFO:tasks.workunit.client.1.smithi079.stdout:5/897: dwrite d13/d43/d26/d35/f56 [0,4194304] 0 2024-05-09T06:29:41.577 INFO:tasks.workunit.client.1.smithi079.stdout:5/898: write d13/d2a/f2b [584961,105489] 0 2024-05-09T06:29:41.578 INFO:tasks.workunit.client.1.smithi079.stdout:2/850: dwrite d8/db/d59/d67/d86/fdb [0,4194304] 0 2024-05-09T06:29:41.580 INFO:tasks.workunit.client.1.smithi079.stdout:8/721: dwrite d1/d67/fcc [0,4194304] 0 2024-05-09T06:29:41.588 INFO:tasks.workunit.client.1.smithi079.stdout:0/725: symlink d3/dd/d66/led 0 2024-05-09T06:29:41.588 INFO:tasks.workunit.client.1.smithi079.stdout:0/726: chown d3/dd/d66/d6d/fae 106878138 1 2024-05-09T06:29:41.588 INFO:tasks.workunit.client.1.smithi079.stdout:0/727: chown d3/dd/d1f/d1e/d2c/d7f/l9a 57 1 2024-05-09T06:29:41.588 INFO:tasks.workunit.client.1.smithi079.stdout:0/728: chown d3/fdd 1866140765 1 2024-05-09T06:29:41.594 INFO:tasks.workunit.client.1.smithi079.stdout:2/851: symlink d8/db/d59/d93/dc7/dd9/l133 0 2024-05-09T06:29:41.601 INFO:tasks.workunit.client.1.smithi079.stdout:0/729: stat d3/dd/d1f/d1e/d2c/d35/d36/fca 0 2024-05-09T06:29:41.601 INFO:tasks.workunit.client.1.smithi079.stdout:2/852: dread d8/db/d4b/d4f/f36 [0,4194304] 0 2024-05-09T06:29:41.604 INFO:tasks.workunit.client.1.smithi079.stdout:0/730: creat d3/dd/d1f/d1e/d2c/d88/fee x:0 0 0 2024-05-09T06:29:41.606 INFO:tasks.workunit.client.1.smithi079.stdout:2/853: mkdir d8/db/d11/d134 0 2024-05-09T06:29:41.606 INFO:tasks.workunit.client.1.smithi079.stdout:2/854: dread - d8/db/d59/d67/f132 zero size 2024-05-09T06:29:41.606 INFO:tasks.workunit.client.1.smithi079.stdout:2/855: fsync d8/db/d5c/d6b/db5/fab 0 2024-05-09T06:29:41.607 INFO:tasks.workunit.client.1.smithi079.stdout:2/856: creat d8/f135 x:0 0 0 2024-05-09T06:29:41.607 INFO:tasks.workunit.client.1.smithi079.stdout:2/857: chown d8/db/d9d/f104 5630 1 2024-05-09T06:29:41.607 INFO:tasks.workunit.client.1.smithi079.stdout:3/835: dwrite d1a/d1c/d1f/f75 [0,4194304] 0 2024-05-09T06:29:41.607 INFO:tasks.workunit.client.1.smithi079.stdout:5/899: dwrite d13/d43/d39/d61/f7d [0,4194304] 0 2024-05-09T06:29:41.607 INFO:tasks.workunit.client.1.smithi079.stdout:8/722: dwrite d1/d3/f6 [4194304,4194304] 0 2024-05-09T06:29:41.607 INFO:tasks.workunit.client.1.smithi079.stdout:3/836: dread - d1a/d1c/d22/d90/db8/fe7 zero size 2024-05-09T06:29:41.614 INFO:tasks.workunit.client.1.smithi079.stdout:2/858: dread d8/db/d11/d5f/fbc [0,4194304] 0 2024-05-09T06:29:41.623 INFO:tasks.workunit.client.1.smithi079.stdout:0/731: dwrite d3/dd/d1f/d1e/d2c/dc0/fd4 [0,4194304] 0 2024-05-09T06:29:41.623 INFO:tasks.workunit.client.1.smithi079.stdout:0/732: readlink d3/dd/d66/d6d/d74/d80/d76/l79 0 2024-05-09T06:29:41.623 INFO:tasks.workunit.client.1.smithi079.stdout:0/733: dread - d3/dd/d66/d6d/d74/d80/d76/fa0 zero size 2024-05-09T06:29:41.628 INFO:tasks.workunit.client.1.smithi079.stdout:8/723: stat d1/d3/d20/d7f/d33/d5d/ld3 0 2024-05-09T06:29:41.629 INFO:tasks.workunit.client.1.smithi079.stdout:8/724: fsync d1/d56/d7c/f89 0 2024-05-09T06:29:41.633 INFO:tasks.workunit.client.1.smithi079.stdout:0/734: dread d3/dd/d66/d6d/d74/d84/fa3 [0,4194304] 0 2024-05-09T06:29:41.633 INFO:tasks.workunit.client.1.smithi079.stdout:5/900: symlink d13/d43/d3d/d40/d63/da2/d8b/d110/d124/l133 0 2024-05-09T06:29:41.642 INFO:tasks.workunit.client.1.smithi079.stdout:3/837: mknod d1a/d82/d87/db2/c114 0 2024-05-09T06:29:41.645 INFO:tasks.workunit.client.1.smithi079.stdout:2/859: creat d8/db/dc/d2c/f136 x:0 0 0 2024-05-09T06:29:41.653 INFO:tasks.workunit.client.1.smithi079.stdout:8/725: mkdir d1/d3/d20/d7f/dc3/d50/dfe 0 2024-05-09T06:29:41.656 INFO:tasks.workunit.client.1.smithi079.stdout:5/901: creat d13/d43/d3d/d40/d63/da2/d8b/d110/d124/f134 x:0 0 0 2024-05-09T06:29:41.658 INFO:tasks.workunit.client.1.smithi079.stdout:3/838: stat d1a/d1c/d22/d53/d4e/dea/l8a 0 2024-05-09T06:29:41.665 INFO:tasks.workunit.client.1.smithi079.stdout:3/839: getdents d1a/d21/db0/dd4/d3a/da4 0 2024-05-09T06:29:41.670 INFO:tasks.workunit.client.1.smithi079.stdout:5/902: write d13/d43/d39/d61/f7d [2026679,58137] 0 2024-05-09T06:29:41.679 INFO:tasks.workunit.client.1.smithi079.stdout:0/735: dwrite d3/dd/d1f/d1e/f2a [0,4194304] 0 2024-05-09T06:29:41.679 INFO:tasks.workunit.client.1.smithi079.stdout:0/736: write d3/fb5 [972750,41788] 0 2024-05-09T06:29:41.689 INFO:tasks.workunit.client.1.smithi079.stdout:3/840: dwrite d1a/d21/db0/dd4/d34/f9c [0,4194304] 0 2024-05-09T06:29:41.691 INFO:tasks.workunit.client.1.smithi079.stdout:2/860: dwrite d8/db/dc/d2c/d2e/fb3 [0,4194304] 0 2024-05-09T06:29:41.691 INFO:tasks.workunit.client.1.smithi079.stdout:2/861: readlink l6 0 2024-05-09T06:29:41.692 INFO:tasks.workunit.client.1.smithi079.stdout:0/737: getdents d3/dd/d1f 0 2024-05-09T06:29:41.695 INFO:tasks.workunit.client.1.smithi079.stdout:3/841: symlink d1a/d1c/d22/d53/d4e/dc3/dd8/l115 0 2024-05-09T06:29:41.706 INFO:tasks.workunit.client.1.smithi079.stdout:0/738: creat d3/dd/d18/d5e/fef x:0 0 0 2024-05-09T06:29:41.706 INFO:tasks.workunit.client.1.smithi079.stdout:0/739: write d3/dd/f3e [682875,91872] 0 2024-05-09T06:29:41.710 INFO:tasks.workunit.client.1.smithi079.stdout:0/740: creat d3/dd/d71/ff0 x:0 0 0 2024-05-09T06:29:41.710 INFO:tasks.workunit.client.1.smithi079.stdout:0/741: chown d3/dd/d1f/d1e/d91 743950 1 2024-05-09T06:29:41.711 INFO:tasks.workunit.client.1.smithi079.stdout:0/742: dread - d3/dd/d18/d5e/d69/f6c zero size 2024-05-09T06:29:41.711 INFO:tasks.workunit.client.1.smithi079.stdout:2/862: dwrite d8/db/d11/f24 [0,4194304] 0 2024-05-09T06:29:41.711 INFO:tasks.workunit.client.1.smithi079.stdout:2/863: chown d8/db/d11/d5f/d130/d88/fc3 1049515549 1 2024-05-09T06:29:41.711 INFO:tasks.workunit.client.1.smithi079.stdout:2/864: fdatasync d8/db/d5c/d6b/ffb 0 2024-05-09T06:29:41.713 INFO:tasks.workunit.client.1.smithi079.stdout:0/743: rename d3/dd/d1f/d1e/fb6 to d3/dd/d1f/d1e/d2c/d7f/de0/ff1 0 2024-05-09T06:29:41.719 INFO:tasks.workunit.client.1.smithi079.stdout:3/842: rmdir d1a/d1c/d22/d53/d4e/dea/dc5/dd1 0 2024-05-09T06:29:41.722 INFO:tasks.workunit.client.1.smithi079.stdout:0/744: creat d3/dd/d71/db4/ff2 x:0 0 0 2024-05-09T06:29:41.722 INFO:tasks.workunit.client.1.smithi079.stdout:0/745: chown d3/dd/d1f/d1e/l59 61283 1 2024-05-09T06:29:41.726 INFO:tasks.workunit.client.1.smithi079.stdout:3/843: rename d1a/d1c/d22/d53/f86 to d1a/d21/db0/dd4/d3a/d7c/f116 0 2024-05-09T06:29:41.729 INFO:tasks.workunit.client.1.smithi079.stdout:0/746: rename d3/faa to d3/dd/d66/d6d/d74/d80/d76/dcc/ff3 0 2024-05-09T06:29:41.730 INFO:tasks.workunit.client.1.smithi079.stdout:0/747: write d3/dd/d66/d6d/da6/f8c [2050084,101837] 0 2024-05-09T06:29:41.731 INFO:tasks.workunit.client.1.smithi079.stdout:3/844: stat d1a/d1c/d22/d53/d4e/dea/l8a 0 2024-05-09T06:29:41.731 INFO:tasks.workunit.client.1.smithi079.stdout:3/845: truncate d1a/d21/db0/dd4/fa1 459815 0 2024-05-09T06:29:41.731 INFO:tasks.workunit.client.1.smithi079.stdout:3/846: write d1a/d21/f62 [389713,67016] 0 2024-05-09T06:29:41.731 INFO:tasks.workunit.client.1.smithi079.stdout:3/847: readlink d1a/l27 0 2024-05-09T06:29:41.732 INFO:tasks.workunit.client.1.smithi079.stdout:0/748: fsync d3/dd/d1f/d1e/d2c/d35/d36/f48 0 2024-05-09T06:29:41.733 INFO:tasks.workunit.client.1.smithi079.stdout:3/848: symlink d1a/d1c/d22/d53/d4e/dea/dc5/df4/l117 0 2024-05-09T06:29:41.735 INFO:tasks.workunit.client.1.smithi079.stdout:0/749: readlink d3/dd/d1f/d1e/d2c/d35/d36/l41 0 2024-05-09T06:29:41.736 INFO:tasks.workunit.client.1.smithi079.stdout:0/750: mknod d3/dd/cf4 0 2024-05-09T06:29:41.744 INFO:tasks.workunit.client.1.smithi079.stdout:0/751: write d3/dd/d1f/d1e/d91/fb8 [2462663,69833] 0 2024-05-09T06:29:41.745 INFO:tasks.workunit.client.1.smithi079.stdout:3/849: write d1a/d21/db0/dd4/d3a/d7c/f116 [3003249,11639] 0 2024-05-09T06:29:41.754 INFO:tasks.workunit.client.1.smithi079.stdout:3/850: write d1a/d21/db0/dd4/d3a/d54/fd2 [7746713,109459] 0 2024-05-09T06:29:41.754 INFO:tasks.workunit.client.1.smithi079.stdout:3/851: chown d1a/d21/db0/dd4/d3a/d54/d55/c102 2913537 1 2024-05-09T06:29:41.758 INFO:tasks.workunit.client.1.smithi079.stdout:0/752: write d3/dd/d66/f72 [1467403,75045] 0 2024-05-09T06:29:41.759 INFO:tasks.workunit.client.1.smithi079.stdout:0/753: read d3/dd/d66/d6d/d74/d80/d2d/f2e [3561367,68476] 0 2024-05-09T06:29:41.762 INFO:tasks.workunit.client.1.smithi079.stdout:3/852: write d1a/d82/d87/fe1 [2349217,9295] 0 2024-05-09T06:29:41.762 INFO:tasks.workunit.client.1.smithi079.stdout:3/853: chown d1a/d1c/d22/d53/l5c 77943146 1 2024-05-09T06:29:41.766 INFO:tasks.workunit.client.1.smithi079.stdout:0/754: rename d3/d5/d87/fa8 to d3/dd/d1f/d1e/d2c/ff5 0 2024-05-09T06:29:41.776 INFO:tasks.workunit.client.1.smithi079.stdout:3/854: mkdir d1a/d21/db0/dd4/d3a/da4/df0/d118 0 2024-05-09T06:29:41.776 INFO:tasks.workunit.client.1.smithi079.stdout:3/855: getdents d1a/d21/db0/dd4/d3a/da4/ddd 0 2024-05-09T06:29:41.779 INFO:tasks.workunit.client.1.smithi079.stdout:0/755: mkdir d3/dd/d18/d5e/df6 0 2024-05-09T06:29:41.788 INFO:tasks.workunit.client.1.smithi079.stdout:0/756: dread d3/dd/d1f/d1e/d2c/d35/f9b [0,4194304] 0 2024-05-09T06:29:41.795 INFO:tasks.workunit.client.1.smithi079.stdout:1/788: sync 2024-05-09T06:29:41.798 INFO:tasks.workunit.client.1.smithi079.stdout:1/789: link d0/d12/d48/d75/d43/c44 d0/d12/d67/db6/d89/c114 0 2024-05-09T06:29:41.804 INFO:tasks.workunit.client.1.smithi079.stdout:1/790: rmdir d0/d12/d67/d93 39 2024-05-09T06:29:41.804 INFO:tasks.workunit.client.1.smithi079.stdout:1/791: readlink d0/d12/d16/l1e 0 2024-05-09T06:29:41.807 INFO:tasks.workunit.client.1.smithi079.stdout:1/792: creat d0/d12/d67/d93/f115 x:0 0 0 2024-05-09T06:29:41.807 INFO:tasks.workunit.client.1.smithi079.stdout:1/793: creat d0/d12/d67/db6/d89/f116 x:0 0 0 2024-05-09T06:29:41.810 INFO:tasks.workunit.client.1.smithi079.stdout:0/757: dwrite d3/dd/f53 [0,4194304] 0 2024-05-09T06:29:41.813 INFO:tasks.workunit.client.1.smithi079.stdout:1/794: creat d0/d12/d67/d53/dbf/dd2/f117 x:0 0 0 2024-05-09T06:29:41.813 INFO:tasks.workunit.client.1.smithi079.stdout:1/795: dread - d0/d12/d67/d53/d6d/f103 zero size 2024-05-09T06:29:41.814 INFO:tasks.workunit.client.1.smithi079.stdout:0/758: creat d3/dd/d66/d6d/d74/d80/d76/dcc/dd9/ff7 x:0 0 0 2024-05-09T06:29:41.815 INFO:tasks.workunit.client.1.smithi079.stdout:1/796: creat d0/d12/d67/d53/dbf/dd2/d4e/f118 x:0 0 0 2024-05-09T06:29:41.819 INFO:tasks.workunit.client.1.smithi079.stdout:1/797: rename d0/d12/d67/d53/dbf/dd2/d4e/d7d/cad to d0/d12/d67/d53/c119 0 2024-05-09T06:29:41.819 INFO:tasks.workunit.client.1.smithi079.stdout:1/798: write d0/d12/d48/d75/d43/f77 [3410062,129148] 0 2024-05-09T06:29:41.830 INFO:tasks.workunit.client.1.smithi079.stdout:0/759: dwrite d3/dd/d71/db4/ff2 [0,4194304] 0 2024-05-09T06:29:41.835 INFO:tasks.workunit.client.1.smithi079.stdout:0/760: creat d3/dd/d1f/d1e/d2c/ff8 x:0 0 0 2024-05-09T06:29:41.836 INFO:tasks.workunit.client.1.smithi079.stdout:0/761: fdatasync d3/dd/d18/fad 0 2024-05-09T06:29:41.836 INFO:tasks.workunit.client.1.smithi079.stdout:0/762: truncate d3/dd/d66/d6d/d74/d80/d2d/f8f 5158880 0 2024-05-09T06:29:41.847 INFO:tasks.workunit.client.1.smithi079.stdout:7/733: getdents d4/d7/dd/d5b 0 2024-05-09T06:29:41.849 INFO:tasks.workunit.client.1.smithi079.stdout:7/734: mknod d4/d7/d37/d90/ce3 0 2024-05-09T06:29:41.859 INFO:tasks.workunit.client.1.smithi079.stdout:7/735: dread d4/d7/dd/f6c [0,4194304] 0 2024-05-09T06:29:41.868 INFO:tasks.workunit.client.1.smithi079.stdout:7/736: mknod d4/d7/dd/d5b/d32/ce4 0 2024-05-09T06:29:41.876 INFO:tasks.workunit.client.1.smithi079.stdout:7/737: dread d4/d7/f13 [0,4194304] 0 2024-05-09T06:29:41.876 INFO:tasks.workunit.client.1.smithi079.stdout:7/738: creat d4/d7/dd/d5b/d31/d34/fe5 x:0 0 0 2024-05-09T06:29:41.890 INFO:tasks.workunit.client.1.smithi079.stdout:8/726: truncate d1/d67/fcc 1956413 0 2024-05-09T06:29:41.893 INFO:tasks.workunit.client.1.smithi079.stdout:8/727: mkdir d1/d3/d20/d7f/dc3/dff 0 2024-05-09T06:29:41.896 INFO:tasks.workunit.client.1.smithi079.stdout:8/728: symlink d1/d3/d20/d7f/d33/l100 0 2024-05-09T06:29:41.899 INFO:tasks.workunit.client.1.smithi079.stdout:8/729: creat d1/f101 x:0 0 0 2024-05-09T06:29:41.899 INFO:tasks.workunit.client.1.smithi079.stdout:8/730: write d1/d56/ff5 [411589,98290] 0 2024-05-09T06:29:41.899 INFO:tasks.workunit.client.1.smithi079.stdout:8/731: chown d1/d67/c83 226918 1 2024-05-09T06:29:41.906 INFO:tasks.workunit.client.1.smithi079.stdout:8/732: write d1/d3/d20/d7f/dc3/d3b/fb7 [1713369,5516] 0 2024-05-09T06:29:41.914 INFO:tasks.workunit.client.1.smithi079.stdout:2/865: getdents d8 0 2024-05-09T06:29:41.915 INFO:tasks.workunit.client.1.smithi079.stdout:8/733: write d1/d3/d20/d7f/f45 [743141,118200] 0 2024-05-09T06:29:41.917 INFO:tasks.workunit.client.1.smithi079.stdout:2/866: mkdir d8/db/d59/d67/d7f/db9/de1/d137 0 2024-05-09T06:29:41.919 INFO:tasks.workunit.client.1.smithi079.stdout:8/734: rmdir d1/d3/d20/d7f/dc3/d44/da2 39 2024-05-09T06:29:41.922 INFO:tasks.workunit.client.1.smithi079.stdout:2/867: link d8/db/d59/d67/d7f/db9/dca/ce0 d8/db/d4b/d4f/d51/d6d/c138 0 2024-05-09T06:29:41.925 INFO:tasks.workunit.client.1.smithi079.stdout:2/868: mknod d8/db/c139 0 2024-05-09T06:29:41.925 INFO:tasks.workunit.client.1.smithi079.stdout:2/869: fdatasync d8/db/d4b/d4f/f90 0 2024-05-09T06:29:41.928 INFO:tasks.workunit.client.1.smithi079.stdout:2/870: rename d8/db/d11/f35 to d8/db/f13a 0 2024-05-09T06:29:41.928 INFO:tasks.workunit.client.1.smithi079.stdout:2/871: dread - d8/db/d4b/d4f/d51/fdc zero size 2024-05-09T06:29:41.929 INFO:tasks.workunit.client.1.smithi079.stdout:2/872: dread - d8/db/dc/d2c/ff2 zero size 2024-05-09T06:29:41.929 INFO:tasks.workunit.client.1.smithi079.stdout:2/873: getdents d8 0 2024-05-09T06:29:41.937 INFO:tasks.workunit.client.1.smithi079.stdout:8/735: dwrite d1/db/daf/f9d [0,4194304] 0 2024-05-09T06:29:41.938 INFO:tasks.workunit.client.1.smithi079.stdout:2/874: read d8/db/d11/d5f/d130/d88/fd7 [415088,2441] 0 2024-05-09T06:29:41.945 INFO:tasks.workunit.client.1.smithi079.stdout:2/875: creat d8/db/d59/d67/d86/f13b x:0 0 0 2024-05-09T06:29:41.946 INFO:tasks.workunit.client.1.smithi079.stdout:2/876: readlink d8/db/d4b/d4f/d51/l53 0 2024-05-09T06:29:41.956 INFO:tasks.workunit.client.1.smithi079.stdout:2/877: rmdir d8/db/d11/d5f/d130/d88 39 2024-05-09T06:29:41.971 INFO:tasks.workunit.client.1.smithi079.stdout:2/878: dwrite d8/db/d59/d67/fc1 [0,4194304] 0 2024-05-09T06:29:41.975 INFO:tasks.workunit.client.1.smithi079.stdout:2/879: link d8/db/d11/c37 d8/db/dc/d2c/c13c 0 2024-05-09T06:29:41.975 INFO:tasks.workunit.client.1.smithi079.stdout:2/880: chown d8/db/d4b/d4f/d51/d6d/cc9 11 1 2024-05-09T06:29:41.978 INFO:tasks.workunit.client.1.smithi079.stdout:2/881: creat d8/db/d9d/f13d x:0 0 0 2024-05-09T06:29:42.032 INFO:tasks.workunit.client.1.smithi079.stdout:0/763: getdents d3/d5/d87 0 2024-05-09T06:29:42.034 INFO:tasks.workunit.client.1.smithi079.stdout:0/764: dread d3/d5/f21 [0,4194304] 0 2024-05-09T06:29:42.038 INFO:tasks.workunit.client.1.smithi079.stdout:0/765: creat d3/dd/d1f/d1e/d2c/d88/d8e/de3/ff9 x:0 0 0 2024-05-09T06:29:42.042 INFO:tasks.workunit.client.1.smithi079.stdout:0/766: write d3/dd/d1f/f1d [1293565,115164] 0 2024-05-09T06:29:42.067 INFO:tasks.workunit.client.1.smithi079.stdout:1/799: rmdir d0/d12/d67/d53/dbf/dd2 39 2024-05-09T06:29:42.068 INFO:tasks.workunit.client.1.smithi079.stdout:1/800: read - d0/d12/d67/db6/de3/ff8 zero size 2024-05-09T06:29:42.069 INFO:tasks.workunit.client.1.smithi079.stdout:1/801: mknod d0/d12/d48/dd7/d101/c11a 0 2024-05-09T06:29:42.136 INFO:tasks.workunit.client.1.smithi079.stdout:8/736: rename d1/d3/d20/d7f to d1/d5/d36/d102 0 2024-05-09T06:29:42.141 INFO:tasks.workunit.client.1.smithi079.stdout:2/882: rename d8/db/d59/d67/d86/l11c to d8/deb/l13e 0 2024-05-09T06:29:42.142 INFO:tasks.workunit.client.1.smithi079.stdout:2/883: write d8/db/dc/d2c/f33 [218598,97051] 0 2024-05-09T06:29:42.144 INFO:tasks.workunit.client.1.smithi079.stdout:8/737: mkdir d1/d5/d36/d102/dc3/d44/de7/d103 0 2024-05-09T06:29:42.144 INFO:tasks.workunit.client.1.smithi079.stdout:8/738: chown d1/d3/f4d 86417543 1 2024-05-09T06:29:42.145 INFO:tasks.workunit.client.1.smithi079.stdout:6/846: sync 2024-05-09T06:29:42.145 INFO:tasks.workunit.client.1.smithi079.stdout:5/903: sync 2024-05-09T06:29:42.145 INFO:tasks.workunit.client.1.smithi079.stdout:4/870: sync 2024-05-09T06:29:42.145 INFO:tasks.workunit.client.1.smithi079.stdout:3/856: sync 2024-05-09T06:29:42.146 INFO:tasks.workunit.client.1.smithi079.stdout:6/847: write d0/d6/d16/d1f/d36/d69/def/ff8 [11422890,19038] 0 2024-05-09T06:29:42.148 INFO:tasks.workunit.client.1.smithi079.stdout:0/767: rename d3/d5/d87/cbf to d3/dd/d71/db4/cfa 0 2024-05-09T06:29:42.150 INFO:tasks.workunit.client.1.smithi079.stdout:2/884: rmdir d8/db/d4b/d4f/d51/d6d 39 2024-05-09T06:29:42.155 INFO:tasks.workunit.client.1.smithi079.stdout:8/739: write d1/d5/dc/f1d [2561157,128384] 0 2024-05-09T06:29:42.155 INFO:tasks.workunit.client.1.smithi079.stdout:5/904: mkdir d13/d43/d39/d61/d72/dd7/d11b/d135 0 2024-05-09T06:29:42.157 INFO:tasks.workunit.client.1.smithi079.stdout:3/857: creat d1a/d21/db0/dd4/f119 x:0 0 0 2024-05-09T06:29:42.161 INFO:tasks.workunit.client.1.smithi079.stdout:1/802: rename d0/d12/d67/db6/de3/ff8 to d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/f11b 0 2024-05-09T06:29:42.165 INFO:tasks.workunit.client.1.smithi079.stdout:0/768: mkdir d3/dd/d66/d6d/d74/d80/d2d/da7/dce/dfb 0 2024-05-09T06:29:42.165 INFO:tasks.workunit.client.1.smithi079.stdout:0/769: write d3/dd/d1f/d1e/d2c/d35/d36/fca [645760,14684] 0 2024-05-09T06:29:42.165 INFO:tasks.workunit.client.1.smithi079.stdout:8/740: write d1/d3/f6 [7540271,70010] 0 2024-05-09T06:29:42.169 INFO:tasks.workunit.client.1.smithi079.stdout:3/858: truncate d1a/d21/db0/de5/ff6 3821043 0 2024-05-09T06:29:42.169 INFO:tasks.workunit.client.1.smithi079.stdout:3/859: write f5 [2970611,13825] 0 2024-05-09T06:29:42.171 INFO:tasks.workunit.client.1.smithi079.stdout:0/770: truncate d3/dd/d71/db4/ff2 788680 0 2024-05-09T06:29:42.171 INFO:tasks.workunit.client.1.smithi079.stdout:0/771: fdatasync d3/dd/d18/d5e/f5a 0 2024-05-09T06:29:42.172 INFO:tasks.workunit.client.1.smithi079.stdout:6/848: dwrite d0/d6/d1b/d20/f5a [4194304,4194304] 0 2024-05-09T06:29:42.174 INFO:tasks.workunit.client.1.smithi079.stdout:8/741: symlink d1/d5/d36/d102/def/l104 0 2024-05-09T06:29:42.174 INFO:tasks.workunit.client.1.smithi079.stdout:5/905: dread d13/d43/d51/dc9/fed [0,4194304] 0 2024-05-09T06:29:42.174 INFO:tasks.workunit.client.1.smithi079.stdout:8/742: fdatasync d1/d56/fe6 0 2024-05-09T06:29:42.174 INFO:tasks.workunit.client.1.smithi079.stdout:5/906: write d13/d43/d39/ffd [488434,51315] 0 2024-05-09T06:29:42.177 INFO:tasks.workunit.client.1.smithi079.stdout:3/860: symlink d1a/d21/l11a 0 2024-05-09T06:29:42.182 INFO:tasks.workunit.client.1.smithi079.stdout:0/772: dread d3/dd/d18/d5e/d69/f7c [0,4194304] 0 2024-05-09T06:29:42.182 INFO:tasks.workunit.client.1.smithi079.stdout:6/849: rename d0/d6/d1b/c45 to d0/d6/d16/d1f/d36/d69/c11e 0 2024-05-09T06:29:42.185 INFO:tasks.workunit.client.1.smithi079.stdout:8/743: mknod d1/d5/d36/d102/dc3/d50/dfe/c105 0 2024-05-09T06:29:42.189 INFO:tasks.workunit.client.1.smithi079.stdout:5/907: creat d13/d43/d26/f136 x:0 0 0 2024-05-09T06:29:42.189 INFO:tasks.workunit.client.1.smithi079.stdout:2/885: dwrite d8/db/d59/d67/d7f/db9/f120 [4194304,4194304] 0 2024-05-09T06:29:42.189 INFO:tasks.workunit.client.1.smithi079.stdout:2/886: readlink d8/db/d4b/d4f/l12d 0 2024-05-09T06:29:42.192 INFO:tasks.workunit.client.1.smithi079.stdout:3/861: creat d1a/d21/db0/dd4/d34/d42/f11b x:0 0 0 2024-05-09T06:29:42.192 INFO:tasks.workunit.client.1.smithi079.stdout:1/803: dwrite d0/df/fc2 [0,4194304] 0 2024-05-09T06:29:42.192 INFO:tasks.workunit.client.1.smithi079.stdout:1/804: truncate d0/d12/dc0/dd4/df3/fc6 582841 0 2024-05-09T06:29:42.195 INFO:tasks.workunit.client.1.smithi079.stdout:6/850: dread d0/d6/d5e/f63 [0,4194304] 0 2024-05-09T06:29:42.195 INFO:tasks.workunit.client.1.smithi079.stdout:4/871: dwrite d6/d1a/d41/d68/da1/f10e [0,4194304] 0 2024-05-09T06:29:42.195 INFO:tasks.workunit.client.1.smithi079.stdout:6/851: truncate d0/d6/d16/d1f/d36/f95 1271661 0 2024-05-09T06:29:42.197 INFO:tasks.workunit.client.1.smithi079.stdout:5/908: rename d13/d2a/l73 to d13/da5/l137 0 2024-05-09T06:29:42.200 INFO:tasks.workunit.client.1.smithi079.stdout:2/887: write d8/db/dc/d2c/d2e/f3e [1737323,24081] 0 2024-05-09T06:29:42.207 INFO:tasks.workunit.client.1.smithi079.stdout:1/805: mknod d0/d12/d67/d53/dbf/dd2/d4e/d7d/c11c 0 2024-05-09T06:29:42.209 INFO:tasks.workunit.client.1.smithi079.stdout:6/852: dread d0/d6/d5e/f9a [0,4194304] 0 2024-05-09T06:29:42.209 INFO:tasks.workunit.client.1.smithi079.stdout:8/744: mkdir d1/d5/d36/d102/dc3/d3b/dc8/d106 0 2024-05-09T06:29:42.209 INFO:tasks.workunit.client.1.smithi079.stdout:8/745: dread - d1/f101 zero size 2024-05-09T06:29:42.209 INFO:tasks.workunit.client.1.smithi079.stdout:8/746: truncate d1/d5/d36/dae/dbe/fc2 614374 0 2024-05-09T06:29:42.209 INFO:tasks.workunit.client.1.smithi079.stdout:1/806: dread d0/d12/d67/db6/d89/fdc [0,4194304] 0 2024-05-09T06:29:42.210 INFO:tasks.workunit.client.1.smithi079.stdout:5/909: dread d13/d4d/f98 [0,4194304] 0 2024-05-09T06:29:42.212 INFO:tasks.workunit.client.1.smithi079.stdout:4/872: creat d6/d1a/d26/d2a/d54/d9e/f119 x:0 0 0 2024-05-09T06:29:42.212 INFO:tasks.workunit.client.1.smithi079.stdout:4/873: truncate d6/d8/fe3 243633 0 2024-05-09T06:29:42.212 INFO:tasks.workunit.client.1.smithi079.stdout:4/874: chown d6/d8/d27/d3d/d5b/c65 144 1 2024-05-09T06:29:42.217 INFO:tasks.workunit.client.1.smithi079.stdout:0/773: dwrite d3/dd/d1f/d1e/d2c/d35/fbe [0,4194304] 0 2024-05-09T06:29:42.218 INFO:tasks.workunit.client.1.smithi079.stdout:3/862: dwrite d1a/f49 [0,4194304] 0 2024-05-09T06:29:42.218 INFO:tasks.workunit.client.1.smithi079.stdout:3/863: read - d1a/d1c/d22/d53/da5/f112 zero size 2024-05-09T06:29:42.218 INFO:tasks.workunit.client.1.smithi079.stdout:3/864: dread - d1a/d21/db0/dd4/d34/d42/f81 zero size 2024-05-09T06:29:42.218 INFO:tasks.workunit.client.1.smithi079.stdout:2/888: unlink d8/db/d11/c21 0 2024-05-09T06:29:42.219 INFO:tasks.workunit.client.1.smithi079.stdout:6/853: mkdir d0/d60/d8e/d11f 0 2024-05-09T06:29:42.220 INFO:tasks.workunit.client.1.smithi079.stdout:8/747: creat d1/d5/d36/d102/d33/d5d/f107 x:0 0 0 2024-05-09T06:29:42.221 INFO:tasks.workunit.client.1.smithi079.stdout:0/774: dread d3/dd/d66/d6d/d74/d80/d2d/da7/fea [0,4194304] 0 2024-05-09T06:29:42.222 INFO:tasks.workunit.client.1.smithi079.stdout:4/875: mknod d6/d1a/d26/d2a/d54/d9e/dd5/df/d8e/c11a 0 2024-05-09T06:29:42.234 INFO:tasks.workunit.client.1.smithi079.stdout:2/889: mkdir d8/db/d59/d67/d86/dd5/d13f 0 2024-05-09T06:29:42.238 INFO:tasks.workunit.client.1.smithi079.stdout:8/748: unlink d1/d5/d36/d102/dc3/d44/da4/cbc 0 2024-05-09T06:29:42.247 INFO:tasks.workunit.client.1.smithi079.stdout:3/865: dwrite d1a/d1c/d22/d90/dfb/f10e [0,4194304] 0 2024-05-09T06:29:42.247 INFO:tasks.workunit.client.1.smithi079.stdout:3/866: chown d1a/d1c/fee 36 1 2024-05-09T06:29:42.247 INFO:tasks.workunit.client.1.smithi079.stdout:3/867: truncate d1a/d21/db0/dd4/d3a/fd3 1299832 0 2024-05-09T06:29:42.247 INFO:tasks.workunit.client.1.smithi079.stdout:5/910: dwrite d13/d43/d51/f10c [0,4194304] 0 2024-05-09T06:29:42.252 INFO:tasks.workunit.client.1.smithi079.stdout:8/749: dread d1/d67/fba [0,4194304] 0 2024-05-09T06:29:42.259 INFO:tasks.workunit.client.1.smithi079.stdout:4/876: mknod d6/d8/d27/d3d/d5b/db4/c11b 0 2024-05-09T06:29:42.261 INFO:tasks.workunit.client.1.smithi079.stdout:2/890: link d8/db/dc/c84 d8/df7/d129/c140 0 2024-05-09T06:29:42.262 INFO:tasks.workunit.client.1.smithi079.stdout:6/854: mknod d0/d6/d16/d1f/d6f/c120 0 2024-05-09T06:29:42.266 INFO:tasks.workunit.client.1.smithi079.stdout:5/911: dwrite d13/d43/d39/d61/f76 [0,4194304] 0 2024-05-09T06:29:42.268 INFO:tasks.workunit.client.1.smithi079.stdout:3/868: mknod d1a/d82/daa/c11c 0 2024-05-09T06:29:42.276 INFO:tasks.workunit.client.1.smithi079.stdout:8/750: creat d1/d5/d36/da0/f108 x:0 0 0 2024-05-09T06:29:42.278 INFO:tasks.workunit.client.1.smithi079.stdout:4/877: mkdir d6/d8/d27/d3d/d5b/db4/dc3/d11c 0 2024-05-09T06:29:42.282 INFO:tasks.workunit.client.1.smithi079.stdout:2/891: dwrite d8/db/d11/f3f [0,4194304] 0 2024-05-09T06:29:42.283 INFO:tasks.workunit.client.1.smithi079.stdout:6/855: link d0/d6/d16/d1f/d36/f95 d0/d6/d16/d1f/d36/db5/f121 0 2024-05-09T06:29:42.283 INFO:tasks.workunit.client.1.smithi079.stdout:8/751: dread d1/d5/d36/d102/dc3/d3b/fb7 [0,4194304] 0 2024-05-09T06:29:42.286 INFO:tasks.workunit.client.1.smithi079.stdout:4/878: symlink d6/d8/d114/l11d 0 2024-05-09T06:29:42.288 INFO:tasks.workunit.client.1.smithi079.stdout:2/892: symlink d8/db/d5c/d6b/db5/l141 0 2024-05-09T06:29:42.288 INFO:tasks.workunit.client.1.smithi079.stdout:2/893: chown d8/db/d59/d93/dc7/dd9/c12a 6365 1 2024-05-09T06:29:42.289 INFO:tasks.workunit.client.1.smithi079.stdout:8/752: symlink d1/d56/d7c/l109 0 2024-05-09T06:29:42.290 INFO:tasks.workunit.client.1.smithi079.stdout:4/879: mknod d6/d90/c11e 0 2024-05-09T06:29:42.292 INFO:tasks.workunit.client.1.smithi079.stdout:2/894: creat d8/d12f/f142 x:0 0 0 2024-05-09T06:29:42.292 INFO:tasks.workunit.client.1.smithi079.stdout:2/895: read - d8/db/d11/d5f/d130/d88/f10b zero size 2024-05-09T06:29:42.294 INFO:tasks.workunit.client.1.smithi079.stdout:3/869: dwrite f5 [0,4194304] 0 2024-05-09T06:29:42.294 INFO:tasks.workunit.client.1.smithi079.stdout:8/753: unlink d1/db/daf/d66/d6c/ceb 0 2024-05-09T06:29:42.301 INFO:tasks.workunit.client.1.smithi079.stdout:6/856: dread d0/d6/d16/d28/f46 [0,4194304] 0 2024-05-09T06:29:42.301 INFO:tasks.workunit.client.1.smithi079.stdout:6/857: stat d0/d6/d16/d1f/d36/d69/dad/fc5 0 2024-05-09T06:29:42.303 INFO:tasks.workunit.client.1.smithi079.stdout:5/912: dwrite d13/d43/d9e/fef [4194304,4194304] 0 2024-05-09T06:29:42.303 INFO:tasks.workunit.client.1.smithi079.stdout:5/913: truncate d13/d92/dcd/deb/f12f 494733 0 2024-05-09T06:29:42.313 INFO:tasks.workunit.client.1.smithi079.stdout:6/858: dread d0/d6/d1b/f50 [0,4194304] 0 2024-05-09T06:29:42.318 INFO:tasks.workunit.client.1.smithi079.stdout:5/914: creat d13/d43/d3d/d40/d9a/dd2/f138 x:0 0 0 2024-05-09T06:29:42.318 INFO:tasks.workunit.client.1.smithi079.stdout:8/754: dwrite d1/f8 [4194304,4194304] 0 2024-05-09T06:29:42.318 INFO:tasks.workunit.client.1.smithi079.stdout:8/755: write d1/d5/f6f [5882631,26180] 0 2024-05-09T06:29:42.318 INFO:tasks.workunit.client.1.smithi079.stdout:8/756: chown d1/db/daf/d66/d6c/c76 0 1 2024-05-09T06:29:42.319 INFO:tasks.workunit.client.1.smithi079.stdout:6/859: creat d0/d6/d16/d28/f122 x:0 0 0 2024-05-09T06:29:42.320 INFO:tasks.workunit.client.1.smithi079.stdout:4/880: dwrite d6/d1a/d26/d2a/d54/d9e/dd5/df/dfb/fbf [0,4194304] 0 2024-05-09T06:29:42.322 INFO:tasks.workunit.client.1.smithi079.stdout:2/896: dwrite d8/db/dc/f121 [0,4194304] 0 2024-05-09T06:29:42.323 INFO:tasks.workunit.client.1.smithi079.stdout:5/915: mkdir d13/d43/d3d/d40/d63/d139 0 2024-05-09T06:29:42.323 INFO:tasks.workunit.client.1.smithi079.stdout:5/916: write d13/d4f/f78 [86384,54732] 0 2024-05-09T06:29:42.326 INFO:tasks.workunit.client.1.smithi079.stdout:8/757: creat d1/d5/d36/d102/dc3/d50/dd7/f10a x:0 0 0 2024-05-09T06:29:42.327 INFO:tasks.workunit.client.1.smithi079.stdout:2/897: read d8/db/dc/fd [1677923,69740] 0 2024-05-09T06:29:42.328 INFO:tasks.workunit.client.1.smithi079.stdout:6/860: creat d0/d60/daf/f123 x:0 0 0 2024-05-09T06:29:42.329 INFO:tasks.workunit.client.1.smithi079.stdout:6/861: write d0/d6/d16/d1f/d36/db5/f115 [660928,19363] 0 2024-05-09T06:29:42.339 INFO:tasks.workunit.client.1.smithi079.stdout:4/881: dwrite d6/d1a/d26/d2a/d54/f45 [0,4194304] 0 2024-05-09T06:29:42.340 INFO:tasks.workunit.client.1.smithi079.stdout:2/898: dread d8/db/d11/f8e [0,4194304] 0 2024-05-09T06:29:42.340 INFO:tasks.workunit.client.1.smithi079.stdout:5/917: unlink d13/f5f 0 2024-05-09T06:29:42.340 INFO:tasks.workunit.client.1.smithi079.stdout:5/918: creat d13/d43/d3d/d40/d9a/df8/f13a x:0 0 0 2024-05-09T06:29:42.340 INFO:tasks.workunit.client.1.smithi079.stdout:5/919: fsync d13/da5/fff 0 2024-05-09T06:29:42.342 INFO:tasks.workunit.client.1.smithi079.stdout:4/882: mkdir d6/d1a/d26/d2a/d54/d9e/dd5/d11f 0 2024-05-09T06:29:42.344 INFO:tasks.workunit.client.1.smithi079.stdout:2/899: symlink d8/db/d59/d67/d7f/l143 0 2024-05-09T06:29:42.344 INFO:tasks.workunit.client.1.smithi079.stdout:2/900: chown d8/db/d4b/d4f 13381 1 2024-05-09T06:29:42.344 INFO:tasks.workunit.client.1.smithi079.stdout:6/862: dread d0/d6/d1b/db8/fe5 [8388608,4194304] 0 2024-05-09T06:29:42.344 INFO:tasks.workunit.client.1.smithi079.stdout:6/863: creat d0/de/f124 x:0 0 0 2024-05-09T06:29:42.347 INFO:tasks.workunit.client.1.smithi079.stdout:5/920: creat d13/d43/d39/d61/f13b x:0 0 0 2024-05-09T06:29:42.348 INFO:tasks.workunit.client.1.smithi079.stdout:4/883: write d6/d8/d27/d3d/f58 [1147148,92002] 0 2024-05-09T06:29:42.348 INFO:tasks.workunit.client.1.smithi079.stdout:4/884: chown d6/d8/fe3 7363753 1 2024-05-09T06:29:42.350 INFO:tasks.workunit.client.1.smithi079.stdout:2/901: unlink d8/db/d4b/f68 0 2024-05-09T06:29:42.353 INFO:tasks.workunit.client.1.smithi079.stdout:8/758: dwrite d1/d5/d36/d102/dc3/d3b/fdf [0,4194304] 0 2024-05-09T06:29:42.355 INFO:tasks.workunit.client.1.smithi079.stdout:4/885: symlink d6/d1a/d41/d68/d6b/l120 0 2024-05-09T06:29:42.360 INFO:tasks.workunit.client.1.smithi079.stdout:6/864: dwrite d0/d60/fd0 [0,4194304] 0 2024-05-09T06:29:42.360 INFO:tasks.workunit.client.1.smithi079.stdout:6/865: write d0/d60/d81/f112 [3570542,79654] 0 2024-05-09T06:29:42.361 INFO:tasks.workunit.client.1.smithi079.stdout:6/866: fdatasync d0/fc 0 2024-05-09T06:29:42.372 INFO:tasks.workunit.client.1.smithi079.stdout:6/867: unlink d0/d6/d1b/d20/ld3 0 2024-05-09T06:29:42.372 INFO:tasks.workunit.client.1.smithi079.stdout:6/868: fsync d0/de/f43 0 2024-05-09T06:29:42.375 INFO:tasks.workunit.client.1.smithi079.stdout:6/869: link d0/f7a d0/d6/d16/d1f/d36/f125 0 2024-05-09T06:29:42.375 INFO:tasks.workunit.client.1.smithi079.stdout:6/870: fdatasync d0/d6/d1b/db8/d105/f10c 0 2024-05-09T06:29:42.378 INFO:tasks.workunit.client.1.smithi079.stdout:6/871: mknod d0/d6/d1b/db8/d119/c126 0 2024-05-09T06:29:42.380 INFO:tasks.workunit.client.1.smithi079.stdout:6/872: getdents d0/d6/d1b/db8 0 2024-05-09T06:29:42.383 INFO:tasks.workunit.client.1.smithi079.stdout:6/873: rmdir d0/da2 39 2024-05-09T06:29:42.383 INFO:tasks.workunit.client.1.smithi079.stdout:2/902: dwrite d8/db/d11/f8e [0,4194304] 0 2024-05-09T06:29:42.383 INFO:tasks.workunit.client.1.smithi079.stdout:2/903: read - d8/db/d4b/d4f/ffe zero size 2024-05-09T06:29:42.383 INFO:tasks.workunit.client.1.smithi079.stdout:8/759: dwrite d1/d5/d36/d102/dc3/d50/fc6 [0,4194304] 0 2024-05-09T06:29:42.385 INFO:tasks.workunit.client.1.smithi079.stdout:5/921: dwrite d13/d4f/f68 [0,4194304] 0 2024-05-09T06:29:42.385 INFO:tasks.workunit.client.1.smithi079.stdout:5/922: dread - d13/d2a/fb3 zero size 2024-05-09T06:29:42.385 INFO:tasks.workunit.client.1.smithi079.stdout:5/923: chown d13/d43/d39/da7/fd1 669 1 2024-05-09T06:29:42.385 INFO:tasks.workunit.client.1.smithi079.stdout:5/924: dread - d13/d43/d3d/d40/d63/da2/f9c zero size 2024-05-09T06:29:42.385 INFO:tasks.workunit.client.1.smithi079.stdout:5/925: write d13/d43/d3d/d40/d63/da2/d8b/fe8 [4960230,29676] 0 2024-05-09T06:29:42.385 INFO:tasks.workunit.client.1.smithi079.stdout:5/926: chown d13/d43/l54 18 1 2024-05-09T06:29:42.385 INFO:tasks.workunit.client.1.smithi079.stdout:4/886: dwrite d6/d8/d27/d3d/d5b/ff4 [0,4194304] 0 2024-05-09T06:29:42.389 INFO:tasks.workunit.client.1.smithi079.stdout:2/904: creat d8/db/d5c/f144 x:0 0 0 2024-05-09T06:29:42.395 INFO:tasks.workunit.client.1.smithi079.stdout:8/760: truncate d1/d3/f4 1183027 0 2024-05-09T06:29:42.395 INFO:tasks.workunit.client.1.smithi079.stdout:8/761: chown d1/d3/f4d 39 1 2024-05-09T06:29:42.395 INFO:tasks.workunit.client.1.smithi079.stdout:8/762: truncate d1/d5/d36/da0/fb3 59987 0 2024-05-09T06:29:42.398 INFO:tasks.workunit.client.1.smithi079.stdout:5/927: link d13/d43/d26/d35/cb1 d13/d43/d39/da7/c13c 0 2024-05-09T06:29:42.402 INFO:tasks.workunit.client.1.smithi079.stdout:6/874: dwrite d0/d6/d5e/fec [0,4194304] 0 2024-05-09T06:29:42.402 INFO:tasks.workunit.client.1.smithi079.stdout:6/875: getdents d0/d6/d16/d1f/d36/dfb 0 2024-05-09T06:29:42.402 INFO:tasks.workunit.client.1.smithi079.stdout:6/876: chown d0/d6/c8d 504600174 1 2024-05-09T06:29:42.402 INFO:tasks.workunit.client.1.smithi079.stdout:6/877: truncate d0/d6/d16/d1f/f90 633569 0 2024-05-09T06:29:42.402 INFO:tasks.workunit.client.1.smithi079.stdout:6/878: creat d0/d6/d1b/d20/d10d/f127 x:0 0 0 2024-05-09T06:29:42.404 INFO:tasks.workunit.client.1.smithi079.stdout:4/887: rename d6/d1a/d41/l118 to d6/d1a/d26/d2a/d54/dc8/l121 0 2024-05-09T06:29:42.405 INFO:tasks.workunit.client.1.smithi079.stdout:8/763: dread d1/d5/dc/f1b [0,4194304] 0 2024-05-09T06:29:42.413 INFO:tasks.workunit.client.1.smithi079.stdout:8/764: dread d1/f91 [0,4194304] 0 2024-05-09T06:29:42.413 INFO:tasks.workunit.client.1.smithi079.stdout:8/765: write d1/f1f [14403,65146] 0 2024-05-09T06:29:42.420 INFO:tasks.workunit.client.1.smithi079.stdout:2/905: creat d8/db/d59/d127/f145 x:0 0 0 2024-05-09T06:29:42.425 INFO:tasks.workunit.client.1.smithi079.stdout:5/928: mknod d13/d43/d3d/d40/d63/da2/c13d 0 2024-05-09T06:29:42.425 INFO:tasks.workunit.client.1.smithi079.stdout:5/929: truncate d13/d92/dcd/deb/f12f 1284908 0 2024-05-09T06:29:42.432 INFO:tasks.workunit.client.1.smithi079.stdout:6/879: symlink d0/d6/d16/d1f/d36/l128 0 2024-05-09T06:29:42.433 INFO:tasks.workunit.client.1.smithi079.stdout:4/888: creat d6/d1a/d26/f122 x:0 0 0 2024-05-09T06:29:42.436 INFO:tasks.workunit.client.1.smithi079.stdout:6/880: dread d0/d6/d16/d1f/d6f/d8c/d93/f9e [0,4194304] 0 2024-05-09T06:29:42.437 INFO:tasks.workunit.client.1.smithi079.stdout:7/739: sync 2024-05-09T06:29:42.439 INFO:tasks.workunit.client.1.smithi079.stdout:2/906: symlink d8/df7/d129/l146 0 2024-05-09T06:29:42.441 INFO:tasks.workunit.client.1.smithi079.stdout:5/930: mkdir d13/d43/d3d/d40/d63/da2/d8b/d13e 0 2024-05-09T06:29:42.441 INFO:tasks.workunit.client.1.smithi079.stdout:5/931: write d13/d43/d3d/d40/d9a/dd2/f138 [926759,58942] 0 2024-05-09T06:29:42.442 INFO:tasks.workunit.client.1.smithi079.stdout:5/932: truncate d13/d4f/f78 4673814 0 2024-05-09T06:29:42.442 INFO:tasks.workunit.client.1.smithi079.stdout:5/933: dread - d13/d43/d26/dac/fc7 zero size 2024-05-09T06:29:42.442 INFO:tasks.workunit.client.1.smithi079.stdout:5/934: creat d13/d43/d39/d61/d72/f13f x:0 0 0 2024-05-09T06:29:42.442 INFO:tasks.workunit.client.1.smithi079.stdout:5/935: creat d13/d43/d39/da7/f140 x:0 0 0 2024-05-09T06:29:42.442 INFO:tasks.workunit.client.1.smithi079.stdout:5/936: stat d13/d2a/c4c 0 2024-05-09T06:29:42.442 INFO:tasks.workunit.client.1.smithi079.stdout:5/937: write d13/d43/d26/dac/fc7 [507379,62759] 0 2024-05-09T06:29:42.443 INFO:tasks.workunit.client.1.smithi079.stdout:4/889: rename d6/d8/f4f to d6/d8/de6/f123 0 2024-05-09T06:29:42.446 INFO:tasks.workunit.client.1.smithi079.stdout:6/881: mkdir d0/d6/d1b/d20/dac/d129 0 2024-05-09T06:29:42.447 INFO:tasks.workunit.client.1.smithi079.stdout:8/766: getdents d1/d64 0 2024-05-09T06:29:42.447 INFO:tasks.workunit.client.1.smithi079.stdout:8/767: truncate d1/d5/d36/d102/dc3/d82/fe8 4978827 0 2024-05-09T06:29:42.447 INFO:tasks.workunit.client.1.smithi079.stdout:8/768: chown d1/d5/d36/d102/d33/d5d/f107 8 1 2024-05-09T06:29:42.447 INFO:tasks.workunit.client.1.smithi079.stdout:8/769: chown d1/d5/d36/d102/dc3/d44/f4c 8029 1 2024-05-09T06:29:42.449 INFO:tasks.workunit.client.1.smithi079.stdout:7/740: write d4/d7/d22/f2a [2370130,60626] 0 2024-05-09T06:29:42.451 INFO:tasks.workunit.client.1.smithi079.stdout:2/907: link d8/db/d4b/d4f/d51/d6d/f96 d8/db/d59/d67/d7f/dac/f147 0 2024-05-09T06:29:42.451 INFO:tasks.workunit.client.1.smithi079.stdout:2/908: fdatasync d8/db/d4b/d4f/d51/fdc 0 2024-05-09T06:29:42.452 INFO:tasks.workunit.client.1.smithi079.stdout:4/890: dread d6/d1a/d26/d2a/d54/d9e/fc0 [0,4194304] 0 2024-05-09T06:29:42.452 INFO:tasks.workunit.client.1.smithi079.stdout:4/891: chown d6/d1a/d26/d2a/dde/df1/df3 1 1 2024-05-09T06:29:42.452 INFO:tasks.workunit.client.1.smithi079.stdout:4/892: write d6/d8/d55/f115 [1867638,109027] 0 2024-05-09T06:29:42.452 INFO:tasks.workunit.client.1.smithi079.stdout:4/893: truncate d6/d8/d27/d3d/d5b/d9a/f82 5118329 0 2024-05-09T06:29:42.457 INFO:tasks.workunit.client.1.smithi079.stdout:8/770: mknod d1/d5/d36/d102/dc3/d44/c10b 0 2024-05-09T06:29:42.459 INFO:tasks.workunit.client.1.smithi079.stdout:4/894: dread d6/d1a/d26/d2a/f72 [0,4194304] 0 2024-05-09T06:29:42.461 INFO:tasks.workunit.client.1.smithi079.stdout:4/895: read d6/d15/f5f [296823,82569] 0 2024-05-09T06:29:42.461 INFO:tasks.workunit.client.1.smithi079.stdout:4/896: write d6/d15/f5c [3506812,7074] 0 2024-05-09T06:29:42.461 INFO:tasks.workunit.client.1.smithi079.stdout:4/897: creat d6/d1a/f124 x:0 0 0 2024-05-09T06:29:42.461 INFO:tasks.workunit.client.1.smithi079.stdout:5/938: dwrite d13/d43/d3d/d40/d9a/df8/f103 [0,4194304] 0 2024-05-09T06:29:42.464 INFO:tasks.workunit.client.1.smithi079.stdout:2/909: unlink d8/db/d4b/d4f/d51/f112 0 2024-05-09T06:29:42.465 INFO:tasks.workunit.client.1.smithi079.stdout:4/898: dread d6/d1a/d26/d2a/f2d [0,4194304] 0 2024-05-09T06:29:42.466 INFO:tasks.workunit.client.1.smithi079.stdout:4/899: write d6/d8/d80/da6/fbc [385369,30295] 0 2024-05-09T06:29:42.466 INFO:tasks.workunit.client.1.smithi079.stdout:4/900: fsync d6/d1a/d26/d2a/d54/f70 0 2024-05-09T06:29:42.466 INFO:tasks.workunit.client.1.smithi079.stdout:8/771: mkdir d1/d56/d10c 0 2024-05-09T06:29:42.466 INFO:tasks.workunit.client.1.smithi079.stdout:6/882: dwrite d0/d60/daf/fb3 [0,4194304] 0 2024-05-09T06:29:42.469 INFO:tasks.workunit.client.1.smithi079.stdout:7/741: getdents d4/d7/dd/d5b/d31 0 2024-05-09T06:29:42.469 INFO:tasks.workunit.client.1.smithi079.stdout:4/901: dread d6/d8/d80/da6/fbc [0,4194304] 0 2024-05-09T06:29:42.474 INFO:tasks.workunit.client.1.smithi079.stdout:5/939: creat d13/d43/d3d/d40/d63/f141 x:0 0 0 2024-05-09T06:29:42.475 INFO:tasks.workunit.client.1.smithi079.stdout:2/910: symlink d8/db/d59/d67/d86/dd5/d13f/l148 0 2024-05-09T06:29:42.478 INFO:tasks.workunit.client.1.smithi079.stdout:8/772: mkdir d1/d5/d36/d102/def/d10d 0 2024-05-09T06:29:42.480 INFO:tasks.workunit.client.1.smithi079.stdout:6/883: dwrite d0/d6/d1b/d20/f5a [0,4194304] 0 2024-05-09T06:29:42.480 INFO:tasks.workunit.client.1.smithi079.stdout:6/884: write d0/d6/d5e/f63 [4861709,62867] 0 2024-05-09T06:29:42.480 INFO:tasks.workunit.client.1.smithi079.stdout:6/885: write d0/d6/d16/d1f/f41 [2296826,36496] 0 2024-05-09T06:29:42.481 INFO:tasks.workunit.client.1.smithi079.stdout:6/886: dread d0/d6/d1b/d2d/f4e [0,4194304] 0 2024-05-09T06:29:42.481 INFO:tasks.workunit.client.1.smithi079.stdout:6/887: fdatasync d0/d6/d5e/f9a 0 2024-05-09T06:29:42.484 INFO:tasks.workunit.client.1.smithi079.stdout:7/742: rename d4/d7/d37/d90/dcc to d4/d7/d37/d67/de6 0 2024-05-09T06:29:42.486 INFO:tasks.workunit.client.1.smithi079.stdout:4/902: truncate d6/d1a/d26/d2a/d54/d9e/dd5/d34/f52 350198 0 2024-05-09T06:29:42.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/911: truncate d8/db/d5c/fc6 8106157 0 2024-05-09T06:29:42.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/912: read - d8/db/d59/d67/d7f/db9/dca/f109 zero size 2024-05-09T06:29:42.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/913: chown d8/db/d59/d67/d7f/db9/de1 182 1 2024-05-09T06:29:42.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/914: creat d8/db/d5c/f149 x:0 0 0 2024-05-09T06:29:42.489 INFO:tasks.workunit.client.1.smithi079.stdout:2/915: read d8/db/d11/d5f/f76 [3540758,79284] 0 2024-05-09T06:29:42.491 INFO:tasks.workunit.client.1.smithi079.stdout:8/773: creat d1/d5/d36/d102/dc3/d50/dd7/f10e x:0 0 0 2024-05-09T06:29:42.491 INFO:tasks.workunit.client.1.smithi079.stdout:8/774: readlink d1/db/daf/d66/d6c/ld6 0 2024-05-09T06:29:42.494 INFO:tasks.workunit.client.1.smithi079.stdout:6/888: creat d0/d6/d16/d1f/d36/d69/d84/f12a x:0 0 0 2024-05-09T06:29:42.495 INFO:tasks.workunit.client.1.smithi079.stdout:7/743: creat d4/d7/d22/d28/fe7 x:0 0 0 2024-05-09T06:29:42.497 INFO:tasks.workunit.client.1.smithi079.stdout:4/903: creat d6/d1a/d26/d2a/dde/df1/d105/f125 x:0 0 0 2024-05-09T06:29:42.517 INFO:tasks.workunit.client.1.smithi079.stdout:5/940: getdents d13/d43/d3d/d40/d63/da2/d8b/d110 0 2024-05-09T06:29:42.517 INFO:tasks.workunit.client.1.smithi079.stdout:5/941: read - d13/d2a/fb3 zero size 2024-05-09T06:29:42.518 INFO:tasks.workunit.client.1.smithi079.stdout:5/942: chown d13/d43/f28 37 1 2024-05-09T06:29:42.518 INFO:tasks.workunit.client.1.smithi079.stdout:5/943: stat d13/d92/dcd/dcf 0 2024-05-09T06:29:42.518 INFO:tasks.workunit.client.1.smithi079.stdout:5/944: creat d13/d2a/f142 x:0 0 0 2024-05-09T06:29:42.521 INFO:tasks.workunit.client.1.smithi079.stdout:2/916: mknod d8/db/d11/d5f/d130/d88/c14a 0 2024-05-09T06:29:42.522 INFO:tasks.workunit.client.1.smithi079.stdout:2/917: dread d8/db/d59/d67/d7f/dac/f147 [0,4194304] 0 2024-05-09T06:29:42.524 INFO:tasks.workunit.client.1.smithi079.stdout:6/889: mknod d0/d6/d1b/d20/dac/d129/c12b 0 2024-05-09T06:29:42.524 INFO:tasks.workunit.client.1.smithi079.stdout:6/890: fdatasync d0/d6/d16/d1f/d36/d69/d84/f94 0 2024-05-09T06:29:42.525 INFO:tasks.workunit.client.1.smithi079.stdout:7/744: rmdir d4/d7/d22/d28/d50/de2 0 2024-05-09T06:29:42.526 INFO:tasks.workunit.client.1.smithi079.stdout:4/904: creat d6/d8/f126 x:0 0 0 2024-05-09T06:29:42.531 INFO:tasks.workunit.client.1.smithi079.stdout:5/945: mknod d13/d43/d3d/c143 0 2024-05-09T06:29:42.531 INFO:tasks.workunit.client.1.smithi079.stdout:6/891: dread d0/d6/d16/d1f/f25 [0,4194304] 0 2024-05-09T06:29:42.532 INFO:tasks.workunit.client.1.smithi079.stdout:8/775: mknod d1/d5/d36/d102/dc3/d3b/c10f 0 2024-05-09T06:29:42.539 INFO:tasks.workunit.client.1.smithi079.stdout:7/745: creat d4/d7/dd/d5b/d32/fe8 x:0 0 0 2024-05-09T06:29:42.542 INFO:tasks.workunit.client.1.smithi079.stdout:5/946: unlink d13/d43/d3d/d40/d9a/df8/f13a 0 2024-05-09T06:29:42.543 INFO:tasks.workunit.client.1.smithi079.stdout:8/776: truncate d1/d5/d36/d102/dc3/d3b/f90 632253 0 2024-05-09T06:29:42.547 INFO:tasks.workunit.client.1.smithi079.stdout:2/918: getdents d8/db/d5c/d6b/db5 0 2024-05-09T06:29:42.547 INFO:tasks.workunit.client.1.smithi079.stdout:2/919: chown d8/db/d5c/d6b/db5/fab 105739300 1 2024-05-09T06:29:42.551 INFO:tasks.workunit.client.1.smithi079.stdout:8/777: mkdir d1/d5/d36/d102/dc3/d82/dda/d110 0 2024-05-09T06:29:42.555 INFO:tasks.workunit.client.1.smithi079.stdout:2/920: unlink d8/db/dc/f56 0 2024-05-09T06:29:42.557 INFO:tasks.workunit.client.1.smithi079.stdout:8/778: creat d1/d5/d36/d102/dc3/f111 x:0 0 0 2024-05-09T06:29:42.557 INFO:tasks.workunit.client.1.smithi079.stdout:8/779: chown d1/d3/f4 991 1 2024-05-09T06:29:42.559 INFO:tasks.workunit.client.1.smithi079.stdout:2/921: mknod d8/db/d4b/d4f/d51/c14b 0 2024-05-09T06:29:42.561 INFO:tasks.workunit.client.1.smithi079.stdout:4/905: dwrite d6/d8/de6/f123 [0,4194304] 0 2024-05-09T06:29:42.567 INFO:tasks.workunit.client.1.smithi079.stdout:5/947: dwrite d13/d43/d39/da7/fa9 [0,4194304] 0 2024-05-09T06:29:42.567 INFO:tasks.workunit.client.1.smithi079.stdout:2/922: unlink d8/db/d59/d67/d7f/db9/dca/fe2 0 2024-05-09T06:29:42.567 INFO:tasks.workunit.client.1.smithi079.stdout:7/746: dwrite d4/d7/d22/d28/d50/d5c/d85/f91 [0,4194304] 0 2024-05-09T06:29:42.567 INFO:tasks.workunit.client.1.smithi079.stdout:7/747: write d4/d7/dd/d5b/d31/d34/f87 [298473,97581] 0 2024-05-09T06:29:42.568 INFO:tasks.workunit.client.1.smithi079.stdout:4/906: stat d6/d8/d27/d3d/f64 0 2024-05-09T06:29:42.568 INFO:tasks.workunit.client.1.smithi079.stdout:4/907: readlink d6/d1a/d26/d2a/d54/d9e/dd5/df/l110 0 2024-05-09T06:29:42.568 INFO:tasks.workunit.client.1.smithi079.stdout:4/908: creat d6/d1a/d26/d2a/d54/d9e/f127 x:0 0 0 2024-05-09T06:29:42.569 INFO:tasks.workunit.client.1.smithi079.stdout:1/807: sync 2024-05-09T06:29:42.572 INFO:tasks.workunit.client.1.smithi079.stdout:8/780: dwrite d1/d5/d36/d102/d33/d5d/d6d/f9a [0,4194304] 0 2024-05-09T06:29:42.572 INFO:tasks.workunit.client.1.smithi079.stdout:8/781: creat d1/f112 x:0 0 0 2024-05-09T06:29:42.572 INFO:tasks.workunit.client.1.smithi079.stdout:8/782: stat d1/db/daf/d66/d6c/dbf/dc9 0 2024-05-09T06:29:42.572 INFO:tasks.workunit.client.1.smithi079.stdout:8/783: write d1/ff6 [1714752,21827] 0 2024-05-09T06:29:42.575 INFO:tasks.workunit.client.1.smithi079.stdout:5/948: creat d13/d43/d3d/d40/d63/da2/d8b/d110/f144 x:0 0 0 2024-05-09T06:29:42.579 INFO:tasks.workunit.client.1.smithi079.stdout:7/748: mkdir d4/d7/dd/d5b/d32/de9 0 2024-05-09T06:29:42.582 INFO:tasks.workunit.client.1.smithi079.stdout:1/808: getdents d0/d12/d48/d75/d43/d20/d39 0 2024-05-09T06:29:42.583 INFO:tasks.workunit.client.1.smithi079.stdout:1/809: write d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/fab [699986,112878] 0 2024-05-09T06:29:42.586 INFO:tasks.workunit.client.1.smithi079.stdout:4/909: dwrite d6/d1a/d26/d2a/f2d [0,4194304] 0 2024-05-09T06:29:42.591 INFO:tasks.workunit.client.1.smithi079.stdout:7/749: creat d4/d9e/fea x:0 0 0 2024-05-09T06:29:42.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:42 smithi079 ceph-mon[35268]: pgmap v250: 65 pgs: 65 active+clean; 1.7 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 163 MiB/s rd, 206 MiB/s wr, 396 op/s 2024-05-09T06:29:42.593 INFO:tasks.workunit.client.1.smithi079.stdout:1/810: rename d0/d12/d67/d53/dbf/dd2/d4e/f72 to d0/d12/d67/db6/d8a/f11d 0 2024-05-09T06:29:42.600 INFO:tasks.workunit.client.1.smithi079.stdout:4/910: symlink d6/d8/d27/d3d/d5b/db4/dc3/l128 0 2024-05-09T06:29:42.600 INFO:tasks.workunit.client.1.smithi079.stdout:4/911: chown d6/d1a/d26/d2a/d54/d9e/dd5 1 1 2024-05-09T06:29:42.616 INFO:tasks.workunit.client.1.smithi079.stdout:1/811: dwrite d0/d12/d48/d75/d26/f55 [4194304,4194304] 0 2024-05-09T06:29:42.616 INFO:tasks.workunit.client.1.smithi079.stdout:1/812: chown d0/d12/d48/d75/d43/d20/c45 3792503 1 2024-05-09T06:29:42.616 INFO:tasks.workunit.client.1.smithi079.stdout:1/813: fdatasync d0/d12/d67/d53/dbf/dd2/d4e/f6c 0 2024-05-09T06:29:42.616 INFO:tasks.workunit.client.1.smithi079.stdout:4/912: dwrite d6/d1a/d41/d68/d6b/f81 [0,4194304] 0 2024-05-09T06:29:42.616 INFO:tasks.workunit.client.1.smithi079.stdout:4/913: truncate d6/d1a/d26/d2a/d54/d9e/dd5/df/d8e/fc1 74388 0 2024-05-09T06:29:42.616 INFO:tasks.workunit.client.1.smithi079.stdout:1/814: dread d0/d12/d67/db6/d89/fdc [0,4194304] 0 2024-05-09T06:29:42.635 INFO:tasks.workunit.client.1.smithi079.stdout:4/914: write d6/d8/d27/d3d/d5b/d9a/f82 [4356130,73088] 0 2024-05-09T06:29:42.635 INFO:tasks.workunit.client.1.smithi079.stdout:4/915: chown d6/d8/d114/l11d 7436257 1 2024-05-09T06:29:42.635 INFO:tasks.workunit.client.1.smithi079.stdout:4/916: chown d6/cbb 233173 1 2024-05-09T06:29:42.636 INFO:tasks.workunit.client.1.smithi079.stdout:1/815: rename d0/d12/d48/d75/d43/f47 to d0/d12/d48/d75/d43/d70/f11e 0 2024-05-09T06:29:42.638 INFO:tasks.workunit.client.1.smithi079.stdout:4/917: mkdir d6/d8/d55/d129 0 2024-05-09T06:29:42.640 INFO:tasks.workunit.client.1.smithi079.stdout:1/816: getdents d0 0 2024-05-09T06:29:42.642 INFO:tasks.workunit.client.1.smithi079.stdout:4/918: creat d6/d8/d27/d3d/f12a x:0 0 0 2024-05-09T06:29:42.646 INFO:tasks.workunit.client.1.smithi079.stdout:4/919: mkdir d6/d12b 0 2024-05-09T06:29:42.650 INFO:tasks.workunit.client.1.smithi079.stdout:4/920: getdents d6/d1a/d26/d2a/d54/d9e/dd5 0 2024-05-09T06:29:42.653 INFO:tasks.workunit.client.1.smithi079.stdout:4/921: creat d6/d8/d27/d3d/d5b/d9a/d8b/f12c x:0 0 0 2024-05-09T06:29:42.655 INFO:tasks.workunit.client.1.smithi079.stdout:4/922: truncate d6/d1a/d26/d2a/d54/f23 1906625 0 2024-05-09T06:29:42.657 INFO:tasks.workunit.client.1.smithi079.stdout:1/817: dwrite d0/d12/d67/db6/de3/fef [0,4194304] 0 2024-05-09T06:29:42.658 INFO:tasks.workunit.client.1.smithi079.stdout:0/775: sync 2024-05-09T06:29:42.658 INFO:tasks.workunit.client.1.smithi079.stdout:0/776: truncate d3/dd/d66/d6d/d74/d80/d2d/da7/dce/fd6 1011339 0 2024-05-09T06:29:42.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:42 smithi062 ceph-mon[26920]: pgmap v250: 65 pgs: 65 active+clean; 1.7 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 163 MiB/s rd, 206 MiB/s wr, 396 op/s 2024-05-09T06:29:42.666 INFO:tasks.workunit.client.1.smithi079.stdout:1/818: getdents d0/d12/d67/d53/d5e 0 2024-05-09T06:29:42.666 INFO:tasks.workunit.client.1.smithi079.stdout:1/819: chown d0/d12/d67/d53/dbf/dd2/d4e/f5d 798 1 2024-05-09T06:29:42.666 INFO:tasks.workunit.client.1.smithi079.stdout:1/820: chown d0/d12/d67/d53/d6d/f80 435028 1 2024-05-09T06:29:42.668 INFO:tasks.workunit.client.1.smithi079.stdout:1/821: creat d0/d12/d67/d53/dbf/f11f x:0 0 0 2024-05-09T06:29:42.673 INFO:tasks.workunit.client.1.smithi079.stdout:1/822: rmdir d0/d12/d67/db6/de3 39 2024-05-09T06:29:42.673 INFO:tasks.workunit.client.1.smithi079.stdout:1/823: write d0/d12/d16/f50 [2940899,63673] 0 2024-05-09T06:29:42.673 INFO:tasks.workunit.client.1.smithi079.stdout:1/824: creat d0/d12/d67/d53/d6d/f120 x:0 0 0 2024-05-09T06:29:42.683 INFO:tasks.workunit.client.1.smithi079.stdout:1/825: rmdir d0/d12 39 2024-05-09T06:29:42.686 INFO:tasks.workunit.client.1.smithi079.stdout:1/826: mkdir d0/d12/d67/db6/de3/d121 0 2024-05-09T06:29:42.686 INFO:tasks.workunit.client.1.smithi079.stdout:1/827: stat d0/d12/d67/d53/d5e/f10d 0 2024-05-09T06:29:42.686 INFO:tasks.workunit.client.1.smithi079.stdout:1/828: chown d0 3 1 2024-05-09T06:29:42.687 INFO:tasks.workunit.client.1.smithi079.stdout:1/829: write d0/d12/d67/d53/dbf/dd2/f9 [912422,51043] 0 2024-05-09T06:29:42.693 INFO:tasks.workunit.client.1.smithi079.stdout:1/830: dread d0/d12/d67/d53/d5e/fcf [0,4194304] 0 2024-05-09T06:29:42.696 INFO:tasks.workunit.client.1.smithi079.stdout:1/831: truncate d0/d12/f8b 1243567 0 2024-05-09T06:29:42.706 INFO:tasks.workunit.client.1.smithi079.stdout:1/832: dread d0/d12/d48/d75/d43/d20/d39/f78 [0,4194304] 0 2024-05-09T06:29:42.716 INFO:tasks.workunit.client.1.smithi079.stdout:1/833: read d0/d12/d67/d53/d5e/fcf [4876980,34917] 0 2024-05-09T06:29:42.724 INFO:tasks.workunit.client.1.smithi079.stdout:1/834: dread d0/d12/d48/d75/d43/f15 [0,4194304] 0 2024-05-09T06:29:42.728 INFO:tasks.workunit.client.1.smithi079.stdout:1/835: rename d0/d12/d67/db6/d8a/f9f to d0/d12/d67/db6/d8a/f122 0 2024-05-09T06:29:42.731 INFO:tasks.workunit.client.1.smithi079.stdout:1/836: link d0/d12/d67/d53/dbf/dd2/d4e/d7d/f107 d0/d12/d48/f123 0 2024-05-09T06:29:42.731 INFO:tasks.workunit.client.1.smithi079.stdout:1/837: fsync d0/d12/fb1 0 2024-05-09T06:29:42.734 INFO:tasks.workunit.client.1.smithi079.stdout:1/838: rename d0/d12/d67/l34 to d0/d12/d67/d93/l124 0 2024-05-09T06:29:42.734 INFO:tasks.workunit.client.1.smithi079.stdout:1/839: fdatasync d0/d12/d67/d53/dbf/dd2/f74 0 2024-05-09T06:29:42.735 INFO:tasks.workunit.client.1.smithi079.stdout:2/923: dwrite d8/db/d59/f11f [0,4194304] 0 2024-05-09T06:29:42.736 INFO:tasks.workunit.client.1.smithi079.stdout:1/840: mknod d0/d12/d67/db6/de3/c125 0 2024-05-09T06:29:42.748 INFO:tasks.workunit.client.1.smithi079.stdout:1/841: link d0/d12/d92/fac d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/f126 0 2024-05-09T06:29:42.749 INFO:tasks.workunit.client.1.smithi079.stdout:1/842: dread d0/df/f62 [0,4194304] 0 2024-05-09T06:29:42.751 INFO:tasks.workunit.client.1.smithi079.stdout:3/870: sync 2024-05-09T06:29:42.752 INFO:tasks.workunit.client.1.smithi079.stdout:1/843: rmdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb 39 2024-05-09T06:29:42.754 INFO:tasks.workunit.client.1.smithi079.stdout:3/871: truncate d1a/d21/db0/dd4/d34/d42/fc9 1354530 0 2024-05-09T06:29:42.756 INFO:tasks.workunit.client.1.smithi079.stdout:1/844: rename d0/d12/d48/dd7 to d0/d12/d67/d53/dbf/dd2/d3e/d127 0 2024-05-09T06:29:42.756 INFO:tasks.workunit.client.1.smithi079.stdout:1/845: write d0/d12/d67/d53/dbf/dd2/d4e/f5d [2984936,15802] 0 2024-05-09T06:29:42.757 INFO:tasks.workunit.client.1.smithi079.stdout:2/924: dwrite d8/db/d11/d5f/f64 [0,4194304] 0 2024-05-09T06:29:42.757 INFO:tasks.workunit.client.1.smithi079.stdout:2/925: chown d8/db/d11/f2f 199535 1 2024-05-09T06:29:42.758 INFO:tasks.workunit.client.1.smithi079.stdout:3/872: creat d1a/d21/db0/dd4/d3a/d54/f11d x:0 0 0 2024-05-09T06:29:42.758 INFO:tasks.workunit.client.1.smithi079.stdout:3/873: getdents d1a/d21/ddc/d104 0 2024-05-09T06:29:42.765 INFO:tasks.workunit.client.1.smithi079.stdout:2/926: creat d8/db/d59/d67/d7f/db9/dca/f14c x:0 0 0 2024-05-09T06:29:42.766 INFO:tasks.workunit.client.1.smithi079.stdout:2/927: getdents d8/db/d9d/d10c 0 2024-05-09T06:29:42.770 INFO:tasks.workunit.client.1.smithi079.stdout:1/846: dread d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6/ff9 [0,4194304] 0 2024-05-09T06:29:42.771 INFO:tasks.workunit.client.1.smithi079.stdout:3/874: mkdir d1a/d21/db0/dd4/d67/d11e 0 2024-05-09T06:29:42.771 INFO:tasks.workunit.client.1.smithi079.stdout:3/875: dread - d1a/d1c/d22/d53/da5/f112 zero size 2024-05-09T06:29:42.784 INFO:tasks.workunit.client.1.smithi079.stdout:1/847: dread d0/d12/d48/d75/d43/d20/f98 [0,4194304] 0 2024-05-09T06:29:42.784 INFO:tasks.workunit.client.1.smithi079.stdout:1/848: read - d0/d12/fb1 zero size 2024-05-09T06:29:42.789 INFO:tasks.workunit.client.1.smithi079.stdout:2/928: dwrite d8/db/d11/d5f/f75 [0,4194304] 0 2024-05-09T06:29:42.790 INFO:tasks.workunit.client.1.smithi079.stdout:3/876: dwrite d1a/d21/db0/dd4/f63 [0,4194304] 0 2024-05-09T06:29:42.798 INFO:tasks.workunit.client.1.smithi079.stdout:3/877: mknod d1a/d82/d87/db2/ddb/de9/c11f 0 2024-05-09T06:29:42.801 INFO:tasks.workunit.client.1.smithi079.stdout:3/878: symlink d1a/d21/ddc/d104/l120 0 2024-05-09T06:29:42.801 INFO:tasks.workunit.client.1.smithi079.stdout:3/879: chown d1a/d1c/d22/d53/d4e/dea/l8a 3709673 1 2024-05-09T06:29:42.810 INFO:tasks.workunit.client.1.smithi079.stdout:3/880: write fc [2068511,8878] 0 2024-05-09T06:29:42.814 INFO:tasks.workunit.client.1.smithi079.stdout:7/750: rmdir d4 39 2024-05-09T06:29:42.818 INFO:tasks.workunit.client.1.smithi079.stdout:3/881: rename d1a/d1c/d22/d53/d4e/dea to d1a/d21/db0/dd4/d3a/d121 0 2024-05-09T06:29:42.818 INFO:tasks.workunit.client.1.smithi079.stdout:3/882: chown d1a/d21/f39 709 1 2024-05-09T06:29:42.821 INFO:tasks.workunit.client.1.smithi079.stdout:7/751: rename d4/d7/dd/d5b/d6f/db9/fc0 to d4/d7/d37/d7c/feb 0 2024-05-09T06:29:42.825 INFO:tasks.workunit.client.1.smithi079.stdout:3/883: dread d1a/d21/db0/dd4/d34/d59/f74 [0,4194304] 0 2024-05-09T06:29:42.828 INFO:tasks.workunit.client.1.smithi079.stdout:7/752: dread d4/f6 [0,4194304] 0 2024-05-09T06:29:42.830 INFO:tasks.workunit.client.1.smithi079.stdout:3/884: rmdir d1a/d21/db0/dd4/d3a/da4/ddd 0 2024-05-09T06:29:42.868 INFO:tasks.workunit.client.1.smithi079.stdout:1/849: truncate d0/d12/d48/d75/d26/f55 7074357 0 2024-05-09T06:29:42.868 INFO:tasks.workunit.client.1.smithi079.stdout:1/850: chown d0/d12/d67/d53/dbf/dd2/d4e/d7d/la5 12 1 2024-05-09T06:29:42.868 INFO:tasks.workunit.client.1.smithi079.stdout:1/851: fdatasync d0/d12/d67/db6/d89/f116 0 2024-05-09T06:29:42.868 INFO:tasks.workunit.client.1.smithi079.stdout:1/852: fsync d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/fab 0 2024-05-09T06:29:42.872 INFO:tasks.workunit.client.1.smithi079.stdout:1/853: rmdir d0/d12/d67/db6/de3/d121 0 2024-05-09T06:29:42.874 INFO:tasks.workunit.client.1.smithi079.stdout:1/854: rmdir d0/df/db8/dba 0 2024-05-09T06:29:42.877 INFO:tasks.workunit.client.1.smithi079.stdout:7/753: dwrite d4/d7/d22/d28/fd1 [0,4194304] 0 2024-05-09T06:29:42.877 INFO:tasks.workunit.client.1.smithi079.stdout:7/754: read - d4/d7/dd/d5b/fe1 zero size 2024-05-09T06:29:42.877 INFO:tasks.workunit.client.1.smithi079.stdout:3/885: dwrite d1a/d1c/d22/d53/d4e/fe3 [0,4194304] 0 2024-05-09T06:29:42.885 INFO:tasks.workunit.client.1.smithi079.stdout:7/755: mkdir d4/d7/d22/d28/d50/d5c/ddc/dec 0 2024-05-09T06:29:42.885 INFO:tasks.workunit.client.1.smithi079.stdout:7/756: write d4/d9e/fea [3289,126812] 0 2024-05-09T06:29:42.885 INFO:tasks.workunit.client.1.smithi079.stdout:7/757: stat d4/d7/dd/d5b/d32/l95 0 2024-05-09T06:29:42.888 INFO:tasks.workunit.client.1.smithi079.stdout:3/886: mkdir d1a/d21/db0/de5/d122 0 2024-05-09T06:29:42.892 INFO:tasks.workunit.client.1.smithi079.stdout:3/887: creat d1a/d82/f123 x:0 0 0 2024-05-09T06:29:42.893 INFO:tasks.workunit.client.1.smithi079.stdout:1/855: dwrite d0/d12/d67/d53/dbf/dd2/f117 [0,4194304] 0 2024-05-09T06:29:42.895 INFO:tasks.workunit.client.1.smithi079.stdout:3/888: mkdir d1a/d21/ddc/d124 0 2024-05-09T06:29:42.896 INFO:tasks.workunit.client.1.smithi079.stdout:3/889: write d1a/d21/db0/dd4/d34/fca [286881,125089] 0 2024-05-09T06:29:42.896 INFO:tasks.workunit.client.1.smithi079.stdout:3/890: fsync d1a/d1c/d22/d90/db8/fd7 0 2024-05-09T06:29:42.898 INFO:tasks.workunit.client.1.smithi079.stdout:7/758: dwrite d4/d7/dd/d5b/d31/d34/fe5 [0,4194304] 0 2024-05-09T06:29:42.910 INFO:tasks.workunit.client.1.smithi079.stdout:1/856: mknod d0/d12/dc0/dd4/c128 0 2024-05-09T06:29:42.910 INFO:tasks.workunit.client.1.smithi079.stdout:1/857: fdatasync d0/d12/d16/f84 0 2024-05-09T06:29:42.910 INFO:tasks.workunit.client.1.smithi079.stdout:3/891: creat d1a/d21/db0/dd4/d34/d59/dd6/d111/f125 x:0 0 0 2024-05-09T06:29:42.910 INFO:tasks.workunit.client.1.smithi079.stdout:7/759: read d4/d7/dd/d5b/f5d [2124647,37999] 0 2024-05-09T06:29:42.910 INFO:tasks.workunit.client.1.smithi079.stdout:7/760: read d4/d7/d22/f2a [2068442,38881] 0 2024-05-09T06:29:42.911 INFO:tasks.workunit.client.1.smithi079.stdout:7/761: chown d4/d7/d37/d67 99516701 1 2024-05-09T06:29:42.912 INFO:tasks.workunit.client.1.smithi079.stdout:1/858: truncate d0/d12/d92/ffe 2029703 0 2024-05-09T06:29:42.912 INFO:tasks.workunit.client.1.smithi079.stdout:1/859: chown d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94 3499 1 2024-05-09T06:29:42.915 INFO:tasks.workunit.client.1.smithi079.stdout:3/892: creat d1a/d1c/d22/d53/da5/dec/f126 x:0 0 0 2024-05-09T06:29:42.917 INFO:tasks.workunit.client.1.smithi079.stdout:7/762: getdents d4 0 2024-05-09T06:29:42.918 INFO:tasks.workunit.client.1.smithi079.stdout:1/860: mkdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/d129 0 2024-05-09T06:29:42.922 INFO:tasks.workunit.client.1.smithi079.stdout:7/763: unlink d4/d7/dd/f16 0 2024-05-09T06:29:42.924 INFO:tasks.workunit.client.1.smithi079.stdout:1/861: mknod d0/d12/d67/d53/d5e/c12a 0 2024-05-09T06:29:42.924 INFO:tasks.workunit.client.1.smithi079.stdout:3/893: dread d1a/d21/db0/dd4/f63 [0,4194304] 0 2024-05-09T06:29:42.924 INFO:tasks.workunit.client.1.smithi079.stdout:3/894: fsync d1a/d21/db0/dd4/d3a/fd3 0 2024-05-09T06:29:42.925 INFO:tasks.workunit.client.1.smithi079.stdout:7/764: dread d4/d7/d37/d7c/feb [0,4194304] 0 2024-05-09T06:29:42.928 INFO:tasks.workunit.client.1.smithi079.stdout:1/862: mknod d0/d12/d48/d75/c12b 0 2024-05-09T06:29:42.928 INFO:tasks.workunit.client.1.smithi079.stdout:1/863: chown d0/d12/d67/cf0 9613 1 2024-05-09T06:29:42.928 INFO:tasks.workunit.client.1.smithi079.stdout:1/864: stat d0/d12/d67/d53/dbf/dd2/d4e/d7d/fb7 0 2024-05-09T06:29:42.931 INFO:tasks.workunit.client.1.smithi079.stdout:3/895: creat d1a/d1c/d22/d53/d4e/f127 x:0 0 0 2024-05-09T06:29:42.931 INFO:tasks.workunit.client.1.smithi079.stdout:3/896: write d1a/d1c/d22/d90/db8/fe7 [996239,49634] 0 2024-05-09T06:29:42.934 INFO:tasks.workunit.client.1.smithi079.stdout:7/765: mknod d4/d7/dd/d5b/d31/d34/ced 0 2024-05-09T06:29:42.936 INFO:tasks.workunit.client.1.smithi079.stdout:1/865: link d0/d12/d67/db6/d8a/fb9 d0/d12/f12c 0 2024-05-09T06:29:42.939 INFO:tasks.workunit.client.1.smithi079.stdout:3/897: symlink d1a/d21/db0/dd4/d3a/da4/df0/d118/l128 0 2024-05-09T06:29:42.942 INFO:tasks.workunit.client.1.smithi079.stdout:7/766: creat d4/d7/dd/d47/fee x:0 0 0 2024-05-09T06:29:42.945 INFO:tasks.workunit.client.1.smithi079.stdout:8/784: sync 2024-05-09T06:29:42.945 INFO:tasks.workunit.client.1.smithi079.stdout:5/949: sync 2024-05-09T06:29:42.945 INFO:tasks.workunit.client.1.smithi079.stdout:4/923: sync 2024-05-09T06:29:42.945 INFO:tasks.workunit.client.1.smithi079.stdout:5/950: fdatasync d13/d43/d9e/fef 0 2024-05-09T06:29:42.945 INFO:tasks.workunit.client.1.smithi079.stdout:5/951: write d13/d2a/f4b [5130945,5040] 0 2024-05-09T06:29:42.945 INFO:tasks.workunit.client.1.smithi079.stdout:6/892: sync 2024-05-09T06:29:42.946 INFO:tasks.workunit.client.1.smithi079.stdout:1/866: dread d0/d12/f18 [0,4194304] 0 2024-05-09T06:29:42.946 INFO:tasks.workunit.client.1.smithi079.stdout:1/867: readlink d0/d12/d67/d53/d5e/le0 0 2024-05-09T06:29:42.947 INFO:tasks.workunit.client.1.smithi079.stdout:4/924: creat d6/d12b/f12d x:0 0 0 2024-05-09T06:29:42.952 INFO:tasks.workunit.client.1.smithi079.stdout:5/952: creat d13/f145 x:0 0 0 2024-05-09T06:29:42.955 INFO:tasks.workunit.client.1.smithi079.stdout:6/893: rename d0/d6/d5e/f9a to d0/de/d110/f12c 0 2024-05-09T06:29:42.960 INFO:tasks.workunit.client.1.smithi079.stdout:4/925: mknod d6/d1a/d26/dd3/c12e 0 2024-05-09T06:29:42.963 INFO:tasks.workunit.client.1.smithi079.stdout:5/953: getdents d13/d43/d3d/d40/d63/da2 0 2024-05-09T06:29:42.964 INFO:tasks.workunit.client.1.smithi079.stdout:3/898: dwrite d1a/d21/f51 [0,4194304] 0 2024-05-09T06:29:42.967 INFO:tasks.workunit.client.1.smithi079.stdout:6/894: symlink d0/d60/d118/l12d 0 2024-05-09T06:29:42.967 INFO:tasks.workunit.client.1.smithi079.stdout:6/895: fsync d0/de/f124 0 2024-05-09T06:29:42.967 INFO:tasks.workunit.client.1.smithi079.stdout:8/785: dwrite d1/d5/d36/d102/dc3/d50/dd7/f10e [0,4194304] 0 2024-05-09T06:29:42.969 INFO:tasks.workunit.client.1.smithi079.stdout:5/954: rmdir d13/d43/d39 39 2024-05-09T06:29:42.974 INFO:tasks.workunit.client.1.smithi079.stdout:4/926: dread d6/d1a/d26/d2a/d54/d9e/dd5/d34/f107 [0,4194304] 0 2024-05-09T06:29:42.974 INFO:tasks.workunit.client.1.smithi079.stdout:4/927: readlink d6/d1a/la0 0 2024-05-09T06:29:42.974 INFO:tasks.workunit.client.1.smithi079.stdout:1/868: dwrite d0/d12/d48/fe1 [0,4194304] 0 2024-05-09T06:29:42.974 INFO:tasks.workunit.client.1.smithi079.stdout:1/869: dread - d0/d12/d67/db6/d8a/fb9 zero size 2024-05-09T06:29:42.975 INFO:tasks.workunit.client.1.smithi079.stdout:1/870: write d0/d12/f8b [79279,119701] 0 2024-05-09T06:29:42.975 INFO:tasks.workunit.client.1.smithi079.stdout:3/899: symlink d1a/d21/ddc/l129 0 2024-05-09T06:29:42.981 INFO:tasks.workunit.client.1.smithi079.stdout:8/786: dread d1/d5/d36/d102/dc3/d50/dd7/f10e [0,4194304] 0 2024-05-09T06:29:42.981 INFO:tasks.workunit.client.1.smithi079.stdout:5/955: mknod d13/d43/d3d/d40/c146 0 2024-05-09T06:29:42.982 INFO:tasks.workunit.client.1.smithi079.stdout:8/787: write d1/d56/ff5 [187852,66810] 0 2024-05-09T06:29:42.982 INFO:tasks.workunit.client.1.smithi079.stdout:8/788: chown d1/d5/d36/d102/dc3/d44/da2/lb9 3 1 2024-05-09T06:29:42.982 INFO:tasks.workunit.client.1.smithi079.stdout:8/789: write d1/d5/d36/d102/dc3/d82/fe8 [2011027,111580] 0 2024-05-09T06:29:42.983 INFO:tasks.workunit.client.1.smithi079.stdout:4/928: symlink d6/d8/d27/d3d/d92/l12f 0 2024-05-09T06:29:42.986 INFO:tasks.workunit.client.1.smithi079.stdout:1/871: rename d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/f11b to d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/d129/f12d 0 2024-05-09T06:29:42.990 INFO:tasks.workunit.client.1.smithi079.stdout:3/900: creat d1a/d21/db0/dd4/d3a/f12a x:0 0 0 2024-05-09T06:29:42.991 INFO:tasks.workunit.client.1.smithi079.stdout:6/896: symlink d0/d6/d16/l12e 0 2024-05-09T06:29:42.992 INFO:tasks.workunit.client.1.smithi079.stdout:6/897: chown d0/d6/d16/d28 12588269 1 2024-05-09T06:29:42.995 INFO:tasks.workunit.client.1.smithi079.stdout:8/790: link d1/d5/d36/d102/d33/fb1 d1/d5/d36/dae/dbe/f113 0 2024-05-09T06:29:42.997 INFO:tasks.workunit.client.1.smithi079.stdout:4/929: creat d6/d8/d27/d3d/d5b/d10c/f130 x:0 0 0 2024-05-09T06:29:42.997 INFO:tasks.workunit.client.1.smithi079.stdout:4/930: write d6/f24 [9327715,38603] 0 2024-05-09T06:29:42.998 INFO:tasks.workunit.client.1.smithi079.stdout:4/931: truncate d6/d1a/d26/d2a/d54/d9e/dd5/df/d8e/fc1 495622 0 2024-05-09T06:29:43.001 INFO:tasks.workunit.client.1.smithi079.stdout:5/956: dwrite d13/d92/dcd/dcf/fa0 [0,4194304] 0 2024-05-09T06:29:43.002 INFO:tasks.workunit.client.1.smithi079.stdout:3/901: creat d1a/d21/ddc/d124/f12b x:0 0 0 2024-05-09T06:29:43.002 INFO:tasks.workunit.client.1.smithi079.stdout:3/902: write d1a/d1c/d1f/f68 [1864361,75676] 0 2024-05-09T06:29:43.007 INFO:tasks.workunit.client.1.smithi079.stdout:8/791: mknod d1/d5/d36/c114 0 2024-05-09T06:29:43.010 INFO:tasks.workunit.client.1.smithi079.stdout:8/792: read d1/f1a [151857,87459] 0 2024-05-09T06:29:43.012 INFO:tasks.workunit.client.1.smithi079.stdout:5/957: rename d13/d4f/f97 to d13/d43/d39/f147 0 2024-05-09T06:29:43.013 INFO:tasks.workunit.client.1.smithi079.stdout:5/958: dread d13/d4d/d77/f113 [0,4194304] 0 2024-05-09T06:29:43.013 INFO:tasks.workunit.client.1.smithi079.stdout:5/959: creat d13/d43/d3d/d40/d9a/dd2/f148 x:0 0 0 2024-05-09T06:29:43.013 INFO:tasks.workunit.client.1.smithi079.stdout:5/960: fsync d13/d43/d39/d61/d72/dbd/fd3 0 2024-05-09T06:29:43.014 INFO:tasks.workunit.client.1.smithi079.stdout:6/898: getdents d0/d6/d16/dcd 0 2024-05-09T06:29:43.014 INFO:tasks.workunit.client.1.smithi079.stdout:6/899: fsync d0/d6/d1b/d20/dac/f104 0 2024-05-09T06:29:43.017 INFO:tasks.workunit.client.1.smithi079.stdout:4/932: dwrite d6/d15/f5f [0,4194304] 0 2024-05-09T06:29:43.019 INFO:tasks.workunit.client.1.smithi079.stdout:5/961: symlink d13/d43/d3d/d40/d63/da2/d8b/d110/d124/l149 0 2024-05-09T06:29:43.020 INFO:tasks.workunit.client.1.smithi079.stdout:6/900: rmdir d0/d6/d16/d1f/d6f/d8c 39 2024-05-09T06:29:43.021 INFO:tasks.workunit.client.1.smithi079.stdout:6/901: truncate d0/d6/d16/f10e 898867 0 2024-05-09T06:29:43.022 INFO:tasks.workunit.client.1.smithi079.stdout:8/793: write d1/d3/fa [1003968,107507] 0 2024-05-09T06:29:43.023 INFO:tasks.workunit.client.1.smithi079.stdout:3/903: rename d1a/d21/db0/dd4/d3a/d54/fd2 to d1a/d21/db0/dd4/d34/f12c 0 2024-05-09T06:29:43.028 INFO:tasks.workunit.client.1.smithi079.stdout:6/902: readlink d0/d6/d16/d1f/d6f/l7f 0 2024-05-09T06:29:43.033 INFO:tasks.workunit.client.1.smithi079.stdout:3/904: dread d1a/d21/f5d [0,4194304] 0 2024-05-09T06:29:43.033 INFO:tasks.workunit.client.1.smithi079.stdout:4/933: dwrite d6/d1a/d26/d2a/d54/d9e/dd5/df/dfb/fee [0,4194304] 0 2024-05-09T06:29:43.033 INFO:tasks.workunit.client.1.smithi079.stdout:8/794: creat d1/d5/d36/d102/dc3/d50/dfe/f115 x:0 0 0 2024-05-09T06:29:43.035 INFO:tasks.workunit.client.1.smithi079.stdout:5/962: rename d13/da5/lfa to d13/d43/d3d/d40/d63/da2/d8b/d110/d124/l14a 0 2024-05-09T06:29:43.037 INFO:tasks.workunit.client.1.smithi079.stdout:6/903: getdents d0/d6/d1b/d20/dac/d129 0 2024-05-09T06:29:43.037 INFO:tasks.workunit.client.1.smithi079.stdout:3/905: dread d1a/d1c/d22/fa0 [0,4194304] 0 2024-05-09T06:29:43.037 INFO:tasks.workunit.client.1.smithi079.stdout:3/906: stat d1a/d1c 0 2024-05-09T06:29:43.044 INFO:tasks.workunit.client.1.smithi079.stdout:8/795: mknod d1/d3/dc4/c116 0 2024-05-09T06:29:43.046 INFO:tasks.workunit.client.1.smithi079.stdout:5/963: mkdir d13/d43/d39/d61/d72/dd7/d11b/d135/d14b 0 2024-05-09T06:29:43.047 INFO:tasks.workunit.client.1.smithi079.stdout:6/904: creat d0/d6/d1b/db8/d119/f12f x:0 0 0 2024-05-09T06:29:43.049 INFO:tasks.workunit.client.1.smithi079.stdout:3/907: creat d1a/d21/db0/dd4/d67/f12d x:0 0 0 2024-05-09T06:29:43.049 INFO:tasks.workunit.client.1.smithi079.stdout:3/908: creat d1a/f12e x:0 0 0 2024-05-09T06:29:43.062 INFO:tasks.workunit.client.1.smithi079.stdout:8/796: dwrite d1/d5/d36/da0/f108 [0,4194304] 0 2024-05-09T06:29:43.063 INFO:tasks.workunit.client.1.smithi079.stdout:5/964: getdents d13/d43/d3d/d40/d53/dad 0 2024-05-09T06:29:43.063 INFO:tasks.workunit.client.1.smithi079.stdout:5/965: fdatasync d13/d43/d51/f10c 0 2024-05-09T06:29:43.066 INFO:tasks.workunit.client.1.smithi079.stdout:6/905: link d0/d6/d1b/l42 d0/d6/d1b/db8/d105/l130 0 2024-05-09T06:29:43.066 INFO:tasks.workunit.client.1.smithi079.stdout:6/906: write d0/d6/d16/d28/f58 [1722220,62253] 0 2024-05-09T06:29:43.066 INFO:tasks.workunit.client.1.smithi079.stdout:6/907: dread - d0/d6/d16/dcd/f109 zero size 2024-05-09T06:29:43.070 INFO:tasks.workunit.client.1.smithi079.stdout:6/908: dread d0/d6/d16/d1f/d6f/d8c/d93/f9e [0,4194304] 0 2024-05-09T06:29:43.073 INFO:tasks.workunit.client.1.smithi079.stdout:8/797: truncate d1/d5/dc/f1b 3316015 0 2024-05-09T06:29:43.073 INFO:tasks.workunit.client.1.smithi079.stdout:8/798: fdatasync d1/d3/d20/f32 0 2024-05-09T06:29:43.076 INFO:tasks.workunit.client.1.smithi079.stdout:5/966: rename d13/l24 to d13/d92/l14c 0 2024-05-09T06:29:43.076 INFO:tasks.workunit.client.1.smithi079.stdout:5/967: chown d13/d43/d26/d35/f100 3761 1 2024-05-09T06:29:43.078 INFO:tasks.workunit.client.1.smithi079.stdout:6/909: creat d0/f131 x:0 0 0 2024-05-09T06:29:43.079 INFO:tasks.workunit.client.1.smithi079.stdout:6/910: stat d0/d60/daf/fd8 0 2024-05-09T06:29:43.080 INFO:tasks.workunit.client.1.smithi079.stdout:0/777: sync 2024-05-09T06:29:43.082 INFO:tasks.workunit.client.1.smithi079.stdout:6/911: write d0/d6/d16/d1f/f25 [2380131,6034] 0 2024-05-09T06:29:43.084 INFO:tasks.workunit.client.1.smithi079.stdout:8/799: link d1/d5/c3e d1/c117 0 2024-05-09T06:29:43.085 INFO:tasks.workunit.client.1.smithi079.stdout:8/800: dread d1/db/f4f [0,4194304] 0 2024-05-09T06:29:43.093 INFO:tasks.workunit.client.1.smithi079.stdout:0/778: mkdir d3/dd/d71/db4/dfc 0 2024-05-09T06:29:43.093 INFO:tasks.workunit.client.1.smithi079.stdout:0/779: write d3/dd/d66/d6d/d74/d84/f95 [698553,130930] 0 2024-05-09T06:29:43.096 INFO:tasks.workunit.client.1.smithi079.stdout:8/801: symlink d1/d5/d36/da0/l118 0 2024-05-09T06:29:43.100 INFO:tasks.workunit.client.1.smithi079.stdout:5/968: rmdir d13/d43/d51 39 2024-05-09T06:29:43.100 INFO:tasks.workunit.client.1.smithi079.stdout:5/969: chown d13/d43/d9e/f132 767 1 2024-05-09T06:29:43.100 INFO:tasks.workunit.client.1.smithi079.stdout:6/912: dwrite d0/d6/d1b/d20/f5a [8388608,4194304] 0 2024-05-09T06:29:43.100 INFO:tasks.workunit.client.1.smithi079.stdout:6/913: write d0/d6/d1b/fa0 [1426253,80187] 0 2024-05-09T06:29:43.111 INFO:tasks.workunit.client.1.smithi079.stdout:8/802: rename d1/d5/d36/d102/dc3/d44/c38 to d1/d5/d36/d102/dc3/d44/de7/d103/c119 0 2024-05-09T06:29:43.114 INFO:tasks.workunit.client.1.smithi079.stdout:5/970: creat d13/d43/d3d/d40/d63/da2/f14d x:0 0 0 2024-05-09T06:29:43.117 INFO:tasks.workunit.client.1.smithi079.stdout:0/780: symlink d3/dd/d1f/d1e/d2c/d35/d36/lfd 0 2024-05-09T06:29:43.117 INFO:tasks.workunit.client.1.smithi079.stdout:0/781: truncate d3/dd/d1f/d1e/d2c/dc0/fc3 1325243 0 2024-05-09T06:29:43.118 INFO:tasks.workunit.client.1.smithi079.stdout:2/929: sync 2024-05-09T06:29:43.118 INFO:tasks.workunit.client.1.smithi079.stdout:0/782: dread d3/dd/d1f/d1e/d2c/dc0/fc3 [0,4194304] 0 2024-05-09T06:29:43.118 INFO:tasks.workunit.client.1.smithi079.stdout:0/783: chown d3/dd/d66/d6d/d74/d80/f32 2187 1 2024-05-09T06:29:43.120 INFO:tasks.workunit.client.1.smithi079.stdout:6/914: dwrite d0/d6/d1b/fa0 [0,4194304] 0 2024-05-09T06:29:43.120 INFO:tasks.workunit.client.1.smithi079.stdout:8/803: symlink d1/d3/dc4/l11a 0 2024-05-09T06:29:43.123 INFO:tasks.workunit.client.1.smithi079.stdout:5/971: symlink d13/d43/d3d/d40/d63/da2/d8b/d110/l14e 0 2024-05-09T06:29:43.124 INFO:tasks.workunit.client.1.smithi079.stdout:5/972: write d13/d43/d39/f147 [140064,121751] 0 2024-05-09T06:29:43.124 INFO:tasks.workunit.client.1.smithi079.stdout:5/973: read d13/d43/d39/d61/f7d [3884957,25110] 0 2024-05-09T06:29:43.127 INFO:tasks.workunit.client.1.smithi079.stdout:0/784: mknod d3/dd/d66/d6d/d74/d80/d2d/d90/cfe 0 2024-05-09T06:29:43.130 INFO:tasks.workunit.client.1.smithi079.stdout:6/915: creat d0/d6/d1b/db8/d105/d10a/f132 x:0 0 0 2024-05-09T06:29:43.130 INFO:tasks.workunit.client.1.smithi079.stdout:6/916: chown d0/d6/d1b/db8/dff 0 1 2024-05-09T06:29:43.134 INFO:tasks.workunit.client.1.smithi079.stdout:5/974: link d13/da5/de4/d101/f10e d13/d4f/d126/f14f 0 2024-05-09T06:29:43.137 INFO:tasks.workunit.client.1.smithi079.stdout:0/785: mknod d3/dd/d66/cff 0 2024-05-09T06:29:43.138 INFO:tasks.workunit.client.1.smithi079.stdout:2/930: dwrite d8/db/d11/f2f [4194304,4194304] 0 2024-05-09T06:29:43.139 INFO:tasks.workunit.client.1.smithi079.stdout:1/872: rmdir d0/d12/d92 39 2024-05-09T06:29:43.139 INFO:tasks.workunit.client.1.smithi079.stdout:0/786: dread d3/dd/d1f/d1e/d2c/d7f/de0/ff1 [0,4194304] 0 2024-05-09T06:29:43.142 INFO:tasks.workunit.client.1.smithi079.stdout:8/804: dwrite d1/d5/d36/da0/ff9 [0,4194304] 0 2024-05-09T06:29:43.142 INFO:tasks.workunit.client.1.smithi079.stdout:8/805: creat d1/d56/d7c/d8f/f11b x:0 0 0 2024-05-09T06:29:43.144 INFO:tasks.workunit.client.1.smithi079.stdout:5/975: unlink d13/d43/d3d/d40/d63/f8c 0 2024-05-09T06:29:43.146 INFO:tasks.workunit.client.1.smithi079.stdout:5/976: dread d13/d43/d3d/d40/d63/f111 [0,4194304] 0 2024-05-09T06:29:43.146 INFO:tasks.workunit.client.1.smithi079.stdout:5/977: creat d13/d43/d3d/d40/d63/da2/d8b/d110/d124/f150 x:0 0 0 2024-05-09T06:29:43.146 INFO:tasks.workunit.client.1.smithi079.stdout:5/978: chown d13/d92/dcd/f115 32101502 1 2024-05-09T06:29:43.148 INFO:tasks.workunit.client.1.smithi079.stdout:2/931: mknod d8/db/d59/d67/d7f/db9/dca/c14d 0 2024-05-09T06:29:43.151 INFO:tasks.workunit.client.1.smithi079.stdout:1/873: unlink d0/d12/d67/d53/dbf/dd2/f7b 0 2024-05-09T06:29:43.151 INFO:tasks.workunit.client.1.smithi079.stdout:1/874: creat d0/d12/dc0/dd4/f12e x:0 0 0 2024-05-09T06:29:43.153 INFO:tasks.workunit.client.1.smithi079.stdout:6/917: dwrite d0/d6/d16/dcd/dce/fa4 [0,4194304] 0 2024-05-09T06:29:43.154 INFO:tasks.workunit.client.1.smithi079.stdout:0/787: symlink d3/dd/d71/db4/l100 0 2024-05-09T06:29:43.158 INFO:tasks.workunit.client.1.smithi079.stdout:8/806: creat d1/d5/d36/d102/f11c x:0 0 0 2024-05-09T06:29:43.163 INFO:tasks.workunit.client.1.smithi079.stdout:5/979: mkdir d13/d92/dcd/dcf/d151 0 2024-05-09T06:29:43.163 INFO:tasks.workunit.client.1.smithi079.stdout:5/980: write d13/d43/d3d/d40/d63/f141 [229080,67018] 0 2024-05-09T06:29:43.163 INFO:tasks.workunit.client.1.smithi079.stdout:5/981: write d13/f145 [135001,82984] 0 2024-05-09T06:29:43.164 INFO:tasks.workunit.client.1.smithi079.stdout:6/918: dread d0/d6/d1b/d20/dac/f104 [0,4194304] 0 2024-05-09T06:29:43.165 INFO:tasks.workunit.client.1.smithi079.stdout:2/932: mkdir d8/db/d14e 0 2024-05-09T06:29:43.169 INFO:tasks.workunit.client.1.smithi079.stdout:1/875: rename d0/d12/d48/d75/d43/d70 to d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/d12f 0 2024-05-09T06:29:43.170 INFO:tasks.workunit.client.1.smithi079.stdout:4/934: rmdir d6/d12b 39 2024-05-09T06:29:43.189 INFO:tasks.workunit.client.1.smithi079.stdout:0/788: mkdir d3/dd/d66/d6d/d74/d80/d2d/da7/dce/d101 0 2024-05-09T06:29:43.189 INFO:tasks.workunit.client.1.smithi079.stdout:0/789: stat d3/dd/d71/ff0 0 2024-05-09T06:29:43.192 INFO:tasks.workunit.client.1.smithi079.stdout:2/933: dwrite d8/db/d4b/d4f/d51/d6f/f7b [4194304,4194304] 0 2024-05-09T06:29:43.193 INFO:tasks.workunit.client.1.smithi079.stdout:1/876: mknod d0/d12/d48/d75/c130 0 2024-05-09T06:29:43.193 INFO:tasks.workunit.client.1.smithi079.stdout:1/877: chown d0/d12/d48/d75/d43/d20/ffa 754771 1 2024-05-09T06:29:43.195 INFO:tasks.workunit.client.1.smithi079.stdout:4/935: symlink d6/d8/d80/da6/l131 0 2024-05-09T06:29:43.196 INFO:tasks.workunit.client.1.smithi079.stdout:4/936: creat d6/d1a/f132 x:0 0 0 2024-05-09T06:29:43.196 INFO:tasks.workunit.client.1.smithi079.stdout:5/982: dwrite d13/d43/d39/d61/d72/fb2 [4194304,4194304] 0 2024-05-09T06:29:43.197 INFO:tasks.workunit.client.1.smithi079.stdout:6/919: dwrite d0/d6/d1b/d20/d10d/f10f [0,4194304] 0 2024-05-09T06:29:43.197 INFO:tasks.workunit.client.1.smithi079.stdout:5/983: read d13/d43/f81 [182256,50466] 0 2024-05-09T06:29:43.197 INFO:tasks.workunit.client.1.smithi079.stdout:0/790: creat d3/dd/d66/de9/f102 x:0 0 0 2024-05-09T06:29:43.201 INFO:tasks.workunit.client.1.smithi079.stdout:1/878: link d0/d12/d48/d75/d43/d20/c45 d0/d12/d67/d93/c131 0 2024-05-09T06:29:43.213 INFO:tasks.workunit.client.1.smithi079.stdout:2/934: dwrite d8/db/d11/d5f/f75 [4194304,4194304] 0 2024-05-09T06:29:43.215 INFO:tasks.workunit.client.1.smithi079.stdout:6/920: getdents d0/d60/d8e 0 2024-05-09T06:29:43.215 INFO:tasks.workunit.client.1.smithi079.stdout:6/921: write d0/d6/d16/f92 [1085100,61946] 0 2024-05-09T06:29:43.215 INFO:tasks.workunit.client.1.smithi079.stdout:5/984: dwrite d13/d43/d39/d61/f7d [0,4194304] 0 2024-05-09T06:29:43.215 INFO:tasks.workunit.client.1.smithi079.stdout:5/985: chown d13/d43/f81 3786130 1 2024-05-09T06:29:43.217 INFO:tasks.workunit.client.1.smithi079.stdout:0/791: truncate d3/dd/d18/f7a 193684 0 2024-05-09T06:29:43.219 INFO:tasks.workunit.client.1.smithi079.stdout:0/792: read d3/fb5 [264119,122618] 0 2024-05-09T06:29:43.219 INFO:tasks.workunit.client.1.smithi079.stdout:1/879: rmdir d0/d12 39 2024-05-09T06:29:43.220 INFO:tasks.workunit.client.1.smithi079.stdout:4/937: mknod d6/d8/c133 0 2024-05-09T06:29:43.226 INFO:tasks.workunit.client.1.smithi079.stdout:2/935: link d8/db/d11/d5f/d130/d88/f116 d8/db/d59/d127/f14f 0 2024-05-09T06:29:43.228 INFO:tasks.workunit.client.1.smithi079.stdout:0/793: dread d3/dd/d1f/d1e/d2c/d35/d36/f4c [0,4194304] 0 2024-05-09T06:29:43.229 INFO:tasks.workunit.client.1.smithi079.stdout:5/986: rmdir d13/d43/d3d/d40/d9a/dd2/d11a 39 2024-05-09T06:29:43.229 INFO:tasks.workunit.client.1.smithi079.stdout:5/987: creat d13/da5/f152 x:0 0 0 2024-05-09T06:29:43.231 INFO:tasks.workunit.client.1.smithi079.stdout:6/922: dwrite d0/d6/d1b/d2d/feb [0,4194304] 0 2024-05-09T06:29:43.231 INFO:tasks.workunit.client.1.smithi079.stdout:1/880: mknod d0/d12/d67/db6/d8a/dc3/c132 0 2024-05-09T06:29:43.231 INFO:tasks.workunit.client.1.smithi079.stdout:1/881: write d0/d12/d92/f9a [5145557,113839] 0 2024-05-09T06:29:43.233 INFO:tasks.workunit.client.1.smithi079.stdout:4/938: mkdir d6/d1a/d26/d2a/dde/df1/d134 0 2024-05-09T06:29:43.233 INFO:tasks.workunit.client.1.smithi079.stdout:4/939: dread - d6/d8/d27/d3d/f12a zero size 2024-05-09T06:29:43.233 INFO:tasks.workunit.client.1.smithi079.stdout:4/940: chown d6/d1a/d41/f104 52940125 1 2024-05-09T06:29:43.235 INFO:tasks.workunit.client.1.smithi079.stdout:2/936: rename d8/db/d4b/d4f/d51/d6d/c98 to d8/db/d5c/d6b/c150 0 2024-05-09T06:29:43.237 INFO:tasks.workunit.client.1.smithi079.stdout:0/794: truncate d3/dd/d66/d6d/d74/d80/d2d/da7/dce/fd6 792339 0 2024-05-09T06:29:43.243 INFO:tasks.workunit.client.1.smithi079.stdout:5/988: unlink d13/f145 0 2024-05-09T06:29:43.243 INFO:tasks.workunit.client.1.smithi079.stdout:5/989: fsync d13/d43/d3d/d40/d9a/dd2/f148 0 2024-05-09T06:29:43.243 INFO:tasks.workunit.client.1.smithi079.stdout:5/990: write d13/d43/d3d/d40/d63/da2/d8b/d110/f131 [349093,76891] 0 2024-05-09T06:29:43.250 INFO:tasks.workunit.client.1.smithi079.stdout:6/923: creat d0/d6/d16/d1f/f133 x:0 0 0 2024-05-09T06:29:43.250 INFO:tasks.workunit.client.1.smithi079.stdout:6/924: readlink d0/d6/d1b/d20/l2c 0 2024-05-09T06:29:43.254 INFO:tasks.workunit.client.1.smithi079.stdout:1/882: mknod d0/d12/d48/d75/d43/c133 0 2024-05-09T06:29:43.254 INFO:tasks.workunit.client.1.smithi079.stdout:0/795: dwrite d3/f4 [4194304,4194304] 0 2024-05-09T06:29:43.259 INFO:tasks.workunit.client.1.smithi079.stdout:4/941: unlink d6/d15/c79 0 2024-05-09T06:29:43.259 INFO:tasks.workunit.client.1.smithi079.stdout:2/937: mknod d8/db/d5c/d6b/db5/c151 0 2024-05-09T06:29:43.260 INFO:tasks.workunit.client.1.smithi079.stdout:5/991: rename d13/d4f/l91 to d13/d43/d39/d61/l153 0 2024-05-09T06:29:43.261 INFO:tasks.workunit.client.1.smithi079.stdout:5/992: chown d13/d43/d3d/d40/d9a/df8/l11f 554740 1 2024-05-09T06:29:43.262 INFO:tasks.workunit.client.1.smithi079.stdout:6/925: mknod d0/d6/d16/dcd/dd7/c134 0 2024-05-09T06:29:43.263 INFO:tasks.workunit.client.1.smithi079.stdout:6/926: chown d0/da2/ld2 10610476 1 2024-05-09T06:29:43.264 INFO:tasks.workunit.client.1.smithi079.stdout:4/942: dread d6/d1a/d41/fdd [0,4194304] 0 2024-05-09T06:29:43.265 INFO:tasks.workunit.client.1.smithi079.stdout:4/943: stat d6/f61 0 2024-05-09T06:29:43.265 INFO:tasks.workunit.client.1.smithi079.stdout:1/883: symlink d0/d12/d67/db6/de3/l134 0 2024-05-09T06:29:43.269 INFO:tasks.workunit.client.1.smithi079.stdout:0/796: dwrite d3/dd/d66/d6d/fae [0,4194304] 0 2024-05-09T06:29:43.269 INFO:tasks.workunit.client.1.smithi079.stdout:0/797: dread - d3/dd/d66/fe8 zero size 2024-05-09T06:29:43.269 INFO:tasks.workunit.client.1.smithi079.stdout:2/938: rename d8/db/d11/c37 to d8/db/c152 0 2024-05-09T06:29:43.272 INFO:tasks.workunit.client.1.smithi079.stdout:1/884: dread d0/d12/d92/ffe [0,4194304] 0 2024-05-09T06:29:43.274 INFO:tasks.workunit.client.1.smithi079.stdout:6/927: mkdir d0/d60/d135 0 2024-05-09T06:29:43.275 INFO:tasks.workunit.client.1.smithi079.stdout:4/944: link d6/d8/d80/da6/le8 d6/d1a/d26/d2a/d98/l135 0 2024-05-09T06:29:43.283 INFO:tasks.workunit.client.1.smithi079.stdout:0/798: mknod d3/dd/d1f/d1e/d2c/d88/d8e/de3/c103 0 2024-05-09T06:29:43.295 INFO:tasks.workunit.client.1.smithi079.stdout:4/945: creat d6/d8/d55/dd6/f136 x:0 0 0 2024-05-09T06:29:43.295 INFO:tasks.workunit.client.1.smithi079.stdout:1/885: dwrite d0/d12/d67/d53/d6d/fbb [0,4194304] 0 2024-05-09T06:29:43.295 INFO:tasks.workunit.client.1.smithi079.stdout:1/886: read d0/df/f8f [490,44770] 0 2024-05-09T06:29:43.296 INFO:tasks.workunit.client.1.smithi079.stdout:1/887: dread d0/d12/d67/d53/dbf/dd2/fc [0,4194304] 0 2024-05-09T06:29:43.296 INFO:tasks.workunit.client.1.smithi079.stdout:1/888: readlink d0/d12/d67/d53/dbf/dd2/d4e/d7d/l96 0 2024-05-09T06:29:43.301 INFO:tasks.workunit.client.1.smithi079.stdout:6/928: dread d0/d6/d16/f3b [0,4194304] 0 2024-05-09T06:29:43.301 INFO:tasks.workunit.client.1.smithi079.stdout:6/929: creat d0/d6/d16/d1f/d36/d69/f136 x:0 0 0 2024-05-09T06:29:43.301 INFO:tasks.workunit.client.1.smithi079.stdout:6/930: fdatasync d0/de/f1e 0 2024-05-09T06:29:43.301 INFO:tasks.workunit.client.1.smithi079.stdout:5/993: rename d13/f17 to d13/d43/d26/f154 0 2024-05-09T06:29:43.305 INFO:tasks.workunit.client.1.smithi079.stdout:1/889: write d0/d12/d67/db6/f7c [4176369,14981] 0 2024-05-09T06:29:43.308 INFO:tasks.workunit.client.1.smithi079.stdout:4/946: creat d6/d8/f137 x:0 0 0 2024-05-09T06:29:43.309 INFO:tasks.workunit.client.1.smithi079.stdout:4/947: write d6/d8/d27/d3d/d5b/d9a/ff8 [874519,95379] 0 2024-05-09T06:29:43.318 INFO:tasks.workunit.client.1.smithi079.stdout:5/994: unlink d13/d43/d3d/d40/d63/l125 0 2024-05-09T06:29:43.323 INFO:tasks.workunit.client.1.smithi079.stdout:1/890: symlink d0/d12/dc0/l135 0 2024-05-09T06:29:43.325 INFO:tasks.workunit.client.1.smithi079.stdout:4/948: getdents d6/d90 0 2024-05-09T06:29:43.325 INFO:tasks.workunit.client.1.smithi079.stdout:4/949: readlink d6/d1a/d41/l5d 0 2024-05-09T06:29:43.329 INFO:tasks.workunit.client.1.smithi079.stdout:1/891: dread d0/d12/d67/d53/dbf/dd2/d4e/f5d [0,4194304] 0 2024-05-09T06:29:43.338 INFO:tasks.workunit.client.1.smithi079.stdout:6/931: rmdir d0/d6/d1b 39 2024-05-09T06:29:43.342 INFO:tasks.workunit.client.1.smithi079.stdout:5/995: truncate d13/d43/d3d/d40/d9a/df8/f103 3127026 0 2024-05-09T06:29:43.342 INFO:tasks.workunit.client.1.smithi079.stdout:5/996: write d13/d4f/f78 [2923850,77349] 0 2024-05-09T06:29:43.342 INFO:tasks.workunit.client.1.smithi079.stdout:5/997: creat d13/d43/d39/da7/f155 x:0 0 0 2024-05-09T06:29:43.344 INFO:tasks.workunit.client.1.smithi079.stdout:4/950: symlink d6/d1a/d26/d2a/dde/l138 0 2024-05-09T06:29:43.346 INFO:tasks.workunit.client.1.smithi079.stdout:1/892: creat d0/d12/d67/f136 x:0 0 0 2024-05-09T06:29:43.348 INFO:tasks.workunit.client.1.smithi079.stdout:1/893: dread d0/d12/d67/d53/dbf/dd2/fc [0,4194304] 0 2024-05-09T06:29:43.348 INFO:tasks.workunit.client.1.smithi079.stdout:1/894: stat d0/d12/d48/d75/d43/c133 0 2024-05-09T06:29:43.351 INFO:tasks.workunit.client.1.smithi079.stdout:5/998: unlink d13/d4f/l6a 0 2024-05-09T06:29:43.353 INFO:tasks.workunit.client.1.smithi079.stdout:4/951: creat d6/d8/d27/f139 x:0 0 0 2024-05-09T06:29:43.353 INFO:tasks.workunit.client.1.smithi079.stdout:4/952: creat d6/d8/d27/d3d/d5b/f13a x:0 0 0 2024-05-09T06:29:43.353 INFO:tasks.workunit.client.1.smithi079.stdout:4/953: chown d6/d1a/d26/d2a/d54/f70 0 1 2024-05-09T06:29:43.355 INFO:tasks.workunit.client.1.smithi079.stdout:6/932: dwrite d0/d6/d16/d1f/d6f/d8c/d93/f9e [0,4194304] 0 2024-05-09T06:29:43.357 INFO:tasks.workunit.client.1.smithi079.stdout:5/999: unlink d13/d43/d3d/d40/d9a/lc4 0 2024-05-09T06:29:43.357 INFO:tasks.workunit.client.1.smithi079.stdout:6/933: dread d0/d6/d16/d28/f58 [0,4194304] 0 2024-05-09T06:29:43.357 INFO:tasks.workunit.client.1.smithi079.stdout:6/934: dread - d0/d6/d16/d28/f122 zero size 2024-05-09T06:29:43.359 INFO:tasks.workunit.client.1.smithi079.stdout:1/895: dread d0/d12/f1a [0,4194304] 0 2024-05-09T06:29:43.361 INFO:tasks.workunit.client.1.smithi079.stdout:4/954: mknod d6/d8/d27/d3d/d5b/d10c/c13b 0 2024-05-09T06:29:43.363 INFO:tasks.workunit.client.1.smithi079.stdout:1/896: dread d0/d12/d48/d75/d43/d20/d39/f5a [0,4194304] 0 2024-05-09T06:29:43.363 INFO:tasks.workunit.client.1.smithi079.stdout:1/897: write d0/d12/d48/d75/d43/d20/ffa [631265,47763] 0 2024-05-09T06:29:43.363 INFO:tasks.workunit.client.1.smithi079.stdout:1/898: stat d0/d12/dc0 0 2024-05-09T06:29:43.367 INFO:tasks.workunit.client.1.smithi079.stdout:1/899: mknod d0/d12/d67/d93/c137 0 2024-05-09T06:29:43.367 INFO:tasks.workunit.client.1.smithi079.stdout:1/900: write d0/d12/d92/f9a [5493743,88010] 0 2024-05-09T06:29:43.372 INFO:tasks.workunit.client.1.smithi079.stdout:1/901: creat d0/d12/dc0/dd4/df3/f138 x:0 0 0 2024-05-09T06:29:43.375 INFO:tasks.workunit.client.1.smithi079.stdout:4/955: rename d6/d8/d27/d3d/lb0 to d6/d8/l13c 0 2024-05-09T06:29:43.375 INFO:tasks.workunit.client.1.smithi079.stdout:6/935: dwrite d0/d6/d16/dcd/dce/f98 [0,4194304] 0 2024-05-09T06:29:43.377 INFO:tasks.workunit.client.1.smithi079.stdout:4/956: mknod d6/d8/d27/d3d/d5b/db4/c13d 0 2024-05-09T06:29:43.378 INFO:tasks.workunit.client.1.smithi079.stdout:4/957: chown d6/d1a/la0 1 1 2024-05-09T06:29:43.382 INFO:tasks.workunit.client.1.smithi079.stdout:4/958: symlink d6/d90/l13e 0 2024-05-09T06:29:43.384 INFO:tasks.workunit.client.1.smithi079.stdout:7/767: sync 2024-05-09T06:29:43.384 INFO:tasks.workunit.client.1.smithi079.stdout:3/909: sync 2024-05-09T06:29:43.384 INFO:tasks.workunit.client.1.smithi079.stdout:3/910: readlink d1a/d21/db0/dd4/d34/d59/l6e 0 2024-05-09T06:29:43.385 INFO:tasks.workunit.client.1.smithi079.stdout:6/936: getdents d0/d6/d5e/df6 0 2024-05-09T06:29:43.385 INFO:tasks.workunit.client.1.smithi079.stdout:6/937: chown d0/d60/daf/ff4 6153 1 2024-05-09T06:29:43.386 INFO:tasks.workunit.client.1.smithi079.stdout:1/902: dwrite d0/df/f62 [0,4194304] 0 2024-05-09T06:29:43.386 INFO:tasks.workunit.client.1.smithi079.stdout:1/903: chown d0/d12/dc0/dd4/df3/fdd 0 1 2024-05-09T06:29:43.386 INFO:tasks.workunit.client.1.smithi079.stdout:4/959: mknod d6/d8/d27/d3d/d5b/d9a/d8b/daa/d10b/c13f 0 2024-05-09T06:29:43.386 INFO:tasks.workunit.client.1.smithi079.stdout:4/960: write d6/d8/d27/d3d/d5b/db4/ff6 [693759,83726] 0 2024-05-09T06:29:43.388 INFO:tasks.workunit.client.1.smithi079.stdout:7/768: truncate d4/d7/d37/d7c/d8e/fb1 2417082 0 2024-05-09T06:29:43.391 INFO:tasks.workunit.client.1.smithi079.stdout:6/938: mknod d0/d6/d16/d1f/d36/d69/def/c137 0 2024-05-09T06:29:43.393 INFO:tasks.workunit.client.1.smithi079.stdout:1/904: mkdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6/d139 0 2024-05-09T06:29:43.395 INFO:tasks.workunit.client.1.smithi079.stdout:4/961: symlink d6/d8/d27/d3d/d5b/d9a/d8b/daa/d10b/l140 0 2024-05-09T06:29:43.398 INFO:tasks.workunit.client.1.smithi079.stdout:0/799: rmdir d3/dd/d66/de9 39 2024-05-09T06:29:43.398 INFO:tasks.workunit.client.1.smithi079.stdout:3/911: dwrite d1a/d1c/d22/d90/db8/fd7 [0,4194304] 0 2024-05-09T06:29:43.398 INFO:tasks.workunit.client.1.smithi079.stdout:3/912: write f11 [1303956,95218] 0 2024-05-09T06:29:43.398 INFO:tasks.workunit.client.1.smithi079.stdout:3/913: chown d1a/d21/db0/dd4/d34/la3 1309215 1 2024-05-09T06:29:43.399 INFO:tasks.workunit.client.1.smithi079.stdout:6/939: dread d0/d6/d1b/d20/dac/dc2/fc8 [0,4194304] 0 2024-05-09T06:29:43.400 INFO:tasks.workunit.client.1.smithi079.stdout:6/940: dread - d0/d60/fb9 zero size 2024-05-09T06:29:43.408 INFO:tasks.workunit.client.1.smithi079.stdout:0/800: mkdir d3/d104 0 2024-05-09T06:29:43.410 INFO:tasks.workunit.client.1.smithi079.stdout:3/914: creat d1a/d21/db0/dd4/d3a/da4/df0/d118/f12f x:0 0 0 2024-05-09T06:29:43.411 INFO:tasks.workunit.client.1.smithi079.stdout:3/915: chown d1a/d82/d87/db2/ddb/de9/lfd 40 1 2024-05-09T06:29:43.411 INFO:tasks.workunit.client.1.smithi079.stdout:3/916: read - d1a/d21/f98 zero size 2024-05-09T06:29:43.415 INFO:tasks.workunit.client.1.smithi079.stdout:6/941: dread d0/d60/f6c [0,4194304] 0 2024-05-09T06:29:43.416 INFO:tasks.workunit.client.1.smithi079.stdout:6/942: truncate d0/de/f48 5293497 0 2024-05-09T06:29:43.416 INFO:tasks.workunit.client.1.smithi079.stdout:8/807: dwrite d1/d3/dc4/fe3 [0,4194304] 0 2024-05-09T06:29:43.425 INFO:tasks.workunit.client.1.smithi079.stdout:0/801: dwrite d3/fb5 [0,4194304] 0 2024-05-09T06:29:43.430 INFO:tasks.workunit.client.1.smithi079.stdout:0/802: dread d3/dd/d66/d6d/fa2 [0,4194304] 0 2024-05-09T06:29:43.437 INFO:tasks.workunit.client.1.smithi079.stdout:3/917: creat d1a/d21/db0/dd4/d3a/d121/f130 x:0 0 0 2024-05-09T06:29:43.439 INFO:tasks.workunit.client.1.smithi079.stdout:6/943: creat d0/d60/d81/f138 x:0 0 0 2024-05-09T06:29:43.445 INFO:tasks.workunit.client.1.smithi079.stdout:8/808: unlink d1/db/daf/d66/d6c/d6b/f98 0 2024-05-09T06:29:43.446 INFO:tasks.workunit.client.1.smithi079.stdout:6/944: write d0/d6/d5e/fec [3874591,126479] 0 2024-05-09T06:29:43.446 INFO:tasks.workunit.client.1.smithi079.stdout:8/809: dread d1/d5/d36/d102/dc3/f9f [4194304,4194304] 0 2024-05-09T06:29:43.450 INFO:tasks.workunit.client.1.smithi079.stdout:0/803: creat d3/dd/d66/d6d/d74/d80/d76/dcc/f105 x:0 0 0 2024-05-09T06:29:43.452 INFO:tasks.workunit.client.1.smithi079.stdout:0/804: write d3/dd/d71/db4/ff2 [556608,49641] 0 2024-05-09T06:29:43.457 INFO:tasks.workunit.client.1.smithi079.stdout:6/945: link d0/d6/d16/d1f/d36/d69/cb7 d0/d60/d8e/d102/c139 0 2024-05-09T06:29:43.463 INFO:tasks.workunit.client.1.smithi079.stdout:8/810: mkdir d1/d5/d36/d102/dc3/d44/de7/d11d 0 2024-05-09T06:29:43.463 INFO:tasks.workunit.client.1.smithi079.stdout:8/811: chown d1/d5/d36/d102/dc3/d44/c10b 23924629 1 2024-05-09T06:29:43.463 INFO:tasks.workunit.client.1.smithi079.stdout:8/812: dread d1/d5/d36/d102/dc3/d44/da4/fd5 [0,4194304] 0 2024-05-09T06:29:43.463 INFO:tasks.workunit.client.1.smithi079.stdout:8/813: dread d1/d56/d7c/f89 [0,4194304] 0 2024-05-09T06:29:43.463 INFO:tasks.workunit.client.1.smithi079.stdout:8/814: fdatasync d1/d5/dc/ffb 0 2024-05-09T06:29:43.465 INFO:tasks.workunit.client.1.smithi079.stdout:3/918: rmdir d1a/d1c/d22/d90/db8 39 2024-05-09T06:29:43.465 INFO:tasks.workunit.client.1.smithi079.stdout:3/919: stat d1a/d1c/d22/d53/d4e/f5b 0 2024-05-09T06:29:43.465 INFO:tasks.workunit.client.1.smithi079.stdout:3/920: getdents d1a/d21/db0/dd4/d67/d10a 0 2024-05-09T06:29:43.468 INFO:tasks.workunit.client.1.smithi079.stdout:6/946: mknod d0/d60/c13a 0 2024-05-09T06:29:43.470 INFO:tasks.workunit.client.0.smithi062.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-09T06:29:43.470 INFO:tasks.workunit.client.0.smithi062.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T06:29:43.470 INFO:tasks.workunit.client.0.smithi062.stderr:+ make 2024-05-09T06:29:43.481 INFO:tasks.workunit.client.1.smithi079.stdout:8/815: mkdir d1/d5/d36/dae/d11e 0 2024-05-09T06:29:43.482 INFO:tasks.workunit.client.1.smithi079.stdout:3/921: creat d1a/d82/d87/f131 x:0 0 0 2024-05-09T06:29:43.485 INFO:tasks.workunit.client.1.smithi079.stdout:6/947: rename d0/d6/d16/d1f/f25 to d0/d60/d118/f13b 0 2024-05-09T06:29:43.485 INFO:tasks.workunit.client.1.smithi079.stdout:6/948: readlink d0/d6/d16/dcd/dce/la8 0 2024-05-09T06:29:43.485 INFO:tasks.workunit.client.1.smithi079.stdout:6/949: write d0/d6/d16/d28/f73 [678462,104941] 0 2024-05-09T06:29:43.490 INFO:tasks.workunit.client.1.smithi079.stdout:3/922: mkdir d1a/d21/db0/dd4/d3a/d121/d132 0 2024-05-09T06:29:43.490 INFO:tasks.workunit.client.1.smithi079.stdout:3/923: creat d1a/d1c/d22/d53/d4e/dc3/dd8/f133 x:0 0 0 2024-05-09T06:29:43.494 INFO:tasks.workunit.client.1.smithi079.stdout:8/816: rmdir d1/d56 39 2024-05-09T06:29:43.499 INFO:tasks.workunit.client.1.smithi079.stdout:3/924: creat d1a/dcc/f134 x:0 0 0 2024-05-09T06:29:43.500 INFO:tasks.workunit.client.1.smithi079.stdout:8/817: dread d1/d5/d36/f70 [0,4194304] 0 2024-05-09T06:29:43.504 INFO:tasks.workunit.client.1.smithi079.stdout:6/950: dwrite d0/de/f124 [0,4194304] 0 2024-05-09T06:29:43.504 INFO:tasks.workunit.client.1.smithi079.stdout:6/951: creat d0/d60/daf/f13c x:0 0 0 2024-05-09T06:29:43.504 INFO:tasks.workunit.client.1.smithi079.stdout:6/952: creat d0/de/f13d x:0 0 0 2024-05-09T06:29:43.504 INFO:tasks.workunit.client.1.smithi079.stdout:8/818: rename d1/d56/d7c/d8f/fee to d1/d3/d20/f11f 0 2024-05-09T06:29:43.505 INFO:tasks.workunit.client.1.smithi079.stdout:3/925: dread d1a/d1c/d1f/f68 [0,4194304] 0 2024-05-09T06:29:43.505 INFO:tasks.workunit.client.1.smithi079.stdout:3/926: getdents d1a/d21/db0/dd4/d3a/d121/d132 0 2024-05-09T06:29:43.513 INFO:tasks.workunit.client.1.smithi079.stdout:6/953: rmdir d0/d6/d16/dcd 39 2024-05-09T06:29:43.513 INFO:tasks.workunit.client.1.smithi079.stdout:6/954: creat d0/de/f13e x:0 0 0 2024-05-09T06:29:43.515 INFO:tasks.workunit.client.1.smithi079.stdout:8/819: creat d1/d5/f120 x:0 0 0 2024-05-09T06:29:43.523 INFO:tasks.workunit.client.1.smithi079.stdout:3/927: dread d1a/d21/f70 [0,4194304] 0 2024-05-09T06:29:43.527 INFO:tasks.workunit.client.1.smithi079.stdout:6/955: mknod d0/d6/d16/d1f/d36/d69/def/c13f 0 2024-05-09T06:29:43.527 INFO:tasks.workunit.client.1.smithi079.stdout:6/956: write d0/de/f10b [620629,68388] 0 2024-05-09T06:29:43.527 INFO:tasks.workunit.client.1.smithi079.stdout:6/957: chown d0/d6/d16/d1f/d36/fdf 1996331 1 2024-05-09T06:29:43.527 INFO:tasks.workunit.client.1.smithi079.stdout:6/958: creat d0/d6/d16/d1f/d36/d69/f140 x:0 0 0 2024-05-09T06:29:43.527 INFO:tasks.workunit.client.1.smithi079.stdout:6/959: dread - d0/de/f13d zero size 2024-05-09T06:29:43.528 INFO:tasks.workunit.client.1.smithi079.stdout:3/928: truncate d1a/d21/db0/dd4/d3a/d54/d55/f113 3747786 0 2024-05-09T06:29:43.530 INFO:tasks.workunit.client.1.smithi079.stdout:6/960: creat d0/d60/d8e/f141 x:0 0 0 2024-05-09T06:29:43.533 INFO:tasks.workunit.client.1.smithi079.stdout:3/929: link d1a/d21/db0/dd4/d3a/d7c/fa9 d1a/d1c/d22/f135 0 2024-05-09T06:29:43.535 INFO:tasks.workunit.client.1.smithi079.stdout:6/961: chown d0/d6/d16/d1f/d6f/lb0 2993 1 2024-05-09T06:29:43.535 INFO:tasks.workunit.client.1.smithi079.stdout:6/962: chown d0/d6/d16/d1f/d36/d69/c11e 1349 1 2024-05-09T06:29:43.535 INFO:tasks.workunit.client.1.smithi079.stdout:6/963: write d0/d6/d16/d1f/f49 [431329,130169] 0 2024-05-09T06:29:43.536 INFO:tasks.workunit.client.1.smithi079.stdout:7/769: write d4/d7/dd/d5b/f3a [2458165,28330] 0 2024-05-09T06:29:43.536 INFO:tasks.workunit.client.1.smithi079.stdout:7/770: chown d4/d20 5047945 1 2024-05-09T06:29:43.539 INFO:tasks.workunit.client.1.smithi079.stdout:6/964: rename d0/de/f3a to d0/da2/db2/f142 0 2024-05-09T06:29:43.541 INFO:tasks.workunit.client.1.smithi079.stdout:7/771: rename d4/d7/d37/d7c/feb to d4/d7/d78/fef 0 2024-05-09T06:29:43.542 INFO:tasks.workunit.client.1.smithi079.stdout:3/930: dread d1a/d1c/d1f/f56 [4194304,4194304] 0 2024-05-09T06:29:43.543 INFO:tasks.workunit.client.1.smithi079.stdout:6/965: mknod d0/d6/d16/d1f/d36/d69/c143 0 2024-05-09T06:29:43.545 INFO:tasks.workunit.client.1.smithi079.stdout:6/966: rename d0/d6/d1b/db8/fe5 to d0/d6/d16/d1f/d36/d69/def/f144 0 2024-05-09T06:29:43.547 INFO:tasks.workunit.client.1.smithi079.stdout:4/962: rmdir d6/d8/d27/d3d/d5b 39 2024-05-09T06:29:43.550 INFO:tasks.workunit.client.1.smithi079.stdout:6/967: rename d0/d6/d16/d1f/d6f/d8c/d93/fe0 to d0/d6/d1b/db8/f145 0 2024-05-09T06:29:43.551 INFO:tasks.workunit.client.1.smithi079.stdout:6/968: creat d0/d60/d8e/f146 x:0 0 0 2024-05-09T06:29:43.551 INFO:tasks.workunit.client.1.smithi079.stdout:6/969: dread d0/d6/d16/d1f/f90 [0,4194304] 0 2024-05-09T06:29:43.555 INFO:tasks.workunit.client.1.smithi079.stdout:4/963: rmdir d6/d8/d27/d3d 39 2024-05-09T06:29:43.557 INFO:tasks.workunit.client.1.smithi079.stdout:3/931: dwrite d1a/d1c/d22/d90/db8/fd7 [0,4194304] 0 2024-05-09T06:29:43.562 INFO:tasks.workunit.client.1.smithi079.stdout:3/932: read d1a/d1c/d22/d53/d4e/fe3 [3451607,73991] 0 2024-05-09T06:29:43.562 INFO:tasks.workunit.client.1.smithi079.stdout:3/933: creat d1a/d21/f136 x:0 0 0 2024-05-09T06:29:43.562 INFO:tasks.workunit.client.1.smithi079.stdout:3/934: getdents d1a/d1c/d22/d53/d4e/de4 0 2024-05-09T06:29:43.562 INFO:tasks.workunit.client.1.smithi079.stdout:3/935: truncate f5 4864883 0 2024-05-09T06:29:43.562 INFO:tasks.workunit.client.1.smithi079.stdout:3/936: write d1a/d1c/d22/d53/d4e/f5b [4296971,116774] 0 2024-05-09T06:29:43.569 INFO:tasks.workunit.client.1.smithi079.stdout:3/937: dread d1a/d21/db0/dd4/d34/d42/fc9 [0,4194304] 0 2024-05-09T06:29:43.570 INFO:tasks.workunit.client.1.smithi079.stdout:3/938: mkdir d1a/dcc/d137 0 2024-05-09T06:29:43.572 INFO:tasks.workunit.client.1.smithi079.stdout:3/939: rename d1a/d21/db0/dd4/d34/d42/fde to d1a/dcc/d137/f138 0 2024-05-09T06:29:43.572 INFO:tasks.workunit.client.1.smithi079.stdout:3/940: dread - d1a/d1c/fee zero size 2024-05-09T06:29:43.576 INFO:tasks.workunit.client.1.smithi079.stdout:8/820: rmdir d1/db/daf/d66/d6c 39 2024-05-09T06:29:43.578 INFO:tasks.workunit.client.1.smithi079.stdout:8/821: symlink d1/d56/l121 0 2024-05-09T06:29:43.578 INFO:tasks.workunit.client.1.smithi079.stdout:8/822: chown d1/d5/cf2 24565340 1 2024-05-09T06:29:43.578 INFO:tasks.workunit.client.1.smithi079.stdout:8/823: readlink d1/d56/d7c/l109 0 2024-05-09T06:29:43.579 INFO:tasks.workunit.client.1.smithi079.stdout:6/970: dwrite d0/d6/d16/d1f/f41 [0,4194304] 0 2024-05-09T06:29:43.580 INFO:tasks.workunit.client.1.smithi079.stdout:4/964: dwrite d6/d8/d27/d3d/d5b/d9a/f86 [0,4194304] 0 2024-05-09T06:29:43.581 INFO:tasks.workunit.client.1.smithi079.stdout:0/805: rmdir d3/dd/d66/d6d 39 2024-05-09T06:29:43.581 INFO:tasks.workunit.client.1.smithi079.stdout:0/806: creat d3/dd/d1f/d1e/d2c/d88/d8e/de3/f106 x:0 0 0 2024-05-09T06:29:43.583 INFO:tasks.workunit.client.1.smithi079.stdout:4/965: creat d6/d1a/d26/dd3/f141 x:0 0 0 2024-05-09T06:29:43.584 INFO:tasks.workunit.client.1.smithi079.stdout:3/941: dread d1a/f9b [0,4194304] 0 2024-05-09T06:29:43.584 INFO:tasks.workunit.client.1.smithi079.stdout:3/942: readlink d1a/d21/db0/dd4/d3a/d54/lb6 0 2024-05-09T06:29:43.586 INFO:tasks.workunit.client.1.smithi079.stdout:4/966: symlink d6/l142 0 2024-05-09T06:29:43.586 INFO:tasks.workunit.client.1.smithi079.stdout:4/967: truncate d6/d1a/f75 4584893 0 2024-05-09T06:29:43.587 INFO:tasks.workunit.client.1.smithi079.stdout:4/968: readlink d6/d1a/d26/d2a/l67 0 2024-05-09T06:29:43.587 INFO:tasks.workunit.client.1.smithi079.stdout:6/971: dread d0/d6/d1b/d2d/feb [0,4194304] 0 2024-05-09T06:29:43.588 INFO:tasks.workunit.client.1.smithi079.stdout:3/943: mkdir d1a/d21/db0/dd4/d3a/d121/dc5/df4/d139 0 2024-05-09T06:29:43.590 INFO:tasks.workunit.client.1.smithi079.stdout:6/972: rmdir d0/d6/d1b/d20 39 2024-05-09T06:29:43.592 INFO:tasks.workunit.client.1.smithi079.stdout:3/944: unlink d1a/d21/db0/dd4/d67/f12d 0 2024-05-09T06:29:43.593 INFO:tasks.workunit.client.1.smithi079.stdout:4/969: dread d6/d1a/fa5 [0,4194304] 0 2024-05-09T06:29:43.593 INFO:tasks.workunit.client.1.smithi079.stdout:4/970: fsync d6/d8/d27/d3d/d5b/d9a/d8b/f9c 0 2024-05-09T06:29:43.595 INFO:tasks.workunit.client.1.smithi079.stdout:6/973: mknod d0/da2/db2/c147 0 2024-05-09T06:29:43.595 INFO:tasks.workunit.client.1.smithi079.stdout:6/974: truncate d0/d6/d1b/d20/f100 416326 0 2024-05-09T06:29:43.595 INFO:tasks.workunit.client.1.smithi079.stdout:3/945: creat d1a/d21/db0/dd4/d67/f13a x:0 0 0 2024-05-09T06:29:43.596 INFO:tasks.workunit.client.1.smithi079.stdout:4/971: mkdir d6/d1a/d26/d2a/dde/df1/df3/d143 0 2024-05-09T06:29:43.597 INFO:tasks.workunit.client.1.smithi079.stdout:6/975: symlink d0/d6/d16/dcd/dd7/l148 0 2024-05-09T06:29:43.597 INFO:tasks.workunit.client.1.smithi079.stdout:6/976: fsync d0/de/f48 0 2024-05-09T06:29:43.600 INFO:tasks.workunit.client.1.smithi079.stdout:4/972: creat d6/d8/d55/d129/f144 x:0 0 0 2024-05-09T06:29:43.600 INFO:tasks.workunit.client.1.smithi079.stdout:4/973: read d6/d8/d55/f74 [46465,19243] 0 2024-05-09T06:29:43.600 INFO:tasks.workunit.client.1.smithi079.stdout:4/974: chown d6/d1a/d26/d2a/dde/df1/d105 867616033 1 2024-05-09T06:29:43.601 INFO:tasks.workunit.client.1.smithi079.stdout:6/977: symlink d0/de/d110/l149 0 2024-05-09T06:29:43.601 INFO:tasks.workunit.client.1.smithi079.stdout:6/978: stat d0/de/c21 0 2024-05-09T06:29:43.608 INFO:tasks.workunit.client.1.smithi079.stdout:8/824: dwrite d1/db/daf/d66/d6c/dbf/dc9/fd9 [0,4194304] 0 2024-05-09T06:29:43.611 INFO:tasks.workunit.client.1.smithi079.stdout:0/807: dwrite d3/dd/d1f/d1e/d2c/d88/d8e/de3/f106 [0,4194304] 0 2024-05-09T06:29:43.615 INFO:tasks.workunit.client.1.smithi079.stdout:0/808: link d3/dd/d66/d6d/d74/d80/d2d/f2e d3/dd/d1f/d1e/d2c/d7f/de0/f107 0 2024-05-09T06:29:43.615 INFO:tasks.workunit.client.1.smithi079.stdout:0/809: chown d3/dd/d1f/d1e/d2c/ff5 197 1 2024-05-09T06:29:43.619 INFO:tasks.workunit.client.1.smithi079.stdout:2/939: sync 2024-05-09T06:29:43.619 INFO:tasks.workunit.client.1.smithi079.stdout:1/905: sync 2024-05-09T06:29:43.620 INFO:tasks.workunit.client.1.smithi079.stdout:2/940: creat d8/db/d11/d5f/f153 x:0 0 0 2024-05-09T06:29:43.623 INFO:tasks.workunit.client.1.smithi079.stdout:2/941: rename d8/db/d59/f11f to d8/db/d59/d67/d86/f154 0 2024-05-09T06:29:43.623 INFO:tasks.workunit.client.1.smithi079.stdout:2/942: truncate d8/db/dc/d2c/f31 5053105 0 2024-05-09T06:29:43.623 INFO:tasks.workunit.client.1.smithi079.stdout:2/943: truncate d8/db/d59/d93/dc7/dd9/f12e 542302 0 2024-05-09T06:29:43.623 INFO:tasks.workunit.client.1.smithi079.stdout:2/944: creat d8/d12f/f155 x:0 0 0 2024-05-09T06:29:43.626 INFO:tasks.workunit.client.1.smithi079.stdout:3/946: dwrite d1a/d1c/d22/fc8 [0,4194304] 0 2024-05-09T06:29:43.630 INFO:tasks.workunit.client.1.smithi079.stdout:0/810: dread d3/dd/d66/d6d/d74/d84/fa3 [0,4194304] 0 2024-05-09T06:29:43.636 INFO:tasks.workunit.client.1.smithi079.stdout:3/947: mkdir d1a/d82/d87/db2/ddb/d13b 0 2024-05-09T06:29:43.638 INFO:tasks.workunit.client.1.smithi079.stdout:0/811: unlink d3/dd/d1f/d1e/d2c/d35/d36/f48 0 2024-05-09T06:29:43.640 INFO:tasks.workunit.client.1.smithi079.stdout:3/948: creat d1a/d21/db0/dd4/d34/d59/dd6/f13c x:0 0 0 2024-05-09T06:29:43.640 INFO:tasks.workunit.client.1.smithi079.stdout:3/949: dread - d1a/d21/db0/dd4/d3a/d7c/fa9 zero size 2024-05-09T06:29:43.641 INFO:tasks.workunit.client.1.smithi079.stdout:0/812: link d3/dd/d1f/d1e/d2c/d35/cbc d3/dd/d66/d6d/d74/d84/db7/c108 0 2024-05-09T06:29:43.641 INFO:tasks.workunit.client.1.smithi079.stdout:4/975: dwrite d6/d8/d27/f139 [0,4194304] 0 2024-05-09T06:29:43.642 INFO:tasks.workunit.client.1.smithi079.stdout:3/950: creat d1a/d1c/d22/d53/d4e/dc3/f13d x:0 0 0 2024-05-09T06:29:43.642 INFO:tasks.workunit.client.1.smithi079.stdout:3/951: fsync d1a/d21/f62 0 2024-05-09T06:29:43.644 INFO:tasks.workunit.client.1.smithi079.stdout:6/979: dwrite d0/d6/d1b/db8/d119/f12f [0,4194304] 0 2024-05-09T06:29:43.644 INFO:tasks.workunit.client.1.smithi079.stdout:6/980: chown d0/d6/f74 57077479 1 2024-05-09T06:29:43.646 INFO:tasks.workunit.client.1.smithi079.stdout:4/976: creat d6/d1a/d26/d2a/d54/dc8/de2/f145 x:0 0 0 2024-05-09T06:29:43.646 INFO:tasks.workunit.client.1.smithi079.stdout:4/977: readlink d6/d1a/d41/d68/da1/dad/lda 0 2024-05-09T06:29:43.646 INFO:tasks.workunit.client.1.smithi079.stdout:4/978: creat d6/d1a/d26/d2a/d98/f146 x:0 0 0 2024-05-09T06:29:43.646 INFO:tasks.workunit.client.1.smithi079.stdout:3/952: stat d1a/d1c/d22/d90/db8/l106 0 2024-05-09T06:29:43.646 INFO:tasks.workunit.client.1.smithi079.stdout:3/953: creat d1a/d21/ddc/d124/f13e x:0 0 0 2024-05-09T06:29:43.649 INFO:tasks.workunit.client.1.smithi079.stdout:6/981: creat d0/d6/d16/f14a x:0 0 0 2024-05-09T06:29:43.650 INFO:tasks.workunit.client.1.smithi079.stdout:0/813: creat d3/dd/d1f/d1e/d2c/d35/d36/d93/f109 x:0 0 0 2024-05-09T06:29:43.650 INFO:tasks.workunit.client.1.smithi079.stdout:0/814: stat d3/dd/d66/d6d 0 2024-05-09T06:29:43.652 INFO:tasks.workunit.client.1.smithi079.stdout:4/979: symlink d6/d8/d27/d3d/d5b/db4/dc3/d11c/l147 0 2024-05-09T06:29:43.653 INFO:tasks.workunit.client.1.smithi079.stdout:1/906: dwrite d0/d12/d48/d75/d43/d20/f5f [4194304,4194304] 0 2024-05-09T06:29:43.653 INFO:tasks.workunit.client.1.smithi079.stdout:8/825: dwrite d1/d3/d20/f7b [0,4194304] 0 2024-05-09T06:29:43.653 INFO:tasks.workunit.client.1.smithi079.stdout:8/826: chown d1/d5/d36/da0/l118 532 1 2024-05-09T06:29:43.653 INFO:tasks.workunit.client.1.smithi079.stdout:8/827: chown d1/ff6 238241 1 2024-05-09T06:29:43.653 INFO:tasks.workunit.client.1.smithi079.stdout:2/945: dwrite d8/db/dc/d2c/d2e/f54 [0,4194304] 0 2024-05-09T06:29:43.654 INFO:tasks.workunit.client.1.smithi079.stdout:6/982: symlink d0/de/d110/l14b 0 2024-05-09T06:29:43.655 INFO:tasks.workunit.client.1.smithi079.stdout:1/907: dread d0/d12/d67/d53/dbf/dd2/d4e/d7d/fb7 [0,4194304] 0 2024-05-09T06:29:43.655 INFO:tasks.workunit.client.1.smithi079.stdout:0/815: mkdir d3/dd/d66/d6d/d74/d80/d2d/da7/dce/d101/d10a 0 2024-05-09T06:29:43.659 INFO:tasks.workunit.client.1.smithi079.stdout:8/828: symlink d1/d5/d36/dae/d11e/l122 0 2024-05-09T06:29:43.660 INFO:tasks.workunit.client.1.smithi079.stdout:8/829: read d1/db/fa9 [2887229,23582] 0 2024-05-09T06:29:43.667 INFO:tasks.workunit.client.1.smithi079.stdout:1/908: dread d0/d12/d48/fe1 [0,4194304] 0 2024-05-09T06:29:43.667 INFO:tasks.workunit.client.1.smithi079.stdout:2/946: creat d8/db/d11/d5f/d11a/f156 x:0 0 0 2024-05-09T06:29:43.667 INFO:tasks.workunit.client.1.smithi079.stdout:2/947: chown d8/db/d11/d5f/f76 2699 1 2024-05-09T06:29:43.667 INFO:tasks.workunit.client.1.smithi079.stdout:6/983: link d0/d6/d1b/db8/d105/l130 d0/da2/l14c 0 2024-05-09T06:29:43.667 INFO:tasks.workunit.client.1.smithi079.stdout:6/984: chown d0/d6/d1b/db8/dff 14 1 2024-05-09T06:29:43.667 INFO:tasks.workunit.client.1.smithi079.stdout:6/985: truncate d0/d6/d1b/d2d/f4a 909766 0 2024-05-09T06:29:43.667 INFO:tasks.workunit.client.1.smithi079.stdout:6/986: write d0/d6/d16/d1f/f90 [1486638,55060] 0 2024-05-09T06:29:43.668 INFO:tasks.workunit.client.1.smithi079.stdout:6/987: write d0/de/f1e [2266068,69714] 0 2024-05-09T06:29:43.670 INFO:tasks.workunit.client.1.smithi079.stdout:8/830: creat d1/d3/f123 x:0 0 0 2024-05-09T06:29:43.673 INFO:tasks.workunit.client.1.smithi079.stdout:2/948: unlink d8/db/d59/d67/d86/fdb 0 2024-05-09T06:29:43.674 INFO:tasks.workunit.client.1.smithi079.stdout:2/949: chown d8/db/c22 4741 1 2024-05-09T06:29:43.677 INFO:tasks.workunit.client.1.smithi079.stdout:4/980: rename d6/d8/d55 to d6/d1a/d26/d2a/dde/df1/df3/d148 0 2024-05-09T06:29:43.678 INFO:tasks.workunit.client.1.smithi079.stdout:8/831: symlink d1/db/daf/d66/d6c/l124 0 2024-05-09T06:29:43.678 INFO:tasks.workunit.client.1.smithi079.stdout:8/832: creat d1/d5/d36/d102/dc3/d50/dd7/f125 x:0 0 0 2024-05-09T06:29:43.679 INFO:tasks.workunit.client.0.smithi062.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-09T06:29:43.680 INFO:tasks.workunit.client.1.smithi079.stdout:2/950: creat d8/db/d59/f157 x:0 0 0 2024-05-09T06:29:43.680 INFO:tasks.workunit.client.1.smithi079.stdout:4/981: rmdir d6/d8/d114 39 2024-05-09T06:29:43.682 INFO:tasks.workunit.client.1.smithi079.stdout:8/833: chown d1/d5/d36/d102/dc3/d3b/l43 266 1 2024-05-09T06:29:43.682 INFO:tasks.workunit.client.1.smithi079.stdout:8/834: write d1/d5/d36/d102/dc3/d82/dda/fe0 [411504,86483] 0 2024-05-09T06:29:43.684 INFO:tasks.workunit.client.1.smithi079.stdout:2/951: rename d8/db/d4b/d4f/d51/d6d/f6e to d8/db/d14e/f158 0 2024-05-09T06:29:43.686 INFO:tasks.workunit.client.1.smithi079.stdout:8/835: mkdir d1/d5/d36/dae/dbe/d126 0 2024-05-09T06:29:43.687 INFO:tasks.workunit.client.1.smithi079.stdout:6/988: dwrite d0/de/f1e [0,4194304] 0 2024-05-09T06:29:43.688 INFO:tasks.workunit.client.1.smithi079.stdout:1/909: dwrite d0/d12/d16/fd0 [0,4194304] 0 2024-05-09T06:29:43.690 INFO:tasks.workunit.client.1.smithi079.stdout:8/836: symlink d1/d5/d36/d102/dc3/d3b/dc8/l127 0 2024-05-09T06:29:43.692 INFO:tasks.workunit.client.1.smithi079.stdout:4/982: dread d6/d1a/d26/d2a/d54/d9e/dd5/df/dfb/fbf [0,4194304] 0 2024-05-09T06:29:43.704 INFO:tasks.workunit.client.1.smithi079.stdout:1/910: dwrite d0/d12/d67/d53/dbf/dd2/fc [0,4194304] 0 2024-05-09T06:29:43.707 INFO:tasks.workunit.client.1.smithi079.stdout:0/816: write d3/dd/d18/d5e/d69/f75 [40587,30340] 0 2024-05-09T06:29:43.715 INFO:tasks.workunit.client.1.smithi079.stdout:2/952: rename d8/d12f to d8/db/d11/d134/d159 0 2024-05-09T06:29:43.715 INFO:tasks.workunit.client.1.smithi079.stdout:4/983: symlink d6/d8/de6/l149 0 2024-05-09T06:29:43.717 INFO:tasks.workunit.client.1.smithi079.stdout:0/817: symlink d3/dd/d18/d5e/l10b 0 2024-05-09T06:29:43.717 INFO:tasks.workunit.client.1.smithi079.stdout:8/837: dread d1/d3/f4 [0,4194304] 0 2024-05-09T06:29:43.719 INFO:tasks.workunit.client.1.smithi079.stdout:4/984: link d6/d8/d27/d3d/d5b/d10c/c13b d6/d1a/d26/d2a/dde/df1/d105/c14a 0 2024-05-09T06:29:43.719 INFO:tasks.workunit.client.1.smithi079.stdout:0/818: dread d3/dd/d71/db4/ff2 [0,4194304] 0 2024-05-09T06:29:43.720 INFO:tasks.workunit.client.1.smithi079.stdout:8/838: creat d1/d64/f128 x:0 0 0 2024-05-09T06:29:43.721 INFO:tasks.workunit.client.1.smithi079.stdout:8/839: truncate d1/d5/d36/d102/dc3/d50/fc6 1907773 0 2024-05-09T06:29:43.722 INFO:tasks.workunit.client.1.smithi079.stdout:8/840: creat d1/d5/d36/d102/dc3/d44/de7/f129 x:0 0 0 2024-05-09T06:29:43.723 INFO:tasks.workunit.client.1.smithi079.stdout:2/953: dread d8/db/d59/d93/fe6 [0,4194304] 0 2024-05-09T06:29:43.723 INFO:tasks.workunit.client.1.smithi079.stdout:2/954: fdatasync d8/db/d11/d5f/fae 0 2024-05-09T06:29:43.724 INFO:tasks.workunit.client.1.smithi079.stdout:8/841: creat d1/d5/d36/d102/dc3/dff/f12a x:0 0 0 2024-05-09T06:29:43.725 INFO:tasks.workunit.client.1.smithi079.stdout:2/955: unlink d8/db/d59/d67/d86/dd5/led 0 2024-05-09T06:29:43.725 INFO:tasks.workunit.client.1.smithi079.stdout:2/956: fsync d8/db/d5c/f144 0 2024-05-09T06:29:43.725 INFO:tasks.workunit.client.1.smithi079.stdout:2/957: chown d8/db/d59/d67/d7f/l143 796577 1 2024-05-09T06:29:43.726 INFO:tasks.workunit.client.1.smithi079.stdout:8/842: truncate d1/d5/d36/d102/f4e 2680022 0 2024-05-09T06:29:43.726 INFO:tasks.workunit.client.1.smithi079.stdout:8/843: fsync d1/db/f4f 0 2024-05-09T06:29:43.730 INFO:tasks.workunit.client.1.smithi079.stdout:0/819: read d3/dd/d66/d6d/d74/d80/f32 [8050359,15430] 0 2024-05-09T06:29:43.731 INFO:tasks.workunit.client.1.smithi079.stdout:0/820: creat d3/dd/d66/d6d/d74/d84/db7/f10c x:0 0 0 2024-05-09T06:29:43.731 INFO:tasks.workunit.client.1.smithi079.stdout:0/821: fsync d3/dd/d18/f7a 0 2024-05-09T06:29:43.734 INFO:tasks.workunit.client.1.smithi079.stdout:4/985: dwrite d6/d8/d27/d3d/d5b/db4/dc3/ffa [0,4194304] 0 2024-05-09T06:29:43.735 INFO:tasks.workunit.client.1.smithi079.stdout:0/822: truncate d3/dd/d1f/d1e/d2c/d7f/de0/f107 208816 0 2024-05-09T06:29:43.735 INFO:tasks.workunit.client.1.smithi079.stdout:0/823: readlink d3/dd/d66/d6d/d74/d80/d2d/l33 0 2024-05-09T06:29:43.735 INFO:tasks.workunit.client.1.smithi079.stdout:0/824: fsync d3/fa1 0 2024-05-09T06:29:43.737 INFO:tasks.workunit.client.1.smithi079.stdout:8/844: dread d1/d3/d20/f32 [0,4194304] 0 2024-05-09T06:29:43.737 INFO:tasks.workunit.client.1.smithi079.stdout:8/845: stat d1/d5/d36/d102/dc3/d50/f5b 0 2024-05-09T06:29:43.741 INFO:tasks.workunit.client.1.smithi079.stdout:4/986: rename d6/d8/d27/d3d/d5b/f13a to d6/d1a/f14b 0 2024-05-09T06:29:43.745 INFO:tasks.workunit.client.1.smithi079.stdout:8/846: rmdir d1/d5/d36/d102/d33/d5d/d6d/dc0 39 2024-05-09T06:29:43.745 INFO:tasks.workunit.client.1.smithi079.stdout:8/847: chown d1/f1f 818516 1 2024-05-09T06:29:43.747 INFO:tasks.workunit.client.1.smithi079.stdout:8/848: symlink d1/db/daf/l12b 0 2024-05-09T06:29:43.751 INFO:tasks.workunit.client.1.smithi079.stdout:8/849: rmdir d1/d5/d36/d102/dc3/d44/de7/d11d 0 2024-05-09T06:29:43.751 INFO:tasks.workunit.client.1.smithi079.stdout:8/850: stat d1/d5/d36/d102/dc3/d3b/fe9 0 2024-05-09T06:29:43.751 INFO:tasks.workunit.client.1.smithi079.stdout:0/825: dwrite d3/dd/d66/d6d/d74/d84/fe5 [0,4194304] 0 2024-05-09T06:29:43.754 INFO:tasks.workunit.client.1.smithi079.stdout:8/851: mkdir d1/d56/d7c/d8f/d12c 0 2024-05-09T06:29:43.756 INFO:tasks.workunit.client.1.smithi079.stdout:0/826: symlink d3/dd/d18/d5e/l10d 0 2024-05-09T06:29:43.760 INFO:tasks.workunit.client.1.smithi079.stdout:4/987: dwrite d6/d1a/d26/d2a/d98/fac [0,4194304] 0 2024-05-09T06:29:43.763 INFO:tasks.workunit.client.1.smithi079.stdout:4/988: symlink d6/d90/l14c 0 2024-05-09T06:29:43.764 INFO:tasks.workunit.client.1.smithi079.stdout:4/989: truncate d6/d1a/d41/d68/d6b/f81 1696329 0 2024-05-09T06:29:43.766 INFO:tasks.workunit.client.1.smithi079.stdout:4/990: getdents d6/d1a/d26/d2a/d54/d9e/dd5/d34 0 2024-05-09T06:29:43.767 INFO:tasks.workunit.client.1.smithi079.stdout:8/852: dread d1/d5/d36/d102/d33/d5d/d6d/f88 [0,4194304] 0 2024-05-09T06:29:43.767 INFO:tasks.workunit.client.1.smithi079.stdout:8/853: write d1/d5/d36/d102/dc3/d50/fc6 [2258548,27156] 0 2024-05-09T06:29:43.770 INFO:tasks.workunit.client.1.smithi079.stdout:8/854: rmdir d1/d5/d36/d102/dc3/d3b 39 2024-05-09T06:29:43.771 INFO:tasks.workunit.client.1.smithi079.stdout:0/827: dwrite d3/dd/d66/d6d/fae [0,4194304] 0 2024-05-09T06:29:43.771 INFO:tasks.workunit.client.1.smithi079.stdout:0/828: fdatasync d3/dd/d66/d6d/d74/d80/d76/dcc/ff3 0 2024-05-09T06:29:43.774 INFO:tasks.workunit.client.1.smithi079.stdout:4/991: rename d6/d1a/d26/d2a/d54 to d6/d1a/d26/d2a/dde/df1/df3/d148/dd6/d14d 0 2024-05-09T06:29:43.775 INFO:tasks.workunit.client.1.smithi079.stdout:8/855: symlink d1/db/daf/d66/d6c/l12d 0 2024-05-09T06:29:43.776 INFO:tasks.workunit.client.1.smithi079.stdout:8/856: stat d1/d5/d36/d102/dc3/d50/f5b 0 2024-05-09T06:29:43.777 INFO:tasks.workunit.client.1.smithi079.stdout:0/829: rmdir d3/dd/d66/d6d/d74/d80/d2d/da7/dce/dfb 0 2024-05-09T06:29:43.778 INFO:tasks.workunit.client.1.smithi079.stdout:4/992: creat d6/d12b/f14e x:0 0 0 2024-05-09T06:29:43.780 INFO:tasks.workunit.client.1.smithi079.stdout:8/857: rename d1/d5/cf2 to d1/d5/d36/d102/dc3/c12e 0 2024-05-09T06:29:43.781 INFO:tasks.workunit.client.1.smithi079.stdout:0/830: symlink d3/dd/d66/de9/l10e 0 2024-05-09T06:29:43.781 INFO:tasks.workunit.client.1.smithi079.stdout:0/831: creat d3/dd/d1f/d1e/d2c/d88/d8e/f10f x:0 0 0 2024-05-09T06:29:43.781 INFO:tasks.workunit.client.1.smithi079.stdout:7/772: sync 2024-05-09T06:29:43.781 INFO:tasks.workunit.client.1.smithi079.stdout:3/954: sync 2024-05-09T06:29:43.782 INFO:tasks.workunit.client.1.smithi079.stdout:0/832: unlink d3/dd/d1f/d1e/d2c/d35/d36/fca 0 2024-05-09T06:29:43.783 INFO:tasks.workunit.client.1.smithi079.stdout:0/833: truncate d3/dd/f1c 630493 0 2024-05-09T06:29:43.783 INFO:tasks.workunit.client.1.smithi079.stdout:3/955: symlink d1a/d1c/d22/d53/da5/l13f 0 2024-05-09T06:29:43.785 INFO:tasks.workunit.client.1.smithi079.stdout:3/956: rmdir d1a/d21/db0/dd4/d3a/d121 39 2024-05-09T06:29:43.785 INFO:tasks.workunit.client.1.smithi079.stdout:3/957: truncate d1a/d21/db0/dd4/d67/f13a 1027390 0 2024-05-09T06:29:43.788 INFO:tasks.workunit.client.1.smithi079.stdout:3/958: link d1a/d82/le0 d1a/d21/db0/dd4/d67/d11e/l140 0 2024-05-09T06:29:43.791 INFO:tasks.workunit.client.1.smithi079.stdout:7/773: dread d4/d7/d37/d7c/f8f [0,4194304] 0 2024-05-09T06:29:43.792 INFO:tasks.workunit.client.1.smithi079.stdout:3/959: rename d1a/d1c/d22/d53/dc6 to d1a/d141 0 2024-05-09T06:29:43.794 INFO:tasks.workunit.client.1.smithi079.stdout:0/834: read d3/dd/d66/d6d/d74/d80/d2d/f8f [657371,113404] 0 2024-05-09T06:29:43.797 INFO:tasks.workunit.client.1.smithi079.stdout:7/774: rename d4/d7/d22/d28/d50/d5c/d84 to d4/d7/d22/d28/d50/d5c/df0 0 2024-05-09T06:29:43.798 INFO:tasks.workunit.client.1.smithi079.stdout:3/960: unlink d1a/d21/l11a 0 2024-05-09T06:29:43.799 INFO:tasks.workunit.client.1.smithi079.stdout:0/835: link d3/dd/d1f/d1e/d2c/d35/ce7 d3/dd/c110 0 2024-05-09T06:29:43.800 INFO:tasks.workunit.client.1.smithi079.stdout:0/836: dread d3/dd/d1f/d1e/d2c/d7f/de0/ff1 [0,4194304] 0 2024-05-09T06:29:43.801 INFO:tasks.workunit.client.1.smithi079.stdout:8/858: dwrite d1/d5/d36/d102/dc3/d50/dd7/f10e [4194304,4194304] 0 2024-05-09T06:29:43.801 INFO:tasks.workunit.client.1.smithi079.stdout:7/775: mkdir d4/d7/d22/d28/df1 0 2024-05-09T06:29:43.801 INFO:tasks.workunit.client.1.smithi079.stdout:4/993: dwrite d6/d1a/d26/d2a/dde/df1/df3/d148/dd6/d14d/d9e/dd5/df/f13 [4194304,4194304] 0 2024-05-09T06:29:43.803 INFO:tasks.workunit.client.1.smithi079.stdout:0/837: symlink d3/dd/d1f/d1e/d2c/d88/d8e/de3/l111 0 2024-05-09T06:29:43.803 INFO:tasks.workunit.client.1.smithi079.stdout:0/838: truncate d3/dd/f9f 676125 0 2024-05-09T06:29:43.809 INFO:tasks.workunit.client.1.smithi079.stdout:3/961: dread d1a/d82/f89 [0,4194304] 0 2024-05-09T06:29:43.810 INFO:tasks.workunit.client.1.smithi079.stdout:8/859: write d1/d5/d36/d102/dc3/d3f/f69 [1865776,5070] 0 2024-05-09T06:29:43.813 INFO:tasks.workunit.client.1.smithi079.stdout:4/994: rename d6/d1a/d26/dd3/f141 to d6/d1a/d26/d2a/dde/df1/df3/d143/f14f 0 2024-05-09T06:29:43.814 INFO:tasks.workunit.client.1.smithi079.stdout:0/839: symlink d3/dd/d18/d5e/d69/l112 0 2024-05-09T06:29:43.817 INFO:tasks.workunit.client.1.smithi079.stdout:8/860: rmdir d1/db/daf/d66/d6c/dbf/dc9 39 2024-05-09T06:29:43.817 INFO:tasks.workunit.client.1.smithi079.stdout:7/776: dwrite d4/d7/d22/d28/d74/fcf [0,4194304] 0 2024-05-09T06:29:43.818 INFO:tasks.workunit.client.1.smithi079.stdout:4/995: getdents d6/d1a/d41/d68/da1/dad 0 2024-05-09T06:29:43.819 INFO:tasks.workunit.client.1.smithi079.stdout:0/840: mknod d3/dd/d1f/d1e/d2c/d88/d8e/de3/c113 0 2024-05-09T06:29:43.819 INFO:tasks.workunit.client.1.smithi079.stdout:0/841: fsync d3/d5/fe 0 2024-05-09T06:29:43.819 INFO:tasks.workunit.client.1.smithi079.stdout:0/842: chown d3/d5/f21 22841 1 2024-05-09T06:29:43.823 INFO:tasks.workunit.client.1.smithi079.stdout:4/996: mkdir d6/d1a/d26/d2a/d150 0 2024-05-09T06:29:43.824 INFO:tasks.workunit.client.1.smithi079.stdout:0/843: symlink d3/d104/l114 0 2024-05-09T06:29:43.825 INFO:tasks.workunit.client.1.smithi079.stdout:3/962: write d1a/d21/db0/dd4/d3a/d54/d55/f113 [4000437,34190] 0 2024-05-09T06:29:43.827 INFO:tasks.workunit.client.1.smithi079.stdout:4/997: creat d6/d8/d27/f151 x:0 0 0 2024-05-09T06:29:43.827 INFO:tasks.workunit.client.1.smithi079.stdout:6/989: sync 2024-05-09T06:29:43.827 INFO:tasks.workunit.client.1.smithi079.stdout:1/911: sync 2024-05-09T06:29:43.829 INFO:tasks.workunit.client.1.smithi079.stdout:4/998: symlink d6/d1a/d26/d2a/dde/df1/df3/d148/dd6/d14d/d9e/dd5/d34/dd4/l152 0 2024-05-09T06:29:43.831 INFO:tasks.workunit.client.1.smithi079.stdout:6/990: rmdir d0/d6/d1b/d20/dac 39 2024-05-09T06:29:43.831 INFO:tasks.workunit.client.1.smithi079.stdout:6/991: truncate d0/d6/d1b/fd4 964203 0 2024-05-09T06:29:43.831 INFO:tasks.workunit.client.1.smithi079.stdout:6/992: write d0/d6/f29 [2511356,44982] 0 2024-05-09T06:29:43.831 INFO:tasks.workunit.client.1.smithi079.stdout:6/993: fdatasync d0/da2/db2/f142 0 2024-05-09T06:29:43.839 INFO:tasks.workunit.client.1.smithi079.stdout:1/912: write d0/d12/d67/d53/dbf/dd2/f9 [2161660,123890] 0 2024-05-09T06:29:43.841 INFO:tasks.workunit.client.1.smithi079.stdout:1/913: creat d0/d12/d67/d53/d5e/f13a x:0 0 0 2024-05-09T06:29:43.841 INFO:tasks.workunit.client.1.smithi079.stdout:1/914: write d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/f126 [511102,118106] 0 2024-05-09T06:29:43.842 INFO:tasks.workunit.client.1.smithi079.stdout:6/994: write d0/f8f [4022815,53152] 0 2024-05-09T06:29:43.842 INFO:tasks.workunit.client.1.smithi079.stdout:6/995: fdatasync d0/d6/d16/dcd/dce/f98 0 2024-05-09T06:29:43.842 INFO:tasks.workunit.client.1.smithi079.stdout:4/999: dread d6/d1a/d26/d2a/dde/df1/df3/d148/dd6/d14d/d9e/dd5/d34/f94 [0,4194304] 0 2024-05-09T06:29:43.844 INFO:tasks.workunit.client.1.smithi079.stdout:6/996: write d0/d6/d16/fe4 [8602242,5280] 0 2024-05-09T06:29:43.846 INFO:tasks.workunit.client.1.smithi079.stdout:6/997: creat d0/d60/d118/f14d x:0 0 0 2024-05-09T06:29:43.846 INFO:tasks.workunit.client.1.smithi079.stdout:6/998: dread - d0/d60/daf/f13c zero size 2024-05-09T06:29:43.847 INFO:tasks.workunit.client.1.smithi079.stdout:8/861: dwrite d1/db/f78 [0,4194304] 0 2024-05-09T06:29:43.847 INFO:tasks.workunit.client.1.smithi079.stdout:6/999: mkdir d0/d6/d1b/d14e 0 2024-05-09T06:29:43.850 INFO:tasks.workunit.client.1.smithi079.stdout:7/777: dwrite d4/d7/dd/d5b/f44 [0,4194304] 0 2024-05-09T06:29:43.850 INFO:tasks.workunit.client.1.smithi079.stdout:7/778: write d4/d7/d37/fa5 [777160,74058] 0 2024-05-09T06:29:43.855 INFO:tasks.workunit.client.1.smithi079.stdout:8/862: read d1/d5/d36/d102/dc3/d50/fc6 [1909198,29318] 0 2024-05-09T06:29:43.855 INFO:tasks.workunit.client.1.smithi079.stdout:8/863: dread - d1/d5/d36/d102/dc3/f111 zero size 2024-05-09T06:29:43.855 INFO:tasks.workunit.client.1.smithi079.stdout:8/864: chown d1/d5/f120 484 1 2024-05-09T06:29:43.856 INFO:tasks.workunit.client.1.smithi079.stdout:0/844: dwrite d3/dd/d66/d6d/d74/d80/d76/dcc/f105 [0,4194304] 0 2024-05-09T06:29:43.856 INFO:tasks.workunit.client.1.smithi079.stdout:0/845: fsync d3/dd/d71/db4/ff2 0 2024-05-09T06:29:43.856 INFO:tasks.workunit.client.1.smithi079.stdout:0/846: chown d3/dd/d1f/f28 1 1 2024-05-09T06:29:43.857 INFO:tasks.workunit.client.1.smithi079.stdout:8/865: mknod d1/d5/d36/dae/dbe/d126/c12f 0 2024-05-09T06:29:43.857 INFO:tasks.workunit.client.1.smithi079.stdout:8/866: chown d1/d5/d36/d102/d33/d5d 51631 1 2024-05-09T06:29:43.857 INFO:tasks.workunit.client.1.smithi079.stdout:8/867: write d1/d5/d36/fb8 [941090,60720] 0 2024-05-09T06:29:43.861 INFO:tasks.workunit.client.1.smithi079.stdout:3/963: dwrite d1a/d21/db0/dd4/d3a/f46 [0,4194304] 0 2024-05-09T06:29:43.863 INFO:tasks.workunit.client.1.smithi079.stdout:1/915: dwrite d0/d12/d48/d75/f54 [0,4194304] 0 2024-05-09T06:29:43.865 INFO:tasks.workunit.client.1.smithi079.stdout:7/779: dread d4/d7/dd/d5b/d31/d34/fa6 [0,4194304] 0 2024-05-09T06:29:43.866 INFO:tasks.workunit.client.1.smithi079.stdout:8/868: mkdir d1/d5/d36/d102/dc3/d82/dda/d110/d130 0 2024-05-09T06:29:43.870 INFO:tasks.workunit.client.1.smithi079.stdout:7/780: creat d4/d7/d22/d28/d50/d5c/d85/db6/ff2 x:0 0 0 2024-05-09T06:29:43.870 INFO:tasks.workunit.client.1.smithi079.stdout:7/781: chown d4/d7/d22/d28/cb0 37370 1 2024-05-09T06:29:43.870 INFO:tasks.workunit.client.1.smithi079.stdout:7/782: write d4/d7/dd/d5b/f3a [3340130,100617] 0 2024-05-09T06:29:43.874 INFO:tasks.workunit.client.1.smithi079.stdout:8/869: symlink d1/d56/l131 0 2024-05-09T06:29:43.875 INFO:tasks.workunit.client.1.smithi079.stdout:3/964: getdents d1a/d21/db0/dd4/d3a 0 2024-05-09T06:29:43.875 INFO:tasks.workunit.client.1.smithi079.stdout:8/870: chown d1/d5/f120 925 1 2024-05-09T06:29:43.875 INFO:tasks.workunit.client.1.smithi079.stdout:3/965: stat d1a/d82/d87/db2/lf8 0 2024-05-09T06:29:43.875 INFO:tasks.workunit.client.1.smithi079.stdout:8/871: rename d1/db/daf/d66 to d1/d5/d36/da0/d132 0 2024-05-09T06:29:43.875 INFO:tasks.workunit.client.1.smithi079.stdout:8/872: stat d1/f112 0 2024-05-09T06:29:43.876 INFO:tasks.workunit.client.1.smithi079.stdout:0/847: dwrite d3/dd/d66/de9/f102 [0,4194304] 0 2024-05-09T06:29:43.877 INFO:tasks.workunit.client.1.smithi079.stdout:0/848: readlink d3/dd/d66/led 0 2024-05-09T06:29:43.877 INFO:tasks.workunit.client.1.smithi079.stdout:0/849: readlink d3/dd/d66/lc4 0 2024-05-09T06:29:43.877 INFO:tasks.workunit.client.1.smithi079.stdout:0/850: chown d3/dd/d18/d5e/df6 27278333 1 2024-05-09T06:29:43.877 INFO:tasks.workunit.client.1.smithi079.stdout:3/966: symlink d1a/d21/db0/dd4/d34/d59/l142 0 2024-05-09T06:29:43.880 INFO:tasks.workunit.client.1.smithi079.stdout:8/873: dread d1/d5/d36/d102/d33/fb1 [0,4194304] 0 2024-05-09T06:29:43.880 INFO:tasks.workunit.client.1.smithi079.stdout:0/851: rename d3/dd/d1f/d1e/d91/dc9 to d3/dd/d66/d6d/d74/d80/d2d/da7/dce/d115 0 2024-05-09T06:29:43.882 INFO:tasks.workunit.client.1.smithi079.stdout:3/967: link d1a/d21/db0/dd4/d34/d42/f47 d1a/d82/d87/db2/ddb/d13b/f143 0 2024-05-09T06:29:43.882 INFO:tasks.workunit.client.1.smithi079.stdout:3/968: chown d1a/d21/db0/dd4/f41 1 1 2024-05-09T06:29:43.884 INFO:tasks.workunit.client.1.smithi079.stdout:8/874: rmdir d1/d3/d20 39 2024-05-09T06:29:43.890 INFO:tasks.workunit.client.1.smithi079.stdout:3/969: symlink d1a/d21/db0/dd4/d34/l144 0 2024-05-09T06:29:43.894 INFO:tasks.workunit.client.1.smithi079.stdout:8/875: write d1/d5/d36/d102/dc3/d44/f4c [1808447,83350] 0 2024-05-09T06:29:43.894 INFO:tasks.workunit.client.1.smithi079.stdout:8/876: fsync d1/d5/d36/d102/dc3/d3f/f69 0 2024-05-09T06:29:43.896 INFO:tasks.workunit.client.1.smithi079.stdout:3/970: dread d1a/d21/f62 [0,4194304] 0 2024-05-09T06:29:43.897 INFO:tasks.workunit.client.1.smithi079.stdout:0/852: dwrite d3/d5/d87/feb [0,4194304] 0 2024-05-09T06:29:43.898 INFO:tasks.workunit.client.1.smithi079.stdout:8/877: rename d1/d5/d36/d102/dc3/l99 to d1/d5/d36/d102/dc3/d82/l133 0 2024-05-09T06:29:43.901 INFO:tasks.workunit.client.1.smithi079.stdout:3/971: rmdir d1a/d21/ddc/d104 39 2024-05-09T06:29:43.904 INFO:tasks.workunit.client.1.smithi079.stdout:2/958: sync 2024-05-09T06:29:43.906 INFO:tasks.workunit.client.1.smithi079.stdout:8/878: unlink d1/d5/d36/d102/dc3/c12e 0 2024-05-09T06:29:43.907 INFO:tasks.workunit.client.1.smithi079.stdout:8/879: fdatasync d1/d5/d36/d102/d33/d5d/d6d/f88 0 2024-05-09T06:29:43.907 INFO:tasks.workunit.client.1.smithi079.stdout:8/880: read d1/d5/d36/d102/dc3/d44/f4c [795227,78711] 0 2024-05-09T06:29:43.908 INFO:tasks.workunit.client.1.smithi079.stdout:3/972: creat d1a/d21/db0/dd4/d3a/d121/dc5/f145 x:0 0 0 2024-05-09T06:29:43.908 INFO:tasks.workunit.client.1.smithi079.stdout:3/973: fdatasync d1a/d1c/d22/d53/f7b 0 2024-05-09T06:29:43.910 INFO:tasks.workunit.client.1.smithi079.stdout:2/959: creat d8/db/d59/d67/d86/dd5/f15a x:0 0 0 2024-05-09T06:29:43.911 INFO:tasks.workunit.client.1.smithi079.stdout:1/916: dwrite d0/d12/d67/f136 [0,4194304] 0 2024-05-09T06:29:43.911 INFO:tasks.workunit.client.1.smithi079.stdout:1/917: readlink d0/d12/d16/l3c 0 2024-05-09T06:29:43.912 INFO:tasks.workunit.client.1.smithi079.stdout:8/881: rmdir d1/d5/d36/d102/d33/d5d/d6d/dc0 39 2024-05-09T06:29:43.913 INFO:tasks.workunit.client.1.smithi079.stdout:3/974: mkdir d1a/d1c/d22/d53/d4e/d146 0 2024-05-09T06:29:43.915 INFO:tasks.workunit.client.1.smithi079.stdout:2/960: creat d8/db/d4b/d4f/d51/d6f/f15b x:0 0 0 2024-05-09T06:29:43.915 INFO:tasks.workunit.client.1.smithi079.stdout:0/853: dwrite d3/dd/d1f/d1e/d2c/dc0/fc3 [0,4194304] 0 2024-05-09T06:29:43.915 INFO:tasks.workunit.client.1.smithi079.stdout:0/854: chown d3/d104/l114 10590 1 2024-05-09T06:29:43.919 INFO:tasks.workunit.client.1.smithi079.stdout:1/918: unlink d0/d12/d67/d53/dbf/dd2/f117 0 2024-05-09T06:29:43.920 INFO:tasks.workunit.client.1.smithi079.stdout:8/882: creat d1/d5/d36/da0/d132/d6c/d6b/f134 x:0 0 0 2024-05-09T06:29:43.920 INFO:tasks.workunit.client.1.smithi079.stdout:1/919: dread d0/d12/dc0/dd4/df3/fdd [0,4194304] 0 2024-05-09T06:29:43.923 INFO:tasks.workunit.client.1.smithi079.stdout:3/975: creat d1a/d21/db0/de5/d122/f147 x:0 0 0 2024-05-09T06:29:43.927 INFO:tasks.workunit.client.1.smithi079.stdout:0/855: rename d3/dd/f3e to d3/dd/d71/db4/f116 0 2024-05-09T06:29:43.927 INFO:tasks.workunit.client.1.smithi079.stdout:0/856: write d3/dd/d66/f72 [2197763,73297] 0 2024-05-09T06:29:43.929 INFO:tasks.workunit.client.1.smithi079.stdout:1/920: rmdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6 39 2024-05-09T06:29:43.931 INFO:tasks.workunit.client.1.smithi079.stdout:3/976: symlink d1a/d21/db0/dd4/d3a/d54/l148 0 2024-05-09T06:29:43.931 INFO:tasks.workunit.client.1.smithi079.stdout:2/961: dwrite d8/db/d9d/f13d [0,4194304] 0 2024-05-09T06:29:43.931 INFO:tasks.workunit.client.1.smithi079.stdout:2/962: readlink d8/db/d11/d5f/d130/d88/lde 0 2024-05-09T06:29:43.931 INFO:tasks.workunit.client.1.smithi079.stdout:2/963: chown d8/db/d59/d67/d7f/db9/de1/df1/fff 236829263 1 2024-05-09T06:29:43.931 INFO:tasks.workunit.client.1.smithi079.stdout:1/921: dread d0/d12/d67/d53/dbf/dd2/f8d [0,4194304] 0 2024-05-09T06:29:43.931 INFO:tasks.workunit.client.1.smithi079.stdout:1/922: fsync d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/d12f/f11e 0 2024-05-09T06:29:43.931 INFO:tasks.workunit.client.1.smithi079.stdout:1/923: chown d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/d12f/cb4 1642277 1 2024-05-09T06:29:43.933 INFO:tasks.workunit.client.1.smithi079.stdout:8/883: getdents d1/d5/dc 0 2024-05-09T06:29:43.937 INFO:tasks.workunit.client.1.smithi079.stdout:3/977: mkdir d1a/d21/ddc/d124/d149 0 2024-05-09T06:29:43.937 INFO:tasks.workunit.client.1.smithi079.stdout:3/978: readlink d1a/d21/db0/dd4/d3a/d54/l148 0 2024-05-09T06:29:43.937 INFO:tasks.workunit.client.1.smithi079.stdout:3/979: creat d1a/d21/ddc/d124/f14a x:0 0 0 2024-05-09T06:29:43.938 INFO:tasks.workunit.client.1.smithi079.stdout:2/964: symlink d8/db/d59/d67/d7f/db9/de1/d137/l15c 0 2024-05-09T06:29:43.938 INFO:tasks.workunit.client.1.smithi079.stdout:2/965: creat d8/db/d59/d67/f15d x:0 0 0 2024-05-09T06:29:43.940 INFO:tasks.workunit.client.1.smithi079.stdout:1/924: rename d0/d12/d67/db6/d89/fdc to d0/d12/d48/d75/f13b 0 2024-05-09T06:29:43.942 INFO:tasks.workunit.client.1.smithi079.stdout:8/884: creat d1/d5/d36/d102/dc3/d3b/dc8/f135 x:0 0 0 2024-05-09T06:29:43.942 INFO:tasks.workunit.client.1.smithi079.stdout:8/885: stat d1/d5/d36/d102/dc3/d44/f35 0 2024-05-09T06:29:43.942 INFO:tasks.workunit.client.1.smithi079.stdout:0/857: write d3/dd/f9f [1171695,66765] 0 2024-05-09T06:29:43.942 INFO:tasks.workunit.client.1.smithi079.stdout:0/858: read d3/dd/d1f/d1e/d2c/d35/d36/f3d [929614,34523] 0 2024-05-09T06:29:43.942 INFO:tasks.workunit.client.1.smithi079.stdout:0/859: write d3/d5/fe [4343266,111253] 0 2024-05-09T06:29:43.942 INFO:tasks.workunit.client.1.smithi079.stdout:0/860: readlink d3/dd/d66/d6d/d74/d80/d2d/l33 0 2024-05-09T06:29:43.948 INFO:tasks.workunit.client.1.smithi079.stdout:2/966: read d8/db/d11/f2f [4353329,5300] 0 2024-05-09T06:29:43.948 INFO:tasks.workunit.client.1.smithi079.stdout:1/925: rename d0/d12/d67/f136 to d0/df/f13c 0 2024-05-09T06:29:43.948 INFO:tasks.workunit.client.1.smithi079.stdout:2/967: write d8/db/d4b/d4f/d51/d6d/fa7 [476267,109592] 0 2024-05-09T06:29:43.948 INFO:tasks.workunit.client.1.smithi079.stdout:8/886: mkdir d1/d5/d36/dae/dbe/d136 0 2024-05-09T06:29:43.951 INFO:tasks.workunit.client.1.smithi079.stdout:3/980: rmdir d1a/d82/d87 39 2024-05-09T06:29:43.951 INFO:tasks.workunit.client.1.smithi079.stdout:3/981: dread - d1a/d21/fd0 zero size 2024-05-09T06:29:43.953 INFO:tasks.workunit.client.1.smithi079.stdout:1/926: rename d0/d12/d67/d53/dbf/dd2/c81 to d0/d12/d67/db6/d89/c13d 0 2024-05-09T06:29:43.954 INFO:tasks.workunit.client.1.smithi079.stdout:1/927: write d0/d12/d16/f50 [42071,69387] 0 2024-05-09T06:29:43.956 INFO:tasks.workunit.client.1.smithi079.stdout:8/887: unlink d1/d5/d36/d102/dc3/d3b/c10f 0 2024-05-09T06:29:43.957 INFO:tasks.workunit.client.1.smithi079.stdout:3/982: link d1a/d21/db0/dd4/f8f d1a/d82/d87/db2/ddb/f14b 0 2024-05-09T06:29:43.960 INFO:tasks.workunit.client.1.smithi079.stdout:1/928: unlink d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/ccc 0 2024-05-09T06:29:43.960 INFO:tasks.workunit.client.1.smithi079.stdout:1/929: fsync d0/d12/d48/fb3 0 2024-05-09T06:29:43.960 INFO:tasks.workunit.client.1.smithi079.stdout:1/930: write d0/d12/dc0/dd4/f12e [665606,59082] 0 2024-05-09T06:29:43.960 INFO:tasks.workunit.client.1.smithi079.stdout:1/931: truncate d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/f126 1429847 0 2024-05-09T06:29:43.961 INFO:tasks.workunit.client.1.smithi079.stdout:0/861: dwrite d3/dd/d1f/d1e/d2c/d88/d8e/fd2 [0,4194304] 0 2024-05-09T06:29:43.962 INFO:tasks.workunit.client.1.smithi079.stdout:2/968: rmdir d8/db/d59/d67/d7f/db9 39 2024-05-09T06:29:43.963 INFO:tasks.workunit.client.1.smithi079.stdout:3/983: rmdir d1a/d21/db0/dd4/d3a/da4/df0 39 2024-05-09T06:29:43.963 INFO:tasks.workunit.client.1.smithi079.stdout:3/984: chown d1a/d1c/d22/d53/da5/f97 3 1 2024-05-09T06:29:43.965 INFO:tasks.workunit.client.1.smithi079.stdout:1/932: truncate d0/df/f14 3555325 0 2024-05-09T06:29:43.970 INFO:tasks.workunit.client.1.smithi079.stdout:0/862: creat d3/dd/d66/d6d/da6/dac/f117 x:0 0 0 2024-05-09T06:29:43.970 INFO:tasks.workunit.client.1.smithi079.stdout:0/863: write d3/dd/d18/d5e/fef [548516,57137] 0 2024-05-09T06:29:43.971 INFO:tasks.workunit.client.1.smithi079.stdout:2/969: mknod d8/db/dc/d2c/c15e 0 2024-05-09T06:29:43.971 INFO:tasks.workunit.client.1.smithi079.stdout:8/888: dwrite d1/d5/d36/dae/dbe/f113 [0,4194304] 0 2024-05-09T06:29:43.975 INFO:tasks.workunit.client.1.smithi079.stdout:3/985: mknod d1a/d21/db0/dd4/d34/d59/dd6/c14c 0 2024-05-09T06:29:43.975 INFO:tasks.workunit.client.1.smithi079.stdout:3/986: dread - d1a/d82/f123 zero size 2024-05-09T06:29:43.975 INFO:tasks.workunit.client.1.smithi079.stdout:3/987: rename d1a/d21/db0/dd4 to d1a/d21/db0/dd4/d34/d42/d14d 22 2024-05-09T06:29:43.980 INFO:tasks.workunit.client.1.smithi079.stdout:0/864: creat d3/dd/d66/d6d/d74/d80/d2d/d90/f118 x:0 0 0 2024-05-09T06:29:43.982 INFO:tasks.workunit.client.1.smithi079.stdout:8/889: truncate d1/d56/f81 1696744 0 2024-05-09T06:29:43.983 INFO:tasks.workunit.client.1.smithi079.stdout:3/988: symlink d1a/d21/db0/dd4/d3a/d54/d55/df3/l14e 0 2024-05-09T06:29:43.984 INFO:tasks.workunit.client.1.smithi079.stdout:1/933: dwrite d0/d12/d67/d53/d5e/f13a [0,4194304] 0 2024-05-09T06:29:43.984 INFO:tasks.workunit.client.1.smithi079.stdout:2/970: write d8/db/d4b/d4f/d51/d6f/f7b [1260470,69125] 0 2024-05-09T06:29:43.985 INFO:tasks.workunit.client.1.smithi079.stdout:0/865: chown d3/dd/d66/d6d/d74/d80/l12 25 1 2024-05-09T06:29:43.985 INFO:tasks.workunit.client.1.smithi079.stdout:0/866: read d3/dd/d66/d6d/d74/d80/d2d/f2e [90951,43946] 0 2024-05-09T06:29:43.985 INFO:tasks.workunit.client.1.smithi079.stdout:0/867: dread - d3/dd/d66/d6d/d74/d84/fc1 zero size 2024-05-09T06:29:43.988 INFO:tasks.workunit.client.1.smithi079.stdout:8/890: link d1/d5/d36/d102/f4e d1/d5/d36/d102/d33/d5d/d6d/dc0/f137 0 2024-05-09T06:29:43.989 INFO:tasks.workunit.client.1.smithi079.stdout:8/891: chown d1/db/ce 619 1 2024-05-09T06:29:43.990 INFO:tasks.workunit.client.1.smithi079.stdout:8/892: dread d1/d5/d36/d102/dc3/d50/dd7/ff8 [0,4194304] 0 2024-05-09T06:29:43.994 INFO:tasks.workunit.client.1.smithi079.stdout:1/934: dread d0/d12/d48/d75/d43/d20/f91 [0,4194304] 0 2024-05-09T06:29:43.997 INFO:tasks.workunit.client.1.smithi079.stdout:2/971: rename d8/db/d4b/d4f/d51/fa4 to d8/db/d4b/f15f 0 2024-05-09T06:29:43.997 INFO:tasks.workunit.client.1.smithi079.stdout:2/972: fsync d8/db/fee 0 2024-05-09T06:29:44.002 INFO:tasks.workunit.client.1.smithi079.stdout:1/935: link d0/d12/d48/d75/d43/d20/d39/l40 d0/d12/d48/d75/d43/l13e 0 2024-05-09T06:29:44.002 INFO:tasks.workunit.client.1.smithi079.stdout:2/973: mkdir d8/db/d59/d67/d7f/db9/d160 0 2024-05-09T06:29:44.003 INFO:tasks.workunit.client.1.smithi079.stdout:1/936: dread d0/d12/d48/d75/f13b [0,4194304] 0 2024-05-09T06:29:44.006 INFO:tasks.workunit.client.1.smithi079.stdout:1/937: mknod d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6/c13f 0 2024-05-09T06:29:44.007 INFO:tasks.workunit.client.1.smithi079.stdout:2/974: getdents d8/db/d11/d5f/d11a 0 2024-05-09T06:29:44.007 INFO:tasks.workunit.client.1.smithi079.stdout:2/975: truncate d8/db/d59/d127/f145 15178 0 2024-05-09T06:29:44.012 INFO:tasks.workunit.client.1.smithi079.stdout:0/868: dwrite d3/dd/d66/f7b [0,4194304] 0 2024-05-09T06:29:44.012 INFO:tasks.workunit.client.1.smithi079.stdout:3/989: dwrite d1a/d21/ddc/d124/f14a [0,4194304] 0 2024-05-09T06:29:44.012 INFO:tasks.workunit.client.1.smithi079.stdout:3/990: dread - d1a/dcc/f134 zero size 2024-05-09T06:29:44.013 INFO:tasks.workunit.client.1.smithi079.stdout:8/893: write d1/d5/d36/d102/dc3/d3b/f52 [1689061,95055] 0 2024-05-09T06:29:44.014 INFO:tasks.workunit.client.1.smithi079.stdout:0/869: read d3/dd/f9f [50160,125248] 0 2024-05-09T06:29:44.019 INFO:tasks.workunit.client.1.smithi079.stdout:2/976: dread d8/db/dc/d2c/f63 [0,4194304] 0 2024-05-09T06:29:44.019 INFO:tasks.workunit.client.1.smithi079.stdout:2/977: stat d8/db/d11/d5f/d130/d88/f10b 0 2024-05-09T06:29:44.019 INFO:tasks.workunit.client.1.smithi079.stdout:2/978: fsync d8/f4e 0 2024-05-09T06:29:44.022 INFO:tasks.workunit.client.1.smithi079.stdout:3/991: mkdir d1a/d21/ddc/d124/d149/d14f 0 2024-05-09T06:29:44.022 INFO:tasks.workunit.client.1.smithi079.stdout:3/992: chown d1a/d21/db0/dd4/d67/d11e 7 1 2024-05-09T06:29:44.022 INFO:tasks.workunit.client.1.smithi079.stdout:3/993: write d1a/d21/db0/dd4/d34/d59/dd6/f13c [114955,116949] 0 2024-05-09T06:29:44.022 INFO:tasks.workunit.client.1.smithi079.stdout:3/994: getdents d1a/d141 0 2024-05-09T06:29:44.023 INFO:tasks.workunit.client.1.smithi079.stdout:3/995: chown d1a/d21/db0/dd4/d3a/d121/dc5/df4 99933 1 2024-05-09T06:29:44.024 INFO:tasks.workunit.client.1.smithi079.stdout:8/894: creat d1/d5/d36/dae/dbe/f138 x:0 0 0 2024-05-09T06:29:44.024 INFO:tasks.workunit.client.1.smithi079.stdout:0/870: mknod d3/dd/d1f/c119 0 2024-05-09T06:29:44.024 INFO:tasks.workunit.client.1.smithi079.stdout:0/871: chown d3/dd/d1f/l57 0 1 2024-05-09T06:29:44.026 INFO:tasks.workunit.client.1.smithi079.stdout:2/979: truncate d8/db/dc/d2c/d2e/f54 3859180 0 2024-05-09T06:29:44.027 INFO:tasks.workunit.client.1.smithi079.stdout:8/895: dread d1/d5/d36/d102/d33/d5d/d6d/f88 [0,4194304] 0 2024-05-09T06:29:44.028 INFO:tasks.workunit.client.1.smithi079.stdout:8/896: write d1/d56/d7c/fcf [885868,72938] 0 2024-05-09T06:29:44.028 INFO:tasks.workunit.client.1.smithi079.stdout:8/897: creat d1/d5/d36/da0/d132/d6c/d6b/f139 x:0 0 0 2024-05-09T06:29:44.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/996: rmdir d1a/d1c/d22/d90 39 2024-05-09T06:29:44.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/997: truncate d1a/d82/d87/db2/ddb/f14b 448400 0 2024-05-09T06:29:44.028 INFO:tasks.workunit.client.1.smithi079.stdout:3/998: readlink d1a/d21/db0/dd4/d3a/d54/d55/df3/l14e 0 2024-05-09T06:29:44.028 INFO:tasks.workunit.client.1.smithi079.stdout:8/898: creat d1/d64/f13a x:0 0 0 2024-05-09T06:29:44.028 INFO:tasks.workunit.client.1.smithi079.stdout:1/938: dwrite d0/d12/d48/d75/d26/f76 [0,4194304] 0 2024-05-09T06:29:44.031 INFO:tasks.workunit.client.1.smithi079.stdout:2/980: creat d8/db/d5c/d6b/f161 x:0 0 0 2024-05-09T06:29:44.036 INFO:tasks.workunit.client.1.smithi079.stdout:3/999: truncate d1a/d21/db0/dd4/d34/d42/f47 3538834 0 2024-05-09T06:29:44.037 INFO:tasks.workunit.client.1.smithi079.stdout:7/783: sync 2024-05-09T06:29:44.038 INFO:tasks.workunit.client.1.smithi079.stdout:8/899: dread d1/d5/d36/da0/fb3 [0,4194304] 0 2024-05-09T06:29:44.038 INFO:tasks.workunit.client.1.smithi079.stdout:8/900: creat d1/d5/d36/d102/f13b x:0 0 0 2024-05-09T06:29:44.043 INFO:tasks.workunit.client.1.smithi079.stdout:0/872: dwrite d3/dd/d66/d6d/d74/d80/d76/dcc/ff3 [0,4194304] 0 2024-05-09T06:29:44.043 INFO:tasks.workunit.client.1.smithi079.stdout:7/784: creat d4/d7/dd/d5b/d32/de9/ff3 x:0 0 0 2024-05-09T06:29:44.043 INFO:tasks.workunit.client.1.smithi079.stdout:7/785: stat d4/d7/d22/d28/d50/d5c/fad 0 2024-05-09T06:29:44.044 INFO:tasks.workunit.client.1.smithi079.stdout:7/786: write d4/d7/dd/d5b/f5d [3347424,73649] 0 2024-05-09T06:29:44.047 INFO:tasks.workunit.client.1.smithi079.stdout:8/901: rename d1/d5/d36/da0/d132/d6c/l12d to d1/d5/d36/d102/d33/d5d/d6d/l13c 0 2024-05-09T06:29:44.047 INFO:tasks.workunit.client.1.smithi079.stdout:8/902: read - d1/d5/d36/d102/dc3/dff/f12a zero size 2024-05-09T06:29:44.047 INFO:tasks.workunit.client.1.smithi079.stdout:8/903: read d1/d3/fa [1751384,5379] 0 2024-05-09T06:29:44.047 INFO:tasks.workunit.client.1.smithi079.stdout:8/904: write d1/d5/d36/d102/dc3/d82/dda/fe0 [673071,103661] 0 2024-05-09T06:29:44.050 INFO:tasks.workunit.client.1.smithi079.stdout:0/873: unlink d3/dd/d66/f72 0 2024-05-09T06:29:44.050 INFO:tasks.workunit.client.1.smithi079.stdout:2/981: dwrite d8/db/dc/d2c/d2e/f10f [0,4194304] 0 2024-05-09T06:29:44.051 INFO:tasks.workunit.client.1.smithi079.stdout:8/905: dread d1/d56/d7c/fcf [0,4194304] 0 2024-05-09T06:29:44.051 INFO:tasks.workunit.client.1.smithi079.stdout:8/906: truncate d1/d5/d36/d102/f45 5197699 0 2024-05-09T06:29:44.051 INFO:tasks.workunit.client.1.smithi079.stdout:8/907: fdatasync d1/d5/d36/d102/dc3/f9f 0 2024-05-09T06:29:44.051 INFO:tasks.workunit.client.1.smithi079.stdout:8/908: getdents d1/d5/dc 0 2024-05-09T06:29:44.052 INFO:tasks.workunit.client.1.smithi079.stdout:7/787: creat d4/d7/d78/ff4 x:0 0 0 2024-05-09T06:29:44.053 INFO:tasks.workunit.client.0.smithi062.stderr:++ readlink -f fsstress 2024-05-09T06:29:44.054 INFO:tasks.workunit.client.1.smithi079.stdout:0/874: mkdir d3/dd/d66/de9/d11a 0 2024-05-09T06:29:44.054 INFO:tasks.workunit.client.1.smithi079.stdout:0/875: truncate d3/dd/d1f/d1e/d2c/d35/d36/f3d 3040822 0 2024-05-09T06:29:44.054 INFO:tasks.workunit.client.1.smithi079.stdout:0/876: stat d3/dd/d1f/d1e/d2c/d88 0 2024-05-09T06:29:44.054 INFO:tasks.workunit.client.1.smithi079.stdout:0/877: dread - d3/dd/d1f/d1e/d2c/d35/d36/d93/f109 zero size 2024-05-09T06:29:44.055 INFO:tasks.workunit.client.0.smithi062.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-09T06:29:44.055 INFO:tasks.workunit.client.0.smithi062.stderr:+ popd 2024-05-09T06:29:44.055 INFO:tasks.workunit.client.0.smithi062.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T06:29:44.055 INFO:tasks.workunit.client.0.smithi062.stderr:+ popd 2024-05-09T06:29:44.056 INFO:tasks.workunit.client.0.smithi062.stdout:~/cephtest/mnt.0/client.0/tmp 2024-05-09T06:29:44.056 INFO:tasks.workunit.client.0.smithi062.stderr:++ mktemp -d -p . 2024-05-09T06:29:44.057 INFO:tasks.workunit.client.1.smithi079.stdout:8/909: stat d1/d5/c3e 0 2024-05-09T06:29:44.059 INFO:tasks.workunit.client.1.smithi079.stdout:7/788: mkdir d4/d7/dd/d47/df5 0 2024-05-09T06:29:44.059 INFO:tasks.workunit.client.1.smithi079.stdout:7/789: chown d4/d7/dd/d5b/d31/d34/cb7 11634879 1 2024-05-09T06:29:44.060 INFO:tasks.workunit.client.0.smithi062.stderr:+ T=./tmp.J3rG3Vk4Ur 2024-05-09T06:29:44.060 INFO:tasks.workunit.client.0.smithi062.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.J3rG3Vk4Ur -l 1 -n 1000 -p 10 -v 2024-05-09T06:29:44.061 INFO:tasks.workunit.client.1.smithi079.stdout:2/982: read d8/db/dc/d2c/fa6 [1423919,6708] 0 2024-05-09T06:29:44.063 INFO:tasks.workunit.client.1.smithi079.stdout:8/910: mknod d1/d5/d36/d102/dc3/d82/dda/d110/c13d 0 2024-05-09T06:29:44.063 INFO:tasks.workunit.client.1.smithi079.stdout:8/911: dread - d1/f101 zero size 2024-05-09T06:29:44.064 INFO:tasks.workunit.client.0.smithi062.stdout:seed = 1715284707 2024-05-09T06:29:44.065 INFO:tasks.workunit.client.1.smithi079.stdout:0/878: dread d3/d5/d87/feb [0,4194304] 0 2024-05-09T06:29:44.065 INFO:tasks.workunit.client.1.smithi079.stdout:0/879: stat d3/dd/d1f/d1e/d2c/d88/d8e/de3/ff9 0 2024-05-09T06:29:44.066 INFO:tasks.workunit.client.1.smithi079.stdout:7/790: creat d4/d7/d22/ff6 x:0 0 0 2024-05-09T06:29:44.067 INFO:tasks.workunit.client.1.smithi079.stdout:8/912: write d1/d5/d36/d102/dc3/d50/f5b [1596984,123282] 0 2024-05-09T06:29:44.068 INFO:tasks.workunit.client.1.smithi079.stdout:7/791: dread d4/d7/d22/d28/d50/d5c/d85/fa9 [0,4194304] 0 2024-05-09T06:29:44.075 INFO:tasks.workunit.client.1.smithi079.stdout:2/983: rmdir d8/db/d4b 39 2024-05-09T06:29:44.075 INFO:tasks.workunit.client.1.smithi079.stdout:2/984: chown d8/db/d11/d5f/fae 820 1 2024-05-09T06:29:44.081 INFO:tasks.workunit.client.0.smithi062.stdout:1/0: truncate - no filename 2024-05-09T06:29:44.081 INFO:tasks.workunit.client.0.smithi062.stdout:1/1: rename - no filename 2024-05-09T06:29:44.081 INFO:tasks.workunit.client.0.smithi062.stdout:1/2: truncate - no filename 2024-05-09T06:29:44.083 INFO:tasks.workunit.client.1.smithi079.stdout:2/985: creat d8/db/d4b/d4f/f162 x:0 0 0 2024-05-09T06:29:44.083 INFO:tasks.workunit.client.1.smithi079.stdout:2/986: truncate d8/fa 4522659 0 2024-05-09T06:29:44.084 INFO:tasks.workunit.client.0.smithi062.stdout:0/0: mknod c0 0 2024-05-09T06:29:44.084 INFO:tasks.workunit.client.0.smithi062.stdout:0/1: readlink - no filename 2024-05-09T06:29:44.084 INFO:tasks.workunit.client.0.smithi062.stdout:0/2: dread - no filename 2024-05-09T06:29:44.084 INFO:tasks.workunit.client.0.smithi062.stdout:0/3: truncate - no filename 2024-05-09T06:29:44.085 INFO:tasks.workunit.client.0.smithi062.stdout:4/0: dread - no filename 2024-05-09T06:29:44.085 INFO:tasks.workunit.client.0.smithi062.stdout:4/1: dwrite - no filename 2024-05-09T06:29:44.086 INFO:tasks.workunit.client.0.smithi062.stdout:4/2: dwrite - no filename 2024-05-09T06:29:44.086 INFO:tasks.workunit.client.0.smithi062.stdout:4/3: getdents . 0 2024-05-09T06:29:44.086 INFO:tasks.workunit.client.0.smithi062.stdout:4/4: fdatasync - no filename 2024-05-09T06:29:44.087 INFO:tasks.workunit.client.1.smithi079.stdout:2/987: creat d8/db/d5c/d6b/db5/f163 x:0 0 0 2024-05-09T06:29:44.089 INFO:tasks.workunit.client.0.smithi062.stdout:1/3: creat f0 x:0 0 0 2024-05-09T06:29:44.089 INFO:tasks.workunit.client.0.smithi062.stdout:1/4: creat f1 x:0 0 0 2024-05-09T06:29:44.089 INFO:tasks.workunit.client.0.smithi062.stdout:1/5: write f1 [797919,69363] 0 2024-05-09T06:29:44.090 INFO:tasks.workunit.client.0.smithi062.stdout:0/4: mkdir d1 0 2024-05-09T06:29:44.093 INFO:tasks.workunit.client.0.smithi062.stdout:2/0: truncate - no filename 2024-05-09T06:29:44.108 INFO:tasks.workunit.client.0.smithi062.stdout:4/5: mkdir d0 0 2024-05-09T06:29:44.108 INFO:tasks.workunit.client.0.smithi062.stdout:4/6: dwrite - no filename 2024-05-09T06:29:44.108 INFO:tasks.workunit.client.0.smithi062.stdout:4/7: chown d0 219183329 1 2024-05-09T06:29:44.109 INFO:tasks.workunit.client.0.smithi062.stdout:4/8: dwrite - no filename 2024-05-09T06:29:44.109 INFO:tasks.workunit.client.0.smithi062.stdout:0/5: mknod d1/c2 0 2024-05-09T06:29:44.116 INFO:tasks.workunit.client.0.smithi062.stdout:0/6: link d1/c2 d1/c3 0 2024-05-09T06:29:44.116 INFO:tasks.workunit.client.0.smithi062.stdout:0/7: read - no filename 2024-05-09T06:29:44.116 INFO:tasks.workunit.client.0.smithi062.stdout:0/8: dread - no filename 2024-05-09T06:29:44.119 INFO:tasks.workunit.client.0.smithi062.stdout:0/9: symlink d1/l4 0 2024-05-09T06:29:44.121 INFO:tasks.workunit.client.0.smithi062.stdout:0/10: unlink d1/c2 0 2024-05-09T06:29:44.121 INFO:tasks.workunit.client.0.smithi062.stdout:0/11: dwrite - no filename 2024-05-09T06:29:44.123 INFO:tasks.workunit.client.0.smithi062.stdout:0/12: mknod d1/c5 0 2024-05-09T06:29:44.180 INFO:tasks.workunit.client.1.smithi079.stdout:8/913: dwrite d1/d5/d36/d102/dc3/dff/f12a [0,4194304] 0 2024-05-09T06:29:44.190 INFO:tasks.workunit.client.1.smithi079.stdout:8/914: link d1/l2 d1/d5/d36/d102/dc3/d3b/dc8/l13e 0 2024-05-09T06:29:44.191 INFO:tasks.workunit.client.1.smithi079.stdout:0/880: dwrite d3/dd/f5b [0,4194304] 0 2024-05-09T06:29:44.191 INFO:tasks.workunit.client.1.smithi079.stdout:0/881: write d3/dd/d1f/d1e/d2c/d88/d8e/de3/ff9 [827803,59080] 0 2024-05-09T06:29:44.191 INFO:tasks.workunit.client.1.smithi079.stdout:0/882: fsync d3/dd/d1f/fa 0 2024-05-09T06:29:44.194 INFO:tasks.workunit.client.1.smithi079.stdout:2/988: dwrite d8/db/d59/d67/d86/f154 [0,4194304] 0 2024-05-09T06:29:44.194 INFO:tasks.workunit.client.1.smithi079.stdout:2/989: chown d8/db/dc/d2c/f115 511344 1 2024-05-09T06:29:44.194 INFO:tasks.workunit.client.1.smithi079.stdout:2/990: truncate d8/db/d59/d67/d86/f9e 703878 0 2024-05-09T06:29:44.195 INFO:tasks.workunit.client.1.smithi079.stdout:0/883: mkdir d3/dd/d18/d5e/d69/d11b 0 2024-05-09T06:29:44.195 INFO:tasks.workunit.client.1.smithi079.stdout:0/884: stat d3/dd/d18/d5e/df6 0 2024-05-09T06:29:44.205 INFO:tasks.workunit.client.1.smithi079.stdout:0/885: stat d3/dd/d66/d6d/d74/d80/l3c 0 2024-05-09T06:29:44.208 INFO:tasks.workunit.client.1.smithi079.stdout:2/991: mknod d8/db/d4b/c164 0 2024-05-09T06:29:44.214 INFO:tasks.workunit.client.1.smithi079.stdout:2/992: mkdir d8/db/d59/d67/d7f/db9/d160/d165 0 2024-05-09T06:29:44.215 INFO:tasks.workunit.client.1.smithi079.stdout:0/886: mkdir d3/dd/d1f/d1e/d2c/d35/d36/d11c 0 2024-05-09T06:29:44.218 INFO:tasks.workunit.client.1.smithi079.stdout:0/887: rmdir d3/dd/d66/d6d/d74/d80/d76 39 2024-05-09T06:29:44.232 INFO:tasks.workunit.client.1.smithi079.stdout:0/888: dread d3/dd/d66/d6d/d74/d80/d76/dcc/f105 [0,4194304] 0 2024-05-09T06:29:44.235 INFO:tasks.workunit.client.1.smithi079.stdout:0/889: unlink d3/dd/d18/c1b 0 2024-05-09T06:29:44.244 INFO:tasks.workunit.client.1.smithi079.stdout:0/890: rmdir d3/dd/d1f/d1e/d2c/d88/d8e/de3 39 2024-05-09T06:29:44.244 INFO:tasks.workunit.client.1.smithi079.stdout:0/891: chown d3/dd/d1f/c25 1153257 1 2024-05-09T06:29:44.273 INFO:tasks.workunit.client.0.smithi062.stdout:3/0: stat - no entries 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:3/1: dwrite - no filename 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:3/2: dwrite - no filename 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:3/3: write - no filename 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:6/0: rename - no filename 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:3/4: dread - no filename 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:3/5: fdatasync - no filename 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:3/6: rename - no filename 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:6/1: dread - no filename 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:3/7: rmdir - no directory 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:6/2: link - no file 2024-05-09T06:29:44.274 INFO:tasks.workunit.client.0.smithi062.stdout:6/3: chown . 24614480 1 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:6/4: unlink - no file 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:9/0: link - no file 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:9/1: readlink - no filename 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:9/2: rmdir - no directory 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:7/0: dwrite - no filename 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:8/0: rename - no filename 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:8/1: write - no filename 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:7/1: unlink - no file 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:8/2: write - no filename 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:8/3: rename - no filename 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:7/2: dwrite - no filename 2024-05-09T06:29:44.275 INFO:tasks.workunit.client.0.smithi062.stdout:8/4: dwrite - no filename 2024-05-09T06:29:44.276 INFO:tasks.workunit.client.0.smithi062.stdout:7/3: write - no filename 2024-05-09T06:29:44.276 INFO:tasks.workunit.client.0.smithi062.stdout:7/4: dwrite - no filename 2024-05-09T06:29:44.276 INFO:tasks.workunit.client.0.smithi062.stdout:7/5: dwrite - no filename 2024-05-09T06:29:44.276 INFO:tasks.workunit.client.0.smithi062.stdout:7/6: write - no filename 2024-05-09T06:29:44.278 INFO:tasks.workunit.client.1.smithi079.stdout:8/915: dwrite d1/d5/d36/da0/d132/d6c/dbf/dc9/fd9 [4194304,4194304] 0 2024-05-09T06:29:44.278 INFO:tasks.workunit.client.0.smithi062.stdout:3/8: symlink l0 0 2024-05-09T06:29:44.278 INFO:tasks.workunit.client.0.smithi062.stdout:3/9: stat l0 0 2024-05-09T06:29:44.278 INFO:tasks.workunit.client.0.smithi062.stdout:3/10: truncate - no filename 2024-05-09T06:29:44.279 INFO:tasks.workunit.client.1.smithi079.stdout:7/792: dwrite d4/d7/dd/d5b/f5d [0,4194304] 0 2024-05-09T06:29:44.279 INFO:tasks.workunit.client.1.smithi079.stdout:7/793: write d4/d7/d22/d28/d74/f76 [5057876,70426] 0 2024-05-09T06:29:44.281 INFO:tasks.workunit.client.0.smithi062.stdout:6/5: creat f0 x:0 0 0 2024-05-09T06:29:44.283 INFO:tasks.workunit.client.0.smithi062.stdout:4/9: symlink d0/l1 0 2024-05-09T06:29:44.285 INFO:tasks.workunit.client.1.smithi079.stdout:8/916: creat d1/d5/dc/f13f x:0 0 0 2024-05-09T06:29:44.286 INFO:tasks.workunit.client.1.smithi079.stdout:8/917: fsync d1/d5/d36/d102/dc3/d44/da4/fd5 0 2024-05-09T06:29:44.286 INFO:tasks.workunit.client.0.smithi062.stdout:9/3: mknod c0 0 2024-05-09T06:29:44.289 INFO:tasks.workunit.client.0.smithi062.stdout:8/5: mknod c0 0 2024-05-09T06:29:44.289 INFO:tasks.workunit.client.0.smithi062.stdout:8/6: truncate - no filename 2024-05-09T06:29:44.289 INFO:tasks.workunit.client.0.smithi062.stdout:8/7: dread - no filename 2024-05-09T06:29:44.294 INFO:tasks.workunit.client.1.smithi079.stdout:7/794: getdents d4/d7/d22/d28 0 2024-05-09T06:29:44.299 INFO:tasks.workunit.client.1.smithi079.stdout:7/795: creat d4/d7/dd/d47/df5/ff7 x:0 0 0 2024-05-09T06:29:44.301 INFO:tasks.workunit.client.0.smithi062.stdout:0/13: rmdir d1 39 2024-05-09T06:29:44.305 INFO:tasks.workunit.client.0.smithi062.stdout:3/11: mkdir d1 0 2024-05-09T06:29:44.305 INFO:tasks.workunit.client.0.smithi062.stdout:3/12: readlink l0 0 2024-05-09T06:29:44.305 INFO:tasks.workunit.client.0.smithi062.stdout:3/13: rename d1 to d1/d2 22 2024-05-09T06:29:44.307 INFO:tasks.workunit.client.1.smithi079.stdout:8/918: write d1/f91 [1285513,96118] 0 2024-05-09T06:29:44.307 INFO:tasks.workunit.client.1.smithi079.stdout:8/919: dread - d1/d3/f123 zero size 2024-05-09T06:29:44.307 INFO:tasks.workunit.client.1.smithi079.stdout:8/920: chown d1/d5/d36/d102/cfd 340 1 2024-05-09T06:29:44.308 INFO:tasks.workunit.client.0.smithi062.stdout:6/6: rename f0 to f1 0 2024-05-09T06:29:44.308 INFO:tasks.workunit.client.0.smithi062.stdout:6/7: dread - f1 zero size 2024-05-09T06:29:44.309 INFO:tasks.workunit.client.0.smithi062.stdout:4/10: mkdir d0/d2 0 2024-05-09T06:29:44.310 INFO:tasks.workunit.client.0.smithi062.stdout:4/11: dread - no filename 2024-05-09T06:29:44.310 INFO:tasks.workunit.client.0.smithi062.stdout:4/12: dwrite - no filename 2024-05-09T06:29:44.314 INFO:tasks.workunit.client.1.smithi079.stdout:0/892: dwrite d3/dd/d1f/f28 [0,4194304] 0 2024-05-09T06:29:44.315 INFO:tasks.workunit.client.1.smithi079.stdout:8/921: mknod d1/d5/d36/d102/dc3/d50/c140 0 2024-05-09T06:29:44.315 INFO:tasks.workunit.client.1.smithi079.stdout:2/993: dwrite d8/db/d59/d67/d86/f9e [0,4194304] 0 2024-05-09T06:29:44.319 INFO:tasks.workunit.client.1.smithi079.stdout:0/893: rmdir d3/dd/d66/d6d/d74/d80/d76 39 2024-05-09T06:29:44.319 INFO:tasks.workunit.client.1.smithi079.stdout:0/894: write d3/dd/d66/d6d/d74/d80/d2d/d90/f118 [1033321,26053] 0 2024-05-09T06:29:44.319 INFO:tasks.workunit.client.1.smithi079.stdout:0/895: stat d3/d5/ce2 0 2024-05-09T06:29:44.319 INFO:tasks.workunit.client.1.smithi079.stdout:0/896: chown d3/dd/d66/d6d/d74/d80/d76/caf 455678 1 2024-05-09T06:29:44.320 INFO:tasks.workunit.client.1.smithi079.stdout:7/796: dwrite d4/d7/d37/d7c/f8f [0,4194304] 0 2024-05-09T06:29:44.322 INFO:tasks.workunit.client.0.smithi062.stdout:9/4: rename c0 to c1 0 2024-05-09T06:29:44.324 INFO:tasks.workunit.client.1.smithi079.stdout:8/922: write d1/d5/d36/da0/ff9 [2490104,30406] 0 2024-05-09T06:29:44.326 INFO:tasks.workunit.client.0.smithi062.stdout:8/8: creat f1 x:0 0 0 2024-05-09T06:29:44.326 INFO:tasks.workunit.client.0.smithi062.stdout:8/9: readlink - no filename 2024-05-09T06:29:44.329 INFO:tasks.workunit.client.1.smithi079.stdout:7/797: mknod d4/d7/d22/d28/cf8 0 2024-05-09T06:29:44.335 INFO:tasks.workunit.client.1.smithi079.stdout:2/994: getdents d8/db/d4b/d4f 0 2024-05-09T06:29:44.336 INFO:tasks.workunit.client.0.smithi062.stdout:0/14: rmdir d1 39 2024-05-09T06:29:44.336 INFO:tasks.workunit.client.0.smithi062.stdout:0/15: dread - no filename 2024-05-09T06:29:44.336 INFO:tasks.workunit.client.1.smithi079.stdout:0/897: dread d3/dd/fb0 [0,4194304] 0 2024-05-09T06:29:44.338 INFO:tasks.workunit.client.1.smithi079.stdout:7/798: link d4/d20/f48 d4/d7/ff9 0 2024-05-09T06:29:44.344 INFO:tasks.workunit.client.1.smithi079.stdout:1/939: sync 2024-05-09T06:29:44.344 INFO:tasks.workunit.client.1.smithi079.stdout:2/995: link d8/db/d59/c9f d8/db/d59/d93/dc7/dd9/c166 0 2024-05-09T06:29:44.350 INFO:tasks.workunit.client.0.smithi062.stdout:3/14: creat d1/f3 x:0 0 0 2024-05-09T06:29:44.352 INFO:tasks.workunit.client.1.smithi079.stdout:2/996: rename d8/db/c20 to d8/db/d11/d5f/d130/d88/c167 0 2024-05-09T06:29:44.352 INFO:tasks.workunit.client.1.smithi079.stdout:1/940: dread d0/d12/d92/f9a [0,4194304] 0 2024-05-09T06:29:44.353 INFO:tasks.workunit.client.0.smithi062.stdout:6/8: mknod c2 0 2024-05-09T06:29:44.356 INFO:tasks.workunit.client.1.smithi079.stdout:0/898: mkdir d3/dd/d1f/d1e/d2c/d35/d36/d11d 0 2024-05-09T06:29:44.356 INFO:tasks.workunit.client.1.smithi079.stdout:0/899: write d3/dd/d66/d6d/d74/d80/d76/fa0 [397948,40141] 0 2024-05-09T06:29:44.357 INFO:tasks.workunit.client.0.smithi062.stdout:8/10: dwrite f1 [0,4194304] 0 2024-05-09T06:29:44.357 INFO:tasks.workunit.client.0.smithi062.stdout:8/11: readlink - no filename 2024-05-09T06:29:44.357 INFO:tasks.workunit.client.0.smithi062.stdout:4/13: creat d0/d2/f3 x:0 0 0 2024-05-09T06:29:44.364 INFO:tasks.workunit.client.0.smithi062.stdout:6/9: symlink l3 0 2024-05-09T06:29:44.369 INFO:tasks.workunit.client.0.smithi062.stdout:4/14: link d0/d2/f3 d0/d2/f4 0 2024-05-09T06:29:44.369 INFO:tasks.workunit.client.0.smithi062.stdout:4/15: write d0/d2/f3 [1040521,8871] 0 2024-05-09T06:29:44.371 INFO:tasks.workunit.client.1.smithi079.stdout:0/900: dread d3/dd/d1f/d1e/d91/fb8 [0,4194304] 0 2024-05-09T06:29:44.371 INFO:tasks.workunit.client.1.smithi079.stdout:0/901: fsync d3/dd/d66/fe8 0 2024-05-09T06:29:44.373 INFO:tasks.workunit.client.1.smithi079.stdout:0/902: symlink d3/dd/d18/d5e/d69/d11b/l11e 0 2024-05-09T06:29:44.373 INFO:tasks.workunit.client.1.smithi079.stdout:0/903: chown d3/dd/d66/d6d/d74/d80/d76/dcc/dd9/ff7 72209065 1 2024-05-09T06:29:44.373 INFO:tasks.workunit.client.1.smithi079.stdout:0/904: dread - d3/dd/d66/d6d/d74/d80/d2d/f70 zero size 2024-05-09T06:29:44.373 INFO:tasks.workunit.client.1.smithi079.stdout:0/905: mkdir d3/dd/d66/d6d/d74/d80/d2d/d90/d11f 0 2024-05-09T06:29:44.375 INFO:tasks.workunit.client.1.smithi079.stdout:0/906: mknod d3/dd/d66/de9/d11a/c120 0 2024-05-09T06:29:44.376 INFO:tasks.workunit.client.1.smithi079.stdout:0/907: mknod d3/dd/d18/d5e/d69/c121 0 2024-05-09T06:29:44.376 INFO:tasks.workunit.client.1.smithi079.stdout:0/908: creat d3/dd/d66/d6d/d74/d80/d2d/d90/f122 x:0 0 0 2024-05-09T06:29:44.378 INFO:tasks.workunit.client.1.smithi079.stdout:7/799: dwrite d4/d7/dd/d5b/d31/d34/fa6 [4194304,4194304] 0 2024-05-09T06:29:44.378 INFO:tasks.workunit.client.1.smithi079.stdout:7/800: readlink d4/d7/dd/d5b/d32/l95 0 2024-05-09T06:29:44.378 INFO:tasks.workunit.client.0.smithi062.stdout:3/15: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:29:44.378 INFO:tasks.workunit.client.0.smithi062.stdout:3/16: chown l0 90665468 1 2024-05-09T06:29:44.379 INFO:tasks.workunit.client.1.smithi079.stdout:2/997: dwrite d8/db/d59/d67/d7f/db9/de1/ffd [0,4194304] 0 2024-05-09T06:29:44.379 INFO:tasks.workunit.client.1.smithi079.stdout:1/941: dwrite d0/d12/d67/d53/dbf/dd2/d4e/f6c [8388608,4194304] 0 2024-05-09T06:29:44.379 INFO:tasks.workunit.client.1.smithi079.stdout:1/942: chown d0/d12/d67/d93/fa1 8 1 2024-05-09T06:29:44.379 INFO:tasks.workunit.client.1.smithi079.stdout:0/909: rename d3/dd/d66/d6d/d74/d80/d2d/f2e to d3/dd/d1f/d1e/d2c/d7f/de0/f123 0 2024-05-09T06:29:44.382 INFO:tasks.workunit.client.1.smithi079.stdout:7/801: symlink d4/d7/d37/d7c/d8e/dd8/lfa 0 2024-05-09T06:29:44.382 INFO:tasks.workunit.client.1.smithi079.stdout:7/802: stat d4/d7/d22/d28/d50/d5c/d85/db6/fc4 0 2024-05-09T06:29:44.383 INFO:tasks.workunit.client.1.smithi079.stdout:7/803: chown d4 5084433 1 2024-05-09T06:29:44.385 INFO:tasks.workunit.client.0.smithi062.stdout:3/17: mknod d1/c4 0 2024-05-09T06:29:44.388 INFO:tasks.workunit.client.1.smithi079.stdout:2/998: link d8/db/d59/d67/d7f/db9/dca/cd2 d8/db/d59/d67/d7f/db9/d160/c168 0 2024-05-09T06:29:44.389 INFO:tasks.workunit.client.0.smithi062.stdout:3/18: mknod d1/c5 0 2024-05-09T06:29:44.392 INFO:tasks.workunit.client.1.smithi079.stdout:1/943: link d0/d12/d48/d75/d43/d20/fd8 d0/df/db8/f140 0 2024-05-09T06:29:44.393 INFO:tasks.workunit.client.0.smithi062.stdout:3/19: mknod d1/c6 0 2024-05-09T06:29:44.395 INFO:tasks.workunit.client.1.smithi079.stdout:7/804: symlink d4/d20/lfb 0 2024-05-09T06:29:44.395 INFO:tasks.workunit.client.1.smithi079.stdout:7/805: truncate d4/d7/d22/d28/fd1 4819896 0 2024-05-09T06:29:44.396 INFO:tasks.workunit.client.1.smithi079.stdout:2/999: mkdir d8/db/d11/d5f/d130/d88/d169 0 2024-05-09T06:29:44.397 INFO:tasks.workunit.client.1.smithi079.stdout:0/910: mknod d3/dd/d66/d6d/d74/d80/c124 0 2024-05-09T06:29:44.399 INFO:tasks.workunit.client.1.smithi079.stdout:1/944: rename d0/d12/d48/d75/l37 to d0/d12/d67/d53/dbf/dd2/d4e/d7d/l141 0 2024-05-09T06:29:44.400 INFO:tasks.workunit.client.1.smithi079.stdout:7/806: mkdir d4/d7/d22/d28/d50/d5c/ddc/dfc 0 2024-05-09T06:29:44.401 INFO:tasks.workunit.client.1.smithi079.stdout:0/911: unlink d3/dd/d1f/d1e/l99 0 2024-05-09T06:29:44.402 INFO:tasks.workunit.client.1.smithi079.stdout:1/945: rename d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6/c13f to d0/d12/d67/d53/dbf/dd2/d3e/c142 0 2024-05-09T06:29:44.403 INFO:tasks.workunit.client.1.smithi079.stdout:7/807: rmdir d4/d9e 39 2024-05-09T06:29:44.404 INFO:tasks.workunit.client.1.smithi079.stdout:1/946: truncate d0/d12/d48/d75/d43/d20/f4f 248748 0 2024-05-09T06:29:44.404 INFO:tasks.workunit.client.1.smithi079.stdout:7/808: rmdir d4/d7 39 2024-05-09T06:29:44.406 INFO:tasks.workunit.client.1.smithi079.stdout:1/947: creat d0/f143 x:0 0 0 2024-05-09T06:29:44.407 INFO:tasks.workunit.client.1.smithi079.stdout:1/948: symlink d0/d12/d48/d75/d43/d20/l144 0 2024-05-09T06:29:44.408 INFO:tasks.workunit.client.1.smithi079.stdout:1/949: rmdir d0/d12/d67/d53/dbf/dd2/d4e/d7d 39 2024-05-09T06:29:44.409 INFO:tasks.workunit.client.1.smithi079.stdout:1/950: write d0/df/db8/f140 [366543,116212] 0 2024-05-09T06:29:44.410 INFO:tasks.workunit.client.1.smithi079.stdout:1/951: mkdir d0/d12/d67/d53/dbf/dd2/d3e/d127/d145 0 2024-05-09T06:29:44.410 INFO:tasks.workunit.client.1.smithi079.stdout:1/952: fdatasync d0/df/f14 0 2024-05-09T06:29:44.411 INFO:tasks.workunit.client.1.smithi079.stdout:0/912: read d3/d5/f21 [2931683,20903] 0 2024-05-09T06:29:44.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:44 smithi062 ceph-mon[26920]: pgmap v251: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 183 MiB/s rd, 232 MiB/s wr, 400 op/s 2024-05-09T06:29:44.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:44 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:44.414 INFO:tasks.workunit.client.1.smithi079.stdout:0/913: symlink d3/dd/d1f/d1e/d2c/d7f/de0/l125 0 2024-05-09T06:29:44.417 INFO:tasks.workunit.client.1.smithi079.stdout:0/914: unlink d3/dd/d66/d6d/d74/d80/d76/dcc/ff3 0 2024-05-09T06:29:44.417 INFO:tasks.workunit.client.1.smithi079.stdout:0/915: dread - d3/dd/d71/ff0 zero size 2024-05-09T06:29:44.420 INFO:tasks.workunit.client.1.smithi079.stdout:0/916: creat d3/dd/d1f/d1e/d2c/d35/d36/d11d/f126 x:0 0 0 2024-05-09T06:29:44.420 INFO:tasks.workunit.client.1.smithi079.stdout:7/809: dwrite d4/d7/d78/f97 [0,4194304] 0 2024-05-09T06:29:44.424 INFO:tasks.workunit.client.1.smithi079.stdout:7/810: chown d4/d7/dd/f1e 78 1 2024-05-09T06:29:44.424 INFO:tasks.workunit.client.1.smithi079.stdout:7/811: fsync d4/d7/dd/f42 0 2024-05-09T06:29:44.426 INFO:tasks.workunit.client.1.smithi079.stdout:0/917: mknod d3/dd/d66/d6d/d74/d80/c127 0 2024-05-09T06:29:44.426 INFO:tasks.workunit.client.1.smithi079.stdout:0/918: dread - d3/dd/d1f/d1e/d2c/d88/f8b zero size 2024-05-09T06:29:44.429 INFO:tasks.workunit.client.1.smithi079.stdout:0/919: creat d3/dd/d66/d6d/d74/d80/d76/dcc/f128 x:0 0 0 2024-05-09T06:29:44.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/5: getdents . 0 2024-05-09T06:29:44.432 INFO:tasks.workunit.client.1.smithi079.stdout:0/920: creat d3/dd/d66/d6d/d74/d80/d2d/da7/dce/d101/f129 x:0 0 0 2024-05-09T06:29:44.432 INFO:tasks.workunit.client.0.smithi062.stdout:9/6: symlink l2 0 2024-05-09T06:29:44.434 INFO:tasks.workunit.client.1.smithi079.stdout:1/953: dwrite d0/d12/f12c [0,4194304] 0 2024-05-09T06:29:44.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/921: rmdir d3/dd/d18/d5e/df6 0 2024-05-09T06:29:44.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/922: readlink d3/dd/d66/d6d/d74/d84/lab 0 2024-05-09T06:29:44.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/923: fdatasync d3/d5/d87/f94 0 2024-05-09T06:29:44.440 INFO:tasks.workunit.client.0.smithi062.stdout:9/7: mkdir d3 0 2024-05-09T06:29:44.440 INFO:tasks.workunit.client.0.smithi062.stdout:9/8: dwrite - no filename 2024-05-09T06:29:44.440 INFO:tasks.workunit.client.0.smithi062.stdout:9/9: dwrite - no filename 2024-05-09T06:29:44.440 INFO:tasks.workunit.client.0.smithi062.stdout:9/10: truncate - no filename 2024-05-09T06:29:44.440 INFO:tasks.workunit.client.0.smithi062.stdout:9/11: dread - no filename 2024-05-09T06:29:44.444 INFO:tasks.workunit.client.1.smithi079.stdout:0/924: unlink d3/dd/d1f/d1e/d2c/d35/fc2 0 2024-05-09T06:29:44.446 INFO:tasks.workunit.client.0.smithi062.stdout:9/12: creat d3/f4 x:0 0 0 2024-05-09T06:29:44.446 INFO:tasks.workunit.client.0.smithi062.stdout:9/13: creat d3/f5 x:0 0 0 2024-05-09T06:29:44.455 INFO:tasks.workunit.client.1.smithi079.stdout:1/954: dwrite d0/d12/d67/d53/d6d/fd6 [0,4194304] 0 2024-05-09T06:29:44.455 INFO:tasks.workunit.client.1.smithi079.stdout:1/955: stat d0/d12/d67/d53/d6d/f120 0 2024-05-09T06:29:44.458 INFO:tasks.workunit.client.1.smithi079.stdout:1/956: write d0/d12/d92/ffe [2003913,35520] 0 2024-05-09T06:29:44.458 INFO:tasks.workunit.client.1.smithi079.stdout:1/957: dread - d0/d12/d67/db6/d89/f116 zero size 2024-05-09T06:29:44.496 INFO:tasks.workunit.client.1.smithi079.stdout:0/925: creat d3/dd/d1f/d1e/d2c/d7f/de0/f12a x:0 0 0 2024-05-09T06:29:44.498 INFO:tasks.workunit.client.1.smithi079.stdout:8/923: write d1/d5/d36/da0/fb3 [91205,130978] 0 2024-05-09T06:29:44.498 INFO:tasks.workunit.client.1.smithi079.stdout:8/924: write d1/d5/d36/d102/dc3/d3b/f52 [1860360,72834] 0 2024-05-09T06:29:44.498 INFO:tasks.workunit.client.1.smithi079.stdout:8/925: rename d1/d3/dc4 to d1/d3/dc4/d141 22 2024-05-09T06:29:44.498 INFO:tasks.workunit.client.1.smithi079.stdout:0/926: dread d3/dd/d66/d6d/f8d [0,4194304] 0 2024-05-09T06:29:44.502 INFO:tasks.workunit.client.0.smithi062.stdout:0/16: chown d1/c3 168 1 2024-05-09T06:29:44.502 INFO:tasks.workunit.client.0.smithi062.stdout:0/17: dwrite - no filename 2024-05-09T06:29:44.502 INFO:tasks.workunit.client.0.smithi062.stdout:0/18: write - no filename 2024-05-09T06:29:44.502 INFO:tasks.workunit.client.0.smithi062.stdout:0/19: dwrite - no filename 2024-05-09T06:29:44.502 INFO:tasks.workunit.client.0.smithi062.stdout:0/20: fsync - no filename 2024-05-09T06:29:44.502 INFO:tasks.workunit.client.0.smithi062.stdout:0/21: stat d1/c3 0 2024-05-09T06:29:44.525 INFO:tasks.workunit.client.0.smithi062.stdout:6/10: getdents . 0 2024-05-09T06:29:44.529 INFO:tasks.workunit.client.0.smithi062.stdout:8/12: truncate f1 769133 0 2024-05-09T06:29:44.529 INFO:tasks.workunit.client.0.smithi062.stdout:8/13: creat f2 x:0 0 0 2024-05-09T06:29:44.529 INFO:tasks.workunit.client.0.smithi062.stdout:8/14: write f2 [945280,111128] 0 2024-05-09T06:29:44.533 INFO:tasks.workunit.client.0.smithi062.stdout:4/16: truncate d0/d2/f3 840454 0 2024-05-09T06:29:44.533 INFO:tasks.workunit.client.0.smithi062.stdout:4/17: chown d0/l1 755504256 1 2024-05-09T06:29:44.533 INFO:tasks.workunit.client.0.smithi062.stdout:4/18: chown d0/d2 165 1 2024-05-09T06:29:44.541 INFO:tasks.workunit.client.0.smithi062.stdout:6/11: creat f4 x:0 0 0 2024-05-09T06:29:44.548 INFO:tasks.workunit.client.1.smithi079.stdout:1/958: mkdir d0/d12/dc0/dd4/df3/d146 0 2024-05-09T06:29:44.548 INFO:tasks.workunit.client.1.smithi079.stdout:1/959: read d0/d12/d67/d53/fce [4592,56085] 0 2024-05-09T06:29:44.549 INFO:tasks.workunit.client.0.smithi062.stdout:4/19: rmdir d0 39 2024-05-09T06:29:44.557 INFO:tasks.workunit.client.0.smithi062.stdout:6/12: read - f1 zero size 2024-05-09T06:29:44.566 INFO:tasks.workunit.client.0.smithi062.stdout:0/22: symlink d1/l6 0 2024-05-09T06:29:44.566 INFO:tasks.workunit.client.0.smithi062.stdout:0/23: read - no filename 2024-05-09T06:29:44.566 INFO:tasks.workunit.client.0.smithi062.stdout:0/24: truncate - no filename 2024-05-09T06:29:44.566 INFO:tasks.workunit.client.0.smithi062.stdout:0/25: dwrite - no filename 2024-05-09T06:29:44.576 INFO:tasks.workunit.client.0.smithi062.stdout:0/26: rename d1 to d1/d7 22 2024-05-09T06:29:44.576 INFO:tasks.workunit.client.0.smithi062.stdout:0/27: readlink d1/l6 0 2024-05-09T06:29:44.583 INFO:tasks.workunit.client.0.smithi062.stdout:0/28: creat d1/f8 x:0 0 0 2024-05-09T06:29:44.586 INFO:tasks.workunit.client.0.smithi062.stdout:0/29: chown d1/c3 23959343 1 2024-05-09T06:29:44.592 INFO:tasks.workunit.client.1.smithi079.stdout:7/812: write d4/d7/f6e [1488941,50204] 0 2024-05-09T06:29:44.592 INFO:tasks.workunit.client.1.smithi079.stdout:7/813: write d4/d7/d22/d28/d50/d5c/d85/db6/ff2 [421679,86116] 0 2024-05-09T06:29:44.592 INFO:tasks.workunit.client.1.smithi079.stdout:7/814: fdatasync d4/d7/d22/fd5 0 2024-05-09T06:29:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:44 smithi079 ceph-mon[35268]: pgmap v251: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 183 MiB/s rd, 232 MiB/s wr, 400 op/s 2024-05-09T06:29:44.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:44 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:44.608 INFO:tasks.workunit.client.1.smithi079.stdout:7/815: dwrite d4/d7/f18 [0,4194304] 0 2024-05-09T06:29:44.673 INFO:tasks.workunit.client.1.smithi079.stdout:8/926: mknod d1/d5/d36/dae/dbe/c142 0 2024-05-09T06:29:44.673 INFO:tasks.workunit.client.1.smithi079.stdout:0/927: readlink d3/dd/d1f/d1e/d2c/d35/d36/l52 0 2024-05-09T06:29:44.677 INFO:tasks.workunit.client.1.smithi079.stdout:7/816: mkdir d4/d7/d22/d28/d50/dfd 0 2024-05-09T06:29:44.677 INFO:tasks.workunit.client.1.smithi079.stdout:7/817: write d4/d7/dd/d5b/f99 [1873451,52211] 0 2024-05-09T06:29:44.677 INFO:tasks.workunit.client.1.smithi079.stdout:7/818: write d4/d7/dd/d47/fee [782250,28217] 0 2024-05-09T06:29:44.677 INFO:tasks.workunit.client.1.smithi079.stdout:8/927: mkdir d1/d5/d36/da0/d132/d6c/dbf/dc9/d143 0 2024-05-09T06:29:44.679 INFO:tasks.workunit.client.1.smithi079.stdout:0/928: creat d3/dd/d1f/d1e/d2c/d7f/f12b x:0 0 0 2024-05-09T06:29:44.682 INFO:tasks.workunit.client.1.smithi079.stdout:8/928: unlink d1/d5/d36/fb8 0 2024-05-09T06:29:44.682 INFO:tasks.workunit.client.1.smithi079.stdout:8/929: truncate d1/d5/d36/d102/dc3/d3f/f69 4347185 0 2024-05-09T06:29:44.682 INFO:tasks.workunit.client.1.smithi079.stdout:8/930: fdatasync d1/f8 0 2024-05-09T06:29:44.682 INFO:tasks.workunit.client.1.smithi079.stdout:8/931: stat d1/d56/fe6 0 2024-05-09T06:29:44.683 INFO:tasks.workunit.client.1.smithi079.stdout:0/929: symlink d3/dd/d18/d5e/d69/d11b/l12c 0 2024-05-09T06:29:44.684 INFO:tasks.workunit.client.1.smithi079.stdout:8/932: mkdir d1/d5/d36/d102/dc3/d3f/d144 0 2024-05-09T06:29:44.686 INFO:tasks.workunit.client.1.smithi079.stdout:7/819: write d4/d7/dd/d5b/d31/f33 [2452672,54017] 0 2024-05-09T06:29:44.686 INFO:tasks.workunit.client.0.smithi062.stdout:9/14: rmdir d3 39 2024-05-09T06:29:44.686 INFO:tasks.workunit.client.0.smithi062.stdout:9/15: fsync d3/f5 0 2024-05-09T06:29:44.687 INFO:tasks.workunit.client.1.smithi079.stdout:0/930: getdents d3/dd/d1f/d1e/d2c/d35/d36 0 2024-05-09T06:29:44.687 INFO:tasks.workunit.client.1.smithi079.stdout:0/931: fdatasync d3/dd/d1f/d1e/d2c/dc0/fd4 0 2024-05-09T06:29:44.690 INFO:tasks.workunit.client.0.smithi062.stdout:9/16: creat d3/f6 x:0 0 0 2024-05-09T06:29:44.690 INFO:tasks.workunit.client.0.smithi062.stdout:9/17: chown d3/f4 1 1 2024-05-09T06:29:44.690 INFO:tasks.workunit.client.0.smithi062.stdout:9/18: dread - d3/f6 zero size 2024-05-09T06:29:44.690 INFO:tasks.workunit.client.0.smithi062.stdout:9/19: truncate d3/f4 561446 0 2024-05-09T06:29:44.694 INFO:tasks.workunit.client.1.smithi079.stdout:8/933: dread d1/db/fa9 [0,4194304] 0 2024-05-09T06:29:44.698 INFO:tasks.workunit.client.1.smithi079.stdout:7/820: dread d4/d7/dd/f6d [0,4194304] 0 2024-05-09T06:29:44.698 INFO:tasks.workunit.client.1.smithi079.stdout:7/821: getdents d4/d7/d22/d28/d50/dfd 0 2024-05-09T06:29:44.698 INFO:tasks.workunit.client.1.smithi079.stdout:8/934: creat d1/d3/d20/f145 x:0 0 0 2024-05-09T06:29:44.700 INFO:tasks.workunit.client.1.smithi079.stdout:7/822: creat d4/d9e/ffe x:0 0 0 2024-05-09T06:29:44.700 INFO:tasks.workunit.client.1.smithi079.stdout:7/823: fsync d4/d7/d22/d28/d50/d5c/d85/db6/fc4 0 2024-05-09T06:29:44.700 INFO:tasks.workunit.client.1.smithi079.stdout:7/824: creat d4/d7/dd/d5b/d32/de9/fff x:0 0 0 2024-05-09T06:29:44.701 INFO:tasks.workunit.client.1.smithi079.stdout:8/935: mknod d1/d5/d36/da0/d132/d6c/c146 0 2024-05-09T06:29:44.703 INFO:tasks.workunit.client.1.smithi079.stdout:8/936: rmdir d1/d5/d36/da0/d132 39 2024-05-09T06:29:44.709 INFO:tasks.workunit.client.0.smithi062.stdout:6/13: getdents . 0 2024-05-09T06:29:44.711 INFO:tasks.workunit.client.0.smithi062.stdout:6/14: symlink l5 0 2024-05-09T06:29:44.712 INFO:tasks.workunit.client.0.smithi062.stdout:6/15: dread - f4 zero size 2024-05-09T06:29:44.712 INFO:tasks.workunit.client.0.smithi062.stdout:6/16: truncate f1 75509 0 2024-05-09T06:29:44.712 INFO:tasks.workunit.client.0.smithi062.stdout:6/17: dread f1 [0,4194304] 0 2024-05-09T06:29:44.713 INFO:tasks.workunit.client.0.smithi062.stdout:6/18: symlink l6 0 2024-05-09T06:29:44.721 INFO:tasks.workunit.client.1.smithi079.stdout:8/937: dwrite d1/d5/f120 [0,4194304] 0 2024-05-09T06:29:44.724 INFO:tasks.workunit.client.0.smithi062.stdout:0/30: getdents d1 0 2024-05-09T06:29:44.724 INFO:tasks.workunit.client.0.smithi062.stdout:0/31: chown d1/l6 293479797 1 2024-05-09T06:29:44.725 INFO:tasks.workunit.client.0.smithi062.stdout:0/32: mknod d1/c9 0 2024-05-09T06:29:44.727 INFO:tasks.workunit.client.0.smithi062.stdout:0/33: mknod d1/ca 0 2024-05-09T06:29:44.737 INFO:tasks.workunit.client.1.smithi079.stdout:8/938: dwrite d1/ff6 [0,4194304] 0 2024-05-09T06:29:44.737 INFO:tasks.workunit.client.1.smithi079.stdout:8/939: chown d1/db/daf 5 1 2024-05-09T06:29:44.740 INFO:tasks.workunit.client.1.smithi079.stdout:7/825: symlink d4/d7/d22/l100 0 2024-05-09T06:29:44.741 INFO:tasks.workunit.client.1.smithi079.stdout:8/940: dread d1/d56/ff5 [0,4194304] 0 2024-05-09T06:29:44.741 INFO:tasks.workunit.client.1.smithi079.stdout:8/941: write d1/d5/d36/d102/dc3/d44/da4/fd5 [1268904,34769] 0 2024-05-09T06:29:44.742 INFO:tasks.workunit.client.1.smithi079.stdout:8/942: getdents d1/d5/d36/d102/dc3/d82/dda 0 2024-05-09T06:29:44.742 INFO:tasks.workunit.client.1.smithi079.stdout:8/943: chown d1/d5/d36/d102/dc3/d82/l133 139604164 1 2024-05-09T06:29:44.743 INFO:tasks.workunit.client.1.smithi079.stdout:8/944: creat d1/d5/d36/d102/dc3/f147 x:0 0 0 2024-05-09T06:29:44.744 INFO:tasks.workunit.client.0.smithi062.stdout:0/34: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:44.744 INFO:tasks.workunit.client.1.smithi079.stdout:8/945: mknod d1/d5/d36/da0/d132/d6c/dbf/c148 0 2024-05-09T06:29:44.744 INFO:tasks.workunit.client.1.smithi079.stdout:8/946: chown d1/d3/dc4/fe3 13 1 2024-05-09T06:29:44.759 INFO:tasks.workunit.client.0.smithi062.stdout:9/20: getdents d3 0 2024-05-09T06:29:44.768 INFO:tasks.workunit.client.0.smithi062.stdout:4/20: write d0/d2/f3 [624942,124216] 0 2024-05-09T06:29:44.769 INFO:tasks.workunit.client.0.smithi062.stdout:4/21: creat d0/d2/f5 x:0 0 0 2024-05-09T06:29:44.770 INFO:tasks.workunit.client.0.smithi062.stdout:0/35: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:44.773 INFO:tasks.workunit.client.0.smithi062.stdout:0/36: creat d1/fb x:0 0 0 2024-05-09T06:29:44.775 INFO:tasks.workunit.client.0.smithi062.stdout:0/37: creat d1/fc x:0 0 0 2024-05-09T06:29:44.776 INFO:tasks.workunit.client.0.smithi062.stdout:0/38: creat d1/fd x:0 0 0 2024-05-09T06:29:44.779 INFO:tasks.workunit.client.0.smithi062.stdout:0/39: rename d1/c9 to d1/ce 0 2024-05-09T06:29:44.786 INFO:tasks.workunit.client.0.smithi062.stdout:9/21: dwrite d3/f6 [0,4194304] 0 2024-05-09T06:29:44.789 INFO:tasks.workunit.client.0.smithi062.stdout:9/22: symlink d3/l7 0 2024-05-09T06:29:44.790 INFO:tasks.workunit.client.0.smithi062.stdout:9/23: creat d3/f8 x:0 0 0 2024-05-09T06:29:44.809 INFO:tasks.workunit.client.0.smithi062.stdout:9/24: dwrite d3/f5 [0,4194304] 0 2024-05-09T06:29:44.809 INFO:tasks.workunit.client.0.smithi062.stdout:9/25: dread - d3/f8 zero size 2024-05-09T06:29:44.809 INFO:tasks.workunit.client.0.smithi062.stdout:9/26: creat d3/f9 x:0 0 0 2024-05-09T06:29:44.811 INFO:tasks.workunit.client.0.smithi062.stdout:9/27: link d3/l7 d3/la 0 2024-05-09T06:29:44.812 INFO:tasks.workunit.client.0.smithi062.stdout:9/28: mknod d3/cb 0 2024-05-09T06:29:44.812 INFO:tasks.workunit.client.0.smithi062.stdout:9/29: mknod d3/cc 0 2024-05-09T06:29:44.813 INFO:tasks.workunit.client.0.smithi062.stdout:9/30: readlink d3/la 0 2024-05-09T06:29:44.813 INFO:tasks.workunit.client.0.smithi062.stdout:9/31: mknod d3/cd 0 2024-05-09T06:29:44.814 INFO:tasks.workunit.client.0.smithi062.stdout:9/32: chown d3/cb 282 1 2024-05-09T06:29:44.829 INFO:tasks.workunit.client.0.smithi062.stdout:9/33: dwrite d3/f8 [0,4194304] 0 2024-05-09T06:29:44.831 INFO:tasks.workunit.client.0.smithi062.stdout:9/34: mknod d3/ce 0 2024-05-09T06:29:44.831 INFO:tasks.workunit.client.0.smithi062.stdout:9/35: read d3/f4 [497781,89102] 0 2024-05-09T06:29:44.833 INFO:tasks.workunit.client.0.smithi062.stdout:9/36: link l2 d3/lf 0 2024-05-09T06:29:44.833 INFO:tasks.workunit.client.0.smithi062.stdout:9/37: mknod d3/c10 0 2024-05-09T06:29:44.856 INFO:tasks.workunit.client.1.smithi079.stdout:1/960: write d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6/ff9 [704641,32948] 0 2024-05-09T06:29:44.857 INFO:tasks.workunit.client.1.smithi079.stdout:1/961: mknod d0/d12/d67/db6/d8a/dc3/c147 0 2024-05-09T06:29:44.862 INFO:tasks.workunit.client.1.smithi079.stdout:0/932: dwrite d3/dd/d66/d6d/d74/d84/db7/f10c [0,4194304] 0 2024-05-09T06:29:44.862 INFO:tasks.workunit.client.1.smithi079.stdout:0/933: readlink d3/dd/d18/le1 0 2024-05-09T06:29:44.863 INFO:tasks.workunit.client.1.smithi079.stdout:8/947: dwrite d1/d5/dc/f13f [0,4194304] 0 2024-05-09T06:29:44.865 INFO:tasks.workunit.client.1.smithi079.stdout:0/934: mkdir d3/dd/d66/de9/d12d 0 2024-05-09T06:29:44.865 INFO:tasks.workunit.client.1.smithi079.stdout:0/935: chown d3/dd/d66/d6d/d74/d84/f95 5952753 1 2024-05-09T06:29:44.867 INFO:tasks.workunit.client.1.smithi079.stdout:0/936: mkdir d3/dd/d66/d6d/da6/d12e 0 2024-05-09T06:29:44.874 INFO:tasks.workunit.client.1.smithi079.stdout:7/826: rename d4/cca to d4/d7/dd/d47/c101 0 2024-05-09T06:29:44.876 INFO:tasks.workunit.client.1.smithi079.stdout:1/962: rename d0/df/db8/f10a to d0/d12/d67/d53/dbf/dd2/d4e/d7d/f148 0 2024-05-09T06:29:44.878 INFO:tasks.workunit.client.1.smithi079.stdout:7/827: link d4/d7/dd/d5b/f5d d4/d7/d37/f102 0 2024-05-09T06:29:44.880 INFO:tasks.workunit.client.1.smithi079.stdout:8/948: rename d1/d5/d36/da0/d132/c73 to d1/d5/d36/da0/d132/d6c/dbf/c149 0 2024-05-09T06:29:44.882 INFO:tasks.workunit.client.1.smithi079.stdout:1/963: rename d0/d12/d67/d53/dbf/dd2/d4e/d7d/fb7 to d0/d12/dc0/dd4/df3/d146/f149 0 2024-05-09T06:29:44.882 INFO:tasks.workunit.client.1.smithi079.stdout:1/964: fdatasync d0/d12/d48/f123 0 2024-05-09T06:29:44.885 INFO:tasks.workunit.client.1.smithi079.stdout:8/949: rename d1/d5/d36/dae/dbe/f113 to d1/d5/d36/d102/dc3/d44/de7/d103/f14a 0 2024-05-09T06:29:44.885 INFO:tasks.workunit.client.1.smithi079.stdout:8/950: dread - d1/d64/f128 zero size 2024-05-09T06:29:44.885 INFO:tasks.workunit.client.1.smithi079.stdout:8/951: chown d1/d5 4584 1 2024-05-09T06:29:44.886 INFO:tasks.workunit.client.1.smithi079.stdout:1/965: rmdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/df6/d10b 0 2024-05-09T06:29:44.886 INFO:tasks.workunit.client.1.smithi079.stdout:1/966: rename d0/d12/d67/d53/dbf/dd2/d3e/d127/d145 to d0/d12/d67/d53/dbf/dd2/d3e/d127/d145/d14a 22 2024-05-09T06:29:44.887 INFO:tasks.workunit.client.1.smithi079.stdout:8/952: mkdir d1/d5/d36/d102/d33/d5d/d6d/d14b 0 2024-05-09T06:29:44.889 INFO:tasks.workunit.client.1.smithi079.stdout:1/967: rename d0/d12/d16/f106 to d0/d12/dc0/dd4/f14b 0 2024-05-09T06:29:44.889 INFO:tasks.workunit.client.1.smithi079.stdout:1/968: truncate d0/d12/d67/d53/dbf/dd2/d4e/d7d/fae 902305 0 2024-05-09T06:29:44.896 INFO:tasks.workunit.client.1.smithi079.stdout:8/953: getdents d1/d5/d36/d102/dc3 0 2024-05-09T06:29:44.896 INFO:tasks.workunit.client.1.smithi079.stdout:8/954: write d1/d5/d36/d102/dc3/d3f/f69 [2856762,96435] 0 2024-05-09T06:29:44.897 INFO:tasks.workunit.client.1.smithi079.stdout:8/955: creat d1/d5/d36/d102/dc3/dff/f14c x:0 0 0 2024-05-09T06:29:44.897 INFO:tasks.workunit.client.1.smithi079.stdout:1/969: dread d0/d12/d48/d75/d43/d20/f5f [4194304,4194304] 0 2024-05-09T06:29:44.901 INFO:tasks.workunit.client.1.smithi079.stdout:1/970: rename d0/d12/d48/l4d to d0/d12/d67/d53/dbf/dd2/d3e/l14c 0 2024-05-09T06:29:44.901 INFO:tasks.workunit.client.1.smithi079.stdout:1/971: fdatasync d0/d12/d67/db6/d8a/f122 0 2024-05-09T06:29:44.902 INFO:tasks.workunit.client.1.smithi079.stdout:1/972: creat d0/df/db8/dfc/f14d x:0 0 0 2024-05-09T06:29:44.902 INFO:tasks.workunit.client.1.smithi079.stdout:1/973: write d0/d12/d67/db6/f7c [3307414,83465] 0 2024-05-09T06:29:44.905 INFO:tasks.workunit.client.1.smithi079.stdout:1/974: mknod d0/d12/d48/d75/d43/d20/d39/c14e 0 2024-05-09T06:29:44.906 INFO:tasks.workunit.client.1.smithi079.stdout:1/975: symlink d0/d12/dc0/dd4/df3/d146/l14f 0 2024-05-09T06:29:44.907 INFO:tasks.workunit.client.1.smithi079.stdout:1/976: write d0/df/db8/f140 [339634,4002] 0 2024-05-09T06:29:44.909 INFO:tasks.workunit.client.1.smithi079.stdout:1/977: creat d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/f150 x:0 0 0 2024-05-09T06:29:44.909 INFO:tasks.workunit.client.1.smithi079.stdout:1/978: creat d0/df/db8/dfc/f151 x:0 0 0 2024-05-09T06:29:44.909 INFO:tasks.workunit.client.1.smithi079.stdout:1/979: chown d0/d12/d48/d75/d43/d20/d39/l5c 63621 1 2024-05-09T06:29:44.910 INFO:tasks.workunit.client.0.smithi062.stdout:4/22: getdents d0/d2 0 2024-05-09T06:29:44.910 INFO:tasks.workunit.client.0.smithi062.stdout:4/23: write d0/d2/f5 [219177,91553] 0 2024-05-09T06:29:44.910 INFO:tasks.workunit.client.0.smithi062.stdout:4/24: getdents d0/d2 0 2024-05-09T06:29:44.912 INFO:tasks.workunit.client.1.smithi079.stdout:1/980: rmdir d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/d129 39 2024-05-09T06:29:44.916 INFO:tasks.workunit.client.1.smithi079.stdout:1/981: unlink d0/d12/d67/d53/dbf/dd2/d4e/f6c 0 2024-05-09T06:29:44.917 INFO:tasks.workunit.client.0.smithi062.stdout:9/38: truncate d3/f6 150735 0 2024-05-09T06:29:44.918 INFO:tasks.workunit.client.1.smithi079.stdout:1/982: write d0/d12/d67/d53/dbf/dd2/d4e/f63 [447999,79889] 0 2024-05-09T06:29:44.918 INFO:tasks.workunit.client.1.smithi079.stdout:1/983: dread - d0/d12/d67/d53/dbf/f11f zero size 2024-05-09T06:29:44.918 INFO:tasks.workunit.client.1.smithi079.stdout:1/984: chown d0/d12/d67/d53/dbf/dd2/d4e/d7d/lf1 7676 1 2024-05-09T06:29:44.919 INFO:tasks.workunit.client.0.smithi062.stdout:9/39: mknod d3/c11 0 2024-05-09T06:29:44.919 INFO:tasks.workunit.client.0.smithi062.stdout:9/40: readlink d3/la 0 2024-05-09T06:29:44.920 INFO:tasks.workunit.client.1.smithi079.stdout:1/985: symlink d0/df/l152 0 2024-05-09T06:29:44.921 INFO:tasks.workunit.client.0.smithi062.stdout:9/41: mknod d3/c12 0 2024-05-09T06:29:44.921 INFO:tasks.workunit.client.0.smithi062.stdout:9/42: creat d3/f13 x:0 0 0 2024-05-09T06:29:44.926 INFO:tasks.workunit.client.0.smithi062.stdout:9/43: symlink d3/l14 0 2024-05-09T06:29:44.932 INFO:tasks.workunit.client.0.smithi062.stdout:4/25: dread d0/d2/f3 [0,4194304] 0 2024-05-09T06:29:44.932 INFO:tasks.workunit.client.0.smithi062.stdout:4/26: stat d0/d2 0 2024-05-09T06:29:44.932 INFO:tasks.workunit.client.0.smithi062.stdout:4/27: write d0/d2/f4 [1805679,58720] 0 2024-05-09T06:29:44.935 INFO:tasks.workunit.client.0.smithi062.stdout:9/44: dread d3/f8 [0,4194304] 0 2024-05-09T06:29:44.936 INFO:tasks.workunit.client.0.smithi062.stdout:9/45: link d3/c12 d3/c15 0 2024-05-09T06:29:44.938 INFO:tasks.workunit.client.0.smithi062.stdout:9/46: rename d3/f4 to d3/f16 0 2024-05-09T06:29:44.938 INFO:tasks.workunit.client.0.smithi062.stdout:9/47: creat d3/f17 x:0 0 0 2024-05-09T06:29:44.940 INFO:tasks.workunit.client.1.smithi079.stdout:0/937: dwrite d3/dd/d71/db4/ff2 [0,4194304] 0 2024-05-09T06:29:44.941 INFO:tasks.workunit.client.1.smithi079.stdout:7/828: dwrite d4/d7/dd/d5b/fc8 [0,4194304] 0 2024-05-09T06:29:44.941 INFO:tasks.workunit.client.1.smithi079.stdout:8/956: dwrite d1/d5/d36/d102/d33/f53 [0,4194304] 0 2024-05-09T06:29:44.942 INFO:tasks.workunit.client.1.smithi079.stdout:8/957: read - d1/d5/d36/d102/dc3/d44/de7/f129 zero size 2024-05-09T06:29:44.942 INFO:tasks.workunit.client.1.smithi079.stdout:0/938: mknod d3/dd/d66/d6d/da6/dac/c12f 0 2024-05-09T06:29:44.944 INFO:tasks.workunit.client.0.smithi062.stdout:4/28: dread d0/d2/f3 [0,4194304] 0 2024-05-09T06:29:44.948 INFO:tasks.workunit.client.1.smithi079.stdout:7/829: dread d4/d7/d78/f97 [0,4194304] 0 2024-05-09T06:29:44.951 INFO:tasks.workunit.client.1.smithi079.stdout:8/958: mkdir d1/d5/d36/d102/dc3/d50/dfe/d14d 0 2024-05-09T06:29:44.955 INFO:tasks.workunit.client.1.smithi079.stdout:0/939: write d3/dd/d66/d6d/d74/d84/fcd [3983006,17188] 0 2024-05-09T06:29:44.956 INFO:tasks.workunit.client.1.smithi079.stdout:7/830: link d4/d7/lde d4/d7/dd/d5b/d6f/db9/l103 0 2024-05-09T06:29:44.956 INFO:tasks.workunit.client.1.smithi079.stdout:8/959: getdents d1/d56 0 2024-05-09T06:29:44.960 INFO:tasks.workunit.client.1.smithi079.stdout:0/940: creat d3/dd/d66/d6d/d74/d80/d2d/f130 x:0 0 0 2024-05-09T06:29:44.960 INFO:tasks.workunit.client.1.smithi079.stdout:0/941: chown d3/dd/d66/d6d/d74/d80/c127 337 1 2024-05-09T06:29:44.961 INFO:tasks.workunit.client.1.smithi079.stdout:7/831: mkdir d4/d7/d22/d28/d50/d5c/df0/d104 0 2024-05-09T06:29:44.963 INFO:tasks.workunit.client.1.smithi079.stdout:0/942: creat d3/dd/d66/d6d/d74/d80/d2d/da7/dce/d115/f131 x:0 0 0 2024-05-09T06:29:44.963 INFO:tasks.workunit.client.1.smithi079.stdout:0/943: fsync d3/dd/d66/d6d/d74/d80/f56 0 2024-05-09T06:29:44.963 INFO:tasks.workunit.client.1.smithi079.stdout:0/944: write d3/dd/d1f/d1e/f2a [4452551,44551] 0 2024-05-09T06:29:44.963 INFO:tasks.workunit.client.1.smithi079.stdout:0/945: dread - d3/dd/d1f/d1e/d2c/ff8 zero size 2024-05-09T06:29:44.965 INFO:tasks.workunit.client.0.smithi062.stdout:4/29: dwrite d0/d2/f5 [0,4194304] 0 2024-05-09T06:29:44.965 INFO:tasks.workunit.client.0.smithi062.stdout:4/30: write d0/d2/f4 [2373018,80161] 0 2024-05-09T06:29:44.968 INFO:tasks.workunit.client.0.smithi062.stdout:4/31: link d0/d2/f3 d0/d2/f6 0 2024-05-09T06:29:44.968 INFO:tasks.workunit.client.1.smithi079.stdout:7/832: dread d4/d7/dd/d88/f8a [0,4194304] 0 2024-05-09T06:29:44.968 INFO:tasks.workunit.client.1.smithi079.stdout:7/833: chown d4/d7/dd/d5b/l39 0 1 2024-05-09T06:29:44.969 INFO:tasks.workunit.client.1.smithi079.stdout:7/834: fsync d4/d7/d22/d28/d50/f9b 0 2024-05-09T06:29:44.969 INFO:tasks.workunit.client.1.smithi079.stdout:1/986: rename d0/d12/d48/d75/d43/d20 to d0/d12/d67/db6/d8a/dc3/d153 0 2024-05-09T06:29:44.970 INFO:tasks.workunit.client.0.smithi062.stdout:4/32: mknod d0/c7 0 2024-05-09T06:29:44.971 INFO:tasks.workunit.client.1.smithi079.stdout:8/960: dwrite d1/d56/d7c/d8f/fa8 [0,4194304] 0 2024-05-09T06:29:44.973 INFO:tasks.workunit.client.1.smithi079.stdout:7/835: creat d4/d7/d22/d28/d50/d5c/d85/f105 x:0 0 0 2024-05-09T06:29:44.973 INFO:tasks.workunit.client.1.smithi079.stdout:7/836: chown d4/d7/dd/d5b/l39 162080 1 2024-05-09T06:29:44.974 INFO:tasks.workunit.client.0.smithi062.stdout:4/33: mkdir d0/d2/d8 0 2024-05-09T06:29:44.975 INFO:tasks.workunit.client.1.smithi079.stdout:8/961: creat d1/d5/d36/d102/dc3/d82/dda/d110/f14e x:0 0 0 2024-05-09T06:29:44.976 INFO:tasks.workunit.client.0.smithi062.stdout:4/34: mkdir d0/d9 0 2024-05-09T06:29:44.976 INFO:tasks.workunit.client.0.smithi062.stdout:9/48: write d3/f6 [799574,79141] 0 2024-05-09T06:29:44.977 INFO:tasks.workunit.client.0.smithi062.stdout:4/35: rmdir d0 39 2024-05-09T06:29:44.979 INFO:tasks.workunit.client.0.smithi062.stdout:9/49: rename d3/f13 to d3/f18 0 2024-05-09T06:29:44.980 INFO:tasks.workunit.client.0.smithi062.stdout:4/36: link d0/c7 d0/d2/ca 0 2024-05-09T06:29:44.983 INFO:tasks.workunit.client.0.smithi062.stdout:4/37: creat d0/d9/fb x:0 0 0 2024-05-09T06:29:44.983 INFO:tasks.workunit.client.0.smithi062.stdout:4/38: fdatasync d0/d9/fb 0 2024-05-09T06:29:44.983 INFO:tasks.workunit.client.0.smithi062.stdout:4/39: creat d0/d9/fc x:0 0 0 2024-05-09T06:29:44.984 INFO:tasks.workunit.client.1.smithi079.stdout:7/837: read d4/d7/dd/d5b/f44 [3628499,13192] 0 2024-05-09T06:29:44.985 INFO:tasks.workunit.client.1.smithi079.stdout:8/962: write d1/d5/f6f [1428338,112988] 0 2024-05-09T06:29:44.988 INFO:tasks.workunit.client.1.smithi079.stdout:8/963: mknod d1/d5/d36/d102/dc3/c14f 0 2024-05-09T06:29:44.994 INFO:tasks.workunit.client.1.smithi079.stdout:8/964: creat d1/d5/d36/dae/dbe/d136/f150 x:0 0 0 2024-05-09T06:29:44.995 INFO:tasks.workunit.client.1.smithi079.stdout:8/965: rmdir d1/d5/d36/d102/dc3/d3f/d144 0 2024-05-09T06:29:44.997 INFO:tasks.workunit.client.1.smithi079.stdout:8/966: mkdir d1/d5/d36/d102/dc3/d44/de7/d151 0 2024-05-09T06:29:44.997 INFO:tasks.workunit.client.1.smithi079.stdout:8/967: readlink d1/d5/d36/d102/d33/d5d/d6d/l13c 0 2024-05-09T06:29:45.005 INFO:tasks.workunit.client.0.smithi062.stdout:9/50: rmdir d3 39 2024-05-09T06:29:45.007 INFO:tasks.workunit.client.0.smithi062.stdout:9/51: creat d3/f19 x:0 0 0 2024-05-09T06:29:45.008 INFO:tasks.workunit.client.0.smithi062.stdout:9/52: mkdir d3/d1a 0 2024-05-09T06:29:45.009 INFO:tasks.workunit.client.0.smithi062.stdout:9/53: creat d3/d1a/f1b x:0 0 0 2024-05-09T06:29:45.009 INFO:tasks.workunit.client.0.smithi062.stdout:9/54: chown l2 319 1 2024-05-09T06:29:45.010 INFO:tasks.workunit.client.0.smithi062.stdout:9/55: mkdir d3/d1a/d1c 0 2024-05-09T06:29:45.038 INFO:tasks.workunit.client.1.smithi079.stdout:0/946: dwrite d3/dd/d18/d5e/fef [0,4194304] 0 2024-05-09T06:29:45.039 INFO:tasks.workunit.client.1.smithi079.stdout:0/947: fdatasync d3/dd/d18/d5e/fef 0 2024-05-09T06:29:45.040 INFO:tasks.workunit.client.1.smithi079.stdout:1/987: dwrite d0/d12/d92/f9a [0,4194304] 0 2024-05-09T06:29:45.041 INFO:tasks.workunit.client.1.smithi079.stdout:0/948: symlink d3/dd/d1f/d1e/d2c/d7f/de0/l132 0 2024-05-09T06:29:45.054 INFO:tasks.workunit.client.1.smithi079.stdout:1/988: rename d0/f4a to d0/d12/dc0/dd4/df3/d146/f154 0 2024-05-09T06:29:45.055 INFO:tasks.workunit.client.1.smithi079.stdout:0/949: creat d3/dd/d1f/d1e/d2c/d88/f133 x:0 0 0 2024-05-09T06:29:45.056 INFO:tasks.workunit.client.1.smithi079.stdout:0/950: fsync d3/dd/d1f/d1e/d2c/d35/d36/f3d 0 2024-05-09T06:29:45.101 INFO:tasks.workunit.client.1.smithi079.stdout:8/968: dwrite d1/f112 [0,4194304] 0 2024-05-09T06:29:45.102 INFO:tasks.workunit.client.0.smithi062.stdout:4/40: dwrite d0/d2/f3 [0,4194304] 0 2024-05-09T06:29:45.102 INFO:tasks.workunit.client.0.smithi062.stdout:4/41: write d0/d9/fb [126113,81115] 0 2024-05-09T06:29:45.104 INFO:tasks.workunit.client.0.smithi062.stdout:9/56: dwrite d3/f8 [0,4194304] 0 2024-05-09T06:29:45.105 INFO:tasks.workunit.client.1.smithi079.stdout:8/969: rename d1/d5/d36/d102/d33/d5d/d6d to d1/d5/d36/dae/d152 0 2024-05-09T06:29:45.105 INFO:tasks.workunit.client.1.smithi079.stdout:8/970: write d1/d5/d36/d102/dc3/d3b/dc8/f135 [842657,108618] 0 2024-05-09T06:29:45.107 INFO:tasks.workunit.client.1.smithi079.stdout:8/971: dread d1/f1f [0,4194304] 0 2024-05-09T06:29:45.107 INFO:tasks.workunit.client.1.smithi079.stdout:8/972: write d1/d5/d36/d102/dc3/d44/fb6 [680936,94017] 0 2024-05-09T06:29:45.109 INFO:tasks.workunit.client.1.smithi079.stdout:8/973: unlink d1/d5/d36/da0/d132/d6c/d6b/c92 0 2024-05-09T06:29:45.110 INFO:tasks.workunit.client.0.smithi062.stdout:4/42: write d0/d2/f4 [675108,104412] 0 2024-05-09T06:29:45.110 INFO:tasks.workunit.client.0.smithi062.stdout:4/43: fsync d0/d9/fc 0 2024-05-09T06:29:45.111 INFO:tasks.workunit.client.1.smithi079.stdout:8/974: rename d1/db/f4f to d1/d5/d36/d102/dc3/d82/dda/d110/f153 0 2024-05-09T06:29:45.111 INFO:tasks.workunit.client.1.smithi079.stdout:8/975: write d1/d5/d36/d102/dc3/d50/fc6 [298753,33116] 0 2024-05-09T06:29:45.111 INFO:tasks.workunit.client.1.smithi079.stdout:8/976: creat d1/d5/d36/d102/dc3/d50/dd7/f154 x:0 0 0 2024-05-09T06:29:45.111 INFO:tasks.workunit.client.1.smithi079.stdout:8/977: dread - d1/f101 zero size 2024-05-09T06:29:45.112 INFO:tasks.workunit.client.1.smithi079.stdout:0/951: dwrite d3/dd/d1f/d1e/d2c/d7f/de0/f12a [0,4194304] 0 2024-05-09T06:29:45.112 INFO:tasks.workunit.client.1.smithi079.stdout:0/952: stat d3/dd/d1f/d1e/d2c/d88/d8e/de3/c113 0 2024-05-09T06:29:45.113 INFO:tasks.workunit.client.1.smithi079.stdout:8/978: creat d1/d5/d36/d102/dc3/d44/da2/f155 x:0 0 0 2024-05-09T06:29:45.117 INFO:tasks.workunit.client.0.smithi062.stdout:9/57: write d3/f8 [2641141,114952] 0 2024-05-09T06:29:45.117 INFO:tasks.workunit.client.0.smithi062.stdout:9/58: readlink d3/lf 0 2024-05-09T06:29:45.118 INFO:tasks.workunit.client.1.smithi079.stdout:8/979: link d1/d5/d36/d102/dc3/d44/c10b d1/d56/dbd/c156 0 2024-05-09T06:29:45.118 INFO:tasks.workunit.client.0.smithi062.stdout:4/44: dread d0/d2/f3 [0,4194304] 0 2024-05-09T06:29:45.118 INFO:tasks.workunit.client.0.smithi062.stdout:9/59: mknod d3/d1a/d1c/c1d 0 2024-05-09T06:29:45.120 INFO:tasks.workunit.client.1.smithi079.stdout:8/980: mknod d1/d56/d7c/c157 0 2024-05-09T06:29:45.121 INFO:tasks.workunit.client.0.smithi062.stdout:9/60: mkdir d3/d1a/d1c/d1e 0 2024-05-09T06:29:45.125 INFO:tasks.workunit.client.1.smithi079.stdout:8/981: mkdir d1/d5/d36/d102/dc3/d44/de7/d158 0 2024-05-09T06:29:45.125 INFO:tasks.workunit.client.1.smithi079.stdout:8/982: write d1/d5/d36/d102/dc3/d44/f4c [2650308,28156] 0 2024-05-09T06:29:45.125 INFO:tasks.workunit.client.1.smithi079.stdout:8/983: chown d1/db/c24 59 1 2024-05-09T06:29:45.125 INFO:tasks.workunit.client.0.smithi062.stdout:9/61: mkdir d3/d1a/d1c/d1f 0 2024-05-09T06:29:45.126 INFO:tasks.workunit.client.1.smithi079.stdout:8/984: stat d1/d5/d36/d102/dc3/d3b/c75 0 2024-05-09T06:29:45.127 INFO:tasks.workunit.client.0.smithi062.stdout:9/62: chown c1 1044557872 1 2024-05-09T06:29:45.128 INFO:tasks.workunit.client.1.smithi079.stdout:8/985: mknod d1/d5/d36/d102/dc3/d50/dfe/c159 0 2024-05-09T06:29:45.128 INFO:tasks.workunit.client.1.smithi079.stdout:8/986: fdatasync d1/d5/d36/dae/d152/dc0/ff3 0 2024-05-09T06:29:45.129 INFO:tasks.workunit.client.0.smithi062.stdout:9/63: mkdir d3/d20 0 2024-05-09T06:29:45.130 INFO:tasks.workunit.client.0.smithi062.stdout:9/64: mkdir d3/d1a/d1c/d21 0 2024-05-09T06:29:45.130 INFO:tasks.workunit.client.0.smithi062.stdout:9/65: stat d3/f9 0 2024-05-09T06:29:45.130 INFO:tasks.workunit.client.0.smithi062.stdout:9/66: dread - d3/f19 zero size 2024-05-09T06:29:45.134 INFO:tasks.workunit.client.0.smithi062.stdout:4/45: truncate d0/d2/f5 794644 0 2024-05-09T06:29:45.134 INFO:tasks.workunit.client.0.smithi062.stdout:4/46: readlink d0/l1 0 2024-05-09T06:29:45.137 INFO:tasks.workunit.client.1.smithi079.stdout:0/953: dwrite d3/dd/d66/d6d/d74/d80/d76/dcc/f105 [4194304,4194304] 0 2024-05-09T06:29:45.138 INFO:tasks.workunit.client.1.smithi079.stdout:8/987: dread d1/d3/d20/f11f [0,4194304] 0 2024-05-09T06:29:45.159 INFO:tasks.workunit.client.1.smithi079.stdout:0/954: dwrite d3/dd/d1f/d1e/d2c/d7f/f12b [0,4194304] 0 2024-05-09T06:29:45.159 INFO:tasks.workunit.client.1.smithi079.stdout:0/955: write d3/dd/d18/f7a [1028132,51226] 0 2024-05-09T06:29:45.159 INFO:tasks.workunit.client.1.smithi079.stdout:8/988: dwrite d1/d5/d36/d102/dc3/dff/f14c [0,4194304] 0 2024-05-09T06:29:45.163 INFO:tasks.workunit.client.1.smithi079.stdout:8/989: mknod d1/d5/d36/d102/dc3/d50/dfe/c15a 0 2024-05-09T06:29:45.171 INFO:tasks.workunit.client.1.smithi079.stdout:0/956: dread d3/dd/d66/f7b [0,4194304] 0 2024-05-09T06:29:45.173 INFO:tasks.workunit.client.1.smithi079.stdout:0/957: mkdir d3/dd/d66/d6d/d74/d80/d2d/da7/dce/d115/d134 0 2024-05-09T06:29:45.173 INFO:tasks.workunit.client.1.smithi079.stdout:0/958: creat d3/dd/d66/d6d/d74/d80/d2d/d90/f135 x:0 0 0 2024-05-09T06:29:45.189 INFO:tasks.workunit.client.0.smithi062.stdout:9/67: truncate d3/f6 467166 0 2024-05-09T06:29:45.190 INFO:tasks.workunit.client.0.smithi062.stdout:9/68: rename d3/d1a/d1c/d1f to d3/d1a/d1c/d22 0 2024-05-09T06:29:45.190 INFO:tasks.workunit.client.0.smithi062.stdout:9/69: read - d3/f19 zero size 2024-05-09T06:29:45.191 INFO:tasks.workunit.client.0.smithi062.stdout:9/70: mkdir d3/d1a/d23 0 2024-05-09T06:29:45.191 INFO:tasks.workunit.client.0.smithi062.stdout:9/71: read - d3/f17 zero size 2024-05-09T06:29:45.192 INFO:tasks.workunit.client.0.smithi062.stdout:9/72: rmdir d3/d1a/d23 0 2024-05-09T06:29:45.192 INFO:tasks.workunit.client.0.smithi062.stdout:9/73: truncate d3/f9 98961 0 2024-05-09T06:29:45.194 INFO:tasks.workunit.client.0.smithi062.stdout:9/74: link d3/f9 d3/d1a/d1c/d21/f24 0 2024-05-09T06:29:45.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/75: stat d3/cb 0 2024-05-09T06:29:45.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/76: chown d3/c15 410475 1 2024-05-09T06:29:45.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/77: chown d3/f6 3555 1 2024-05-09T06:29:45.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/78: truncate d3/f19 702021 0 2024-05-09T06:29:45.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/79: mkdir d3/d20/d25 0 2024-05-09T06:29:45.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/80: truncate d3/d1a/f1b 1003816 0 2024-05-09T06:29:45.196 INFO:tasks.workunit.client.0.smithi062.stdout:9/81: link d3/f18 d3/d1a/d1c/f26 0 2024-05-09T06:29:45.197 INFO:tasks.workunit.client.0.smithi062.stdout:9/82: truncate d3/f16 1366913 0 2024-05-09T06:29:45.197 INFO:tasks.workunit.client.0.smithi062.stdout:9/83: chown d3 11426 1 2024-05-09T06:29:45.197 INFO:tasks.workunit.client.1.smithi079.stdout:0/959: dread d3/d5/fe [0,4194304] 0 2024-05-09T06:29:45.197 INFO:tasks.workunit.client.1.smithi079.stdout:0/960: truncate d3/dd/d66/d6d/d74/d80/d2d/d90/f135 140861 0 2024-05-09T06:29:45.197 INFO:tasks.workunit.client.1.smithi079.stdout:0/961: read - d3/dd/d66/d6d/d74/d80/d2d/d90/f122 zero size 2024-05-09T06:29:45.197 INFO:tasks.workunit.client.1.smithi079.stdout:8/990: dwrite d1/d5/d36/d102/dc3/d44/f35 [0,4194304] 0 2024-05-09T06:29:45.199 INFO:tasks.workunit.client.1.smithi079.stdout:8/991: link d1/d3/d20/f145 d1/d5/d36/d102/dc3/d50/dd7/f15b 0 2024-05-09T06:29:45.204 INFO:tasks.workunit.client.0.smithi062.stdout:9/84: rmdir d3/d1a 39 2024-05-09T06:29:45.206 INFO:tasks.workunit.client.0.smithi062.stdout:9/85: rmdir d3/d1a/d1c/d22 0 2024-05-09T06:29:45.207 INFO:tasks.workunit.client.0.smithi062.stdout:9/86: mknod d3/d1a/d1c/d1e/c27 0 2024-05-09T06:29:45.207 INFO:tasks.workunit.client.1.smithi079.stdout:8/992: dread d1/d3/dc4/fe3 [0,4194304] 0 2024-05-09T06:29:45.208 INFO:tasks.workunit.client.1.smithi079.stdout:8/993: dread - d1/f93 zero size 2024-05-09T06:29:45.208 INFO:tasks.workunit.client.1.smithi079.stdout:0/962: write d3/dd/d1f/d1e/d2c/d7f/de0/f12a [4081600,128340] 0 2024-05-09T06:29:45.208 INFO:tasks.workunit.client.0.smithi062.stdout:9/87: rename d3/c10 to d3/d1a/d1c/c28 0 2024-05-09T06:29:45.210 INFO:tasks.workunit.client.1.smithi079.stdout:8/994: unlink d1/d5/dc/f6a 0 2024-05-09T06:29:45.212 INFO:tasks.workunit.client.1.smithi079.stdout:8/995: mkdir d1/d5/d36/d102/dc3/d44/de7/d103/d15c 0 2024-05-09T06:29:45.212 INFO:tasks.workunit.client.1.smithi079.stdout:8/996: symlink d1/d5/d36/dae/dbe/l15d 0 2024-05-09T06:29:45.214 INFO:tasks.workunit.client.1.smithi079.stdout:8/997: creat d1/d5/d36/d102/dc3/d82/dda/d110/d130/f15e x:0 0 0 2024-05-09T06:29:45.214 INFO:tasks.workunit.client.1.smithi079.stdout:8/998: getdents d1/d5/d36/d102/dc3/d82/dda 0 2024-05-09T06:29:45.214 INFO:tasks.workunit.client.1.smithi079.stdout:8/999: chown d1/d5/d36/d102/dc3/f9c 515942 1 2024-05-09T06:29:45.231 INFO:tasks.workunit.client.0.smithi062.stdout:9/88: dwrite d3/f8 [0,4194304] 0 2024-05-09T06:29:45.231 INFO:tasks.workunit.client.1.smithi079.stdout:0/963: dwrite d3/dd/d66/d6d/d74/d80/d76/dcc/f128 [0,4194304] 0 2024-05-09T06:29:45.232 INFO:tasks.workunit.client.0.smithi062.stdout:9/89: mkdir d3/d1a/d29 0 2024-05-09T06:29:45.234 INFO:tasks.workunit.client.0.smithi062.stdout:9/90: rmdir d3/d1a/d29 0 2024-05-09T06:29:45.235 INFO:tasks.workunit.client.0.smithi062.stdout:9/91: dread d3/d1a/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:29:45.236 INFO:tasks.workunit.client.0.smithi062.stdout:9/92: getdents d3/d20 0 2024-05-09T06:29:45.238 INFO:tasks.workunit.client.1.smithi079.stdout:0/964: dread d3/dd/d66/d6d/d74/d84/fa3 [0,4194304] 0 2024-05-09T06:29:45.238 INFO:tasks.workunit.client.0.smithi062.stdout:9/93: unlink d3/f9 0 2024-05-09T06:29:45.240 INFO:tasks.workunit.client.0.smithi062.stdout:9/94: creat d3/d1a/f2a x:0 0 0 2024-05-09T06:29:45.240 INFO:tasks.workunit.client.0.smithi062.stdout:9/95: write d3/d1a/f2a [500412,39032] 0 2024-05-09T06:29:45.240 INFO:tasks.workunit.client.0.smithi062.stdout:9/96: write d3/f18 [138182,55792] 0 2024-05-09T06:29:45.240 INFO:tasks.workunit.client.0.smithi062.stdout:9/97: stat d3/cb 0 2024-05-09T06:29:45.249 INFO:tasks.workunit.client.0.smithi062.stdout:9/98: dread d3/f8 [0,4194304] 0 2024-05-09T06:29:45.250 INFO:tasks.workunit.client.0.smithi062.stdout:9/99: mkdir d3/d1a/d1c/d2b 0 2024-05-09T06:29:45.252 INFO:tasks.workunit.client.1.smithi079.stdout:0/965: dwrite d3/dd/d66/d6d/d74/fe6 [0,4194304] 0 2024-05-09T06:29:45.261 INFO:tasks.workunit.client.1.smithi079.stdout:7/838: sync 2024-05-09T06:29:45.261 INFO:tasks.workunit.client.1.smithi079.stdout:1/989: sync 2024-05-09T06:29:45.262 INFO:tasks.workunit.client.1.smithi079.stdout:1/990: write d0/d12/dc0/dd4/f12e [530751,16409] 0 2024-05-09T06:29:45.263 INFO:tasks.workunit.client.1.smithi079.stdout:7/839: creat d4/d7/d22/d28/d74/f106 x:0 0 0 2024-05-09T06:29:45.265 INFO:tasks.workunit.client.1.smithi079.stdout:1/991: truncate d0/d12/d48/fe1 3647603 0 2024-05-09T06:29:45.266 INFO:tasks.workunit.client.1.smithi079.stdout:1/992: readlink d0/d12/d67/d53/dbf/le9 0 2024-05-09T06:29:45.267 INFO:tasks.workunit.client.1.smithi079.stdout:7/840: symlink d4/d7/dd/d47/df5/l107 0 2024-05-09T06:29:45.267 INFO:tasks.workunit.client.1.smithi079.stdout:1/993: getdents d0/df 0 2024-05-09T06:29:45.267 INFO:tasks.workunit.client.1.smithi079.stdout:1/994: chown d0/d12/d48/d75/d43/leb 3 1 2024-05-09T06:29:45.268 INFO:tasks.workunit.client.1.smithi079.stdout:1/995: fsync d0/d12/d67/db6/d8a/dc3/d153/d39/f5a 0 2024-05-09T06:29:45.270 INFO:tasks.workunit.client.0.smithi062.stdout:9/100: dwrite d3/f16 [0,4194304] 0 2024-05-09T06:29:45.279 INFO:tasks.workunit.client.1.smithi079.stdout:7/841: dread d4/f26 [0,4194304] 0 2024-05-09T06:29:45.279 INFO:tasks.workunit.client.1.smithi079.stdout:7/842: write d4/d7/d37/f57 [924637,109208] 0 2024-05-09T06:29:45.283 INFO:tasks.workunit.client.1.smithi079.stdout:1/996: dwrite d0/df/f62 [4194304,4194304] 0 2024-05-09T06:29:45.287 INFO:tasks.workunit.client.1.smithi079.stdout:1/997: mknod d0/d12/d67/d53/dbf/dd2/d4e/d7d/d94/da3/ddb/d12f/c155 0 2024-05-09T06:29:45.288 INFO:tasks.workunit.client.1.smithi079.stdout:1/998: truncate d0/d12/d67/d53/d6d/fd6 2851400 0 2024-05-09T06:29:45.289 INFO:tasks.workunit.client.1.smithi079.stdout:1/999: symlink d0/d12/dc0/l156 0 2024-05-09T06:29:45.301 INFO:tasks.workunit.client.0.smithi062.stdout:9/101: dwrite d3/f17 [0,4194304] 0 2024-05-09T06:29:45.302 INFO:tasks.workunit.client.1.smithi079.stdout:7/843: dwrite d4/d7/dd/d5b/f99 [0,4194304] 0 2024-05-09T06:29:45.304 INFO:tasks.workunit.client.0.smithi062.stdout:9/102: creat d3/d1a/d1c/d2b/f2c x:0 0 0 2024-05-09T06:29:45.304 INFO:tasks.workunit.client.0.smithi062.stdout:9/103: dread d3/d1a/f1b [0,4194304] 0 2024-05-09T06:29:45.307 INFO:tasks.workunit.client.1.smithi079.stdout:7/844: mkdir d4/d7/dd/d5b/d31/d108 0 2024-05-09T06:29:45.307 INFO:tasks.workunit.client.1.smithi079.stdout:7/845: fdatasync d4/d7/d22/d28/fd9 0 2024-05-09T06:29:45.308 INFO:tasks.workunit.client.1.smithi079.stdout:7/846: mkdir d4/d7/d22/d109 0 2024-05-09T06:29:45.310 INFO:tasks.workunit.client.1.smithi079.stdout:7/847: creat d4/d7/d22/d109/f10a x:0 0 0 2024-05-09T06:29:45.333 INFO:tasks.workunit.client.0.smithi062.stdout:9/104: dwrite d3/d1a/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:29:45.334 INFO:tasks.workunit.client.1.smithi079.stdout:7/848: dwrite d4/d7/d22/d109/f10a [0,4194304] 0 2024-05-09T06:29:45.335 INFO:tasks.workunit.client.0.smithi062.stdout:9/105: truncate d3/f5 393092 0 2024-05-09T06:29:45.343 INFO:tasks.workunit.client.0.smithi062.stdout:9/106: dread d3/f8 [0,4194304] 0 2024-05-09T06:29:45.345 INFO:tasks.workunit.client.0.smithi062.stdout:9/107: rename d3/d1a/f2a to d3/d1a/d1c/d2b/f2d 0 2024-05-09T06:29:45.350 INFO:tasks.workunit.client.0.smithi062.stdout:9/108: write d3/f6 [349551,94813] 0 2024-05-09T06:29:45.353 INFO:tasks.workunit.client.0.smithi062.stdout:9/109: unlink d3/f8 0 2024-05-09T06:29:45.358 INFO:tasks.workunit.client.0.smithi062.stdout:9/110: fsync d3/f18 0 2024-05-09T06:29:45.358 INFO:tasks.workunit.client.1.smithi079.stdout:7/849: dwrite d4/d7/d22/d28/d50/d5c/ddc/fcd [4194304,4194304] 0 2024-05-09T06:29:45.358 INFO:tasks.workunit.client.1.smithi079.stdout:7/850: stat d4/d20/f4f 0 2024-05-09T06:29:45.359 INFO:tasks.workunit.client.0.smithi062.stdout:9/111: mknod d3/d20/d25/c2e 0 2024-05-09T06:29:45.360 INFO:tasks.workunit.client.1.smithi079.stdout:7/851: mkdir d4/d7/d22/d28/d50/d5c/ddc/d10b 0 2024-05-09T06:29:45.362 INFO:tasks.workunit.client.0.smithi062.stdout:9/112: symlink d3/d1a/d1c/l2f 0 2024-05-09T06:29:45.362 INFO:tasks.workunit.client.0.smithi062.stdout:9/113: chown d3/l14 527298 1 2024-05-09T06:29:45.364 INFO:tasks.workunit.client.1.smithi079.stdout:7/852: mknod d4/d7/dd/d5b/d31/d108/c10c 0 2024-05-09T06:29:45.366 INFO:tasks.workunit.client.1.smithi079.stdout:7/853: symlink d4/d7/d37/d90/l10d 0 2024-05-09T06:29:45.382 INFO:tasks.workunit.client.0.smithi062.stdout:9/114: dwrite d3/f17 [4194304,4194304] 0 2024-05-09T06:29:45.382 INFO:tasks.workunit.client.1.smithi079.stdout:7/854: dwrite d4/d7/d37/f46 [0,4194304] 0 2024-05-09T06:29:45.382 INFO:tasks.workunit.client.1.smithi079.stdout:7/855: creat d4/d7/dd/d47/df5/f10e x:0 0 0 2024-05-09T06:29:45.389 INFO:tasks.workunit.client.0.smithi062.stdout:9/115: dread d3/f6 [0,4194304] 0 2024-05-09T06:29:45.391 INFO:tasks.workunit.client.1.smithi079.stdout:0/966: sync 2024-05-09T06:29:45.391 INFO:tasks.workunit.client.1.smithi079.stdout:0/967: write d3/dd/d1f/d1e/d2c/d88/d8e/de3/f106 [4555831,103450] 0 2024-05-09T06:29:45.393 INFO:tasks.workunit.client.1.smithi079.stdout:0/968: creat d3/dd/d66/d6d/d74/d80/d2d/da7/dce/d115/f136 x:0 0 0 2024-05-09T06:29:45.393 INFO:tasks.workunit.client.1.smithi079.stdout:0/969: fsync d3/dd/d66/d6d/d74/d80/d2d/da7/dce/d101/f129 0 2024-05-09T06:29:45.394 INFO:tasks.workunit.client.1.smithi079.stdout:0/970: creat d3/d5/f137 x:0 0 0 2024-05-09T06:29:45.398 INFO:tasks.workunit.client.0.smithi062.stdout:9/116: dread d3/f17 [0,4194304] 0 2024-05-09T06:29:45.403 INFO:tasks.workunit.client.1.smithi079.stdout:0/971: write d3/dd/d1f/d1e/f2a [345578,122685] 0 2024-05-09T06:29:45.403 INFO:tasks.workunit.client.1.smithi079.stdout:0/972: fsync d3/dd/d1f/f1d 0 2024-05-09T06:29:45.403 INFO:tasks.workunit.client.1.smithi079.stdout:0/973: write d3/dd/f53 [4988217,15275] 0 2024-05-09T06:29:45.406 INFO:tasks.workunit.client.0.smithi062.stdout:9/117: write d3/f17 [7141096,93504] 0 2024-05-09T06:29:45.406 INFO:tasks.workunit.client.0.smithi062.stdout:9/118: readlink d3/l14 0 2024-05-09T06:29:45.406 INFO:tasks.workunit.client.0.smithi062.stdout:9/119: chown d3/d1a/d1c/l2f 107060401 1 2024-05-09T06:29:45.408 INFO:tasks.workunit.client.0.smithi062.stdout:9/120: rename d3/cb to d3/d1a/d1c/d2b/c30 0 2024-05-09T06:29:45.408 INFO:tasks.workunit.client.0.smithi062.stdout:9/121: chown c1 51875531 1 2024-05-09T06:29:45.408 INFO:tasks.workunit.client.0.smithi062.stdout:9/122: chown d3/d1a/f1b 89031403 1 2024-05-09T06:29:45.412 INFO:tasks.workunit.client.1.smithi079.stdout:0/974: dread d3/dd/d1f/d1e/f2a [0,4194304] 0 2024-05-09T06:29:45.412 INFO:tasks.workunit.client.1.smithi079.stdout:0/975: fdatasync d3/dd/d18/f7a 0 2024-05-09T06:29:45.417 INFO:tasks.workunit.client.1.smithi079.stdout:0/976: dread d3/dd/d66/d6d/d74/d84/fa3 [0,4194304] 0 2024-05-09T06:29:45.430 INFO:tasks.workunit.client.1.smithi079.stdout:0/977: dwrite d3/fbb [0,4194304] 0 2024-05-09T06:29:45.433 INFO:tasks.workunit.client.1.smithi079.stdout:0/978: rename d3/dd/d66/lb3 to d3/dd/d66/d6d/d74/d80/l138 0 2024-05-09T06:29:45.433 INFO:tasks.workunit.client.1.smithi079.stdout:0/979: stat d3/dd/d18/d5e/d69/d11b/l11e 0 2024-05-09T06:29:45.434 INFO:tasks.workunit.client.1.smithi079.stdout:0/980: symlink d3/dd/d66/d6d/d74/d80/d2d/d90/l139 0 2024-05-09T06:29:45.435 INFO:tasks.workunit.client.1.smithi079.stdout:0/981: truncate d3/dd/d66/d6d/d74/d80/d2d/da7/fea 517813 0 2024-05-09T06:29:45.442 INFO:tasks.workunit.client.1.smithi079.stdout:0/982: read d3/dd/d1f/d1e/d2c/dc0/fd4 [2078518,12059] 0 2024-05-09T06:29:45.455 INFO:tasks.workunit.client.1.smithi079.stdout:0/983: dwrite d3/dd/d18/d5e/d69/f75 [0,4194304] 0 2024-05-09T06:29:45.459 INFO:tasks.workunit.client.1.smithi079.stdout:0/984: rename d3/d5 to d3/dd/d1f/d1e/d2c/dc0/d13a 0 2024-05-09T06:29:45.459 INFO:tasks.workunit.client.1.smithi079.stdout:0/985: fsync d3/dd/d1f/d1e/d2c/d35/d36/f4c 0 2024-05-09T06:29:45.463 INFO:tasks.workunit.client.1.smithi079.stdout:0/986: write d3/dd/d18/d5e/d69/f7c [1086122,53901] 0 2024-05-09T06:29:45.463 INFO:tasks.workunit.client.1.smithi079.stdout:0/987: readlink d3/dd/d66/d6d/d74/d80/d2d/d90/l139 0 2024-05-09T06:29:45.463 INFO:tasks.workunit.client.1.smithi079.stdout:0/988: getdents d3/dd/d66/d6d/d74/d80/d2d/d90/d11f 0 2024-05-09T06:29:45.467 INFO:tasks.workunit.client.1.smithi079.stdout:7/856: sync 2024-05-09T06:29:45.468 INFO:tasks.workunit.client.1.smithi079.stdout:0/989: dread d3/dd/d66/d6d/d74/d80/f32 [4194304,4194304] 0 2024-05-09T06:29:45.468 INFO:tasks.workunit.client.1.smithi079.stdout:7/857: mknod d4/d7/d37/d7c/c10f 0 2024-05-09T06:29:45.469 INFO:tasks.workunit.client.1.smithi079.stdout:7/858: truncate d4/d7/d37/f46 3057036 0 2024-05-09T06:29:45.470 INFO:tasks.workunit.client.1.smithi079.stdout:7/859: symlink d4/d7/dd/d47/df5/l110 0 2024-05-09T06:29:45.472 INFO:tasks.workunit.client.1.smithi079.stdout:7/860: dread d4/d9e/fea [0,4194304] 0 2024-05-09T06:29:45.473 INFO:tasks.workunit.client.1.smithi079.stdout:7/861: symlink d4/d7/d78/l111 0 2024-05-09T06:29:45.488 INFO:tasks.workunit.client.1.smithi079.stdout:7/862: dwrite d4/d7/dd/d5b/d31/d34/f7a [0,4194304] 0 2024-05-09T06:29:45.488 INFO:tasks.workunit.client.1.smithi079.stdout:0/990: dread d3/dd/d1f/d1e/d2c/dc0/d13a/d87/f94 [0,4194304] 0 2024-05-09T06:29:45.490 INFO:tasks.workunit.client.1.smithi079.stdout:7/863: unlink d4/d7/d22/d28/d50/d5c/la2 0 2024-05-09T06:29:45.491 INFO:tasks.workunit.client.1.smithi079.stdout:7/864: mkdir d4/d7/d37/d7c/d112 0 2024-05-09T06:29:45.491 INFO:tasks.workunit.client.1.smithi079.stdout:7/865: chown d4/d7/d22/d28/d50/d5c/ddc/fcd 646910 1 2024-05-09T06:29:45.492 INFO:tasks.workunit.client.1.smithi079.stdout:7/866: rename d4/d7/d22/d28/c77 to d4/d7/d22/d28/d50/c113 0 2024-05-09T06:29:45.502 INFO:tasks.workunit.client.1.smithi079.stdout:7/867: dread d4/f64 [0,4194304] 0 2024-05-09T06:29:45.503 INFO:tasks.workunit.client.1.smithi079.stdout:7/868: truncate d4/d7/d22/d28/d50/d5c/d85/f105 195693 0 2024-05-09T06:29:45.504 INFO:tasks.workunit.client.1.smithi079.stdout:0/991: dwrite d3/dd/d66/d6d/d74/d80/d76/fa0 [0,4194304] 0 2024-05-09T06:29:45.504 INFO:tasks.workunit.client.1.smithi079.stdout:7/869: rename d4/d7/cf to d4/d20/c114 0 2024-05-09T06:29:45.506 INFO:tasks.workunit.client.1.smithi079.stdout:0/992: rename d3/dd/d1f/d1e/d2c/d7f/l9a to d3/dd/d66/d6d/d74/d80/d2d/da7/l13b 0 2024-05-09T06:29:45.508 INFO:tasks.workunit.client.1.smithi079.stdout:7/870: creat d4/d7/dd/d5b/d31/d34/f115 x:0 0 0 2024-05-09T06:29:45.510 INFO:tasks.workunit.client.1.smithi079.stdout:0/993: creat d3/dd/d66/d6d/d74/d84/f13c x:0 0 0 2024-05-09T06:29:45.510 INFO:tasks.workunit.client.1.smithi079.stdout:0/994: creat d3/dd/d71/db4/f13d x:0 0 0 2024-05-09T06:29:45.523 INFO:tasks.workunit.client.1.smithi079.stdout:0/995: dread d3/dd/d1f/d1e/d2c/d88/d8e/de3/f106 [0,4194304] 0 2024-05-09T06:29:45.525 INFO:tasks.workunit.client.1.smithi079.stdout:0/996: link d3/dd/d1f/d1e/c61 d3/dd/d66/d6d/da6/d12e/c13e 0 2024-05-09T06:29:45.525 INFO:tasks.workunit.client.1.smithi079.stdout:7/871: dwrite d4/d7/dd/d5b/d31/d34/f3c [0,4194304] 0 2024-05-09T06:29:45.526 INFO:tasks.workunit.client.1.smithi079.stdout:0/997: unlink d3/dd/d1f/d1e/d2c/d35/f7d 0 2024-05-09T06:29:45.527 INFO:tasks.workunit.client.1.smithi079.stdout:7/872: symlink d4/d7/d22/d28/d50/d5c/df0/d104/l116 0 2024-05-09T06:29:45.527 INFO:tasks.workunit.client.1.smithi079.stdout:7/873: write d4/d7/d37/f46 [3787213,46974] 0 2024-05-09T06:29:45.528 INFO:tasks.workunit.client.1.smithi079.stdout:7/874: mknod d4/d7/dd/d5b/d31/d108/c117 0 2024-05-09T06:29:45.528 INFO:tasks.workunit.client.1.smithi079.stdout:7/875: chown d4/d7/dd/d88/fb5 431 1 2024-05-09T06:29:45.528 INFO:tasks.workunit.client.1.smithi079.stdout:7/876: chown d4/d7/d37/f46 2 1 2024-05-09T06:29:45.528 INFO:tasks.workunit.client.1.smithi079.stdout:7/877: chown d4/d20 15 1 2024-05-09T06:29:45.529 INFO:tasks.workunit.client.1.smithi079.stdout:7/878: truncate d4/d7/dd/d5b/d32/f8b 343007 0 2024-05-09T06:29:45.531 INFO:tasks.workunit.client.1.smithi079.stdout:7/879: mknod d4/d7/d22/d28/d50/d5c/df0/c118 0 2024-05-09T06:29:45.531 INFO:tasks.workunit.client.1.smithi079.stdout:7/880: chown d4/d7/dd/d5b/d31/f75 3927925 1 2024-05-09T06:29:45.533 INFO:tasks.workunit.client.1.smithi079.stdout:7/881: rename d4/d7/d78/ldf to d4/l119 0 2024-05-09T06:29:45.533 INFO:tasks.workunit.client.1.smithi079.stdout:7/882: chown d4/d7/dd/d5b/d31/d34/f3c 0 1 2024-05-09T06:29:45.541 INFO:tasks.workunit.client.1.smithi079.stdout:0/998: dwrite d3/fa1 [4194304,4194304] 0 2024-05-09T06:29:45.553 INFO:tasks.workunit.client.1.smithi079.stdout:7/883: dwrite d4/d7/d22/d28/d50/fb2 [0,4194304] 0 2024-05-09T06:29:45.559 INFO:tasks.workunit.client.1.smithi079.stdout:0/999: dwrite d3/dd/d66/d6d/d74/d80/d76/fa0 [0,4194304] 0 2024-05-09T06:29:45.616 INFO:tasks.workunit.client.1.smithi079.stdout:7/884: sync 2024-05-09T06:29:45.616 INFO:tasks.workunit.client.1.smithi079.stdout:7/885: fsync d4/d7/d37/f46 0 2024-05-09T06:29:45.617 INFO:tasks.workunit.client.1.smithi079.stdout:7/886: getdents d4/d7/d22/d28/d50 0 2024-05-09T06:29:45.617 INFO:tasks.workunit.client.1.smithi079.stdout:7/887: creat d4/d7/dd/d5b/d32/de9/f11a x:0 0 0 2024-05-09T06:29:45.618 INFO:tasks.workunit.client.1.smithi079.stdout:7/888: mknod d4/d7/d22/d28/d50/d5c/d85/c11b 0 2024-05-09T06:29:45.619 INFO:tasks.workunit.client.1.smithi079.stdout:7/889: getdents d4/d7/d22/d28 0 2024-05-09T06:29:45.620 INFO:tasks.workunit.client.1.smithi079.stdout:7/890: mkdir d4/d7/dd/d5b/d6f/db9/d11c 0 2024-05-09T06:29:45.620 INFO:tasks.workunit.client.1.smithi079.stdout:7/891: mknod d4/d9e/dc5/c11d 0 2024-05-09T06:29:45.629 INFO:tasks.workunit.client.1.smithi079.stdout:7/892: read d4/d7/d22/d28/d50/d5c/ddc/fcd [902524,37338] 0 2024-05-09T06:29:45.630 INFO:tasks.workunit.client.1.smithi079.stdout:7/893: mknod d4/d7/d37/d7c/d112/c11e 0 2024-05-09T06:29:45.648 INFO:tasks.workunit.client.1.smithi079.stdout:7/894: dwrite d4/d7/d22/d28/d50/fb2 [0,4194304] 0 2024-05-09T06:29:45.650 INFO:tasks.workunit.client.1.smithi079.stdout:7/895: unlink d4/f26 0 2024-05-09T06:29:45.651 INFO:tasks.workunit.client.1.smithi079.stdout:7/896: symlink d4/d7/l11f 0 2024-05-09T06:29:45.658 INFO:tasks.workunit.client.1.smithi079.stdout:7/897: dread d4/d7/dd/d5b/f3a [0,4194304] 0 2024-05-09T06:29:45.673 INFO:tasks.workunit.client.1.smithi079.stdout:7/898: dwrite d4/d7/dd/d5b/d31/fc1 [0,4194304] 0 2024-05-09T06:29:45.674 INFO:tasks.workunit.client.1.smithi079.stdout:7/899: read d4/d7/d37/f57 [230986,53071] 0 2024-05-09T06:29:45.675 INFO:tasks.workunit.client.1.smithi079.stdout:7/900: dread d4/d7/dd/d5b/d6f/f80 [0,4194304] 0 2024-05-09T06:29:45.677 INFO:tasks.workunit.client.1.smithi079.stdout:7/901: mknod d4/d7/d22/d28/d50/d5c/c120 0 2024-05-09T06:29:45.690 INFO:tasks.workunit.client.1.smithi079.stdout:7/902: dwrite d4/d7/d22/d28/d50/d5c/d85/f105 [0,4194304] 0 2024-05-09T06:29:45.690 INFO:tasks.workunit.client.1.smithi079.stdout:7/903: write d4/d7/dd/d5b/d31/f75 [2202405,127402] 0 2024-05-09T06:29:45.690 INFO:tasks.workunit.client.1.smithi079.stdout:7/904: fdatasync d4/d7/dd/d5b/d31/d34/f115 0 2024-05-09T06:29:45.693 INFO:tasks.workunit.client.1.smithi079.stdout:7/905: rename d4/d7/d22/d28/d50/d5c/ddc/lbf to d4/d7/dd/d5b/d31/d108/l121 0 2024-05-09T06:29:45.694 INFO:tasks.workunit.client.1.smithi079.stdout:7/906: chown d4/d7/dd/d47/c101 393349892 1 2024-05-09T06:29:45.694 INFO:tasks.workunit.client.1.smithi079.stdout:7/907: stat d4/d7/dd/d5b/d31/d34/ced 0 2024-05-09T06:29:45.694 INFO:tasks.workunit.client.1.smithi079.stdout:7/908: write d4/d9e/fea [334483,69716] 0 2024-05-09T06:29:45.695 INFO:tasks.workunit.client.1.smithi079.stdout:7/909: creat d4/d7/d22/d28/d50/dfd/f122 x:0 0 0 2024-05-09T06:29:45.696 INFO:tasks.workunit.client.1.smithi079.stdout:7/910: link d4/f6 d4/d7/dd/d5b/d6f/db9/d11c/f123 0 2024-05-09T06:29:45.697 INFO:tasks.workunit.client.1.smithi079.stdout:7/911: mkdir d4/d7/d22/d109/d124 0 2024-05-09T06:29:45.699 INFO:tasks.workunit.client.1.smithi079.stdout:7/912: rmdir d4/d7/dd/d47 39 2024-05-09T06:29:45.700 INFO:tasks.workunit.client.1.smithi079.stdout:7/913: symlink d4/d7/d22/l125 0 2024-05-09T06:29:45.718 INFO:tasks.workunit.client.1.smithi079.stdout:7/914: dwrite d4/f11 [0,4194304] 0 2024-05-09T06:29:45.720 INFO:tasks.workunit.client.1.smithi079.stdout:7/915: unlink d4/d7/d78/f97 0 2024-05-09T06:29:45.720 INFO:tasks.workunit.client.1.smithi079.stdout:7/916: dread - d4/d7/dd/d5b/d6f/f62 zero size 2024-05-09T06:29:45.734 INFO:tasks.workunit.client.1.smithi079.stdout:7/917: dwrite d4/d7/dd/f6d [0,4194304] 0 2024-05-09T06:29:45.735 INFO:tasks.workunit.client.1.smithi079.stdout:7/918: rename d4/d7/f18 to d4/d7/d22/d28/d50/dfd/f126 0 2024-05-09T06:29:45.736 INFO:tasks.workunit.client.1.smithi079.stdout:7/919: mkdir d4/d7/d22/d127 0 2024-05-09T06:29:45.736 INFO:tasks.workunit.client.1.smithi079.stdout:7/920: chown d4/d7/dd/f42 843123 1 2024-05-09T06:29:45.737 INFO:tasks.workunit.client.1.smithi079.stdout:7/921: creat d4/d7/d22/d28/f128 x:0 0 0 2024-05-09T06:29:45.751 INFO:tasks.workunit.client.1.smithi079.stdout:7/922: dwrite d4/d7/dd/d5b/d32/fe8 [0,4194304] 0 2024-05-09T06:29:45.764 INFO:tasks.workunit.client.1.smithi079.stdout:7/923: dwrite d4/d7/d22/fd5 [0,4194304] 0 2024-05-09T06:29:45.765 INFO:tasks.workunit.client.1.smithi079.stdout:7/924: symlink d4/d7/d37/d7c/l129 0 2024-05-09T06:29:45.766 INFO:tasks.workunit.client.1.smithi079.stdout:7/925: rmdir d4/d7/d22/d109/d124 0 2024-05-09T06:29:45.767 INFO:tasks.workunit.client.1.smithi079.stdout:7/926: link d4/d9e/fea d4/d7/d22/d28/d50/d5c/d85/f12a 0 2024-05-09T06:29:45.772 INFO:tasks.workunit.client.1.smithi079.stdout:7/927: dread d4/d7/d37/d7c/d8e/fb1 [0,4194304] 0 2024-05-09T06:29:45.772 INFO:tasks.workunit.client.1.smithi079.stdout:7/928: readlink d4/l119 0 2024-05-09T06:29:45.773 INFO:tasks.workunit.client.1.smithi079.stdout:7/929: mknod d4/d7/dd/c12b 0 2024-05-09T06:29:45.773 INFO:tasks.workunit.client.1.smithi079.stdout:7/930: fsync d4/d7/dd/d5b/f3a 0 2024-05-09T06:29:45.785 INFO:tasks.workunit.client.1.smithi079.stdout:7/931: dwrite d4/d7/dd/d5b/d6f/f80 [0,4194304] 0 2024-05-09T06:29:45.788 INFO:tasks.workunit.client.1.smithi079.stdout:7/932: mkdir d4/d7/d78/d12c 0 2024-05-09T06:29:45.789 INFO:tasks.workunit.client.1.smithi079.stdout:7/933: truncate d4/f64 2937952 0 2024-05-09T06:29:45.789 INFO:tasks.workunit.client.1.smithi079.stdout:7/934: chown d4/d7/d22/d28/d74/fcf 0 1 2024-05-09T06:29:45.790 INFO:tasks.workunit.client.1.smithi079.stdout:7/935: creat d4/d7/d78/d12c/f12d x:0 0 0 2024-05-09T06:29:45.790 INFO:tasks.workunit.client.1.smithi079.stdout:7/936: chown d4/d7/dd/d5b/f3a 27562 1 2024-05-09T06:29:45.807 INFO:tasks.workunit.client.1.smithi079.stdout:7/937: dwrite d4/d7/d22/d28/d74/f106 [0,4194304] 0 2024-05-09T06:29:45.814 INFO:tasks.workunit.client.1.smithi079.stdout:7/938: dread d4/d7/d22/d28/fd1 [0,4194304] 0 2024-05-09T06:29:45.815 INFO:tasks.workunit.client.1.smithi079.stdout:7/939: link d4/d7/d22/l2d d4/d7/d37/d7c/d112/l12e 0 2024-05-09T06:29:45.828 INFO:tasks.workunit.client.1.smithi079.stdout:7/940: dwrite d4/d7/dd/d5b/d6f/db9/d11c/f123 [0,4194304] 0 2024-05-09T06:29:45.829 INFO:tasks.workunit.client.1.smithi079.stdout:7/941: mknod d4/d7/dd/d47/c12f 0 2024-05-09T06:29:45.830 INFO:tasks.workunit.client.1.smithi079.stdout:7/942: mkdir d4/d7/dd/d47/d130 0 2024-05-09T06:29:45.830 INFO:tasks.workunit.client.1.smithi079.stdout:7/943: getdents d4/d7/d22/d28/d50/d5c/df0 0 2024-05-09T06:29:45.831 INFO:tasks.workunit.client.1.smithi079.stdout:7/944: creat d4/d7/d37/d7c/d8e/f131 x:0 0 0 2024-05-09T06:29:45.831 INFO:tasks.workunit.client.1.smithi079.stdout:7/945: dread - d4/d7/dd/d5b/fe1 zero size 2024-05-09T06:29:45.832 INFO:tasks.workunit.client.1.smithi079.stdout:7/946: link d4/d7/dd/d5b/d32/ce4 d4/d7/d37/d67/de6/c132 0 2024-05-09T06:29:45.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:45.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:45.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:45 smithi079 ceph-mon[35268]: pgmap v252: 65 pgs: 65 active+clean; 2.1 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 161 MiB/s rd, 199 MiB/s wr, 469 op/s 2024-05-09T06:29:45.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:45.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:45 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:45.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:45.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:45.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:45 smithi062 ceph-mon[26920]: pgmap v252: 65 pgs: 65 active+clean; 2.1 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 161 MiB/s rd, 199 MiB/s wr, 469 op/s 2024-05-09T06:29:45.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:45.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:45 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:46.026 INFO:tasks.workunit.client.1.smithi079.stdout:7/947: sync 2024-05-09T06:29:46.027 INFO:tasks.workunit.client.1.smithi079.stdout:7/948: mkdir d4/d7/d22/d28/d50/d5c/ddc/d133 0 2024-05-09T06:29:46.027 INFO:tasks.workunit.client.1.smithi079.stdout:7/949: fsync d4/d7/d37/d7c/f8f 0 2024-05-09T06:29:46.030 INFO:tasks.workunit.client.1.smithi079.stdout:7/950: dread d4/d7/d37/f4a [0,4194304] 0 2024-05-09T06:29:46.031 INFO:tasks.workunit.client.1.smithi079.stdout:7/951: creat d4/d7/d78/f134 x:0 0 0 2024-05-09T06:29:46.046 INFO:tasks.workunit.client.1.smithi079.stdout:7/952: dwrite d4/d7/d37/d7c/d8e/f131 [0,4194304] 0 2024-05-09T06:29:46.059 INFO:tasks.workunit.client.1.smithi079.stdout:7/953: dwrite d4/d7/dd/d5b/d31/f75 [0,4194304] 0 2024-05-09T06:29:46.061 INFO:tasks.workunit.client.1.smithi079.stdout:7/954: creat d4/d7/d22/d28/d50/d5c/ddc/d133/f135 x:0 0 0 2024-05-09T06:29:46.061 INFO:tasks.workunit.client.1.smithi079.stdout:7/955: dread d4/d7/dd/d47/f5e [0,4194304] 0 2024-05-09T06:29:46.062 INFO:tasks.workunit.client.1.smithi079.stdout:7/956: fsync d4/d7/dd/d5b/f3a 0 2024-05-09T06:29:46.070 INFO:tasks.workunit.client.1.smithi079.stdout:7/957: write d4/d7/dd/d5b/d31/d34/f3c [3441523,19427] 0 2024-05-09T06:29:46.071 INFO:tasks.workunit.client.1.smithi079.stdout:7/958: truncate d4/d7/d22/d28/d74/f76 4423268 0 2024-05-09T06:29:46.081 INFO:tasks.workunit.client.1.smithi079.stdout:7/959: write d4/d7/d22/f23 [2675438,62747] 0 2024-05-09T06:29:46.136 INFO:tasks.workunit.client.1.smithi079.stdout:7/960: sync 2024-05-09T06:29:46.136 INFO:tasks.workunit.client.1.smithi079.stdout:7/961: write d4/d9e/ffe [742124,56236] 0 2024-05-09T06:29:46.136 INFO:tasks.workunit.client.1.smithi079.stdout:7/962: truncate d4/d7/d22/d28/d50/d5c/ddc/fcd 1645272 0 2024-05-09T06:29:46.138 INFO:tasks.workunit.client.1.smithi079.stdout:7/963: mknod d4/d7/d22/d28/d74/c136 0 2024-05-09T06:29:46.139 INFO:tasks.workunit.client.1.smithi079.stdout:7/964: symlink d4/d7/d22/d28/d50/d5c/d85/db6/l137 0 2024-05-09T06:29:46.150 INFO:tasks.workunit.client.1.smithi079.stdout:7/965: write d4/d7/dd/f6d [2905694,10047] 0 2024-05-09T06:29:46.236 INFO:tasks.workunit.client.1.smithi079.stdout:7/966: sync 2024-05-09T06:29:46.236 INFO:tasks.workunit.client.1.smithi079.stdout:7/967: fsync d4/d7/d37/d7c/f8f 0 2024-05-09T06:29:46.237 INFO:tasks.workunit.client.1.smithi079.stdout:7/968: symlink d4/d7/dd/d5b/d6f/db9/d11c/l138 0 2024-05-09T06:29:46.237 INFO:tasks.workunit.client.1.smithi079.stdout:7/969: stat d4/d7/dd/d47/fee 0 2024-05-09T06:29:46.237 INFO:tasks.workunit.client.1.smithi079.stdout:7/970: getdents d4/d20 0 2024-05-09T06:29:46.239 INFO:tasks.workunit.client.1.smithi079.stdout:7/971: getdents d4/d9e 0 2024-05-09T06:29:46.239 INFO:tasks.workunit.client.1.smithi079.stdout:7/972: creat d4/d7/d22/d28/d50/d5c/d85/f139 x:0 0 0 2024-05-09T06:29:46.241 INFO:tasks.workunit.client.1.smithi079.stdout:7/973: mknod d4/d7/d37/d7c/d8e/c13a 0 2024-05-09T06:29:46.241 INFO:tasks.workunit.client.1.smithi079.stdout:7/974: fdatasync d4/d7/dd/d5b/d31/f81 0 2024-05-09T06:29:46.242 INFO:tasks.workunit.client.1.smithi079.stdout:7/975: mkdir d4/d7/d22/d28/d50/d5c/d85/db6/d13b 0 2024-05-09T06:29:46.243 INFO:tasks.workunit.client.1.smithi079.stdout:7/976: creat d4/d7/d22/d28/d50/d5c/d85/db6/d13b/f13c x:0 0 0 2024-05-09T06:29:46.243 INFO:tasks.workunit.client.1.smithi079.stdout:7/977: write d4/d9e/fea [1368662,27930] 0 2024-05-09T06:29:46.268 INFO:tasks.workunit.client.1.smithi079.stdout:7/978: dwrite d4/d9e/fea [0,4194304] 0 2024-05-09T06:29:46.270 INFO:tasks.workunit.client.1.smithi079.stdout:7/979: getdents d4/d7/dd/d5b/d31 0 2024-05-09T06:29:46.271 INFO:tasks.workunit.client.1.smithi079.stdout:7/980: creat d4/d7/d22/d28/d50/d5c/ddc/f13d x:0 0 0 2024-05-09T06:29:46.272 INFO:tasks.workunit.client.1.smithi079.stdout:7/981: mknod d4/d7/d22/c13e 0 2024-05-09T06:29:46.273 INFO:tasks.workunit.client.1.smithi079.stdout:7/982: getdents d4/d7/dd/d47/df5 0 2024-05-09T06:29:46.357 INFO:tasks.workunit.client.1.smithi079.stdout:7/983: sync 2024-05-09T06:29:46.359 INFO:tasks.workunit.client.1.smithi079.stdout:7/984: unlink d4/d7/dd/d5b/d6f/f62 0 2024-05-09T06:29:46.361 INFO:tasks.workunit.client.1.smithi079.stdout:7/985: creat d4/d7/dd/d5b/d6f/f13f x:0 0 0 2024-05-09T06:29:46.361 INFO:tasks.workunit.client.1.smithi079.stdout:7/986: chown d4/d7/dd/d88/lbe 109640395 1 2024-05-09T06:29:46.361 INFO:tasks.workunit.client.1.smithi079.stdout:7/987: fsync d4/d7/d22/d28/fd9 0 2024-05-09T06:29:46.361 INFO:tasks.workunit.client.1.smithi079.stdout:7/988: stat d4/d7/dd/f1e 0 2024-05-09T06:29:46.361 INFO:tasks.workunit.client.1.smithi079.stdout:7/989: write d4/d20/f4f [4651351,60447] 0 2024-05-09T06:29:46.367 INFO:tasks.workunit.client.1.smithi079.stdout:7/990: write d4/d7/d22/d28/d50/d5c/d85/f105 [134956,70678] 0 2024-05-09T06:29:46.369 INFO:tasks.workunit.client.1.smithi079.stdout:7/991: creat d4/d7/d22/d28/d50/d5c/f140 x:0 0 0 2024-05-09T06:29:46.376 INFO:tasks.workunit.client.1.smithi079.stdout:7/992: dread d4/f6 [0,4194304] 0 2024-05-09T06:29:46.379 INFO:tasks.workunit.client.1.smithi079.stdout:7/993: dread d4/d7/d22/d28/fd1 [0,4194304] 0 2024-05-09T06:29:46.381 INFO:tasks.workunit.client.1.smithi079.stdout:7/994: dread d4/d7/d22/d28/fd1 [0,4194304] 0 2024-05-09T06:29:46.382 INFO:tasks.workunit.client.1.smithi079.stdout:7/995: chown d4/d7/dd/d47 129222 1 2024-05-09T06:29:46.382 INFO:tasks.workunit.client.1.smithi079.stdout:7/996: write d4/d7/dd/f21 [2560794,65200] 0 2024-05-09T06:29:46.384 INFO:tasks.workunit.client.1.smithi079.stdout:7/997: link d4/d7/lde d4/d7/dd/d5b/d31/d108/l141 0 2024-05-09T06:29:46.565 INFO:tasks.workunit.client.1.smithi079.stdout:7/998: sync 2024-05-09T06:29:46.567 INFO:tasks.workunit.client.1.smithi079.stdout:7/999: rename d4/l119 to d4/d20/l142 0 2024-05-09T06:29:46.571 INFO:tasks.workunit.client.1.smithi079.stderr:+ rm -rf -- ./tmp.7Uz5uDasSK 2024-05-09T06:29:46.762 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:46 smithi079 ceph-mon[35268]: Standby manager daemon smithi079.genyri restarted 2024-05-09T06:29:46.763 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:46 smithi079 ceph-mon[35268]: Standby manager daemon smithi079.genyri started 2024-05-09T06:29:46.763 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:46 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:29:46.763 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:46 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:29:46.763 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:46 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:29:46.763 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:46 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:29:46.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:46 smithi062 ceph-mon[26920]: Standby manager daemon smithi079.genyri restarted 2024-05-09T06:29:46.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:46 smithi062 ceph-mon[26920]: Standby manager daemon smithi079.genyri started 2024-05-09T06:29:46.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:46 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:29:46.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:46 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:29:46.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:46 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:29:46.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:46 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:29:47.175 INFO:tasks.workunit.client.0.smithi062.stdout:0/40: sync 2024-05-09T06:29:47.175 INFO:tasks.workunit.client.0.smithi062.stdout:2/1: sync 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:7/7: sync 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:7/8: write - no filename 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:8/15: sync 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:3/20: sync 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:3/21: chown d1/c4 159367882 1 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:2/2: getdents . 0 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:2/3: chown . 21 1 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:6/19: sync 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:2/4: dread - no filename 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:2/5: rmdir - no directory 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:9/123: sync 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:1/6: sync 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:6/20: fdatasync f4 0 2024-05-09T06:29:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:4/47: sync 2024-05-09T06:29:47.177 INFO:tasks.workunit.client.0.smithi062.stdout:5/0: sync 2024-05-09T06:29:47.177 INFO:tasks.workunit.client.0.smithi062.stdout:4/48: stat d0/d2/f5 0 2024-05-09T06:29:47.178 INFO:tasks.workunit.client.0.smithi062.stdout:7/9: mkdir d0 0 2024-05-09T06:29:47.178 INFO:tasks.workunit.client.0.smithi062.stdout:7/10: dwrite - no filename 2024-05-09T06:29:47.179 INFO:tasks.workunit.client.0.smithi062.stdout:7/11: dwrite - no filename 2024-05-09T06:29:47.179 INFO:tasks.workunit.client.0.smithi062.stdout:7/12: dwrite - no filename 2024-05-09T06:29:47.179 INFO:tasks.workunit.client.0.smithi062.stdout:7/13: chown d0 1017126 1 2024-05-09T06:29:47.181 INFO:tasks.workunit.client.0.smithi062.stdout:0/41: creat d1/ff x:0 0 0 2024-05-09T06:29:47.181 INFO:tasks.workunit.client.0.smithi062.stdout:0/42: stat d1/ca 0 2024-05-09T06:29:47.181 INFO:tasks.workunit.client.0.smithi062.stdout:0/43: dread - d1/ff zero size 2024-05-09T06:29:47.182 INFO:tasks.workunit.client.0.smithi062.stdout:3/22: link l0 d1/l7 0 2024-05-09T06:29:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:3/23: creat d1/f8 x:0 0 0 2024-05-09T06:29:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:3/24: chown d1/c5 1064 1 2024-05-09T06:29:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:2/6: mkdir d0 0 2024-05-09T06:29:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:2/7: read - no filename 2024-05-09T06:29:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:2/8: rename d0 to d0/d1 22 2024-05-09T06:29:47.186 INFO:tasks.workunit.client.0.smithi062.stdout:6/21: creat f7 x:0 0 0 2024-05-09T06:29:47.186 INFO:tasks.workunit.client.0.smithi062.stdout:6/22: stat l6 0 2024-05-09T06:29:47.186 INFO:tasks.workunit.client.0.smithi062.stdout:6/23: dread - f7 zero size 2024-05-09T06:29:47.187 INFO:tasks.workunit.client.0.smithi062.stdout:1/7: rename f1 to f2 0 2024-05-09T06:29:47.188 INFO:tasks.workunit.client.0.smithi062.stdout:1/8: readlink - no filename 2024-05-09T06:29:47.191 INFO:tasks.workunit.client.0.smithi062.stdout:9/124: mkdir d3/d1a/d1c/d2b/d31 0 2024-05-09T06:29:47.192 INFO:tasks.workunit.client.0.smithi062.stdout:1/9: dread f2 [0,4194304] 0 2024-05-09T06:29:47.193 INFO:tasks.workunit.client.0.smithi062.stdout:8/16: dwrite f2 [0,4194304] 0 2024-05-09T06:29:47.193 INFO:tasks.workunit.client.0.smithi062.stdout:4/49: mkdir d0/d9/dd 0 2024-05-09T06:29:47.194 INFO:tasks.workunit.client.0.smithi062.stdout:9/125: dread d3/d1a/d1c/d2b/f2d [0,4194304] 0 2024-05-09T06:29:47.194 INFO:tasks.workunit.client.0.smithi062.stdout:9/126: creat d3/d1a/f32 x:0 0 0 2024-05-09T06:29:47.194 INFO:tasks.workunit.client.0.smithi062.stdout:9/127: fsync d3/f16 0 2024-05-09T06:29:47.194 INFO:tasks.workunit.client.0.smithi062.stdout:9/128: stat d3/d1a/d1c 0 2024-05-09T06:29:47.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/1: mkdir d0 0 2024-05-09T06:29:47.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/2: dread - no filename 2024-05-09T06:29:47.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/3: rename d0 to d0/d1 22 2024-05-09T06:29:47.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/4: dread - no filename 2024-05-09T06:29:47.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/5: rename d0 to d0/d2 22 2024-05-09T06:29:47.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/6: chown d0 127 1 2024-05-09T06:29:47.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/7: rename d0 to d0/d3 22 2024-05-09T06:29:47.202 INFO:tasks.workunit.client.0.smithi062.stdout:7/14: creat d0/f1 x:0 0 0 2024-05-09T06:29:47.202 INFO:tasks.workunit.client.0.smithi062.stdout:7/15: dread - d0/f1 zero size 2024-05-09T06:29:47.202 INFO:tasks.workunit.client.0.smithi062.stdout:7/16: creat d0/f2 x:0 0 0 2024-05-09T06:29:47.209 INFO:tasks.workunit.client.0.smithi062.stdout:1/10: dwrite f0 [0,4194304] 0 2024-05-09T06:29:47.209 INFO:tasks.workunit.client.0.smithi062.stdout:1/11: chown f2 32800 1 2024-05-09T06:29:47.209 INFO:tasks.workunit.client.0.smithi062.stdout:1/12: chown f0 1321 1 2024-05-09T06:29:47.211 INFO:tasks.workunit.client.0.smithi062.stdout:3/25: symlink d1/l9 0 2024-05-09T06:29:47.217 INFO:tasks.workunit.client.0.smithi062.stdout:2/9: mknod d0/c2 0 2024-05-09T06:29:47.220 INFO:tasks.workunit.client.0.smithi062.stdout:6/24: creat f8 x:0 0 0 2024-05-09T06:29:47.225 INFO:tasks.workunit.client.0.smithi062.stdout:8/17: unlink f2 0 2024-05-09T06:29:47.225 INFO:tasks.workunit.client.0.smithi062.stdout:8/18: creat f3 x:0 0 0 2024-05-09T06:29:47.225 INFO:tasks.workunit.client.0.smithi062.stdout:8/19: write f1 [1754235,2968] 0 2024-05-09T06:29:47.226 INFO:tasks.workunit.client.0.smithi062.stdout:4/50: symlink d0/d2/le 0 2024-05-09T06:29:47.226 INFO:tasks.workunit.client.0.smithi062.stdout:4/51: chown d0/d9/fb 0 1 2024-05-09T06:29:47.226 INFO:tasks.workunit.client.0.smithi062.stdout:4/52: write d0/d2/f6 [3437178,37134] 0 2024-05-09T06:29:47.229 INFO:tasks.workunit.client.0.smithi062.stdout:5/8: mkdir d0/d4 0 2024-05-09T06:29:47.236 INFO:tasks.workunit.client.0.smithi062.stdout:7/17: mkdir d0/d3 0 2024-05-09T06:29:47.236 INFO:tasks.workunit.client.0.smithi062.stdout:7/18: dread - d0/f2 zero size 2024-05-09T06:29:47.238 INFO:tasks.workunit.client.0.smithi062.stdout:0/44: mknod d1/c10 0 2024-05-09T06:29:47.246 INFO:tasks.workunit.client.0.smithi062.stdout:1/13: link f2 f3 0 2024-05-09T06:29:47.246 INFO:tasks.workunit.client.0.smithi062.stdout:1/14: write f3 [1573096,113657] 0 2024-05-09T06:29:47.248 INFO:tasks.workunit.client.0.smithi062.stdout:6/25: creat f9 x:0 0 0 2024-05-09T06:29:47.251 INFO:tasks.workunit.client.0.smithi062.stdout:8/20: mknod c4 0 2024-05-09T06:29:47.254 INFO:tasks.workunit.client.0.smithi062.stdout:1/15: dread f3 [0,4194304] 0 2024-05-09T06:29:47.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/9: mkdir d0/d4/d5 0 2024-05-09T06:29:47.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/10: dwrite - no filename 2024-05-09T06:29:47.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/11: rename d0 to d0/d4/d5/d6 22 2024-05-09T06:29:47.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/12: truncate - no filename 2024-05-09T06:29:47.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/13: write - no filename 2024-05-09T06:29:47.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/14: unlink - no file 2024-05-09T06:29:47.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/15: fsync - no filename 2024-05-09T06:29:47.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/16: unlink - no file 2024-05-09T06:29:47.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/17: dread - no filename 2024-05-09T06:29:47.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/18: unlink - no file 2024-05-09T06:29:47.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/19: write - no filename 2024-05-09T06:29:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.276+0000 7f0c3bac6700 1 -- 172.21.15.62:0/2811936985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 msgr2=0x7f0c340fe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.276+0000 7f0c3bac6700 1 --2- 172.21.15.62:0/2811936985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 0x7f0c340fe500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0c24004940 tx=0x7f0c24009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.276+0000 7f0c3bac6700 1 -- 172.21.15.62:0/2811936985 shutdown_connections 2024-05-09T06:29:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.276+0000 7f0c3bac6700 1 --2- 172.21.15.62:0/2811936985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 0x7f0c340fe500 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.276+0000 7f0c3bac6700 1 --2- 172.21.15.62:0/2811936985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c340fce90 0x7f0c340fd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.276+0000 7f0c3bac6700 1 -- 172.21.15.62:0/2811936985 >> 172.21.15.62:0/2811936985 conn(0x7f0c340f85c0 msgr2=0x7f0c340fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.276+0000 7f0c3bac6700 1 -- 172.21.15.62:0/2811936985 shutdown_connections 2024-05-09T06:29:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.276+0000 7f0c3bac6700 1 -- 172.21.15.62:0/2811936985 wait complete. 2024-05-09T06:29:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.277+0000 7f0c3bac6700 1 Processor -- start 2024-05-09T06:29:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.277+0000 7f0c3bac6700 1 -- start start 2024-05-09T06:29:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.277+0000 7f0c3bac6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c340fce90 0x7f0c34071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.277+0000 7f0c3bac6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 0x7f0c340702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.277+0000 7f0c3bac6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34070860 con 0x7f0c340fe090 2024-05-09T06:29:47.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.277+0000 7f0c3bac6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c340709d0 con 0x7f0c340fce90 2024-05-09T06:29:47.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c39061700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 0x7f0c340702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:47.261 INFO:tasks.workunit.client.0.smithi062.stdout:7/19: rename d0/f1 to d0/f4 0 2024-05-09T06:29:47.261 INFO:tasks.workunit.client.0.smithi062.stdout:7/20: read - d0/f2 zero size 2024-05-09T06:29:47.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c39862700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c340fce90 0x7f0c34071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:47.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c39061700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 0x7f0c340702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45652/0 (socket says 172.21.15.62:45652) 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c39061700 1 -- 172.21.15.62:0/593219484 learned_addr learned my addr 172.21.15.62:0/593219484 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c39862700 1 -- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 msgr2=0x7f0c340702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c39862700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 0x7f0c340702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c39862700 1 -- 172.21.15.62:0/593219484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c24005040 con 0x7f0c340fce90 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c39862700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c340fce90 0x7f0c34071de0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0c30002840 tx=0x7f0c30004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.278+0000 7f0c2a7fc700 1 -- 172.21.15.62:0/593219484 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c30007cc0 con 0x7f0c340fce90 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.279+0000 7f0c2a7fc700 1 -- 172.21.15.62:0/593219484 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c3000f040 con 0x7f0c340fce90 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.279+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c34070cb0 con 0x7f0c340fce90 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.279+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c34115a50 con 0x7f0c340fce90 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.279+0000 7f0c2a7fc700 1 -- 172.21.15.62:0/593219484 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c30013920 con 0x7f0c340fce90 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.280+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c180052e0 con 0x7f0c340fce90 2024-05-09T06:29:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.280+0000 7f0c2a7fc700 1 -- 172.21.15.62:0/593219484 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 20) v1 ==== 93219+0+0 (secure 0 0 0) 0x7f0c30013b90 con 0x7f0c340fce90 2024-05-09T06:29:47.264 INFO:tasks.workunit.client.0.smithi062.stdout:0/45: chown d1/c5 4884 1 2024-05-09T06:29:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.281+0000 7f0c2a7fc700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c20070aa0 0x7f0c20072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.281+0000 7f0c2a7fc700 1 -- 172.21.15.62:0/593219484 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0c300903a0 con 0x7f0c340fce90 2024-05-09T06:29:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.281+0000 7f0c39061700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c20070aa0 0x7f0c20072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:47.265 INFO:tasks.workunit.client.0.smithi062.stdout:1/16: dread f0 [0,4194304] 0 2024-05-09T06:29:47.265 INFO:tasks.workunit.client.0.smithi062.stdout:1/17: chown f3 17321636 1 2024-05-09T06:29:47.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.282+0000 7f0c39061700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c20070aa0 0x7f0c20072f50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c24004f90 tx=0x7f0c24009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:47.267 INFO:tasks.workunit.client.0.smithi062.stdout:1/18: read f0 [3897596,95939] 0 2024-05-09T06:29:47.267 INFO:tasks.workunit.client.0.smithi062.stdout:6/26: creat fa x:0 0 0 2024-05-09T06:29:47.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.286+0000 7f0c2a7fc700 1 -- 172.21.15.62:0/593219484 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0c3005c5f0 con 0x7f0c340fce90 2024-05-09T06:29:47.272 INFO:tasks.workunit.client.0.smithi062.stdout:8/21: symlink l5 0 2024-05-09T06:29:47.278 INFO:tasks.workunit.client.0.smithi062.stdout:4/53: truncate d0/d2/f4 267182 0 2024-05-09T06:29:47.278 INFO:tasks.workunit.client.0.smithi062.stdout:5/20: creat d0/d4/f7 x:0 0 0 2024-05-09T06:29:47.279 INFO:tasks.workunit.client.0.smithi062.stdout:5/21: stat d0/d4/d5 0 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/21: creat d0/d3/f5 x:0 0 0 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/22: stat d0/f4 0 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/23: dread - d0/f4 zero size 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/24: dread - d0/f4 zero size 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/25: dread - d0/f2 zero size 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/26: stat d0/f2 0 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/27: dread - d0/f4 zero size 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/28: read - d0/f2 zero size 2024-05-09T06:29:47.281 INFO:tasks.workunit.client.0.smithi062.stdout:8/22: dread f1 [0,4194304] 0 2024-05-09T06:29:47.284 INFO:tasks.workunit.client.0.smithi062.stdout:0/46: truncate d1/f8 1495194 0 2024-05-09T06:29:47.287 INFO:tasks.workunit.client.0.smithi062.stdout:1/19: rename f2 to f4 0 2024-05-09T06:29:47.289 INFO:tasks.workunit.client.0.smithi062.stdout:1/20: dread f4 [0,4194304] 0 2024-05-09T06:29:47.289 INFO:tasks.workunit.client.0.smithi062.stdout:1/21: truncate f0 4296237 0 2024-05-09T06:29:47.289 INFO:tasks.workunit.client.0.smithi062.stdout:1/22: chown f3 914969 1 2024-05-09T06:29:47.289 INFO:tasks.workunit.client.0.smithi062.stdout:1/23: creat f5 x:0 0 0 2024-05-09T06:29:47.290 INFO:tasks.workunit.client.0.smithi062.stdout:1/24: write f5 [500009,110461] 0 2024-05-09T06:29:47.294 INFO:tasks.workunit.client.0.smithi062.stdout:4/54: rename d0/d9/dd to d0/d2/d8/df 0 2024-05-09T06:29:47.295 INFO:tasks.workunit.client.0.smithi062.stdout:5/22: mkdir d0/d8 0 2024-05-09T06:29:47.295 INFO:tasks.workunit.client.0.smithi062.stdout:5/23: chown d0/d4/d5 430 1 2024-05-09T06:29:47.295 INFO:tasks.workunit.client.0.smithi062.stdout:5/24: fdatasync d0/d4/f7 0 2024-05-09T06:29:47.296 INFO:tasks.workunit.client.0.smithi062.stdout:7/29: symlink d0/l6 0 2024-05-09T06:29:47.298 INFO:tasks.workunit.client.0.smithi062.stdout:4/55: dread d0/d2/f3 [0,4194304] 0 2024-05-09T06:29:47.301 INFO:tasks.workunit.client.0.smithi062.stdout:6/27: link f4 fb 0 2024-05-09T06:29:47.302 INFO:tasks.workunit.client.0.smithi062.stdout:4/56: dread d0/d9/fb [0,4194304] 0 2024-05-09T06:29:47.303 INFO:tasks.workunit.client.0.smithi062.stdout:4/57: dread d0/d9/fb [0,4194304] 0 2024-05-09T06:29:47.303 INFO:tasks.workunit.client.0.smithi062.stdout:4/58: truncate d0/d2/f4 913263 0 2024-05-09T06:29:47.304 INFO:tasks.workunit.client.0.smithi062.stdout:4/59: dread - d0/d9/fc zero size 2024-05-09T06:29:47.304 INFO:tasks.workunit.client.0.smithi062.stdout:4/60: chown d0/d2/d8/df 46849062 1 2024-05-09T06:29:47.304 INFO:tasks.workunit.client.0.smithi062.stdout:4/61: read d0/d9/fb [142523,78533] 0 2024-05-09T06:29:47.305 INFO:tasks.workunit.client.0.smithi062.stdout:5/25: symlink d0/d4/l9 0 2024-05-09T06:29:47.308 INFO:tasks.workunit.client.0.smithi062.stdout:8/23: dwrite f3 [0,4194304] 0 2024-05-09T06:29:47.308 INFO:tasks.workunit.client.0.smithi062.stdout:0/47: dwrite d1/ff [0,4194304] 0 2024-05-09T06:29:47.310 INFO:tasks.workunit.client.0.smithi062.stdout:4/62: creat d0/f10 x:0 0 0 2024-05-09T06:29:47.316 INFO:tasks.workunit.client.0.smithi062.stdout:7/30: getdents d0 0 2024-05-09T06:29:47.316 INFO:tasks.workunit.client.0.smithi062.stdout:7/31: stat d0/d3 0 2024-05-09T06:29:47.317 INFO:tasks.workunit.client.0.smithi062.stdout:8/24: write f1 [870778,88563] 0 2024-05-09T06:29:47.317 INFO:tasks.workunit.client.0.smithi062.stdout:8/25: fsync f3 0 2024-05-09T06:29:47.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/28: dwrite fa [0,4194304] 0 2024-05-09T06:29:47.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/29: fdatasync fa 0 2024-05-09T06:29:47.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/30: readlink l5 0 2024-05-09T06:29:47.326 INFO:tasks.workunit.client.0.smithi062.stdout:0/48: chown d1/l6 16 1 2024-05-09T06:29:47.332 INFO:tasks.workunit.client.0.smithi062.stdout:8/26: write f3 [4706422,103849] 0 2024-05-09T06:29:47.332 INFO:tasks.workunit.client.0.smithi062.stdout:8/27: rmdir - no directory 2024-05-09T06:29:47.332 INFO:tasks.workunit.client.0.smithi062.stdout:8/28: stat f1 0 2024-05-09T06:29:47.334 INFO:tasks.workunit.client.0.smithi062.stdout:6/31: mkdir dc 0 2024-05-09T06:29:47.337 INFO:tasks.workunit.client.0.smithi062.stdout:0/49: write d1/ff [3796310,76296] 0 2024-05-09T06:29:47.340 INFO:tasks.workunit.client.0.smithi062.stdout:7/32: dwrite d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.340 INFO:tasks.workunit.client.0.smithi062.stdout:7/33: truncate d0/f2 58413 0 2024-05-09T06:29:47.340 INFO:tasks.workunit.client.0.smithi062.stdout:7/34: stat d0 0 2024-05-09T06:29:47.340 INFO:tasks.workunit.client.0.smithi062.stdout:7/35: truncate d0/f4 906566 0 2024-05-09T06:29:47.340 INFO:tasks.workunit.client.0.smithi062.stdout:7/36: chown d0/f4 1355634 1 2024-05-09T06:29:47.340 INFO:tasks.workunit.client.0.smithi062.stdout:5/26: dwrite d0/d4/f7 [0,4194304] 0 2024-05-09T06:29:47.340 INFO:tasks.workunit.client.0.smithi062.stdout:8/29: fdatasync f1 0 2024-05-09T06:29:47.340 INFO:tasks.workunit.client.0.smithi062.stdout:8/30: chown f3 580 1 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/31: stat c4 0 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/32: creat f6 x:0 0 0 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/33: truncate f6 396224 0 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/34: creat f7 x:0 0 0 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/35: readlink l5 0 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/36: creat f8 x:0 0 0 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/37: chown f6 1 1 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/38: truncate f7 343188 0 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:8/39: creat f9 x:0 0 0 2024-05-09T06:29:47.341 INFO:tasks.workunit.client.0.smithi062.stdout:7/37: dread d0/f2 [0,4194304] 0 2024-05-09T06:29:47.342 INFO:tasks.workunit.client.0.smithi062.stdout:6/32: write fa [4926364,79523] 0 2024-05-09T06:29:47.356 INFO:tasks.workunit.client.0.smithi062.stdout:6/33: dwrite f9 [0,4194304] 0 2024-05-09T06:29:47.356 INFO:tasks.workunit.client.0.smithi062.stdout:6/34: chown fb 17968272 1 2024-05-09T06:29:47.362 INFO:tasks.workunit.client.0.smithi062.stdout:7/38: rename d0/f2 to d0/f7 0 2024-05-09T06:29:47.366 INFO:tasks.workunit.client.0.smithi062.stdout:5/27: truncate d0/d4/f7 2787326 0 2024-05-09T06:29:47.368 INFO:tasks.workunit.client.0.smithi062.stdout:6/35: dread fa [0,4194304] 0 2024-05-09T06:29:47.371 INFO:tasks.workunit.client.0.smithi062.stdout:8/40: truncate f3 98336 0 2024-05-09T06:29:47.374 INFO:tasks.workunit.client.0.smithi062.stdout:7/39: creat d0/f8 x:0 0 0 2024-05-09T06:29:47.377 INFO:tasks.workunit.client.0.smithi062.stdout:6/36: creat dc/fd x:0 0 0 2024-05-09T06:29:47.381 INFO:tasks.workunit.client.0.smithi062.stdout:8/41: mkdir da 0 2024-05-09T06:29:47.381 INFO:tasks.workunit.client.0.smithi062.stdout:7/40: dread d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.381 INFO:tasks.workunit.client.0.smithi062.stdout:7/41: truncate d0/f8 354547 0 2024-05-09T06:29:47.382 INFO:tasks.workunit.client.0.smithi062.stdout:7/42: write d0/f8 [1310450,11284] 0 2024-05-09T06:29:47.382 INFO:tasks.workunit.client.0.smithi062.stdout:7/43: dread d0/f7 [0,4194304] 0 2024-05-09T06:29:47.382 INFO:tasks.workunit.client.0.smithi062.stdout:7/44: chown d0/l6 1610 1 2024-05-09T06:29:47.382 INFO:tasks.workunit.client.0.smithi062.stdout:5/28: truncate d0/d4/f7 679096 0 2024-05-09T06:29:47.385 INFO:tasks.workunit.client.0.smithi062.stdout:6/37: mkdir dc/de 0 2024-05-09T06:29:47.386 INFO:tasks.workunit.client.0.smithi062.stdout:8/42: mknod da/cb 0 2024-05-09T06:29:47.391 INFO:tasks.workunit.client.0.smithi062.stdout:5/29: symlink d0/d4/la 0 2024-05-09T06:29:47.398 INFO:tasks.workunit.client.0.smithi062.stdout:7/45: rmdir d0 39 2024-05-09T06:29:47.400 INFO:tasks.workunit.client.0.smithi062.stdout:5/30: read d0/d4/f7 [304446,15054] 0 2024-05-09T06:29:47.402 INFO:tasks.workunit.client.0.smithi062.stdout:7/46: dread d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.402 INFO:tasks.workunit.client.0.smithi062.stdout:8/43: dwrite f6 [0,4194304] 0 2024-05-09T06:29:47.403 INFO:tasks.workunit.client.0.smithi062.stdout:6/38: unlink l3 0 2024-05-09T06:29:47.403 INFO:tasks.workunit.client.0.smithi062.stdout:6/39: write f7 [149253,19698] 0 2024-05-09T06:29:47.406 INFO:tasks.workunit.client.0.smithi062.stdout:7/47: dread d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.406 INFO:tasks.workunit.client.0.smithi062.stdout:7/48: write d0/f7 [147245,45434] 0 2024-05-09T06:29:47.406 INFO:tasks.workunit.client.0.smithi062.stdout:5/31: mknod d0/cb 0 2024-05-09T06:29:47.409 INFO:tasks.workunit.client.0.smithi062.stdout:6/40: dread f7 [0,4194304] 0 2024-05-09T06:29:47.416 INFO:tasks.workunit.client.0.smithi062.stdout:6/41: rename f8 to dc/ff 0 2024-05-09T06:29:47.416 INFO:tasks.workunit.client.0.smithi062.stdout:6/42: fdatasync dc/fd 0 2024-05-09T06:29:47.423 INFO:tasks.workunit.client.0.smithi062.stdout:7/49: truncate d0/f4 543777 0 2024-05-09T06:29:47.426 INFO:tasks.workunit.client.0.smithi062.stdout:7/50: symlink d0/d3/l9 0 2024-05-09T06:29:47.429 INFO:tasks.workunit.client.0.smithi062.stdout:7/51: read d0/d3/f5 [357298,119759] 0 2024-05-09T06:29:47.429 INFO:tasks.workunit.client.0.smithi062.stdout:7/52: truncate d0/f4 887902 0 2024-05-09T06:29:47.432 INFO:tasks.workunit.client.0.smithi062.stdout:6/43: dwrite f7 [0,4194304] 0 2024-05-09T06:29:47.433 INFO:tasks.workunit.client.0.smithi062.stdout:6/44: dread f1 [0,4194304] 0 2024-05-09T06:29:47.433 INFO:tasks.workunit.client.0.smithi062.stdout:7/53: dread d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.433 INFO:tasks.workunit.client.0.smithi062.stdout:7/54: write d0/f7 [1083737,20007] 0 2024-05-09T06:29:47.436 INFO:tasks.workunit.client.0.smithi062.stdout:7/55: truncate d0/d3/f5 3456951 0 2024-05-09T06:29:47.436 INFO:tasks.workunit.client.0.smithi062.stdout:7/56: stat d0/f7 0 2024-05-09T06:29:47.436 INFO:tasks.workunit.client.0.smithi062.stdout:7/57: chown d0/l6 222055555 1 2024-05-09T06:29:47.442 INFO:tasks.workunit.client.0.smithi062.stdout:6/45: write f7 [2882503,91855] 0 2024-05-09T06:29:47.442 INFO:tasks.workunit.client.0.smithi062.stdout:6/46: dread - dc/fd zero size 2024-05-09T06:29:47.444 INFO:tasks.workunit.client.0.smithi062.stdout:6/47: mkdir dc/de/d10 0 2024-05-09T06:29:47.444 INFO:tasks.workunit.client.0.smithi062.stdout:6/48: fdatasync f4 0 2024-05-09T06:29:47.452 INFO:tasks.workunit.client.0.smithi062.stdout:6/49: dread f7 [0,4194304] 0 2024-05-09T06:29:47.455 INFO:tasks.workunit.client.0.smithi062.stdout:6/50: creat dc/de/f11 x:0 0 0 2024-05-09T06:29:47.455 INFO:tasks.workunit.client.0.smithi062.stdout:6/51: truncate dc/fd 291336 0 2024-05-09T06:29:47.455 INFO:tasks.workunit.client.0.smithi062.stdout:6/52: read - dc/ff zero size 2024-05-09T06:29:47.455 INFO:tasks.workunit.client.0.smithi062.stdout:6/53: write dc/ff [269425,123599] 0 2024-05-09T06:29:47.455 INFO:tasks.workunit.client.0.smithi062.stdout:6/54: write f1 [979314,127788] 0 2024-05-09T06:29:47.456 INFO:tasks.workunit.client.0.smithi062.stdout:6/55: rename l6 to dc/de/l12 0 2024-05-09T06:29:47.458 INFO:tasks.workunit.client.0.smithi062.stdout:7/58: truncate d0/d3/f5 2025921 0 2024-05-09T06:29:47.459 INFO:tasks.workunit.client.0.smithi062.stdout:7/59: rmdir d0 39 2024-05-09T06:29:47.459 INFO:tasks.workunit.client.0.smithi062.stdout:7/60: chown d0/f8 147 1 2024-05-09T06:29:47.461 INFO:tasks.workunit.client.0.smithi062.stdout:7/61: fsync d0/f7 0 2024-05-09T06:29:47.461 INFO:tasks.workunit.client.0.smithi062.stdout:7/62: fdatasync d0/f7 0 2024-05-09T06:29:47.463 INFO:tasks.workunit.client.0.smithi062.stdout:6/56: dread f1 [0,4194304] 0 2024-05-09T06:29:47.463 INFO:tasks.workunit.client.0.smithi062.stdout:6/57: creat dc/f13 x:0 0 0 2024-05-09T06:29:47.467 INFO:tasks.workunit.client.0.smithi062.stdout:7/63: dread d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.467 INFO:tasks.workunit.client.0.smithi062.stdout:7/64: fdatasync d0/d3/f5 0 2024-05-09T06:29:47.467 INFO:tasks.workunit.client.0.smithi062.stdout:7/65: stat d0/f4 0 2024-05-09T06:29:47.468 INFO:tasks.workunit.client.0.smithi062.stdout:7/66: dread d0/f4 [0,4194304] 0 2024-05-09T06:29:47.468 INFO:tasks.workunit.client.0.smithi062.stdout:7/67: write d0/d3/f5 [52247,64133] 0 2024-05-09T06:29:47.468 INFO:tasks.workunit.client.0.smithi062.stdout:7/68: truncate d0/f7 2047316 0 2024-05-09T06:29:47.468 INFO:tasks.workunit.client.0.smithi062.stdout:6/58: unlink f9 0 2024-05-09T06:29:47.468 INFO:tasks.workunit.client.0.smithi062.stdout:6/59: write dc/ff [1222228,114039] 0 2024-05-09T06:29:47.468 INFO:tasks.workunit.client.0.smithi062.stdout:6/60: chown f7 1815748 1 2024-05-09T06:29:47.471 INFO:tasks.workunit.client.0.smithi062.stdout:7/69: mknod d0/d3/ca 0 2024-05-09T06:29:47.473 INFO:tasks.workunit.client.0.smithi062.stdout:6/61: rename f7 to dc/de/f14 0 2024-05-09T06:29:47.476 INFO:tasks.workunit.client.0.smithi062.stdout:7/70: creat d0/fb x:0 0 0 2024-05-09T06:29:47.476 INFO:tasks.workunit.client.0.smithi062.stdout:7/71: write d0/f8 [2027055,43538] 0 2024-05-09T06:29:47.479 INFO:tasks.workunit.client.0.smithi062.stdout:7/72: mknod d0/d3/cc 0 2024-05-09T06:29:47.480 INFO:tasks.workunit.client.0.smithi062.stdout:7/73: write d0/f7 [681856,128522] 0 2024-05-09T06:29:47.485 INFO:tasks.workunit.client.0.smithi062.stdout:6/62: getdents dc/de 0 2024-05-09T06:29:47.486 INFO:tasks.workunit.client.0.smithi062.stdout:6/63: dread dc/fd [0,4194304] 0 2024-05-09T06:29:47.488 INFO:tasks.workunit.client.0.smithi062.stdout:6/64: symlink dc/de/l15 0 2024-05-09T06:29:47.488 INFO:tasks.workunit.client.0.smithi062.stdout:6/65: chown dc/de 10 1 2024-05-09T06:29:47.488 INFO:tasks.workunit.client.0.smithi062.stdout:6/66: readlink dc/de/l15 0 2024-05-09T06:29:47.499 INFO:tasks.workunit.client.0.smithi062.stdout:7/74: dwrite d0/f7 [0,4194304] 0 2024-05-09T06:29:47.506 INFO:tasks.workunit.client.0.smithi062.stdout:7/75: fsync d0/f8 0 2024-05-09T06:29:47.506 INFO:tasks.workunit.client.0.smithi062.stdout:6/67: dwrite dc/de/f14 [0,4194304] 0 2024-05-09T06:29:47.511 INFO:tasks.workunit.client.0.smithi062.stdout:7/76: rename d0/fb to d0/d3/fd 0 2024-05-09T06:29:47.511 INFO:tasks.workunit.client.0.smithi062.stdout:7/77: dread d0/f4 [0,4194304] 0 2024-05-09T06:29:47.514 INFO:tasks.workunit.client.0.smithi062.stdout:7/78: symlink d0/le 0 2024-05-09T06:29:47.526 INFO:tasks.workunit.client.0.smithi062.stdout:7/79: dread d0/f8 [0,4194304] 0 2024-05-09T06:29:47.527 INFO:tasks.workunit.client.0.smithi062.stdout:7/80: dread d0/f4 [0,4194304] 0 2024-05-09T06:29:47.530 INFO:tasks.workunit.client.0.smithi062.stdout:7/81: dread d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.530 INFO:tasks.workunit.client.0.smithi062.stdout:7/82: fsync d0/d3/f5 0 2024-05-09T06:29:47.532 INFO:tasks.workunit.client.0.smithi062.stdout:7/83: rename d0/l6 to d0/d3/lf 0 2024-05-09T06:29:47.532 INFO:tasks.workunit.client.0.smithi062.stdout:7/84: chown d0/d3/lf 9666 1 2024-05-09T06:29:47.552 INFO:tasks.workunit.client.0.smithi062.stdout:7/85: dwrite d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.552 INFO:tasks.workunit.client.0.smithi062.stdout:7/86: readlink d0/d3/l9 0 2024-05-09T06:29:47.552 INFO:tasks.workunit.client.0.smithi062.stdout:7/87: write d0/f8 [2278373,84321] 0 2024-05-09T06:29:47.556 INFO:tasks.workunit.client.0.smithi062.stdout:7/88: rename d0/d3/ca to d0/c10 0 2024-05-09T06:29:47.559 INFO:tasks.workunit.client.0.smithi062.stdout:7/89: mknod d0/c11 0 2024-05-09T06:29:47.560 INFO:tasks.workunit.client.0.smithi062.stdout:7/90: write d0/f4 [44866,39511] 0 2024-05-09T06:29:47.560 INFO:tasks.workunit.client.0.smithi062.stdout:7/91: truncate d0/f7 4749562 0 2024-05-09T06:29:47.561 INFO:tasks.workunit.client.0.smithi062.stdout:7/92: mkdir d0/d12 0 2024-05-09T06:29:47.563 INFO:tasks.workunit.client.0.smithi062.stdout:7/93: mknod d0/c13 0 2024-05-09T06:29:47.581 INFO:tasks.workunit.client.0.smithi062.stdout:7/94: dwrite d0/f8 [0,4194304] 0 2024-05-09T06:29:47.581 INFO:tasks.workunit.client.0.smithi062.stdout:7/95: fdatasync d0/d3/fd 0 2024-05-09T06:29:47.581 INFO:tasks.workunit.client.0.smithi062.stdout:7/96: chown d0 126271573 1 2024-05-09T06:29:47.582 INFO:tasks.workunit.client.0.smithi062.stdout:7/97: mknod d0/d12/c14 0 2024-05-09T06:29:47.582 INFO:tasks.workunit.client.0.smithi062.stdout:7/98: creat d0/f15 x:0 0 0 2024-05-09T06:29:47.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.617+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c18000bf0 con 0x7f0c20070aa0 2024-05-09T06:29:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.619+0000 7f0c2a7fc700 1 -- 172.21.15.62:0/593219484 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f0c18000bf0 con 0x7f0c20070aa0 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c20070aa0 msgr2=0x7f0c20072f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c20070aa0 0x7f0c20072f50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c24004f90 tx=0x7f0c24009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c340fce90 msgr2=0x7f0c34071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c340fce90 0x7f0c34071de0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0c30002840 tx=0x7f0c30004570 comp rx=0 tx=0).stop 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 shutdown_connections 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f0c20070aa0 0x7f0c20072f50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c340fce90 0x7f0c34071de0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 --2- 172.21.15.62:0/593219484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c340fe090 0x7f0c340702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 >> 172.21.15.62:0/593219484 conn(0x7f0c340f85c0 msgr2=0x7f0c340f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 shutdown_connections 2024-05-09T06:29:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.621+0000 7f0c3bac6700 1 -- 172.21.15.62:0/593219484 wait complete. 2024-05-09T06:29:47.605 INFO:tasks.workunit.client.0.smithi062.stdout:7/99: getdents d0/d12 0 2024-05-09T06:29:47.607 INFO:tasks.workunit.client.0.smithi062.stdout:7/100: rename d0/f15 to d0/f16 0 2024-05-09T06:29:47.609 INFO:tasks.workunit.client.0.smithi062.stdout:7/101: creat d0/d3/f17 x:0 0 0 2024-05-09T06:29:47.609 INFO:tasks.workunit.client.0.smithi062.stdout:7/102: mknod d0/d12/c18 0 2024-05-09T06:29:47.611 INFO:tasks.workunit.client.0.smithi062.stdout:7/103: unlink d0/f7 0 2024-05-09T06:29:47.614 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:29:47.634 INFO:tasks.workunit.client.0.smithi062.stdout:7/104: truncate d0/f8 3907142 0 2024-05-09T06:29:47.637 INFO:tasks.workunit.client.0.smithi062.stdout:7/105: symlink d0/d3/l19 0 2024-05-09T06:29:47.637 INFO:tasks.workunit.client.0.smithi062.stdout:7/106: fdatasync d0/d3/fd 0 2024-05-09T06:29:47.637 INFO:tasks.workunit.client.0.smithi062.stdout:7/107: write d0/f4 [1574008,12964] 0 2024-05-09T06:29:47.647 INFO:tasks.workunit.client.0.smithi062.stdout:7/108: read d0/d3/f5 [3020326,3334] 0 2024-05-09T06:29:47.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/109: dwrite d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/110: write d0/d3/fd [68968,48757] 0 2024-05-09T06:29:47.679 INFO:tasks.workunit.client.0.smithi062.stdout:7/111: creat d0/d12/f1a x:0 0 0 2024-05-09T06:29:47.700 INFO:tasks.workunit.client.0.smithi062.stdout:7/112: dwrite d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:47.700 INFO:tasks.workunit.client.0.smithi062.stdout:7/113: creat d0/f1b x:0 0 0 2024-05-09T06:29:47.700 INFO:tasks.workunit.client.0.smithi062.stdout:7/114: chown d0/d3/fd 207614425 1 2024-05-09T06:29:47.725 INFO:tasks.workunit.client.0.smithi062.stdout:7/115: mknod d0/d12/c1c 0 2024-05-09T06:29:47.739 INFO:tasks.workunit.client.0.smithi062.stdout:7/116: dwrite d0/d3/fd [0,4194304] 0 2024-05-09T06:29:47.747 INFO:tasks.workunit.client.0.smithi062.stdout:7/117: read d0/d3/f5 [1187755,2060] 0 2024-05-09T06:29:47.748 INFO:tasks.workunit.client.0.smithi062.stdout:7/118: dread - d0/d12/f1a zero size 2024-05-09T06:29:47.748 INFO:tasks.workunit.client.0.smithi062.stdout:7/119: fdatasync d0/f4 0 2024-05-09T06:29:47.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.769+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/4291051270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fcf60 msgr2=0x7fb9d40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:47.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.769+0000 7fb9d9fe0700 1 --2- 172.21.15.62:0/4291051270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fcf60 0x7fb9d40fd3d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8004940 tx=0x7fb9c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:47.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.769+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/4291051270 shutdown_connections 2024-05-09T06:29:47.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.769+0000 7fb9d9fe0700 1 --2- 172.21.15.62:0/4291051270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fcf60 0x7fb9d40fd3d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.769+0000 7fb9d9fe0700 1 --2- 172.21.15.62:0/4291051270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40fbcb0 0x7fb9d40fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.769+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/4291051270 >> 172.21.15.62:0/4291051270 conn(0x7fb9d40f7410 msgr2=0x7fb9d40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:47.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.769+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/4291051270 shutdown_connections 2024-05-09T06:29:47.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.769+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/4291051270 wait complete. 2024-05-09T06:29:47.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d9fe0700 1 Processor -- start 2024-05-09T06:29:47.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d9fe0700 1 -- start start 2024-05-09T06:29:47.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d9fe0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fbcb0 0x7fb9d410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d9fe0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40fcf60 0x7fb9d410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d9fe0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d410e520 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d9fe0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d410e690 con 0x7fb9d40fcf60 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fbcb0 0x7fb9d410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fbcb0 0x7fb9d410d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45662/0 (socket says 172.21.15.62:45662) 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.770+0000 7fb9d37fe700 1 -- 172.21.15.62:0/2864896445 learned_addr learned my addr 172.21.15.62:0/2864896445 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9d2ffd700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40fcf60 0x7fb9d410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9d37fe700 1 -- 172.21.15.62:0/2864896445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40fcf60 msgr2=0x7fb9d410df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9d37fe700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40fcf60 0x7fb9d410df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9d37fe700 1 -- 172.21.15.62:0/2864896445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c8005040 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9d37fe700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fbcb0 0x7fb9d410d9e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400c8c0 tx=0x7fb9c40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:47.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9bbfff700 1 -- 172.21.15.62:0/2864896445 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9c400a760 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9bbfff700 1 -- 172.21.15.62:0/2864896445 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9c400ad90 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d4112ff0 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9bbfff700 1 -- 172.21.15.62:0/2864896445 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9c40113a0 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.771+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d4113580 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.772+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d4101af0 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.773+0000 7fb9bbfff700 1 -- 172.21.15.62:0/2864896445 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 20) v1 ==== 93219+0+0 (secure 0 0 0) 0x7fb9c4012400 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.773+0000 7fb9bbfff700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb9bc070aa0 0x7fb9bc072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:47.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.773+0000 7fb9bbfff700 1 -- 172.21.15.62:0/2864896445 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb9c40906a0 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.773+0000 7fb9d2ffd700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb9bc070aa0 0x7fb9bc072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:47.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.774+0000 7fb9d2ffd700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb9bc070aa0 0x7fb9bc072f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800b3b0 tx=0x7fb9c8009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:47.778+0000 7fb9bbfff700 1 -- 172.21.15.62:0/2864896445 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb9c4060460 con 0x7fb9d40fbcb0 2024-05-09T06:29:47.786 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:47 smithi079 ceph-mon[35268]: mgrmap e20: smithi062.juuasl(active, since 7m), standbys: smithi079.genyri 2024-05-09T06:29:47.786 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:47 smithi079 ceph-mon[35268]: pgmap v253: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 166 MiB/s rd, 207 MiB/s wr, 482 op/s 2024-05-09T06:29:47.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:47 smithi062 ceph-mon[26920]: mgrmap e20: smithi062.juuasl(active, since 7m), standbys: smithi079.genyri 2024-05-09T06:29:47.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:47 smithi062 ceph-mon[26920]: pgmap v253: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 166 MiB/s rd, 207 MiB/s wr, 482 op/s 2024-05-09T06:29:47.938 INFO:tasks.workunit.client.0.smithi062.stdout:9/129: sync 2024-05-09T06:29:47.939 INFO:tasks.workunit.client.0.smithi062.stdout:9/130: dread d3/d1a/f1b [0,4194304] 0 2024-05-09T06:29:47.946 INFO:tasks.workunit.client.0.smithi062.stdout:9/131: dread d3/f16 [0,4194304] 0 2024-05-09T06:29:47.946 INFO:tasks.workunit.client.0.smithi062.stdout:9/132: rename d3/d1a to d3/d1a/d1c/d1e/d33 22 2024-05-09T06:29:47.969 INFO:tasks.workunit.client.0.smithi062.stdout:9/133: dwrite d3/f6 [0,4194304] 0 2024-05-09T06:29:47.977 INFO:tasks.workunit.client.0.smithi062.stdout:9/134: read d3/d1a/d1c/d21/f24 [674128,89774] 0 2024-05-09T06:29:47.979 INFO:tasks.workunit.client.0.smithi062.stdout:9/135: creat d3/d1a/d1c/f34 x:0 0 0 2024-05-09T06:29:47.979 INFO:tasks.workunit.client.0.smithi062.stdout:9/136: dread - d3/d1a/d1c/f34 zero size 2024-05-09T06:29:47.980 INFO:tasks.workunit.client.0.smithi062.stdout:9/137: creat d3/d1a/f35 x:0 0 0 2024-05-09T06:29:47.983 INFO:tasks.workunit.client.0.smithi062.stdout:9/138: symlink d3/d1a/d1c/d21/l36 0 2024-05-09T06:29:47.986 INFO:tasks.workunit.client.0.smithi062.stdout:9/139: dread d3/f17 [4194304,4194304] 0 2024-05-09T06:29:47.986 INFO:tasks.workunit.client.0.smithi062.stdout:9/140: chown d3/c12 9420121 1 2024-05-09T06:29:47.987 INFO:tasks.workunit.client.0.smithi062.stdout:9/141: dread d3/f19 [0,4194304] 0 2024-05-09T06:29:47.990 INFO:tasks.workunit.client.0.smithi062.stdout:9/142: rename d3/d1a/d1c/l2f to d3/d1a/d1c/d1e/l37 0 2024-05-09T06:29:48.006 INFO:tasks.workunit.client.0.smithi062.stdout:9/143: dwrite d3/f5 [0,4194304] 0 2024-05-09T06:29:48.007 INFO:tasks.workunit.client.0.smithi062.stdout:9/144: creat d3/d1a/d1c/d2b/f38 x:0 0 0 2024-05-09T06:29:48.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.025+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9d402b3b0 con 0x7fb9bc070aa0 2024-05-09T06:29:48.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.026+0000 7fb9bbfff700 1 -- 172.21.15.62:0/2864896445 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fb9d402b3b0 con 0x7fb9bc070aa0 2024-05-09T06:29:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb9bc070aa0 msgr2=0x7fb9bc072f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb9bc070aa0 0x7fb9bc072f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800b3b0 tx=0x7fb9c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fbcb0 msgr2=0x7fb9d410d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fbcb0 0x7fb9d410d9e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400c8c0 tx=0x7fb9c40044c0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 shutdown_connections 2024-05-09T06:29:48.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fb9bc070aa0 0x7fb9bc072f50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9d40fbcb0 0x7fb9d410d9e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 --2- 172.21.15.62:0/2864896445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9d40fcf60 0x7fb9d410df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 >> 172.21.15.62:0/2864896445 conn(0x7fb9d40f7410 msgr2=0x7fb9d4066840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 shutdown_connections 2024-05-09T06:29:48.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.029+0000 7fb9d9fe0700 1 -- 172.21.15.62:0/2864896445 wait complete. 2024-05-09T06:29:48.012 INFO:tasks.workunit.client.0.smithi062.stdout:9/145: mknod d3/d1a/d1c/d21/c39 0 2024-05-09T06:29:48.017 INFO:tasks.workunit.client.0.smithi062.stdout:9/146: dread d3/d1a/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:29:48.022 INFO:tasks.workunit.client.0.smithi062.stdout:9/147: dread d3/f16 [0,4194304] 0 2024-05-09T06:29:48.022 INFO:tasks.workunit.client.0.smithi062.stdout:9/148: rename d3/d1a to d3/d1a/d1c/d1e/d3a 22 2024-05-09T06:29:48.022 INFO:tasks.workunit.client.0.smithi062.stdout:9/149: write d3/d1a/d1c/d2b/f2c [709890,101354] 0 2024-05-09T06:29:48.025 INFO:tasks.workunit.client.0.smithi062.stdout:9/150: link d3/cd d3/d1a/d1c/c3b 0 2024-05-09T06:29:48.026 INFO:tasks.workunit.client.0.smithi062.stdout:9/151: dread d3/d1a/d1c/d2b/f2d [0,4194304] 0 2024-05-09T06:29:48.041 INFO:tasks.workunit.client.0.smithi062.stdout:9/152: dwrite d3/f17 [4194304,4194304] 0 2024-05-09T06:29:48.051 INFO:tasks.workunit.client.0.smithi062.stdout:9/153: rmdir d3/d20/d25 39 2024-05-09T06:29:48.053 INFO:tasks.workunit.client.0.smithi062.stdout:9/154: rename d3/d1a/d1c/d2b/f38 to d3/f3c 0 2024-05-09T06:29:48.053 INFO:tasks.workunit.client.0.smithi062.stdout:9/155: write d3/f16 [4358440,93923] 0 2024-05-09T06:29:48.056 INFO:tasks.workunit.client.0.smithi062.stdout:9/156: rename d3/la to d3/d20/d25/l3d 0 2024-05-09T06:29:48.056 INFO:tasks.workunit.client.0.smithi062.stdout:9/157: read - d3/d1a/f35 zero size 2024-05-09T06:29:48.058 INFO:tasks.workunit.client.0.smithi062.stdout:9/158: mkdir d3/d3e 0 2024-05-09T06:29:48.059 INFO:tasks.workunit.client.0.smithi062.stdout:9/159: chown d3/d1a/d1c/f26 7261028 1 2024-05-09T06:29:48.061 INFO:tasks.workunit.client.0.smithi062.stdout:9/160: rename d3/f17 to d3/d1a/d1c/d2b/d31/f3f 0 2024-05-09T06:29:48.063 INFO:tasks.workunit.client.0.smithi062.stdout:9/161: rename d3/d20/d25 to d3/d40 0 2024-05-09T06:29:48.064 INFO:tasks.workunit.client.0.smithi062.stdout:9/162: mkdir d3/d1a/d1c/d1e/d41 0 2024-05-09T06:29:48.065 INFO:tasks.workunit.client.0.smithi062.stdout:9/163: chown d3/d1a/d1c/d21/l36 4193719 1 2024-05-09T06:29:48.067 INFO:tasks.workunit.client.0.smithi062.stdout:9/164: mknod d3/d1a/d1c/d21/c42 0 2024-05-09T06:29:48.069 INFO:tasks.workunit.client.0.smithi062.stdout:2/10: sync 2024-05-09T06:29:48.069 INFO:tasks.workunit.client.0.smithi062.stdout:3/26: sync 2024-05-09T06:29:48.070 INFO:tasks.workunit.client.0.smithi062.stdout:2/11: fsync - no filename 2024-05-09T06:29:48.070 INFO:tasks.workunit.client.0.smithi062.stdout:2/12: write - no filename 2024-05-09T06:29:48.070 INFO:tasks.workunit.client.0.smithi062.stdout:3/27: dread - d1/f8 zero size 2024-05-09T06:29:48.071 INFO:tasks.workunit.client.0.smithi062.stdout:2/13: creat d0/f3 x:0 0 0 2024-05-09T06:29:48.072 INFO:tasks.workunit.client.0.smithi062.stdout:2/14: write d0/f3 [310576,86799] 0 2024-05-09T06:29:48.072 INFO:tasks.workunit.client.0.smithi062.stdout:3/28: symlink d1/la 0 2024-05-09T06:29:48.072 INFO:tasks.workunit.client.0.smithi062.stdout:3/29: chown d1/l7 161846105 1 2024-05-09T06:29:48.072 INFO:tasks.workunit.client.0.smithi062.stdout:3/30: readlink d1/l7 0 2024-05-09T06:29:48.074 INFO:tasks.workunit.client.0.smithi062.stdout:3/31: mknod d1/cb 0 2024-05-09T06:29:48.077 INFO:tasks.workunit.client.0.smithi062.stdout:3/32: mknod d1/cc 0 2024-05-09T06:29:48.079 INFO:tasks.workunit.client.0.smithi062.stdout:3/33: mkdir d1/dd 0 2024-05-09T06:29:48.079 INFO:tasks.workunit.client.0.smithi062.stdout:3/34: write d1/f8 [499979,122532] 0 2024-05-09T06:29:48.086 INFO:tasks.workunit.client.0.smithi062.stdout:9/165: dwrite d3/d1a/d1c/f26 [0,4194304] 0 2024-05-09T06:29:48.088 INFO:tasks.workunit.client.0.smithi062.stdout:3/35: dread d1/f8 [0,4194304] 0 2024-05-09T06:29:48.092 INFO:tasks.workunit.client.0.smithi062.stdout:9/166: unlink d3/d1a/d1c/c3b 0 2024-05-09T06:29:48.093 INFO:tasks.workunit.client.0.smithi062.stdout:9/167: creat d3/d1a/d1c/d2b/d31/f43 x:0 0 0 2024-05-09T06:29:48.094 INFO:tasks.workunit.client.0.smithi062.stdout:9/168: mknod d3/d1a/d1c/c44 0 2024-05-09T06:29:48.095 INFO:tasks.workunit.client.0.smithi062.stdout:9/169: dread d3/d1a/f1b [0,4194304] 0 2024-05-09T06:29:48.105 INFO:tasks.workunit.client.0.smithi062.stdout:3/36: dread d1/f3 [0,4194304] 0 2024-05-09T06:29:48.105 INFO:tasks.workunit.client.0.smithi062.stdout:2/15: dwrite d0/f3 [0,4194304] 0 2024-05-09T06:29:48.106 INFO:tasks.workunit.client.0.smithi062.stdout:3/37: mknod d1/dd/ce 0 2024-05-09T06:29:48.106 INFO:tasks.workunit.client.0.smithi062.stdout:3/38: fsync d1/f3 0 2024-05-09T06:29:48.109 INFO:tasks.workunit.client.0.smithi062.stdout:9/170: write d3/d1a/d1c/d2b/d31/f3f [4515638,82563] 0 2024-05-09T06:29:48.109 INFO:tasks.workunit.client.0.smithi062.stdout:9/171: stat d3/cc 0 2024-05-09T06:29:48.109 INFO:tasks.workunit.client.0.smithi062.stdout:3/39: creat d1/dd/ff x:0 0 0 2024-05-09T06:29:48.109 INFO:tasks.workunit.client.0.smithi062.stdout:3/40: dread - d1/dd/ff zero size 2024-05-09T06:29:48.109 INFO:tasks.workunit.client.0.smithi062.stdout:3/41: creat d1/dd/f10 x:0 0 0 2024-05-09T06:29:48.109 INFO:tasks.workunit.client.0.smithi062.stdout:3/42: fdatasync d1/dd/f10 0 2024-05-09T06:29:48.119 INFO:tasks.workunit.client.0.smithi062.stdout:8/44: sync 2024-05-09T06:29:48.120 INFO:tasks.workunit.client.0.smithi062.stdout:0/50: sync 2024-05-09T06:29:48.120 INFO:tasks.workunit.client.0.smithi062.stdout:5/32: sync 2024-05-09T06:29:48.120 INFO:tasks.workunit.client.0.smithi062.stdout:0/51: write d1/f8 [1819118,112133] 0 2024-05-09T06:29:48.120 INFO:tasks.workunit.client.0.smithi062.stdout:4/63: sync 2024-05-09T06:29:48.120 INFO:tasks.workunit.client.0.smithi062.stdout:6/68: sync 2024-05-09T06:29:48.120 INFO:tasks.workunit.client.0.smithi062.stdout:6/69: chown dc 0 1 2024-05-09T06:29:48.120 INFO:tasks.workunit.client.0.smithi062.stdout:7/120: sync 2024-05-09T06:29:48.120 INFO:tasks.workunit.client.0.smithi062.stdout:1/25: sync 2024-05-09T06:29:48.121 INFO:tasks.workunit.client.0.smithi062.stdout:8/45: rmdir da 39 2024-05-09T06:29:48.121 INFO:tasks.workunit.client.0.smithi062.stdout:9/172: dread d3/d1a/d1c/f26 [0,4194304] 0 2024-05-09T06:29:48.122 INFO:tasks.workunit.client.0.smithi062.stdout:5/33: dread d0/d4/f7 [0,4194304] 0 2024-05-09T06:29:48.122 INFO:tasks.workunit.client.0.smithi062.stdout:0/52: creat d1/f11 x:0 0 0 2024-05-09T06:29:48.122 INFO:tasks.workunit.client.0.smithi062.stdout:0/53: dread - d1/fc zero size 2024-05-09T06:29:48.123 INFO:tasks.workunit.client.0.smithi062.stdout:0/54: fdatasync d1/ff 0 2024-05-09T06:29:48.123 INFO:tasks.workunit.client.0.smithi062.stdout:0/55: dread - d1/f11 zero size 2024-05-09T06:29:48.126 INFO:tasks.workunit.client.0.smithi062.stdout:4/64: mknod d0/d9/c11 0 2024-05-09T06:29:48.126 INFO:tasks.workunit.client.0.smithi062.stdout:4/65: truncate d0/f10 946532 0 2024-05-09T06:29:48.126 INFO:tasks.workunit.client.0.smithi062.stdout:4/66: chown d0/l1 2388 1 2024-05-09T06:29:48.127 INFO:tasks.workunit.client.0.smithi062.stdout:7/121: mknod d0/c1d 0 2024-05-09T06:29:48.129 INFO:tasks.workunit.client.0.smithi062.stdout:6/70: read dc/de/f14 [3457944,56285] 0 2024-05-09T06:29:48.129 INFO:tasks.workunit.client.0.smithi062.stdout:6/71: fdatasync dc/f13 0 2024-05-09T06:29:48.129 INFO:tasks.workunit.client.0.smithi062.stdout:6/72: readlink dc/de/l12 0 2024-05-09T06:29:48.129 INFO:tasks.workunit.client.0.smithi062.stdout:6/73: truncate dc/f13 973267 0 2024-05-09T06:29:48.131 INFO:tasks.workunit.client.0.smithi062.stdout:1/26: rename f4 to f6 0 2024-05-09T06:29:48.131 INFO:tasks.workunit.client.0.smithi062.stdout:3/43: fsync d1/dd/f10 0 2024-05-09T06:29:48.131 INFO:tasks.workunit.client.0.smithi062.stdout:3/44: truncate d1/dd/ff 167463 0 2024-05-09T06:29:48.132 INFO:tasks.workunit.client.0.smithi062.stdout:5/34: mkdir d0/d4/d5/dc 0 2024-05-09T06:29:48.135 INFO:tasks.workunit.client.0.smithi062.stdout:5/35: dread d0/d4/f7 [0,4194304] 0 2024-05-09T06:29:48.135 INFO:tasks.workunit.client.0.smithi062.stdout:2/16: dwrite d0/f3 [0,4194304] 0 2024-05-09T06:29:48.143 INFO:tasks.workunit.client.0.smithi062.stdout:7/122: unlink d0/d3/lf 0 2024-05-09T06:29:48.145 INFO:tasks.workunit.client.0.smithi062.stdout:7/123: write d0/f4 [1313141,85535] 0 2024-05-09T06:29:48.145 INFO:tasks.workunit.client.0.smithi062.stdout:7/124: fsync d0/d3/f5 0 2024-05-09T06:29:48.145 INFO:tasks.workunit.client.0.smithi062.stdout:7/125: creat d0/f1e x:0 0 0 2024-05-09T06:29:48.146 INFO:tasks.workunit.client.0.smithi062.stdout:6/74: symlink dc/de/l16 0 2024-05-09T06:29:48.146 INFO:tasks.workunit.client.0.smithi062.stdout:6/75: readlink dc/de/l16 0 2024-05-09T06:29:48.146 INFO:tasks.workunit.client.0.smithi062.stdout:7/126: write d0/f16 [914031,13411] 0 2024-05-09T06:29:48.146 INFO:tasks.workunit.client.0.smithi062.stdout:6/76: creat dc/f17 x:0 0 0 2024-05-09T06:29:48.146 INFO:tasks.workunit.client.0.smithi062.stdout:6/77: dread - dc/de/f11 zero size 2024-05-09T06:29:48.149 INFO:tasks.workunit.client.0.smithi062.stdout:3/45: symlink d1/l11 0 2024-05-09T06:29:48.149 INFO:tasks.workunit.client.0.smithi062.stdout:3/46: chown l0 919 1 2024-05-09T06:29:48.150 INFO:tasks.workunit.client.0.smithi062.stdout:8/46: getdents da 0 2024-05-09T06:29:48.150 INFO:tasks.workunit.client.0.smithi062.stdout:8/47: readlink l5 0 2024-05-09T06:29:48.150 INFO:tasks.workunit.client.0.smithi062.stdout:8/48: stat f3 0 2024-05-09T06:29:48.155 INFO:tasks.workunit.client.0.smithi062.stdout:6/78: link f4 dc/de/d10/f18 0 2024-05-09T06:29:48.156 INFO:tasks.workunit.client.0.smithi062.stdout:6/79: write dc/de/d10/f18 [737010,20114] 0 2024-05-09T06:29:48.158 INFO:tasks.workunit.client.0.smithi062.stdout:3/47: dread d1/f8 [0,4194304] 0 2024-05-09T06:29:48.159 INFO:tasks.workunit.client.0.smithi062.stdout:1/27: dwrite f5 [0,4194304] 0 2024-05-09T06:29:48.159 INFO:tasks.workunit.client.0.smithi062.stdout:0/56: rename d1/c3 to d1/c12 0 2024-05-09T06:29:48.159 INFO:tasks.workunit.client.0.smithi062.stdout:6/80: write fb [395928,53361] 0 2024-05-09T06:29:48.159 INFO:tasks.workunit.client.0.smithi062.stdout:6/81: readlink dc/de/l16 0 2024-05-09T06:29:48.159 INFO:tasks.workunit.client.0.smithi062.stdout:4/67: dwrite d0/d9/fc [0,4194304] 0 2024-05-09T06:29:48.159 INFO:tasks.workunit.client.0.smithi062.stdout:4/68: rename d0/d2 to d0/d2/d12 22 2024-05-09T06:29:48.159 INFO:tasks.workunit.client.0.smithi062.stdout:4/69: fdatasync d0/d2/f5 0 2024-05-09T06:29:48.160 INFO:tasks.workunit.client.0.smithi062.stdout:3/48: dread d1/dd/ff [0,4194304] 0 2024-05-09T06:29:48.160 INFO:tasks.workunit.client.0.smithi062.stdout:3/49: readlink l0 0 2024-05-09T06:29:48.160 INFO:tasks.workunit.client.0.smithi062.stdout:3/50: dread - d1/dd/f10 zero size 2024-05-09T06:29:48.166 INFO:tasks.workunit.client.0.smithi062.stdout:1/28: fsync f3 0 2024-05-09T06:29:48.168 INFO:tasks.workunit.client.0.smithi062.stdout:4/70: rename d0/f10 to d0/f13 0 2024-05-09T06:29:48.172 INFO:tasks.workunit.client.0.smithi062.stdout:3/51: rename d1/dd/ce to d1/c12 0 2024-05-09T06:29:48.172 INFO:tasks.workunit.client.0.smithi062.stdout:3/52: chown d1/dd 13394289 1 2024-05-09T06:29:48.173 INFO:tasks.workunit.client.0.smithi062.stdout:0/57: mknod d1/c13 0 2024-05-09T06:29:48.175 INFO:tasks.workunit.client.0.smithi062.stdout:1/29: link f3 f7 0 2024-05-09T06:29:48.176 INFO:tasks.workunit.client.0.smithi062.stdout:3/53: symlink d1/l13 0 2024-05-09T06:29:48.177 INFO:tasks.workunit.client.0.smithi062.stdout:3/54: dread d1/dd/ff [0,4194304] 0 2024-05-09T06:29:48.177 INFO:tasks.workunit.client.0.smithi062.stdout:3/55: write d1/dd/f10 [133087,24255] 0 2024-05-09T06:29:48.177 INFO:tasks.workunit.client.0.smithi062.stdout:3/56: readlink d1/l7 0 2024-05-09T06:29:48.177 INFO:tasks.workunit.client.0.smithi062.stdout:3/57: write d1/dd/f10 [138507,115669] 0 2024-05-09T06:29:48.177 INFO:tasks.workunit.client.0.smithi062.stdout:3/58: creat d1/dd/f14 x:0 0 0 2024-05-09T06:29:48.179 INFO:tasks.workunit.client.0.smithi062.stdout:0/58: unlink d1/fb 0 2024-05-09T06:29:48.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.198+0000 7ff77239b700 1 -- 172.21.15.62:0/1262026668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0fff90 msgr2=0x7ff76c102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:48.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.198+0000 7ff77239b700 1 --2- 172.21.15.62:0/1262026668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0fff90 0x7ff76c102370 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff760004880 tx=0x7ff760009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:48.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.198+0000 7ff77239b700 1 -- 172.21.15.62:0/1262026668 shutdown_connections 2024-05-09T06:29:48.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.198+0000 7ff77239b700 1 --2- 172.21.15.62:0/1262026668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0fff90 0x7ff76c102370 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.198+0000 7ff77239b700 1 --2- 172.21.15.62:0/1262026668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff76c066ab0 0x7ff76c0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.198+0000 7ff77239b700 1 -- 172.21.15.62:0/1262026668 >> 172.21.15.62:0/1262026668 conn(0x7ff76c0f7420 msgr2=0x7ff76c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:48.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.198+0000 7ff77239b700 1 -- 172.21.15.62:0/1262026668 shutdown_connections 2024-05-09T06:29:48.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.198+0000 7ff77239b700 1 -- 172.21.15.62:0/1262026668 wait complete. 2024-05-09T06:29:48.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.199+0000 7ff77239b700 1 Processor -- start 2024-05-09T06:29:48.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.200+0000 7ff77239b700 1 -- start start 2024-05-09T06:29:48.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.200+0000 7ff77239b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff76c066ab0 0x7ff76c10b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:48.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.200+0000 7ff77239b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0fff90 0x7ff76c10bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:48.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.200+0000 7ff77239b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c10c350 con 0x7ff76c066ab0 2024-05-09T06:29:48.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.200+0000 7ff77239b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c10cba0 con 0x7ff76c0fff90 2024-05-09T06:29:48.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.200+0000 7ff76bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff76c066ab0 0x7ff76c10b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:48.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.200+0000 7ff76bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff76c066ab0 0x7ff76c10b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45694/0 (socket says 172.21.15.62:45694) 2024-05-09T06:29:48.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.200+0000 7ff76bfff700 1 -- 172.21.15.62:0/1629477097 learned_addr learned my addr 172.21.15.62:0/1629477097 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:48.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.201+0000 7ff76b7fe700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0fff90 0x7ff76c10bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:48.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.201+0000 7ff76bfff700 1 -- 172.21.15.62:0/1629477097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0fff90 msgr2=0x7ff76c10bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:48.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.201+0000 7ff76bfff700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0fff90 0x7ff76c10bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.201+0000 7ff76bfff700 1 -- 172.21.15.62:0/1629477097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff760005040 con 0x7ff76c066ab0 2024-05-09T06:29:48.184 INFO:tasks.workunit.client.0.smithi062.stdout:3/59: unlink d1/c6 0 2024-05-09T06:29:48.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.201+0000 7ff76bfff700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff76c066ab0 0x7ff76c10b7c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00eb40 tx=0x7ff75c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:48.185 INFO:tasks.workunit.client.0.smithi062.stdout:2/17: dwrite d0/f3 [0,4194304] 0 2024-05-09T06:29:48.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.202+0000 7ff768ff9700 1 -- 172.21.15.62:0/1629477097 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff75c007cc0 con 0x7ff76c066ab0 2024-05-09T06:29:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.202+0000 7ff768ff9700 1 -- 172.21.15.62:0/1629477097 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff75c00f040 con 0x7ff76c066ab0 2024-05-09T06:29:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.202+0000 7ff768ff9700 1 -- 172.21.15.62:0/1629477097 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff75c009680 con 0x7ff76c066ab0 2024-05-09T06:29:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.202+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76c10ce80 con 0x7ff76c066ab0 2024-05-09T06:29:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.202+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c10d380 con 0x7ff76c066ab0 2024-05-09T06:29:48.186 INFO:tasks.workunit.client.0.smithi062.stdout:8/49: dwrite f3 [0,4194304] 0 2024-05-09T06:29:48.186 INFO:tasks.workunit.client.0.smithi062.stdout:2/18: getdents d0 0 2024-05-09T06:29:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.204+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c05f5c0 con 0x7ff76c066ab0 2024-05-09T06:29:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.204+0000 7ff768ff9700 1 -- 172.21.15.62:0/1629477097 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 20) v1 ==== 93219+0+0 (secure 0 0 0) 0x7ff75c0097e0 con 0x7ff76c066ab0 2024-05-09T06:29:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.205+0000 7ff768ff9700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff754070aa0 0x7ff754072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.205+0000 7ff768ff9700 1 -- 172.21.15.62:0/1629477097 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff75c090150 con 0x7ff76c066ab0 2024-05-09T06:29:48.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.206+0000 7ff76b7fe700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff754070aa0 0x7ff754072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:48.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.206+0000 7ff76b7fe700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff754070aa0 0x7ff754072f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff760005010 tx=0x7ff760009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:48.189 INFO:tasks.workunit.client.0.smithi062.stdout:8/50: rename f3 to da/fc 0 2024-05-09T06:29:48.189 INFO:tasks.workunit.client.0.smithi062.stdout:8/51: dread - f9 zero size 2024-05-09T06:29:48.189 INFO:tasks.workunit.client.0.smithi062.stdout:8/52: stat da/fc 0 2024-05-09T06:29:48.191 INFO:tasks.workunit.client.0.smithi062.stdout:2/19: link d0/c2 d0/c4 0 2024-05-09T06:29:48.192 INFO:tasks.workunit.client.0.smithi062.stdout:7/127: dwrite d0/d3/f5 [0,4194304] 0 2024-05-09T06:29:48.193 INFO:tasks.workunit.client.0.smithi062.stdout:8/53: unlink da/cb 0 2024-05-09T06:29:48.193 INFO:tasks.workunit.client.0.smithi062.stdout:8/54: chown f8 23819 1 2024-05-09T06:29:48.193 INFO:tasks.workunit.client.0.smithi062.stdout:8/55: readlink l5 0 2024-05-09T06:29:48.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.212+0000 7ff768ff9700 1 -- 172.21.15.62:0/1629477097 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff75c05ff20 con 0x7ff76c066ab0 2024-05-09T06:29:48.194 INFO:tasks.workunit.client.0.smithi062.stdout:6/82: dwrite dc/fd [0,4194304] 0 2024-05-09T06:29:48.194 INFO:tasks.workunit.client.0.smithi062.stdout:4/71: dwrite d0/d2/f6 [0,4194304] 0 2024-05-09T06:29:48.198 INFO:tasks.workunit.client.0.smithi062.stdout:8/56: symlink da/ld 0 2024-05-09T06:29:48.206 INFO:tasks.workunit.client.0.smithi062.stdout:7/128: dread d0/f8 [0,4194304] 0 2024-05-09T06:29:48.206 INFO:tasks.workunit.client.0.smithi062.stdout:7/129: fsync d0/f1e 0 2024-05-09T06:29:48.206 INFO:tasks.workunit.client.0.smithi062.stdout:7/130: chown d0/d12/c1c 14787338 1 2024-05-09T06:29:48.206 INFO:tasks.workunit.client.0.smithi062.stdout:7/131: fdatasync d0/f8 0 2024-05-09T06:29:48.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/132: write d0/f8 [2519116,23367] 0 2024-05-09T06:29:48.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/133: write d0/f8 [153642,117721] 0 2024-05-09T06:29:48.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/134: stat d0/f8 0 2024-05-09T06:29:48.211 INFO:tasks.workunit.client.0.smithi062.stdout:0/59: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:48.211 INFO:tasks.workunit.client.0.smithi062.stdout:3/60: dwrite d1/dd/ff [0,4194304] 0 2024-05-09T06:29:48.212 INFO:tasks.workunit.client.0.smithi062.stdout:6/83: link dc/de/l16 dc/l19 0 2024-05-09T06:29:48.215 INFO:tasks.workunit.client.0.smithi062.stdout:2/20: unlink d0/c2 0 2024-05-09T06:29:48.218 INFO:tasks.workunit.client.0.smithi062.stdout:8/57: creat da/fe x:0 0 0 2024-05-09T06:29:48.218 INFO:tasks.workunit.client.0.smithi062.stdout:8/58: chown f6 127 1 2024-05-09T06:29:48.222 INFO:tasks.workunit.client.0.smithi062.stdout:4/72: rmdir d0 39 2024-05-09T06:29:48.222 INFO:tasks.workunit.client.0.smithi062.stdout:4/73: write d0/d2/f5 [1162811,66374] 0 2024-05-09T06:29:48.226 INFO:tasks.workunit.client.0.smithi062.stdout:7/135: rename d0/d12/f1a to d0/d3/f1f 0 2024-05-09T06:29:48.226 INFO:tasks.workunit.client.0.smithi062.stdout:7/136: dread - d0/f1b zero size 2024-05-09T06:29:48.226 INFO:tasks.workunit.client.0.smithi062.stdout:1/30: getdents . 0 2024-05-09T06:29:48.226 INFO:tasks.workunit.client.0.smithi062.stdout:1/31: write f5 [4954275,46089] 0 2024-05-09T06:29:48.227 INFO:tasks.workunit.client.0.smithi062.stdout:0/60: dwrite d1/f11 [0,4194304] 0 2024-05-09T06:29:48.227 INFO:tasks.workunit.client.0.smithi062.stdout:0/61: fsync d1/fd 0 2024-05-09T06:29:48.230 INFO:tasks.workunit.client.0.smithi062.stdout:4/74: dread d0/d2/f3 [0,4194304] 0 2024-05-09T06:29:48.233 INFO:tasks.workunit.client.0.smithi062.stdout:3/61: mkdir d1/d15 0 2024-05-09T06:29:48.236 INFO:tasks.workunit.client.0.smithi062.stdout:7/137: write d0/d3/fd [577905,69051] 0 2024-05-09T06:29:48.242 INFO:tasks.workunit.client.0.smithi062.stdout:6/84: mkdir dc/de/d10/d1a 0 2024-05-09T06:29:48.271 INFO:tasks.workunit.client.0.smithi062.stdout:8/59: unlink c4 0 2024-05-09T06:29:48.273 INFO:tasks.workunit.client.0.smithi062.stdout:1/32: mkdir d8 0 2024-05-09T06:29:48.277 INFO:tasks.workunit.client.0.smithi062.stdout:0/62: unlink d1/ff 0 2024-05-09T06:29:48.279 INFO:tasks.workunit.client.0.smithi062.stdout:8/60: write da/fc [2493238,79975] 0 2024-05-09T06:29:48.281 INFO:tasks.workunit.client.0.smithi062.stdout:4/75: mkdir d0/d2/d14 0 2024-05-09T06:29:48.281 INFO:tasks.workunit.client.0.smithi062.stdout:3/62: stat l0 0 2024-05-09T06:29:48.283 INFO:tasks.workunit.client.0.smithi062.stdout:7/138: link d0/f4 d0/f20 0 2024-05-09T06:29:48.285 INFO:tasks.workunit.client.0.smithi062.stdout:6/85: unlink l5 0 2024-05-09T06:29:48.285 INFO:tasks.workunit.client.0.smithi062.stdout:6/86: fdatasync dc/de/f11 0 2024-05-09T06:29:48.287 INFO:tasks.workunit.client.0.smithi062.stdout:2/21: write d0/f3 [4368227,9672] 0 2024-05-09T06:29:48.287 INFO:tasks.workunit.client.0.smithi062.stdout:2/22: readlink - no filename 2024-05-09T06:29:48.290 INFO:tasks.workunit.client.0.smithi062.stdout:4/76: dread d0/d9/fc [0,4194304] 0 2024-05-09T06:29:48.290 INFO:tasks.workunit.client.0.smithi062.stdout:4/77: truncate d0/d2/f3 4410169 0 2024-05-09T06:29:48.290 INFO:tasks.workunit.client.0.smithi062.stdout:7/139: dread d0/d3/fd [0,4194304] 0 2024-05-09T06:29:48.293 INFO:tasks.workunit.client.0.smithi062.stdout:1/33: stat f5 0 2024-05-09T06:29:48.293 INFO:tasks.workunit.client.0.smithi062.stdout:1/34: stat f5 0 2024-05-09T06:29:48.294 INFO:tasks.workunit.client.0.smithi062.stdout:0/63: creat d1/f14 x:0 0 0 2024-05-09T06:29:48.294 INFO:tasks.workunit.client.0.smithi062.stdout:0/64: truncate d1/fd 414040 0 2024-05-09T06:29:48.295 INFO:tasks.workunit.client.0.smithi062.stdout:8/61: mknod da/cf 0 2024-05-09T06:29:48.295 INFO:tasks.workunit.client.0.smithi062.stdout:8/62: write f7 [716307,43678] 0 2024-05-09T06:29:48.298 INFO:tasks.workunit.client.0.smithi062.stdout:3/63: rmdir d1/d15 0 2024-05-09T06:29:48.301 INFO:tasks.workunit.client.0.smithi062.stdout:4/78: creat d0/d9/f15 x:0 0 0 2024-05-09T06:29:48.303 INFO:tasks.workunit.client.0.smithi062.stdout:2/23: write d0/f3 [3132022,116267] 0 2024-05-09T06:29:48.310 INFO:tasks.workunit.client.0.smithi062.stdout:0/65: creat d1/f15 x:0 0 0 2024-05-09T06:29:48.313 INFO:tasks.workunit.client.0.smithi062.stdout:8/63: rename l5 to da/l10 0 2024-05-09T06:29:48.315 INFO:tasks.workunit.client.0.smithi062.stdout:7/140: dwrite d0/d3/f17 [0,4194304] 0 2024-05-09T06:29:48.316 INFO:tasks.workunit.client.0.smithi062.stdout:0/66: creat d1/f16 x:0 0 0 2024-05-09T06:29:48.316 INFO:tasks.workunit.client.0.smithi062.stdout:0/67: write d1/fd [1349315,67301] 0 2024-05-09T06:29:48.320 INFO:tasks.workunit.client.0.smithi062.stdout:6/87: dwrite dc/ff [0,4194304] 0 2024-05-09T06:29:48.321 INFO:tasks.workunit.client.0.smithi062.stdout:3/64: dwrite d1/dd/f14 [0,4194304] 0 2024-05-09T06:29:48.321 INFO:tasks.workunit.client.0.smithi062.stdout:3/65: chown d1/la 94358103 1 2024-05-09T06:29:48.321 INFO:tasks.workunit.client.0.smithi062.stdout:4/79: rename d0/d9/fb to d0/d2/d8/df/f16 0 2024-05-09T06:29:48.321 INFO:tasks.workunit.client.0.smithi062.stdout:4/80: fdatasync d0/d9/fc 0 2024-05-09T06:29:48.322 INFO:tasks.workunit.client.0.smithi062.stdout:3/66: rename d1 to d1/dd/d16 22 2024-05-09T06:29:48.322 INFO:tasks.workunit.client.0.smithi062.stdout:8/64: mkdir da/d11 0 2024-05-09T06:29:48.330 INFO:tasks.workunit.client.0.smithi062.stdout:1/35: dwrite f7 [0,4194304] 0 2024-05-09T06:29:48.330 INFO:tasks.workunit.client.0.smithi062.stdout:0/68: creat d1/f17 x:0 0 0 2024-05-09T06:29:48.330 INFO:tasks.workunit.client.0.smithi062.stdout:0/69: fdatasync d1/f14 0 2024-05-09T06:29:48.336 INFO:tasks.workunit.client.0.smithi062.stdout:3/67: dread d1/dd/f14 [0,4194304] 0 2024-05-09T06:29:48.340 INFO:tasks.workunit.client.0.smithi062.stdout:6/88: dwrite dc/ff [0,4194304] 0 2024-05-09T06:29:48.342 INFO:tasks.workunit.client.0.smithi062.stdout:4/81: unlink d0/f13 0 2024-05-09T06:29:48.343 INFO:tasks.workunit.client.0.smithi062.stdout:8/65: creat da/d11/f12 x:0 0 0 2024-05-09T06:29:48.346 INFO:tasks.workunit.client.0.smithi062.stdout:2/24: link d0/c4 d0/c5 0 2024-05-09T06:29:48.346 INFO:tasks.workunit.client.0.smithi062.stdout:2/25: read d0/f3 [1651979,42650] 0 2024-05-09T06:29:48.346 INFO:tasks.workunit.client.0.smithi062.stdout:2/26: readlink - no filename 2024-05-09T06:29:48.350 INFO:tasks.workunit.client.0.smithi062.stdout:8/66: dread da/fc [0,4194304] 0 2024-05-09T06:29:48.350 INFO:tasks.workunit.client.0.smithi062.stdout:8/67: write da/fc [847267,64765] 0 2024-05-09T06:29:48.352 INFO:tasks.workunit.client.0.smithi062.stdout:3/68: dwrite d1/dd/ff [4194304,4194304] 0 2024-05-09T06:29:48.361 INFO:tasks.workunit.client.0.smithi062.stdout:3/69: dread d1/dd/ff [4194304,4194304] 0 2024-05-09T06:29:48.368 INFO:tasks.workunit.client.0.smithi062.stdout:6/89: creat dc/de/f1b x:0 0 0 2024-05-09T06:29:48.368 INFO:tasks.workunit.client.0.smithi062.stdout:5/36: sync 2024-05-09T06:29:48.368 INFO:tasks.workunit.client.0.smithi062.stdout:9/173: sync 2024-05-09T06:29:48.372 INFO:tasks.workunit.client.0.smithi062.stdout:1/36: dread f3 [0,4194304] 0 2024-05-09T06:29:48.372 INFO:tasks.workunit.client.0.smithi062.stdout:4/82: creat d0/f17 x:0 0 0 2024-05-09T06:29:48.372 INFO:tasks.workunit.client.0.smithi062.stdout:4/83: truncate d0/d2/f4 4821433 0 2024-05-09T06:29:48.372 INFO:tasks.workunit.client.0.smithi062.stdout:4/84: read - d0/d9/f15 zero size 2024-05-09T06:29:48.372 INFO:tasks.workunit.client.0.smithi062.stdout:4/85: dread - d0/d9/f15 zero size 2024-05-09T06:29:48.373 INFO:tasks.workunit.client.0.smithi062.stdout:2/27: creat d0/f6 x:0 0 0 2024-05-09T06:29:48.381 INFO:tasks.workunit.client.0.smithi062.stdout:3/70: mknod d1/dd/c17 0 2024-05-09T06:29:48.381 INFO:tasks.workunit.client.0.smithi062.stdout:3/71: fsync d1/f8 0 2024-05-09T06:29:48.381 INFO:tasks.workunit.client.0.smithi062.stdout:5/37: symlink d0/d4/d5/dc/ld 0 2024-05-09T06:29:48.382 INFO:tasks.workunit.client.0.smithi062.stdout:1/37: mknod d8/c9 0 2024-05-09T06:29:48.384 INFO:tasks.workunit.client.0.smithi062.stdout:3/72: dread d1/f3 [0,4194304] 0 2024-05-09T06:29:48.386 INFO:tasks.workunit.client.0.smithi062.stdout:4/86: rename d0/c7 to d0/d2/d8/c18 0 2024-05-09T06:29:48.386 INFO:tasks.workunit.client.0.smithi062.stdout:4/87: rename d0 to d0/d2/d8/d19 22 2024-05-09T06:29:48.387 INFO:tasks.workunit.client.0.smithi062.stdout:1/38: dread f7 [0,4194304] 0 2024-05-09T06:29:48.387 INFO:tasks.workunit.client.0.smithi062.stdout:1/39: readlink - no filename 2024-05-09T06:29:48.388 INFO:tasks.workunit.client.0.smithi062.stdout:8/68: getdents da/d11 0 2024-05-09T06:29:48.389 INFO:tasks.workunit.client.0.smithi062.stdout:1/40: fdatasync f6 0 2024-05-09T06:29:48.389 INFO:tasks.workunit.client.0.smithi062.stdout:1/41: fdatasync f3 0 2024-05-09T06:29:48.391 INFO:tasks.workunit.client.0.smithi062.stdout:2/28: mkdir d0/d7 0 2024-05-09T06:29:48.398 INFO:tasks.workunit.client.0.smithi062.stdout:3/73: write d1/dd/ff [6418581,2817] 0 2024-05-09T06:29:48.398 INFO:tasks.workunit.client.0.smithi062.stdout:3/74: readlink d1/l11 0 2024-05-09T06:29:48.398 INFO:tasks.workunit.client.0.smithi062.stdout:1/42: write f3 [2360776,92009] 0 2024-05-09T06:29:48.403 INFO:tasks.workunit.client.0.smithi062.stdout:1/43: unlink f0 0 2024-05-09T06:29:48.408 INFO:tasks.workunit.client.0.smithi062.stdout:6/90: dwrite dc/f13 [0,4194304] 0 2024-05-09T06:29:48.412 INFO:tasks.workunit.client.0.smithi062.stdout:6/91: creat dc/de/d10/f1c x:0 0 0 2024-05-09T06:29:48.413 INFO:tasks.workunit.client.0.smithi062.stdout:6/92: stat dc/l19 0 2024-05-09T06:29:48.414 INFO:tasks.workunit.client.0.smithi062.stdout:6/93: symlink dc/de/d10/l1d 0 2024-05-09T06:29:48.414 INFO:tasks.workunit.client.0.smithi062.stdout:1/44: write f5 [223640,72386] 0 2024-05-09T06:29:48.416 INFO:tasks.workunit.client.0.smithi062.stdout:8/69: dwrite da/fe [0,4194304] 0 2024-05-09T06:29:48.416 INFO:tasks.workunit.client.0.smithi062.stdout:8/70: chown da/fc 852539 1 2024-05-09T06:29:48.416 INFO:tasks.workunit.client.0.smithi062.stdout:8/71: creat da/f13 x:0 0 0 2024-05-09T06:29:48.416 INFO:tasks.workunit.client.0.smithi062.stdout:8/72: fdatasync da/fc 0 2024-05-09T06:29:48.417 INFO:tasks.workunit.client.0.smithi062.stdout:9/174: dwrite d3/d1a/f35 [0,4194304] 0 2024-05-09T06:29:48.417 INFO:tasks.workunit.client.0.smithi062.stdout:2/29: dwrite d0/f6 [0,4194304] 0 2024-05-09T06:29:48.417 INFO:tasks.workunit.client.0.smithi062.stdout:2/30: fsync d0/f3 0 2024-05-09T06:29:48.417 INFO:tasks.workunit.client.0.smithi062.stdout:5/38: dwrite d0/d4/f7 [0,4194304] 0 2024-05-09T06:29:48.417 INFO:tasks.workunit.client.0.smithi062.stdout:1/45: symlink d8/la 0 2024-05-09T06:29:48.422 INFO:tasks.workunit.client.0.smithi062.stdout:4/88: getdents d0 0 2024-05-09T06:29:48.422 INFO:tasks.workunit.client.0.smithi062.stdout:4/89: fdatasync d0/d2/f4 0 2024-05-09T06:29:48.422 INFO:tasks.workunit.client.0.smithi062.stdout:4/90: truncate d0/d9/fc 5199611 0 2024-05-09T06:29:48.427 INFO:tasks.workunit.client.0.smithi062.stdout:9/175: symlink d3/d1a/d1c/l45 0 2024-05-09T06:29:48.431 INFO:tasks.workunit.client.0.smithi062.stdout:1/46: symlink d8/lb 0 2024-05-09T06:29:48.434 INFO:tasks.workunit.client.0.smithi062.stdout:5/39: mknod d0/ce 0 2024-05-09T06:29:48.436 INFO:tasks.workunit.client.0.smithi062.stdout:9/176: truncate d3/d1a/d1c/d21/f24 1007663 0 2024-05-09T06:29:48.438 INFO:tasks.workunit.client.0.smithi062.stdout:2/31: symlink d0/l8 0 2024-05-09T06:29:48.438 INFO:tasks.workunit.client.0.smithi062.stdout:2/32: fdatasync d0/f3 0 2024-05-09T06:29:48.440 INFO:tasks.workunit.client.0.smithi062.stdout:5/40: creat d0/ff x:0 0 0 2024-05-09T06:29:48.440 INFO:tasks.workunit.client.0.smithi062.stdout:5/41: dread - d0/ff zero size 2024-05-09T06:29:48.441 INFO:tasks.workunit.client.0.smithi062.stdout:3/75: dread d1/dd/ff [0,4194304] 0 2024-05-09T06:29:48.442 INFO:tasks.workunit.client.0.smithi062.stdout:9/177: mknod d3/d1a/d1c/c46 0 2024-05-09T06:29:48.443 INFO:tasks.workunit.client.0.smithi062.stdout:9/178: write d3/d1a/d1c/d2b/d31/f43 [200301,38078] 0 2024-05-09T06:29:48.443 INFO:tasks.workunit.client.0.smithi062.stdout:9/179: fsync d3/d1a/d1c/f26 0 2024-05-09T06:29:48.443 INFO:tasks.workunit.client.0.smithi062.stdout:3/76: write d1/f3 [977392,8505] 0 2024-05-09T06:29:48.443 INFO:tasks.workunit.client.0.smithi062.stdout:5/42: symlink d0/d4/d5/l10 0 2024-05-09T06:29:48.450 INFO:tasks.workunit.client.0.smithi062.stdout:3/77: mkdir d1/dd/d18 0 2024-05-09T06:29:48.450 INFO:tasks.workunit.client.0.smithi062.stdout:3/78: chown d1/dd/f10 3583848 1 2024-05-09T06:29:48.450 INFO:tasks.workunit.client.0.smithi062.stdout:2/33: read d0/f6 [3888474,118822] 0 2024-05-09T06:29:48.453 INFO:tasks.workunit.client.0.smithi062.stdout:5/43: rename d0/d4/d5/dc to d0/d11 0 2024-05-09T06:29:48.454 INFO:tasks.workunit.client.0.smithi062.stdout:8/73: dwrite da/fc [0,4194304] 0 2024-05-09T06:29:48.454 INFO:tasks.workunit.client.0.smithi062.stdout:8/74: creat da/f14 x:0 0 0 2024-05-09T06:29:48.454 INFO:tasks.workunit.client.0.smithi062.stdout:8/75: fsync f6 0 2024-05-09T06:29:48.455 INFO:tasks.workunit.client.0.smithi062.stdout:3/79: read d1/dd/f14 [2697315,103605] 0 2024-05-09T06:29:48.455 INFO:tasks.workunit.client.0.smithi062.stdout:6/94: dwrite dc/f13 [0,4194304] 0 2024-05-09T06:29:48.455 INFO:tasks.workunit.client.0.smithi062.stdout:4/91: dwrite d0/d2/d8/df/f16 [0,4194304] 0 2024-05-09T06:29:48.463 INFO:tasks.workunit.client.0.smithi062.stdout:5/44: rename d0/d4/f7 to d0/d4/f12 0 2024-05-09T06:29:48.463 INFO:tasks.workunit.client.0.smithi062.stdout:3/80: dread d1/dd/f14 [0,4194304] 0 2024-05-09T06:29:48.465 INFO:tasks.workunit.client.0.smithi062.stdout:3/81: dread d1/f8 [0,4194304] 0 2024-05-09T06:29:48.465 INFO:tasks.workunit.client.0.smithi062.stdout:8/76: rmdir da/d11 39 2024-05-09T06:29:48.467 INFO:tasks.workunit.client.0.smithi062.stdout:9/180: fsync d3/d1a/d1c/d21/f24 0 2024-05-09T06:29:48.470 INFO:tasks.workunit.client.0.smithi062.stdout:4/92: mknod d0/d2/c1a 0 2024-05-09T06:29:48.477 INFO:tasks.workunit.client.0.smithi062.stdout:5/45: symlink d0/d11/l13 0 2024-05-09T06:29:48.477 INFO:tasks.workunit.client.0.smithi062.stdout:5/46: write d0/ff [835125,47299] 0 2024-05-09T06:29:48.479 INFO:tasks.workunit.client.0.smithi062.stdout:6/95: dwrite fa [0,4194304] 0 2024-05-09T06:29:48.479 INFO:tasks.workunit.client.0.smithi062.stdout:4/93: link d0/d2/d8/c18 d0/d9/c1b 0 2024-05-09T06:29:48.479 INFO:tasks.workunit.client.0.smithi062.stdout:1/47: dwrite f6 [4194304,4194304] 0 2024-05-09T06:29:48.481 INFO:tasks.workunit.client.0.smithi062.stdout:9/181: mknod d3/d1a/d1c/d21/c47 0 2024-05-09T06:29:48.481 INFO:tasks.workunit.client.0.smithi062.stdout:9/182: creat d3/d1a/f48 x:0 0 0 2024-05-09T06:29:48.482 INFO:tasks.workunit.client.0.smithi062.stdout:6/96: symlink dc/de/l1e 0 2024-05-09T06:29:48.486 INFO:tasks.workunit.client.0.smithi062.stdout:4/94: symlink d0/d9/l1c 0 2024-05-09T06:29:48.489 INFO:tasks.workunit.client.0.smithi062.stdout:5/47: dread d0/d4/f12 [0,4194304] 0 2024-05-09T06:29:48.494 INFO:tasks.workunit.client.0.smithi062.stdout:6/97: rename dc/de/l12 to dc/l1f 0 2024-05-09T06:29:48.494 INFO:tasks.workunit.client.0.smithi062.stdout:1/48: dwrite f3 [4194304,4194304] 0 2024-05-09T06:29:48.495 INFO:tasks.workunit.client.0.smithi062.stdout:4/95: creat d0/d2/f1d x:0 0 0 2024-05-09T06:29:48.495 INFO:tasks.workunit.client.0.smithi062.stdout:4/96: readlink d0/l1 0 2024-05-09T06:29:48.495 INFO:tasks.workunit.client.0.smithi062.stdout:4/97: write d0/d2/f4 [4305165,94438] 0 2024-05-09T06:29:48.497 INFO:tasks.workunit.client.0.smithi062.stdout:5/48: creat d0/d4/d5/f14 x:0 0 0 2024-05-09T06:29:48.498 INFO:tasks.workunit.client.0.smithi062.stdout:9/183: getdents d3/d1a/d1c/d2b/d31 0 2024-05-09T06:29:48.498 INFO:tasks.workunit.client.0.smithi062.stdout:9/184: dread - d3/d1a/f48 zero size 2024-05-09T06:29:48.500 INFO:tasks.workunit.client.0.smithi062.stdout:6/98: mkdir dc/de/d10/d20 0 2024-05-09T06:29:48.501 INFO:tasks.workunit.client.0.smithi062.stdout:5/49: write d0/d4/f12 [3346236,26476] 0 2024-05-09T06:29:48.502 INFO:tasks.workunit.client.0.smithi062.stdout:5/50: getdents d0/d8 0 2024-05-09T06:29:48.502 INFO:tasks.workunit.client.0.smithi062.stdout:1/49: creat d8/fc x:0 0 0 2024-05-09T06:29:48.502 INFO:tasks.workunit.client.0.smithi062.stdout:1/50: chown d8/fc 383266704 1 2024-05-09T06:29:48.506 INFO:tasks.workunit.client.0.smithi062.stdout:9/185: rename d3/d1a/d1c/d21/c42 to d3/d1a/d1c/d2b/c49 0 2024-05-09T06:29:48.506 INFO:tasks.workunit.client.0.smithi062.stdout:9/186: creat d3/d1a/d1c/f4a x:0 0 0 2024-05-09T06:29:48.508 INFO:tasks.workunit.client.0.smithi062.stdout:5/51: mknod d0/d11/c15 0 2024-05-09T06:29:48.508 INFO:tasks.workunit.client.0.smithi062.stdout:5/52: truncate d0/ff 1923581 0 2024-05-09T06:29:48.508 INFO:tasks.workunit.client.0.smithi062.stdout:5/53: write d0/d4/d5/f14 [57194,100515] 0 2024-05-09T06:29:48.509 INFO:tasks.workunit.client.0.smithi062.stdout:1/51: symlink d8/ld 0 2024-05-09T06:29:48.509 INFO:tasks.workunit.client.0.smithi062.stdout:1/52: creat d8/fe x:0 0 0 2024-05-09T06:29:48.509 INFO:tasks.workunit.client.0.smithi062.stdout:6/99: dread dc/ff [0,4194304] 0 2024-05-09T06:29:48.515 INFO:tasks.workunit.client.0.smithi062.stdout:9/187: write d3/f5 [1274207,12671] 0 2024-05-09T06:29:48.515 INFO:tasks.workunit.client.0.smithi062.stdout:9/188: chown d3/d3e 2 1 2024-05-09T06:29:48.517 INFO:tasks.workunit.client.0.smithi062.stdout:4/98: rmdir d0/d9 39 2024-05-09T06:29:48.520 INFO:tasks.workunit.client.0.smithi062.stdout:1/53: symlink d8/lf 0 2024-05-09T06:29:48.524 INFO:tasks.workunit.client.0.smithi062.stdout:6/100: link dc/de/d10/l1d dc/l21 0 2024-05-09T06:29:48.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.547+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff76c10d6f0 con 0x7ff754070aa0 2024-05-09T06:29:48.530 INFO:tasks.workunit.client.0.smithi062.stdout:5/54: rmdir d0/d4 39 2024-05-09T06:29:48.532 INFO:tasks.workunit.client.0.smithi062.stdout:6/101: write fa [657913,93167] 0 2024-05-09T06:29:48.533 INFO:tasks.workunit.client.0.smithi062.stdout:4/99: rmdir d0/d9 39 2024-05-09T06:29:48.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.563+0000 7ff768ff9700 1 -- 172.21.15.62:0/1629477097 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff76c10d6f0 con 0x7ff754070aa0 2024-05-09T06:29:48.545 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:29:48.545 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (6m) 2m ago 8m 24.9M - 0.25.0 c8568f914cd2 b9c4737eec20 2024-05-09T06:29:48.545 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (8m) 2m ago 8m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (7m) 4s ago 7m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (6m) 2m ago 7m 84.5M - 9.4.7 954c08fa6188 06a19fe449ea 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (2m) 2m ago 2m 12.1M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (2m) 2m ago 2m 15.9M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (2m) 4s ago 2m 12.7M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (2m) 4s ago 2m 12.8M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:9283 running (9m) 2m ago 9m 481M - 17.2.7-933-g4ba5a836 b96134859c76 f1bb37d51b2f 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283 running (12s) 4s ago 6m 51.1M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5fe8e477d847 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (9m) 2m ago 9m 47.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (6m) 4s ago 6m 37.0M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (8m) 2m ago 8m 15.9M - 1.5.0 0da6a335fe13 a2eb68715549 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (7m) 4s ago 7m 15.7M - 1.5.0 0da6a335fe13 9d423500267f 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (6m) 2m ago 6m 45.6M 4288M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:29:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (5m) 2m ago 5m 48.0M 4288M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:29:48.547 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (5m) 2m ago 5m 46.4M 4288M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:29:48.547 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (4m) 4s ago 4m 241M 5312M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:29:48.547 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (4m) 4s ago 4m 181M 5312M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:29:48.547 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (3m) 4s ago 3m 229M 5312M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:29:48.547 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (6m) 2m ago 7m 58.4M - 2.43.0 a07b618ecd1d c90458655289 2024-05-09T06:29:48.548 INFO:tasks.workunit.client.0.smithi062.stdout:1/54: mknod d8/c10 0 2024-05-09T06:29:48.548 INFO:tasks.workunit.client.0.smithi062.stdout:1/55: readlink d8/lf 0 2024-05-09T06:29:48.548 INFO:tasks.workunit.client.0.smithi062.stdout:1/56: fsync f6 0 2024-05-09T06:29:48.548 INFO:tasks.workunit.client.0.smithi062.stdout:5/55: unlink d0/d4/la 0 2024-05-09T06:29:48.548 INFO:tasks.workunit.client.0.smithi062.stdout:4/100: dwrite d0/d2/f3 [0,4194304] 0 2024-05-09T06:29:48.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff754070aa0 msgr2=0x7ff754072f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff754070aa0 0x7ff754072f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff760005010 tx=0x7ff760009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff76c066ab0 msgr2=0x7ff76c10b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff76c066ab0 0x7ff76c10b7c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00eb40 tx=0x7ff75c00b040 comp rx=0 tx=0).stop 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 shutdown_connections 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7ff754070aa0 0x7ff754072f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff76c066ab0 0x7ff76c10b7c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 --2- 172.21.15.62:0/1629477097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff76c0fff90 0x7ff76c10bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.566+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 >> 172.21.15.62:0/1629477097 conn(0x7ff76c0f7420 msgr2=0x7ff76c0fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.567+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 shutdown_connections 2024-05-09T06:29:48.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.567+0000 7ff77239b700 1 -- 172.21.15.62:0/1629477097 wait complete. 2024-05-09T06:29:48.553 INFO:tasks.workunit.client.0.smithi062.stdout:1/57: symlink d8/l11 0 2024-05-09T06:29:48.555 INFO:tasks.workunit.client.0.smithi062.stdout:4/101: truncate d0/d2/f5 965008 0 2024-05-09T06:29:48.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/58: symlink d8/l12 0 2024-05-09T06:29:48.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/59: creat d8/f13 x:0 0 0 2024-05-09T06:29:48.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/60: stat d8 0 2024-05-09T06:29:48.561 INFO:tasks.workunit.client.0.smithi062.stdout:1/61: mkdir d8/d14 0 2024-05-09T06:29:48.562 INFO:tasks.workunit.client.0.smithi062.stdout:1/62: write d8/f13 [691755,46955] 0 2024-05-09T06:29:48.627 INFO:tasks.workunit.client.0.smithi062.stdout:4/102: dwrite d0/f17 [0,4194304] 0 2024-05-09T06:29:48.627 INFO:tasks.workunit.client.0.smithi062.stdout:4/103: chown d0 214 1 2024-05-09T06:29:48.644 INFO:tasks.workunit.client.0.smithi062.stdout:1/63: dwrite f7 [0,4194304] 0 2024-05-09T06:29:48.645 INFO:tasks.workunit.client.0.smithi062.stdout:4/104: dwrite d0/d2/f4 [0,4194304] 0 2024-05-09T06:29:48.646 INFO:tasks.workunit.client.0.smithi062.stdout:1/64: link d8/l12 d8/d14/l15 0 2024-05-09T06:29:48.646 INFO:tasks.workunit.client.0.smithi062.stdout:1/65: chown d8/f13 8922995 1 2024-05-09T06:29:48.648 INFO:tasks.workunit.client.0.smithi062.stdout:4/105: creat d0/f1e x:0 0 0 2024-05-09T06:29:48.648 INFO:tasks.workunit.client.0.smithi062.stdout:4/106: dread - d0/f1e zero size 2024-05-09T06:29:48.652 INFO:tasks.workunit.client.0.smithi062.stdout:1/66: dread d8/f13 [0,4194304] 0 2024-05-09T06:29:48.654 INFO:tasks.workunit.client.0.smithi062.stdout:1/67: read f5 [4672830,82876] 0 2024-05-09T06:29:48.666 INFO:tasks.workunit.client.0.smithi062.stdout:1/68: dread f7 [0,4194304] 0 2024-05-09T06:29:48.666 INFO:tasks.workunit.client.0.smithi062.stdout:4/107: dwrite d0/f1e [0,4194304] 0 2024-05-09T06:29:48.668 INFO:tasks.workunit.client.0.smithi062.stdout:4/108: write d0/d2/f5 [814957,20676] 0 2024-05-09T06:29:48.670 INFO:tasks.workunit.client.0.smithi062.stdout:1/69: getdents d8/d14 0 2024-05-09T06:29:48.673 INFO:tasks.workunit.client.0.smithi062.stdout:1/70: symlink d8/l16 0 2024-05-09T06:29:48.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.691+0000 7f235c812700 1 -- 172.21.15.62:0/1827901952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 msgr2=0x7f2358102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:48.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.691+0000 7f235c812700 1 --2- 172.21.15.62:0/1827901952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 0x7f2358102390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f234c004940 tx=0x7f234c009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.692+0000 7f235c812700 1 -- 172.21.15.62:0/1827901952 shutdown_connections 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.692+0000 7f235c812700 1 --2- 172.21.15.62:0/1827901952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 0x7f2358102390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.692+0000 7f235c812700 1 --2- 172.21.15.62:0/1827901952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2358066b50 0x7f23580ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.692+0000 7f235c812700 1 -- 172.21.15.62:0/1827901952 >> 172.21.15.62:0/1827901952 conn(0x7f23580f74c0 msgr2=0x7f23580f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.692+0000 7f235c812700 1 -- 172.21.15.62:0/1827901952 shutdown_connections 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.692+0000 7f235c812700 1 -- 172.21.15.62:0/1827901952 wait complete. 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f235c812700 1 Processor -- start 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f235c812700 1 -- start start 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f235c812700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2358066b50 0x7f235810d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f235c812700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 0x7f235810df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f235c812700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235810e530 con 0x7f23580fff70 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f235c812700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235810ed80 con 0x7f2358066b50 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f2355d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 0x7f235810df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:48.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f2355d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 0x7f235810df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45706/0 (socket says 172.21.15.62:45706) 2024-05-09T06:29:48.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f2355d9b700 1 -- 172.21.15.62:0/2471593511 learned_addr learned my addr 172.21.15.62:0/2471593511 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:48.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.693+0000 7f235659c700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2358066b50 0x7f235810d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.694+0000 7f2355d9b700 1 -- 172.21.15.62:0/2471593511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2358066b50 msgr2=0x7f235810d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.694+0000 7f2355d9b700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2358066b50 0x7f235810d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.694+0000 7f2355d9b700 1 -- 172.21.15.62:0/2471593511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c005040 con 0x7f23580fff70 2024-05-09T06:29:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.694+0000 7f2355d9b700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 0x7f235810df30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f234c013870 tx=0x7f234c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.694+0000 7f2346ffd700 1 -- 172.21.15.62:0/2471593511 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f234c021070 con 0x7f23580fff70 2024-05-09T06:29:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.694+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235810f000 con 0x7f23580fff70 2024-05-09T06:29:48.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.694+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235810f540 con 0x7f23580fff70 2024-05-09T06:29:48.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.694+0000 7f2346ffd700 1 -- 172.21.15.62:0/2471593511 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f234c009430 con 0x7f23580fff70 2024-05-09T06:29:48.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.695+0000 7f2346ffd700 1 -- 172.21.15.62:0/2471593511 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f234c00e070 con 0x7f23580fff70 2024-05-09T06:29:48.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.695+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235805f5c0 con 0x7f23580fff70 2024-05-09T06:29:48.679 INFO:tasks.workunit.client.0.smithi062.stdout:1/71: rmdir d8 39 2024-05-09T06:29:48.680 INFO:tasks.workunit.client.0.smithi062.stdout:1/72: stat f6 0 2024-05-09T06:29:48.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.696+0000 7f2346ffd700 1 -- 172.21.15.62:0/2471593511 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 20) v1 ==== 93219+0+0 (secure 0 0 0) 0x7f234c026760 con 0x7f23580fff70 2024-05-09T06:29:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.697+0000 7f2346ffd700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2340070aa0 0x7f2340072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.697+0000 7f2346ffd700 1 -- 172.21.15.62:0/2471593511 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f234c0917f0 con 0x7f23580fff70 2024-05-09T06:29:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.698+0000 7f235659c700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2340070aa0 0x7f2340072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.698+0000 7f235659c700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2340070aa0 0x7f2340072f50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2348009b80 tx=0x7f234800b040 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:48.681 INFO:tasks.workunit.client.0.smithi062.stdout:4/109: truncate d0/d2/f6 2735735 0 2024-05-09T06:29:48.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:48.707+0000 7f2346ffd700 1 -- 172.21.15.62:0/2471593511 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f234c0615b0 con 0x7f23580fff70 2024-05-09T06:29:48.699 INFO:tasks.workunit.client.0.smithi062.stdout:4/110: dwrite d0/d9/fc [0,4194304] 0 2024-05-09T06:29:48.715 INFO:tasks.workunit.client.0.smithi062.stdout:4/111: dwrite d0/f1e [0,4194304] 0 2024-05-09T06:29:48.716 INFO:tasks.workunit.client.0.smithi062.stdout:4/112: unlink d0/d2/d8/c18 0 2024-05-09T06:29:48.717 INFO:tasks.workunit.client.0.smithi062.stdout:0/70: sync 2024-05-09T06:29:48.717 INFO:tasks.workunit.client.0.smithi062.stdout:7/141: sync 2024-05-09T06:29:48.717 INFO:tasks.workunit.client.0.smithi062.stdout:0/71: dread - d1/f17 zero size 2024-05-09T06:29:48.718 INFO:tasks.workunit.client.0.smithi062.stdout:4/113: mkdir d0/d2/d1f 0 2024-05-09T06:29:48.722 INFO:tasks.workunit.client.0.smithi062.stdout:7/142: symlink d0/d3/l21 0 2024-05-09T06:29:48.725 INFO:tasks.workunit.client.0.smithi062.stdout:7/143: dread d0/f20 [0,4194304] 0 2024-05-09T06:29:48.726 INFO:tasks.workunit.client.0.smithi062.stdout:0/72: mkdir d1/d18 0 2024-05-09T06:29:48.729 INFO:tasks.workunit.client.0.smithi062.stdout:7/144: mkdir d0/d22 0 2024-05-09T06:29:48.730 INFO:tasks.workunit.client.0.smithi062.stdout:0/73: creat d1/f19 x:0 0 0 2024-05-09T06:29:48.731 INFO:tasks.workunit.client.0.smithi062.stdout:4/114: rmdir d0/d2 39 2024-05-09T06:29:48.732 INFO:tasks.workunit.client.0.smithi062.stdout:7/145: link d0/f1e d0/d22/f23 0 2024-05-09T06:29:48.734 INFO:tasks.workunit.client.0.smithi062.stdout:4/115: symlink d0/d2/d8/l20 0 2024-05-09T06:29:48.740 INFO:tasks.workunit.client.0.smithi062.stdout:7/146: getdents d0/d22 0 2024-05-09T06:29:48.740 INFO:tasks.workunit.client.0.smithi062.stdout:7/147: creat d0/d12/f24 x:0 0 0 2024-05-09T06:29:48.740 INFO:tasks.workunit.client.0.smithi062.stdout:7/148: truncate d0/f4 2297694 0 2024-05-09T06:29:48.741 INFO:tasks.workunit.client.0.smithi062.stdout:0/74: link d1/l4 d1/d18/l1a 0 2024-05-09T06:29:48.745 INFO:tasks.workunit.client.0.smithi062.stdout:7/149: dread d0/f8 [0,4194304] 0 2024-05-09T06:29:48.749 INFO:tasks.workunit.client.0.smithi062.stdout:7/150: symlink d0/d3/l25 0 2024-05-09T06:29:48.749 INFO:tasks.workunit.client.0.smithi062.stdout:7/151: dread - d0/f1e zero size 2024-05-09T06:29:48.749 INFO:tasks.workunit.client.0.smithi062.stdout:7/152: write d0/f20 [513387,80309] 0 2024-05-09T06:29:48.750 INFO:tasks.workunit.client.0.smithi062.stdout:0/75: dread d1/f11 [0,4194304] 0 2024-05-09T06:29:48.750 INFO:tasks.workunit.client.0.smithi062.stdout:4/116: link d0/d9/c11 d0/d9/c21 0 2024-05-09T06:29:48.753 INFO:tasks.workunit.client.0.smithi062.stdout:4/117: creat d0/d2/d1f/f22 x:0 0 0 2024-05-09T06:29:48.764 INFO:tasks.workunit.client.0.smithi062.stdout:4/118: read d0/f1e [1561232,96957] 0 2024-05-09T06:29:48.764 INFO:tasks.workunit.client.0.smithi062.stdout:4/119: write d0/d2/f5 [1831402,115510] 0 2024-05-09T06:29:48.764 INFO:tasks.workunit.client.0.smithi062.stdout:4/120: fsync d0/d2/f1d 0 2024-05-09T06:29:48.765 INFO:tasks.workunit.client.0.smithi062.stdout:4/121: chown d0/d2/d8/df/f16 0 1 2024-05-09T06:29:48.765 INFO:tasks.workunit.client.0.smithi062.stdout:4/122: mknod d0/d2/d8/c23 0 2024-05-09T06:29:48.766 INFO:tasks.workunit.client.0.smithi062.stdout:4/123: mkdir d0/d24 0 2024-05-09T06:29:48.766 INFO:tasks.workunit.client.0.smithi062.stdout:4/124: write d0/f1e [887574,49162] 0 2024-05-09T06:29:48.770 INFO:tasks.workunit.client.0.smithi062.stdout:4/125: dread d0/d2/f4 [0,4194304] 0 2024-05-09T06:29:48.781 INFO:tasks.workunit.client.0.smithi062.stdout:7/153: dwrite d0/d12/f24 [0,4194304] 0 2024-05-09T06:29:48.781 INFO:tasks.workunit.client.0.smithi062.stdout:0/76: dwrite d1/fd [0,4194304] 0 2024-05-09T06:29:48.786 INFO:tasks.workunit.client.0.smithi062.stdout:7/154: rename d0/c1d to d0/d12/c26 0 2024-05-09T06:29:48.786 INFO:tasks.workunit.client.0.smithi062.stdout:7/155: truncate d0/d22/f23 716481 0 2024-05-09T06:29:48.786 INFO:tasks.workunit.client.0.smithi062.stdout:7/156: fdatasync d0/d3/f17 0 2024-05-09T06:29:48.791 INFO:tasks.workunit.client.0.smithi062.stdout:0/77: creat d1/f1b x:0 0 0 2024-05-09T06:29:48.797 INFO:tasks.workunit.client.0.smithi062.stdout:4/126: dwrite d0/d2/f5 [0,4194304] 0 2024-05-09T06:29:48.811 INFO:tasks.workunit.client.0.smithi062.stdout:7/157: dwrite d0/d3/f1f [0,4194304] 0 2024-05-09T06:29:48.813 INFO:tasks.workunit.client.0.smithi062.stdout:7/158: symlink d0/d3/l27 0 2024-05-09T06:29:48.813 INFO:tasks.workunit.client.0.smithi062.stdout:7/159: stat d0/d3/l19 0 2024-05-09T06:29:48.818 INFO:tasks.workunit.client.0.smithi062.stdout:0/78: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:48.818 INFO:tasks.workunit.client.0.smithi062.stdout:0/79: chown d1/f16 56 1 2024-05-09T06:29:48.818 INFO:tasks.workunit.client.0.smithi062.stdout:4/127: dwrite d0/d2/f6 [0,4194304] 0 2024-05-09T06:29:48.820 INFO:tasks.workunit.client.0.smithi062.stdout:0/80: truncate d1/fd 3650919 0 2024-05-09T06:29:48.821 INFO:tasks.workunit.client.0.smithi062.stdout:0/81: dread - d1/f1b zero size 2024-05-09T06:29:48.821 INFO:tasks.workunit.client.0.smithi062.stdout:0/82: dread - d1/fc zero size 2024-05-09T06:29:48.824 INFO:tasks.workunit.client.0.smithi062.stdout:7/160: dread d0/d3/f17 [0,4194304] 0 2024-05-09T06:29:48.824 INFO:tasks.workunit.client.0.smithi062.stdout:7/161: write d0/f1e [1579551,46340] 0 2024-05-09T06:29:48.828 INFO:tasks.workunit.client.0.smithi062.stdout:0/83: getdents d1 0 2024-05-09T06:29:48.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:48 smithi079 ceph-mon[35268]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:48.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:48 smithi079 ceph-mon[35268]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:48.857 INFO:tasks.workunit.client.0.smithi062.stdout:4/128: dwrite d0/f1e [4194304,4194304] 0 2024-05-09T06:29:48.858 INFO:tasks.workunit.client.0.smithi062.stdout:7/162: dwrite d0/d3/f1f [0,4194304] 0 2024-05-09T06:29:48.858 INFO:tasks.workunit.client.0.smithi062.stdout:7/163: creat d0/f28 x:0 0 0 2024-05-09T06:29:48.858 INFO:tasks.workunit.client.0.smithi062.stdout:0/84: dwrite d1/f11 [0,4194304] 0 2024-05-09T06:29:48.860 INFO:tasks.workunit.client.0.smithi062.stdout:4/129: creat d0/d2/f25 x:0 0 0 2024-05-09T06:29:48.860 INFO:tasks.workunit.client.0.smithi062.stdout:4/130: read - d0/d2/f1d zero size 2024-05-09T06:29:48.865 INFO:tasks.workunit.client.0.smithi062.stdout:7/164: link d0/d3/l9 d0/d12/l29 0 2024-05-09T06:29:48.866 INFO:tasks.workunit.client.0.smithi062.stdout:7/165: write d0/f28 [448558,27331] 0 2024-05-09T06:29:48.875 INFO:tasks.workunit.client.0.smithi062.stdout:4/131: dwrite d0/d2/f4 [0,4194304] 0 2024-05-09T06:29:48.875 INFO:tasks.workunit.client.0.smithi062.stdout:7/166: truncate d0/f1e 867688 0 2024-05-09T06:29:48.879 INFO:tasks.workunit.client.0.smithi062.stdout:7/167: read d0/d3/f17 [875315,102030] 0 2024-05-09T06:29:48.879 INFO:tasks.workunit.client.0.smithi062.stdout:7/168: creat d0/d3/f2a x:0 0 0 2024-05-09T06:29:48.880 INFO:tasks.workunit.client.0.smithi062.stdout:7/169: creat d0/d3/f2b x:0 0 0 2024-05-09T06:29:48.886 INFO:tasks.workunit.client.0.smithi062.stdout:7/170: unlink d0/d3/f5 0 2024-05-09T06:29:48.886 INFO:tasks.workunit.client.0.smithi062.stdout:7/171: chown d0/d12/c1c 1634536820 1 2024-05-09T06:29:48.886 INFO:tasks.workunit.client.0.smithi062.stdout:7/172: write d0/d3/f17 [891074,41146] 0 2024-05-09T06:29:48.886 INFO:tasks.workunit.client.0.smithi062.stdout:7/173: creat d0/f2c x:0 0 0 2024-05-09T06:29:48.886 INFO:tasks.workunit.client.0.smithi062.stdout:4/132: read d0/d2/f6 [91128,98168] 0 2024-05-09T06:29:48.891 INFO:tasks.workunit.client.0.smithi062.stdout:4/133: creat d0/d2/d14/f26 x:0 0 0 2024-05-09T06:29:48.899 INFO:tasks.workunit.client.0.smithi062.stdout:4/134: dread d0/f1e [4194304,4194304] 0 2024-05-09T06:29:48.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:48 smithi062 ceph-mon[26920]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:48.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:48 smithi062 ceph-mon[26920]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:48.913 INFO:tasks.workunit.client.0.smithi062.stdout:4/135: dwrite d0/d2/d14/f26 [0,4194304] 0 2024-05-09T06:29:48.921 INFO:tasks.workunit.client.0.smithi062.stdout:4/136: dread d0/d2/d14/f26 [0,4194304] 0 2024-05-09T06:29:48.922 INFO:tasks.workunit.client.0.smithi062.stdout:4/137: creat d0/d2/d8/f27 x:0 0 0 2024-05-09T06:29:48.922 INFO:tasks.workunit.client.0.smithi062.stdout:4/138: write d0/d2/d8/f27 [673865,29022] 0 2024-05-09T06:29:48.947 INFO:tasks.workunit.client.0.smithi062.stdout:2/34: sync 2024-05-09T06:29:48.950 INFO:tasks.workunit.client.0.smithi062.stdout:2/35: mkdir d0/d9 0 2024-05-09T06:29:48.950 INFO:tasks.workunit.client.0.smithi062.stdout:2/36: write d0/f3 [4568640,2123] 0 2024-05-09T06:29:48.950 INFO:tasks.workunit.client.0.smithi062.stdout:2/37: creat d0/fa x:0 0 0 2024-05-09T06:29:48.951 INFO:tasks.workunit.client.0.smithi062.stdout:2/38: mknod d0/d9/cb 0 2024-05-09T06:29:48.951 INFO:tasks.workunit.client.0.smithi062.stdout:2/39: chown d0/d9 5033 1 2024-05-09T06:29:48.952 INFO:tasks.workunit.client.0.smithi062.stdout:2/40: mknod d0/d9/cc 0 2024-05-09T06:29:48.952 INFO:tasks.workunit.client.0.smithi062.stdout:2/41: write d0/fa [904048,122831] 0 2024-05-09T06:29:48.954 INFO:tasks.workunit.client.0.smithi062.stdout:2/42: unlink d0/d9/cb 0 2024-05-09T06:29:48.955 INFO:tasks.workunit.client.0.smithi062.stdout:2/43: mkdir d0/d9/dd 0 2024-05-09T06:29:48.958 INFO:tasks.workunit.client.0.smithi062.stdout:2/44: mknod d0/ce 0 2024-05-09T06:29:48.965 INFO:tasks.workunit.client.0.smithi062.stdout:2/45: fsync d0/fa 0 2024-05-09T06:29:48.973 INFO:tasks.workunit.client.0.smithi062.stdout:2/46: dread d0/f6 [0,4194304] 0 2024-05-09T06:29:48.981 INFO:tasks.workunit.client.0.smithi062.stdout:2/47: dread d0/f3 [0,4194304] 0 2024-05-09T06:29:48.983 INFO:tasks.workunit.client.0.smithi062.stdout:2/48: rename d0/d9/cc to d0/d9/dd/cf 0 2024-05-09T06:29:48.988 INFO:tasks.workunit.client.0.smithi062.stdout:2/49: dread d0/f6 [0,4194304] 0 2024-05-09T06:29:48.992 INFO:tasks.workunit.client.0.smithi062.stdout:2/50: dread d0/f3 [0,4194304] 0 2024-05-09T06:29:48.998 INFO:tasks.workunit.client.0.smithi062.stdout:2/51: mkdir d0/d10 0 2024-05-09T06:29:49.000 INFO:tasks.workunit.client.0.smithi062.stdout:2/52: dread d0/fa [0,4194304] 0 2024-05-09T06:29:49.000 INFO:tasks.workunit.client.0.smithi062.stdout:2/53: chown d0 648 1 2024-05-09T06:29:49.008 INFO:tasks.workunit.client.0.smithi062.stdout:2/54: mknod d0/c11 0 2024-05-09T06:29:49.011 INFO:tasks.workunit.client.0.smithi062.stdout:2/55: creat d0/d9/f12 x:0 0 0 2024-05-09T06:29:49.013 INFO:tasks.workunit.client.0.smithi062.stdout:2/56: rename d0/d9/dd/cf to d0/d10/c13 0 2024-05-09T06:29:49.013 INFO:tasks.workunit.client.0.smithi062.stdout:2/57: chown d0/l8 2 1 2024-05-09T06:29:49.037 INFO:tasks.workunit.client.0.smithi062.stdout:2/58: dwrite d0/f3 [0,4194304] 0 2024-05-09T06:29:49.061 INFO:tasks.workunit.client.0.smithi062.stdout:2/59: dwrite d0/f3 [0,4194304] 0 2024-05-09T06:29:49.062 INFO:tasks.workunit.client.0.smithi062.stdout:2/60: symlink d0/d9/l14 0 2024-05-09T06:29:49.062 INFO:tasks.workunit.client.0.smithi062.stdout:2/61: fsync d0/d9/f12 0 2024-05-09T06:29:49.062 INFO:tasks.workunit.client.0.smithi062.stdout:2/62: stat d0/d9/l14 0 2024-05-09T06:29:49.062 INFO:tasks.workunit.client.0.smithi062.stdout:2/63: chown d0/ce 126148 1 2024-05-09T06:29:49.070 INFO:tasks.workunit.client.0.smithi062.stdout:2/64: truncate d0/f3 3448089 0 2024-05-09T06:29:49.071 INFO:tasks.workunit.client.0.smithi062.stdout:2/65: creat d0/f15 x:0 0 0 2024-05-09T06:29:49.071 INFO:tasks.workunit.client.0.smithi062.stdout:2/66: write d0/d9/f12 [408943,117994] 0 2024-05-09T06:29:49.072 INFO:tasks.workunit.client.0.smithi062.stdout:2/67: write d0/fa [1419994,103700] 0 2024-05-09T06:29:49.072 INFO:tasks.workunit.client.0.smithi062.stdout:2/68: chown d0/d10/c13 70952753 1 2024-05-09T06:29:49.083 INFO:tasks.workunit.client.0.smithi062.stdout:8/77: sync 2024-05-09T06:29:49.083 INFO:tasks.workunit.client.0.smithi062.stdout:3/82: sync 2024-05-09T06:29:49.083 INFO:tasks.workunit.client.0.smithi062.stdout:9/189: sync 2024-05-09T06:29:49.083 INFO:tasks.workunit.client.0.smithi062.stdout:3/83: stat d1/dd/d18 0 2024-05-09T06:29:49.086 INFO:tasks.workunit.client.0.smithi062.stdout:9/190: rename d3/d40 to d3/d3e/d4b 0 2024-05-09T06:29:49.086 INFO:tasks.workunit.client.0.smithi062.stdout:9/191: chown d3/d1a/f48 137646 1 2024-05-09T06:29:49.088 INFO:tasks.workunit.client.0.smithi062.stdout:3/84: truncate d1/dd/f10 194606 0 2024-05-09T06:29:49.088 INFO:tasks.workunit.client.0.smithi062.stdout:3/85: readlink d1/l11 0 2024-05-09T06:29:49.088 INFO:tasks.workunit.client.0.smithi062.stdout:3/86: readlink d1/l9 0 2024-05-09T06:29:49.088 INFO:tasks.workunit.client.0.smithi062.stdout:3/87: readlink d1/la 0 2024-05-09T06:29:49.088 INFO:tasks.workunit.client.0.smithi062.stdout:3/88: chown d1/c12 0 1 2024-05-09T06:29:49.090 INFO:tasks.workunit.client.0.smithi062.stdout:8/78: rmdir da 39 2024-05-09T06:29:49.090 INFO:tasks.workunit.client.0.smithi062.stdout:8/79: fdatasync f6 0 2024-05-09T06:29:49.093 INFO:tasks.workunit.client.0.smithi062.stdout:2/69: dwrite d0/f6 [0,4194304] 0 2024-05-09T06:29:49.094 INFO:tasks.workunit.client.0.smithi062.stdout:9/192: creat d3/d1a/d1c/d1e/f4c x:0 0 0 2024-05-09T06:29:49.096 INFO:tasks.workunit.client.0.smithi062.stdout:8/80: mknod da/c15 0 2024-05-09T06:29:49.096 INFO:tasks.workunit.client.0.smithi062.stdout:3/89: write d1/dd/f10 [753051,47119] 0 2024-05-09T06:29:49.098 INFO:tasks.workunit.client.0.smithi062.stdout:3/90: write d1/f3 [1343146,40269] 0 2024-05-09T06:29:49.102 INFO:tasks.workunit.client.0.smithi062.stdout:2/70: unlink d0/d9/f12 0 2024-05-09T06:29:49.107 INFO:tasks.workunit.client.0.smithi062.stdout:9/193: symlink d3/d1a/l4d 0 2024-05-09T06:29:49.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.127+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f235804bed0 con 0x7f23580fff70 2024-05-09T06:29:49.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.127+0000 7f2346ffd700 1 -- 172.21.15.62:0/2471593511 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f234c061140 con 0x7f23580fff70 2024-05-09T06:29:49.109 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:29:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:29:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:29:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:29:49.109 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:29:49.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:29:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:29:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 13, 2024-05-09T06:29:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:29:49.111 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:29:49.111 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.129+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2340070aa0 msgr2=0x7f2340072f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.129+0000 7f235c812700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2340070aa0 0x7f2340072f50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2348009b80 tx=0x7f234800b040 comp rx=0 tx=0).stop 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.129+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 msgr2=0x7f235810df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.129+0000 7f235c812700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 0x7f235810df30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f234c013870 tx=0x7f234c009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.130+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 shutdown_connections 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.130+0000 7f235c812700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7f2340070aa0 0x7f2340072f50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.130+0000 7f235c812700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2358066b50 0x7f235810d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.130+0000 7f235c812700 1 --2- 172.21.15.62:0/2471593511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23580fff70 0x7f235810df30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.130+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 >> 172.21.15.62:0/2471593511 conn(0x7f23580f74c0 msgr2=0x7f23580f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.130+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 shutdown_connections 2024-05-09T06:29:49.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.130+0000 7f235c812700 1 -- 172.21.15.62:0/2471593511 wait complete. 2024-05-09T06:29:49.113 INFO:tasks.workunit.client.0.smithi062.stdout:3/91: rmdir d1/dd/d18 0 2024-05-09T06:29:49.113 INFO:tasks.workunit.client.0.smithi062.stdout:3/92: rename d1 to d1/dd/d19 22 2024-05-09T06:29:49.113 INFO:tasks.workunit.client.0.smithi062.stdout:3/93: creat d1/dd/f1a x:0 0 0 2024-05-09T06:29:49.116 INFO:tasks.workunit.client.0.smithi062.stdout:9/194: symlink d3/l4e 0 2024-05-09T06:29:49.122 INFO:tasks.workunit.client.0.smithi062.stdout:9/195: creat d3/d1a/d1c/d1e/d41/f4f x:0 0 0 2024-05-09T06:29:49.122 INFO:tasks.workunit.client.0.smithi062.stdout:9/196: write d3/f5 [987704,56343] 0 2024-05-09T06:29:49.127 INFO:tasks.workunit.client.0.smithi062.stdout:9/197: read d3/d1a/d1c/f26 [4026576,87335] 0 2024-05-09T06:29:49.128 INFO:tasks.workunit.client.0.smithi062.stdout:3/94: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:29:49.128 INFO:tasks.workunit.client.0.smithi062.stdout:3/95: creat d1/f1b x:0 0 0 2024-05-09T06:29:49.128 INFO:tasks.workunit.client.0.smithi062.stdout:9/198: rename d3/c15 to d3/d3e/d4b/c50 0 2024-05-09T06:29:49.145 INFO:tasks.workunit.client.0.smithi062.stdout:9/199: dwrite d3/d1a/d1c/d2b/f2c [0,4194304] 0 2024-05-09T06:29:49.151 INFO:tasks.workunit.client.0.smithi062.stdout:9/200: creat d3/d3e/d4b/f51 x:0 0 0 2024-05-09T06:29:49.171 INFO:tasks.workunit.client.0.smithi062.stdout:9/201: dwrite d3/f19 [0,4194304] 0 2024-05-09T06:29:49.176 INFO:tasks.workunit.client.0.smithi062.stdout:9/202: mkdir d3/d3e/d52 0 2024-05-09T06:29:49.177 INFO:tasks.workunit.client.0.smithi062.stdout:9/203: chown d3/d1a/d1c/c28 171823 1 2024-05-09T06:29:49.178 INFO:tasks.workunit.client.0.smithi062.stdout:9/204: creat d3/d1a/d1c/d21/f53 x:0 0 0 2024-05-09T06:29:49.196 INFO:tasks.workunit.client.0.smithi062.stdout:9/205: dwrite d3/f18 [0,4194304] 0 2024-05-09T06:29:49.196 INFO:tasks.workunit.client.0.smithi062.stdout:9/206: readlink d3/lf 0 2024-05-09T06:29:49.205 INFO:tasks.workunit.client.0.smithi062.stdout:9/207: write d3/d1a/f35 [3725623,19869] 0 2024-05-09T06:29:49.231 INFO:tasks.workunit.client.0.smithi062.stdout:5/56: sync 2024-05-09T06:29:49.231 INFO:tasks.workunit.client.0.smithi062.stdout:6/102: sync 2024-05-09T06:29:49.231 INFO:tasks.workunit.client.0.smithi062.stdout:6/103: getdents dc/de/d10/d20 0 2024-05-09T06:29:49.231 INFO:tasks.workunit.client.0.smithi062.stdout:6/104: creat dc/de/f22 x:0 0 0 2024-05-09T06:29:49.238 INFO:tasks.workunit.client.0.smithi062.stdout:5/57: link d0/d4/l9 d0/d11/l16 0 2024-05-09T06:29:49.239 INFO:tasks.workunit.client.0.smithi062.stdout:6/105: mknod dc/de/d10/d20/c23 0 2024-05-09T06:29:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.259+0000 7fe839932700 1 -- 172.21.15.62:0/2107434264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8340fff20 msgr2=0x7fe834102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.259+0000 7fe839932700 1 --2- 172.21.15.62:0/2107434264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8340fff20 0x7fe834102300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe828004940 tx=0x7fe828009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.259+0000 7fe839932700 1 -- 172.21.15.62:0/2107434264 shutdown_connections 2024-05-09T06:29:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.259+0000 7fe839932700 1 --2- 172.21.15.62:0/2107434264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8340fff20 0x7fe834102300 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.259+0000 7fe839932700 1 --2- 172.21.15.62:0/2107434264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe834066280 0x7fe8340ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.259+0000 7fe839932700 1 -- 172.21.15.62:0/2107434264 >> 172.21.15.62:0/2107434264 conn(0x7fe8340f7430 msgr2=0x7fe8340f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:49.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.259+0000 7fe839932700 1 -- 172.21.15.62:0/2107434264 shutdown_connections 2024-05-09T06:29:49.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.259+0000 7fe839932700 1 -- 172.21.15.62:0/2107434264 wait complete. 2024-05-09T06:29:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe839932700 1 Processor -- start 2024-05-09T06:29:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe839932700 1 -- start start 2024-05-09T06:29:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe839932700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe834066280 0x7fe8340fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe839932700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8340fff20 0x7fe8340fb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:49.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe839932700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8340fbe70 con 0x7fe834066280 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe839932700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8340fbfb0 con 0x7fe8340fff20 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe834066280 0x7fe8340fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe834066280 0x7fe8340fd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45712/0 (socket says 172.21.15.62:45712) 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe832ffd700 1 -- 172.21.15.62:0/3288561396 learned_addr learned my addr 172.21.15.62:0/3288561396 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.260+0000 7fe8327fc700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8340fff20 0x7fe8340fb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe832ffd700 1 -- 172.21.15.62:0/3288561396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8340fff20 msgr2=0x7fe8340fb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe832ffd700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8340fff20 0x7fe8340fb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe832ffd700 1 -- 172.21.15.62:0/3288561396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828005040 con 0x7fe834066280 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe832ffd700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe834066280 0x7fe8340fd3c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe82400eb40 tx=0x7fe82400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe81b7fe700 1 -- 172.21.15.62:0/3288561396 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe824007cc0 con 0x7fe834066280 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe81b7fe700 1 -- 172.21.15.62:0/3288561396 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe82400f040 con 0x7fe834066280 2024-05-09T06:29:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8340fc230 con 0x7fe834066280 2024-05-09T06:29:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe81b7fe700 1 -- 172.21.15.62:0/3288561396 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe82400caa0 con 0x7fe834066280 2024-05-09T06:29:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.261+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8340fc740 con 0x7fe834066280 2024-05-09T06:29:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.262+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8341060c0 con 0x7fe834066280 2024-05-09T06:29:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.263+0000 7fe81b7fe700 1 -- 172.21.15.62:0/3288561396 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 20) v1 ==== 93219+0+0 (secure 0 0 0) 0x7fe82400cc00 con 0x7fe834066280 2024-05-09T06:29:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.263+0000 7fe81b7fe700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe81c070aa0 0x7fe81c072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.263+0000 7fe81b7fe700 1 -- 172.21.15.62:0/3288561396 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe8240900f0 con 0x7fe834066280 2024-05-09T06:29:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.263+0000 7fe8327fc700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe81c070aa0 0x7fe81c072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:49.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.264+0000 7fe8327fc700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe81c070aa0 0x7fe81c072f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe828009b30 tx=0x7fe828009e30 comp rx=0 tx=0).ready entity=mgr.14224 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:49.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.268+0000 7fe81b7fe700 1 -- 172.21.15.62:0/3288561396 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe82405c420 con 0x7fe834066280 2024-05-09T06:29:49.304 INFO:tasks.workunit.client.0.smithi062.stdout:5/58: mkdir d0/d4/d17 0 2024-05-09T06:29:49.305 INFO:tasks.workunit.client.0.smithi062.stdout:6/106: rename fa to dc/de/f24 0 2024-05-09T06:29:49.309 INFO:tasks.workunit.client.0.smithi062.stdout:5/59: dread d0/d4/f12 [0,4194304] 0 2024-05-09T06:29:49.309 INFO:tasks.workunit.client.0.smithi062.stdout:5/60: readlink d0/d4/d5/l10 0 2024-05-09T06:29:49.312 INFO:tasks.workunit.client.0.smithi062.stdout:6/107: rename c2 to dc/de/d10/d20/c25 0 2024-05-09T06:29:49.313 INFO:tasks.workunit.client.0.smithi062.stdout:6/108: mkdir dc/de/d10/d1a/d26 0 2024-05-09T06:29:49.329 INFO:tasks.workunit.client.0.smithi062.stdout:6/109: dwrite dc/de/f11 [0,4194304] 0 2024-05-09T06:29:49.332 INFO:tasks.workunit.client.0.smithi062.stdout:6/110: creat dc/de/d10/d1a/d26/f27 x:0 0 0 2024-05-09T06:29:49.341 INFO:tasks.workunit.client.0.smithi062.stdout:6/111: dread dc/f13 [0,4194304] 0 2024-05-09T06:29:49.350 INFO:tasks.workunit.client.0.smithi062.stdout:6/112: rename dc/de to dc/d28 0 2024-05-09T06:29:49.352 INFO:tasks.workunit.client.0.smithi062.stdout:6/113: dread f4 [0,4194304] 0 2024-05-09T06:29:49.352 INFO:tasks.workunit.client.0.smithi062.stdout:6/114: fdatasync dc/ff 0 2024-05-09T06:29:49.353 INFO:tasks.workunit.client.0.smithi062.stdout:6/115: creat dc/d28/d10/d1a/f29 x:0 0 0 2024-05-09T06:29:49.353 INFO:tasks.workunit.client.0.smithi062.stdout:6/116: write dc/d28/d10/f1c [5726,89842] 0 2024-05-09T06:29:49.354 INFO:tasks.workunit.client.0.smithi062.stdout:6/117: rename fb to dc/f2a 0 2024-05-09T06:29:49.356 INFO:tasks.workunit.client.0.smithi062.stdout:6/118: creat dc/d28/d10/d1a/d26/f2b x:0 0 0 2024-05-09T06:29:49.357 INFO:tasks.workunit.client.0.smithi062.stdout:6/119: link dc/d28/f14 dc/d28/d10/f2c 0 2024-05-09T06:29:49.360 INFO:tasks.workunit.client.0.smithi062.stdout:6/120: rename dc/d28/l1e to dc/l2d 0 2024-05-09T06:29:49.360 INFO:tasks.workunit.client.0.smithi062.stdout:6/121: read dc/d28/d10/f18 [564261,109298] 0 2024-05-09T06:29:49.363 INFO:tasks.workunit.client.0.smithi062.stdout:7/174: sync 2024-05-09T06:29:49.363 INFO:tasks.workunit.client.0.smithi062.stdout:4/139: sync 2024-05-09T06:29:49.363 INFO:tasks.workunit.client.0.smithi062.stdout:0/85: sync 2024-05-09T06:29:49.363 INFO:tasks.workunit.client.0.smithi062.stdout:4/140: readlink d0/l1 0 2024-05-09T06:29:49.363 INFO:tasks.workunit.client.0.smithi062.stdout:7/175: creat d0/d3/f2d x:0 0 0 2024-05-09T06:29:49.363 INFO:tasks.workunit.client.0.smithi062.stdout:7/176: write d0/d3/f2a [279514,39455] 0 2024-05-09T06:29:49.363 INFO:tasks.workunit.client.0.smithi062.stdout:0/86: write d1/f17 [699075,76154] 0 2024-05-09T06:29:49.364 INFO:tasks.workunit.client.0.smithi062.stdout:4/141: write d0/d2/d8/df/f16 [4809604,106572] 0 2024-05-09T06:29:49.364 INFO:tasks.workunit.client.0.smithi062.stdout:1/73: sync 2024-05-09T06:29:49.371 INFO:tasks.workunit.client.0.smithi062.stdout:6/122: link dc/l2d dc/d28/d10/d1a/d26/l2e 0 2024-05-09T06:29:49.374 INFO:tasks.workunit.client.0.smithi062.stdout:0/87: symlink d1/d18/l1c 0 2024-05-09T06:29:49.375 INFO:tasks.workunit.client.0.smithi062.stdout:4/142: unlink d0/d9/c11 0 2024-05-09T06:29:49.377 INFO:tasks.workunit.client.0.smithi062.stdout:1/74: creat d8/d14/f17 x:0 0 0 2024-05-09T06:29:49.377 INFO:tasks.workunit.client.0.smithi062.stdout:1/75: fsync f5 0 2024-05-09T06:29:49.382 INFO:tasks.workunit.client.0.smithi062.stdout:6/123: symlink dc/d28/d10/l2f 0 2024-05-09T06:29:49.384 INFO:tasks.workunit.client.0.smithi062.stdout:7/177: getdents d0/d12 0 2024-05-09T06:29:49.384 INFO:tasks.workunit.client.0.smithi062.stdout:7/178: dread - d0/f1b zero size 2024-05-09T06:29:49.385 INFO:tasks.workunit.client.0.smithi062.stdout:0/88: creat d1/d18/f1d x:0 0 0 2024-05-09T06:29:49.388 INFO:tasks.workunit.client.0.smithi062.stdout:4/143: mkdir d0/d2/d8/df/d28 0 2024-05-09T06:29:49.393 INFO:tasks.workunit.client.0.smithi062.stdout:1/76: rename d8/lb to d8/d14/l18 0 2024-05-09T06:29:49.395 INFO:tasks.workunit.client.0.smithi062.stdout:6/124: unlink dc/d28/d10/d20/c25 0 2024-05-09T06:29:49.395 INFO:tasks.workunit.client.0.smithi062.stdout:6/125: truncate dc/ff 4605878 0 2024-05-09T06:29:49.398 INFO:tasks.workunit.client.0.smithi062.stdout:7/179: mknod d0/d12/c2e 0 2024-05-09T06:29:49.399 INFO:tasks.workunit.client.0.smithi062.stdout:0/89: mknod d1/c1e 0 2024-05-09T06:29:49.404 INFO:tasks.workunit.client.0.smithi062.stdout:4/144: chown d0/d9/l1c 517719807 1 2024-05-09T06:29:49.406 INFO:tasks.workunit.client.0.smithi062.stdout:0/90: dread d1/f17 [0,4194304] 0 2024-05-09T06:29:49.409 INFO:tasks.workunit.client.0.smithi062.stdout:1/77: mknod d8/c19 0 2024-05-09T06:29:49.409 INFO:tasks.workunit.client.0.smithi062.stdout:1/78: dread - d8/d14/f17 zero size 2024-05-09T06:29:49.411 INFO:tasks.workunit.client.0.smithi062.stdout:6/126: symlink dc/d28/d10/d1a/d26/l30 0 2024-05-09T06:29:49.412 INFO:tasks.workunit.client.0.smithi062.stdout:7/180: getdents d0/d12 0 2024-05-09T06:29:49.416 INFO:tasks.workunit.client.0.smithi062.stdout:7/181: dread d0/d3/fd [0,4194304] 0 2024-05-09T06:29:49.416 INFO:tasks.workunit.client.0.smithi062.stdout:7/182: fsync d0/d3/f17 0 2024-05-09T06:29:49.417 INFO:tasks.workunit.client.0.smithi062.stdout:7/183: write d0/d3/f2a [519227,96599] 0 2024-05-09T06:29:49.417 INFO:tasks.workunit.client.0.smithi062.stdout:7/184: write d0/f8 [2781457,120939] 0 2024-05-09T06:29:49.417 INFO:tasks.workunit.client.0.smithi062.stdout:7/185: fdatasync d0/f1b 0 2024-05-09T06:29:49.417 INFO:tasks.workunit.client.0.smithi062.stdout:4/145: mknod d0/d2/d14/c29 0 2024-05-09T06:29:49.421 INFO:tasks.workunit.client.0.smithi062.stdout:0/91: unlink d1/c1e 0 2024-05-09T06:29:49.426 INFO:tasks.workunit.client.0.smithi062.stdout:1/79: creat d8/f1a x:0 0 0 2024-05-09T06:29:49.426 INFO:tasks.workunit.client.0.smithi062.stdout:1/80: chown f6 10 1 2024-05-09T06:29:49.426 INFO:tasks.workunit.client.0.smithi062.stdout:1/81: dread - d8/f1a zero size 2024-05-09T06:29:49.426 INFO:tasks.workunit.client.0.smithi062.stdout:1/82: write f5 [3033700,79622] 0 2024-05-09T06:29:49.426 INFO:tasks.workunit.client.0.smithi062.stdout:1/83: creat d8/d14/f1b x:0 0 0 2024-05-09T06:29:49.426 INFO:tasks.workunit.client.0.smithi062.stdout:1/84: chown d8 963283 1 2024-05-09T06:29:49.426 INFO:tasks.workunit.client.0.smithi062.stdout:6/127: creat dc/d28/d10/d20/f31 x:0 0 0 2024-05-09T06:29:49.427 INFO:tasks.workunit.client.0.smithi062.stdout:7/186: symlink d0/l2f 0 2024-05-09T06:29:49.432 INFO:tasks.workunit.client.0.smithi062.stdout:1/85: link d8/c9 d8/d14/c1c 0 2024-05-09T06:29:49.432 INFO:tasks.workunit.client.0.smithi062.stdout:1/86: read - d8/fe zero size 2024-05-09T06:29:49.434 INFO:tasks.workunit.client.0.smithi062.stdout:1/87: mkdir d8/d1d 0 2024-05-09T06:29:49.434 INFO:tasks.workunit.client.0.smithi062.stdout:1/88: readlink d8/l12 0 2024-05-09T06:29:49.436 INFO:tasks.workunit.client.0.smithi062.stdout:1/89: rename d8/fe to d8/d14/f1e 0 2024-05-09T06:29:49.437 INFO:tasks.workunit.client.0.smithi062.stdout:4/146: dwrite d0/d2/f4 [4194304,4194304] 0 2024-05-09T06:29:49.437 INFO:tasks.workunit.client.0.smithi062.stdout:1/90: mknod d8/d14/c1f 0 2024-05-09T06:29:49.443 INFO:tasks.workunit.client.0.smithi062.stdout:7/187: dread d0/d3/f1f [0,4194304] 0 2024-05-09T06:29:49.443 INFO:tasks.workunit.client.0.smithi062.stdout:7/188: stat d0/f1b 0 2024-05-09T06:29:49.450 INFO:tasks.workunit.client.0.smithi062.stdout:0/92: dwrite d1/f15 [0,4194304] 0 2024-05-09T06:29:49.454 INFO:tasks.workunit.client.0.smithi062.stdout:6/128: dwrite dc/d28/d10/d1a/d26/f27 [0,4194304] 0 2024-05-09T06:29:49.467 INFO:tasks.workunit.client.0.smithi062.stdout:7/189: dwrite d0/f20 [0,4194304] 0 2024-05-09T06:29:49.483 INFO:tasks.workunit.client.0.smithi062.stdout:7/190: read d0/d12/f24 [1807232,85289] 0 2024-05-09T06:29:49.484 INFO:tasks.workunit.client.0.smithi062.stdout:7/191: write d0/f1b [303462,90010] 0 2024-05-09T06:29:49.486 INFO:tasks.workunit.client.0.smithi062.stdout:6/129: dwrite dc/d28/f24 [0,4194304] 0 2024-05-09T06:29:49.486 INFO:tasks.workunit.client.0.smithi062.stdout:6/130: chown dc/d28/d10/d20/f31 353257 1 2024-05-09T06:29:49.487 INFO:tasks.workunit.client.0.smithi062.stdout:0/93: dwrite d1/f17 [0,4194304] 0 2024-05-09T06:29:49.487 INFO:tasks.workunit.client.0.smithi062.stdout:1/91: dwrite f5 [4194304,4194304] 0 2024-05-09T06:29:49.488 INFO:tasks.workunit.client.0.smithi062.stdout:1/92: chown f3 7863669 1 2024-05-09T06:29:49.494 INFO:tasks.workunit.client.0.smithi062.stdout:7/192: dread d0/f8 [0,4194304] 0 2024-05-09T06:29:49.513 INFO:tasks.workunit.client.0.smithi062.stdout:4/147: rename d0/d2 to d0/d2a 0 2024-05-09T06:29:49.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.588+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 --> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8340f8f20 con 0x7fe81c070aa0 2024-05-09T06:29:49.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.589+0000 7fe81b7fe700 1 -- 172.21.15.62:0/3288561396 <== mgr.14224 v2:172.21.15.62:6800/3998880457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fe8340f8f20 con 0x7fe81c070aa0 2024-05-09T06:29:49.571 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:29:49.571 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:29:49.571 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:29:49.571 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:29:49.572 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-05-09T06:29:49.572 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "1/2 daemons upgraded", 2024-05-09T06:29:49.572 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mgr daemons", 2024-05-09T06:29:49.572 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:29:49.572 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe81c070aa0 msgr2=0x7fe81c072f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe81c070aa0 0x7fe81c072f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe828009b30 tx=0x7fe828009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe834066280 msgr2=0x7fe8340fd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe834066280 0x7fe8340fd3c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe82400eb40 tx=0x7fe82400b040 comp rx=0 tx=0).stop 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 shutdown_connections 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:6800/3998880457,v1:172.21.15.62:6801/3998880457] conn(0x7fe81c070aa0 0x7fe81c072f50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe834066280 0x7fe8340fd3c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 --2- 172.21.15.62:0/3288561396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8340fff20 0x7fe8340fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 >> 172.21.15.62:0/3288561396 conn(0x7fe8340f7430 msgr2=0x7fe8340f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 shutdown_connections 2024-05-09T06:29:49.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:29:49.593+0000 7fe839932700 1 -- 172.21.15.62:0/3288561396 wait complete. 2024-05-09T06:29:49.591 INFO:tasks.workunit.client.0.smithi062.stdout:6/131: link dc/d28/d10/d1a/f29 dc/d28/d10/d20/f32 0 2024-05-09T06:29:49.591 INFO:tasks.workunit.client.0.smithi062.stdout:6/132: dread - dc/d28/d10/d20/f31 zero size 2024-05-09T06:29:49.591 INFO:tasks.workunit.client.0.smithi062.stdout:6/133: chown dc/ff 327037 1 2024-05-09T06:29:49.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/94: mknod d1/d18/c1f 0 2024-05-09T06:29:49.602 INFO:tasks.workunit.client.0.smithi062.stdout:1/93: mkdir d8/d14/d20 0 2024-05-09T06:29:49.612 INFO:tasks.workunit.client.0.smithi062.stdout:1/94: write f6 [4727308,58412] 0 2024-05-09T06:29:49.642 INFO:tasks.workunit.client.0.smithi062.stdout:7/193: creat d0/d12/f30 x:0 0 0 2024-05-09T06:29:49.642 INFO:tasks.workunit.client.0.smithi062.stdout:7/194: chown d0/d3 136703 1 2024-05-09T06:29:49.661 INFO:tasks.workunit.client.0.smithi062.stdout:8/81: sync 2024-05-09T06:29:49.661 INFO:tasks.workunit.client.0.smithi062.stdout:8/82: write f9 [561969,125689] 0 2024-05-09T06:29:49.661 INFO:tasks.workunit.client.0.smithi062.stdout:8/83: getdents da/d11 0 2024-05-09T06:29:49.684 INFO:tasks.workunit.client.0.smithi062.stdout:4/148: symlink d0/d2a/l2b 0 2024-05-09T06:29:49.693 INFO:tasks.workunit.client.0.smithi062.stdout:6/134: symlink dc/d28/d10/l33 0 2024-05-09T06:29:49.698 INFO:tasks.workunit.client.0.smithi062.stdout:6/135: dread dc/d28/d10/f2c [0,4194304] 0 2024-05-09T06:29:49.698 INFO:tasks.workunit.client.0.smithi062.stdout:6/136: stat dc/d28/l15 0 2024-05-09T06:29:49.698 INFO:tasks.workunit.client.0.smithi062.stdout:6/137: readlink dc/d28/l16 0 2024-05-09T06:29:49.699 INFO:tasks.workunit.client.0.smithi062.stdout:1/95: link d8/c19 d8/d14/c21 0 2024-05-09T06:29:49.703 INFO:tasks.workunit.client.0.smithi062.stdout:7/195: symlink d0/l31 0 2024-05-09T06:29:49.705 INFO:tasks.workunit.client.0.smithi062.stdout:8/84: truncate f7 2939 0 2024-05-09T06:29:49.712 INFO:tasks.workunit.client.0.smithi062.stdout:0/95: rename d1/f15 to d1/f20 0 2024-05-09T06:29:49.713 INFO:tasks.workunit.client.0.smithi062.stdout:7/196: link d0/f8 d0/d12/f32 0 2024-05-09T06:29:49.715 INFO:tasks.workunit.client.0.smithi062.stdout:8/85: read da/fe [3421853,114912] 0 2024-05-09T06:29:49.715 INFO:tasks.workunit.client.0.smithi062.stdout:8/86: readlink da/ld 0 2024-05-09T06:29:49.717 INFO:tasks.workunit.client.0.smithi062.stdout:0/96: mknod d1/d18/c21 0 2024-05-09T06:29:49.718 INFO:tasks.workunit.client.0.smithi062.stdout:8/87: creat da/d11/f16 x:0 0 0 2024-05-09T06:29:49.720 INFO:tasks.workunit.client.0.smithi062.stdout:7/197: dread d0/f1b [0,4194304] 0 2024-05-09T06:29:49.720 INFO:tasks.workunit.client.0.smithi062.stdout:7/198: write d0/f2c [732522,121952] 0 2024-05-09T06:29:49.720 INFO:tasks.workunit.client.0.smithi062.stdout:7/199: write d0/d12/f32 [2044609,79115] 0 2024-05-09T06:29:49.722 INFO:tasks.workunit.client.0.smithi062.stdout:8/88: rmdir da 39 2024-05-09T06:29:49.722 INFO:tasks.workunit.client.0.smithi062.stdout:8/89: chown da/f13 0 1 2024-05-09T06:29:49.722 INFO:tasks.workunit.client.0.smithi062.stdout:8/90: write da/d11/f12 [982114,11521] 0 2024-05-09T06:29:49.723 INFO:tasks.workunit.client.0.smithi062.stdout:8/91: stat f7 0 2024-05-09T06:29:49.726 INFO:tasks.workunit.client.0.smithi062.stdout:7/200: mkdir d0/d12/d33 0 2024-05-09T06:29:49.726 INFO:tasks.workunit.client.0.smithi062.stdout:7/201: write d0/f8 [4818230,34136] 0 2024-05-09T06:29:49.726 INFO:tasks.workunit.client.0.smithi062.stdout:7/202: creat d0/f34 x:0 0 0 2024-05-09T06:29:49.730 INFO:tasks.workunit.client.0.smithi062.stdout:6/138: dwrite dc/ff [0,4194304] 0 2024-05-09T06:29:49.731 INFO:tasks.workunit.client.0.smithi062.stdout:6/139: chown dc/d28/d10/d1a 255 1 2024-05-09T06:29:49.731 INFO:tasks.workunit.client.0.smithi062.stdout:1/96: dwrite d8/d14/f1b [0,4194304] 0 2024-05-09T06:29:49.731 INFO:tasks.workunit.client.0.smithi062.stdout:7/203: symlink d0/d12/l35 0 2024-05-09T06:29:49.739 INFO:tasks.workunit.client.0.smithi062.stdout:8/92: write da/fc [814810,128115] 0 2024-05-09T06:29:49.740 INFO:tasks.workunit.client.0.smithi062.stdout:8/93: write da/fe [663395,121866] 0 2024-05-09T06:29:49.740 INFO:tasks.workunit.client.0.smithi062.stdout:8/94: write da/f13 [831733,84020] 0 2024-05-09T06:29:49.743 INFO:tasks.workunit.client.0.smithi062.stdout:6/140: truncate dc/d28/f24 603401 0 2024-05-09T06:29:49.748 INFO:tasks.workunit.client.0.smithi062.stdout:8/95: getdents da 0 2024-05-09T06:29:49.749 INFO:tasks.workunit.client.0.smithi062.stdout:8/96: chown da/c15 813 1 2024-05-09T06:29:49.749 INFO:tasks.workunit.client.0.smithi062.stdout:8/97: dread - da/d11/f16 zero size 2024-05-09T06:29:49.749 INFO:tasks.workunit.client.0.smithi062.stdout:8/98: creat da/d11/f17 x:0 0 0 2024-05-09T06:29:49.750 INFO:tasks.workunit.client.0.smithi062.stdout:1/97: dwrite f5 [4194304,4194304] 0 2024-05-09T06:29:49.750 INFO:tasks.workunit.client.0.smithi062.stdout:1/98: write d8/f1a [559124,130379] 0 2024-05-09T06:29:49.754 INFO:tasks.workunit.client.0.smithi062.stdout:1/99: dread f7 [0,4194304] 0 2024-05-09T06:29:49.769 INFO:tasks.workunit.client.0.smithi062.stdout:1/100: dwrite d8/fc [0,4194304] 0 2024-05-09T06:29:49.775 INFO:tasks.workunit.client.0.smithi062.stdout:1/101: write f3 [3650237,22628] 0 2024-05-09T06:29:49.775 INFO:tasks.workunit.client.0.smithi062.stdout:1/102: readlink d8/d14/l18 0 2024-05-09T06:29:49.781 INFO:tasks.workunit.client.0.smithi062.stdout:1/103: dread d8/f1a [0,4194304] 0 2024-05-09T06:29:49.782 INFO:tasks.workunit.client.0.smithi062.stdout:1/104: fdatasync d8/d14/f1b 0 2024-05-09T06:29:49.782 INFO:tasks.workunit.client.0.smithi062.stdout:1/105: rename d8/d1d to d8/d1d/d22 22 2024-05-09T06:29:49.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:49 smithi079 ceph-mon[35268]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:49.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:49 smithi079 ceph-mon[35268]: pgmap v254: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 147 MiB/s rd, 189 MiB/s wr, 483 op/s 2024-05-09T06:29:49.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:49 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2471593511' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:29:49.783 INFO:tasks.workunit.client.0.smithi062.stdout:1/106: getdents d8 0 2024-05-09T06:29:49.785 INFO:tasks.workunit.client.0.smithi062.stdout:1/107: symlink d8/d14/l23 0 2024-05-09T06:29:49.806 INFO:tasks.workunit.client.0.smithi062.stdout:1/108: dwrite d8/d14/f17 [0,4194304] 0 2024-05-09T06:29:49.814 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:49 smithi062 ceph-mon[26920]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:49.814 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:49 smithi062 ceph-mon[26920]: pgmap v254: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 147 MiB/s rd, 189 MiB/s wr, 483 op/s 2024-05-09T06:29:49.814 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:49 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2471593511' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:29:49.831 INFO:tasks.workunit.client.0.smithi062.stdout:1/109: dwrite f5 [4194304,4194304] 0 2024-05-09T06:29:49.831 INFO:tasks.workunit.client.0.smithi062.stdout:1/110: chown d8/d14/l18 525075807 1 2024-05-09T06:29:49.835 INFO:tasks.workunit.client.0.smithi062.stdout:1/111: creat d8/d1d/f24 x:0 0 0 2024-05-09T06:29:49.835 INFO:tasks.workunit.client.0.smithi062.stdout:1/112: dread - d8/d1d/f24 zero size 2024-05-09T06:29:49.859 INFO:tasks.workunit.client.0.smithi062.stdout:2/71: sync 2024-05-09T06:29:49.859 INFO:tasks.workunit.client.0.smithi062.stdout:9/208: sync 2024-05-09T06:29:49.859 INFO:tasks.workunit.client.0.smithi062.stdout:5/61: sync 2024-05-09T06:29:49.861 INFO:tasks.workunit.client.0.smithi062.stdout:3/96: sync 2024-05-09T06:29:49.861 INFO:tasks.workunit.client.0.smithi062.stdout:3/97: creat d1/f1c x:0 0 0 2024-05-09T06:29:49.861 INFO:tasks.workunit.client.0.smithi062.stdout:3/98: creat d1/dd/f1d x:0 0 0 2024-05-09T06:29:49.864 INFO:tasks.workunit.client.0.smithi062.stdout:5/62: dread d0/d4/d5/f14 [0,4194304] 0 2024-05-09T06:29:49.875 INFO:tasks.workunit.client.0.smithi062.stdout:1/113: dwrite f7 [4194304,4194304] 0 2024-05-09T06:29:49.877 INFO:tasks.workunit.client.0.smithi062.stdout:1/114: write d8/f13 [482818,89568] 0 2024-05-09T06:29:49.889 INFO:tasks.workunit.client.0.smithi062.stdout:1/115: read d8/d14/f1b [1424121,96374] 0 2024-05-09T06:29:49.889 INFO:tasks.workunit.client.0.smithi062.stdout:1/116: chown d8/d14 0 1 2024-05-09T06:29:49.894 INFO:tasks.workunit.client.0.smithi062.stdout:3/99: truncate d1/dd/ff 4587857 0 2024-05-09T06:29:49.950 INFO:tasks.workunit.client.0.smithi062.stdout:2/72: rmdir d0/d9 39 2024-05-09T06:29:49.958 INFO:tasks.workunit.client.0.smithi062.stdout:5/63: rename d0/d4/d17 to d0/d8/d18 0 2024-05-09T06:29:49.959 INFO:tasks.workunit.client.0.smithi062.stdout:5/64: write d0/d4/d5/f14 [677657,44472] 0 2024-05-09T06:29:49.968 INFO:tasks.workunit.client.0.smithi062.stdout:9/209: getdents d3/d1a/d1c/d1e 0 2024-05-09T06:29:49.977 INFO:tasks.workunit.client.0.smithi062.stdout:1/117: unlink d8/d14/l15 0 2024-05-09T06:29:49.977 INFO:tasks.workunit.client.0.smithi062.stdout:1/118: stat d8/d14/f17 0 2024-05-09T06:29:49.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/73: stat d0/c5 0 2024-05-09T06:29:49.984 INFO:tasks.workunit.client.0.smithi062.stdout:5/65: truncate d0/d4/f12 1453662 0 2024-05-09T06:29:49.986 INFO:tasks.workunit.client.0.smithi062.stdout:9/210: rename d3/d1a/d1c/c28 to d3/d3e/d4b/c54 0 2024-05-09T06:29:49.986 INFO:tasks.workunit.client.0.smithi062.stdout:9/211: read - d3/d1a/d1c/d1e/d41/f4f zero size 2024-05-09T06:29:49.990 INFO:tasks.workunit.client.0.smithi062.stdout:9/212: dread d3/d1a/f35 [0,4194304] 0 2024-05-09T06:29:49.997 INFO:tasks.workunit.client.0.smithi062.stdout:5/66: symlink d0/d8/l19 0 2024-05-09T06:29:49.999 INFO:tasks.workunit.client.0.smithi062.stdout:0/97: getdents d1 0 2024-05-09T06:29:49.999 INFO:tasks.workunit.client.0.smithi062.stdout:0/98: chown d1/c12 0 1 2024-05-09T06:29:50.001 INFO:tasks.workunit.client.0.smithi062.stdout:9/213: unlink d3/d1a/d1c/d2b/d31/f3f 0 2024-05-09T06:29:50.001 INFO:tasks.workunit.client.0.smithi062.stdout:9/214: write d3/d3e/d4b/f51 [204290,9762] 0 2024-05-09T06:29:50.002 INFO:tasks.workunit.client.0.smithi062.stdout:9/215: readlink d3/l4e 0 2024-05-09T06:29:50.002 INFO:tasks.workunit.client.0.smithi062.stdout:9/216: fdatasync d3/d1a/d1c/d2b/f2d 0 2024-05-09T06:29:50.002 INFO:tasks.workunit.client.0.smithi062.stdout:9/217: write d3/d1a/d1c/d21/f24 [1405455,33365] 0 2024-05-09T06:29:50.002 INFO:tasks.workunit.client.0.smithi062.stdout:5/67: dread d0/d4/d5/f14 [0,4194304] 0 2024-05-09T06:29:50.003 INFO:tasks.workunit.client.0.smithi062.stdout:2/74: rmdir d0 39 2024-05-09T06:29:50.006 INFO:tasks.workunit.client.0.smithi062.stdout:0/99: link d1/c13 d1/c22 0 2024-05-09T06:29:50.007 INFO:tasks.workunit.client.0.smithi062.stdout:2/75: symlink d0/d9/dd/l16 0 2024-05-09T06:29:50.007 INFO:tasks.workunit.client.0.smithi062.stdout:2/76: write d0/f6 [4550906,96908] 0 2024-05-09T06:29:50.009 INFO:tasks.workunit.client.0.smithi062.stdout:0/100: dread - d1/f19 zero size 2024-05-09T06:29:50.019 INFO:tasks.workunit.client.0.smithi062.stdout:7/204: truncate d0/f8 1737341 0 2024-05-09T06:29:50.020 INFO:tasks.workunit.client.0.smithi062.stdout:8/99: rmdir da/d11 39 2024-05-09T06:29:50.021 INFO:tasks.workunit.client.0.smithi062.stdout:0/101: write d1/fd [2731617,72209] 0 2024-05-09T06:29:50.021 INFO:tasks.workunit.client.0.smithi062.stdout:8/100: stat da/d11/f16 0 2024-05-09T06:29:50.023 INFO:tasks.workunit.client.0.smithi062.stdout:9/218: dwrite d3/d1a/f48 [0,4194304] 0 2024-05-09T06:29:50.026 INFO:tasks.workunit.client.0.smithi062.stdout:2/77: dread d0/f6 [4194304,4194304] 0 2024-05-09T06:29:50.033 INFO:tasks.workunit.client.0.smithi062.stdout:8/101: rename da/cf to da/d11/c18 0 2024-05-09T06:29:50.036 INFO:tasks.workunit.client.0.smithi062.stdout:0/102: link d1/f14 d1/f23 0 2024-05-09T06:29:50.037 INFO:tasks.workunit.client.0.smithi062.stdout:7/205: dwrite d0/d3/f2d [0,4194304] 0 2024-05-09T06:29:50.037 INFO:tasks.workunit.client.0.smithi062.stdout:9/219: rename d3/d1a/f1b to d3/d1a/d1c/d1e/f55 0 2024-05-09T06:29:50.038 INFO:tasks.workunit.client.0.smithi062.stdout:9/220: write d3/d1a/d1c/f26 [4493667,45928] 0 2024-05-09T06:29:50.040 INFO:tasks.workunit.client.0.smithi062.stdout:8/102: rmdir da 39 2024-05-09T06:29:50.040 INFO:tasks.workunit.client.0.smithi062.stdout:7/206: dread d0/d3/f2a [0,4194304] 0 2024-05-09T06:29:50.050 INFO:tasks.workunit.client.0.smithi062.stdout:2/78: rename d0/d10 to d0/d9/d17 0 2024-05-09T06:29:50.051 INFO:tasks.workunit.client.0.smithi062.stdout:9/221: symlink d3/d3e/d52/l56 0 2024-05-09T06:29:50.052 INFO:tasks.workunit.client.0.smithi062.stdout:8/103: readlink da/l10 0 2024-05-09T06:29:50.052 INFO:tasks.workunit.client.0.smithi062.stdout:8/104: chown c0 43 1 2024-05-09T06:29:50.054 INFO:tasks.workunit.client.0.smithi062.stdout:7/207: dwrite d0/f20 [0,4194304] 0 2024-05-09T06:29:50.056 INFO:tasks.workunit.client.0.smithi062.stdout:2/79: rmdir d0 39 2024-05-09T06:29:50.058 INFO:tasks.workunit.client.0.smithi062.stdout:9/222: mknod d3/d1a/d1c/d2b/c57 0 2024-05-09T06:29:50.058 INFO:tasks.workunit.client.0.smithi062.stdout:9/223: dread - d3/d1a/d1c/d1e/f4c zero size 2024-05-09T06:29:50.058 INFO:tasks.workunit.client.0.smithi062.stdout:9/224: readlink d3/d1a/d1c/d1e/l37 0 2024-05-09T06:29:50.059 INFO:tasks.workunit.client.0.smithi062.stdout:8/105: write da/f14 [150935,111927] 0 2024-05-09T06:29:50.059 INFO:tasks.workunit.client.0.smithi062.stdout:7/208: dread d0/d3/f17 [0,4194304] 0 2024-05-09T06:29:50.060 INFO:tasks.workunit.client.0.smithi062.stdout:0/103: link d1/f20 d1/f24 0 2024-05-09T06:29:50.060 INFO:tasks.workunit.client.0.smithi062.stdout:8/106: dread da/d11/f12 [0,4194304] 0 2024-05-09T06:29:50.060 INFO:tasks.workunit.client.0.smithi062.stdout:2/80: rmdir d0/d9 39 2024-05-09T06:29:50.061 INFO:tasks.workunit.client.0.smithi062.stdout:2/81: write d0/f15 [382733,25748] 0 2024-05-09T06:29:50.061 INFO:tasks.workunit.client.0.smithi062.stdout:2/82: write d0/f15 [301330,77785] 0 2024-05-09T06:29:50.062 INFO:tasks.workunit.client.0.smithi062.stdout:9/225: unlink d3/c11 0 2024-05-09T06:29:50.062 INFO:tasks.workunit.client.0.smithi062.stdout:9/226: write d3/d1a/d1c/d2b/d31/f43 [701938,5875] 0 2024-05-09T06:29:50.062 INFO:tasks.workunit.client.0.smithi062.stdout:9/227: fsync d3/f3c 0 2024-05-09T06:29:50.063 INFO:tasks.workunit.client.0.smithi062.stdout:0/104: dread - d1/f1b zero size 2024-05-09T06:29:50.063 INFO:tasks.workunit.client.0.smithi062.stdout:2/83: dread d0/fa [0,4194304] 0 2024-05-09T06:29:50.064 INFO:tasks.workunit.client.0.smithi062.stdout:8/107: mknod da/d11/c19 0 2024-05-09T06:29:50.065 INFO:tasks.workunit.client.0.smithi062.stdout:8/108: chown f7 22939069 1 2024-05-09T06:29:50.065 INFO:tasks.workunit.client.0.smithi062.stdout:8/109: chown c0 227509 1 2024-05-09T06:29:50.066 INFO:tasks.workunit.client.0.smithi062.stdout:0/105: truncate d1/d18/f1d 560864 0 2024-05-09T06:29:50.070 INFO:tasks.workunit.client.0.smithi062.stdout:0/106: truncate d1/f17 3456279 0 2024-05-09T06:29:50.070 INFO:tasks.workunit.client.0.smithi062.stdout:0/107: fdatasync d1/f14 0 2024-05-09T06:29:50.073 INFO:tasks.workunit.client.0.smithi062.stdout:2/84: dread d0/f6 [0,4194304] 0 2024-05-09T06:29:50.073 INFO:tasks.workunit.client.0.smithi062.stdout:2/85: write d0/f15 [1012491,29892] 0 2024-05-09T06:29:50.073 INFO:tasks.workunit.client.0.smithi062.stdout:0/108: mkdir d1/d25 0 2024-05-09T06:29:50.074 INFO:tasks.workunit.client.0.smithi062.stdout:0/109: link d1/f1b d1/d25/f26 0 2024-05-09T06:29:50.075 INFO:tasks.workunit.client.0.smithi062.stdout:0/110: mknod d1/d18/c27 0 2024-05-09T06:29:50.077 INFO:tasks.workunit.client.0.smithi062.stdout:0/111: mknod d1/d18/c28 0 2024-05-09T06:29:50.081 INFO:tasks.workunit.client.0.smithi062.stdout:8/110: dwrite da/d11/f12 [0,4194304] 0 2024-05-09T06:29:50.081 INFO:tasks.workunit.client.0.smithi062.stdout:8/111: dread - f8 zero size 2024-05-09T06:29:50.081 INFO:tasks.workunit.client.0.smithi062.stdout:8/112: dread f7 [0,4194304] 0 2024-05-09T06:29:50.082 INFO:tasks.workunit.client.0.smithi062.stdout:2/86: dread d0/f15 [0,4194304] 0 2024-05-09T06:29:50.084 INFO:tasks.workunit.client.0.smithi062.stdout:8/113: readlink da/ld 0 2024-05-09T06:29:50.091 INFO:tasks.workunit.client.0.smithi062.stdout:2/87: dread d0/f3 [0,4194304] 0 2024-05-09T06:29:50.091 INFO:tasks.workunit.client.0.smithi062.stdout:2/88: write d0/fa [2078628,71505] 0 2024-05-09T06:29:50.094 INFO:tasks.workunit.client.0.smithi062.stdout:3/100: rename d1/dd to d1/d1e 0 2024-05-09T06:29:50.094 INFO:tasks.workunit.client.0.smithi062.stdout:3/101: creat d1/f1f x:0 0 0 2024-05-09T06:29:50.094 INFO:tasks.workunit.client.0.smithi062.stdout:3/102: write d1/f1f [94140,9428] 0 2024-05-09T06:29:50.109 INFO:tasks.workunit.client.0.smithi062.stdout:1/119: truncate d8/f1a 66223 0 2024-05-09T06:29:50.109 INFO:tasks.workunit.client.0.smithi062.stdout:1/120: creat d8/d1d/f25 x:0 0 0 2024-05-09T06:29:50.111 INFO:tasks.workunit.client.0.smithi062.stdout:5/68: dread d0/d4/f12 [0,4194304] 0 2024-05-09T06:29:50.113 INFO:tasks.workunit.client.0.smithi062.stdout:8/114: dwrite f6 [0,4194304] 0 2024-05-09T06:29:50.115 INFO:tasks.workunit.client.0.smithi062.stdout:3/103: dwrite d1/d1e/f1a [0,4194304] 0 2024-05-09T06:29:50.115 INFO:tasks.workunit.client.0.smithi062.stdout:3/104: readlink d1/l11 0 2024-05-09T06:29:50.115 INFO:tasks.workunit.client.0.smithi062.stdout:3/105: creat d1/f20 x:0 0 0 2024-05-09T06:29:50.115 INFO:tasks.workunit.client.0.smithi062.stdout:3/106: truncate d1/f1f 770344 0 2024-05-09T06:29:50.116 INFO:tasks.workunit.client.0.smithi062.stdout:5/69: mknod d0/d8/c1a 0 2024-05-09T06:29:50.116 INFO:tasks.workunit.client.0.smithi062.stdout:5/70: fdatasync d0/d4/f12 0 2024-05-09T06:29:50.117 INFO:tasks.workunit.client.0.smithi062.stdout:2/89: truncate d0/f6 3169316 0 2024-05-09T06:29:50.121 INFO:tasks.workunit.client.0.smithi062.stdout:0/112: truncate d1/fd 2544904 0 2024-05-09T06:29:50.132 INFO:tasks.workunit.client.0.smithi062.stdout:0/113: write d1/f24 [3351687,116093] 0 2024-05-09T06:29:50.138 INFO:tasks.workunit.client.0.smithi062.stdout:8/115: unlink f1 0 2024-05-09T06:29:50.139 INFO:tasks.workunit.client.0.smithi062.stdout:8/116: write f7 [328260,119066] 0 2024-05-09T06:29:50.141 INFO:tasks.workunit.client.0.smithi062.stdout:9/228: truncate d3/d1a/d1c/d21/f24 403407 0 2024-05-09T06:29:50.157 INFO:tasks.workunit.client.0.smithi062.stdout:5/71: creat d0/d8/f1b x:0 0 0 2024-05-09T06:29:50.157 INFO:tasks.workunit.client.0.smithi062.stdout:5/72: readlink d0/d4/l9 0 2024-05-09T06:29:50.159 INFO:tasks.workunit.client.0.smithi062.stdout:5/73: dread d0/d4/f12 [0,4194304] 0 2024-05-09T06:29:50.159 INFO:tasks.workunit.client.0.smithi062.stdout:5/74: fsync d0/d4/f12 0 2024-05-09T06:29:50.160 INFO:tasks.workunit.client.0.smithi062.stdout:5/75: dread - d0/d8/f1b zero size 2024-05-09T06:29:50.162 INFO:tasks.workunit.client.0.smithi062.stdout:8/117: mknod da/d11/c1a 0 2024-05-09T06:29:50.168 INFO:tasks.workunit.client.0.smithi062.stdout:5/76: mkdir d0/d8/d1c 0 2024-05-09T06:29:50.169 INFO:tasks.workunit.client.0.smithi062.stdout:8/118: chown da/c15 354 1 2024-05-09T06:29:50.178 INFO:tasks.workunit.client.0.smithi062.stdout:2/90: dread d0/f6 [0,4194304] 0 2024-05-09T06:29:50.182 INFO:tasks.workunit.client.0.smithi062.stdout:8/119: mknod da/d11/c1b 0 2024-05-09T06:29:50.185 INFO:tasks.workunit.client.0.smithi062.stdout:8/120: unlink da/d11/f12 0 2024-05-09T06:29:50.186 INFO:tasks.workunit.client.0.smithi062.stdout:8/121: write da/d11/f16 [461901,56367] 0 2024-05-09T06:29:50.186 INFO:tasks.workunit.client.0.smithi062.stdout:5/77: dwrite d0/d4/d5/f14 [0,4194304] 0 2024-05-09T06:29:50.186 INFO:tasks.workunit.client.0.smithi062.stdout:5/78: creat d0/f1d x:0 0 0 2024-05-09T06:29:50.190 INFO:tasks.workunit.client.0.smithi062.stdout:8/122: dread f7 [0,4194304] 0 2024-05-09T06:29:50.192 INFO:tasks.workunit.client.0.smithi062.stdout:5/79: mknod d0/d8/c1e 0 2024-05-09T06:29:50.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/229: rename d3/d1a to d3/d3e/d52/d58 0 2024-05-09T06:29:50.197 INFO:tasks.workunit.client.0.smithi062.stdout:5/80: symlink d0/d4/d5/l1f 0 2024-05-09T06:29:50.198 INFO:tasks.workunit.client.0.smithi062.stdout:8/123: truncate da/f13 574349 0 2024-05-09T06:29:50.200 INFO:tasks.workunit.client.0.smithi062.stdout:5/81: creat d0/d8/d1c/f20 x:0 0 0 2024-05-09T06:29:50.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/124: mkdir da/d11/d1c 0 2024-05-09T06:29:50.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/125: chown f7 51 1 2024-05-09T06:29:50.203 INFO:tasks.workunit.client.0.smithi062.stdout:2/91: dwrite d0/f3 [0,4194304] 0 2024-05-09T06:29:50.204 INFO:tasks.workunit.client.0.smithi062.stdout:5/82: creat d0/d4/d5/f21 x:0 0 0 2024-05-09T06:29:50.204 INFO:tasks.workunit.client.0.smithi062.stdout:5/83: dread - d0/d8/d1c/f20 zero size 2024-05-09T06:29:50.204 INFO:tasks.workunit.client.0.smithi062.stdout:5/84: creat d0/d8/d1c/f22 x:0 0 0 2024-05-09T06:29:50.209 INFO:tasks.workunit.client.0.smithi062.stdout:2/92: write d0/f6 [1978414,119750] 0 2024-05-09T06:29:50.215 INFO:tasks.workunit.client.0.smithi062.stdout:7/209: truncate d0/f8 138422 0 2024-05-09T06:29:50.215 INFO:tasks.workunit.client.0.smithi062.stdout:7/210: chown d0/l31 26789755 1 2024-05-09T06:29:50.216 INFO:tasks.workunit.client.0.smithi062.stdout:7/211: creat d0/d12/d33/f36 x:0 0 0 2024-05-09T06:29:50.218 INFO:tasks.workunit.client.0.smithi062.stdout:7/212: mknod d0/d3/c37 0 2024-05-09T06:29:50.231 INFO:tasks.workunit.client.0.smithi062.stdout:8/126: dwrite f8 [0,4194304] 0 2024-05-09T06:29:50.231 INFO:tasks.workunit.client.0.smithi062.stdout:8/127: chown da/d11/c1b 7437067 1 2024-05-09T06:29:50.231 INFO:tasks.workunit.client.0.smithi062.stdout:8/128: stat da/d11/f17 0 2024-05-09T06:29:50.232 INFO:tasks.workunit.client.0.smithi062.stdout:8/129: readlink da/ld 0 2024-05-09T06:29:50.235 INFO:tasks.workunit.client.0.smithi062.stdout:5/85: dwrite d0/ff [0,4194304] 0 2024-05-09T06:29:50.235 INFO:tasks.workunit.client.0.smithi062.stdout:7/213: dwrite d0/d12/d33/f36 [0,4194304] 0 2024-05-09T06:29:50.236 INFO:tasks.workunit.client.0.smithi062.stdout:8/130: dread da/f13 [0,4194304] 0 2024-05-09T06:29:50.238 INFO:tasks.workunit.client.0.smithi062.stdout:2/93: truncate d0/f6 2477069 0 2024-05-09T06:29:50.241 INFO:tasks.workunit.client.0.smithi062.stdout:4/149: sync 2024-05-09T06:29:50.241 INFO:tasks.workunit.client.0.smithi062.stdout:6/141: sync 2024-05-09T06:29:50.241 INFO:tasks.workunit.client.0.smithi062.stdout:4/150: truncate d0/d2a/f25 178106 0 2024-05-09T06:29:50.241 INFO:tasks.workunit.client.0.smithi062.stdout:6/142: write dc/f17 [537052,22039] 0 2024-05-09T06:29:50.249 INFO:tasks.workunit.client.0.smithi062.stdout:8/131: getdents da 0 2024-05-09T06:29:50.249 INFO:tasks.workunit.client.0.smithi062.stdout:8/132: chown da/d11 1476918 1 2024-05-09T06:29:50.252 INFO:tasks.workunit.client.0.smithi062.stdout:2/94: symlink d0/d9/l18 0 2024-05-09T06:29:50.256 INFO:tasks.workunit.client.0.smithi062.stdout:4/151: rename d0/d2a/c1a to d0/d24/c2c 0 2024-05-09T06:29:50.262 INFO:tasks.workunit.client.0.smithi062.stdout:7/214: link d0/d12/d33/f36 d0/d3/f38 0 2024-05-09T06:29:50.266 INFO:tasks.workunit.client.0.smithi062.stdout:2/95: link d0/fa d0/d7/f19 0 2024-05-09T06:29:50.270 INFO:tasks.workunit.client.0.smithi062.stdout:4/152: creat d0/d2a/d8/df/f2d x:0 0 0 2024-05-09T06:29:50.275 INFO:tasks.workunit.client.0.smithi062.stdout:6/143: rmdir dc 39 2024-05-09T06:29:50.275 INFO:tasks.workunit.client.0.smithi062.stdout:6/144: read - dc/d28/f1b zero size 2024-05-09T06:29:50.278 INFO:tasks.workunit.client.0.smithi062.stdout:8/133: getdents da/d11 0 2024-05-09T06:29:50.280 INFO:tasks.workunit.client.0.smithi062.stdout:7/215: dwrite d0/d3/f38 [0,4194304] 0 2024-05-09T06:29:50.280 INFO:tasks.workunit.client.0.smithi062.stdout:7/216: creat d0/f39 x:0 0 0 2024-05-09T06:29:50.280 INFO:tasks.workunit.client.0.smithi062.stdout:7/217: chown d0/d3/f2b 993 1 2024-05-09T06:29:50.282 INFO:tasks.workunit.client.0.smithi062.stdout:4/153: mknod d0/d2a/d8/c2e 0 2024-05-09T06:29:50.284 INFO:tasks.workunit.client.0.smithi062.stdout:6/145: mkdir dc/d28/d34 0 2024-05-09T06:29:50.284 INFO:tasks.workunit.client.0.smithi062.stdout:6/146: write dc/d28/f1b [151151,20509] 0 2024-05-09T06:29:50.286 INFO:tasks.workunit.client.0.smithi062.stdout:8/134: creat da/d11/f1d x:0 0 0 2024-05-09T06:29:50.293 INFO:tasks.workunit.client.0.smithi062.stdout:7/218: mkdir d0/d3a 0 2024-05-09T06:29:50.293 INFO:tasks.workunit.client.0.smithi062.stdout:7/219: fsync d0/f4 0 2024-05-09T06:29:50.294 INFO:tasks.workunit.client.0.smithi062.stdout:7/220: creat d0/d12/d33/f3b x:0 0 0 2024-05-09T06:29:50.294 INFO:tasks.workunit.client.0.smithi062.stdout:7/221: chown d0/le 1311 1 2024-05-09T06:29:50.294 INFO:tasks.workunit.client.0.smithi062.stdout:7/222: write d0/f1b [958425,127266] 0 2024-05-09T06:29:50.294 INFO:tasks.workunit.client.0.smithi062.stdout:7/223: read - d0/d3/f2b zero size 2024-05-09T06:29:50.295 INFO:tasks.workunit.client.0.smithi062.stdout:8/135: unlink da/fc 0 2024-05-09T06:29:50.297 INFO:tasks.workunit.client.0.smithi062.stdout:7/224: unlink d0/d3/l21 0 2024-05-09T06:29:50.297 INFO:tasks.workunit.client.0.smithi062.stdout:7/225: creat d0/d12/d33/f3c x:0 0 0 2024-05-09T06:29:50.300 INFO:tasks.workunit.client.0.smithi062.stdout:6/147: dwrite dc/d28/d10/d20/f31 [0,4194304] 0 2024-05-09T06:29:50.373 INFO:tasks.workunit.client.0.smithi062.stdout:8/136: mkdir da/d1e 0 2024-05-09T06:29:50.379 INFO:tasks.workunit.client.0.smithi062.stdout:6/148: link dc/d28/f22 dc/d28/d10/f35 0 2024-05-09T06:29:50.379 INFO:tasks.workunit.client.0.smithi062.stdout:6/149: chown dc/d28/d10/d20/c23 172974545 1 2024-05-09T06:29:50.383 INFO:tasks.workunit.client.0.smithi062.stdout:6/150: mknod dc/d28/d10/d20/c36 0 2024-05-09T06:29:50.386 INFO:tasks.workunit.client.0.smithi062.stdout:8/137: rename da/d11/c19 to da/c1f 0 2024-05-09T06:29:50.387 INFO:tasks.workunit.client.0.smithi062.stdout:6/151: link dc/d28/l16 dc/d28/d34/l37 0 2024-05-09T06:29:50.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/152: creat dc/d28/d34/f38 x:0 0 0 2024-05-09T06:29:50.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/153: chown dc/l19 3236 1 2024-05-09T06:29:50.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/154: chown dc/ff 773211 1 2024-05-09T06:29:50.392 INFO:tasks.workunit.client.0.smithi062.stdout:8/138: creat da/d11/d1c/f20 x:0 0 0 2024-05-09T06:29:50.392 INFO:tasks.workunit.client.0.smithi062.stdout:8/139: truncate f6 4641816 0 2024-05-09T06:29:50.395 INFO:tasks.workunit.client.0.smithi062.stdout:6/155: mkdir dc/d28/d34/d39 0 2024-05-09T06:29:50.396 INFO:tasks.workunit.client.0.smithi062.stdout:8/140: truncate da/fe 3022794 0 2024-05-09T06:29:50.398 INFO:tasks.workunit.client.0.smithi062.stdout:6/156: mkdir dc/d28/d10/d1a/d3a 0 2024-05-09T06:29:50.398 INFO:tasks.workunit.client.0.smithi062.stdout:6/157: stat dc/d28/d10/f1c 0 2024-05-09T06:29:50.400 INFO:tasks.workunit.client.0.smithi062.stdout:8/141: rename da/d1e to da/d21 0 2024-05-09T06:29:50.402 INFO:tasks.workunit.client.0.smithi062.stdout:8/142: write f9 [507179,4397] 0 2024-05-09T06:29:50.402 INFO:tasks.workunit.client.0.smithi062.stdout:8/143: chown f8 49539 1 2024-05-09T06:29:50.402 INFO:tasks.workunit.client.0.smithi062.stdout:6/158: symlink dc/d28/d34/l3b 0 2024-05-09T06:29:50.402 INFO:tasks.workunit.client.0.smithi062.stdout:6/159: write dc/f2a [852168,130268] 0 2024-05-09T06:29:50.411 INFO:tasks.workunit.client.0.smithi062.stdout:8/144: getdents da/d11/d1c 0 2024-05-09T06:29:50.413 INFO:tasks.workunit.client.0.smithi062.stdout:8/145: dread da/f13 [0,4194304] 0 2024-05-09T06:29:50.416 INFO:tasks.workunit.client.0.smithi062.stdout:8/146: symlink da/d11/l22 0 2024-05-09T06:29:50.417 INFO:tasks.workunit.client.0.smithi062.stdout:6/160: dwrite dc/fd [0,4194304] 0 2024-05-09T06:29:50.420 INFO:tasks.workunit.client.0.smithi062.stdout:8/147: rename da/fe to da/d11/f23 0 2024-05-09T06:29:50.423 INFO:tasks.workunit.client.0.smithi062.stdout:6/161: link dc/d28/d10/f2c dc/d28/d10/d1a/d3a/f3c 0 2024-05-09T06:29:50.425 INFO:tasks.workunit.client.0.smithi062.stdout:8/148: mknod da/d11/d1c/c24 0 2024-05-09T06:29:50.425 INFO:tasks.workunit.client.0.smithi062.stdout:8/149: fsync f7 0 2024-05-09T06:29:50.427 INFO:tasks.workunit.client.0.smithi062.stdout:1/121: sync 2024-05-09T06:29:50.427 INFO:tasks.workunit.client.0.smithi062.stdout:1/122: creat d8/d1d/f26 x:0 0 0 2024-05-09T06:29:50.427 INFO:tasks.workunit.client.0.smithi062.stdout:1/123: read - d8/d14/f1e zero size 2024-05-09T06:29:50.428 INFO:tasks.workunit.client.0.smithi062.stdout:8/150: truncate f8 3659075 0 2024-05-09T06:29:50.429 INFO:tasks.workunit.client.0.smithi062.stdout:8/151: stat da/d11/d1c/c24 0 2024-05-09T06:29:50.444 INFO:tasks.workunit.client.0.smithi062.stdout:8/152: mknod da/d11/c25 0 2024-05-09T06:29:50.446 INFO:tasks.workunit.client.0.smithi062.stdout:8/153: creat da/d11/f26 x:0 0 0 2024-05-09T06:29:50.447 INFO:tasks.workunit.client.0.smithi062.stdout:8/154: symlink da/d11/d1c/l27 0 2024-05-09T06:29:50.449 INFO:tasks.workunit.client.0.smithi062.stdout:8/155: creat da/f28 x:0 0 0 2024-05-09T06:29:50.449 INFO:tasks.workunit.client.0.smithi062.stdout:8/156: write da/d11/f23 [2942012,3301] 0 2024-05-09T06:29:50.450 INFO:tasks.workunit.client.0.smithi062.stdout:8/157: creat da/d11/f29 x:0 0 0 2024-05-09T06:29:50.451 INFO:tasks.workunit.client.0.smithi062.stdout:8/158: write da/d11/f16 [1365123,3027] 0 2024-05-09T06:29:50.451 INFO:tasks.workunit.client.0.smithi062.stdout:8/159: chown da/c15 1244888735 1 2024-05-09T06:29:50.452 INFO:tasks.workunit.client.0.smithi062.stdout:1/124: dwrite d8/f1a [0,4194304] 0 2024-05-09T06:29:50.452 INFO:tasks.workunit.client.0.smithi062.stdout:6/162: dwrite dc/f2a [0,4194304] 0 2024-05-09T06:29:50.452 INFO:tasks.workunit.client.0.smithi062.stdout:1/125: readlink d8/la 0 2024-05-09T06:29:50.452 INFO:tasks.workunit.client.0.smithi062.stdout:1/126: chown d8/d1d/f26 61665729 1 2024-05-09T06:29:50.452 INFO:tasks.workunit.client.0.smithi062.stdout:6/163: write dc/d28/d10/d1a/d26/f2b [356519,36020] 0 2024-05-09T06:29:50.452 INFO:tasks.workunit.client.0.smithi062.stdout:8/160: symlink da/d11/d1c/l2a 0 2024-05-09T06:29:50.458 INFO:tasks.workunit.client.0.smithi062.stdout:1/127: rename d8/la to d8/l27 0 2024-05-09T06:29:50.460 INFO:tasks.workunit.client.0.smithi062.stdout:6/164: write f4 [2202683,32102] 0 2024-05-09T06:29:50.460 INFO:tasks.workunit.client.0.smithi062.stdout:6/165: dread - dc/d28/f22 zero size 2024-05-09T06:29:50.461 INFO:tasks.workunit.client.0.smithi062.stdout:8/161: mknod da/d11/c2b 0 2024-05-09T06:29:50.463 INFO:tasks.workunit.client.0.smithi062.stdout:6/166: getdents dc/d28 0 2024-05-09T06:29:50.464 INFO:tasks.workunit.client.0.smithi062.stdout:8/162: truncate da/d11/f17 597650 0 2024-05-09T06:29:50.464 INFO:tasks.workunit.client.0.smithi062.stdout:8/163: truncate da/d11/f29 397467 0 2024-05-09T06:29:50.464 INFO:tasks.workunit.client.0.smithi062.stdout:8/164: readlink da/d11/d1c/l27 0 2024-05-09T06:29:50.465 INFO:tasks.workunit.client.0.smithi062.stdout:6/167: dread dc/d28/d10/d1a/d26/f2b [0,4194304] 0 2024-05-09T06:29:50.465 INFO:tasks.workunit.client.0.smithi062.stdout:6/168: truncate dc/d28/d10/f35 830619 0 2024-05-09T06:29:50.470 INFO:tasks.workunit.client.0.smithi062.stdout:8/165: rmdir da/d21 0 2024-05-09T06:29:50.471 INFO:tasks.workunit.client.0.smithi062.stdout:8/166: stat da/d11/d1c 0 2024-05-09T06:29:50.471 INFO:tasks.workunit.client.0.smithi062.stdout:8/167: chown da/d11/d1c/l27 62610 1 2024-05-09T06:29:50.471 INFO:tasks.workunit.client.0.smithi062.stdout:8/168: truncate da/d11/f1d 1007922 0 2024-05-09T06:29:50.473 INFO:tasks.workunit.client.0.smithi062.stdout:8/169: creat da/d11/d1c/f2c x:0 0 0 2024-05-09T06:29:50.473 INFO:tasks.workunit.client.0.smithi062.stdout:8/170: fdatasync da/d11/f23 0 2024-05-09T06:29:50.474 INFO:tasks.workunit.client.0.smithi062.stdout:8/171: write da/f13 [345200,70618] 0 2024-05-09T06:29:50.477 INFO:tasks.workunit.client.0.smithi062.stdout:8/172: creat da/d11/f2d x:0 0 0 2024-05-09T06:29:50.477 INFO:tasks.workunit.client.0.smithi062.stdout:8/173: chown f9 1903 1 2024-05-09T06:29:50.483 INFO:tasks.workunit.client.0.smithi062.stdout:6/169: dwrite dc/d28/f14 [0,4194304] 0 2024-05-09T06:29:50.483 INFO:tasks.workunit.client.0.smithi062.stdout:6/170: chown dc/d28/d10/d20/c23 65708884 1 2024-05-09T06:29:50.488 INFO:tasks.workunit.client.0.smithi062.stdout:8/174: rmdir da 39 2024-05-09T06:29:50.488 INFO:tasks.workunit.client.0.smithi062.stdout:8/175: write da/d11/f2d [1023095,1507] 0 2024-05-09T06:29:50.488 INFO:tasks.workunit.client.0.smithi062.stdout:8/176: fdatasync da/d11/d1c/f20 0 2024-05-09T06:29:50.492 INFO:tasks.workunit.client.0.smithi062.stdout:8/177: dread da/d11/f16 [0,4194304] 0 2024-05-09T06:29:50.493 INFO:tasks.workunit.client.0.smithi062.stdout:6/171: write dc/d28/d10/d1a/d26/f27 [1736853,65739] 0 2024-05-09T06:29:50.493 INFO:tasks.workunit.client.0.smithi062.stdout:6/172: creat dc/d28/d34/f3d x:0 0 0 2024-05-09T06:29:50.501 INFO:tasks.workunit.client.0.smithi062.stdout:6/173: creat dc/d28/d10/d1a/d3a/f3e x:0 0 0 2024-05-09T06:29:50.502 INFO:tasks.workunit.client.0.smithi062.stdout:8/178: mkdir da/d11/d2e 0 2024-05-09T06:29:50.502 INFO:tasks.workunit.client.0.smithi062.stdout:6/174: read dc/d28/d10/d1a/d26/f2b [146035,87229] 0 2024-05-09T06:29:50.504 INFO:tasks.workunit.client.0.smithi062.stdout:8/179: rmdir da 39 2024-05-09T06:29:50.507 INFO:tasks.workunit.client.0.smithi062.stdout:6/175: mknod dc/d28/d10/c3f 0 2024-05-09T06:29:50.511 INFO:tasks.workunit.client.0.smithi062.stdout:8/180: mknod da/d11/c2f 0 2024-05-09T06:29:50.516 INFO:tasks.workunit.client.0.smithi062.stdout:6/176: write dc/d28/f14 [4021727,108466] 0 2024-05-09T06:29:50.516 INFO:tasks.workunit.client.0.smithi062.stdout:6/177: write dc/d28/d10/d1a/d3a/f3c [2907948,19382] 0 2024-05-09T06:29:50.516 INFO:tasks.workunit.client.0.smithi062.stdout:6/178: read dc/f2a [4114163,48558] 0 2024-05-09T06:29:50.516 INFO:tasks.workunit.client.0.smithi062.stdout:8/181: symlink da/d11/d2e/l30 0 2024-05-09T06:29:50.536 INFO:tasks.workunit.client.0.smithi062.stdout:6/179: truncate dc/d28/f14 496218 0 2024-05-09T06:29:50.540 INFO:tasks.workunit.client.0.smithi062.stdout:8/182: dwrite f8 [0,4194304] 0 2024-05-09T06:29:50.540 INFO:tasks.workunit.client.0.smithi062.stdout:8/183: truncate f7 881259 0 2024-05-09T06:29:50.541 INFO:tasks.workunit.client.0.smithi062.stdout:8/184: symlink da/l31 0 2024-05-09T06:29:50.542 INFO:tasks.workunit.client.0.smithi062.stdout:0/114: sync 2024-05-09T06:29:50.542 INFO:tasks.workunit.client.0.smithi062.stdout:3/107: sync 2024-05-09T06:29:50.543 INFO:tasks.workunit.client.0.smithi062.stdout:3/108: fsync d1/f8 0 2024-05-09T06:29:50.543 INFO:tasks.workunit.client.0.smithi062.stdout:3/109: creat d1/f21 x:0 0 0 2024-05-09T06:29:50.543 INFO:tasks.workunit.client.0.smithi062.stdout:8/185: dread f7 [0,4194304] 0 2024-05-09T06:29:50.545 INFO:tasks.workunit.client.0.smithi062.stdout:3/110: link d1/c12 d1/c22 0 2024-05-09T06:29:50.548 INFO:tasks.workunit.client.0.smithi062.stdout:6/180: rename dc/d28/d10/f2c to dc/d28/d10/d1a/d3a/f40 0 2024-05-09T06:29:50.548 INFO:tasks.workunit.client.0.smithi062.stdout:8/186: mknod da/d11/d1c/c32 0 2024-05-09T06:29:50.550 INFO:tasks.workunit.client.0.smithi062.stdout:3/111: symlink d1/l23 0 2024-05-09T06:29:50.552 INFO:tasks.workunit.client.0.smithi062.stdout:3/112: dread d1/d1e/f10 [0,4194304] 0 2024-05-09T06:29:50.555 INFO:tasks.workunit.client.0.smithi062.stdout:6/181: mkdir dc/d28/d34/d41 0 2024-05-09T06:29:50.556 INFO:tasks.workunit.client.0.smithi062.stdout:0/115: rename d1/l4 to d1/d25/l29 0 2024-05-09T06:29:50.558 INFO:tasks.workunit.client.0.smithi062.stdout:3/113: link d1/d1e/ff d1/d1e/f24 0 2024-05-09T06:29:50.558 INFO:tasks.workunit.client.0.smithi062.stdout:3/114: readlink l0 0 2024-05-09T06:29:50.558 INFO:tasks.workunit.client.0.smithi062.stdout:3/115: dread - d1/f20 zero size 2024-05-09T06:29:50.559 INFO:tasks.workunit.client.0.smithi062.stdout:3/116: chown d1/f1b 745 1 2024-05-09T06:29:50.559 INFO:tasks.workunit.client.0.smithi062.stdout:3/117: chown d1/cc 0 1 2024-05-09T06:29:50.559 INFO:tasks.workunit.client.0.smithi062.stdout:6/182: mkdir dc/d42 0 2024-05-09T06:29:50.561 INFO:tasks.workunit.client.0.smithi062.stdout:0/116: write d1/fc [618913,21901] 0 2024-05-09T06:29:50.562 INFO:tasks.workunit.client.0.smithi062.stdout:3/118: unlink d1/cb 0 2024-05-09T06:29:50.563 INFO:tasks.workunit.client.0.smithi062.stdout:6/183: creat dc/d28/f43 x:0 0 0 2024-05-09T06:29:50.564 INFO:tasks.workunit.client.0.smithi062.stdout:0/117: rmdir d1/d25 39 2024-05-09T06:29:50.565 INFO:tasks.workunit.client.0.smithi062.stdout:8/187: dwrite f6 [0,4194304] 0 2024-05-09T06:29:50.566 INFO:tasks.workunit.client.0.smithi062.stdout:0/118: creat d1/f2a x:0 0 0 2024-05-09T06:29:50.566 INFO:tasks.workunit.client.0.smithi062.stdout:0/119: dread - d1/f14 zero size 2024-05-09T06:29:50.575 INFO:tasks.workunit.client.0.smithi062.stdout:0/120: rename c0 to d1/c2b 0 2024-05-09T06:29:50.577 INFO:tasks.workunit.client.0.smithi062.stdout:6/184: write dc/d28/f11 [2365626,25511] 0 2024-05-09T06:29:50.577 INFO:tasks.workunit.client.0.smithi062.stdout:6/185: truncate dc/d28/d34/f3d 52928 0 2024-05-09T06:29:50.579 INFO:tasks.workunit.client.0.smithi062.stdout:8/188: dwrite da/d11/d1c/f20 [0,4194304] 0 2024-05-09T06:29:50.579 INFO:tasks.workunit.client.0.smithi062.stdout:6/186: link dc/d28/d10/d1a/d26/l2e dc/d28/d10/d20/l44 0 2024-05-09T06:29:50.580 INFO:tasks.workunit.client.0.smithi062.stdout:6/187: write dc/d28/d10/d1a/d3a/f3c [1182992,114540] 0 2024-05-09T06:29:50.581 INFO:tasks.workunit.client.0.smithi062.stdout:8/189: dread da/f13 [0,4194304] 0 2024-05-09T06:29:50.588 INFO:tasks.workunit.client.0.smithi062.stdout:8/190: mknod da/d11/d2e/c33 0 2024-05-09T06:29:50.588 INFO:tasks.workunit.client.0.smithi062.stdout:6/188: write dc/fd [1365916,92563] 0 2024-05-09T06:29:50.592 INFO:tasks.workunit.client.0.smithi062.stdout:6/189: symlink dc/d28/d34/l45 0 2024-05-09T06:29:50.594 INFO:tasks.workunit.client.0.smithi062.stdout:6/190: dread dc/d28/f24 [0,4194304] 0 2024-05-09T06:29:50.617 INFO:tasks.workunit.client.0.smithi062.stdout:0/121: dwrite d1/fd [0,4194304] 0 2024-05-09T06:29:50.617 INFO:tasks.workunit.client.0.smithi062.stdout:0/122: fsync d1/f2a 0 2024-05-09T06:29:50.627 INFO:tasks.workunit.client.0.smithi062.stdout:6/191: dwrite dc/f13 [0,4194304] 0 2024-05-09T06:29:50.627 INFO:tasks.workunit.client.0.smithi062.stdout:6/192: truncate dc/d28/d10/d1a/f29 982774 0 2024-05-09T06:29:50.628 INFO:tasks.workunit.client.0.smithi062.stdout:8/191: dwrite da/d11/f1d [0,4194304] 0 2024-05-09T06:29:50.628 INFO:tasks.workunit.client.0.smithi062.stdout:0/123: write d1/f17 [723746,924] 0 2024-05-09T06:29:50.628 INFO:tasks.workunit.client.0.smithi062.stdout:0/124: write d1/fd [4237313,13999] 0 2024-05-09T06:29:50.632 INFO:tasks.workunit.client.0.smithi062.stdout:0/125: dread d1/f20 [0,4194304] 0 2024-05-09T06:29:50.632 INFO:tasks.workunit.client.0.smithi062.stdout:8/192: dread da/d11/f23 [0,4194304] 0 2024-05-09T06:29:50.634 INFO:tasks.workunit.client.0.smithi062.stdout:6/193: rename dc/d28/d10/d1a to dc/d28/d46 0 2024-05-09T06:29:50.634 INFO:tasks.workunit.client.0.smithi062.stdout:6/194: write dc/fd [910295,68631] 0 2024-05-09T06:29:50.635 INFO:tasks.workunit.client.0.smithi062.stdout:6/195: write dc/d28/d46/d26/f2b [446584,28930] 0 2024-05-09T06:29:50.636 INFO:tasks.workunit.client.0.smithi062.stdout:0/126: chown d1/c10 548 1 2024-05-09T06:29:50.636 INFO:tasks.workunit.client.0.smithi062.stdout:0/127: truncate d1/f2a 527099 0 2024-05-09T06:29:50.638 INFO:tasks.workunit.client.0.smithi062.stdout:8/193: mkdir da/d11/d2e/d34 0 2024-05-09T06:29:50.639 INFO:tasks.workunit.client.0.smithi062.stdout:6/196: symlink dc/d42/l47 0 2024-05-09T06:29:50.640 INFO:tasks.workunit.client.0.smithi062.stdout:0/128: creat d1/f2c x:0 0 0 2024-05-09T06:29:50.642 INFO:tasks.workunit.client.0.smithi062.stdout:8/194: symlink da/d11/d2e/d34/l35 0 2024-05-09T06:29:50.642 INFO:tasks.workunit.client.0.smithi062.stdout:8/195: chown da/d11/d1c/c32 8339884 1 2024-05-09T06:29:50.643 INFO:tasks.workunit.client.0.smithi062.stdout:0/129: symlink d1/d25/l2d 0 2024-05-09T06:29:50.647 INFO:tasks.workunit.client.0.smithi062.stdout:8/196: unlink da/d11/d1c/f20 0 2024-05-09T06:29:50.648 INFO:tasks.workunit.client.0.smithi062.stdout:6/197: write dc/f13 [4018179,34524] 0 2024-05-09T06:29:50.648 INFO:tasks.workunit.client.0.smithi062.stdout:6/198: fsync dc/d28/f43 0 2024-05-09T06:29:50.650 INFO:tasks.workunit.client.0.smithi062.stdout:0/130: symlink d1/l2e 0 2024-05-09T06:29:50.653 INFO:tasks.workunit.client.0.smithi062.stdout:8/197: link da/l10 da/d11/l36 0 2024-05-09T06:29:50.657 INFO:tasks.workunit.client.0.smithi062.stdout:8/198: rename da/c15 to da/c37 0 2024-05-09T06:29:50.666 INFO:tasks.workunit.client.0.smithi062.stdout:0/131: dwrite d1/f19 [0,4194304] 0 2024-05-09T06:29:50.675 INFO:tasks.workunit.client.0.smithi062.stdout:2/96: sync 2024-05-09T06:29:50.675 INFO:tasks.workunit.client.0.smithi062.stdout:5/86: sync 2024-05-09T06:29:50.675 INFO:tasks.workunit.client.0.smithi062.stdout:9/230: sync 2024-05-09T06:29:50.675 INFO:tasks.workunit.client.0.smithi062.stdout:5/87: chown d0/d8/c1a 106937 1 2024-05-09T06:29:50.675 INFO:tasks.workunit.client.0.smithi062.stdout:5/88: chown d0/f1d 1923 1 2024-05-09T06:29:50.675 INFO:tasks.workunit.client.0.smithi062.stdout:9/231: chown d3/d3e/d52/d58/d1c/d2b/f2c 426 1 2024-05-09T06:29:50.676 INFO:tasks.workunit.client.0.smithi062.stdout:9/232: readlink d3/d3e/d52/d58/l4d 0 2024-05-09T06:29:50.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/226: sync 2024-05-09T06:29:50.676 INFO:tasks.workunit.client.0.smithi062.stdout:4/154: sync 2024-05-09T06:29:50.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/227: write d0/d3/f17 [207204,6476] 0 2024-05-09T06:29:50.676 INFO:tasks.workunit.client.0.smithi062.stdout:1/128: sync 2024-05-09T06:29:50.676 INFO:tasks.workunit.client.0.smithi062.stdout:2/97: creat d0/d9/dd/f1a x:0 0 0 2024-05-09T06:29:50.676 INFO:tasks.workunit.client.0.smithi062.stdout:2/98: stat d0/d9 0 2024-05-09T06:29:50.678 INFO:tasks.workunit.client.0.smithi062.stdout:5/89: mkdir d0/d8/d1c/d23 0 2024-05-09T06:29:50.678 INFO:tasks.workunit.client.0.smithi062.stdout:5/90: creat d0/f24 x:0 0 0 2024-05-09T06:29:50.678 INFO:tasks.workunit.client.0.smithi062.stdout:7/228: dread d0/f16 [0,4194304] 0 2024-05-09T06:29:50.678 INFO:tasks.workunit.client.0.smithi062.stdout:7/229: dread - d0/d12/d33/f3c zero size 2024-05-09T06:29:50.678 INFO:tasks.workunit.client.0.smithi062.stdout:7/230: creat d0/f3d x:0 0 0 2024-05-09T06:29:50.680 INFO:tasks.workunit.client.0.smithi062.stdout:4/155: mknod d0/d2a/d14/c2f 0 2024-05-09T06:29:50.681 INFO:tasks.workunit.client.0.smithi062.stdout:1/129: symlink d8/d1d/l28 0 2024-05-09T06:29:50.685 INFO:tasks.workunit.client.0.smithi062.stdout:5/91: unlink d0/d4/d5/l1f 0 2024-05-09T06:29:50.685 INFO:tasks.workunit.client.0.smithi062.stdout:5/92: write d0/d8/d1c/f22 [830003,89757] 0 2024-05-09T06:29:50.685 INFO:tasks.workunit.client.0.smithi062.stdout:5/93: creat d0/d8/d1c/f25 x:0 0 0 2024-05-09T06:29:50.688 INFO:tasks.workunit.client.0.smithi062.stdout:7/231: unlink d0/d3/l19 0 2024-05-09T06:29:50.690 INFO:tasks.workunit.client.0.smithi062.stdout:0/132: dwrite d1/f2c [0,4194304] 0 2024-05-09T06:29:50.691 INFO:tasks.workunit.client.0.smithi062.stdout:9/233: dwrite d3/d3e/d52/d58/d1c/d1e/f55 [0,4194304] 0 2024-05-09T06:29:50.692 INFO:tasks.workunit.client.0.smithi062.stdout:2/99: mknod d0/c1b 0 2024-05-09T06:29:50.692 INFO:tasks.workunit.client.0.smithi062.stdout:2/100: creat d0/d9/dd/f1c x:0 0 0 2024-05-09T06:29:50.692 INFO:tasks.workunit.client.0.smithi062.stdout:2/101: write d0/d7/f19 [2355524,125283] 0 2024-05-09T06:29:50.695 INFO:tasks.workunit.client.0.smithi062.stdout:5/94: symlink d0/d4/d5/l26 0 2024-05-09T06:29:50.695 INFO:tasks.workunit.client.0.smithi062.stdout:5/95: chown d0/d11/l16 0 1 2024-05-09T06:29:50.695 INFO:tasks.workunit.client.0.smithi062.stdout:5/96: fsync d0/f1d 0 2024-05-09T06:29:50.699 INFO:tasks.workunit.client.0.smithi062.stdout:0/133: rename d1/f20 to d1/d25/f2f 0 2024-05-09T06:29:50.700 INFO:tasks.workunit.client.0.smithi062.stdout:0/134: fsync d1/f2a 0 2024-05-09T06:29:50.701 INFO:tasks.workunit.client.0.smithi062.stdout:1/130: dwrite d8/f13 [0,4194304] 0 2024-05-09T06:29:50.703 INFO:tasks.workunit.client.0.smithi062.stdout:7/232: getdents d0/d12 0 2024-05-09T06:29:50.706 INFO:tasks.workunit.client.0.smithi062.stdout:9/234: write d3/d3e/d52/d58/d1c/d2b/f2c [1107679,63670] 0 2024-05-09T06:29:50.706 INFO:tasks.workunit.client.0.smithi062.stdout:9/235: write d3/d3e/d4b/f51 [477790,81898] 0 2024-05-09T06:29:50.706 INFO:tasks.workunit.client.0.smithi062.stdout:9/236: fdatasync d3/f6 0 2024-05-09T06:29:50.706 INFO:tasks.workunit.client.0.smithi062.stdout:9/237: readlink l2 0 2024-05-09T06:29:50.707 INFO:tasks.workunit.client.0.smithi062.stdout:2/102: dread d0/d7/f19 [0,4194304] 0 2024-05-09T06:29:50.710 INFO:tasks.workunit.client.0.smithi062.stdout:1/131: dread f5 [0,4194304] 0 2024-05-09T06:29:50.710 INFO:tasks.workunit.client.0.smithi062.stdout:1/132: chown d8/l11 44 1 2024-05-09T06:29:50.712 INFO:tasks.workunit.client.0.smithi062.stdout:0/135: symlink d1/l30 0 2024-05-09T06:29:50.713 INFO:tasks.workunit.client.0.smithi062.stdout:4/156: getdents d0/d2a/d14 0 2024-05-09T06:29:50.714 INFO:tasks.workunit.client.0.smithi062.stdout:4/157: rename d0 to d0/d2a/d8/df/d30 22 2024-05-09T06:29:50.716 INFO:tasks.workunit.client.0.smithi062.stdout:2/103: unlink d0/l8 0 2024-05-09T06:29:50.716 INFO:tasks.workunit.client.0.smithi062.stdout:2/104: fdatasync d0/d9/dd/f1a 0 2024-05-09T06:29:50.716 INFO:tasks.workunit.client.0.smithi062.stdout:2/105: fdatasync d0/d7/f19 0 2024-05-09T06:29:50.716 INFO:tasks.workunit.client.0.smithi062.stdout:2/106: dread - d0/d9/dd/f1a zero size 2024-05-09T06:29:50.717 INFO:tasks.workunit.client.0.smithi062.stdout:5/97: dwrite d0/d8/d1c/f20 [0,4194304] 0 2024-05-09T06:29:50.717 INFO:tasks.workunit.client.0.smithi062.stdout:5/98: fsync d0/d4/d5/f21 0 2024-05-09T06:29:50.721 INFO:tasks.workunit.client.0.smithi062.stdout:5/99: dread d0/d4/f12 [0,4194304] 0 2024-05-09T06:29:50.721 INFO:tasks.workunit.client.0.smithi062.stdout:4/158: mkdir d0/d2a/d8/df/d28/d31 0 2024-05-09T06:29:50.726 INFO:tasks.workunit.client.0.smithi062.stdout:0/136: rmdir d1/d18 39 2024-05-09T06:29:50.728 INFO:tasks.workunit.client.0.smithi062.stdout:5/100: mknod d0/c27 0 2024-05-09T06:29:50.728 INFO:tasks.workunit.client.0.smithi062.stdout:5/101: chown d0/d8/c1e 0 1 2024-05-09T06:29:50.728 INFO:tasks.workunit.client.0.smithi062.stdout:5/102: creat d0/f28 x:0 0 0 2024-05-09T06:29:50.728 INFO:tasks.workunit.client.0.smithi062.stdout:5/103: read - d0/d8/d1c/f25 zero size 2024-05-09T06:29:50.731 INFO:tasks.workunit.client.0.smithi062.stdout:4/159: creat d0/d24/f32 x:0 0 0 2024-05-09T06:29:50.733 INFO:tasks.workunit.client.0.smithi062.stdout:0/137: dread d1/f17 [0,4194304] 0 2024-05-09T06:29:50.734 INFO:tasks.workunit.client.0.smithi062.stdout:5/104: creat d0/d8/d1c/d23/f29 x:0 0 0 2024-05-09T06:29:50.735 INFO:tasks.workunit.client.0.smithi062.stdout:5/105: dread - d0/d4/d5/f21 zero size 2024-05-09T06:29:50.735 INFO:tasks.workunit.client.0.smithi062.stdout:5/106: write d0/f24 [3935,91157] 0 2024-05-09T06:29:50.735 INFO:tasks.workunit.client.0.smithi062.stdout:5/107: chown d0/d8/d1c 12360773 1 2024-05-09T06:29:50.741 INFO:tasks.workunit.client.0.smithi062.stdout:9/238: dwrite d3/d3e/d4b/f51 [0,4194304] 0 2024-05-09T06:29:50.742 INFO:tasks.workunit.client.0.smithi062.stdout:9/239: write d3/d3e/d52/d58/d1c/d2b/d31/f43 [1674903,117534] 0 2024-05-09T06:29:50.743 INFO:tasks.workunit.client.0.smithi062.stdout:9/240: mknod d3/d3e/d52/d58/d1c/d1e/d41/c59 0 2024-05-09T06:29:50.744 INFO:tasks.workunit.client.0.smithi062.stdout:2/107: dwrite d0/d9/dd/f1a [0,4194304] 0 2024-05-09T06:29:50.749 INFO:tasks.workunit.client.0.smithi062.stdout:4/160: write d0/d9/fc [2860448,90635] 0 2024-05-09T06:29:50.750 INFO:tasks.workunit.client.0.smithi062.stdout:4/161: dread d0/d2a/f25 [0,4194304] 0 2024-05-09T06:29:50.757 INFO:tasks.workunit.client.0.smithi062.stdout:0/138: write d1/f11 [3180890,23291] 0 2024-05-09T06:29:50.757 INFO:tasks.workunit.client.0.smithi062.stdout:5/108: dwrite d0/f1d [0,4194304] 0 2024-05-09T06:29:50.764 INFO:tasks.workunit.client.0.smithi062.stdout:4/162: link d0/d2a/ca d0/d2a/d8/df/c33 0 2024-05-09T06:29:50.783 INFO:tasks.workunit.client.0.smithi062.stdout:2/108: dwrite d0/f15 [0,4194304] 0 2024-05-09T06:29:50.784 INFO:tasks.workunit.client.0.smithi062.stdout:2/109: dread - d0/d9/dd/f1c zero size 2024-05-09T06:29:50.789 INFO:tasks.workunit.client.0.smithi062.stdout:4/163: mknod d0/d2a/d8/df/c34 0 2024-05-09T06:29:50.789 INFO:tasks.workunit.client.0.smithi062.stdout:4/164: truncate d0/d2a/d8/df/f2d 262561 0 2024-05-09T06:29:50.793 INFO:tasks.workunit.client.0.smithi062.stdout:9/241: dwrite d3/f5 [0,4194304] 0 2024-05-09T06:29:50.794 INFO:tasks.workunit.client.0.smithi062.stdout:9/242: write d3/d3e/d52/d58/d1c/d21/f24 [913321,10406] 0 2024-05-09T06:29:50.796 INFO:tasks.workunit.client.0.smithi062.stdout:0/139: dwrite d1/f23 [0,4194304] 0 2024-05-09T06:29:50.797 INFO:tasks.workunit.client.0.smithi062.stdout:0/140: dread d1/f2a [0,4194304] 0 2024-05-09T06:29:50.883 INFO:tasks.workunit.client.0.smithi062.stdout:2/110: creat d0/d9/d17/f1d x:0 0 0 2024-05-09T06:29:50.883 INFO:tasks.workunit.client.0.smithi062.stdout:3/119: sync 2024-05-09T06:29:50.883 INFO:tasks.workunit.client.0.smithi062.stdout:3/120: write d1/f20 [1026901,129077] 0 2024-05-09T06:29:50.890 INFO:tasks.workunit.client.0.smithi062.stdout:0/141: mkdir d1/d25/d31 0 2024-05-09T06:29:50.892 INFO:tasks.workunit.client.0.smithi062.stdout:4/165: getdents d0/d2a/d8/df 0 2024-05-09T06:29:50.894 INFO:tasks.workunit.client.0.smithi062.stdout:3/121: link d1/d1e/f24 d1/d1e/f25 0 2024-05-09T06:29:50.897 INFO:tasks.workunit.client.0.smithi062.stdout:9/243: rename d3/d3e/d52/d58/d1c/d1e/f55 to d3/d3e/d52/d58/d1c/d21/f5a 0 2024-05-09T06:29:50.900 INFO:tasks.workunit.client.0.smithi062.stdout:0/142: mkdir d1/d32 0 2024-05-09T06:29:50.904 INFO:tasks.workunit.client.0.smithi062.stdout:0/143: creat d1/d25/d31/f33 x:0 0 0 2024-05-09T06:29:50.907 INFO:tasks.workunit.client.0.smithi062.stdout:0/144: chown d1/c13 7324 1 2024-05-09T06:29:50.908 INFO:tasks.workunit.client.0.smithi062.stdout:2/111: dwrite d0/f3 [0,4194304] 0 2024-05-09T06:29:50.908 INFO:tasks.workunit.client.0.smithi062.stdout:4/166: dread d0/d2a/f4 [4194304,4194304] 0 2024-05-09T06:29:50.909 INFO:tasks.workunit.client.0.smithi062.stdout:0/145: truncate d1/f14 3551612 0 2024-05-09T06:29:50.912 INFO:tasks.workunit.client.0.smithi062.stdout:2/112: symlink d0/d9/l1e 0 2024-05-09T06:29:50.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr fail", "who": "smithi062.juuasl"}]: dispatch 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: Activating manager daemon smithi079.genyri 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: osdmap e47: 6 total, 6 up, 6 in 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "mgr fail", "who": "smithi062.juuasl"}]': finished 2024-05-09T06:29:50.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: mgrmap e21: smithi079.genyri(active, starting, since 0.0149162s) 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr metadata", "who": "smithi079.genyri", "id": "smithi079.genyri"}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:29:50.914 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: Manager daemon smithi079.genyri is now available 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.genyri/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.genyri/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.genyri/trash_purge_schedule"}]: dispatch 2024-05-09T06:29:50.915 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:50 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.genyri/trash_purge_schedule"}]: dispatch 2024-05-09T06:29:50.916 INFO:tasks.workunit.client.0.smithi062.stdout:0/146: unlink d1/d18/c28 0 2024-05-09T06:29:50.916 INFO:tasks.workunit.client.0.smithi062.stdout:0/147: readlink d1/d25/l29 0 2024-05-09T06:29:50.916 INFO:tasks.workunit.client.0.smithi062.stdout:3/122: dwrite d1/f20 [0,4194304] 0 2024-05-09T06:29:50.917 INFO:tasks.workunit.client.0.smithi062.stdout:3/123: fsync d1/d1e/f24 0 2024-05-09T06:29:50.917 INFO:tasks.workunit.client.0.smithi062.stdout:3/124: write d1/f1b [698644,73333] 0 2024-05-09T06:29:50.917 INFO:tasks.workunit.client.0.smithi062.stdout:2/113: unlink d0/f3 0 2024-05-09T06:29:50.917 INFO:tasks.workunit.client.0.smithi062.stdout:2/114: fsync d0/d9/dd/f1c 0 2024-05-09T06:29:50.917 INFO:tasks.workunit.client.0.smithi062.stdout:2/115: write d0/d9/dd/f1c [377671,44120] 0 2024-05-09T06:29:50.921 INFO:tasks.workunit.client.0.smithi062.stdout:0/148: creat d1/d18/f34 x:0 0 0 2024-05-09T06:29:50.926 INFO:tasks.workunit.client.0.smithi062.stdout:3/125: mkdir d1/d1e/d26 0 2024-05-09T06:29:50.926 INFO:tasks.workunit.client.0.smithi062.stdout:3/126: fdatasync d1/d1e/f1d 0 2024-05-09T06:29:50.928 INFO:tasks.workunit.client.0.smithi062.stdout:2/116: unlink d0/d7/f19 0 2024-05-09T06:29:50.931 INFO:tasks.workunit.client.0.smithi062.stdout:0/149: rmdir d1/d18 39 2024-05-09T06:29:50.935 INFO:tasks.workunit.client.0.smithi062.stdout:0/150: getdents d1 0 2024-05-09T06:29:50.936 INFO:tasks.workunit.client.0.smithi062.stdout:0/151: fdatasync d1/f2a 0 2024-05-09T06:29:50.936 INFO:tasks.workunit.client.0.smithi062.stdout:0/152: chown d1/d25/f2f 26 1 2024-05-09T06:29:50.938 INFO:tasks.workunit.client.0.smithi062.stdout:0/153: rename d1/f23 to d1/d18/f35 0 2024-05-09T06:29:50.938 INFO:tasks.workunit.client.0.smithi062.stdout:3/127: write d1/f20 [2881831,80794] 0 2024-05-09T06:29:50.938 INFO:tasks.workunit.client.0.smithi062.stdout:3/128: write d1/d1e/f14 [1618619,104821] 0 2024-05-09T06:29:50.938 INFO:tasks.workunit.client.0.smithi062.stdout:3/129: chown d1/l7 7341747 1 2024-05-09T06:29:50.938 INFO:tasks.workunit.client.0.smithi062.stdout:3/130: read d1/f1f [603334,8872] 0 2024-05-09T06:29:50.939 INFO:tasks.workunit.client.0.smithi062.stdout:3/131: fdatasync d1/f1c 0 2024-05-09T06:29:50.940 INFO:tasks.workunit.client.0.smithi062.stdout:0/154: creat d1/d32/f36 x:0 0 0 2024-05-09T06:29:50.942 INFO:tasks.workunit.client.0.smithi062.stdout:0/155: creat d1/d18/f37 x:0 0 0 2024-05-09T06:29:50.942 INFO:tasks.workunit.client.0.smithi062.stdout:0/156: chown d1/c22 27305279 1 2024-05-09T06:29:50.947 INFO:tasks.workunit.client.0.smithi062.stdout:6/199: sync 2024-05-09T06:29:50.948 INFO:tasks.workunit.client.0.smithi062.stdout:8/199: sync 2024-05-09T06:29:50.948 INFO:tasks.workunit.client.0.smithi062.stdout:6/200: write dc/d28/d10/f35 [1692737,84637] 0 2024-05-09T06:29:50.948 INFO:tasks.workunit.client.0.smithi062.stdout:2/117: dwrite d0/f15 [0,4194304] 0 2024-05-09T06:29:50.948 INFO:tasks.workunit.client.0.smithi062.stdout:2/118: chown d0/d9/d17 1898 1 2024-05-09T06:29:50.948 INFO:tasks.workunit.client.0.smithi062.stdout:0/157: write d1/f2a [288866,52933] 0 2024-05-09T06:29:50.949 INFO:tasks.workunit.client.0.smithi062.stdout:8/200: symlink da/d11/d2e/l38 0 2024-05-09T06:29:50.951 INFO:tasks.workunit.client.0.smithi062.stdout:2/119: mkdir d0/d9/dd/d1f 0 2024-05-09T06:29:50.951 INFO:tasks.workunit.client.0.smithi062.stdout:2/120: chown d0/d9/d17 82 1 2024-05-09T06:29:50.953 INFO:tasks.workunit.client.0.smithi062.stdout:8/201: creat da/d11/d1c/f39 x:0 0 0 2024-05-09T06:29:50.953 INFO:tasks.workunit.client.0.smithi062.stdout:8/202: chown da/d11/d1c/f2c 4731235 1 2024-05-09T06:29:50.953 INFO:tasks.workunit.client.0.smithi062.stdout:8/203: fdatasync da/d11/f29 0 2024-05-09T06:29:50.964 INFO:tasks.workunit.client.0.smithi062.stdout:0/158: dread d1/f8 [0,4194304] 0 2024-05-09T06:29:50.964 INFO:tasks.workunit.client.0.smithi062.stdout:0/159: dread - d1/d32/f36 zero size 2024-05-09T06:29:50.968 INFO:tasks.workunit.client.0.smithi062.stdout:0/160: creat d1/f38 x:0 0 0 2024-05-09T06:29:50.969 INFO:tasks.workunit.client.0.smithi062.stdout:8/204: dwrite da/d11/f26 [0,4194304] 0 2024-05-09T06:29:50.976 INFO:tasks.workunit.client.0.smithi062.stdout:8/205: mkdir da/d11/d2e/d3a 0 2024-05-09T06:29:50.978 INFO:tasks.workunit.client.0.smithi062.stdout:0/161: mkdir d1/d39 0 2024-05-09T06:29:50.985 INFO:tasks.workunit.client.0.smithi062.stdout:0/162: symlink d1/l3a 0 2024-05-09T06:29:50.992 INFO:tasks.workunit.client.0.smithi062.stdout:8/206: dwrite da/d11/d1c/f39 [0,4194304] 0 2024-05-09T06:29:50.997 INFO:tasks.workunit.client.0.smithi062.stdout:8/207: symlink da/d11/d1c/l3b 0 2024-05-09T06:29:50.998 INFO:tasks.workunit.client.0.smithi062.stdout:8/208: creat da/d11/f3c x:0 0 0 2024-05-09T06:29:51.000 INFO:tasks.workunit.client.0.smithi062.stdout:8/209: creat da/d11/d2e/d34/f3d x:0 0 0 2024-05-09T06:29:51.001 INFO:tasks.workunit.client.0.smithi062.stdout:8/210: dread da/f13 [0,4194304] 0 2024-05-09T06:29:51.002 INFO:tasks.workunit.client.0.smithi062.stdout:8/211: truncate f8 2421386 0 2024-05-09T06:29:51.003 INFO:tasks.workunit.client.0.smithi062.stdout:8/212: creat da/d11/d1c/f3e x:0 0 0 2024-05-09T06:29:51.003 INFO:tasks.workunit.client.0.smithi062.stdout:8/213: chown da/d11/d1c/c32 11223532 1 2024-05-09T06:29:51.004 INFO:tasks.workunit.client.0.smithi062.stdout:8/214: write da/d11/f16 [1060495,60398] 0 2024-05-09T06:29:51.004 INFO:tasks.workunit.client.0.smithi062.stdout:8/215: stat f7 0 2024-05-09T06:29:51.004 INFO:tasks.workunit.client.0.smithi062.stdout:8/216: stat da/d11/f2d 0 2024-05-09T06:29:51.005 INFO:tasks.workunit.client.0.smithi062.stdout:8/217: truncate da/d11/f23 3860511 0 2024-05-09T06:29:51.005 INFO:tasks.workunit.client.0.smithi062.stdout:8/218: write da/d11/f17 [127198,6007] 0 2024-05-09T06:29:51.039 INFO:tasks.workunit.client.0.smithi062.stdout:8/219: dwrite da/d11/d1c/f39 [0,4194304] 0 2024-05-09T06:29:51.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:51.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:51.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr fail", "who": "smithi062.juuasl"}]: dispatch 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: Activating manager daemon smithi079.genyri 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: osdmap e47: 6 total, 6 up, 6 in 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.14224 172.21.15.62:0/3077591527' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "mgr fail", "who": "smithi062.juuasl"}]': finished 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: mgrmap e21: smithi079.genyri(active, starting, since 0.0149162s) 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:29:51.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr metadata", "who": "smithi079.genyri", "id": "smithi079.genyri"}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: Manager daemon smithi079.genyri is now available 2024-05-09T06:29:51.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:51.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:51.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.genyri/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:29:51.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.genyri/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:29:51.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.genyri/trash_purge_schedule"}]: dispatch 2024-05-09T06:29:51.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:50 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.genyri/trash_purge_schedule"}]: dispatch 2024-05-09T06:29:51.108 INFO:tasks.workunit.client.0.smithi062.stdout:8/220: symlink da/d11/d1c/l3f 0 2024-05-09T06:29:51.114 INFO:tasks.workunit.client.0.smithi062.stdout:8/221: rename da/d11/c1b to da/c40 0 2024-05-09T06:29:51.116 INFO:tasks.workunit.client.0.smithi062.stdout:8/222: mkdir da/d11/d2e/d41 0 2024-05-09T06:29:51.124 INFO:tasks.workunit.client.0.smithi062.stdout:8/223: dread da/d11/f26 [0,4194304] 0 2024-05-09T06:29:51.127 INFO:tasks.workunit.client.0.smithi062.stdout:8/224: link da/d11/l36 da/d11/d1c/l42 0 2024-05-09T06:29:51.127 INFO:tasks.workunit.client.0.smithi062.stdout:8/225: chown da/d11/c2f 12 1 2024-05-09T06:29:51.127 INFO:tasks.workunit.client.0.smithi062.stdout:8/226: creat da/d11/d1c/f43 x:0 0 0 2024-05-09T06:29:51.150 INFO:tasks.workunit.client.0.smithi062.stdout:7/233: sync 2024-05-09T06:29:51.150 INFO:tasks.workunit.client.0.smithi062.stdout:7/234: write d0/d12/f32 [387286,118778] 0 2024-05-09T06:29:51.150 INFO:tasks.workunit.client.0.smithi062.stdout:1/133: sync 2024-05-09T06:29:51.150 INFO:tasks.workunit.client.0.smithi062.stdout:5/109: sync 2024-05-09T06:29:51.151 INFO:tasks.workunit.client.0.smithi062.stdout:5/110: readlink d0/d4/d5/l26 0 2024-05-09T06:29:51.151 INFO:tasks.workunit.client.0.smithi062.stdout:1/134: mkdir d8/d1d/d29 0 2024-05-09T06:29:51.153 INFO:tasks.workunit.client.0.smithi062.stdout:1/135: truncate d8/f13 3360020 0 2024-05-09T06:29:51.163 INFO:tasks.workunit.client.0.smithi062.stdout:1/136: dread f7 [4194304,4194304] 0 2024-05-09T06:29:51.164 INFO:tasks.workunit.client.0.smithi062.stdout:1/137: creat d8/f2a x:0 0 0 2024-05-09T06:29:51.167 INFO:tasks.workunit.client.0.smithi062.stdout:5/111: dwrite d0/d4/d5/f21 [0,4194304] 0 2024-05-09T06:29:51.167 INFO:tasks.workunit.client.0.smithi062.stdout:5/112: stat d0/d11/ld 0 2024-05-09T06:29:51.168 INFO:tasks.workunit.client.0.smithi062.stdout:1/138: rmdir d8/d1d/d29 0 2024-05-09T06:29:51.168 INFO:tasks.workunit.client.0.smithi062.stdout:1/139: write d8/d14/f1b [2661838,45201] 0 2024-05-09T06:29:51.176 INFO:tasks.workunit.client.0.smithi062.stdout:1/140: write d8/fc [1158038,37034] 0 2024-05-09T06:29:51.178 INFO:tasks.workunit.client.0.smithi062.stdout:5/113: rename d0/d11/l16 to d0/d11/l2a 0 2024-05-09T06:29:51.180 INFO:tasks.workunit.client.0.smithi062.stdout:5/114: dread d0/f24 [0,4194304] 0 2024-05-09T06:29:51.189 INFO:tasks.workunit.client.0.smithi062.stdout:1/141: rename d8/d14/d20 to d8/d14/d2b 0 2024-05-09T06:29:51.193 INFO:tasks.workunit.client.0.smithi062.stdout:5/115: link d0/cb d0/d4/c2b 0 2024-05-09T06:29:51.200 INFO:tasks.workunit.client.0.smithi062.stdout:1/142: unlink d8/d14/l18 0 2024-05-09T06:29:51.205 INFO:tasks.workunit.client.0.smithi062.stdout:5/116: mkdir d0/d8/d1c/d2c 0 2024-05-09T06:29:51.205 INFO:tasks.workunit.client.0.smithi062.stdout:5/117: chown d0/d4/c2b 12965 1 2024-05-09T06:29:51.205 INFO:tasks.workunit.client.0.smithi062.stdout:5/118: write d0/f24 [771711,33607] 0 2024-05-09T06:29:51.205 INFO:tasks.workunit.client.0.smithi062.stdout:5/119: creat d0/f2d x:0 0 0 2024-05-09T06:29:51.207 INFO:tasks.workunit.client.0.smithi062.stdout:1/143: unlink d8/fc 0 2024-05-09T06:29:51.207 INFO:tasks.workunit.client.0.smithi062.stdout:1/144: stat d8/l16 0 2024-05-09T06:29:51.207 INFO:tasks.workunit.client.0.smithi062.stdout:1/145: truncate d8/f2a 577374 0 2024-05-09T06:29:51.207 INFO:tasks.workunit.client.0.smithi062.stdout:1/146: truncate d8/d1d/f25 231496 0 2024-05-09T06:29:51.207 INFO:tasks.workunit.client.0.smithi062.stdout:1/147: fdatasync f6 0 2024-05-09T06:29:51.215 INFO:tasks.workunit.client.0.smithi062.stdout:5/120: dread d0/d4/d5/f14 [0,4194304] 0 2024-05-09T06:29:51.215 INFO:tasks.workunit.client.0.smithi062.stdout:5/121: write d0/f28 [390689,29105] 0 2024-05-09T06:29:51.215 INFO:tasks.workunit.client.0.smithi062.stdout:5/122: chown d0/f24 2 1 2024-05-09T06:29:51.220 INFO:tasks.workunit.client.0.smithi062.stdout:1/148: getdents d8/d14 0 2024-05-09T06:29:51.220 INFO:tasks.workunit.client.0.smithi062.stdout:1/149: chown d8/d14/d2b 12926982 1 2024-05-09T06:29:51.224 INFO:tasks.workunit.client.0.smithi062.stdout:5/123: dread d0/d4/d5/f21 [0,4194304] 0 2024-05-09T06:29:51.225 INFO:tasks.workunit.client.0.smithi062.stdout:5/124: getdents d0/d11 0 2024-05-09T06:29:51.239 INFO:tasks.workunit.client.0.smithi062.stdout:1/150: dwrite d8/d14/f17 [0,4194304] 0 2024-05-09T06:29:51.245 INFO:tasks.workunit.client.0.smithi062.stdout:5/125: dwrite d0/d8/f1b [0,4194304] 0 2024-05-09T06:29:51.278 INFO:tasks.workunit.client.0.smithi062.stdout:5/126: link d0/d4/d5/l10 d0/d4/l2e 0 2024-05-09T06:29:51.288 INFO:tasks.workunit.client.0.smithi062.stdout:1/151: getdents d8/d1d 0 2024-05-09T06:29:51.288 INFO:tasks.workunit.client.0.smithi062.stdout:1/152: fsync f7 0 2024-05-09T06:29:51.292 INFO:tasks.workunit.client.0.smithi062.stdout:5/127: mknod d0/d8/d1c/c2f 0 2024-05-09T06:29:51.292 INFO:tasks.workunit.client.0.smithi062.stdout:5/128: write d0/d4/f12 [465133,27737] 0 2024-05-09T06:29:51.296 INFO:tasks.workunit.client.0.smithi062.stdout:1/153: mkdir d8/d2c 0 2024-05-09T06:29:51.296 INFO:tasks.workunit.client.0.smithi062.stdout:1/154: dread - d8/d1d/f24 zero size 2024-05-09T06:29:51.296 INFO:tasks.workunit.client.0.smithi062.stdout:1/155: getdents d8/d2c 0 2024-05-09T06:29:51.297 INFO:tasks.workunit.client.0.smithi062.stdout:5/129: mkdir d0/d8/d30 0 2024-05-09T06:29:51.299 INFO:tasks.workunit.client.0.smithi062.stdout:1/156: creat d8/d14/d2b/f2d x:0 0 0 2024-05-09T06:29:51.313 INFO:tasks.workunit.client.0.smithi062.stdout:5/130: rename d0/d4 to d0/d8/d1c/d23/d31 0 2024-05-09T06:29:51.313 INFO:tasks.workunit.client.0.smithi062.stdout:5/131: stat d0/d8/d1c/f25 0 2024-05-09T06:29:51.313 INFO:tasks.workunit.client.0.smithi062.stdout:5/132: write d0/d8/d1c/d23/d31/f12 [288200,15009] 0 2024-05-09T06:29:51.315 INFO:tasks.workunit.client.0.smithi062.stdout:5/133: dread d0/f24 [0,4194304] 0 2024-05-09T06:29:51.321 INFO:tasks.workunit.client.0.smithi062.stdout:9/244: sync 2024-05-09T06:29:51.321 INFO:tasks.workunit.client.0.smithi062.stdout:1/157: dwrite d8/d14/f17 [4194304,4194304] 0 2024-05-09T06:29:51.322 INFO:tasks.workunit.client.0.smithi062.stdout:5/134: rmdir d0/d8/d1c/d23/d31 39 2024-05-09T06:29:51.324 INFO:tasks.workunit.client.0.smithi062.stdout:9/245: creat d3/d3e/d52/d58/d1c/d1e/f5b x:0 0 0 2024-05-09T06:29:51.326 INFO:tasks.workunit.client.0.smithi062.stdout:1/158: getdents d8/d14/d2b 0 2024-05-09T06:29:51.333 INFO:tasks.workunit.client.0.smithi062.stdout:5/135: truncate d0/ff 3379365 0 2024-05-09T06:29:51.333 INFO:tasks.workunit.client.0.smithi062.stdout:5/136: creat d0/d8/d1c/f32 x:0 0 0 2024-05-09T06:29:51.340 INFO:tasks.workunit.client.0.smithi062.stdout:5/137: rename d0/d8/d1c/d23/d31/d5/f14 to d0/d8/d1c/d2c/f33 0 2024-05-09T06:29:51.340 INFO:tasks.workunit.client.0.smithi062.stdout:9/246: dwrite d3/d3e/d52/d58/d1c/d1e/d41/f4f [0,4194304] 0 2024-05-09T06:29:51.342 INFO:tasks.workunit.client.0.smithi062.stdout:1/159: unlink d8/d14/f17 0 2024-05-09T06:29:51.342 INFO:tasks.workunit.client.0.smithi062.stdout:1/160: chown d8/f13 24506 1 2024-05-09T06:29:51.345 INFO:tasks.workunit.client.0.smithi062.stdout:5/138: mknod d0/d8/c34 0 2024-05-09T06:29:51.350 INFO:tasks.workunit.client.0.smithi062.stdout:1/161: creat d8/d14/d2b/f2e x:0 0 0 2024-05-09T06:29:51.351 INFO:tasks.workunit.client.0.smithi062.stdout:9/247: read d3/f6 [412170,122161] 0 2024-05-09T06:29:51.352 INFO:tasks.workunit.client.0.smithi062.stdout:5/139: link d0/d8/d1c/d23/d31/l9 d0/l35 0 2024-05-09T06:29:51.352 INFO:tasks.workunit.client.0.smithi062.stdout:5/140: truncate d0/f2d 211584 0 2024-05-09T06:29:51.355 INFO:tasks.workunit.client.0.smithi062.stdout:1/162: mkdir d8/d2c/d2f 0 2024-05-09T06:29:51.357 INFO:tasks.workunit.client.0.smithi062.stdout:9/248: link d3/d3e/d52/d58/d1c/f4a d3/d3e/d4b/f5c 0 2024-05-09T06:29:51.362 INFO:tasks.workunit.client.0.smithi062.stdout:5/141: creat d0/d8/d1c/d23/d31/d5/f36 x:0 0 0 2024-05-09T06:29:51.365 INFO:tasks.workunit.client.0.smithi062.stdout:5/142: rename d0/d8/f1b to d0/f37 0 2024-05-09T06:29:51.365 INFO:tasks.workunit.client.0.smithi062.stdout:5/143: truncate d0/ff 4265563 0 2024-05-09T06:29:51.367 INFO:tasks.workunit.client.0.smithi062.stdout:9/249: write d3/f18 [2370906,14909] 0 2024-05-09T06:29:51.367 INFO:tasks.workunit.client.0.smithi062.stdout:9/250: dread - d3/f3c zero size 2024-05-09T06:29:51.367 INFO:tasks.workunit.client.0.smithi062.stdout:9/251: write d3/d3e/d52/d58/d1c/f34 [365266,121409] 0 2024-05-09T06:29:51.367 INFO:tasks.workunit.client.0.smithi062.stdout:9/252: fsync d3/d3e/d52/d58/f48 0 2024-05-09T06:29:51.367 INFO:tasks.workunit.client.0.smithi062.stdout:9/253: creat d3/f5d x:0 0 0 2024-05-09T06:29:51.367 INFO:tasks.workunit.client.0.smithi062.stdout:5/144: mkdir d0/d11/d38 0 2024-05-09T06:29:51.370 INFO:tasks.workunit.client.0.smithi062.stdout:5/145: unlink d0/ce 0 2024-05-09T06:29:51.370 INFO:tasks.workunit.client.0.smithi062.stdout:5/146: chown d0/d8/d1c/f25 36 1 2024-05-09T06:29:51.370 INFO:tasks.workunit.client.0.smithi062.stdout:5/147: creat d0/f39 x:0 0 0 2024-05-09T06:29:51.371 INFO:tasks.workunit.client.0.smithi062.stdout:9/254: dread d3/d3e/d52/d58/d1c/f26 [4194304,4194304] 0 2024-05-09T06:29:51.375 INFO:tasks.workunit.client.0.smithi062.stdout:5/148: unlink d0/d8/d1c/d23/d31/d5/f21 0 2024-05-09T06:29:51.378 INFO:tasks.workunit.client.0.smithi062.stdout:1/163: dwrite f7 [0,4194304] 0 2024-05-09T06:29:51.379 INFO:tasks.workunit.client.0.smithi062.stdout:1/164: chown d8/d14/c21 23 1 2024-05-09T06:29:51.379 INFO:tasks.workunit.client.0.smithi062.stdout:5/149: unlink d0/ff 0 2024-05-09T06:29:51.379 INFO:tasks.workunit.client.0.smithi062.stdout:5/150: chown d0/d8/d1c/d23/d31/d5/l10 9916 1 2024-05-09T06:29:51.384 INFO:tasks.workunit.client.0.smithi062.stdout:1/165: link d8/ld d8/d1d/l30 0 2024-05-09T06:29:51.385 INFO:tasks.workunit.client.0.smithi062.stdout:1/166: readlink d8/d14/l23 0 2024-05-09T06:29:51.388 INFO:tasks.workunit.client.0.smithi062.stdout:5/151: write d0/f37 [360771,53811] 0 2024-05-09T06:29:51.388 INFO:tasks.workunit.client.0.smithi062.stdout:5/152: dread - d0/d8/d1c/d23/f29 zero size 2024-05-09T06:29:51.388 INFO:tasks.workunit.client.0.smithi062.stdout:5/153: dread - d0/d8/d1c/f25 zero size 2024-05-09T06:29:51.388 INFO:tasks.workunit.client.0.smithi062.stdout:5/154: stat d0/d8/d1c/f22 0 2024-05-09T06:29:51.389 INFO:tasks.workunit.client.0.smithi062.stdout:1/167: rename f7 to d8/f31 0 2024-05-09T06:29:51.389 INFO:tasks.workunit.client.0.smithi062.stdout:1/168: write d8/d14/f1b [1594549,73964] 0 2024-05-09T06:29:51.389 INFO:tasks.workunit.client.0.smithi062.stdout:1/169: write d8/d14/f1b [443332,26000] 0 2024-05-09T06:29:51.392 INFO:tasks.workunit.client.0.smithi062.stdout:5/155: creat d0/d8/d1c/d23/d31/f3a x:0 0 0 2024-05-09T06:29:51.394 INFO:tasks.workunit.client.0.smithi062.stdout:9/255: dwrite d3/d3e/d52/d58/d1c/f4a [0,4194304] 0 2024-05-09T06:29:51.395 INFO:tasks.workunit.client.0.smithi062.stdout:9/256: dread - d3/d3e/d52/d58/d1c/d21/f53 zero size 2024-05-09T06:29:51.395 INFO:tasks.workunit.client.0.smithi062.stdout:1/170: creat d8/d14/f32 x:0 0 0 2024-05-09T06:29:51.396 INFO:tasks.workunit.client.0.smithi062.stdout:5/156: mkdir d0/d3b 0 2024-05-09T06:29:51.396 INFO:tasks.workunit.client.0.smithi062.stdout:5/157: chown d0/f37 35 1 2024-05-09T06:29:51.403 INFO:tasks.workunit.client.0.smithi062.stdout:9/257: dread d3/d3e/d52/d58/d1c/f4a [0,4194304] 0 2024-05-09T06:29:51.403 INFO:tasks.workunit.client.0.smithi062.stdout:9/258: fdatasync d3/d3e/d52/d58/d1c/d1e/d41/f4f 0 2024-05-09T06:29:51.403 INFO:tasks.workunit.client.0.smithi062.stdout:9/259: stat d3/f3c 0 2024-05-09T06:29:51.403 INFO:tasks.workunit.client.0.smithi062.stdout:9/260: write d3/d3e/d52/d58/d1c/f26 [5202991,711] 0 2024-05-09T06:29:51.403 INFO:tasks.workunit.client.0.smithi062.stdout:9/261: write d3/d3e/d52/d58/d1c/d2b/f2d [1218925,42553] 0 2024-05-09T06:29:51.413 INFO:tasks.workunit.client.0.smithi062.stdout:1/171: mknod d8/c33 0 2024-05-09T06:29:51.415 INFO:tasks.workunit.client.0.smithi062.stdout:9/262: creat d3/d3e/d52/d58/d1c/f5e x:0 0 0 2024-05-09T06:29:51.417 INFO:tasks.workunit.client.0.smithi062.stdout:2/121: sync 2024-05-09T06:29:51.417 INFO:tasks.workunit.client.0.smithi062.stdout:4/167: sync 2024-05-09T06:29:51.417 INFO:tasks.workunit.client.0.smithi062.stdout:3/132: sync 2024-05-09T06:29:51.417 INFO:tasks.workunit.client.0.smithi062.stdout:7/235: sync 2024-05-09T06:29:51.417 INFO:tasks.workunit.client.0.smithi062.stdout:4/168: fdatasync d0/d2a/f1d 0 2024-05-09T06:29:51.417 INFO:tasks.workunit.client.0.smithi062.stdout:4/169: chown d0/d2a/d8/c2e 2540766 1 2024-05-09T06:29:51.417 INFO:tasks.workunit.client.0.smithi062.stdout:0/163: sync 2024-05-09T06:29:51.417 INFO:tasks.workunit.client.0.smithi062.stdout:6/201: sync 2024-05-09T06:29:51.418 INFO:tasks.workunit.client.0.smithi062.stdout:2/122: creat d0/d9/dd/f20 x:0 0 0 2024-05-09T06:29:51.418 INFO:tasks.workunit.client.0.smithi062.stdout:2/123: getdents d0/d9/dd/d1f 0 2024-05-09T06:29:51.418 INFO:tasks.workunit.client.0.smithi062.stdout:6/202: read f4 [3289171,82110] 0 2024-05-09T06:29:51.418 INFO:tasks.workunit.client.0.smithi062.stdout:6/203: dread - dc/d28/d46/d3a/f3e zero size 2024-05-09T06:29:51.418 INFO:tasks.workunit.client.0.smithi062.stdout:4/170: write d0/d2a/f1d [682309,60567] 0 2024-05-09T06:29:51.420 INFO:tasks.workunit.client.0.smithi062.stdout:1/172: creat d8/d2c/d2f/f34 x:0 0 0 2024-05-09T06:29:51.420 INFO:tasks.workunit.client.0.smithi062.stdout:1/173: creat d8/d14/f35 x:0 0 0 2024-05-09T06:29:51.423 INFO:tasks.workunit.client.0.smithi062.stdout:8/227: sync 2024-05-09T06:29:51.425 INFO:tasks.workunit.client.0.smithi062.stdout:5/158: unlink d0/d8/d1c/d23/d31/f3a 0 2024-05-09T06:29:51.426 INFO:tasks.workunit.client.0.smithi062.stdout:9/263: getdents d3/d3e/d52/d58/d1c/d21 0 2024-05-09T06:29:51.430 INFO:tasks.workunit.client.0.smithi062.stdout:3/133: link d1/f20 d1/f27 0 2024-05-09T06:29:51.438 INFO:tasks.workunit.client.0.smithi062.stdout:0/164: fsync d1/f1b 0 2024-05-09T06:29:51.442 INFO:tasks.workunit.client.0.smithi062.stdout:2/124: rename d0/d7 to d0/d9/dd/d1f/d21 0 2024-05-09T06:29:51.442 INFO:tasks.workunit.client.0.smithi062.stdout:2/125: readlink d0/d9/l18 0 2024-05-09T06:29:51.444 INFO:tasks.workunit.client.0.smithi062.stdout:3/134: write d1/d1e/f24 [796198,10160] 0 2024-05-09T06:29:51.444 INFO:tasks.workunit.client.0.smithi062.stdout:4/171: dwrite d0/d2a/d1f/f22 [0,4194304] 0 2024-05-09T06:29:51.447 INFO:tasks.workunit.client.0.smithi062.stdout:6/204: truncate dc/f2a 2922344 0 2024-05-09T06:29:51.448 INFO:tasks.workunit.client.0.smithi062.stdout:1/174: dwrite d8/f13 [0,4194304] 0 2024-05-09T06:29:51.448 INFO:tasks.workunit.client.0.smithi062.stdout:1/175: truncate d8/d14/f35 408161 0 2024-05-09T06:29:51.451 INFO:tasks.workunit.client.0.smithi062.stdout:8/228: unlink da/d11/f16 0 2024-05-09T06:29:51.451 INFO:tasks.workunit.client.0.smithi062.stdout:8/229: creat da/d11/d2e/d34/f44 x:0 0 0 2024-05-09T06:29:51.451 INFO:tasks.workunit.client.0.smithi062.stdout:8/230: write da/d11/d1c/f43 [205420,7832] 0 2024-05-09T06:29:51.459 INFO:tasks.workunit.client.0.smithi062.stdout:5/159: symlink d0/d11/d38/l3c 0 2024-05-09T06:29:51.459 INFO:tasks.workunit.client.0.smithi062.stdout:5/160: fsync d0/f2d 0 2024-05-09T06:29:51.463 INFO:tasks.workunit.client.0.smithi062.stdout:9/264: unlink d3/d3e/d52/d58/d1c/d21/c47 0 2024-05-09T06:29:51.470 INFO:tasks.workunit.client.0.smithi062.stdout:9/265: dread d3/d3e/d52/d58/d1c/f4a [0,4194304] 0 2024-05-09T06:29:51.471 INFO:tasks.workunit.client.0.smithi062.stdout:4/172: dwrite d0/d2a/f5 [0,4194304] 0 2024-05-09T06:29:51.481 INFO:tasks.workunit.client.0.smithi062.stdout:2/126: mknod d0/d9/dd/d1f/d21/c22 0 2024-05-09T06:29:51.481 INFO:tasks.workunit.client.0.smithi062.stdout:2/127: write d0/d9/dd/f1c [958052,108625] 0 2024-05-09T06:29:51.489 INFO:tasks.workunit.client.0.smithi062.stdout:3/135: creat d1/d1e/d26/f28 x:0 0 0 2024-05-09T06:29:51.489 INFO:tasks.workunit.client.0.smithi062.stdout:3/136: creat d1/d1e/d26/f29 x:0 0 0 2024-05-09T06:29:51.489 INFO:tasks.workunit.client.0.smithi062.stdout:3/137: write d1/d1e/f14 [2476106,58079] 0 2024-05-09T06:29:51.490 INFO:tasks.workunit.client.0.smithi062.stdout:6/205: creat dc/d28/d34/d39/f48 x:0 0 0 2024-05-09T06:29:51.490 INFO:tasks.workunit.client.0.smithi062.stdout:3/138: read d1/f8 [257506,12183] 0 2024-05-09T06:29:51.494 INFO:tasks.workunit.client.0.smithi062.stdout:1/176: mkdir d8/d36 0 2024-05-09T06:29:51.494 INFO:tasks.workunit.client.0.smithi062.stdout:1/177: fsync d8/d14/d2b/f2d 0 2024-05-09T06:29:51.494 INFO:tasks.workunit.client.0.smithi062.stdout:1/178: dread - d8/d14/d2b/f2d zero size 2024-05-09T06:29:51.494 INFO:tasks.workunit.client.0.smithi062.stdout:1/179: fdatasync d8/d14/f35 0 2024-05-09T06:29:51.494 INFO:tasks.workunit.client.0.smithi062.stdout:1/180: fsync d8/d14/f1b 0 2024-05-09T06:29:51.496 INFO:tasks.workunit.client.0.smithi062.stdout:8/231: symlink da/d11/d2e/d3a/l45 0 2024-05-09T06:29:51.497 INFO:tasks.workunit.client.0.smithi062.stdout:5/161: symlink d0/d8/d30/l3d 0 2024-05-09T06:29:51.499 INFO:tasks.workunit.client.0.smithi062.stdout:2/128: dwrite d0/d9/dd/f1a [0,4194304] 0 2024-05-09T06:29:51.503 INFO:tasks.workunit.client.0.smithi062.stdout:4/173: rmdir d0/d2a 39 2024-05-09T06:29:51.503 INFO:tasks.workunit.client.0.smithi062.stdout:9/266: read d3/d3e/d52/d58/d1c/d21/f24 [848076,79170] 0 2024-05-09T06:29:51.506 INFO:tasks.workunit.client.0.smithi062.stdout:0/165: link d1/f38 d1/d25/d31/f3b 0 2024-05-09T06:29:51.506 INFO:tasks.workunit.client.0.smithi062.stdout:1/181: write f5 [6415211,103013] 0 2024-05-09T06:29:51.511 INFO:tasks.workunit.client.0.smithi062.stdout:9/267: dread d3/d3e/d52/d58/f48 [0,4194304] 0 2024-05-09T06:29:51.511 INFO:tasks.workunit.client.0.smithi062.stdout:9/268: creat d3/d3e/d52/d58/d1c/d1e/f5f x:0 0 0 2024-05-09T06:29:51.513 INFO:tasks.workunit.client.0.smithi062.stdout:6/206: link dc/l19 dc/d28/d34/l49 0 2024-05-09T06:29:51.513 INFO:tasks.workunit.client.0.smithi062.stdout:6/207: write dc/f13 [5116321,12652] 0 2024-05-09T06:29:51.513 INFO:tasks.workunit.client.0.smithi062.stdout:6/208: fsync dc/d28/d10/d20/f32 0 2024-05-09T06:29:51.513 INFO:tasks.workunit.client.0.smithi062.stdout:6/209: write dc/f2a [285364,55534] 0 2024-05-09T06:29:51.517 INFO:tasks.workunit.client.0.smithi062.stdout:3/139: unlink d1/l11 0 2024-05-09T06:29:51.518 INFO:tasks.workunit.client.0.smithi062.stdout:8/232: symlink da/d11/d1c/l46 0 2024-05-09T06:29:51.518 INFO:tasks.workunit.client.0.smithi062.stdout:8/233: chown f6 9 1 2024-05-09T06:29:51.520 INFO:tasks.workunit.client.0.smithi062.stdout:5/162: mkdir d0/d8/d1c/d23/d3e 0 2024-05-09T06:29:51.522 INFO:tasks.workunit.client.0.smithi062.stdout:4/174: symlink d0/d2a/d8/l35 0 2024-05-09T06:29:51.525 INFO:tasks.workunit.client.0.smithi062.stdout:0/166: fsync d1/f14 0 2024-05-09T06:29:51.526 INFO:tasks.workunit.client.0.smithi062.stdout:8/234: write f6 [2308855,123296] 0 2024-05-09T06:29:51.527 INFO:tasks.workunit.client.0.smithi062.stdout:1/182: symlink d8/d14/d2b/l37 0 2024-05-09T06:29:51.529 INFO:tasks.workunit.client.0.smithi062.stdout:9/269: mkdir d3/d3e/d52/d58/d1c/d1e/d60 0 2024-05-09T06:29:51.531 INFO:tasks.workunit.client.0.smithi062.stdout:6/210: mkdir dc/d28/d46/d4a 0 2024-05-09T06:29:51.531 INFO:tasks.workunit.client.0.smithi062.stdout:9/270: dread d3/d3e/d52/d58/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:29:51.531 INFO:tasks.workunit.client.0.smithi062.stdout:9/271: chown d3/d3e/d52/d58/d1c/c44 25574642 1 2024-05-09T06:29:51.532 INFO:tasks.workunit.client.0.smithi062.stdout:3/140: creat d1/d1e/f2a x:0 0 0 2024-05-09T06:29:51.536 INFO:tasks.workunit.client.0.smithi062.stdout:5/163: rename d0/d11/d38 to d0/d3b/d3f 0 2024-05-09T06:29:51.538 INFO:tasks.workunit.client.0.smithi062.stdout:2/129: truncate d0/fa 425736 0 2024-05-09T06:29:51.542 INFO:tasks.workunit.client.0.smithi062.stdout:4/175: creat d0/d2a/f36 x:0 0 0 2024-05-09T06:29:51.542 INFO:tasks.workunit.client.0.smithi062.stdout:0/167: mkdir d1/d39/d3c 0 2024-05-09T06:29:51.544 INFO:tasks.workunit.client.0.smithi062.stdout:8/235: symlink da/d11/d2e/d34/l47 0 2024-05-09T06:29:51.546 INFO:tasks.workunit.client.0.smithi062.stdout:9/272: creat d3/d3e/f61 x:0 0 0 2024-05-09T06:29:51.550 INFO:tasks.workunit.client.0.smithi062.stdout:5/164: unlink d0/d8/l19 0 2024-05-09T06:29:51.552 INFO:tasks.workunit.client.0.smithi062.stdout:3/141: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:51.552 INFO:tasks.workunit.client.0.smithi062.stdout:3/142: creat d1/d1e/d26/f2b x:0 0 0 2024-05-09T06:29:51.554 INFO:tasks.workunit.client.0.smithi062.stdout:1/183: rename d8/d36 to d8/d2c/d2f/d38 0 2024-05-09T06:29:51.554 INFO:tasks.workunit.client.0.smithi062.stdout:1/184: dread - d8/d14/f1e zero size 2024-05-09T06:29:51.556 INFO:tasks.workunit.client.0.smithi062.stdout:6/211: dwrite dc/d28/f43 [0,4194304] 0 2024-05-09T06:29:51.562 INFO:tasks.workunit.client.0.smithi062.stdout:4/176: unlink d0/d24/c2c 0 2024-05-09T06:29:51.564 INFO:tasks.workunit.client.0.smithi062.stdout:9/273: write d3/f5 [1205022,62786] 0 2024-05-09T06:29:51.574 INFO:tasks.workunit.client.0.smithi062.stdout:0/168: mknod d1/d25/d31/c3d 0 2024-05-09T06:29:51.574 INFO:tasks.workunit.client.0.smithi062.stdout:0/169: write d1/d25/d31/f3b [621292,51552] 0 2024-05-09T06:29:51.575 INFO:tasks.workunit.client.0.smithi062.stdout:8/236: unlink da/d11/d2e/c33 0 2024-05-09T06:29:51.575 INFO:tasks.workunit.client.0.smithi062.stdout:8/237: stat da/d11/d1c/f2c 0 2024-05-09T06:29:51.579 INFO:tasks.workunit.client.0.smithi062.stdout:5/165: link d0/d8/c1a d0/d8/d1c/d23/d3e/c40 0 2024-05-09T06:29:51.579 INFO:tasks.workunit.client.0.smithi062.stdout:5/166: chown d0/d8/d1c/f32 84450 1 2024-05-09T06:29:51.579 INFO:tasks.workunit.client.0.smithi062.stdout:5/167: fsync d0/d8/d1c/d23/d31/f12 0 2024-05-09T06:29:51.580 INFO:tasks.workunit.client.0.smithi062.stdout:5/168: write d0/d8/d1c/d2c/f33 [4570545,86919] 0 2024-05-09T06:29:51.581 INFO:tasks.workunit.client.0.smithi062.stdout:5/169: write d0/d8/d1c/f22 [207703,67430] 0 2024-05-09T06:29:51.581 INFO:tasks.workunit.client.0.smithi062.stdout:5/170: creat d0/d8/f41 x:0 0 0 2024-05-09T06:29:51.581 INFO:tasks.workunit.client.0.smithi062.stdout:3/143: dwrite d1/d1e/f10 [0,4194304] 0 2024-05-09T06:29:51.581 INFO:tasks.workunit.client.0.smithi062.stdout:3/144: write d1/d1e/f1d [925392,126] 0 2024-05-09T06:29:51.582 INFO:tasks.workunit.client.0.smithi062.stdout:3/145: chown d1/f3 30 1 2024-05-09T06:29:51.582 INFO:tasks.workunit.client.0.smithi062.stdout:4/177: dwrite d0/d9/fc [4194304,4194304] 0 2024-05-09T06:29:51.582 INFO:tasks.workunit.client.0.smithi062.stdout:4/178: creat d0/d24/f37 x:0 0 0 2024-05-09T06:29:51.582 INFO:tasks.workunit.client.0.smithi062.stdout:6/212: dwrite dc/d28/d34/f3d [0,4194304] 0 2024-05-09T06:29:51.589 INFO:tasks.workunit.client.0.smithi062.stdout:3/146: write d1/f3 [1752991,103871] 0 2024-05-09T06:29:51.593 INFO:tasks.workunit.client.0.smithi062.stdout:1/185: creat d8/d2c/d2f/d38/f39 x:0 0 0 2024-05-09T06:29:51.611 INFO:tasks.workunit.client.0.smithi062.stdout:2/130: getdents d0/d9/dd 0 2024-05-09T06:29:51.614 INFO:tasks.workunit.client.0.smithi062.stdout:9/274: rename d3/d3e/d52/l56 to d3/d3e/d52/d58/d1c/d1e/d41/l62 0 2024-05-09T06:29:51.617 INFO:tasks.workunit.client.0.smithi062.stdout:8/238: creat da/d11/f48 x:0 0 0 2024-05-09T06:29:51.617 INFO:tasks.workunit.client.0.smithi062.stdout:8/239: dread - da/d11/d1c/f2c zero size 2024-05-09T06:29:51.620 INFO:tasks.workunit.client.0.smithi062.stdout:5/171: mkdir d0/d8/d1c/d23/d42 0 2024-05-09T06:29:51.634 INFO:tasks.workunit.client.0.smithi062.stdout:2/131: symlink d0/d9/dd/d1f/d21/l23 0 2024-05-09T06:29:51.637 INFO:tasks.workunit.client.0.smithi062.stdout:0/170: rename d1/d25/d31/c3d to d1/d32/c3e 0 2024-05-09T06:29:51.638 INFO:tasks.workunit.client.0.smithi062.stdout:9/275: mknod d3/d3e/d52/d58/c63 0 2024-05-09T06:29:51.645 INFO:tasks.workunit.client.0.smithi062.stdout:2/132: creat d0/d9/dd/d1f/f24 x:0 0 0 2024-05-09T06:29:51.646 INFO:tasks.workunit.client.0.smithi062.stdout:4/179: rename d0/d2a/d14/c2f to d0/d24/c38 0 2024-05-09T06:29:51.650 INFO:tasks.workunit.client.0.smithi062.stdout:6/213: rename dc/d28/d34/d39/f48 to dc/d28/d10/f4b 0 2024-05-09T06:29:51.650 INFO:tasks.workunit.client.0.smithi062.stdout:6/214: stat dc/d28/d34/l3b 0 2024-05-09T06:29:51.650 INFO:tasks.workunit.client.0.smithi062.stdout:6/215: readlink dc/d28/d34/l49 0 2024-05-09T06:29:51.651 INFO:tasks.workunit.client.0.smithi062.stdout:4/180: truncate d0/d2a/f6 2956119 0 2024-05-09T06:29:51.652 INFO:tasks.workunit.client.0.smithi062.stdout:2/133: rmdir d0/d9/d17 39 2024-05-09T06:29:51.652 INFO:tasks.workunit.client.0.smithi062.stdout:2/134: chown d0/d9/dd/d1f 2 1 2024-05-09T06:29:51.652 INFO:tasks.workunit.client.0.smithi062.stdout:2/135: write d0/d9/dd/f20 [547872,91990] 0 2024-05-09T06:29:51.654 INFO:tasks.workunit.client.0.smithi062.stdout:6/216: rename dc/d28/d46/d26 to dc/d28/d46/d3a/d4c 0 2024-05-09T06:29:51.656 INFO:tasks.workunit.client.0.smithi062.stdout:4/181: truncate d0/f17 67078 0 2024-05-09T06:29:51.656 INFO:tasks.workunit.client.0.smithi062.stdout:7/236: sync 2024-05-09T06:29:51.658 INFO:tasks.workunit.client.0.smithi062.stdout:2/136: rmdir d0/d9/dd/d1f/d21 39 2024-05-09T06:29:51.660 INFO:tasks.workunit.client.0.smithi062.stdout:2/137: dread d0/fa [0,4194304] 0 2024-05-09T06:29:51.660 INFO:tasks.workunit.client.0.smithi062.stdout:2/138: readlink d0/d9/dd/l16 0 2024-05-09T06:29:51.662 INFO:tasks.workunit.client.0.smithi062.stdout:3/147: rename d1/d1e/d26/f28 to d1/d1e/f2c 0 2024-05-09T06:29:51.663 INFO:tasks.workunit.client.0.smithi062.stdout:4/182: creat d0/d2a/d8/df/d28/d31/f39 x:0 0 0 2024-05-09T06:29:51.663 INFO:tasks.workunit.client.0.smithi062.stdout:4/183: chown d0/d2a/f1d 72769711 1 2024-05-09T06:29:51.664 INFO:tasks.workunit.client.0.smithi062.stdout:2/139: symlink d0/d9/d17/l25 0 2024-05-09T06:29:51.665 INFO:tasks.workunit.client.0.smithi062.stdout:1/186: rename d8/d14/d2b/f2d to d8/d2c/d2f/f3a 0 2024-05-09T06:29:51.666 INFO:tasks.workunit.client.0.smithi062.stdout:3/148: mkdir d1/d2d 0 2024-05-09T06:29:51.668 INFO:tasks.workunit.client.0.smithi062.stdout:4/184: symlink d0/d2a/l3a 0 2024-05-09T06:29:51.669 INFO:tasks.workunit.client.0.smithi062.stdout:7/237: dread d0/d3/f38 [0,4194304] 0 2024-05-09T06:29:51.669 INFO:tasks.workunit.client.0.smithi062.stdout:7/238: creat d0/d3/f3e x:0 0 0 2024-05-09T06:29:51.669 INFO:tasks.workunit.client.0.smithi062.stdout:7/239: write d0/f1e [1825674,66531] 0 2024-05-09T06:29:51.669 INFO:tasks.workunit.client.0.smithi062.stdout:7/240: write d0/d12/f24 [3110776,112547] 0 2024-05-09T06:29:51.670 INFO:tasks.workunit.client.0.smithi062.stdout:2/140: dread d0/d9/dd/f1c [0,4194304] 0 2024-05-09T06:29:51.672 INFO:tasks.workunit.client.0.smithi062.stdout:8/240: rename da/d11/d2e/d41 to da/d11/d2e/d3a/d49 0 2024-05-09T06:29:51.672 INFO:tasks.workunit.client.0.smithi062.stdout:8/241: creat da/d11/d1c/f4a x:0 0 0 2024-05-09T06:29:51.672 INFO:tasks.workunit.client.0.smithi062.stdout:8/242: chown da/d11/d2e/d3a 8 1 2024-05-09T06:29:51.672 INFO:tasks.workunit.client.0.smithi062.stdout:9/276: dwrite d3/d3e/d52/d58/d1c/d2b/d31/f43 [0,4194304] 0 2024-05-09T06:29:51.673 INFO:tasks.workunit.client.0.smithi062.stdout:0/171: dwrite d1/f11 [4194304,4194304] 0 2024-05-09T06:29:51.673 INFO:tasks.workunit.client.0.smithi062.stdout:0/172: readlink d1/d25/l2d 0 2024-05-09T06:29:51.679 INFO:tasks.workunit.client.0.smithi062.stdout:0/173: dread d1/d25/f2f [0,4194304] 0 2024-05-09T06:29:51.681 INFO:tasks.workunit.client.0.smithi062.stdout:2/141: rename d0/ce to d0/d9/dd/d1f/d21/c26 0 2024-05-09T06:29:51.681 INFO:tasks.workunit.client.0.smithi062.stdout:7/241: dread d0/f20 [0,4194304] 0 2024-05-09T06:29:51.681 INFO:tasks.workunit.client.0.smithi062.stdout:6/217: dwrite dc/d28/d10/f18 [0,4194304] 0 2024-05-09T06:29:51.681 INFO:tasks.workunit.client.0.smithi062.stdout:7/242: write d0/f8 [1524828,22013] 0 2024-05-09T06:29:51.684 INFO:tasks.workunit.client.0.smithi062.stdout:8/243: link da/d11/d1c/l27 da/d11/d2e/d34/l4b 0 2024-05-09T06:29:51.692 INFO:tasks.workunit.client.0.smithi062.stdout:0/174: creat d1/d39/d3c/f3f x:0 0 0 2024-05-09T06:29:51.693 INFO:tasks.workunit.client.0.smithi062.stdout:9/277: rename d3/d3e/d52/d58/d1c/d2b to d3/d3e/d52/d58/d1c/d1e/d41/d64 0 2024-05-09T06:29:51.695 INFO:tasks.workunit.client.0.smithi062.stdout:6/218: stat dc/d28/l16 0 2024-05-09T06:29:51.696 INFO:tasks.workunit.client.0.smithi062.stdout:2/142: dwrite d0/fa [0,4194304] 0 2024-05-09T06:29:51.697 INFO:tasks.workunit.client.0.smithi062.stdout:7/243: mkdir d0/d3a/d3f 0 2024-05-09T06:29:51.697 INFO:tasks.workunit.client.0.smithi062.stdout:7/244: truncate d0/f28 633617 0 2024-05-09T06:29:51.697 INFO:tasks.workunit.client.0.smithi062.stdout:7/245: creat d0/d3/f40 x:0 0 0 2024-05-09T06:29:51.703 INFO:tasks.workunit.client.0.smithi062.stdout:9/278: creat d3/d3e/d52/d58/d1c/d1e/d41/f65 x:0 0 0 2024-05-09T06:29:51.703 INFO:tasks.workunit.client.0.smithi062.stdout:9/279: truncate d3/f5d 460370 0 2024-05-09T06:29:51.707 INFO:tasks.workunit.client.0.smithi062.stdout:9/280: dread d3/d3e/d52/d58/d1c/f34 [0,4194304] 0 2024-05-09T06:29:51.707 INFO:tasks.workunit.client.0.smithi062.stdout:9/281: stat d3/d3e/d52/d58/d1c/d1e 0 2024-05-09T06:29:51.708 INFO:tasks.workunit.client.0.smithi062.stdout:9/282: creat d3/d3e/d52/d58/d1c/f66 x:0 0 0 2024-05-09T06:29:51.711 INFO:tasks.workunit.client.0.smithi062.stdout:6/219: creat dc/d42/f4d x:0 0 0 2024-05-09T06:29:51.721 INFO:tasks.workunit.client.0.smithi062.stdout:4/185: write d0/d2a/f4 [396702,81899] 0 2024-05-09T06:29:51.723 INFO:tasks.workunit.client.0.smithi062.stdout:0/175: dwrite d1/f16 [0,4194304] 0 2024-05-09T06:29:51.723 INFO:tasks.workunit.client.0.smithi062.stdout:0/176: dread - d1/d25/d31/f33 zero size 2024-05-09T06:29:51.723 INFO:tasks.workunit.client.0.smithi062.stdout:2/143: dwrite d0/f6 [0,4194304] 0 2024-05-09T06:29:51.723 INFO:tasks.workunit.client.0.smithi062.stdout:2/144: write d0/d9/d17/f1d [1017191,3979] 0 2024-05-09T06:29:51.724 INFO:tasks.workunit.client.0.smithi062.stdout:4/186: symlink d0/l3b 0 2024-05-09T06:29:51.729 INFO:tasks.workunit.client.0.smithi062.stdout:2/145: symlink d0/d9/dd/d1f/l27 0 2024-05-09T06:29:51.731 INFO:tasks.workunit.client.0.smithi062.stdout:4/187: mkdir d0/d3c 0 2024-05-09T06:29:51.731 INFO:tasks.workunit.client.0.smithi062.stdout:4/188: write d0/d24/f32 [1000022,25750] 0 2024-05-09T06:29:51.732 INFO:tasks.workunit.client.0.smithi062.stdout:3/149: rmdir d1/d1e 39 2024-05-09T06:29:51.736 INFO:tasks.workunit.client.0.smithi062.stdout:1/187: getdents d8/d14/d2b 0 2024-05-09T06:29:51.740 INFO:tasks.workunit.client.0.smithi062.stdout:1/188: write d8/f2a [260991,75054] 0 2024-05-09T06:29:51.747 INFO:tasks.workunit.client.0.smithi062.stdout:8/244: rmdir da/d11/d2e/d3a/d49 0 2024-05-09T06:29:51.752 INFO:tasks.workunit.client.0.smithi062.stdout:1/189: getdents d8/d2c/d2f 0 2024-05-09T06:29:51.752 INFO:tasks.workunit.client.0.smithi062.stdout:1/190: fsync d8/d1d/f24 0 2024-05-09T06:29:51.754 INFO:tasks.workunit.client.0.smithi062.stdout:8/245: creat da/d11/d2e/f4c x:0 0 0 2024-05-09T06:29:51.754 INFO:tasks.workunit.client.0.smithi062.stdout:8/246: write da/d11/d1c/f2c [303053,34556] 0 2024-05-09T06:29:51.756 INFO:tasks.workunit.client.0.smithi062.stdout:1/191: mknod d8/c3b 0 2024-05-09T06:29:51.756 INFO:tasks.workunit.client.0.smithi062.stdout:1/192: chown d8/d1d/f26 205088473 1 2024-05-09T06:29:51.759 INFO:tasks.workunit.client.0.smithi062.stdout:2/146: dwrite d0/f15 [4194304,4194304] 0 2024-05-09T06:29:51.760 INFO:tasks.workunit.client.0.smithi062.stdout:8/247: unlink da/d11/d1c/l46 0 2024-05-09T06:29:51.760 INFO:tasks.workunit.client.0.smithi062.stdout:3/150: dwrite d1/f3 [4194304,4194304] 0 2024-05-09T06:29:51.760 INFO:tasks.workunit.client.0.smithi062.stdout:3/151: write d1/d1e/f1d [984773,57312] 0 2024-05-09T06:29:51.760 INFO:tasks.workunit.client.0.smithi062.stdout:4/189: dwrite d0/d9/fc [8388608,4194304] 0 2024-05-09T06:29:51.760 INFO:tasks.workunit.client.0.smithi062.stdout:4/190: fsync d0/f17 0 2024-05-09T06:29:51.764 INFO:tasks.workunit.client.0.smithi062.stdout:2/147: truncate d0/d9/dd/f1a 2966750 0 2024-05-09T06:29:51.768 INFO:tasks.workunit.client.0.smithi062.stdout:8/248: symlink da/d11/d2e/d3a/l4d 0 2024-05-09T06:29:51.778 INFO:tasks.workunit.client.0.smithi062.stdout:8/249: unlink da/d11/d1c/f2c 0 2024-05-09T06:29:51.778 INFO:tasks.workunit.client.0.smithi062.stdout:8/250: stat da/f13 0 2024-05-09T06:29:51.781 INFO:tasks.workunit.client.0.smithi062.stdout:8/251: mknod da/d11/c4e 0 2024-05-09T06:29:51.782 INFO:tasks.workunit.client.0.smithi062.stdout:8/252: rename da/d11/d2e to da/d11/d2e/d3a/d4f 22 2024-05-09T06:29:51.786 INFO:tasks.workunit.client.0.smithi062.stdout:4/191: dwrite d0/f17 [0,4194304] 0 2024-05-09T06:29:51.787 INFO:tasks.workunit.client.0.smithi062.stdout:4/192: dread d0/d2a/d8/df/f2d [0,4194304] 0 2024-05-09T06:29:51.787 INFO:tasks.workunit.client.0.smithi062.stdout:4/193: readlink d0/l1 0 2024-05-09T06:29:51.801 INFO:tasks.workunit.client.0.smithi062.stdout:1/193: dwrite d8/d14/f1b [0,4194304] 0 2024-05-09T06:29:51.801 INFO:tasks.workunit.client.0.smithi062.stdout:2/148: dwrite d0/fa [0,4194304] 0 2024-05-09T06:29:51.801 INFO:tasks.workunit.client.0.smithi062.stdout:2/149: fsync d0/f6 0 2024-05-09T06:29:51.802 INFO:tasks.workunit.client.0.smithi062.stdout:3/152: dwrite d1/d1e/f10 [4194304,4194304] 0 2024-05-09T06:29:51.803 INFO:tasks.workunit.client.0.smithi062.stdout:4/194: dwrite d0/d9/fc [4194304,4194304] 0 2024-05-09T06:29:51.803 INFO:tasks.workunit.client.0.smithi062.stdout:4/195: truncate d0/d24/f37 158174 0 2024-05-09T06:29:51.819 INFO:tasks.workunit.client.0.smithi062.stdout:3/153: dwrite d1/d1e/f1d [0,4194304] 0 2024-05-09T06:29:51.819 INFO:tasks.workunit.client.0.smithi062.stdout:3/154: write d1/f1f [1214424,65489] 0 2024-05-09T06:29:51.840 INFO:tasks.workunit.client.0.smithi062.stdout:1/194: stat d8/c9 0 2024-05-09T06:29:51.847 INFO:tasks.workunit.client.0.smithi062.stdout:2/150: link d0/d9/d17/f1d d0/d9/dd/d1f/d21/f28 0 2024-05-09T06:29:51.855 INFO:tasks.workunit.client.0.smithi062.stdout:4/196: rename d0/d24/f37 to d0/f3d 0 2024-05-09T06:29:51.855 INFO:tasks.workunit.client.0.smithi062.stdout:4/197: write d0/d2a/f1d [841286,1341] 0 2024-05-09T06:29:51.858 INFO:tasks.workunit.client.0.smithi062.stdout:3/155: symlink d1/d1e/l2e 0 2024-05-09T06:29:51.858 INFO:tasks.workunit.client.0.smithi062.stdout:3/156: creat d1/f2f x:0 0 0 2024-05-09T06:29:51.866 INFO:tasks.workunit.client.0.smithi062.stdout:3/157: dread d1/d1e/ff [0,4194304] 0 2024-05-09T06:29:51.868 INFO:tasks.workunit.client.0.smithi062.stdout:1/195: dwrite f6 [4194304,4194304] 0 2024-05-09T06:29:51.878 INFO:tasks.workunit.client.0.smithi062.stdout:4/198: creat d0/d9/f3e x:0 0 0 2024-05-09T06:29:51.882 INFO:tasks.workunit.client.0.smithi062.stdout:1/196: unlink d8/l12 0 2024-05-09T06:29:51.884 INFO:tasks.workunit.client.0.smithi062.stdout:1/197: mkdir d8/d14/d2b/d3c 0 2024-05-09T06:29:51.885 INFO:tasks.workunit.client.0.smithi062.stdout:1/198: write d8/d2c/d2f/f34 [431223,24911] 0 2024-05-09T06:29:51.886 INFO:tasks.workunit.client.0.smithi062.stdout:1/199: mkdir d8/d14/d2b/d3d 0 2024-05-09T06:29:51.893 INFO:tasks.workunit.client.0.smithi062.stdout:3/158: dwrite d1/d1e/f25 [0,4194304] 0 2024-05-09T06:29:51.896 INFO:tasks.workunit.client.0.smithi062.stdout:4/199: dwrite d0/d2a/f3 [0,4194304] 0 2024-05-09T06:29:51.904 INFO:tasks.workunit.client.0.smithi062.stdout:4/200: symlink d0/l3f 0 2024-05-09T06:29:51.906 INFO:tasks.workunit.client.0.smithi062.stdout:4/201: unlink d0/d2a/ca 0 2024-05-09T06:29:51.906 INFO:tasks.workunit.client.0.smithi062.stdout:4/202: chown d0/d2a/d1f 0 1 2024-05-09T06:29:51.917 INFO:tasks.workunit.client.0.smithi062.stdout:1/200: dwrite d8/d2c/d2f/f34 [0,4194304] 0 2024-05-09T06:29:51.917 INFO:tasks.workunit.client.0.smithi062.stdout:1/201: fsync d8/d1d/f24 0 2024-05-09T06:29:51.917 INFO:tasks.workunit.client.0.smithi062.stdout:1/202: stat f5 0 2024-05-09T06:29:51.917 INFO:tasks.workunit.client.0.smithi062.stdout:1/203: chown d8 364365778 1 2024-05-09T06:29:51.917 INFO:tasks.workunit.client.0.smithi062.stdout:8/253: getdents da/d11 0 2024-05-09T06:29:51.922 INFO:tasks.workunit.client.0.smithi062.stdout:1/204: mkdir d8/d14/d2b/d3d/d3e 0 2024-05-09T06:29:51.922 INFO:tasks.workunit.client.0.smithi062.stdout:1/205: write d8/d14/f1e [967654,109424] 0 2024-05-09T06:29:51.922 INFO:tasks.workunit.client.0.smithi062.stdout:1/206: chown d8/f13 253609 1 2024-05-09T06:29:51.924 INFO:tasks.workunit.client.0.smithi062.stdout:2/151: truncate d0/fa 2503091 0 2024-05-09T06:29:51.925 INFO:tasks.workunit.client.0.smithi062.stdout:8/254: symlink da/l50 0 2024-05-09T06:29:51.927 INFO:tasks.workunit.client.0.smithi062.stdout:1/207: rename d8/d14/f35 to d8/f3f 0 2024-05-09T06:29:51.927 INFO:tasks.workunit.client.0.smithi062.stdout:1/208: fsync d8/d14/f1b 0 2024-05-09T06:29:51.936 INFO:tasks.workunit.client.0.smithi062.stdout:8/255: dread da/d11/f1d [0,4194304] 0 2024-05-09T06:29:51.939 INFO:tasks.workunit.client.0.smithi062.stdout:8/256: rename f6 to da/d11/d2e/d3a/f51 0 2024-05-09T06:29:51.944 INFO:tasks.workunit.client.0.smithi062.stdout:8/257: creat da/d11/d2e/d3a/f52 x:0 0 0 2024-05-09T06:29:51.944 INFO:tasks.workunit.client.0.smithi062.stdout:8/258: readlink da/d11/d1c/l27 0 2024-05-09T06:29:51.944 INFO:tasks.workunit.client.0.smithi062.stdout:8/259: write da/d11/d1c/f3e [365731,15473] 0 2024-05-09T06:29:51.944 INFO:tasks.workunit.client.0.smithi062.stdout:8/260: creat da/d11/d2e/f53 x:0 0 0 2024-05-09T06:29:51.944 INFO:tasks.workunit.client.0.smithi062.stdout:8/261: chown da/d11/d2e/d3a/l45 3956 1 2024-05-09T06:29:51.948 INFO:tasks.workunit.client.0.smithi062.stdout:8/262: dread f9 [0,4194304] 0 2024-05-09T06:29:51.950 INFO:tasks.workunit.client.0.smithi062.stdout:8/263: mknod da/d11/c54 0 2024-05-09T06:29:51.952 INFO:tasks.workunit.client.0.smithi062.stdout:8/264: creat da/d11/f55 x:0 0 0 2024-05-09T06:29:51.968 INFO:tasks.workunit.client.0.smithi062.stdout:8/265: dwrite da/d11/f2d [0,4194304] 0 2024-05-09T06:29:51.974 INFO:tasks.workunit.client.0.smithi062.stdout:8/266: dread da/d11/d2e/d3a/f51 [0,4194304] 0 2024-05-09T06:29:51.978 INFO:tasks.workunit.client.0.smithi062.stdout:8/267: mknod da/d11/d1c/c56 0 2024-05-09T06:29:51.978 INFO:tasks.workunit.client.0.smithi062.stdout:8/268: write da/d11/d2e/f4c [490654,121620] 0 2024-05-09T06:29:51.987 INFO:tasks.workunit.client.0.smithi062.stdout:5/172: sync 2024-05-09T06:29:51.988 INFO:tasks.workunit.client.0.smithi062.stdout:2/152: read d0/fa [1200155,76121] 0 2024-05-09T06:29:51.989 INFO:tasks.workunit.client.0.smithi062.stdout:2/153: stat d0/d9/dd/d1f 0 2024-05-09T06:29:51.990 INFO:tasks.workunit.client.0.smithi062.stdout:5/173: symlink d0/d8/d30/l43 0 2024-05-09T06:29:51.990 INFO:tasks.workunit.client.0.smithi062.stdout:5/174: creat d0/d8/f44 x:0 0 0 2024-05-09T06:29:51.995 INFO:tasks.workunit.client.0.smithi062.stdout:2/154: mkdir d0/d9/dd/d1f/d21/d29 0 2024-05-09T06:29:51.995 INFO:tasks.workunit.client.0.smithi062.stdout:2/155: write d0/fa [175786,106549] 0 2024-05-09T06:29:51.995 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:51 smithi079 ceph-mon[35268]: Deploying cephadm binary to smithi079 2024-05-09T06:29:51.996 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:51 smithi079 ceph-mon[35268]: Deploying cephadm binary to smithi062 2024-05-09T06:29:51.996 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:51 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:29:51.996 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:51 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:29:51.996 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:51 smithi079 ceph-mon[35268]: mgrmap e22: smithi079.genyri(active, since 1.0211s) 2024-05-09T06:29:51.996 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:51 smithi079 ceph-mon[35268]: pgmap v3: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail 2024-05-09T06:29:51.996 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:51 smithi079 ceph-mon[35268]: [09/May/2024:06:29:51] ENGINE Bus STARTING 2024-05-09T06:29:51.999 INFO:tasks.workunit.client.0.smithi062.stdout:5/175: mkdir d0/d8/d1c/d23/d31/d45 0 2024-05-09T06:29:52.001 INFO:tasks.workunit.client.0.smithi062.stdout:8/269: fsync da/d11/f55 0 2024-05-09T06:29:52.002 INFO:tasks.workunit.client.0.smithi062.stdout:2/156: mknod d0/d9/dd/d1f/d21/d29/c2a 0 2024-05-09T06:29:52.006 INFO:tasks.workunit.client.0.smithi062.stdout:5/176: mknod d0/d8/d30/c46 0 2024-05-09T06:29:52.009 INFO:tasks.workunit.client.0.smithi062.stdout:2/157: mknod d0/d9/dd/d1f/c2b 0 2024-05-09T06:29:52.012 INFO:tasks.workunit.client.0.smithi062.stdout:8/270: getdents da/d11/d2e 0 2024-05-09T06:29:52.014 INFO:tasks.workunit.client.0.smithi062.stdout:8/271: creat da/f57 x:0 0 0 2024-05-09T06:29:52.014 INFO:tasks.workunit.client.0.smithi062.stdout:8/272: fsync da/d11/f48 0 2024-05-09T06:29:52.014 INFO:tasks.workunit.client.0.smithi062.stdout:8/273: truncate da/f57 118982 0 2024-05-09T06:29:52.015 INFO:tasks.workunit.client.0.smithi062.stdout:8/274: truncate da/f14 42128 0 2024-05-09T06:29:52.015 INFO:tasks.workunit.client.0.smithi062.stdout:8/275: creat da/d11/f58 x:0 0 0 2024-05-09T06:29:52.020 INFO:tasks.workunit.client.0.smithi062.stdout:5/177: dwrite d0/d8/f41 [0,4194304] 0 2024-05-09T06:29:52.020 INFO:tasks.workunit.client.0.smithi062.stdout:5/178: dread - d0/f39 zero size 2024-05-09T06:29:52.020 INFO:tasks.workunit.client.0.smithi062.stdout:5/179: fdatasync d0/f39 0 2024-05-09T06:29:52.020 INFO:tasks.workunit.client.0.smithi062.stdout:5/180: readlink d0/d8/d30/l3d 0 2024-05-09T06:29:52.020 INFO:tasks.workunit.client.0.smithi062.stdout:5/181: read - d0/f39 zero size 2024-05-09T06:29:52.020 INFO:tasks.workunit.client.0.smithi062.stdout:5/182: dread - d0/d8/d1c/f32 zero size 2024-05-09T06:29:52.024 INFO:tasks.workunit.client.0.smithi062.stdout:5/183: mkdir d0/d8/d47 0 2024-05-09T06:29:52.024 INFO:tasks.workunit.client.0.smithi062.stdout:5/184: creat d0/d8/d1c/d23/f48 x:0 0 0 2024-05-09T06:29:52.028 INFO:tasks.workunit.client.0.smithi062.stdout:5/185: mknod d0/d3b/d3f/c49 0 2024-05-09T06:29:52.031 INFO:tasks.workunit.client.0.smithi062.stdout:5/186: rmdir d0/d3b/d3f 39 2024-05-09T06:29:52.031 INFO:tasks.workunit.client.0.smithi062.stdout:8/276: dwrite da/d11/f17 [0,4194304] 0 2024-05-09T06:29:52.033 INFO:tasks.workunit.client.0.smithi062.stdout:5/187: mkdir d0/d8/d30/d4a 0 2024-05-09T06:29:52.037 INFO:tasks.workunit.client.0.smithi062.stdout:5/188: creat d0/d8/d1c/d23/d42/f4b x:0 0 0 2024-05-09T06:29:52.038 INFO:tasks.workunit.client.0.smithi062.stdout:5/189: write d0/f2d [493791,129903] 0 2024-05-09T06:29:52.054 INFO:tasks.workunit.client.0.smithi062.stdout:8/277: dwrite da/d11/f1d [0,4194304] 0 2024-05-09T06:29:52.054 INFO:tasks.workunit.client.0.smithi062.stdout:8/278: read - da/d11/f3c zero size 2024-05-09T06:29:52.061 INFO:tasks.workunit.client.0.smithi062.stdout:5/190: dwrite d0/d8/f44 [0,4194304] 0 2024-05-09T06:29:52.067 INFO:tasks.workunit.client.0.smithi062.stdout:9/283: sync 2024-05-09T06:29:52.068 INFO:tasks.workunit.client.0.smithi062.stdout:7/246: sync 2024-05-09T06:29:52.068 INFO:tasks.workunit.client.0.smithi062.stdout:8/279: dwrite da/d11/f29 [0,4194304] 0 2024-05-09T06:29:52.070 INFO:tasks.workunit.client.0.smithi062.stdout:5/191: mknod d0/d8/d1c/d23/c4c 0 2024-05-09T06:29:52.071 INFO:tasks.workunit.client.0.smithi062.stdout:7/247: mknod d0/d12/c41 0 2024-05-09T06:29:52.071 INFO:tasks.workunit.client.0.smithi062.stdout:7/248: fsync d0/d3/f17 0 2024-05-09T06:29:52.071 INFO:tasks.workunit.client.0.smithi062.stdout:7/249: readlink d0/d12/l29 0 2024-05-09T06:29:52.073 INFO:tasks.workunit.client.0.smithi062.stdout:9/284: creat d3/d3e/d52/d58/d1c/d21/f67 x:0 0 0 2024-05-09T06:29:52.073 INFO:tasks.workunit.client.0.smithi062.stdout:9/285: write d3/f18 [3975481,30813] 0 2024-05-09T06:29:52.076 INFO:tasks.workunit.client.0.smithi062.stdout:5/192: creat d0/d8/d1c/d23/d3e/f4d x:0 0 0 2024-05-09T06:29:52.076 INFO:tasks.workunit.client.0.smithi062.stdout:5/193: dread - d0/d8/d1c/d23/f48 zero size 2024-05-09T06:29:52.080 INFO:tasks.workunit.client.0.smithi062.stdout:7/250: creat d0/d22/f42 x:0 0 0 2024-05-09T06:29:52.081 INFO:tasks.workunit.client.0.smithi062.stdout:9/286: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/f2c [0,4194304] 0 2024-05-09T06:29:52.086 INFO:tasks.workunit.client.0.smithi062.stdout:5/194: rename d0/d3b/d3f/l3c to d0/d8/d1c/d23/d3e/l4e 0 2024-05-09T06:29:52.086 INFO:tasks.workunit.client.0.smithi062.stdout:5/195: truncate d0/d8/f41 4382045 0 2024-05-09T06:29:52.087 INFO:tasks.workunit.client.0.smithi062.stdout:5/196: chown d0/d8/d1c/d2c/f33 1008610 1 2024-05-09T06:29:52.087 INFO:tasks.workunit.client.0.smithi062.stdout:5/197: chown d0/d8/d30/c46 31272560 1 2024-05-09T06:29:52.087 INFO:tasks.workunit.client.0.smithi062.stdout:5/198: creat d0/d8/d1c/d23/f4f x:0 0 0 2024-05-09T06:29:52.087 INFO:tasks.workunit.client.0.smithi062.stdout:9/287: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/f2d [0,4194304] 0 2024-05-09T06:29:52.087 INFO:tasks.workunit.client.0.smithi062.stdout:9/288: chown d3/f5 63 1 2024-05-09T06:29:52.087 INFO:tasks.workunit.client.0.smithi062.stdout:8/280: dwrite f7 [0,4194304] 0 2024-05-09T06:29:52.088 INFO:tasks.workunit.client.0.smithi062.stdout:9/289: dread d3/d3e/d52/d58/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:29:52.088 INFO:tasks.workunit.client.0.smithi062.stdout:5/199: truncate d0/d8/d1c/f20 326775 0 2024-05-09T06:29:52.091 INFO:tasks.workunit.client.0.smithi062.stdout:9/290: truncate d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f43 2927374 0 2024-05-09T06:29:52.091 INFO:tasks.workunit.client.0.smithi062.stdout:9/291: readlink d3/lf 0 2024-05-09T06:29:52.091 INFO:tasks.workunit.client.0.smithi062.stdout:5/200: symlink d0/d3b/d3f/l50 0 2024-05-09T06:29:52.092 INFO:tasks.workunit.client.0.smithi062.stdout:5/201: write d0/d8/d1c/f25 [835787,57422] 0 2024-05-09T06:29:52.092 INFO:tasks.workunit.client.0.smithi062.stdout:9/292: symlink d3/d3e/d52/d58/d1c/d1e/d41/l68 0 2024-05-09T06:29:52.094 INFO:tasks.workunit.client.0.smithi062.stdout:5/202: rename d0/d8/d1c/d23/c4c to d0/d8/d30/c51 0 2024-05-09T06:29:52.094 INFO:tasks.workunit.client.0.smithi062.stdout:5/203: truncate d0/d8/d1c/d23/f48 433216 0 2024-05-09T06:29:52.095 INFO:tasks.workunit.client.0.smithi062.stdout:9/293: mkdir d3/d20/d69 0 2024-05-09T06:29:52.098 INFO:tasks.workunit.client.0.smithi062.stdout:8/281: dread da/d11/f29 [0,4194304] 0 2024-05-09T06:29:52.103 INFO:tasks.workunit.client.0.smithi062.stdout:9/294: write d3/f19 [2483705,23131] 0 2024-05-09T06:29:52.103 INFO:tasks.workunit.client.0.smithi062.stdout:9/295: truncate d3/d3e/d52/d58/d1c/f66 63701 0 2024-05-09T06:29:52.119 INFO:tasks.workunit.client.0.smithi062.stdout:5/204: rmdir d0 39 2024-05-09T06:29:52.128 INFO:tasks.workunit.client.0.smithi062.stdout:9/296: dwrite d3/d3e/d52/d58/f48 [0,4194304] 0 2024-05-09T06:29:52.128 INFO:tasks.workunit.client.0.smithi062.stdout:8/282: dwrite da/d11/f26 [0,4194304] 0 2024-05-09T06:29:52.128 INFO:tasks.workunit.client.0.smithi062.stdout:9/297: fsync d3/d3e/d52/d58/d1c/f26 0 2024-05-09T06:29:52.135 INFO:tasks.workunit.client.0.smithi062.stdout:8/283: symlink da/d11/d2e/l59 0 2024-05-09T06:29:52.135 INFO:tasks.workunit.client.0.smithi062.stdout:5/205: dwrite d0/d8/d1c/d23/d3e/f4d [0,4194304] 0 2024-05-09T06:29:52.135 INFO:tasks.workunit.client.0.smithi062.stdout:5/206: readlink d0/d8/d1c/d23/d3e/l4e 0 2024-05-09T06:29:52.136 INFO:tasks.workunit.client.0.smithi062.stdout:8/284: symlink da/d11/d2e/d3a/l5a 0 2024-05-09T06:29:52.137 INFO:tasks.workunit.client.0.smithi062.stdout:5/207: dread d0/f28 [0,4194304] 0 2024-05-09T06:29:52.140 INFO:tasks.workunit.client.0.smithi062.stdout:5/208: creat d0/d8/f52 x:0 0 0 2024-05-09T06:29:52.140 INFO:tasks.workunit.client.0.smithi062.stdout:5/209: truncate d0/f39 629780 0 2024-05-09T06:29:52.154 INFO:tasks.workunit.client.0.smithi062.stdout:8/285: dwrite da/d11/f48 [0,4194304] 0 2024-05-09T06:29:52.157 INFO:tasks.workunit.client.0.smithi062.stdout:8/286: mkdir da/d11/d1c/d5b 0 2024-05-09T06:29:52.157 INFO:tasks.workunit.client.0.smithi062.stdout:8/287: fsync da/f13 0 2024-05-09T06:29:52.157 INFO:tasks.workunit.client.0.smithi062.stdout:8/288: dread - da/d11/d2e/d34/f3d zero size 2024-05-09T06:29:52.158 INFO:tasks.workunit.client.0.smithi062.stdout:8/289: mknod da/d11/d2e/d3a/c5c 0 2024-05-09T06:29:52.160 INFO:tasks.workunit.client.0.smithi062.stdout:8/290: rename da/d11/f48 to da/f5d 0 2024-05-09T06:29:52.160 INFO:tasks.workunit.client.0.smithi062.stdout:5/210: dwrite d0/d8/d1c/f25 [0,4194304] 0 2024-05-09T06:29:52.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:51 smithi062 ceph-mon[26920]: Deploying cephadm binary to smithi079 2024-05-09T06:29:52.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:51 smithi062 ceph-mon[26920]: Deploying cephadm binary to smithi062 2024-05-09T06:29:52.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:51 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:29:52.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:51 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:29:52.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:51 smithi062 ceph-mon[26920]: mgrmap e22: smithi079.genyri(active, since 1.0211s) 2024-05-09T06:29:52.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:51 smithi062 ceph-mon[26920]: pgmap v3: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail 2024-05-09T06:29:52.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:51 smithi062 ceph-mon[26920]: [09/May/2024:06:29:51] ENGINE Bus STARTING 2024-05-09T06:29:52.181 INFO:tasks.workunit.client.0.smithi062.stdout:5/211: mknod d0/d8/d1c/d23/d31/d45/c53 0 2024-05-09T06:29:52.182 INFO:tasks.workunit.client.0.smithi062.stdout:5/212: write d0/d8/d1c/f20 [239170,55769] 0 2024-05-09T06:29:52.182 INFO:tasks.workunit.client.0.smithi062.stdout:8/291: rmdir da/d11/d1c 39 2024-05-09T06:29:52.185 INFO:tasks.workunit.client.0.smithi062.stdout:5/213: symlink d0/d3b/d3f/l54 0 2024-05-09T06:29:52.186 INFO:tasks.workunit.client.0.smithi062.stdout:8/292: symlink da/d11/d2e/l5e 0 2024-05-09T06:29:52.190 INFO:tasks.workunit.client.0.smithi062.stdout:8/293: symlink da/d11/d2e/d34/l5f 0 2024-05-09T06:29:52.190 INFO:tasks.workunit.client.0.smithi062.stdout:8/294: chown da/d11/d2e/d3a/f51 113935558 1 2024-05-09T06:29:52.190 INFO:tasks.workunit.client.0.smithi062.stdout:8/295: chown da/d11/d2e/d3a/f51 62937228 1 2024-05-09T06:29:52.193 INFO:tasks.workunit.client.0.smithi062.stdout:8/296: rmdir da/d11/d1c/d5b 0 2024-05-09T06:29:52.194 INFO:tasks.workunit.client.0.smithi062.stdout:5/214: write d0/d8/f41 [3780316,27101] 0 2024-05-09T06:29:52.195 INFO:tasks.workunit.client.0.smithi062.stdout:8/297: symlink da/d11/d1c/l60 0 2024-05-09T06:29:52.195 INFO:tasks.workunit.client.0.smithi062.stdout:8/298: truncate da/d11/f55 1028710 0 2024-05-09T06:29:52.197 INFO:tasks.workunit.client.0.smithi062.stdout:5/215: dread d0/d8/d1c/d23/d31/f12 [0,4194304] 0 2024-05-09T06:29:52.197 INFO:tasks.workunit.client.0.smithi062.stdout:5/216: fsync d0/d8/d1c/d23/f48 0 2024-05-09T06:29:52.197 INFO:tasks.workunit.client.0.smithi062.stdout:5/217: readlink d0/l35 0 2024-05-09T06:29:52.197 INFO:tasks.workunit.client.0.smithi062.stdout:5/218: chown d0/d8/d30 389629 1 2024-05-09T06:29:52.199 INFO:tasks.workunit.client.0.smithi062.stdout:5/219: symlink d0/d8/d1c/d23/d3e/l55 0 2024-05-09T06:29:52.199 INFO:tasks.workunit.client.0.smithi062.stdout:5/220: chown d0/f2d 100687005 1 2024-05-09T06:29:52.199 INFO:tasks.workunit.client.0.smithi062.stdout:5/221: write d0/d8/d1c/d23/d31/d5/f36 [393256,67953] 0 2024-05-09T06:29:52.200 INFO:tasks.workunit.client.0.smithi062.stdout:5/222: chown d0/d8/c34 0 1 2024-05-09T06:29:52.201 INFO:tasks.workunit.client.0.smithi062.stdout:5/223: rename d0/d8/d1c/d23/d31 to d0/d56 0 2024-05-09T06:29:52.201 INFO:tasks.workunit.client.0.smithi062.stdout:5/224: fdatasync d0/d8/d1c/d23/f48 0 2024-05-09T06:29:52.202 INFO:tasks.workunit.client.0.smithi062.stdout:5/225: creat d0/d56/d5/f57 x:0 0 0 2024-05-09T06:29:52.210 INFO:tasks.workunit.client.0.smithi062.stdout:6/220: sync 2024-05-09T06:29:52.210 INFO:tasks.workunit.client.0.smithi062.stdout:3/159: sync 2024-05-09T06:29:52.210 INFO:tasks.workunit.client.0.smithi062.stdout:0/177: sync 2024-05-09T06:29:52.210 INFO:tasks.workunit.client.0.smithi062.stdout:6/221: stat dc/d28/d34 0 2024-05-09T06:29:52.212 INFO:tasks.workunit.client.0.smithi062.stdout:0/178: symlink d1/d25/d31/l40 0 2024-05-09T06:29:52.212 INFO:tasks.workunit.client.0.smithi062.stdout:0/179: chown d1/d18/f1d 16882 1 2024-05-09T06:29:52.216 INFO:tasks.workunit.client.0.smithi062.stdout:6/222: dread dc/d28/d46/d3a/d4c/f27 [0,4194304] 0 2024-05-09T06:29:52.217 INFO:tasks.workunit.client.0.smithi062.stdout:6/223: mkdir dc/d28/d34/d4e 0 2024-05-09T06:29:52.221 INFO:tasks.workunit.client.0.smithi062.stdout:0/180: read d1/fd [2506766,84049] 0 2024-05-09T06:29:52.222 INFO:tasks.workunit.client.0.smithi062.stdout:0/181: truncate d1/f16 3531764 0 2024-05-09T06:29:52.222 INFO:tasks.workunit.client.0.smithi062.stdout:0/182: rename d1/d18 to d1/d18/d41 22 2024-05-09T06:29:52.224 INFO:tasks.workunit.client.0.smithi062.stdout:0/183: mkdir d1/d39/d42 0 2024-05-09T06:29:52.225 INFO:tasks.workunit.client.0.smithi062.stdout:0/184: read d1/f17 [3350398,128390] 0 2024-05-09T06:29:52.226 INFO:tasks.workunit.client.0.smithi062.stdout:0/185: mkdir d1/d39/d42/d43 0 2024-05-09T06:29:52.232 INFO:tasks.workunit.client.0.smithi062.stdout:0/186: dread d1/f38 [0,4194304] 0 2024-05-09T06:29:52.236 INFO:tasks.workunit.client.0.smithi062.stdout:6/224: write dc/d28/d10/d20/f31 [2583186,66302] 0 2024-05-09T06:29:52.236 INFO:tasks.workunit.client.0.smithi062.stdout:5/226: dwrite d0/d8/d1c/f20 [0,4194304] 0 2024-05-09T06:29:52.236 INFO:tasks.workunit.client.0.smithi062.stdout:5/227: truncate d0/d8/d1c/d23/f48 794433 0 2024-05-09T06:29:52.236 INFO:tasks.workunit.client.0.smithi062.stdout:3/160: dwrite d1/d1e/d26/f2b [0,4194304] 0 2024-05-09T06:29:52.238 INFO:tasks.workunit.client.0.smithi062.stdout:6/225: creat dc/d28/d46/d3a/f4f x:0 0 0 2024-05-09T06:29:52.238 INFO:tasks.workunit.client.0.smithi062.stdout:6/226: creat dc/d28/d34/f50 x:0 0 0 2024-05-09T06:29:52.238 INFO:tasks.workunit.client.0.smithi062.stdout:6/227: fdatasync dc/d28/d46/f29 0 2024-05-09T06:29:52.252 INFO:tasks.workunit.client.0.smithi062.stdout:0/187: dwrite d1/f1b [0,4194304] 0 2024-05-09T06:29:52.260 INFO:tasks.workunit.client.0.smithi062.stdout:0/188: getdents d1/d39 0 2024-05-09T06:29:52.260 INFO:tasks.workunit.client.0.smithi062.stdout:0/189: fdatasync d1/d25/f2f 0 2024-05-09T06:29:52.261 INFO:tasks.workunit.client.0.smithi062.stdout:0/190: stat d1/fc 0 2024-05-09T06:29:52.269 INFO:tasks.workunit.client.0.smithi062.stdout:3/161: dwrite d1/d1e/d26/f29 [0,4194304] 0 2024-05-09T06:29:52.269 INFO:tasks.workunit.client.0.smithi062.stdout:5/228: dwrite d0/d8/d1c/d2c/f33 [0,4194304] 0 2024-05-09T06:29:52.269 INFO:tasks.workunit.client.0.smithi062.stdout:5/229: write d0/f28 [915060,15971] 0 2024-05-09T06:29:52.276 INFO:tasks.workunit.client.0.smithi062.stdout:0/191: dread d1/f16 [0,4194304] 0 2024-05-09T06:29:52.282 INFO:tasks.workunit.client.0.smithi062.stdout:3/162: write d1/d1e/ff [307761,105937] 0 2024-05-09T06:29:52.284 INFO:tasks.workunit.client.0.smithi062.stdout:5/230: mknod d0/d8/d1c/c58 0 2024-05-09T06:29:52.284 INFO:tasks.workunit.client.0.smithi062.stdout:5/231: chown d0/d56/l2e 7 1 2024-05-09T06:29:52.289 INFO:tasks.workunit.client.0.smithi062.stdout:3/163: creat d1/d1e/f30 x:0 0 0 2024-05-09T06:29:52.290 INFO:tasks.workunit.client.0.smithi062.stdout:3/164: stat d1/f2f 0 2024-05-09T06:29:52.290 INFO:tasks.workunit.client.0.smithi062.stdout:5/232: mknod d0/d56/d5/c59 0 2024-05-09T06:29:52.293 INFO:tasks.workunit.client.0.smithi062.stdout:3/165: symlink d1/l31 0 2024-05-09T06:29:52.294 INFO:tasks.workunit.client.0.smithi062.stdout:5/233: symlink d0/d8/d1c/d2c/l5a 0 2024-05-09T06:29:52.296 INFO:tasks.workunit.client.0.smithi062.stdout:3/166: mknod d1/d1e/c32 0 2024-05-09T06:29:52.297 INFO:tasks.workunit.client.0.smithi062.stdout:5/234: rename d0/f39 to d0/d8/d1c/d23/f5b 0 2024-05-09T06:29:52.300 INFO:tasks.workunit.client.0.smithi062.stdout:5/235: link d0/d8/d1c/f32 d0/f5c 0 2024-05-09T06:29:52.306 INFO:tasks.workunit.client.0.smithi062.stdout:0/192: dwrite d1/f2c [0,4194304] 0 2024-05-09T06:29:52.306 INFO:tasks.workunit.client.0.smithi062.stdout:3/167: write d1/f3 [7791528,4752] 0 2024-05-09T06:29:52.307 INFO:tasks.workunit.client.0.smithi062.stdout:0/193: mkdir d1/d32/d44 0 2024-05-09T06:29:52.308 INFO:tasks.workunit.client.0.smithi062.stdout:3/168: mkdir d1/d1e/d26/d33 0 2024-05-09T06:29:52.309 INFO:tasks.workunit.client.0.smithi062.stdout:3/169: write d1/d1e/ff [5363196,128658] 0 2024-05-09T06:29:52.309 INFO:tasks.workunit.client.0.smithi062.stdout:3/170: write d1/f1f [1459448,54713] 0 2024-05-09T06:29:52.310 INFO:tasks.workunit.client.0.smithi062.stdout:0/194: creat d1/d39/d42/d43/f45 x:0 0 0 2024-05-09T06:29:52.310 INFO:tasks.workunit.client.0.smithi062.stdout:0/195: dread - d1/d18/f34 zero size 2024-05-09T06:29:52.312 INFO:tasks.workunit.client.0.smithi062.stdout:0/196: link d1/f14 d1/d25/d31/f46 0 2024-05-09T06:29:52.319 INFO:tasks.workunit.client.0.smithi062.stdout:3/171: dread d1/d1e/f1d [0,4194304] 0 2024-05-09T06:29:52.322 INFO:tasks.workunit.client.0.smithi062.stdout:1/209: sync 2024-05-09T06:29:52.322 INFO:tasks.workunit.client.0.smithi062.stdout:7/251: sync 2024-05-09T06:29:52.322 INFO:tasks.workunit.client.0.smithi062.stdout:2/158: sync 2024-05-09T06:29:52.322 INFO:tasks.workunit.client.0.smithi062.stdout:4/203: sync 2024-05-09T06:29:52.323 INFO:tasks.workunit.client.0.smithi062.stdout:5/236: dwrite d0/d8/d1c/f20 [0,4194304] 0 2024-05-09T06:29:52.323 INFO:tasks.workunit.client.0.smithi062.stdout:5/237: write d0/d56/d5/f36 [1360349,33083] 0 2024-05-09T06:29:52.325 INFO:tasks.workunit.client.0.smithi062.stdout:7/252: unlink d0/f3d 0 2024-05-09T06:29:52.328 INFO:tasks.workunit.client.0.smithi062.stdout:0/197: dread d1/f19 [0,4194304] 0 2024-05-09T06:29:52.330 INFO:tasks.workunit.client.0.smithi062.stdout:2/159: dread d0/d9/dd/f1c [0,4194304] 0 2024-05-09T06:29:52.334 INFO:tasks.workunit.client.0.smithi062.stdout:2/160: symlink d0/l2c 0 2024-05-09T06:29:52.336 INFO:tasks.workunit.client.0.smithi062.stdout:7/253: read d0/d12/d33/f36 [3964838,116840] 0 2024-05-09T06:29:52.338 INFO:tasks.workunit.client.0.smithi062.stdout:2/161: link d0/l2c d0/d9/dd/l2d 0 2024-05-09T06:29:52.339 INFO:tasks.workunit.client.0.smithi062.stdout:2/162: symlink d0/d9/d17/l2e 0 2024-05-09T06:29:52.340 INFO:tasks.workunit.client.0.smithi062.stdout:7/254: write d0/f16 [302534,44976] 0 2024-05-09T06:29:52.340 INFO:tasks.workunit.client.0.smithi062.stdout:7/255: getdents d0/d3a/d3f 0 2024-05-09T06:29:52.340 INFO:tasks.workunit.client.0.smithi062.stdout:0/198: dread d1/f14 [0,4194304] 0 2024-05-09T06:29:52.342 INFO:tasks.workunit.client.0.smithi062.stdout:7/256: creat d0/d12/f43 x:0 0 0 2024-05-09T06:29:52.342 INFO:tasks.workunit.client.0.smithi062.stdout:7/257: write d0/d22/f23 [2662121,64296] 0 2024-05-09T06:29:52.342 INFO:tasks.workunit.client.0.smithi062.stdout:7/258: fsync d0/d12/d33/f3c 0 2024-05-09T06:29:52.351 INFO:tasks.workunit.client.0.smithi062.stdout:0/199: dread d1/f17 [0,4194304] 0 2024-05-09T06:29:52.351 INFO:tasks.workunit.client.0.smithi062.stdout:0/200: write d1/d39/d42/d43/f45 [926315,117717] 0 2024-05-09T06:29:52.353 INFO:tasks.workunit.client.0.smithi062.stdout:1/210: dwrite d8/d1d/f24 [0,4194304] 0 2024-05-09T06:29:52.353 INFO:tasks.workunit.client.0.smithi062.stdout:3/172: dwrite d1/d1e/f14 [0,4194304] 0 2024-05-09T06:29:52.354 INFO:tasks.workunit.client.0.smithi062.stdout:5/238: dread d0/d56/d5/f36 [0,4194304] 0 2024-05-09T06:29:52.354 INFO:tasks.workunit.client.0.smithi062.stdout:4/204: dwrite d0/d2a/d14/f26 [0,4194304] 0 2024-05-09T06:29:52.354 INFO:tasks.workunit.client.0.smithi062.stdout:4/205: fsync d0/f17 0 2024-05-09T06:29:52.354 INFO:tasks.workunit.client.0.smithi062.stdout:0/201: mknod d1/d39/d42/c47 0 2024-05-09T06:29:52.354 INFO:tasks.workunit.client.0.smithi062.stdout:2/163: write d0/f6 [1950271,126609] 0 2024-05-09T06:29:52.359 INFO:tasks.workunit.client.0.smithi062.stdout:3/173: creat d1/d1e/d26/d33/f34 x:0 0 0 2024-05-09T06:29:52.361 INFO:tasks.workunit.client.0.smithi062.stdout:7/259: dwrite d0/d22/f42 [0,4194304] 0 2024-05-09T06:29:52.364 INFO:tasks.workunit.client.0.smithi062.stdout:5/239: creat d0/d8/d18/f5d x:0 0 0 2024-05-09T06:29:52.365 INFO:tasks.workunit.client.0.smithi062.stdout:1/211: dread d8/f13 [0,4194304] 0 2024-05-09T06:29:52.365 INFO:tasks.workunit.client.0.smithi062.stdout:1/212: dread - d8/d1d/f26 zero size 2024-05-09T06:29:52.368 INFO:tasks.workunit.client.0.smithi062.stdout:4/206: symlink d0/d24/l40 0 2024-05-09T06:29:52.371 INFO:tasks.workunit.client.0.smithi062.stdout:0/202: mkdir d1/d18/d48 0 2024-05-09T06:29:52.377 INFO:tasks.workunit.client.0.smithi062.stdout:4/207: dread d0/d2a/f4 [0,4194304] 0 2024-05-09T06:29:52.378 INFO:tasks.workunit.client.0.smithi062.stdout:3/174: mknod d1/d1e/c35 0 2024-05-09T06:29:52.381 INFO:tasks.workunit.client.0.smithi062.stdout:5/240: dwrite d0/d8/d1c/d23/f48 [0,4194304] 0 2024-05-09T06:29:52.387 INFO:tasks.workunit.client.0.smithi062.stdout:3/175: dread d1/d1e/f25 [0,4194304] 0 2024-05-09T06:29:52.394 INFO:tasks.workunit.client.0.smithi062.stdout:1/213: mknod d8/d14/d2b/d3d/d3e/c40 0 2024-05-09T06:29:52.397 INFO:tasks.workunit.client.0.smithi062.stdout:2/164: rename d0/d9/dd/d1f/l27 to d0/l2f 0 2024-05-09T06:29:52.399 INFO:tasks.workunit.client.0.smithi062.stdout:4/208: unlink d0/d2a/d8/df/f2d 0 2024-05-09T06:29:52.399 INFO:tasks.workunit.client.0.smithi062.stdout:4/209: write d0/d2a/f25 [1167556,25180] 0 2024-05-09T06:29:52.402 INFO:tasks.workunit.client.0.smithi062.stdout:5/241: dwrite d0/d8/d1c/f25 [0,4194304] 0 2024-05-09T06:29:52.407 INFO:tasks.workunit.client.0.smithi062.stdout:5/242: dread d0/d8/f41 [0,4194304] 0 2024-05-09T06:29:52.408 INFO:tasks.workunit.client.0.smithi062.stdout:7/260: rename d0/d3/f2a to d0/d22/f44 0 2024-05-09T06:29:52.408 INFO:tasks.workunit.client.0.smithi062.stdout:4/210: dread d0/f17 [0,4194304] 0 2024-05-09T06:29:52.408 INFO:tasks.workunit.client.0.smithi062.stdout:4/211: chown d0/l1 145 1 2024-05-09T06:29:52.413 INFO:tasks.workunit.client.0.smithi062.stdout:3/176: rmdir d1/d1e 39 2024-05-09T06:29:52.415 INFO:tasks.workunit.client.0.smithi062.stdout:7/261: mknod d0/d3a/d3f/c45 0 2024-05-09T06:29:52.415 INFO:tasks.workunit.client.0.smithi062.stdout:7/262: creat d0/d12/d33/f46 x:0 0 0 2024-05-09T06:29:52.416 INFO:tasks.workunit.client.0.smithi062.stdout:4/212: creat d0/d2a/d8/df/d28/f41 x:0 0 0 2024-05-09T06:29:52.419 INFO:tasks.workunit.client.0.smithi062.stdout:3/177: mkdir d1/d1e/d36 0 2024-05-09T06:29:52.419 INFO:tasks.workunit.client.0.smithi062.stdout:1/214: dwrite d8/d14/f32 [0,4194304] 0 2024-05-09T06:29:52.420 INFO:tasks.workunit.client.0.smithi062.stdout:9/298: sync 2024-05-09T06:29:52.420 INFO:tasks.workunit.client.0.smithi062.stdout:8/299: sync 2024-05-09T06:29:52.420 INFO:tasks.workunit.client.0.smithi062.stdout:6/228: sync 2024-05-09T06:29:52.420 INFO:tasks.workunit.client.0.smithi062.stdout:6/229: write dc/f13 [5635916,51691] 0 2024-05-09T06:29:52.420 INFO:tasks.workunit.client.0.smithi062.stdout:6/230: readlink dc/l2d 0 2024-05-09T06:29:52.421 INFO:tasks.workunit.client.0.smithi062.stdout:0/203: rename d1/d39 to d1/d25/d49 0 2024-05-09T06:29:52.421 INFO:tasks.workunit.client.0.smithi062.stdout:0/204: write d1/fd [3722948,73227] 0 2024-05-09T06:29:52.423 INFO:tasks.workunit.client.0.smithi062.stdout:4/213: dread - d0/d9/f15 zero size 2024-05-09T06:29:52.423 INFO:tasks.workunit.client.0.smithi062.stdout:2/165: dwrite d0/d9/dd/f1c [0,4194304] 0 2024-05-09T06:29:52.424 INFO:tasks.workunit.client.0.smithi062.stdout:5/243: dwrite d0/d8/d1c/f25 [4194304,4194304] 0 2024-05-09T06:29:52.426 INFO:tasks.workunit.client.0.smithi062.stdout:3/178: creat d1/d1e/d26/f37 x:0 0 0 2024-05-09T06:29:52.428 INFO:tasks.workunit.client.0.smithi062.stdout:7/263: dread d0/d3/f2d [0,4194304] 0 2024-05-09T06:29:52.430 INFO:tasks.workunit.client.0.smithi062.stdout:1/215: mkdir d8/d2c/d41 0 2024-05-09T06:29:52.433 INFO:tasks.workunit.client.0.smithi062.stdout:8/300: mkdir da/d11/d2e/d61 0 2024-05-09T06:29:52.435 INFO:tasks.workunit.client.0.smithi062.stdout:2/166: dread d0/f15 [0,4194304] 0 2024-05-09T06:29:52.436 INFO:tasks.workunit.client.0.smithi062.stdout:2/167: stat d0/d9/d17/f1d 0 2024-05-09T06:29:52.436 INFO:tasks.workunit.client.0.smithi062.stdout:6/231: creat dc/d28/d10/d20/f51 x:0 0 0 2024-05-09T06:29:52.436 INFO:tasks.workunit.client.0.smithi062.stdout:0/205: truncate d1/d25/d31/f46 525550 0 2024-05-09T06:29:52.439 INFO:tasks.workunit.client.0.smithi062.stdout:5/244: dread d0/d8/d1c/d23/d3e/f4d [0,4194304] 0 2024-05-09T06:29:52.439 INFO:tasks.workunit.client.0.smithi062.stdout:5/245: chown d0/d56/d5 35154937 1 2024-05-09T06:29:52.442 INFO:tasks.workunit.client.0.smithi062.stdout:3/179: link d1/l23 d1/d2d/l38 0 2024-05-09T06:29:52.444 INFO:tasks.workunit.client.0.smithi062.stdout:7/264: creat d0/d3a/f47 x:0 0 0 2024-05-09T06:29:52.446 INFO:tasks.workunit.client.0.smithi062.stdout:1/216: symlink d8/d14/d2b/d3d/d3e/l42 0 2024-05-09T06:29:52.447 INFO:tasks.workunit.client.0.smithi062.stdout:5/246: dread d0/d8/d1c/f20 [0,4194304] 0 2024-05-09T06:29:52.447 INFO:tasks.workunit.client.0.smithi062.stdout:9/299: rmdir d3/d3e/d52/d58/d1c/d1e/d41 39 2024-05-09T06:29:52.449 INFO:tasks.workunit.client.0.smithi062.stdout:8/301: symlink da/l62 0 2024-05-09T06:29:52.451 INFO:tasks.workunit.client.0.smithi062.stdout:2/168: truncate d0/f15 8053903 0 2024-05-09T06:29:52.451 INFO:tasks.workunit.client.0.smithi062.stdout:2/169: fsync d0/d9/dd/f1c 0 2024-05-09T06:29:52.452 INFO:tasks.workunit.client.0.smithi062.stdout:6/232: symlink dc/d28/l52 0 2024-05-09T06:29:52.452 INFO:tasks.workunit.client.0.smithi062.stdout:6/233: chown dc/d28/d10/c3f 895 1 2024-05-09T06:29:52.456 INFO:tasks.workunit.client.0.smithi062.stdout:0/206: rename d1/f38 to d1/d32/d44/f4a 0 2024-05-09T06:29:52.457 INFO:tasks.workunit.client.0.smithi062.stdout:4/214: rmdir d0/d9 39 2024-05-09T06:29:52.457 INFO:tasks.workunit.client.0.smithi062.stdout:4/215: chown d0/d2a/d14/f26 15393 1 2024-05-09T06:29:52.457 INFO:tasks.workunit.client.0.smithi062.stdout:0/207: dread d1/d32/d44/f4a [0,4194304] 0 2024-05-09T06:29:52.457 INFO:tasks.workunit.client.0.smithi062.stdout:0/208: stat d1/d18/f1d 0 2024-05-09T06:29:52.459 INFO:tasks.workunit.client.0.smithi062.stdout:2/170: dread d0/d9/dd/f1a [0,4194304] 0 2024-05-09T06:29:52.460 INFO:tasks.workunit.client.0.smithi062.stdout:0/209: dread d1/d25/d31/f46 [0,4194304] 0 2024-05-09T06:29:52.461 INFO:tasks.workunit.client.0.smithi062.stdout:3/180: rmdir d1/d1e/d26/d33 39 2024-05-09T06:29:52.466 INFO:tasks.workunit.client.0.smithi062.stdout:7/265: link d0/d12/l29 d0/d12/d33/l48 0 2024-05-09T06:29:52.469 INFO:tasks.workunit.client.0.smithi062.stdout:1/217: creat d8/d2c/f43 x:0 0 0 2024-05-09T06:29:52.472 INFO:tasks.workunit.client.0.smithi062.stdout:5/247: symlink d0/d8/d18/l5e 0 2024-05-09T06:29:52.472 INFO:tasks.workunit.client.0.smithi062.stdout:9/300: stat d3/d3e/d52/d58/d1c/d1e/d41/l62 0 2024-05-09T06:29:52.474 INFO:tasks.workunit.client.0.smithi062.stdout:8/302: creat da/d11/d2e/d61/f63 x:0 0 0 2024-05-09T06:29:52.476 INFO:tasks.workunit.client.0.smithi062.stdout:6/234: unlink dc/d28/d34/l45 0 2024-05-09T06:29:52.477 INFO:tasks.workunit.client.0.smithi062.stdout:7/266: mknod d0/d12/c49 0 2024-05-09T06:29:52.480 INFO:tasks.workunit.client.0.smithi062.stdout:1/218: rename d8/d2c/d2f to d8/d14/d2b/d3c/d44 0 2024-05-09T06:29:52.480 INFO:tasks.workunit.client.0.smithi062.stdout:5/248: mknod d0/d8/d1c/d2c/c5f 0 2024-05-09T06:29:52.481 INFO:tasks.workunit.client.0.smithi062.stdout:8/303: mkdir da/d11/d2e/d61/d64 0 2024-05-09T06:29:52.481 INFO:tasks.workunit.client.0.smithi062.stdout:8/304: creat da/d11/d2e/d34/f65 x:0 0 0 2024-05-09T06:29:52.482 INFO:tasks.workunit.client.0.smithi062.stdout:3/181: getdents d1/d1e/d26 0 2024-05-09T06:29:52.484 INFO:tasks.workunit.client.0.smithi062.stdout:9/301: read d3/f16 [2477214,80432] 0 2024-05-09T06:29:52.484 INFO:tasks.workunit.client.0.smithi062.stdout:9/302: creat d3/d3e/d52/d58/d1c/f6a x:0 0 0 2024-05-09T06:29:52.484 INFO:tasks.workunit.client.0.smithi062.stdout:9/303: chown d3/d3e/d52/d58/d1c/d1e/d41/d64/c30 12500 1 2024-05-09T06:29:52.484 INFO:tasks.workunit.client.0.smithi062.stdout:1/219: getdents d8/d14/d2b/d3c/d44/d38 0 2024-05-09T06:29:52.484 INFO:tasks.workunit.client.0.smithi062.stdout:1/220: creat d8/d2c/f45 x:0 0 0 2024-05-09T06:29:52.485 INFO:tasks.workunit.client.0.smithi062.stdout:5/249: mknod d0/d8/d1c/c60 0 2024-05-09T06:29:52.485 INFO:tasks.workunit.client.0.smithi062.stdout:5/250: chown d0/d8/d1c/d23/d3e/c40 2 1 2024-05-09T06:29:52.485 INFO:tasks.workunit.client.0.smithi062.stdout:3/182: stat d1/c12 0 2024-05-09T06:29:52.488 INFO:tasks.workunit.client.0.smithi062.stdout:9/304: creat d3/d3e/d52/d58/f6b x:0 0 0 2024-05-09T06:29:52.489 INFO:tasks.workunit.client.0.smithi062.stdout:7/267: dread d0/f1b [0,4194304] 0 2024-05-09T06:29:52.489 INFO:tasks.workunit.client.0.smithi062.stdout:1/221: stat d8/ld 0 2024-05-09T06:29:52.491 INFO:tasks.workunit.client.0.smithi062.stdout:5/251: symlink d0/d8/d30/l61 0 2024-05-09T06:29:52.491 INFO:tasks.workunit.client.0.smithi062.stdout:5/252: fsync d0/d8/d1c/f25 0 2024-05-09T06:29:52.492 INFO:tasks.workunit.client.0.smithi062.stdout:3/183: creat d1/d1e/f39 x:0 0 0 2024-05-09T06:29:52.492 INFO:tasks.workunit.client.0.smithi062.stdout:3/184: write d1/f21 [947219,42514] 0 2024-05-09T06:29:52.492 INFO:tasks.workunit.client.0.smithi062.stdout:3/185: write d1/f27 [4793778,60687] 0 2024-05-09T06:29:52.492 INFO:tasks.workunit.client.0.smithi062.stdout:3/186: stat d1/d1e/f14 0 2024-05-09T06:29:52.494 INFO:tasks.workunit.client.0.smithi062.stdout:7/268: mknod d0/d12/c4a 0 2024-05-09T06:29:52.494 INFO:tasks.workunit.client.0.smithi062.stdout:7/269: stat d0/c11 0 2024-05-09T06:29:52.494 INFO:tasks.workunit.client.0.smithi062.stdout:7/270: creat d0/f4b x:0 0 0 2024-05-09T06:29:52.495 INFO:tasks.workunit.client.0.smithi062.stdout:5/253: creat d0/d8/d1c/f62 x:0 0 0 2024-05-09T06:29:52.497 INFO:tasks.workunit.client.0.smithi062.stdout:3/187: mkdir d1/d1e/d36/d3a 0 2024-05-09T06:29:52.497 INFO:tasks.workunit.client.0.smithi062.stdout:3/188: chown d1/d1e/f25 24577496 1 2024-05-09T06:29:52.497 INFO:tasks.workunit.client.0.smithi062.stdout:3/189: truncate d1/d1e/d26/f37 229476 0 2024-05-09T06:29:52.497 INFO:tasks.workunit.client.0.smithi062.stdout:3/190: stat d1/d1e/f24 0 2024-05-09T06:29:52.497 INFO:tasks.workunit.client.0.smithi062.stdout:3/191: chown d1/d1e/c17 9598149 1 2024-05-09T06:29:52.498 INFO:tasks.workunit.client.0.smithi062.stdout:1/222: dread f3 [0,4194304] 0 2024-05-09T06:29:52.498 INFO:tasks.workunit.client.0.smithi062.stdout:1/223: truncate d8/d1d/f24 5192526 0 2024-05-09T06:29:52.498 INFO:tasks.workunit.client.0.smithi062.stdout:7/271: getdents d0/d3a/d3f 0 2024-05-09T06:29:52.498 INFO:tasks.workunit.client.0.smithi062.stdout:3/192: mkdir d1/d1e/d3b 0 2024-05-09T06:29:52.499 INFO:tasks.workunit.client.0.smithi062.stdout:1/224: creat d8/d14/d2b/d3c/f46 x:0 0 0 2024-05-09T06:29:52.500 INFO:tasks.workunit.client.0.smithi062.stdout:7/272: rename d0/d12/d33/f36 to d0/d3a/d3f/f4c 0 2024-05-09T06:29:52.501 INFO:tasks.workunit.client.0.smithi062.stdout:7/273: write d0/f4b [414673,27818] 0 2024-05-09T06:29:52.501 INFO:tasks.workunit.client.0.smithi062.stdout:5/254: dread d0/d8/d1c/f22 [0,4194304] 0 2024-05-09T06:29:52.504 INFO:tasks.workunit.client.0.smithi062.stdout:3/193: creat d1/d1e/d26/f3c x:0 0 0 2024-05-09T06:29:52.506 INFO:tasks.workunit.client.0.smithi062.stdout:1/225: rename d8/c10 to d8/d14/c47 0 2024-05-09T06:29:52.507 INFO:tasks.workunit.client.0.smithi062.stdout:7/274: symlink d0/d3a/l4d 0 2024-05-09T06:29:52.508 INFO:tasks.workunit.client.0.smithi062.stdout:1/226: link d8/c33 d8/d14/d2b/d3d/c48 0 2024-05-09T06:29:52.509 INFO:tasks.workunit.client.0.smithi062.stdout:9/305: write d3/d3e/d52/d58/d1c/d21/f5a [3119283,93002] 0 2024-05-09T06:29:52.509 INFO:tasks.workunit.client.0.smithi062.stdout:7/275: mknod d0/d3/c4e 0 2024-05-09T06:29:52.510 INFO:tasks.workunit.client.0.smithi062.stdout:9/306: truncate d3/d3e/d52/d58/d1c/d21/f24 189740 0 2024-05-09T06:29:52.511 INFO:tasks.workunit.client.0.smithi062.stdout:9/307: truncate d3/d3e/d4b/f5c 2065291 0 2024-05-09T06:29:52.514 INFO:tasks.workunit.client.0.smithi062.stdout:2/171: dwrite d0/d9/dd/f1c [0,4194304] 0 2024-05-09T06:29:52.514 INFO:tasks.workunit.client.0.smithi062.stdout:1/227: write d8/f13 [844523,117779] 0 2024-05-09T06:29:52.514 INFO:tasks.workunit.client.0.smithi062.stdout:1/228: creat d8/f49 x:0 0 0 2024-05-09T06:29:52.515 INFO:tasks.workunit.client.0.smithi062.stdout:2/172: creat d0/f30 x:0 0 0 2024-05-09T06:29:52.518 INFO:tasks.workunit.client.0.smithi062.stdout:1/229: creat d8/d14/d2b/d3c/d44/f4a x:0 0 0 2024-05-09T06:29:52.519 INFO:tasks.workunit.client.0.smithi062.stdout:7/276: dread d0/d3/f17 [0,4194304] 0 2024-05-09T06:29:52.519 INFO:tasks.workunit.client.0.smithi062.stdout:7/277: truncate d0/d3/f2d 4931139 0 2024-05-09T06:29:52.519 INFO:tasks.workunit.client.0.smithi062.stdout:2/173: mknod d0/d9/dd/c31 0 2024-05-09T06:29:52.519 INFO:tasks.workunit.client.0.smithi062.stdout:2/174: write d0/d9/dd/d1f/d21/f28 [1096241,121401] 0 2024-05-09T06:29:52.521 INFO:tasks.workunit.client.0.smithi062.stdout:1/230: mkdir d8/d14/d2b/d3c/d44/d4b 0 2024-05-09T06:29:52.521 INFO:tasks.workunit.client.0.smithi062.stdout:9/308: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f43 [0,4194304] 0 2024-05-09T06:29:52.521 INFO:tasks.workunit.client.0.smithi062.stdout:9/309: truncate d3/d3e/d52/d58/d1c/d1e/f5f 533430 0 2024-05-09T06:29:52.522 INFO:tasks.workunit.client.0.smithi062.stdout:2/175: symlink d0/d9/dd/l32 0 2024-05-09T06:29:52.522 INFO:tasks.workunit.client.0.smithi062.stdout:1/231: mknod d8/d2c/c4c 0 2024-05-09T06:29:52.524 INFO:tasks.workunit.client.0.smithi062.stdout:1/232: dread d8/f3f [0,4194304] 0 2024-05-09T06:29:52.524 INFO:tasks.workunit.client.0.smithi062.stdout:9/310: mknod d3/d3e/d4b/c6c 0 2024-05-09T06:29:52.524 INFO:tasks.workunit.client.0.smithi062.stdout:4/216: dwrite d0/d2a/f25 [0,4194304] 0 2024-05-09T06:29:52.524 INFO:tasks.workunit.client.0.smithi062.stdout:1/233: dread d8/d1d/f25 [0,4194304] 0 2024-05-09T06:29:52.525 INFO:tasks.workunit.client.0.smithi062.stdout:0/210: dwrite d1/d32/f36 [0,4194304] 0 2024-05-09T06:29:52.525 INFO:tasks.workunit.client.0.smithi062.stdout:6/235: dwrite f1 [0,4194304] 0 2024-05-09T06:29:52.525 INFO:tasks.workunit.client.0.smithi062.stdout:8/305: dwrite da/d11/f29 [0,4194304] 0 2024-05-09T06:29:52.527 INFO:tasks.workunit.client.0.smithi062.stdout:2/176: dread d0/d9/dd/f1a [0,4194304] 0 2024-05-09T06:29:52.527 INFO:tasks.workunit.client.0.smithi062.stdout:9/311: link d3/d3e/d52/d58/d1c/d1e/d41/d64/c57 d3/d3e/c6d 0 2024-05-09T06:29:52.528 INFO:tasks.workunit.client.0.smithi062.stdout:0/211: dread d1/d25/d31/f46 [0,4194304] 0 2024-05-09T06:29:52.528 INFO:tasks.workunit.client.0.smithi062.stdout:0/212: dread - d1/d25/d49/d3c/f3f zero size 2024-05-09T06:29:52.529 INFO:tasks.workunit.client.0.smithi062.stdout:4/217: symlink d0/d2a/d8/df/l42 0 2024-05-09T06:29:52.530 INFO:tasks.workunit.client.0.smithi062.stdout:4/218: write d0/d24/f32 [1334927,34065] 0 2024-05-09T06:29:52.531 INFO:tasks.workunit.client.0.smithi062.stdout:1/234: mknod d8/d14/d2b/d3c/d44/d38/c4d 0 2024-05-09T06:29:52.531 INFO:tasks.workunit.client.0.smithi062.stdout:1/235: creat d8/d14/d2b/d3c/f4e x:0 0 0 2024-05-09T06:29:52.534 INFO:tasks.workunit.client.0.smithi062.stdout:9/312: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/f2c [0,4194304] 0 2024-05-09T06:29:52.534 INFO:tasks.workunit.client.0.smithi062.stdout:9/313: fsync d3/d3e/d52/d58/d1c/d21/f67 0 2024-05-09T06:29:52.540 INFO:tasks.workunit.client.0.smithi062.stdout:4/219: write d0/d2a/d1f/f22 [2849529,101076] 0 2024-05-09T06:29:52.540 INFO:tasks.workunit.client.0.smithi062.stdout:7/278: dwrite d0/f2c [0,4194304] 0 2024-05-09T06:29:52.540 INFO:tasks.workunit.client.0.smithi062.stdout:7/279: creat d0/d3/f4f x:0 0 0 2024-05-09T06:29:52.542 INFO:tasks.workunit.client.0.smithi062.stdout:8/306: rename da/d11/d1c/c32 to da/d11/d2e/d61/c66 0 2024-05-09T06:29:52.546 INFO:tasks.workunit.client.0.smithi062.stdout:2/177: creat d0/d9/dd/f33 x:0 0 0 2024-05-09T06:29:52.547 INFO:tasks.workunit.client.0.smithi062.stdout:9/314: write d3/d3e/d52/d58/d1c/d1e/d41/f4f [3287312,23889] 0 2024-05-09T06:29:52.548 INFO:tasks.workunit.client.0.smithi062.stdout:6/236: dwrite dc/d28/d10/f35 [0,4194304] 0 2024-05-09T06:29:52.550 INFO:tasks.workunit.client.0.smithi062.stdout:9/315: read d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f43 [1858966,62203] 0 2024-05-09T06:29:52.550 INFO:tasks.workunit.client.0.smithi062.stdout:9/316: truncate d3/d3e/d52/d58/d1c/d1e/d41/f65 1005350 0 2024-05-09T06:29:52.556 INFO:tasks.workunit.client.0.smithi062.stdout:0/213: unlink d1/d18/c21 0 2024-05-09T06:29:52.560 INFO:tasks.workunit.client.0.smithi062.stdout:4/220: getdents d0/d2a/d1f 0 2024-05-09T06:29:52.560 INFO:tasks.workunit.client.0.smithi062.stdout:4/221: fdatasync d0/d2a/f36 0 2024-05-09T06:29:52.567 INFO:tasks.workunit.client.0.smithi062.stdout:7/280: mknod d0/d3/c50 0 2024-05-09T06:29:52.569 INFO:tasks.workunit.client.0.smithi062.stdout:8/307: symlink da/d11/d2e/d34/l67 0 2024-05-09T06:29:52.577 INFO:tasks.workunit.client.0.smithi062.stdout:2/178: stat d0/c4 0 2024-05-09T06:29:52.587 INFO:tasks.workunit.client.0.smithi062.stdout:6/237: link dc/d42/l47 dc/d28/d34/d41/l53 0 2024-05-09T06:29:52.589 INFO:tasks.workunit.client.0.smithi062.stdout:9/317: truncate d3/d3e/d52/d58/f48 2196067 0 2024-05-09T06:29:52.590 INFO:tasks.workunit.client.0.smithi062.stdout:9/318: chown d3/f18 34266193 1 2024-05-09T06:29:52.597 INFO:tasks.workunit.client.0.smithi062.stdout:0/214: rename d1/d25/l29 to d1/d32/d44/l4b 0 2024-05-09T06:29:52.601 INFO:tasks.workunit.client.0.smithi062.stdout:4/222: symlink d0/d2a/d8/l43 0 2024-05-09T06:29:52.602 INFO:tasks.workunit.client.0.smithi062.stdout:7/281: truncate d0/d12/f24 4023098 0 2024-05-09T06:29:52.604 INFO:tasks.workunit.client.0.smithi062.stdout:8/308: mkdir da/d11/d2e/d34/d68 0 2024-05-09T06:29:52.607 INFO:tasks.workunit.client.0.smithi062.stdout:0/215: write d1/f24 [3955744,129141] 0 2024-05-09T06:29:52.610 INFO:tasks.workunit.client.0.smithi062.stdout:4/223: link d0/d2a/d14/f26 d0/d2a/d8/df/f44 0 2024-05-09T06:29:52.614 INFO:tasks.workunit.client.0.smithi062.stdout:8/309: unlink da/d11/d2e/d3a/f51 0 2024-05-09T06:29:52.614 INFO:tasks.workunit.client.0.smithi062.stdout:2/179: mknod d0/c34 0 2024-05-09T06:29:52.615 INFO:tasks.workunit.client.0.smithi062.stdout:6/238: getdents dc/d42 0 2024-05-09T06:29:52.626 INFO:tasks.workunit.client.0.smithi062.stdout:4/224: dwrite d0/d2a/d8/f27 [0,4194304] 0 2024-05-09T06:29:52.630 INFO:tasks.workunit.client.0.smithi062.stdout:2/180: truncate d0/d9/dd/f1a 1659099 0 2024-05-09T06:29:52.630 INFO:tasks.workunit.client.0.smithi062.stdout:4/225: dread d0/f17 [0,4194304] 0 2024-05-09T06:29:52.631 INFO:tasks.workunit.client.0.smithi062.stdout:6/239: symlink dc/d28/d46/d3a/l54 0 2024-05-09T06:29:52.631 INFO:tasks.workunit.client.0.smithi062.stdout:6/240: fdatasync dc/d28/d46/d3a/f4f 0 2024-05-09T06:29:52.632 INFO:tasks.workunit.client.0.smithi062.stdout:6/241: write dc/d28/d46/f29 [256986,10154] 0 2024-05-09T06:29:52.633 INFO:tasks.workunit.client.0.smithi062.stdout:7/282: rename d0/d22 to d0/d3a/d51 0 2024-05-09T06:29:52.633 INFO:tasks.workunit.client.0.smithi062.stdout:7/283: chown d0/f4 261 1 2024-05-09T06:29:52.642 INFO:tasks.workunit.client.0.smithi062.stdout:2/181: creat d0/d9/dd/d1f/d21/f35 x:0 0 0 2024-05-09T06:29:52.642 INFO:tasks.workunit.client.0.smithi062.stdout:2/182: creat d0/d9/dd/d1f/f36 x:0 0 0 2024-05-09T06:29:52.642 INFO:tasks.workunit.client.0.smithi062.stdout:4/226: mknod d0/d2a/d8/c45 0 2024-05-09T06:29:52.645 INFO:tasks.workunit.client.0.smithi062.stdout:7/284: symlink d0/d12/l52 0 2024-05-09T06:29:52.648 INFO:tasks.workunit.client.0.smithi062.stdout:2/183: mkdir d0/d9/d17/d37 0 2024-05-09T06:29:52.650 INFO:tasks.workunit.client.0.smithi062.stdout:4/227: unlink d0/d24/l40 0 2024-05-09T06:29:52.651 INFO:tasks.workunit.client.0.smithi062.stdout:6/242: rmdir dc/d28/d10/d20 39 2024-05-09T06:29:52.654 INFO:tasks.workunit.client.0.smithi062.stdout:7/285: mknod d0/d3a/d51/c53 0 2024-05-09T06:29:52.654 INFO:tasks.workunit.client.0.smithi062.stdout:7/286: creat d0/f54 x:0 0 0 2024-05-09T06:29:52.657 INFO:tasks.workunit.client.0.smithi062.stdout:4/228: creat d0/f46 x:0 0 0 2024-05-09T06:29:52.661 INFO:tasks.workunit.client.0.smithi062.stdout:2/184: dread d0/d9/dd/f1c [0,4194304] 0 2024-05-09T06:29:52.661 INFO:tasks.workunit.client.0.smithi062.stdout:2/185: fdatasync d0/d9/dd/f1a 0 2024-05-09T06:29:52.661 INFO:tasks.workunit.client.0.smithi062.stdout:2/186: chown d0/d9/dd/l16 13091 1 2024-05-09T06:29:52.661 INFO:tasks.workunit.client.0.smithi062.stdout:2/187: chown d0/f30 137 1 2024-05-09T06:29:52.661 INFO:tasks.workunit.client.0.smithi062.stdout:2/188: chown d0/d9/dd/d1f/d21/l23 4246130 1 2024-05-09T06:29:52.661 INFO:tasks.workunit.client.0.smithi062.stdout:2/189: readlink d0/d9/dd/d1f/d21/l23 0 2024-05-09T06:29:52.663 INFO:tasks.workunit.client.0.smithi062.stdout:6/243: dread dc/d28/d10/d20/f31 [0,4194304] 0 2024-05-09T06:29:52.669 INFO:tasks.workunit.client.0.smithi062.stdout:4/229: write d0/d2a/d8/f27 [1314347,11562] 0 2024-05-09T06:29:52.671 INFO:tasks.workunit.client.0.smithi062.stdout:6/244: symlink dc/l55 0 2024-05-09T06:29:52.673 INFO:tasks.workunit.client.0.smithi062.stdout:7/287: unlink d0/f54 0 2024-05-09T06:29:52.673 INFO:tasks.workunit.client.0.smithi062.stdout:7/288: dread - d0/d12/d33/f3c zero size 2024-05-09T06:29:52.673 INFO:tasks.workunit.client.0.smithi062.stdout:7/289: creat d0/d12/d33/f55 x:0 0 0 2024-05-09T06:29:52.675 INFO:tasks.workunit.client.0.smithi062.stdout:4/230: creat d0/d2a/d8/f47 x:0 0 0 2024-05-09T06:29:52.680 INFO:tasks.workunit.client.0.smithi062.stdout:6/245: creat dc/d28/d10/f56 x:0 0 0 2024-05-09T06:29:52.680 INFO:tasks.workunit.client.0.smithi062.stdout:8/310: rmdir da/d11 39 2024-05-09T06:29:52.685 INFO:tasks.workunit.client.0.smithi062.stdout:6/246: mkdir dc/d28/d34/d4e/d57 0 2024-05-09T06:29:52.686 INFO:tasks.workunit.client.0.smithi062.stdout:8/311: creat da/d11/d2e/d61/d64/f69 x:0 0 0 2024-05-09T06:29:52.687 INFO:tasks.workunit.client.0.smithi062.stdout:9/319: truncate d3/d3e/d52/d58/d1c/d1e/f5f 411443 0 2024-05-09T06:29:52.688 INFO:tasks.workunit.client.0.smithi062.stdout:2/190: dwrite d0/f15 [0,4194304] 0 2024-05-09T06:29:52.688 INFO:tasks.workunit.client.0.smithi062.stdout:2/191: chown d0/d9/dd/l32 5 1 2024-05-09T06:29:52.689 INFO:tasks.workunit.client.0.smithi062.stdout:7/290: link d0/d3/f3e d0/d3a/d3f/f56 0 2024-05-09T06:29:52.694 INFO:tasks.workunit.client.0.smithi062.stdout:9/320: creat d3/d20/d69/f6e x:0 0 0 2024-05-09T06:29:52.694 INFO:tasks.workunit.client.0.smithi062.stdout:4/231: truncate d0/d2a/f25 2726249 0 2024-05-09T06:29:52.698 INFO:tasks.workunit.client.0.smithi062.stdout:7/291: mknod d0/d3a/d51/c57 0 2024-05-09T06:29:52.701 INFO:tasks.workunit.client.0.smithi062.stdout:9/321: unlink d3/l7 0 2024-05-09T06:29:52.701 INFO:tasks.workunit.client.0.smithi062.stdout:9/322: write d3/d3e/d52/d58/d1c/f5e [763494,127450] 0 2024-05-09T06:29:52.701 INFO:tasks.workunit.client.0.smithi062.stdout:9/323: write d3/d3e/f61 [45732,108348] 0 2024-05-09T06:29:52.701 INFO:tasks.workunit.client.0.smithi062.stdout:9/324: creat d3/d3e/d52/d58/d1c/f6f x:0 0 0 2024-05-09T06:29:52.702 INFO:tasks.workunit.client.0.smithi062.stdout:6/247: read f1 [2946169,101019] 0 2024-05-09T06:29:52.702 INFO:tasks.workunit.client.0.smithi062.stdout:6/248: readlink dc/d28/d46/d3a/d4c/l2e 0 2024-05-09T06:29:52.702 INFO:tasks.workunit.client.0.smithi062.stdout:4/232: symlink d0/l48 0 2024-05-09T06:29:52.703 INFO:tasks.workunit.client.0.smithi062.stdout:7/292: mknod d0/d3a/d51/c58 0 2024-05-09T06:29:52.704 INFO:tasks.workunit.client.0.smithi062.stdout:2/192: dread d0/f15 [0,4194304] 0 2024-05-09T06:29:52.704 INFO:tasks.workunit.client.0.smithi062.stdout:7/293: write d0/d12/d33/f3b [260444,100801] 0 2024-05-09T06:29:52.704 INFO:tasks.workunit.client.0.smithi062.stdout:7/294: write d0/d12/d33/f46 [620852,110958] 0 2024-05-09T06:29:52.705 INFO:tasks.workunit.client.0.smithi062.stdout:6/249: symlink dc/d28/d34/d41/l58 0 2024-05-09T06:29:52.705 INFO:tasks.workunit.client.0.smithi062.stdout:6/250: write dc/d28/d10/f1c [943491,79115] 0 2024-05-09T06:29:52.707 INFO:tasks.workunit.client.0.smithi062.stdout:4/233: symlink d0/d2a/l49 0 2024-05-09T06:29:52.707 INFO:tasks.workunit.client.0.smithi062.stdout:4/234: creat d0/d2a/d8/f4a x:0 0 0 2024-05-09T06:29:52.707 INFO:tasks.workunit.client.0.smithi062.stdout:4/235: dread - d0/d2a/f36 zero size 2024-05-09T06:29:52.707 INFO:tasks.workunit.client.0.smithi062.stdout:9/325: dread d3/d3e/d52/d58/d1c/f26 [0,4194304] 0 2024-05-09T06:29:52.710 INFO:tasks.workunit.client.0.smithi062.stdout:2/193: write d0/d9/dd/f1c [3079627,50420] 0 2024-05-09T06:29:52.711 INFO:tasks.workunit.client.0.smithi062.stdout:4/236: mkdir d0/d2a/d4b 0 2024-05-09T06:29:52.712 INFO:tasks.workunit.client.0.smithi062.stdout:4/237: chown d0/d2a/d8/df/d28/f41 3122824 1 2024-05-09T06:29:52.712 INFO:tasks.workunit.client.0.smithi062.stdout:4/238: stat d0/d2a/d8/df 0 2024-05-09T06:29:52.713 INFO:tasks.workunit.client.0.smithi062.stdout:9/326: rename d3/f5d to d3/d20/d69/f70 0 2024-05-09T06:29:52.715 INFO:tasks.workunit.client.0.smithi062.stdout:2/194: mkdir d0/d9/d38 0 2024-05-09T06:29:52.718 INFO:tasks.workunit.client.0.smithi062.stdout:9/327: unlink d3/d3e/d52/d58/d1c/f4a 0 2024-05-09T06:29:52.719 INFO:tasks.workunit.client.0.smithi062.stdout:7/295: rmdir d0/d3a/d51 39 2024-05-09T06:29:52.719 INFO:tasks.workunit.client.0.smithi062.stdout:7/296: readlink d0/d3/l27 0 2024-05-09T06:29:52.722 INFO:tasks.workunit.client.0.smithi062.stdout:9/328: readlink d3/d3e/d52/d58/d1c/d21/l36 0 2024-05-09T06:29:52.726 INFO:tasks.workunit.client.0.smithi062.stdout:7/297: link d0/f16 d0/d12/f59 0 2024-05-09T06:29:52.728 INFO:tasks.workunit.client.0.smithi062.stdout:2/195: rename d0/f15 to d0/f39 0 2024-05-09T06:29:52.730 INFO:tasks.workunit.client.0.smithi062.stdout:2/196: rmdir d0/d9 39 2024-05-09T06:29:52.732 INFO:tasks.workunit.client.0.smithi062.stdout:4/239: dwrite d0/d2a/f5 [0,4194304] 0 2024-05-09T06:29:52.732 INFO:tasks.workunit.client.0.smithi062.stdout:4/240: write d0/d2a/f36 [207739,83637] 0 2024-05-09T06:29:52.732 INFO:tasks.workunit.client.0.smithi062.stdout:4/241: write d0/d2a/d14/f26 [4210359,90666] 0 2024-05-09T06:29:52.732 INFO:tasks.workunit.client.0.smithi062.stdout:6/251: dwrite dc/d28/d46/d3a/f4f [0,4194304] 0 2024-05-09T06:29:52.738 INFO:tasks.workunit.client.0.smithi062.stdout:4/242: mkdir d0/d2a/d8/df/d28/d4c 0 2024-05-09T06:29:52.738 INFO:tasks.workunit.client.0.smithi062.stdout:4/243: dread - d0/d9/f3e zero size 2024-05-09T06:29:52.758 INFO:tasks.workunit.client.0.smithi062.stdout:8/312: rmdir da/d11/d2e/d61/d64 39 2024-05-09T06:29:52.761 INFO:tasks.workunit.client.0.smithi062.stdout:2/197: dwrite d0/d9/dd/f1a [0,4194304] 0 2024-05-09T06:29:52.761 INFO:tasks.workunit.client.0.smithi062.stdout:8/313: rename da/d11/l36 to da/d11/d2e/d3a/l6a 0 2024-05-09T06:29:52.764 INFO:tasks.workunit.client.0.smithi062.stdout:2/198: creat d0/f3a x:0 0 0 2024-05-09T06:29:52.764 INFO:tasks.workunit.client.0.smithi062.stdout:2/199: write d0/f30 [467337,2509] 0 2024-05-09T06:29:52.765 INFO:tasks.workunit.client.0.smithi062.stdout:2/200: creat d0/d9/dd/d1f/f3b x:0 0 0 2024-05-09T06:29:52.765 INFO:tasks.workunit.client.0.smithi062.stdout:2/201: fdatasync d0/f39 0 2024-05-09T06:29:52.766 INFO:tasks.workunit.client.0.smithi062.stdout:8/314: mknod da/d11/d2e/d61/d64/c6b 0 2024-05-09T06:29:52.766 INFO:tasks.workunit.client.0.smithi062.stdout:8/315: write da/d11/d2e/d61/f63 [964460,51349] 0 2024-05-09T06:29:52.767 INFO:tasks.workunit.client.0.smithi062.stdout:6/252: dwrite dc/d28/d46/d3a/d4c/f2b [0,4194304] 0 2024-05-09T06:29:52.767 INFO:tasks.workunit.client.0.smithi062.stdout:6/253: fsync dc/d28/d10/d20/f32 0 2024-05-09T06:29:52.767 INFO:tasks.workunit.client.0.smithi062.stdout:6/254: fdatasync dc/d28/f43 0 2024-05-09T06:29:52.767 INFO:tasks.workunit.client.0.smithi062.stdout:4/244: dwrite d0/f46 [0,4194304] 0 2024-05-09T06:29:52.767 INFO:tasks.workunit.client.0.smithi062.stdout:4/245: readlink d0/d2a/l2b 0 2024-05-09T06:29:52.773 INFO:tasks.workunit.client.0.smithi062.stdout:2/202: rename d0/d9/dd/d1f/f36 to d0/d9/dd/d1f/d21/f3c 0 2024-05-09T06:29:52.798 INFO:tasks.workunit.client.0.smithi062.stdout:4/246: dwrite d0/d2a/f6 [4194304,4194304] 0 2024-05-09T06:29:52.800 INFO:tasks.workunit.client.0.smithi062.stdout:6/255: dwrite dc/d42/f4d [0,4194304] 0 2024-05-09T06:29:52.800 INFO:tasks.workunit.client.0.smithi062.stdout:8/316: dwrite da/d11/d2e/d61/f63 [0,4194304] 0 2024-05-09T06:29:52.801 INFO:tasks.workunit.client.0.smithi062.stdout:8/317: fdatasync da/d11/d1c/f39 0 2024-05-09T06:29:52.801 INFO:tasks.workunit.client.0.smithi062.stdout:2/203: dwrite d0/d9/dd/f33 [0,4194304] 0 2024-05-09T06:29:52.801 INFO:tasks.workunit.client.0.smithi062.stdout:2/204: write d0/d9/d17/f1d [1856228,53397] 0 2024-05-09T06:29:52.805 INFO:tasks.workunit.client.0.smithi062.stdout:6/256: getdents dc/d28/d34/d4e 0 2024-05-09T06:29:52.805 INFO:tasks.workunit.client.0.smithi062.stdout:6/257: creat dc/d28/d34/f59 x:0 0 0 2024-05-09T06:29:52.805 INFO:tasks.workunit.client.0.smithi062.stdout:6/258: chown dc/d28/l15 375 1 2024-05-09T06:29:52.806 INFO:tasks.workunit.client.0.smithi062.stdout:5/255: sync 2024-05-09T06:29:52.809 INFO:tasks.workunit.client.0.smithi062.stdout:6/259: dread dc/f13 [4194304,4194304] 0 2024-05-09T06:29:52.810 INFO:tasks.workunit.client.0.smithi062.stdout:4/247: write d0/d2a/d8/df/f44 [141609,48635] 0 2024-05-09T06:29:52.817 INFO:tasks.workunit.client.0.smithi062.stdout:5/256: dread d0/d8/d1c/d2c/f33 [0,4194304] 0 2024-05-09T06:29:52.817 INFO:tasks.workunit.client.0.smithi062.stdout:5/257: write d0/d8/d1c/d23/f29 [106821,99701] 0 2024-05-09T06:29:52.817 INFO:tasks.workunit.client.0.smithi062.stdout:5/258: fsync d0/f1d 0 2024-05-09T06:29:52.817 INFO:tasks.workunit.client.0.smithi062.stdout:5/259: read - d0/f5c zero size 2024-05-09T06:29:52.817 INFO:tasks.workunit.client.0.smithi062.stdout:5/260: write d0/d56/d5/f57 [663998,61497] 0 2024-05-09T06:29:52.817 INFO:tasks.workunit.client.0.smithi062.stdout:5/261: stat d0/d56/d5/c59 0 2024-05-09T06:29:52.821 INFO:tasks.workunit.client.0.smithi062.stdout:6/260: mknod dc/d28/d34/c5a 0 2024-05-09T06:29:52.825 INFO:tasks.workunit.client.0.smithi062.stdout:8/318: rmdir da 39 2024-05-09T06:29:52.825 INFO:tasks.workunit.client.0.smithi062.stdout:8/319: chown da/d11/d1c/l3f 0 1 2024-05-09T06:29:52.825 INFO:tasks.workunit.client.0.smithi062.stdout:6/261: dread dc/fd [0,4194304] 0 2024-05-09T06:29:52.826 INFO:tasks.workunit.client.0.smithi062.stdout:2/205: dwrite d0/d9/dd/d1f/f3b [0,4194304] 0 2024-05-09T06:29:52.826 INFO:tasks.workunit.client.0.smithi062.stdout:8/320: dread da/f13 [0,4194304] 0 2024-05-09T06:29:52.826 INFO:tasks.workunit.client.0.smithi062.stdout:8/321: chown da/d11/l22 1 1 2024-05-09T06:29:52.830 INFO:tasks.workunit.client.0.smithi062.stdout:6/262: mkdir dc/d28/d10/d20/d5b 0 2024-05-09T06:29:52.831 INFO:tasks.workunit.client.0.smithi062.stdout:5/262: dread d0/f1d [0,4194304] 0 2024-05-09T06:29:52.833 INFO:tasks.workunit.client.0.smithi062.stdout:2/206: mkdir d0/d9/dd/d1f/d21/d29/d3d 0 2024-05-09T06:29:52.833 INFO:tasks.workunit.client.0.smithi062.stdout:2/207: creat d0/d9/dd/d1f/f3e x:0 0 0 2024-05-09T06:29:52.833 INFO:tasks.workunit.client.0.smithi062.stdout:2/208: fdatasync d0/d9/dd/d1f/d21/f35 0 2024-05-09T06:29:52.834 INFO:tasks.workunit.client.0.smithi062.stdout:8/322: rename da/f14 to da/f6c 0 2024-05-09T06:29:52.835 INFO:tasks.workunit.client.0.smithi062.stdout:6/263: mkdir dc/d28/d34/d4e/d5c 0 2024-05-09T06:29:52.837 INFO:tasks.workunit.client.0.smithi062.stdout:2/209: truncate d0/d9/dd/f1c 1004218 0 2024-05-09T06:29:52.837 INFO:tasks.workunit.client.0.smithi062.stdout:2/210: chown d0/c34 26 1 2024-05-09T06:29:52.837 INFO:tasks.workunit.client.0.smithi062.stdout:2/211: fsync d0/d9/dd/d1f/f3b 0 2024-05-09T06:29:52.841 INFO:tasks.workunit.client.0.smithi062.stdout:5/263: read d0/d8/d1c/d23/f48 [2905944,91863] 0 2024-05-09T06:29:52.844 INFO:tasks.workunit.client.0.smithi062.stdout:8/323: rmdir da/d11/d2e/d34/d68 0 2024-05-09T06:29:52.848 INFO:tasks.workunit.client.0.smithi062.stdout:6/264: rename dc/d28/d46/d3a/d4c to dc/d28/d46/d4a/d5d 0 2024-05-09T06:29:52.848 INFO:tasks.workunit.client.0.smithi062.stdout:6/265: chown dc/d28/d10/f1c 98608957 1 2024-05-09T06:29:52.848 INFO:tasks.workunit.client.0.smithi062.stdout:6/266: readlink dc/d28/d10/d20/l44 0 2024-05-09T06:29:52.848 INFO:tasks.workunit.client.0.smithi062.stdout:6/267: fsync dc/d28/f1b 0 2024-05-09T06:29:52.848 INFO:tasks.workunit.client.0.smithi062.stdout:6/268: readlink dc/l19 0 2024-05-09T06:29:52.852 INFO:tasks.workunit.client.0.smithi062.stdout:2/212: link d0/d9/dd/l2d d0/d9/d17/l3f 0 2024-05-09T06:29:52.853 INFO:tasks.workunit.client.0.smithi062.stdout:4/248: truncate d0/d2a/f6 558767 0 2024-05-09T06:29:52.858 INFO:tasks.workunit.client.0.smithi062.stdout:4/249: write d0/f17 [2789892,88023] 0 2024-05-09T06:29:52.859 INFO:tasks.workunit.client.0.smithi062.stdout:4/250: creat d0/d24/f4d x:0 0 0 2024-05-09T06:29:52.859 INFO:tasks.workunit.client.0.smithi062.stdout:4/251: truncate d0/d2a/d8/f47 955301 0 2024-05-09T06:29:52.863 INFO:tasks.workunit.client.0.smithi062.stdout:6/269: dwrite dc/d28/d34/f3d [0,4194304] 0 2024-05-09T06:29:52.863 INFO:tasks.workunit.client.0.smithi062.stdout:6/270: fdatasync dc/d28/f43 0 2024-05-09T06:29:52.880 INFO:tasks.workunit.client.0.smithi062.stdout:2/213: dwrite d0/f30 [0,4194304] 0 2024-05-09T06:29:52.880 INFO:tasks.workunit.client.0.smithi062.stdout:4/252: dwrite d0/f3d [0,4194304] 0 2024-05-09T06:29:52.880 INFO:tasks.workunit.client.0.smithi062.stdout:2/214: write d0/d9/d17/f1d [2174180,47035] 0 2024-05-09T06:29:52.880 INFO:tasks.workunit.client.0.smithi062.stdout:4/253: write d0/d2a/d8/df/f44 [292132,56568] 0 2024-05-09T06:29:52.884 INFO:tasks.workunit.client.0.smithi062.stdout:5/264: symlink d0/d56/d5/l63 0 2024-05-09T06:29:52.891 INFO:tasks.workunit.client.0.smithi062.stdout:8/324: rename da/d11/d2e/d3a/f52 to da/d11/f6d 0 2024-05-09T06:29:52.901 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:52 smithi062 ceph-mon[26920]: [09/May/2024:06:29:51] ENGINE Serving on https://172.21.15.79:7150 2024-05-09T06:29:52.901 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:52 smithi062 ceph-mon[26920]: [09/May/2024:06:29:51] ENGINE Serving on http://172.21.15.79:8765 2024-05-09T06:29:52.901 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:52 smithi062 ceph-mon[26920]: [09/May/2024:06:29:51] ENGINE Bus STARTED 2024-05-09T06:29:52.901 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:52 smithi062 ceph-mon[26920]: pgmap v4: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail 2024-05-09T06:29:52.901 INFO:tasks.workunit.client.0.smithi062.stdout:6/271: rmdir dc/d28/d46/d4a/d5d 39 2024-05-09T06:29:52.902 INFO:tasks.workunit.client.0.smithi062.stdout:6/272: read - dc/d28/d10/d20/f51 zero size 2024-05-09T06:29:52.902 INFO:tasks.workunit.client.0.smithi062.stdout:6/273: truncate dc/d28/d46/d3a/f3e 560259 0 2024-05-09T06:29:52.909 INFO:tasks.workunit.client.0.smithi062.stdout:3/194: sync 2024-05-09T06:29:52.910 INFO:tasks.workunit.client.0.smithi062.stdout:0/216: sync 2024-05-09T06:29:52.910 INFO:tasks.workunit.client.0.smithi062.stdout:1/236: sync 2024-05-09T06:29:52.910 INFO:tasks.workunit.client.0.smithi062.stdout:3/195: fdatasync d1/d1e/f39 0 2024-05-09T06:29:52.910 INFO:tasks.workunit.client.0.smithi062.stdout:0/217: creat d1/d25/d31/f4c x:0 0 0 2024-05-09T06:29:52.922 INFO:tasks.workunit.client.0.smithi062.stdout:2/215: mkdir d0/d9/dd/d1f/d21/d29/d40 0 2024-05-09T06:29:52.922 INFO:tasks.workunit.client.0.smithi062.stdout:2/216: dread - d0/f3a zero size 2024-05-09T06:29:52.925 INFO:tasks.workunit.client.0.smithi062.stdout:3/196: dwrite d1/d1e/f24 [4194304,4194304] 0 2024-05-09T06:29:52.925 INFO:tasks.workunit.client.0.smithi062.stdout:3/197: fdatasync d1/d1e/f2c 0 2024-05-09T06:29:52.926 INFO:tasks.workunit.client.0.smithi062.stdout:4/254: mkdir d0/d3c/d4e 0 2024-05-09T06:29:52.928 INFO:tasks.workunit.client.0.smithi062.stdout:5/265: creat d0/d8/d18/f64 x:0 0 0 2024-05-09T06:29:52.929 INFO:tasks.workunit.client.0.smithi062.stdout:5/266: write d0/d8/d1c/d23/f29 [37669,98056] 0 2024-05-09T06:29:52.930 INFO:tasks.workunit.client.0.smithi062.stdout:8/325: link da/d11/d1c/l60 da/l6e 0 2024-05-09T06:29:52.935 INFO:tasks.workunit.client.0.smithi062.stdout:6/274: unlink dc/d28/d10/f56 0 2024-05-09T06:29:52.936 INFO:tasks.workunit.client.0.smithi062.stdout:1/237: creat d8/d2c/d41/f4f x:0 0 0 2024-05-09T06:29:52.940 INFO:tasks.workunit.client.0.smithi062.stdout:8/326: dread da/d11/f1d [0,4194304] 0 2024-05-09T06:29:52.942 INFO:tasks.workunit.client.0.smithi062.stdout:0/218: mknod d1/d25/d49/c4d 0 2024-05-09T06:29:52.942 INFO:tasks.workunit.client.0.smithi062.stdout:9/329: sync 2024-05-09T06:29:52.942 INFO:tasks.workunit.client.0.smithi062.stdout:9/330: truncate d3/d3e/d52/d58/d1c/f34 1496779 0 2024-05-09T06:29:52.945 INFO:tasks.workunit.client.0.smithi062.stdout:2/217: mkdir d0/d9/d38/d41 0 2024-05-09T06:29:52.946 INFO:tasks.workunit.client.0.smithi062.stdout:2/218: creat d0/d9/dd/d1f/d21/f42 x:0 0 0 2024-05-09T06:29:52.946 INFO:tasks.workunit.client.0.smithi062.stdout:2/219: write d0/d9/d17/f1d [2431909,45309] 0 2024-05-09T06:29:52.947 INFO:tasks.workunit.client.0.smithi062.stdout:3/198: unlink d1/d1e/f2a 0 2024-05-09T06:29:52.950 INFO:tasks.workunit.client.0.smithi062.stdout:9/331: dread d3/f16 [0,4194304] 0 2024-05-09T06:29:52.950 INFO:tasks.workunit.client.0.smithi062.stdout:9/332: creat d3/d3e/d52/d58/f71 x:0 0 0 2024-05-09T06:29:52.951 INFO:tasks.workunit.client.0.smithi062.stdout:4/255: mkdir d0/d2a/d14/d4f 0 2024-05-09T06:29:52.955 INFO:tasks.workunit.client.0.smithi062.stdout:1/238: dwrite d8/d1d/f25 [0,4194304] 0 2024-05-09T06:29:52.956 INFO:tasks.workunit.client.0.smithi062.stdout:5/267: getdents d0/d8/d18 0 2024-05-09T06:29:52.956 INFO:tasks.workunit.client.0.smithi062.stdout:5/268: chown d0/d8/d1c/d23/d3e/f4d 0 1 2024-05-09T06:29:52.958 INFO:tasks.workunit.client.0.smithi062.stdout:6/275: creat dc/f5e x:0 0 0 2024-05-09T06:29:52.958 INFO:tasks.workunit.client.0.smithi062.stdout:6/276: readlink dc/d28/d46/d4a/d5d/l2e 0 2024-05-09T06:29:52.959 INFO:tasks.workunit.client.0.smithi062.stdout:8/327: rmdir da 39 2024-05-09T06:29:52.959 INFO:tasks.workunit.client.0.smithi062.stdout:8/328: chown da/l6e 72052 1 2024-05-09T06:29:52.966 INFO:tasks.workunit.client.0.smithi062.stdout:4/256: write d0/d2a/f25 [1271784,28181] 0 2024-05-09T06:29:52.966 INFO:tasks.workunit.client.0.smithi062.stdout:0/219: rename d1/f16 to d1/d25/d49/d42/d43/f4e 0 2024-05-09T06:29:52.966 INFO:tasks.workunit.client.0.smithi062.stdout:0/220: chown d1/f2a 105865 1 2024-05-09T06:29:52.966 INFO:tasks.workunit.client.0.smithi062.stdout:3/199: dread d1/d1e/f25 [4194304,4194304] 0 2024-05-09T06:29:52.966 INFO:tasks.workunit.client.0.smithi062.stdout:9/333: dread d3/f5 [0,4194304] 0 2024-05-09T06:29:52.968 INFO:tasks.workunit.client.0.smithi062.stdout:0/221: write d1/d25/d49/d42/d43/f4e [1626575,50978] 0 2024-05-09T06:29:52.969 INFO:tasks.workunit.client.0.smithi062.stdout:8/329: write da/d11/f17 [2321828,122194] 0 2024-05-09T06:29:52.970 INFO:tasks.workunit.client.0.smithi062.stdout:2/220: unlink d0/d9/l14 0 2024-05-09T06:29:52.970 INFO:tasks.workunit.client.0.smithi062.stdout:2/221: write d0/d9/dd/d1f/f3b [4375961,128048] 0 2024-05-09T06:29:52.970 INFO:tasks.workunit.client.0.smithi062.stdout:4/257: dread d0/d2a/d1f/f22 [0,4194304] 0 2024-05-09T06:29:52.980 INFO:tasks.workunit.client.0.smithi062.stdout:5/269: dwrite d0/f37 [0,4194304] 0 2024-05-09T06:29:52.985 INFO:tasks.workunit.client.0.smithi062.stdout:2/222: dread d0/f30 [0,4194304] 0 2024-05-09T06:29:52.987 INFO:tasks.workunit.client.0.smithi062.stdout:6/277: mknod dc/d28/d10/c5f 0 2024-05-09T06:29:52.988 INFO:tasks.workunit.client.0.smithi062.stdout:3/200: symlink d1/d1e/d3b/l3d 0 2024-05-09T06:29:52.991 INFO:tasks.workunit.client.0.smithi062.stdout:9/334: symlink d3/d3e/d52/d58/d1c/l72 0 2024-05-09T06:29:52.993 INFO:tasks.workunit.client.0.smithi062.stdout:0/222: mkdir d1/d25/d49/d4f 0 2024-05-09T06:29:52.996 INFO:tasks.workunit.client.0.smithi062.stdout:8/330: rename da/d11/d2e/d3a/c5c to da/d11/d1c/c6f 0 2024-05-09T06:29:52.996 INFO:tasks.workunit.client.0.smithi062.stdout:5/270: rename d0/d56 to d0/d56/d5/d65 22 2024-05-09T06:29:52.996 INFO:tasks.workunit.client.0.smithi062.stdout:8/331: chown da/d11/f58 0 1 2024-05-09T06:29:52.996 INFO:tasks.workunit.client.0.smithi062.stdout:8/332: write da/d11/d2e/d34/f65 [433804,72776] 0 2024-05-09T06:29:52.998 INFO:tasks.workunit.client.0.smithi062.stdout:4/258: rename d0/d2a/d8/f27 to d0/d2a/d8/f50 0 2024-05-09T06:29:53.001 INFO:tasks.workunit.client.0.smithi062.stdout:1/239: rmdir d8/d14 39 2024-05-09T06:29:53.001 INFO:tasks.workunit.client.0.smithi062.stdout:1/240: creat d8/d2c/f50 x:0 0 0 2024-05-09T06:29:53.001 INFO:tasks.workunit.client.0.smithi062.stdout:6/278: dwrite dc/d28/f11 [4194304,4194304] 0 2024-05-09T06:29:53.002 INFO:tasks.workunit.client.0.smithi062.stdout:7/298: sync 2024-05-09T06:29:53.002 INFO:tasks.workunit.client.0.smithi062.stdout:3/201: link d1/f1b d1/d1e/d26/d33/f3e 0 2024-05-09T06:29:53.004 INFO:tasks.workunit.client.0.smithi062.stdout:9/335: creat d3/d3e/d52/d58/d1c/d1e/d60/f73 x:0 0 0 2024-05-09T06:29:53.006 INFO:tasks.workunit.client.0.smithi062.stdout:9/336: dread d3/d3e/d52/d58/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:29:53.006 INFO:tasks.workunit.client.0.smithi062.stdout:0/223: creat d1/d25/d49/d3c/f50 x:0 0 0 2024-05-09T06:29:53.006 INFO:tasks.workunit.client.0.smithi062.stdout:9/337: fsync d3/d3e/d52/d58/f35 0 2024-05-09T06:29:53.009 INFO:tasks.workunit.client.0.smithi062.stdout:2/223: rename d0/d9/d17/l3f to d0/d9/l43 0 2024-05-09T06:29:53.011 INFO:tasks.workunit.client.0.smithi062.stdout:5/271: unlink d0/d56/d45/c53 0 2024-05-09T06:29:53.012 INFO:tasks.workunit.client.0.smithi062.stdout:1/241: dread d8/d14/d2b/d3c/d44/f34 [0,4194304] 0 2024-05-09T06:29:53.013 INFO:tasks.workunit.client.0.smithi062.stdout:8/333: creat da/d11/d2e/f70 x:0 0 0 2024-05-09T06:29:53.014 INFO:tasks.workunit.client.0.smithi062.stdout:4/259: mknod d0/c51 0 2024-05-09T06:29:53.014 INFO:tasks.workunit.client.0.smithi062.stdout:4/260: fdatasync d0/d2a/f1d 0 2024-05-09T06:29:53.017 INFO:tasks.workunit.client.0.smithi062.stdout:7/299: rmdir d0/d3a/d3f 39 2024-05-09T06:29:53.017 INFO:tasks.workunit.client.0.smithi062.stdout:7/300: chown d0/d3a/d3f/f4c 12 1 2024-05-09T06:29:53.018 INFO:tasks.workunit.client.0.smithi062.stdout:0/224: creat d1/f51 x:0 0 0 2024-05-09T06:29:53.019 INFO:tasks.workunit.client.0.smithi062.stdout:9/338: truncate d3/d3e/d52/d58/d1c/d1e/d41/d64/f2d 867522 0 2024-05-09T06:29:53.019 INFO:tasks.workunit.client.0.smithi062.stdout:9/339: read - d3/d3e/d52/d58/d1c/d1e/f4c zero size 2024-05-09T06:29:53.022 INFO:tasks.workunit.client.0.smithi062.stdout:6/279: rename dc/l2d to dc/d28/d46/d3a/l60 0 2024-05-09T06:29:53.022 INFO:tasks.workunit.client.0.smithi062.stdout:6/280: write dc/d28/d10/d20/f31 [3440816,126837] 0 2024-05-09T06:29:53.024 INFO:tasks.workunit.client.0.smithi062.stdout:5/272: getdents d0/d8/d1c/d23/d3e 0 2024-05-09T06:29:53.024 INFO:tasks.workunit.client.0.smithi062.stdout:5/273: write d0/d8/d1c/f22 [1542694,98366] 0 2024-05-09T06:29:53.026 INFO:tasks.workunit.client.0.smithi062.stdout:1/242: link d8/d14/d2b/d3d/c48 d8/c51 0 2024-05-09T06:29:53.028 INFO:tasks.workunit.client.0.smithi062.stdout:4/261: link d0/d2a/d8/df/c34 d0/d2a/d4b/c52 0 2024-05-09T06:29:53.028 INFO:tasks.workunit.client.0.smithi062.stdout:4/262: chown d0/d2a/d8/df/f16 6652 1 2024-05-09T06:29:53.028 INFO:tasks.workunit.client.0.smithi062.stdout:0/225: mkdir d1/d25/d49/d4f/d52 0 2024-05-09T06:29:53.031 INFO:tasks.workunit.client.0.smithi062.stdout:8/334: rename da/d11/d2e/d34/f3d to da/f71 0 2024-05-09T06:29:53.032 INFO:tasks.workunit.client.0.smithi062.stdout:4/263: dread d0/d2a/f36 [0,4194304] 0 2024-05-09T06:29:53.033 INFO:tasks.workunit.client.0.smithi062.stdout:2/224: dwrite d0/fa [0,4194304] 0 2024-05-09T06:29:53.033 INFO:tasks.workunit.client.0.smithi062.stdout:2/225: write d0/d9/dd/d1f/f3b [5156680,29627] 0 2024-05-09T06:29:53.033 INFO:tasks.workunit.client.0.smithi062.stdout:2/226: chown d0/d9/dd/d1f/d21/c26 1510384182 1 2024-05-09T06:29:53.034 INFO:tasks.workunit.client.0.smithi062.stdout:2/227: fdatasync d0/f6 0 2024-05-09T06:29:53.034 INFO:tasks.workunit.client.0.smithi062.stdout:2/228: truncate d0/d9/dd/d1f/d21/f35 229217 0 2024-05-09T06:29:53.034 INFO:tasks.workunit.client.0.smithi062.stdout:2/229: truncate d0/d9/dd/d1f/f3b 5300400 0 2024-05-09T06:29:53.034 INFO:tasks.workunit.client.0.smithi062.stdout:2/230: chown d0/d9/dd/d1f/d21/f3c 3524965 1 2024-05-09T06:29:53.034 INFO:tasks.workunit.client.0.smithi062.stdout:2/231: fsync d0/d9/dd/d1f/d21/f42 0 2024-05-09T06:29:53.034 INFO:tasks.workunit.client.0.smithi062.stdout:5/274: unlink d0/d8/d1c/d23/d42/f4b 0 2024-05-09T06:29:53.034 INFO:tasks.workunit.client.0.smithi062.stdout:3/202: dwrite d1/d1e/f10 [0,4194304] 0 2024-05-09T06:29:53.035 INFO:tasks.workunit.client.0.smithi062.stdout:0/226: link d1/d25/d49/d42/d43/f4e d1/d18/d48/f53 0 2024-05-09T06:29:53.037 INFO:tasks.workunit.client.0.smithi062.stdout:6/281: dread dc/d28/f22 [0,4194304] 0 2024-05-09T06:29:53.037 INFO:tasks.workunit.client.0.smithi062.stdout:6/282: write dc/d28/d10/f4b [348274,71591] 0 2024-05-09T06:29:53.038 INFO:tasks.workunit.client.0.smithi062.stdout:4/264: link d0/d24/c38 d0/d2a/d8/c53 0 2024-05-09T06:29:53.039 INFO:tasks.workunit.client.0.smithi062.stdout:4/265: dread d0/d2a/f4 [0,4194304] 0 2024-05-09T06:29:53.040 INFO:tasks.workunit.client.0.smithi062.stdout:1/243: dwrite d8/d1d/f26 [0,4194304] 0 2024-05-09T06:29:53.041 INFO:tasks.workunit.client.0.smithi062.stdout:6/283: dread dc/d28/d10/f1c [0,4194304] 0 2024-05-09T06:29:53.042 INFO:tasks.workunit.client.0.smithi062.stdout:2/232: creat d0/f44 x:0 0 0 2024-05-09T06:29:53.043 INFO:tasks.workunit.client.0.smithi062.stdout:5/275: link d0/d11/l13 d0/d8/d1c/d23/d3e/l66 0 2024-05-09T06:29:53.044 INFO:tasks.workunit.client.0.smithi062.stdout:3/203: mknod d1/d1e/d26/c3f 0 2024-05-09T06:29:53.048 INFO:tasks.workunit.client.0.smithi062.stdout:0/227: mkdir d1/d25/d49/d42/d43/d54 0 2024-05-09T06:29:53.048 INFO:tasks.workunit.client.0.smithi062.stdout:0/228: write d1/fd [3633196,468] 0 2024-05-09T06:29:53.050 INFO:tasks.workunit.client.0.smithi062.stdout:7/301: rename d0/f34 to d0/d3a/d3f/f5a 0 2024-05-09T06:29:53.050 INFO:tasks.workunit.client.0.smithi062.stdout:8/335: rename da/d11 to da/d11/d2e/d34/d72 22 2024-05-09T06:29:53.050 INFO:tasks.workunit.client.0.smithi062.stdout:7/302: stat d0/c13 0 2024-05-09T06:29:53.050 INFO:tasks.workunit.client.0.smithi062.stdout:8/336: fdatasync f7 0 2024-05-09T06:29:53.050 INFO:tasks.workunit.client.0.smithi062.stdout:8/337: write da/d11/d1c/f43 [560695,38225] 0 2024-05-09T06:29:53.050 INFO:tasks.workunit.client.0.smithi062.stdout:8/338: truncate da/d11/f3c 674281 0 2024-05-09T06:29:53.051 INFO:tasks.workunit.client.0.smithi062.stdout:4/266: mknod d0/c54 0 2024-05-09T06:29:53.058 INFO:tasks.workunit.client.0.smithi062.stdout:1/244: creat d8/d14/d2b/f52 x:0 0 0 2024-05-09T06:29:53.060 INFO:tasks.workunit.client.0.smithi062.stdout:6/284: creat dc/d28/d34/d4e/f61 x:0 0 0 2024-05-09T06:29:53.062 INFO:tasks.workunit.client.0.smithi062.stdout:2/233: unlink d0/d9/l1e 0 2024-05-09T06:29:53.062 INFO:tasks.workunit.client.0.smithi062.stdout:2/234: chown d0/fa 1 1 2024-05-09T06:29:53.064 INFO:tasks.workunit.client.0.smithi062.stdout:5/276: mkdir d0/d11/d67 0 2024-05-09T06:29:53.066 INFO:tasks.workunit.client.0.smithi062.stdout:3/204: truncate d1/d1e/f1a 779325 0 2024-05-09T06:29:53.068 INFO:tasks.workunit.client.0.smithi062.stdout:0/229: unlink d1/d25/d49/d42/d43/f45 0 2024-05-09T06:29:53.072 INFO:tasks.workunit.client.0.smithi062.stdout:8/339: link da/d11/d2e/d34/l4b da/d11/d2e/d34/l73 0 2024-05-09T06:29:53.072 INFO:tasks.workunit.client.0.smithi062.stdout:3/205: dread d1/d1e/d26/d33/f3e [0,4194304] 0 2024-05-09T06:29:53.073 INFO:tasks.workunit.client.0.smithi062.stdout:8/340: dread da/f6c [0,4194304] 0 2024-05-09T06:29:53.074 INFO:tasks.workunit.client.0.smithi062.stdout:2/235: read d0/f39 [4974575,94258] 0 2024-05-09T06:29:53.074 INFO:tasks.workunit.client.0.smithi062.stdout:1/245: rename d8/d14/f1e to d8/d14/d2b/f53 0 2024-05-09T06:29:53.075 INFO:tasks.workunit.client.0.smithi062.stdout:1/246: creat d8/f54 x:0 0 0 2024-05-09T06:29:53.075 INFO:tasks.workunit.client.0.smithi062.stdout:1/247: read d8/f2a [343470,71604] 0 2024-05-09T06:29:53.075 INFO:tasks.workunit.client.0.smithi062.stdout:1/248: chown d8/d14/c21 53624 1 2024-05-09T06:29:53.080 INFO:tasks.workunit.client.0.smithi062.stdout:7/303: dwrite d0/f20 [0,4194304] 0 2024-05-09T06:29:53.081 INFO:tasks.workunit.client.0.smithi062.stdout:5/277: dread d0/d8/d1c/f20 [0,4194304] 0 2024-05-09T06:29:53.081 INFO:tasks.workunit.client.0.smithi062.stdout:5/278: dread - d0/d8/d1c/d23/f4f zero size 2024-05-09T06:29:53.082 INFO:tasks.workunit.client.0.smithi062.stdout:5/279: write d0/f28 [80705,36858] 0 2024-05-09T06:29:53.083 INFO:tasks.workunit.client.0.smithi062.stdout:4/267: dwrite d0/d2a/f6 [0,4194304] 0 2024-05-09T06:29:53.083 INFO:tasks.workunit.client.0.smithi062.stdout:5/280: write d0/d8/d18/f5d [440505,87060] 0 2024-05-09T06:29:53.083 INFO:tasks.workunit.client.0.smithi062.stdout:6/285: symlink dc/d28/d46/d4a/d5d/l62 0 2024-05-09T06:29:53.083 INFO:tasks.workunit.client.0.smithi062.stdout:6/286: write dc/d28/d46/d3a/f3c [2180693,127855] 0 2024-05-09T06:29:53.084 INFO:tasks.workunit.client.0.smithi062.stdout:0/230: symlink d1/d25/d49/d4f/l55 0 2024-05-09T06:29:53.084 INFO:tasks.workunit.client.0.smithi062.stdout:0/231: fsync d1/d25/d31/f4c 0 2024-05-09T06:29:53.084 INFO:tasks.workunit.client.0.smithi062.stdout:0/232: readlink d1/d18/l1c 0 2024-05-09T06:29:53.086 INFO:tasks.workunit.client.0.smithi062.stdout:2/236: write d0/d9/dd/d1f/f3b [3343861,283] 0 2024-05-09T06:29:53.089 INFO:tasks.workunit.client.0.smithi062.stdout:8/341: mknod da/d11/d2e/d61/c74 0 2024-05-09T06:29:53.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:52 smithi079 ceph-mon[35268]: [09/May/2024:06:29:51] ENGINE Serving on https://172.21.15.79:7150 2024-05-09T06:29:53.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:52 smithi079 ceph-mon[35268]: [09/May/2024:06:29:51] ENGINE Serving on http://172.21.15.79:8765 2024-05-09T06:29:53.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:52 smithi079 ceph-mon[35268]: [09/May/2024:06:29:51] ENGINE Bus STARTED 2024-05-09T06:29:53.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:52 smithi079 ceph-mon[35268]: pgmap v4: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail 2024-05-09T06:29:53.094 INFO:tasks.workunit.client.0.smithi062.stdout:7/304: symlink d0/l5b 0 2024-05-09T06:29:53.094 INFO:tasks.workunit.client.0.smithi062.stdout:7/305: chown d0/d3a/d3f 85391469 1 2024-05-09T06:29:53.095 INFO:tasks.workunit.client.0.smithi062.stdout:7/306: dread - d0/d12/d33/f55 zero size 2024-05-09T06:29:53.096 INFO:tasks.workunit.client.0.smithi062.stdout:6/287: write dc/ff [3418190,89396] 0 2024-05-09T06:29:53.099 INFO:tasks.workunit.client.0.smithi062.stdout:3/206: dwrite d1/f1b [0,4194304] 0 2024-05-09T06:29:53.099 INFO:tasks.workunit.client.0.smithi062.stdout:1/249: dwrite d8/d2c/f50 [0,4194304] 0 2024-05-09T06:29:53.101 INFO:tasks.workunit.client.0.smithi062.stdout:4/268: creat d0/d2a/d14/d4f/f55 x:0 0 0 2024-05-09T06:29:53.102 INFO:tasks.workunit.client.0.smithi062.stdout:4/269: readlink d0/d2a/l49 0 2024-05-09T06:29:53.102 INFO:tasks.workunit.client.0.smithi062.stdout:4/270: creat d0/d2a/d14/d4f/f56 x:0 0 0 2024-05-09T06:29:53.106 INFO:tasks.workunit.client.0.smithi062.stdout:5/281: symlink d0/d8/d30/d4a/l68 0 2024-05-09T06:29:53.108 INFO:tasks.workunit.client.0.smithi062.stdout:0/233: dwrite d1/d25/f26 [4194304,4194304] 0 2024-05-09T06:29:53.111 INFO:tasks.workunit.client.0.smithi062.stdout:2/237: creat d0/d9/d17/f45 x:0 0 0 2024-05-09T06:29:53.113 INFO:tasks.workunit.client.0.smithi062.stdout:4/271: write d0/d2a/f4 [2601095,97934] 0 2024-05-09T06:29:53.115 INFO:tasks.workunit.client.0.smithi062.stdout:8/342: symlink da/d11/l75 0 2024-05-09T06:29:53.115 INFO:tasks.workunit.client.0.smithi062.stdout:8/343: read da/d11/f17 [3864583,42234] 0 2024-05-09T06:29:53.115 INFO:tasks.workunit.client.0.smithi062.stdout:8/344: dread - da/d11/d2e/f70 zero size 2024-05-09T06:29:53.126 INFO:tasks.workunit.client.0.smithi062.stdout:6/288: dwrite dc/d28/d10/f35 [0,4194304] 0 2024-05-09T06:29:53.128 INFO:tasks.workunit.client.0.smithi062.stdout:3/207: creat d1/d2d/f40 x:0 0 0 2024-05-09T06:29:53.130 INFO:tasks.workunit.client.0.smithi062.stdout:5/282: dwrite d0/f28 [0,4194304] 0 2024-05-09T06:29:53.133 INFO:tasks.workunit.client.0.smithi062.stdout:6/289: dread dc/d28/f11 [0,4194304] 0 2024-05-09T06:29:53.134 INFO:tasks.workunit.client.0.smithi062.stdout:1/250: rename d8/d1d/f24 to d8/d2c/d41/f55 0 2024-05-09T06:29:53.137 INFO:tasks.workunit.client.0.smithi062.stdout:6/290: dread dc/d28/d46/f29 [0,4194304] 0 2024-05-09T06:29:53.143 INFO:tasks.workunit.client.0.smithi062.stdout:5/283: dread d0/f28 [0,4194304] 0 2024-05-09T06:29:53.144 INFO:tasks.workunit.client.0.smithi062.stdout:4/272: dwrite d0/d2a/d8/df/d28/d31/f39 [0,4194304] 0 2024-05-09T06:29:53.144 INFO:tasks.workunit.client.0.smithi062.stdout:4/273: write d0/d2a/f6 [1963515,25804] 0 2024-05-09T06:29:53.144 INFO:tasks.workunit.client.0.smithi062.stdout:4/274: write d0/d2a/d8/f4a [132695,53383] 0 2024-05-09T06:29:53.147 INFO:tasks.workunit.client.0.smithi062.stdout:0/234: mknod d1/d25/d49/d42/d43/d54/c56 0 2024-05-09T06:29:53.147 INFO:tasks.workunit.client.0.smithi062.stdout:0/235: chown d1/d25/d31 7 1 2024-05-09T06:29:53.153 INFO:tasks.workunit.client.0.smithi062.stdout:0/236: dread d1/d25/f2f [0,4194304] 0 2024-05-09T06:29:53.153 INFO:tasks.workunit.client.0.smithi062.stdout:0/237: fsync d1/f17 0 2024-05-09T06:29:53.153 INFO:tasks.workunit.client.0.smithi062.stdout:0/238: chown d1/d25/d49/d3c/f50 67123947 1 2024-05-09T06:29:53.153 INFO:tasks.workunit.client.0.smithi062.stdout:6/291: dwrite dc/d28/d34/f3d [4194304,4194304] 0 2024-05-09T06:29:53.153 INFO:tasks.workunit.client.0.smithi062.stdout:6/292: write dc/d28/d34/f38 [689265,14101] 0 2024-05-09T06:29:53.154 INFO:tasks.workunit.client.0.smithi062.stdout:2/238: mkdir d0/d9/dd/d1f/d21/d29/d3d/d46 0 2024-05-09T06:29:53.159 INFO:tasks.workunit.client.0.smithi062.stdout:8/345: mknod da/d11/c76 0 2024-05-09T06:29:53.159 INFO:tasks.workunit.client.0.smithi062.stdout:8/346: truncate da/d11/f58 246888 0 2024-05-09T06:29:53.159 INFO:tasks.workunit.client.0.smithi062.stdout:8/347: fdatasync da/f28 0 2024-05-09T06:29:53.161 INFO:tasks.workunit.client.0.smithi062.stdout:3/208: mknod d1/d2d/c41 0 2024-05-09T06:29:53.164 INFO:tasks.workunit.client.0.smithi062.stdout:1/251: stat d8/c33 0 2024-05-09T06:29:53.165 INFO:tasks.workunit.client.0.smithi062.stdout:1/252: write d8/d14/d2b/f52 [191538,84912] 0 2024-05-09T06:29:53.165 INFO:tasks.workunit.client.0.smithi062.stdout:5/284: truncate d0/d56/d5/f36 716497 0 2024-05-09T06:29:53.174 INFO:tasks.workunit.client.0.smithi062.stdout:4/275: rmdir d0/d9 39 2024-05-09T06:29:53.174 INFO:tasks.workunit.client.0.smithi062.stdout:4/276: read d0/d2a/d1f/f22 [992452,59341] 0 2024-05-09T06:29:53.174 INFO:tasks.workunit.client.0.smithi062.stdout:4/277: creat d0/f57 x:0 0 0 2024-05-09T06:29:53.174 INFO:tasks.workunit.client.0.smithi062.stdout:4/278: truncate d0/d2a/d8/f47 1036762 0 2024-05-09T06:29:53.174 INFO:tasks.workunit.client.0.smithi062.stdout:4/279: fdatasync d0/d2a/d14/d4f/f55 0 2024-05-09T06:29:53.175 INFO:tasks.workunit.client.0.smithi062.stdout:0/239: readlink d1/l30 0 2024-05-09T06:29:53.177 INFO:tasks.workunit.client.0.smithi062.stdout:6/293: mknod dc/d28/d34/c63 0 2024-05-09T06:29:53.178 INFO:tasks.workunit.client.0.smithi062.stdout:2/239: symlink d0/d9/dd/d1f/d21/d29/d3d/l47 0 2024-05-09T06:29:53.180 INFO:tasks.workunit.client.0.smithi062.stdout:8/348: mkdir da/d77 0 2024-05-09T06:29:53.182 INFO:tasks.workunit.client.0.smithi062.stdout:3/209: mknod d1/d1e/c42 0 2024-05-09T06:29:53.184 INFO:tasks.workunit.client.0.smithi062.stdout:4/280: write d0/d2a/d8/df/d28/d31/f39 [66913,43289] 0 2024-05-09T06:29:53.184 INFO:tasks.workunit.client.0.smithi062.stdout:4/281: write d0/d2a/d14/d4f/f55 [586370,112066] 0 2024-05-09T06:29:53.184 INFO:tasks.workunit.client.0.smithi062.stdout:4/282: dread - d0/d24/f4d zero size 2024-05-09T06:29:53.184 INFO:tasks.workunit.client.0.smithi062.stdout:1/253: rmdir d8/d14/d2b/d3c/d44 39 2024-05-09T06:29:53.187 INFO:tasks.workunit.client.0.smithi062.stdout:5/285: write d0/d56/d5/f36 [1202049,36987] 0 2024-05-09T06:29:53.191 INFO:tasks.workunit.client.0.smithi062.stdout:4/283: dread d0/d2a/f3 [0,4194304] 0 2024-05-09T06:29:53.192 INFO:tasks.workunit.client.0.smithi062.stdout:4/284: creat d0/d2a/d8/df/d28/d31/f58 x:0 0 0 2024-05-09T06:29:53.194 INFO:tasks.workunit.client.0.smithi062.stdout:0/240: unlink d1/l30 0 2024-05-09T06:29:53.194 INFO:tasks.workunit.client.0.smithi062.stdout:0/241: fdatasync d1/d18/f1d 0 2024-05-09T06:29:53.196 INFO:tasks.workunit.client.0.smithi062.stdout:6/294: unlink dc/d28/d46/d4a/d5d/f2b 0 2024-05-09T06:29:53.199 INFO:tasks.workunit.client.0.smithi062.stdout:5/286: dread d0/d56/d5/f36 [0,4194304] 0 2024-05-09T06:29:53.199 INFO:tasks.workunit.client.0.smithi062.stdout:5/287: chown d0/d8/c1a 1347 1 2024-05-09T06:29:53.200 INFO:tasks.workunit.client.0.smithi062.stdout:2/240: mkdir d0/d9/d38/d41/d48 0 2024-05-09T06:29:53.200 INFO:tasks.workunit.client.0.smithi062.stdout:2/241: write d0/d9/dd/d1f/d21/f28 [3352078,90083] 0 2024-05-09T06:29:53.201 INFO:tasks.workunit.client.0.smithi062.stdout:2/242: dread d0/d9/dd/d1f/d21/f35 [0,4194304] 0 2024-05-09T06:29:53.201 INFO:tasks.workunit.client.0.smithi062.stdout:3/210: mkdir d1/d1e/d26/d43 0 2024-05-09T06:29:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:6/295: dread dc/d28/d46/f29 [0,4194304] 0 2024-05-09T06:29:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/349: dwrite da/f28 [0,4194304] 0 2024-05-09T06:29:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/350: chown da/d11/d2e/d3a/l6a 6821720 1 2024-05-09T06:29:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/351: fsync da/d11/f3c 0 2024-05-09T06:29:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/352: truncate da/d11/f1d 5054036 0 2024-05-09T06:29:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/353: chown da/d11/c2f 27 1 2024-05-09T06:29:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/354: stat da/d11/c54 0 2024-05-09T06:29:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:2/243: write d0/d9/dd/f20 [162288,78908] 0 2024-05-09T06:29:53.209 INFO:tasks.workunit.client.0.smithi062.stdout:4/285: dwrite d0/d2a/d8/df/f44 [0,4194304] 0 2024-05-09T06:29:53.209 INFO:tasks.workunit.client.0.smithi062.stdout:4/286: truncate d0/d2a/d8/df/d28/f41 402435 0 2024-05-09T06:29:53.212 INFO:tasks.workunit.client.0.smithi062.stdout:6/296: read dc/d28/f22 [1325685,71697] 0 2024-05-09T06:29:53.214 INFO:tasks.workunit.client.0.smithi062.stdout:6/297: dread dc/d28/d10/f1c [0,4194304] 0 2024-05-09T06:29:53.214 INFO:tasks.workunit.client.0.smithi062.stdout:6/298: write dc/d28/d10/f35 [2103206,93693] 0 2024-05-09T06:29:53.214 INFO:tasks.workunit.client.0.smithi062.stdout:6/299: chown dc/d28/d34/d4e 108976 1 2024-05-09T06:29:53.217 INFO:tasks.workunit.client.0.smithi062.stdout:0/242: mkdir d1/d32/d44/d57 0 2024-05-09T06:29:53.219 INFO:tasks.workunit.client.0.smithi062.stdout:5/288: mknod d0/c69 0 2024-05-09T06:29:53.221 INFO:tasks.workunit.client.0.smithi062.stdout:3/211: unlink d1/l31 0 2024-05-09T06:29:53.226 INFO:tasks.workunit.client.0.smithi062.stdout:8/355: link da/d11/l75 da/d11/d2e/d34/l78 0 2024-05-09T06:29:53.226 INFO:tasks.workunit.client.0.smithi062.stdout:8/356: truncate da/d11/f23 4526142 0 2024-05-09T06:29:53.228 INFO:tasks.workunit.client.0.smithi062.stdout:2/244: creat d0/d9/d38/d41/f49 x:0 0 0 2024-05-09T06:29:53.230 INFO:tasks.workunit.client.0.smithi062.stdout:4/287: dwrite d0/f3d [0,4194304] 0 2024-05-09T06:29:53.230 INFO:tasks.workunit.client.0.smithi062.stdout:6/300: getdents dc/d28/d46/d4a 0 2024-05-09T06:29:53.233 INFO:tasks.workunit.client.0.smithi062.stdout:5/289: creat d0/d56/f6a x:0 0 0 2024-05-09T06:29:53.234 INFO:tasks.workunit.client.0.smithi062.stdout:3/212: truncate d1/d1e/d26/f29 2702132 0 2024-05-09T06:29:53.237 INFO:tasks.workunit.client.0.smithi062.stdout:4/288: rename d0/d2a/f3 to d0/d2a/d8/df/d28/f59 0 2024-05-09T06:29:53.237 INFO:tasks.workunit.client.0.smithi062.stdout:4/289: readlink d0/l48 0 2024-05-09T06:29:53.237 INFO:tasks.workunit.client.0.smithi062.stdout:4/290: write d0/d9/f3e [750505,47957] 0 2024-05-09T06:29:53.238 INFO:tasks.workunit.client.0.smithi062.stdout:0/243: dwrite d1/f19 [0,4194304] 0 2024-05-09T06:29:53.240 INFO:tasks.workunit.client.0.smithi062.stdout:6/301: creat dc/d28/d46/f64 x:0 0 0 2024-05-09T06:29:53.240 INFO:tasks.workunit.client.0.smithi062.stdout:6/302: readlink dc/d28/d34/l37 0 2024-05-09T06:29:53.240 INFO:tasks.workunit.client.0.smithi062.stdout:6/303: readlink dc/d28/d10/l2f 0 2024-05-09T06:29:53.240 INFO:tasks.workunit.client.0.smithi062.stdout:6/304: write dc/d28/d46/f64 [764013,9634] 0 2024-05-09T06:29:53.241 INFO:tasks.workunit.client.0.smithi062.stdout:5/290: symlink d0/d8/d1c/d23/l6b 0 2024-05-09T06:29:53.241 INFO:tasks.workunit.client.0.smithi062.stdout:5/291: write d0/d56/f12 [594843,119300] 0 2024-05-09T06:29:53.244 INFO:tasks.workunit.client.0.smithi062.stdout:3/213: symlink d1/d1e/l44 0 2024-05-09T06:29:53.244 INFO:tasks.workunit.client.0.smithi062.stdout:3/214: readlink d1/d2d/l38 0 2024-05-09T06:29:53.244 INFO:tasks.workunit.client.0.smithi062.stdout:3/215: dread d1/d1e/d26/f37 [0,4194304] 0 2024-05-09T06:29:53.245 INFO:tasks.workunit.client.0.smithi062.stdout:3/216: write d1/d2d/f40 [437544,38378] 0 2024-05-09T06:29:53.248 INFO:tasks.workunit.client.0.smithi062.stdout:8/357: dwrite da/f57 [0,4194304] 0 2024-05-09T06:29:53.248 INFO:tasks.workunit.client.0.smithi062.stdout:8/358: chown da/d11/f17 298330666 1 2024-05-09T06:29:53.248 INFO:tasks.workunit.client.0.smithi062.stdout:8/359: chown da/d11/d2e/d61/d64 119 1 2024-05-09T06:29:53.249 INFO:tasks.workunit.client.0.smithi062.stdout:4/291: symlink d0/d2a/d8/df/d28/d4c/l5a 0 2024-05-09T06:29:53.249 INFO:tasks.workunit.client.0.smithi062.stdout:4/292: stat d0/d2a/d14/d4f/f56 0 2024-05-09T06:29:53.249 INFO:tasks.workunit.client.0.smithi062.stdout:4/293: chown d0/d2a/d8/df/d28/d31/f58 183908740 1 2024-05-09T06:29:53.249 INFO:tasks.workunit.client.0.smithi062.stdout:4/294: chown d0/d2a/d8/f4a 19041 1 2024-05-09T06:29:53.249 INFO:tasks.workunit.client.0.smithi062.stdout:3/217: dread d1/d1e/ff [0,4194304] 0 2024-05-09T06:29:53.250 INFO:tasks.workunit.client.0.smithi062.stdout:3/218: write d1/f8 [4692576,41351] 0 2024-05-09T06:29:53.252 INFO:tasks.workunit.client.0.smithi062.stdout:0/244: getdents d1/d32/d44 0 2024-05-09T06:29:53.252 INFO:tasks.workunit.client.0.smithi062.stdout:2/245: rmdir d0/d9/d38/d41 39 2024-05-09T06:29:53.253 INFO:tasks.workunit.client.0.smithi062.stdout:2/246: write d0/f39 [5797304,72977] 0 2024-05-09T06:29:53.255 INFO:tasks.workunit.client.0.smithi062.stdout:6/305: creat dc/d28/d34/d4e/d57/f65 x:0 0 0 2024-05-09T06:29:53.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/292: unlink d0/d8/f44 0 2024-05-09T06:29:53.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/293: creat d0/d8/d1c/f6c x:0 0 0 2024-05-09T06:29:53.262 INFO:tasks.workunit.client.0.smithi062.stdout:8/360: rmdir da 39 2024-05-09T06:29:53.266 INFO:tasks.workunit.client.0.smithi062.stdout:3/219: link d1/d1e/l44 d1/d1e/l45 0 2024-05-09T06:29:53.267 INFO:tasks.workunit.client.0.smithi062.stdout:4/295: dwrite d0/d2a/f36 [0,4194304] 0 2024-05-09T06:29:53.267 INFO:tasks.workunit.client.0.smithi062.stdout:0/245: symlink d1/d18/d48/l58 0 2024-05-09T06:29:53.272 INFO:tasks.workunit.client.0.smithi062.stdout:3/220: write d1/d1e/f1d [3365782,119913] 0 2024-05-09T06:29:53.273 INFO:tasks.workunit.client.0.smithi062.stdout:0/246: dread d1/d18/d48/f53 [0,4194304] 0 2024-05-09T06:29:53.273 INFO:tasks.workunit.client.0.smithi062.stdout:2/247: truncate d0/f30 3186963 0 2024-05-09T06:29:53.275 INFO:tasks.workunit.client.0.smithi062.stdout:2/248: read d0/d9/dd/d1f/d21/f28 [205022,110234] 0 2024-05-09T06:29:53.277 INFO:tasks.workunit.client.0.smithi062.stdout:4/296: write d0/d2a/d8/df/f44 [2385269,5570] 0 2024-05-09T06:29:53.277 INFO:tasks.workunit.client.0.smithi062.stdout:4/297: read - d0/d2a/d14/d4f/f56 zero size 2024-05-09T06:29:53.278 INFO:tasks.workunit.client.0.smithi062.stdout:6/306: creat dc/d42/f66 x:0 0 0 2024-05-09T06:29:53.278 INFO:tasks.workunit.client.0.smithi062.stdout:6/307: write dc/d28/d46/d3a/f40 [233939,40822] 0 2024-05-09T06:29:53.278 INFO:tasks.workunit.client.0.smithi062.stdout:6/308: creat dc/d42/f67 x:0 0 0 2024-05-09T06:29:53.282 INFO:tasks.workunit.client.0.smithi062.stdout:4/298: dread d0/d2a/d8/df/d28/d31/f39 [0,4194304] 0 2024-05-09T06:29:53.282 INFO:tasks.workunit.client.0.smithi062.stdout:4/299: read d0/d2a/d1f/f22 [4094775,30719] 0 2024-05-09T06:29:53.282 INFO:tasks.workunit.client.0.smithi062.stdout:8/361: rename da/d11/d2e/d34/l35 to da/d11/d1c/l79 0 2024-05-09T06:29:53.282 INFO:tasks.workunit.client.0.smithi062.stdout:8/362: fsync da/f57 0 2024-05-09T06:29:53.300 INFO:tasks.workunit.client.0.smithi062.stdout:4/300: dwrite d0/d2a/d1f/f22 [4194304,4194304] 0 2024-05-09T06:29:53.309 INFO:tasks.workunit.client.0.smithi062.stdout:4/301: dread d0/f46 [0,4194304] 0 2024-05-09T06:29:53.314 INFO:tasks.workunit.client.0.smithi062.stdout:3/221: truncate d1/d1e/d26/f2b 1544674 0 2024-05-09T06:29:53.316 INFO:tasks.workunit.client.0.smithi062.stdout:0/247: mkdir d1/d25/d59 0 2024-05-09T06:29:53.317 INFO:tasks.workunit.client.0.smithi062.stdout:2/249: mknod d0/d9/d17/c4a 0 2024-05-09T06:29:53.320 INFO:tasks.workunit.client.0.smithi062.stdout:6/309: truncate dc/d28/f1b 165492 0 2024-05-09T06:29:53.322 INFO:tasks.workunit.client.0.smithi062.stdout:6/310: dread dc/d28/f24 [0,4194304] 0 2024-05-09T06:29:53.323 INFO:tasks.workunit.client.0.smithi062.stdout:5/294: truncate d0/d56/f12 71468 0 2024-05-09T06:29:53.324 INFO:tasks.workunit.client.0.smithi062.stdout:5/295: dread d0/d8/d1c/d23/f5b [0,4194304] 0 2024-05-09T06:29:53.325 INFO:tasks.workunit.client.0.smithi062.stdout:8/363: creat da/f7a x:0 0 0 2024-05-09T06:29:53.328 INFO:tasks.workunit.client.0.smithi062.stdout:4/302: mkdir d0/d5b 0 2024-05-09T06:29:53.332 INFO:tasks.workunit.client.0.smithi062.stdout:3/222: rmdir d1/d1e/d3b 39 2024-05-09T06:29:53.332 INFO:tasks.workunit.client.0.smithi062.stdout:3/223: truncate d1/d1e/f39 581166 0 2024-05-09T06:29:53.333 INFO:tasks.workunit.client.0.smithi062.stdout:0/248: symlink d1/d25/d49/d4f/d52/l5a 0 2024-05-09T06:29:53.337 INFO:tasks.workunit.client.0.smithi062.stdout:2/250: creat d0/d9/d38/d41/d48/f4b x:0 0 0 2024-05-09T06:29:53.341 INFO:tasks.workunit.client.0.smithi062.stdout:6/311: link dc/d28/d34/l49 dc/d28/d46/d3a/l68 0 2024-05-09T06:29:53.341 INFO:tasks.workunit.client.0.smithi062.stdout:6/312: creat dc/d42/f69 x:0 0 0 2024-05-09T06:29:53.342 INFO:tasks.workunit.client.0.smithi062.stdout:8/364: dwrite da/d11/f1d [0,4194304] 0 2024-05-09T06:29:53.345 INFO:tasks.workunit.client.0.smithi062.stdout:4/303: symlink d0/d2a/d8/df/l5c 0 2024-05-09T06:29:53.346 INFO:tasks.workunit.client.0.smithi062.stdout:4/304: fdatasync d0/f3d 0 2024-05-09T06:29:53.349 INFO:tasks.workunit.client.0.smithi062.stdout:3/224: link d1/f2f d1/f46 0 2024-05-09T06:29:53.352 INFO:tasks.workunit.client.0.smithi062.stdout:0/249: mkdir d1/d25/d49/d42/d5b 0 2024-05-09T06:29:53.352 INFO:tasks.workunit.client.0.smithi062.stdout:0/250: creat d1/d25/d49/d3c/f5c x:0 0 0 2024-05-09T06:29:53.353 INFO:tasks.workunit.client.0.smithi062.stdout:3/225: fdatasync d1/d1e/f1d 0 2024-05-09T06:29:53.355 INFO:tasks.workunit.client.0.smithi062.stdout:4/305: dread d0/f3d [0,4194304] 0 2024-05-09T06:29:53.356 INFO:tasks.workunit.client.0.smithi062.stdout:2/251: link d0/d9/d38/d41/d48/f4b d0/d9/d38/d41/d48/f4c 0 2024-05-09T06:29:53.356 INFO:tasks.workunit.client.0.smithi062.stdout:2/252: truncate d0/f3a 145246 0 2024-05-09T06:29:53.361 INFO:tasks.workunit.client.0.smithi062.stdout:2/253: dread d0/f39 [4194304,4194304] 0 2024-05-09T06:29:53.361 INFO:tasks.workunit.client.0.smithi062.stdout:2/254: chown d0/d9/d38/d41 24614048 1 2024-05-09T06:29:53.362 INFO:tasks.workunit.client.0.smithi062.stdout:6/313: rename dc/d28/f1b to dc/d28/d10/d20/d5b/f6a 0 2024-05-09T06:29:53.362 INFO:tasks.workunit.client.0.smithi062.stdout:6/314: chown dc/ff 0 1 2024-05-09T06:29:53.364 INFO:tasks.workunit.client.0.smithi062.stdout:3/226: write d1/f1b [1485726,72038] 0 2024-05-09T06:29:53.368 INFO:tasks.workunit.client.0.smithi062.stdout:6/315: dread dc/d28/d46/d4a/d5d/f27 [0,4194304] 0 2024-05-09T06:29:53.375 INFO:tasks.workunit.client.0.smithi062.stdout:8/365: creat da/d11/d2e/d34/f7b x:0 0 0 2024-05-09T06:29:53.375 INFO:tasks.workunit.client.0.smithi062.stdout:8/366: chown da/f28 9635 1 2024-05-09T06:29:53.377 INFO:tasks.workunit.client.0.smithi062.stdout:5/296: unlink d0/d56/f12 0 2024-05-09T06:29:53.380 INFO:tasks.workunit.client.0.smithi062.stdout:2/255: dwrite d0/f3a [0,4194304] 0 2024-05-09T06:29:53.380 INFO:tasks.workunit.client.0.smithi062.stdout:2/256: fsync d0/d9/dd/d1f/f3e 0 2024-05-09T06:29:53.380 INFO:tasks.workunit.client.0.smithi062.stdout:2/257: read d0/d9/dd/f1c [939640,2610] 0 2024-05-09T06:29:53.382 INFO:tasks.workunit.client.0.smithi062.stdout:0/251: mknod d1/d32/c5d 0 2024-05-09T06:29:53.386 INFO:tasks.workunit.client.0.smithi062.stdout:4/306: rmdir d0/d2a/d1f 39 2024-05-09T06:29:53.387 INFO:tasks.workunit.client.0.smithi062.stdout:4/307: read d0/d2a/d8/df/d28/f41 [331388,54127] 0 2024-05-09T06:29:53.387 INFO:tasks.workunit.client.0.smithi062.stdout:4/308: readlink d0/l3b 0 2024-05-09T06:29:53.387 INFO:tasks.workunit.client.0.smithi062.stdout:8/367: symlink da/d11/l7c 0 2024-05-09T06:29:53.390 INFO:tasks.workunit.client.0.smithi062.stdout:5/297: symlink d0/d11/d67/l6d 0 2024-05-09T06:29:53.395 INFO:tasks.workunit.client.0.smithi062.stdout:0/252: rename d1/d25/f2f to d1/d25/d49/d42/d43/f5e 0 2024-05-09T06:29:53.395 INFO:tasks.workunit.client.0.smithi062.stdout:0/253: write d1/d25/d31/f33 [154789,117261] 0 2024-05-09T06:29:53.396 INFO:tasks.workunit.client.0.smithi062.stdout:0/254: read - d1/d25/d49/d3c/f5c zero size 2024-05-09T06:29:53.396 INFO:tasks.workunit.client.0.smithi062.stdout:4/309: creat d0/d2a/d8/df/f5d x:0 0 0 2024-05-09T06:29:53.397 INFO:tasks.workunit.client.0.smithi062.stdout:5/298: mkdir d0/d8/d47/d6e 0 2024-05-09T06:29:53.398 INFO:tasks.workunit.client.0.smithi062.stdout:0/255: chown d1/ca 22989 1 2024-05-09T06:29:53.398 INFO:tasks.workunit.client.0.smithi062.stdout:0/256: write d1/f2a [1093816,28221] 0 2024-05-09T06:29:53.400 INFO:tasks.workunit.client.0.smithi062.stdout:4/310: creat d0/d3c/f5e x:0 0 0 2024-05-09T06:29:53.400 INFO:tasks.workunit.client.0.smithi062.stdout:4/311: write d0/d2a/d8/df/d28/d31/f58 [809933,102597] 0 2024-05-09T06:29:53.406 INFO:tasks.workunit.client.0.smithi062.stdout:7/307: sync 2024-05-09T06:29:53.407 INFO:tasks.workunit.client.0.smithi062.stdout:7/308: chown d0/d12/d33/f55 3 1 2024-05-09T06:29:53.407 INFO:tasks.workunit.client.0.smithi062.stdout:7/309: fsync d0/d3/f40 0 2024-05-09T06:29:53.407 INFO:tasks.workunit.client.0.smithi062.stdout:9/340: sync 2024-05-09T06:29:53.407 INFO:tasks.workunit.client.0.smithi062.stdout:1/254: sync 2024-05-09T06:29:53.407 INFO:tasks.workunit.client.0.smithi062.stdout:1/255: rename d8/d14/d2b/d3c/d44/d4b to d8/d14/d2b/d3c/d44/d4b/d56 22 2024-05-09T06:29:53.410 INFO:tasks.workunit.client.0.smithi062.stdout:6/316: dwrite dc/d28/d34/d4e/d57/f65 [0,4194304] 0 2024-05-09T06:29:53.410 INFO:tasks.workunit.client.0.smithi062.stdout:3/227: dwrite d1/f27 [0,4194304] 0 2024-05-09T06:29:53.410 INFO:tasks.workunit.client.0.smithi062.stdout:6/317: write dc/d28/d10/f35 [4348586,43284] 0 2024-05-09T06:29:53.410 INFO:tasks.workunit.client.0.smithi062.stdout:9/341: truncate d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f43 55330 0 2024-05-09T06:29:53.414 INFO:tasks.workunit.client.0.smithi062.stdout:2/258: dwrite d0/f39 [8388608,4194304] 0 2024-05-09T06:29:53.415 INFO:tasks.workunit.client.0.smithi062.stdout:3/228: symlink d1/l47 0 2024-05-09T06:29:53.417 INFO:tasks.workunit.client.0.smithi062.stdout:9/342: unlink d3/d3e/d52/d58/d1c/d21/f5a 0 2024-05-09T06:29:53.417 INFO:tasks.workunit.client.0.smithi062.stdout:9/343: fsync d3/f19 0 2024-05-09T06:29:53.422 INFO:tasks.workunit.client.0.smithi062.stdout:3/229: mkdir d1/d48 0 2024-05-09T06:29:53.423 INFO:tasks.workunit.client.0.smithi062.stdout:1/256: write d8/f31 [8295739,116945] 0 2024-05-09T06:29:53.426 INFO:tasks.workunit.client.0.smithi062.stdout:2/259: getdents d0/d9/d38/d41/d48 0 2024-05-09T06:29:53.426 INFO:tasks.workunit.client.0.smithi062.stdout:2/260: write d0/d9/dd/f1a [5218975,33412] 0 2024-05-09T06:29:53.428 INFO:tasks.workunit.client.0.smithi062.stdout:1/257: read d8/d14/d2b/d3c/d44/f34 [3757137,60961] 0 2024-05-09T06:29:53.430 INFO:tasks.workunit.client.0.smithi062.stdout:4/312: dwrite d0/d2a/f6 [0,4194304] 0 2024-05-09T06:29:53.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/344: mknod d3/d3e/d4b/c74 0 2024-05-09T06:29:53.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/345: write d3/d3e/d52/d58/d1c/d1e/d41/f4f [2142617,27985] 0 2024-05-09T06:29:53.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/346: write d3/d3e/d52/d58/d1c/f66 [990908,90936] 0 2024-05-09T06:29:53.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/347: creat d3/f75 x:0 0 0 2024-05-09T06:29:53.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/348: stat d3/d3e/d52/d58/d1c/f6f 0 2024-05-09T06:29:53.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/349: chown d3/d3e/d52/d58/d1c/d1e/f4c 970 1 2024-05-09T06:29:53.433 INFO:tasks.workunit.client.0.smithi062.stdout:1/258: symlink d8/d14/d2b/d3c/l57 0 2024-05-09T06:29:53.438 INFO:tasks.workunit.client.0.smithi062.stdout:2/261: dread d0/fa [0,4194304] 0 2024-05-09T06:29:53.438 INFO:tasks.workunit.client.0.smithi062.stdout:2/262: getdents d0/d9/dd/d1f/d21/d29/d40 0 2024-05-09T06:29:53.438 INFO:tasks.workunit.client.0.smithi062.stdout:7/310: dwrite d0/d12/d33/f3c [0,4194304] 0 2024-05-09T06:29:53.439 INFO:tasks.workunit.client.0.smithi062.stdout:7/311: dread - d0/d3/f3e zero size 2024-05-09T06:29:53.439 INFO:tasks.workunit.client.0.smithi062.stdout:7/312: chown d0/d3 114801 1 2024-05-09T06:29:53.439 INFO:tasks.workunit.client.0.smithi062.stdout:6/318: dread dc/d28/f22 [0,4194304] 0 2024-05-09T06:29:53.439 INFO:tasks.workunit.client.0.smithi062.stdout:6/319: fsync dc/d28/d46/f29 0 2024-05-09T06:29:53.439 INFO:tasks.workunit.client.0.smithi062.stdout:6/320: chown dc/f5e 0 1 2024-05-09T06:29:53.439 INFO:tasks.workunit.client.0.smithi062.stdout:4/313: rename d0/f17 to d0/d3c/f5f 0 2024-05-09T06:29:53.445 INFO:tasks.workunit.client.0.smithi062.stdout:3/230: dwrite d1/d1e/f14 [0,4194304] 0 2024-05-09T06:29:53.445 INFO:tasks.workunit.client.0.smithi062.stdout:1/259: write d8/d1d/f26 [1592232,55444] 0 2024-05-09T06:29:53.450 INFO:tasks.workunit.client.0.smithi062.stdout:7/313: dread d0/d3/f1f [0,4194304] 0 2024-05-09T06:29:53.450 INFO:tasks.workunit.client.0.smithi062.stdout:7/314: creat d0/f5c x:0 0 0 2024-05-09T06:29:53.450 INFO:tasks.workunit.client.0.smithi062.stdout:7/315: creat d0/d12/f5d x:0 0 0 2024-05-09T06:29:53.450 INFO:tasks.workunit.client.0.smithi062.stdout:7/316: creat d0/d12/d33/f5e x:0 0 0 2024-05-09T06:29:53.451 INFO:tasks.workunit.client.0.smithi062.stdout:7/317: readlink d0/l31 0 2024-05-09T06:29:53.451 INFO:tasks.workunit.client.0.smithi062.stdout:7/318: fdatasync d0/d3/f2b 0 2024-05-09T06:29:53.451 INFO:tasks.workunit.client.0.smithi062.stdout:7/319: creat d0/d3a/f5f x:0 0 0 2024-05-09T06:29:53.451 INFO:tasks.workunit.client.0.smithi062.stdout:7/320: readlink d0/l31 0 2024-05-09T06:29:53.451 INFO:tasks.workunit.client.0.smithi062.stdout:4/314: write d0/d2a/f4 [3798198,12104] 0 2024-05-09T06:29:53.454 INFO:tasks.workunit.client.0.smithi062.stdout:6/321: rename dc/ff to dc/d28/d46/d4a/f6b 0 2024-05-09T06:29:53.454 INFO:tasks.workunit.client.0.smithi062.stdout:6/322: fdatasync dc/d28/d46/d3a/f3c 0 2024-05-09T06:29:53.461 INFO:tasks.workunit.client.0.smithi062.stdout:3/231: creat d1/d1e/d36/f49 x:0 0 0 2024-05-09T06:29:53.461 INFO:tasks.workunit.client.0.smithi062.stdout:3/232: fsync d1/d1e/f25 0 2024-05-09T06:29:53.465 INFO:tasks.workunit.client.0.smithi062.stdout:1/260: creat d8/d1d/f58 x:0 0 0 2024-05-09T06:29:53.474 INFO:tasks.workunit.client.0.smithi062.stdout:2/263: truncate d0/f3a 3047350 0 2024-05-09T06:29:53.479 INFO:tasks.workunit.client.0.smithi062.stdout:7/321: rename d0/f39 to d0/d3a/d51/f60 0 2024-05-09T06:29:53.481 INFO:tasks.workunit.client.0.smithi062.stdout:6/323: mknod dc/d28/d34/d4e/c6c 0 2024-05-09T06:29:53.483 INFO:tasks.workunit.client.0.smithi062.stdout:3/233: mkdir d1/d1e/d36/d4a 0 2024-05-09T06:29:53.485 INFO:tasks.workunit.client.0.smithi062.stdout:1/261: rename d8/d14/d2b/d3d/d3e/c40 to d8/d14/d2b/d3d/d3e/c59 0 2024-05-09T06:29:53.489 INFO:tasks.workunit.client.0.smithi062.stdout:2/264: truncate d0/d9/dd/f33 1824254 0 2024-05-09T06:29:53.491 INFO:tasks.workunit.client.0.smithi062.stdout:4/315: rename d0/d9/fc to d0/d2a/d14/d4f/f60 0 2024-05-09T06:29:53.495 INFO:tasks.workunit.client.0.smithi062.stdout:6/324: link dc/f13 dc/d28/d10/d20/d5b/f6d 0 2024-05-09T06:29:53.496 INFO:tasks.workunit.client.0.smithi062.stdout:3/234: mknod d1/d1e/d26/c4b 0 2024-05-09T06:29:53.497 INFO:tasks.workunit.client.0.smithi062.stdout:2/265: creat d0/d9/dd/d1f/d21/d29/d3d/d46/f4d x:0 0 0 2024-05-09T06:29:53.497 INFO:tasks.workunit.client.0.smithi062.stdout:2/266: creat d0/d9/dd/f4e x:0 0 0 2024-05-09T06:29:53.498 INFO:tasks.workunit.client.0.smithi062.stdout:7/322: rmdir d0/d3 39 2024-05-09T06:29:53.502 INFO:tasks.workunit.client.0.smithi062.stdout:6/325: mknod dc/d28/d34/d4e/c6e 0 2024-05-09T06:29:53.504 INFO:tasks.workunit.client.0.smithi062.stdout:3/235: rename d1/d1e/ff to d1/d48/f4c 0 2024-05-09T06:29:53.504 INFO:tasks.workunit.client.0.smithi062.stdout:3/236: readlink d1/l13 0 2024-05-09T06:29:53.511 INFO:tasks.workunit.client.0.smithi062.stdout:4/316: dwrite d0/d2a/d14/d4f/f60 [8388608,4194304] 0 2024-05-09T06:29:53.512 INFO:tasks.workunit.client.0.smithi062.stdout:4/317: stat d0/f57 0 2024-05-09T06:29:53.527 INFO:tasks.workunit.client.0.smithi062.stdout:6/326: dwrite dc/d28/d10/d20/d5b/f6d [0,4194304] 0 2024-05-09T06:29:53.691 INFO:tasks.workunit.client.0.smithi062.stdout:2/267: mknod d0/d9/dd/d1f/d21/d29/d3d/d46/c4f 0 2024-05-09T06:29:53.691 INFO:tasks.workunit.client.0.smithi062.stdout:2/268: write d0/d9/dd/d1f/f3e [968300,40732] 0 2024-05-09T06:29:53.693 INFO:tasks.workunit.client.0.smithi062.stdout:7/323: symlink d0/l61 0 2024-05-09T06:29:53.695 INFO:tasks.workunit.client.0.smithi062.stdout:3/237: unlink d1/d2d/c41 0 2024-05-09T06:29:53.695 INFO:tasks.workunit.client.0.smithi062.stdout:3/238: getdents d1/d1e/d26/d43 0 2024-05-09T06:29:53.697 INFO:tasks.workunit.client.0.smithi062.stdout:4/318: symlink d0/d2a/l61 0 2024-05-09T06:29:53.704 INFO:tasks.workunit.client.0.smithi062.stdout:7/324: symlink d0/d12/d33/l62 0 2024-05-09T06:29:53.705 INFO:tasks.workunit.client.0.smithi062.stdout:7/325: write d0/d12/d33/f3b [1174532,126398] 0 2024-05-09T06:29:53.705 INFO:tasks.workunit.client.0.smithi062.stdout:7/326: truncate d0/d3/f3e 466879 0 2024-05-09T06:29:53.707 INFO:tasks.workunit.client.0.smithi062.stdout:4/319: link d0/d2a/d8/df/f5d d0/d2a/d8/df/d28/f62 0 2024-05-09T06:29:53.711 INFO:tasks.workunit.client.0.smithi062.stdout:4/320: symlink d0/d3c/d4e/l63 0 2024-05-09T06:29:53.715 INFO:tasks.workunit.client.0.smithi062.stdout:7/327: dread d0/d3a/d51/f42 [0,4194304] 0 2024-05-09T06:29:53.716 INFO:tasks.workunit.client.0.smithi062.stdout:7/328: fdatasync d0/f1e 0 2024-05-09T06:29:53.716 INFO:tasks.workunit.client.0.smithi062.stdout:7/329: fdatasync d0/d12/f30 0 2024-05-09T06:29:53.717 INFO:tasks.workunit.client.0.smithi062.stdout:7/330: symlink d0/d3/l63 0 2024-05-09T06:29:53.717 INFO:tasks.workunit.client.0.smithi062.stdout:7/331: fsync d0/d3a/d3f/f4c 0 2024-05-09T06:29:53.720 INFO:tasks.workunit.client.0.smithi062.stdout:2/269: dwrite d0/f30 [0,4194304] 0 2024-05-09T06:29:53.720 INFO:tasks.workunit.client.0.smithi062.stdout:2/270: dread - d0/d9/d38/d41/d48/f4b zero size 2024-05-09T06:29:53.721 INFO:tasks.workunit.client.0.smithi062.stdout:3/239: dwrite d1/f20 [0,4194304] 0 2024-05-09T06:29:53.721 INFO:tasks.workunit.client.0.smithi062.stdout:7/332: mkdir d0/d3a/d51/d64 0 2024-05-09T06:29:53.727 INFO:tasks.workunit.client.0.smithi062.stdout:2/271: mknod d0/d9/dd/d1f/d21/c50 0 2024-05-09T06:29:53.727 INFO:tasks.workunit.client.0.smithi062.stdout:2/272: dread - d0/d9/d38/d41/f49 zero size 2024-05-09T06:29:53.728 INFO:tasks.workunit.client.0.smithi062.stdout:7/333: dread d0/f1e [0,4194304] 0 2024-05-09T06:29:53.728 INFO:tasks.workunit.client.0.smithi062.stdout:7/334: chown d0/d3/f4f 9865827 1 2024-05-09T06:29:53.730 INFO:tasks.workunit.client.0.smithi062.stdout:2/273: creat d0/d9/d38/d41/f51 x:0 0 0 2024-05-09T06:29:53.731 INFO:tasks.workunit.client.0.smithi062.stdout:7/335: creat d0/d3/f65 x:0 0 0 2024-05-09T06:29:53.731 INFO:tasks.workunit.client.0.smithi062.stdout:7/336: read - d0/d3a/d3f/f5a zero size 2024-05-09T06:29:53.735 INFO:tasks.workunit.client.0.smithi062.stdout:2/274: rename d0/c34 to d0/d9/dd/d1f/c52 0 2024-05-09T06:29:53.735 INFO:tasks.workunit.client.0.smithi062.stdout:4/321: dwrite d0/d2a/d8/df/f16 [0,4194304] 0 2024-05-09T06:29:53.737 INFO:tasks.workunit.client.0.smithi062.stdout:7/337: mkdir d0/d12/d66 0 2024-05-09T06:29:53.737 INFO:tasks.workunit.client.0.smithi062.stdout:7/338: write d0/d12/f30 [764867,119055] 0 2024-05-09T06:29:53.739 INFO:tasks.workunit.client.0.smithi062.stdout:2/275: mkdir d0/d9/d38/d41/d53 0 2024-05-09T06:29:53.739 INFO:tasks.workunit.client.0.smithi062.stdout:2/276: chown d0/f39 29959 1 2024-05-09T06:29:53.742 INFO:tasks.workunit.client.0.smithi062.stdout:4/322: creat d0/d2a/d4b/f64 x:0 0 0 2024-05-09T06:29:53.743 INFO:tasks.workunit.client.0.smithi062.stdout:3/240: dwrite d1/d1e/f10 [0,4194304] 0 2024-05-09T06:29:53.751 INFO:tasks.workunit.client.0.smithi062.stdout:3/241: dread d1/d1e/f10 [4194304,4194304] 0 2024-05-09T06:29:53.757 INFO:tasks.workunit.client.0.smithi062.stdout:4/323: stat d0/d2a/d8/c53 0 2024-05-09T06:29:53.758 INFO:tasks.workunit.client.0.smithi062.stdout:4/324: write d0/d2a/d8/df/f5d [476077,103462] 0 2024-05-09T06:29:53.763 INFO:tasks.workunit.client.0.smithi062.stdout:3/242: creat d1/d1e/d36/d3a/f4d x:0 0 0 2024-05-09T06:29:53.763 INFO:tasks.workunit.client.0.smithi062.stdout:3/243: write d1/d1e/f30 [431311,60947] 0 2024-05-09T06:29:53.776 INFO:tasks.workunit.client.0.smithi062.stdout:4/325: creat d0/d2a/d1f/f65 x:0 0 0 2024-05-09T06:29:53.776 INFO:tasks.workunit.client.0.smithi062.stdout:4/326: read d0/d2a/f4 [3283092,5635] 0 2024-05-09T06:29:53.778 INFO:tasks.workunit.client.0.smithi062.stdout:4/327: rename d0/d2a/d8/l35 to d0/d3c/l66 0 2024-05-09T06:29:53.778 INFO:tasks.workunit.client.0.smithi062.stdout:4/328: chown d0/d2a/d8 32403971 1 2024-05-09T06:29:53.779 INFO:tasks.workunit.client.0.smithi062.stdout:3/244: dwrite d1/d2d/f40 [0,4194304] 0 2024-05-09T06:29:53.786 INFO:tasks.workunit.client.0.smithi062.stdout:4/329: dread d0/d2a/f5 [0,4194304] 0 2024-05-09T06:29:53.803 INFO:tasks.workunit.client.0.smithi062.stdout:4/330: dwrite d0/f57 [0,4194304] 0 2024-05-09T06:29:53.805 INFO:tasks.workunit.client.0.smithi062.stdout:4/331: dread d0/d2a/d8/df/d28/d31/f58 [0,4194304] 0 2024-05-09T06:29:53.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:53 smithi079 ceph-mon[35268]: mgrmap e23: smithi079.genyri(active, since 3s) 2024-05-09T06:29:53.843 INFO:tasks.workunit.client.0.smithi062.stdout:3/245: mkdir d1/d1e/d36/d3a/d4e 0 2024-05-09T06:29:53.850 INFO:tasks.workunit.client.0.smithi062.stdout:7/339: rmdir d0 39 2024-05-09T06:29:53.851 INFO:tasks.workunit.client.0.smithi062.stdout:4/332: link d0/d2a/d8/df/d28/d4c/l5a d0/d2a/d8/df/d28/d31/l67 0 2024-05-09T06:29:53.851 INFO:tasks.workunit.client.0.smithi062.stdout:4/333: write d0/d2a/d14/d4f/f55 [795980,98587] 0 2024-05-09T06:29:53.858 INFO:tasks.workunit.client.0.smithi062.stdout:3/246: mkdir d1/d1e/d26/d33/d4f 0 2024-05-09T06:29:53.860 INFO:tasks.workunit.client.0.smithi062.stdout:7/340: mkdir d0/d12/d33/d67 0 2024-05-09T06:29:53.861 INFO:tasks.workunit.client.0.smithi062.stdout:4/334: truncate d0/f3d 3739501 0 2024-05-09T06:29:53.863 INFO:tasks.workunit.client.0.smithi062.stdout:3/247: rename d1/f21 to d1/d48/f50 0 2024-05-09T06:29:53.866 INFO:tasks.workunit.client.0.smithi062.stdout:7/341: unlink d0/d3/f38 0 2024-05-09T06:29:53.866 INFO:tasks.workunit.client.0.smithi062.stdout:7/342: write d0/d12/f24 [246989,53239] 0 2024-05-09T06:29:53.868 INFO:tasks.workunit.client.0.smithi062.stdout:4/335: rename d0/d2a/d8/c53 to d0/c68 0 2024-05-09T06:29:53.868 INFO:tasks.workunit.client.0.smithi062.stdout:4/336: fdatasync d0/f57 0 2024-05-09T06:29:53.868 INFO:tasks.workunit.client.0.smithi062.stdout:4/337: stat d0/d24/f4d 0 2024-05-09T06:29:53.870 INFO:tasks.workunit.client.0.smithi062.stdout:3/248: mkdir d1/d1e/d36/d4a/d51 0 2024-05-09T06:29:53.874 INFO:tasks.workunit.client.0.smithi062.stdout:3/249: mkdir d1/d1e/d26/d43/d52 0 2024-05-09T06:29:53.877 INFO:tasks.workunit.client.0.smithi062.stdout:3/250: creat d1/d1e/d26/d43/d52/f53 x:0 0 0 2024-05-09T06:29:53.878 INFO:tasks.workunit.client.0.smithi062.stdout:3/251: mkdir d1/d1e/d54 0 2024-05-09T06:29:53.879 INFO:tasks.workunit.client.0.smithi062.stdout:3/252: creat d1/f55 x:0 0 0 2024-05-09T06:29:53.879 INFO:tasks.workunit.client.0.smithi062.stdout:3/253: write d1/d1e/d26/f3c [72668,52016] 0 2024-05-09T06:29:53.889 INFO:tasks.workunit.client.0.smithi062.stdout:4/338: dwrite d0/d2a/d8/df/f44 [4194304,4194304] 0 2024-05-09T06:29:53.898 INFO:tasks.workunit.client.0.smithi062.stdout:3/254: dwrite d1/d1e/f1a [0,4194304] 0 2024-05-09T06:29:53.910 INFO:tasks.workunit.client.0.smithi062.stdout:4/339: dwrite d0/d9/f3e [0,4194304] 0 2024-05-09T06:29:53.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:53 smithi062 ceph-mon[26920]: mgrmap e23: smithi079.genyri(active, since 3s) 2024-05-09T06:29:53.916 INFO:tasks.workunit.client.0.smithi062.stdout:3/255: dread d1/d2d/f40 [0,4194304] 0 2024-05-09T06:29:53.921 INFO:tasks.workunit.client.0.smithi062.stdout:3/256: dread d1/d2d/f40 [0,4194304] 0 2024-05-09T06:29:53.921 INFO:tasks.workunit.client.0.smithi062.stdout:3/257: chown d1/d1e/d3b 11 1 2024-05-09T06:29:53.921 INFO:tasks.workunit.client.0.smithi062.stdout:3/258: fsync d1/d1e/f30 0 2024-05-09T06:29:53.921 INFO:tasks.workunit.client.0.smithi062.stdout:3/259: fdatasync d1/f55 0 2024-05-09T06:29:53.921 INFO:tasks.workunit.client.0.smithi062.stdout:3/260: creat d1/d1e/d26/f56 x:0 0 0 2024-05-09T06:29:53.925 INFO:tasks.workunit.client.0.smithi062.stdout:3/261: creat d1/d48/f57 x:0 0 0 2024-05-09T06:29:53.925 INFO:tasks.workunit.client.0.smithi062.stdout:3/262: write d1/f46 [617784,100935] 0 2024-05-09T06:29:53.929 INFO:tasks.workunit.client.0.smithi062.stdout:5/299: sync 2024-05-09T06:29:53.930 INFO:tasks.workunit.client.0.smithi062.stdout:8/368: sync 2024-05-09T06:29:53.930 INFO:tasks.workunit.client.0.smithi062.stdout:8/369: readlink da/d11/d2e/l30 0 2024-05-09T06:29:53.930 INFO:tasks.workunit.client.0.smithi062.stdout:8/370: chown da/d11/d2e/d34/l5f 394100 1 2024-05-09T06:29:53.930 INFO:tasks.workunit.client.0.smithi062.stdout:8/371: truncate da/f13 1212640 0 2024-05-09T06:29:53.930 INFO:tasks.workunit.client.0.smithi062.stdout:8/372: fdatasync da/d11/d2e/f4c 0 2024-05-09T06:29:53.931 INFO:tasks.workunit.client.0.smithi062.stdout:3/263: read d1/d1e/f10 [6557628,83344] 0 2024-05-09T06:29:53.932 INFO:tasks.workunit.client.0.smithi062.stdout:5/300: dread d0/d8/d18/f5d [0,4194304] 0 2024-05-09T06:29:53.934 INFO:tasks.workunit.client.0.smithi062.stdout:5/301: dread d0/d8/d18/f5d [0,4194304] 0 2024-05-09T06:29:53.936 INFO:tasks.workunit.client.0.smithi062.stdout:4/340: dwrite d0/d3c/f5e [0,4194304] 0 2024-05-09T06:29:53.938 INFO:tasks.workunit.client.0.smithi062.stdout:8/373: link da/d11/d1c/l27 da/l7d 0 2024-05-09T06:29:53.940 INFO:tasks.workunit.client.0.smithi062.stdout:5/302: creat d0/d56/d5/f6f x:0 0 0 2024-05-09T06:29:53.940 INFO:tasks.workunit.client.0.smithi062.stdout:5/303: readlink d0/d56/d5/l63 0 2024-05-09T06:29:53.943 INFO:tasks.workunit.client.0.smithi062.stdout:5/304: write d0/f24 [647886,88258] 0 2024-05-09T06:29:53.943 INFO:tasks.workunit.client.0.smithi062.stdout:5/305: readlink d0/d8/d1c/d2c/l5a 0 2024-05-09T06:29:53.948 INFO:tasks.workunit.client.0.smithi062.stdout:4/341: rmdir d0/d2a/d14 39 2024-05-09T06:29:53.949 INFO:tasks.workunit.client.0.smithi062.stdout:7/343: truncate d0/d12/f24 2228182 0 2024-05-09T06:29:53.951 INFO:tasks.workunit.client.0.smithi062.stdout:8/374: mkdir da/d11/d2e/d7e 0 2024-05-09T06:29:53.951 INFO:tasks.workunit.client.0.smithi062.stdout:8/375: chown da/d11/d1c/f4a 7833806 1 2024-05-09T06:29:53.953 INFO:tasks.workunit.client.0.smithi062.stdout:5/306: getdents d0/d8/d47 0 2024-05-09T06:29:53.954 INFO:tasks.workunit.client.0.smithi062.stdout:7/344: symlink d0/d3a/d51/d64/l68 0 2024-05-09T06:29:53.955 INFO:tasks.workunit.client.0.smithi062.stdout:5/307: getdents d0/d8/d30/d4a 0 2024-05-09T06:29:53.958 INFO:tasks.workunit.client.0.smithi062.stdout:3/264: dwrite d1/f1b [0,4194304] 0 2024-05-09T06:29:53.959 INFO:tasks.workunit.client.0.smithi062.stdout:7/345: mkdir d0/d3a/d69 0 2024-05-09T06:29:53.962 INFO:tasks.workunit.client.0.smithi062.stdout:5/308: read d0/f1d [908982,17488] 0 2024-05-09T06:29:53.964 INFO:tasks.workunit.client.0.smithi062.stdout:3/265: mknod d1/d1e/d26/d33/c58 0 2024-05-09T06:29:53.965 INFO:tasks.workunit.client.0.smithi062.stdout:7/346: creat d0/d12/d33/d67/f6a x:0 0 0 2024-05-09T06:29:53.965 INFO:tasks.workunit.client.0.smithi062.stdout:7/347: creat d0/d12/d33/d67/f6b x:0 0 0 2024-05-09T06:29:53.968 INFO:tasks.workunit.client.0.smithi062.stdout:5/309: creat d0/d3b/d3f/f70 x:0 0 0 2024-05-09T06:29:53.968 INFO:tasks.workunit.client.0.smithi062.stdout:5/310: truncate d0/d8/d1c/d23/f29 852879 0 2024-05-09T06:29:53.970 INFO:tasks.workunit.client.0.smithi062.stdout:7/348: dread d0/d12/d33/f46 [0,4194304] 0 2024-05-09T06:29:53.971 INFO:tasks.workunit.client.0.smithi062.stdout:3/266: rename d1/d1e/c17 to d1/d1e/d54/c59 0 2024-05-09T06:29:53.973 INFO:tasks.workunit.client.0.smithi062.stdout:5/311: truncate d0/f28 1218444 0 2024-05-09T06:29:53.973 INFO:tasks.workunit.client.0.smithi062.stdout:5/312: chown d0/d8/d1c/d2c/c5f 3984 1 2024-05-09T06:29:53.976 INFO:tasks.workunit.client.0.smithi062.stdout:3/267: symlink d1/d1e/d36/d3a/d4e/l5a 0 2024-05-09T06:29:53.978 INFO:tasks.workunit.client.0.smithi062.stdout:4/342: dwrite d0/d2a/d14/d4f/f60 [4194304,4194304] 0 2024-05-09T06:29:53.978 INFO:tasks.workunit.client.0.smithi062.stdout:4/343: write d0/d2a/f5 [4673811,98951] 0 2024-05-09T06:29:53.978 INFO:tasks.workunit.client.0.smithi062.stdout:8/376: dwrite da/d11/d1c/f39 [0,4194304] 0 2024-05-09T06:29:53.980 INFO:tasks.workunit.client.0.smithi062.stdout:3/268: unlink d1/d1e/d26/d33/f34 0 2024-05-09T06:29:53.991 INFO:tasks.workunit.client.0.smithi062.stdout:5/313: getdents d0/d56/d5 0 2024-05-09T06:29:53.996 INFO:tasks.workunit.client.0.smithi062.stdout:9/350: sync 2024-05-09T06:29:53.996 INFO:tasks.workunit.client.0.smithi062.stdout:0/257: sync 2024-05-09T06:29:53.997 INFO:tasks.workunit.client.0.smithi062.stdout:0/258: read - d1/d25/d49/d3c/f5c zero size 2024-05-09T06:29:53.997 INFO:tasks.workunit.client.0.smithi062.stdout:9/351: creat d3/d3e/d52/d58/d1c/f76 x:0 0 0 2024-05-09T06:29:53.997 INFO:tasks.workunit.client.0.smithi062.stdout:9/352: chown d3/ce 20 1 2024-05-09T06:29:53.997 INFO:tasks.workunit.client.0.smithi062.stdout:9/353: write d3/f75 [536184,93793] 0 2024-05-09T06:29:54.004 INFO:tasks.workunit.client.0.smithi062.stdout:8/377: rename da/d11/d2e/d61/c66 to da/d11/d1c/c7f 0 2024-05-09T06:29:54.007 INFO:tasks.workunit.client.0.smithi062.stdout:5/314: mknod d0/d8/d1c/c71 0 2024-05-09T06:29:54.010 INFO:tasks.workunit.client.0.smithi062.stdout:4/344: dwrite d0/f57 [0,4194304] 0 2024-05-09T06:29:54.010 INFO:tasks.workunit.client.0.smithi062.stdout:3/269: getdents d1/d1e/d36/d3a/d4e 0 2024-05-09T06:29:54.010 INFO:tasks.workunit.client.0.smithi062.stdout:3/270: readlink d1/l7 0 2024-05-09T06:29:54.011 INFO:tasks.workunit.client.0.smithi062.stdout:0/259: mknod d1/d25/d49/d42/d5b/c5f 0 2024-05-09T06:29:54.011 INFO:tasks.workunit.client.0.smithi062.stdout:0/260: chown d1/f2a 204 1 2024-05-09T06:29:54.013 INFO:tasks.workunit.client.0.smithi062.stdout:0/261: dread d1/d25/d31/f46 [0,4194304] 0 2024-05-09T06:29:54.021 INFO:tasks.workunit.client.0.smithi062.stdout:4/345: dread d0/d2a/d8/f50 [0,4194304] 0 2024-05-09T06:29:54.025 INFO:tasks.workunit.client.0.smithi062.stdout:0/262: dread d1/f2c [0,4194304] 0 2024-05-09T06:29:54.025 INFO:tasks.workunit.client.0.smithi062.stdout:0/263: write d1/d18/d48/f53 [2764083,4636] 0 2024-05-09T06:29:54.025 INFO:tasks.workunit.client.0.smithi062.stdout:8/378: getdents da/d11/d1c 0 2024-05-09T06:29:54.026 INFO:tasks.workunit.client.0.smithi062.stdout:8/379: read da/d11/d1c/f43 [274627,79356] 0 2024-05-09T06:29:54.027 INFO:tasks.workunit.client.0.smithi062.stdout:2/277: sync 2024-05-09T06:29:54.027 INFO:tasks.workunit.client.0.smithi062.stdout:1/262: sync 2024-05-09T06:29:54.027 INFO:tasks.workunit.client.0.smithi062.stdout:6/327: sync 2024-05-09T06:29:54.032 INFO:tasks.workunit.client.0.smithi062.stdout:9/354: dwrite d3/d3e/d52/d58/f35 [0,4194304] 0 2024-05-09T06:29:54.032 INFO:tasks.workunit.client.0.smithi062.stdout:6/328: mkdir dc/d28/d46/d4a/d5d/d6f 0 2024-05-09T06:29:54.033 INFO:tasks.workunit.client.0.smithi062.stdout:5/315: dwrite d0/d8/d1c/d2c/f33 [0,4194304] 0 2024-05-09T06:29:54.033 INFO:tasks.workunit.client.0.smithi062.stdout:3/271: dwrite d1/f1f [0,4194304] 0 2024-05-09T06:29:54.033 INFO:tasks.workunit.client.0.smithi062.stdout:4/346: read d0/d3c/f5e [2773258,86411] 0 2024-05-09T06:29:54.033 INFO:tasks.workunit.client.0.smithi062.stdout:4/347: write d0/d2a/f4 [1236988,89556] 0 2024-05-09T06:29:54.034 INFO:tasks.workunit.client.0.smithi062.stdout:6/329: dread dc/d28/d34/f38 [0,4194304] 0 2024-05-09T06:29:54.036 INFO:tasks.workunit.client.0.smithi062.stdout:0/264: rename d1/l2e to d1/d25/d49/l60 0 2024-05-09T06:29:54.040 INFO:tasks.workunit.client.0.smithi062.stdout:8/380: dread da/f28 [0,4194304] 0 2024-05-09T06:29:54.040 INFO:tasks.workunit.client.0.smithi062.stdout:8/381: chown da/d11/d1c/f4a 50 1 2024-05-09T06:29:54.040 INFO:tasks.workunit.client.0.smithi062.stdout:8/382: truncate da/d11/d2e/f53 54670 0 2024-05-09T06:29:54.041 INFO:tasks.workunit.client.0.smithi062.stdout:9/355: mkdir d3/d3e/d52/d58/d77 0 2024-05-09T06:29:54.041 INFO:tasks.workunit.client.0.smithi062.stdout:5/316: dread d0/f37 [0,4194304] 0 2024-05-09T06:29:54.043 INFO:tasks.workunit.client.0.smithi062.stdout:5/317: dread d0/f2d [0,4194304] 0 2024-05-09T06:29:54.049 INFO:tasks.workunit.client.0.smithi062.stdout:4/348: mkdir d0/d2a/d8/d69 0 2024-05-09T06:29:54.049 INFO:tasks.workunit.client.0.smithi062.stdout:4/349: readlink d0/d2a/d8/df/d28/d4c/l5a 0 2024-05-09T06:29:54.051 INFO:tasks.workunit.client.0.smithi062.stdout:6/330: truncate dc/d28/d10/d20/f31 257929 0 2024-05-09T06:29:54.051 INFO:tasks.workunit.client.0.smithi062.stdout:6/331: chown dc/d28/d46/d4a/d5d/f27 456492 1 2024-05-09T06:29:54.051 INFO:tasks.workunit.client.0.smithi062.stdout:6/332: readlink dc/d28/d10/l1d 0 2024-05-09T06:29:54.051 INFO:tasks.workunit.client.0.smithi062.stdout:6/333: fdatasync dc/d28/d34/f3d 0 2024-05-09T06:29:54.054 INFO:tasks.workunit.client.0.smithi062.stdout:1/263: rename d8/d14/d2b/f53 to d8/f5a 0 2024-05-09T06:29:54.054 INFO:tasks.workunit.client.0.smithi062.stdout:1/264: chown d8/d1d/l28 15 1 2024-05-09T06:29:54.055 INFO:tasks.workunit.client.0.smithi062.stdout:0/265: truncate d1/fd 488266 0 2024-05-09T06:29:54.059 INFO:tasks.workunit.client.0.smithi062.stdout:8/383: symlink da/d11/l80 0 2024-05-09T06:29:54.059 INFO:tasks.workunit.client.0.smithi062.stdout:8/384: truncate da/d11/d1c/f4a 168644 0 2024-05-09T06:29:54.060 INFO:tasks.workunit.client.0.smithi062.stdout:8/385: readlink da/d11/d2e/d34/l5f 0 2024-05-09T06:29:54.060 INFO:tasks.workunit.client.0.smithi062.stdout:8/386: write da/d11/d2e/d61/d64/f69 [161308,96199] 0 2024-05-09T06:29:54.060 INFO:tasks.workunit.client.0.smithi062.stdout:8/387: chown da/d11/d1c/f3e 1 1 2024-05-09T06:29:54.061 INFO:tasks.workunit.client.0.smithi062.stdout:9/356: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f78 x:0 0 0 2024-05-09T06:29:54.062 INFO:tasks.workunit.client.0.smithi062.stdout:5/318: creat d0/d8/d30/f72 x:0 0 0 2024-05-09T06:29:54.064 INFO:tasks.workunit.client.0.smithi062.stdout:4/350: truncate d0/d2a/f36 3998497 0 2024-05-09T06:29:54.064 INFO:tasks.workunit.client.0.smithi062.stdout:4/351: chown d0/d2a/d8/c2e 205555111 1 2024-05-09T06:29:54.066 INFO:tasks.workunit.client.0.smithi062.stdout:6/334: mkdir dc/d42/d70 0 2024-05-09T06:29:54.070 INFO:tasks.workunit.client.0.smithi062.stdout:2/278: rename d0/d9/dd/d1f/f3e to d0/d9/dd/f54 0 2024-05-09T06:29:54.070 INFO:tasks.workunit.client.0.smithi062.stdout:2/279: write d0/d9/dd/d1f/d21/f35 [243474,102764] 0 2024-05-09T06:29:54.072 INFO:tasks.workunit.client.0.smithi062.stdout:1/265: mknod d8/d14/d2b/d3c/d44/d38/c5b 0 2024-05-09T06:29:54.072 INFO:tasks.workunit.client.0.smithi062.stdout:1/266: dread - d8/f54 zero size 2024-05-09T06:29:54.074 INFO:tasks.workunit.client.0.smithi062.stdout:0/266: mkdir d1/d25/d49/d42/d43/d54/d61 0 2024-05-09T06:29:54.074 INFO:tasks.workunit.client.0.smithi062.stdout:0/267: write d1/d18/f35 [1259497,56424] 0 2024-05-09T06:29:54.078 INFO:tasks.workunit.client.0.smithi062.stdout:9/357: symlink d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/l79 0 2024-05-09T06:29:54.080 INFO:tasks.workunit.client.0.smithi062.stdout:8/388: getdents da/d11 0 2024-05-09T06:29:54.080 INFO:tasks.workunit.client.0.smithi062.stdout:8/389: getdents da/d11/d2e/d7e 0 2024-05-09T06:29:54.080 INFO:tasks.workunit.client.0.smithi062.stdout:8/390: fdatasync da/f57 0 2024-05-09T06:29:54.081 INFO:tasks.workunit.client.0.smithi062.stdout:9/358: dread d3/d3e/d52/d58/d1c/f66 [0,4194304] 0 2024-05-09T06:29:54.082 INFO:tasks.workunit.client.0.smithi062.stdout:6/335: symlink dc/d28/d46/d4a/l71 0 2024-05-09T06:29:54.086 INFO:tasks.workunit.client.0.smithi062.stdout:3/272: rename d1/cc to d1/d1e/d54/c5b 0 2024-05-09T06:29:54.091 INFO:tasks.workunit.client.0.smithi062.stdout:4/352: dwrite d0/d2a/f25 [0,4194304] 0 2024-05-09T06:29:54.091 INFO:tasks.workunit.client.0.smithi062.stdout:4/353: write d0/d2a/d4b/f64 [843606,129889] 0 2024-05-09T06:29:54.095 INFO:tasks.workunit.client.0.smithi062.stdout:8/391: symlink da/d11/d2e/d34/l81 0 2024-05-09T06:29:54.095 INFO:tasks.workunit.client.0.smithi062.stdout:8/392: read da/d11/f23 [4246143,51953] 0 2024-05-09T06:29:54.096 INFO:tasks.workunit.client.0.smithi062.stdout:6/336: symlink dc/d28/d46/l72 0 2024-05-09T06:29:54.096 INFO:tasks.workunit.client.0.smithi062.stdout:6/337: chown dc 1773113988 1 2024-05-09T06:29:54.099 INFO:tasks.workunit.client.0.smithi062.stdout:5/319: rename d0/d11/c15 to d0/d8/d1c/d23/d42/c73 0 2024-05-09T06:29:54.100 INFO:tasks.workunit.client.0.smithi062.stdout:4/354: symlink d0/d24/l6a 0 2024-05-09T06:29:54.101 INFO:tasks.workunit.client.0.smithi062.stdout:6/338: getdents dc/d28/d10/d20 0 2024-05-09T06:29:54.102 INFO:tasks.workunit.client.0.smithi062.stdout:8/393: dread f9 [0,4194304] 0 2024-05-09T06:29:54.102 INFO:tasks.workunit.client.0.smithi062.stdout:8/394: creat da/f82 x:0 0 0 2024-05-09T06:29:54.104 INFO:tasks.workunit.client.0.smithi062.stdout:3/273: rename d1/l47 to d1/d1e/d36/d3a/d4e/l5c 0 2024-05-09T06:29:54.104 INFO:tasks.workunit.client.0.smithi062.stdout:3/274: fdatasync d1/d48/f57 0 2024-05-09T06:29:54.104 INFO:tasks.workunit.client.0.smithi062.stdout:3/275: creat d1/d1e/d36/f5d x:0 0 0 2024-05-09T06:29:54.104 INFO:tasks.workunit.client.0.smithi062.stdout:5/320: creat d0/f74 x:0 0 0 2024-05-09T06:29:54.107 INFO:tasks.workunit.client.0.smithi062.stdout:6/339: mknod dc/d28/d34/c73 0 2024-05-09T06:29:54.109 INFO:tasks.workunit.client.0.smithi062.stdout:1/267: dwrite f3 [4194304,4194304] 0 2024-05-09T06:29:54.109 INFO:tasks.workunit.client.0.smithi062.stdout:2/280: dwrite d0/d9/dd/d1f/d21/f28 [0,4194304] 0 2024-05-09T06:29:54.111 INFO:tasks.workunit.client.0.smithi062.stdout:3/276: mknod d1/d48/c5e 0 2024-05-09T06:29:54.112 INFO:tasks.workunit.client.0.smithi062.stdout:5/321: rename d0/d8/d1c/f20 to d0/d56/d45/f75 0 2024-05-09T06:29:54.113 INFO:tasks.workunit.client.0.smithi062.stdout:5/322: write d0/d8/d1c/f62 [297582,121697] 0 2024-05-09T06:29:54.115 INFO:tasks.workunit.client.0.smithi062.stdout:4/355: getdents d0/d2a 0 2024-05-09T06:29:54.116 INFO:tasks.workunit.client.0.smithi062.stdout:8/395: dread f7 [0,4194304] 0 2024-05-09T06:29:54.116 INFO:tasks.workunit.client.0.smithi062.stdout:8/396: chown da/d11/f58 7 1 2024-05-09T06:29:54.116 INFO:tasks.workunit.client.0.smithi062.stdout:8/397: fdatasync da/d11/f6d 0 2024-05-09T06:29:54.116 INFO:tasks.workunit.client.0.smithi062.stdout:8/398: readlink da/d11/l7c 0 2024-05-09T06:29:54.117 INFO:tasks.workunit.client.0.smithi062.stdout:6/340: mkdir dc/d42/d70/d74 0 2024-05-09T06:29:54.117 INFO:tasks.workunit.client.0.smithi062.stdout:6/341: fdatasync dc/d28/f11 0 2024-05-09T06:29:54.117 INFO:tasks.workunit.client.0.smithi062.stdout:6/342: creat dc/d28/d34/d4e/d57/f75 x:0 0 0 2024-05-09T06:29:54.119 INFO:tasks.workunit.client.0.smithi062.stdout:2/281: rmdir d0/d9/dd/d1f/d21/d29/d3d 39 2024-05-09T06:29:54.119 INFO:tasks.workunit.client.0.smithi062.stdout:2/282: getdents d0/d9/dd/d1f/d21/d29/d40 0 2024-05-09T06:29:54.119 INFO:tasks.workunit.client.0.smithi062.stdout:2/283: read - d0/d9/d38/d41/d48/f4c zero size 2024-05-09T06:29:54.119 INFO:tasks.workunit.client.0.smithi062.stdout:8/399: mkdir da/d11/d2e/d7e/d83 0 2024-05-09T06:29:54.119 INFO:tasks.workunit.client.0.smithi062.stdout:8/400: chown c0 29 1 2024-05-09T06:29:54.120 INFO:tasks.workunit.client.0.smithi062.stdout:8/401: read da/f13 [857715,119033] 0 2024-05-09T06:29:54.120 INFO:tasks.workunit.client.0.smithi062.stdout:8/402: truncate da/d11/d2e/f53 1056080 0 2024-05-09T06:29:54.121 INFO:tasks.workunit.client.0.smithi062.stdout:4/356: read d0/f46 [1345642,121529] 0 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:1/268: write f6 [2211900,117615] 0 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:1/269: dread - d8/d14/d2b/d3c/f4e zero size 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:1/270: write d8/f3f [1416465,59633] 0 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:1/271: readlink d8/ld 0 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:9/359: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f43 [0,4194304] 0 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:2/284: stat d0/d9/dd/l2d 0 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:2/285: dread - d0/d9/d38/d41/f49 zero size 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:3/277: write d1/f8 [3444834,66531] 0 2024-05-09T06:29:54.126 INFO:tasks.workunit.client.0.smithi062.stdout:3/278: readlink d1/l7 0 2024-05-09T06:29:54.128 INFO:tasks.workunit.client.0.smithi062.stdout:1/272: unlink d8/d1d/l30 0 2024-05-09T06:29:54.129 INFO:tasks.workunit.client.0.smithi062.stdout:5/323: dread d0/d8/f41 [0,4194304] 0 2024-05-09T06:29:54.131 INFO:tasks.workunit.client.0.smithi062.stdout:9/360: creat d3/d20/f7a x:0 0 0 2024-05-09T06:29:54.133 INFO:tasks.workunit.client.0.smithi062.stdout:2/286: link d0/fa d0/d9/dd/d1f/d21/f55 0 2024-05-09T06:29:54.133 INFO:tasks.workunit.client.0.smithi062.stdout:2/287: creat d0/d9/dd/d1f/f56 x:0 0 0 2024-05-09T06:29:54.136 INFO:tasks.workunit.client.0.smithi062.stdout:5/324: dread d0/d8/d1c/d23/f48 [0,4194304] 0 2024-05-09T06:29:54.141 INFO:tasks.workunit.client.0.smithi062.stdout:3/279: mknod d1/c5f 0 2024-05-09T06:29:54.146 INFO:tasks.workunit.client.0.smithi062.stdout:6/343: dwrite dc/d28/d10/f4b [0,4194304] 0 2024-05-09T06:29:54.146 INFO:tasks.workunit.client.0.smithi062.stdout:6/344: chown dc/d28/d10/f35 2850027 1 2024-05-09T06:29:54.146 INFO:tasks.workunit.client.0.smithi062.stdout:6/345: chown dc/d28/d46/d4a/f6b 0 1 2024-05-09T06:29:54.146 INFO:tasks.workunit.client.0.smithi062.stdout:8/403: dwrite da/f5d [4194304,4194304] 0 2024-05-09T06:29:54.147 INFO:tasks.workunit.client.0.smithi062.stdout:1/273: link d8/d2c/c4c d8/d14/d2b/d3c/d44/d4b/c5c 0 2024-05-09T06:29:54.147 INFO:tasks.workunit.client.0.smithi062.stdout:1/274: write d8/d14/d2b/f2e [724850,14947] 0 2024-05-09T06:29:54.147 INFO:tasks.workunit.client.0.smithi062.stdout:1/275: truncate d8/d2c/d41/f4f 553130 0 2024-05-09T06:29:54.147 INFO:tasks.workunit.client.0.smithi062.stdout:9/361: dwrite d3/d3e/d52/d58/d1c/f76 [0,4194304] 0 2024-05-09T06:29:54.147 INFO:tasks.workunit.client.0.smithi062.stdout:3/280: write d1/d1e/f25 [6753168,68755] 0 2024-05-09T06:29:54.154 INFO:tasks.workunit.client.0.smithi062.stdout:5/325: rmdir d0/d11/d67 39 2024-05-09T06:29:54.155 INFO:tasks.workunit.client.0.smithi062.stdout:5/326: chown d0 1483 1 2024-05-09T06:29:54.155 INFO:tasks.workunit.client.0.smithi062.stdout:5/327: truncate d0/d8/d1c/d23/f4f 847252 0 2024-05-09T06:29:54.158 INFO:tasks.workunit.client.0.smithi062.stdout:6/346: mkdir dc/d28/d46/d4a/d5d/d6f/d76 0 2024-05-09T06:29:54.159 INFO:tasks.workunit.client.0.smithi062.stdout:9/362: dread d3/f18 [0,4194304] 0 2024-05-09T06:29:54.161 INFO:tasks.workunit.client.0.smithi062.stdout:8/404: symlink da/d77/l84 0 2024-05-09T06:29:54.165 INFO:tasks.workunit.client.0.smithi062.stdout:3/281: symlink d1/d1e/d36/d4a/l60 0 2024-05-09T06:29:54.174 INFO:tasks.workunit.client.0.smithi062.stdout:4/357: rename d0/d24 to d0/d2a/d14/d4f/d6b 0 2024-05-09T06:29:54.175 INFO:tasks.workunit.client.0.smithi062.stdout:5/328: rmdir d0/d8/d1c/d2c 39 2024-05-09T06:29:54.180 INFO:tasks.workunit.client.0.smithi062.stdout:6/347: mkdir dc/d28/d10/d20/d5b/d77 0 2024-05-09T06:29:54.182 INFO:tasks.workunit.client.0.smithi062.stdout:6/348: read dc/f17 [32001,119665] 0 2024-05-09T06:29:54.182 INFO:tasks.workunit.client.0.smithi062.stdout:2/288: getdents d0/d9/dd/d1f/d21 0 2024-05-09T06:29:54.183 INFO:tasks.workunit.client.0.smithi062.stdout:2/289: read d0/f6 [2425789,65482] 0 2024-05-09T06:29:54.184 INFO:tasks.workunit.client.0.smithi062.stdout:2/290: dread d0/d9/dd/d1f/d21/f35 [0,4194304] 0 2024-05-09T06:29:54.185 INFO:tasks.workunit.client.0.smithi062.stdout:2/291: fsync d0/d9/d38/d41/d48/f4b 0 2024-05-09T06:29:54.185 INFO:tasks.workunit.client.0.smithi062.stdout:9/363: unlink c1 0 2024-05-09T06:29:54.185 INFO:tasks.workunit.client.0.smithi062.stdout:9/364: stat d3/cc 0 2024-05-09T06:29:54.185 INFO:tasks.workunit.client.0.smithi062.stdout:3/282: dwrite d1/d1e/f14 [0,4194304] 0 2024-05-09T06:29:54.186 INFO:tasks.workunit.client.0.smithi062.stdout:8/405: mkdir da/d85 0 2024-05-09T06:29:54.188 INFO:tasks.workunit.client.0.smithi062.stdout:4/358: mkdir d0/d2a/d1f/d6c 0 2024-05-09T06:29:54.188 INFO:tasks.workunit.client.0.smithi062.stdout:4/359: readlink d0/d3c/d4e/l63 0 2024-05-09T06:29:54.189 INFO:tasks.workunit.client.0.smithi062.stdout:4/360: read d0/d2a/f1d [263124,114751] 0 2024-05-09T06:29:54.190 INFO:tasks.workunit.client.0.smithi062.stdout:6/349: rename dc/d28/d34/d4e/d5c to dc/d28/d34/d4e/d78 0 2024-05-09T06:29:54.192 INFO:tasks.workunit.client.0.smithi062.stdout:2/292: symlink d0/d9/dd/d1f/d21/d29/l57 0 2024-05-09T06:29:54.192 INFO:tasks.workunit.client.0.smithi062.stdout:2/293: rename d0/d9/dd to d0/d9/dd/d1f/d58 22 2024-05-09T06:29:54.193 INFO:tasks.workunit.client.0.smithi062.stdout:9/365: truncate d3/d3e/d52/d58/d1c/f26 1975110 0 2024-05-09T06:29:54.196 INFO:tasks.workunit.client.0.smithi062.stdout:9/366: write d3/d3e/d52/d58/d1c/f66 [167829,16029] 0 2024-05-09T06:29:54.196 INFO:tasks.workunit.client.0.smithi062.stdout:9/367: write d3/f19 [461774,128635] 0 2024-05-09T06:29:54.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/329: dwrite d0/d56/d5/f6f [0,4194304] 0 2024-05-09T06:29:54.197 INFO:tasks.workunit.client.0.smithi062.stdout:3/283: mknod d1/d48/c61 0 2024-05-09T06:29:54.197 INFO:tasks.workunit.client.0.smithi062.stdout:2/294: write d0/d9/dd/d1f/d21/f55 [2953770,67618] 0 2024-05-09T06:29:54.198 INFO:tasks.workunit.client.0.smithi062.stdout:2/295: chown d0/d9/dd/l2d 7657667 1 2024-05-09T06:29:54.199 INFO:tasks.workunit.client.0.smithi062.stdout:8/406: symlink da/d11/d1c/l86 0 2024-05-09T06:29:54.202 INFO:tasks.workunit.client.0.smithi062.stdout:4/361: mknod d0/d2a/d8/df/d28/c6d 0 2024-05-09T06:29:54.202 INFO:tasks.workunit.client.0.smithi062.stdout:6/350: dread dc/d28/d10/f18 [0,4194304] 0 2024-05-09T06:29:54.209 INFO:tasks.workunit.client.0.smithi062.stdout:2/296: mknod d0/d9/dd/d1f/d21/c59 0 2024-05-09T06:29:54.211 INFO:tasks.workunit.client.0.smithi062.stdout:8/407: mknod da/d11/d2e/d3a/c87 0 2024-05-09T06:29:54.211 INFO:tasks.workunit.client.0.smithi062.stdout:8/408: truncate da/f6c 738803 0 2024-05-09T06:29:54.211 INFO:tasks.workunit.client.0.smithi062.stdout:8/409: chown da/d11/f29 1252874 1 2024-05-09T06:29:54.212 INFO:tasks.workunit.client.0.smithi062.stdout:6/351: write dc/d42/f4d [1052695,5577] 0 2024-05-09T06:29:54.212 INFO:tasks.workunit.client.0.smithi062.stdout:4/362: mknod d0/c6e 0 2024-05-09T06:29:54.215 INFO:tasks.workunit.client.0.smithi062.stdout:8/410: creat da/d11/d2e/d61/d64/f88 x:0 0 0 2024-05-09T06:29:54.218 INFO:tasks.workunit.client.0.smithi062.stdout:3/284: dread d1/f20 [0,4194304] 0 2024-05-09T06:29:54.220 INFO:tasks.workunit.client.0.smithi062.stdout:5/330: dwrite d0/d8/d1c/d23/d3e/f4d [0,4194304] 0 2024-05-09T06:29:54.221 INFO:tasks.workunit.client.0.smithi062.stdout:5/331: truncate d0/d8/d1c/f62 1316570 0 2024-05-09T06:29:54.221 INFO:tasks.workunit.client.0.smithi062.stdout:5/332: fdatasync d0/d8/d1c/d23/f29 0 2024-05-09T06:29:54.222 INFO:tasks.workunit.client.0.smithi062.stdout:6/352: rename dc/d28/d34/c63 to dc/d28/d34/d4e/d57/c79 0 2024-05-09T06:29:54.222 INFO:tasks.workunit.client.0.smithi062.stdout:2/297: mknod d0/c5a 0 2024-05-09T06:29:54.224 INFO:tasks.workunit.client.0.smithi062.stdout:8/411: creat da/d11/f89 x:0 0 0 2024-05-09T06:29:54.224 INFO:tasks.workunit.client.0.smithi062.stdout:9/368: dwrite d3/d3e/d52/d58/d1c/d1e/d41/f4f [0,4194304] 0 2024-05-09T06:29:54.225 INFO:tasks.workunit.client.0.smithi062.stdout:8/412: write da/d11/d1c/f3e [899425,18528] 0 2024-05-09T06:29:54.225 INFO:tasks.workunit.client.0.smithi062.stdout:9/369: dread - d3/f3c zero size 2024-05-09T06:29:54.225 INFO:tasks.workunit.client.0.smithi062.stdout:9/370: write d3/d20/f7a [842639,110950] 0 2024-05-09T06:29:54.225 INFO:tasks.workunit.client.0.smithi062.stdout:3/285: mknod d1/d48/c62 0 2024-05-09T06:29:54.227 INFO:tasks.workunit.client.0.smithi062.stdout:9/371: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/f2d [0,4194304] 0 2024-05-09T06:29:54.227 INFO:tasks.workunit.client.0.smithi062.stdout:9/372: creat d3/d3e/f7b x:0 0 0 2024-05-09T06:29:54.227 INFO:tasks.workunit.client.0.smithi062.stdout:9/373: truncate d3/d3e/d52/d58/d1c/d1e/f5f 1245803 0 2024-05-09T06:29:54.227 INFO:tasks.workunit.client.0.smithi062.stdout:8/413: dread da/d11/d2e/d61/d64/f69 [0,4194304] 0 2024-05-09T06:29:54.227 INFO:tasks.workunit.client.0.smithi062.stdout:8/414: chown da/d11/d2e/d61/c74 188150 1 2024-05-09T06:29:54.227 INFO:tasks.workunit.client.0.smithi062.stdout:8/415: write da/f71 [132659,112847] 0 2024-05-09T06:29:54.230 INFO:tasks.workunit.client.0.smithi062.stdout:6/353: symlink dc/d42/d70/l7a 0 2024-05-09T06:29:54.230 INFO:tasks.workunit.client.0.smithi062.stdout:6/354: fsync f1 0 2024-05-09T06:29:54.231 INFO:tasks.workunit.client.0.smithi062.stdout:5/333: dread d0/d8/d1c/d2c/f33 [0,4194304] 0 2024-05-09T06:29:54.232 INFO:tasks.workunit.client.0.smithi062.stdout:5/334: dread d0/d8/d1c/d23/f4f [0,4194304] 0 2024-05-09T06:29:54.249 INFO:tasks.workunit.client.0.smithi062.stdout:3/286: creat d1/d1e/d54/f63 x:0 0 0 2024-05-09T06:29:54.249 INFO:tasks.workunit.client.0.smithi062.stdout:3/287: creat d1/d1e/d26/d43/d52/f64 x:0 0 0 2024-05-09T06:29:54.249 INFO:tasks.workunit.client.0.smithi062.stdout:3/288: truncate d1/d1e/d26/f29 3652133 0 2024-05-09T06:29:54.252 INFO:tasks.workunit.client.0.smithi062.stdout:9/374: mkdir d3/d3e/d7c 0 2024-05-09T06:29:54.253 INFO:tasks.workunit.client.0.smithi062.stdout:8/416: mkdir da/d85/d8a 0 2024-05-09T06:29:54.255 INFO:tasks.workunit.client.0.smithi062.stdout:6/355: mknod dc/d42/c7b 0 2024-05-09T06:29:54.257 INFO:tasks.workunit.client.0.smithi062.stdout:5/335: truncate d0/d8/d1c/d23/f48 3759776 0 2024-05-09T06:29:54.257 INFO:tasks.workunit.client.0.smithi062.stdout:6/356: dread dc/d28/d46/f64 [0,4194304] 0 2024-05-09T06:29:54.260 INFO:tasks.workunit.client.0.smithi062.stdout:3/289: rename d1/f20 to d1/d1e/d26/d33/f65 0 2024-05-09T06:29:54.261 INFO:tasks.workunit.client.0.smithi062.stdout:2/298: truncate d0/d9/dd/d1f/d21/f28 1190440 0 2024-05-09T06:29:54.262 INFO:tasks.workunit.client.0.smithi062.stdout:9/375: getdents d3/d3e/d4b 0 2024-05-09T06:29:54.264 INFO:tasks.workunit.client.0.smithi062.stdout:8/417: symlink da/d11/d2e/l8b 0 2024-05-09T06:29:54.264 INFO:tasks.workunit.client.0.smithi062.stdout:8/418: stat da/l31 0 2024-05-09T06:29:54.266 INFO:tasks.workunit.client.0.smithi062.stdout:5/336: creat d0/d56/d45/f76 x:0 0 0 2024-05-09T06:29:54.267 INFO:tasks.workunit.client.0.smithi062.stdout:6/357: mknod dc/d28/d46/c7c 0 2024-05-09T06:29:54.269 INFO:tasks.workunit.client.0.smithi062.stdout:3/290: creat d1/d1e/d36/d4a/f66 x:0 0 0 2024-05-09T06:29:54.269 INFO:tasks.workunit.client.0.smithi062.stdout:3/291: chown d1/d1e/d26/f2b 11153460 1 2024-05-09T06:29:54.270 INFO:tasks.workunit.client.0.smithi062.stdout:6/358: dread dc/d28/d10/f18 [0,4194304] 0 2024-05-09T06:29:54.271 INFO:tasks.workunit.client.0.smithi062.stdout:2/299: unlink d0/c1b 0 2024-05-09T06:29:54.274 INFO:tasks.workunit.client.0.smithi062.stdout:9/376: link d3/d3e/d52/d58/d1c/l72 d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/l7d 0 2024-05-09T06:29:54.274 INFO:tasks.workunit.client.0.smithi062.stdout:9/377: getdents d3/d3e/d7c 0 2024-05-09T06:29:54.276 INFO:tasks.workunit.client.0.smithi062.stdout:5/337: mknod d0/d56/d5/c77 0 2024-05-09T06:29:54.278 INFO:tasks.workunit.client.0.smithi062.stdout:3/292: unlink d1/d1e/d26/d43/d52/f64 0 2024-05-09T06:29:54.280 INFO:tasks.workunit.client.0.smithi062.stdout:6/359: symlink dc/d28/d46/d4a/d5d/d6f/l7d 0 2024-05-09T06:29:54.284 INFO:tasks.workunit.client.0.smithi062.stdout:2/300: truncate d0/f3a 2744437 0 2024-05-09T06:29:54.288 INFO:tasks.workunit.client.0.smithi062.stdout:8/419: dwrite da/f57 [4194304,4194304] 0 2024-05-09T06:29:54.288 INFO:tasks.workunit.client.0.smithi062.stdout:8/420: fsync da/d11/d2e/d61/f63 0 2024-05-09T06:29:54.288 INFO:tasks.workunit.client.0.smithi062.stdout:8/421: readlink da/d11/l7c 0 2024-05-09T06:29:54.288 INFO:tasks.workunit.client.0.smithi062.stdout:8/422: fsync da/d11/f89 0 2024-05-09T06:29:54.288 INFO:tasks.workunit.client.0.smithi062.stdout:8/423: write da/f5d [8903946,127367] 0 2024-05-09T06:29:54.293 INFO:tasks.workunit.client.0.smithi062.stdout:3/293: link d1/d48/f50 d1/d1e/d36/d3a/f67 0 2024-05-09T06:29:54.293 INFO:tasks.workunit.client.0.smithi062.stdout:3/294: chown d1/d1e/c42 10 1 2024-05-09T06:29:54.293 INFO:tasks.workunit.client.0.smithi062.stdout:3/295: creat d1/d1e/d36/d4a/f68 x:0 0 0 2024-05-09T06:29:54.293 INFO:tasks.workunit.client.0.smithi062.stdout:3/296: creat d1/d1e/d26/f69 x:0 0 0 2024-05-09T06:29:54.294 INFO:tasks.workunit.client.0.smithi062.stdout:6/360: symlink dc/d28/d10/d20/d5b/l7e 0 2024-05-09T06:29:54.294 INFO:tasks.workunit.client.0.smithi062.stdout:6/361: fsync dc/d28/d46/d3a/f3c 0 2024-05-09T06:29:54.298 INFO:tasks.workunit.client.0.smithi062.stdout:2/301: creat d0/d9/dd/d1f/d21/f5b x:0 0 0 2024-05-09T06:29:54.300 INFO:tasks.workunit.client.0.smithi062.stdout:8/424: dread da/d11/f2d [0,4194304] 0 2024-05-09T06:29:54.300 INFO:tasks.workunit.client.0.smithi062.stdout:8/425: dread - da/f7a zero size 2024-05-09T06:29:54.300 INFO:tasks.workunit.client.0.smithi062.stdout:9/378: getdents d3/d3e/d52/d58/d1c/d1e/d41/d64/d31 0 2024-05-09T06:29:54.303 INFO:tasks.workunit.client.0.smithi062.stdout:6/362: dread dc/d28/d46/d4a/d5d/f27 [0,4194304] 0 2024-05-09T06:29:54.318 INFO:tasks.workunit.client.0.smithi062.stdout:5/338: rmdir d0/d56 39 2024-05-09T06:29:54.323 INFO:tasks.workunit.client.0.smithi062.stdout:8/426: dwrite da/d11/d1c/f43 [0,4194304] 0 2024-05-09T06:29:54.323 INFO:tasks.workunit.client.0.smithi062.stdout:9/379: dwrite d3/f3c [0,4194304] 0 2024-05-09T06:29:54.325 INFO:tasks.workunit.client.0.smithi062.stdout:3/297: mkdir d1/d1e/d26/d43/d52/d6a 0 2024-05-09T06:29:54.331 INFO:tasks.workunit.client.0.smithi062.stdout:5/339: creat d0/d8/d18/f78 x:0 0 0 2024-05-09T06:29:54.336 INFO:tasks.workunit.client.0.smithi062.stdout:8/427: mknod da/d11/d2e/d7e/d83/c8c 0 2024-05-09T06:29:54.340 INFO:tasks.workunit.client.0.smithi062.stdout:9/380: creat d3/d3e/d7c/f7e x:0 0 0 2024-05-09T06:29:54.342 INFO:tasks.workunit.client.0.smithi062.stdout:3/298: rename d1/d1e/d36/f5d to d1/d1e/d36/d4a/d51/f6b 0 2024-05-09T06:29:54.344 INFO:tasks.workunit.client.0.smithi062.stdout:2/302: mknod d0/c5c 0 2024-05-09T06:29:54.345 INFO:tasks.workunit.client.0.smithi062.stdout:6/363: rmdir dc/d28/d46/d4a/d5d 39 2024-05-09T06:29:54.346 INFO:tasks.workunit.client.0.smithi062.stdout:6/364: chown dc/d28/d34/d4e/d57/c79 0 1 2024-05-09T06:29:54.347 INFO:tasks.workunit.client.0.smithi062.stdout:5/340: getdents d0/d8/d1c/d23 0 2024-05-09T06:29:54.347 INFO:tasks.workunit.client.0.smithi062.stdout:5/341: creat d0/f79 x:0 0 0 2024-05-09T06:29:54.349 INFO:tasks.workunit.client.0.smithi062.stdout:8/428: unlink da/d11/d1c/l3f 0 2024-05-09T06:29:54.349 INFO:tasks.workunit.client.0.smithi062.stdout:8/429: truncate da/d11/d2e/f70 778383 0 2024-05-09T06:29:54.350 INFO:tasks.workunit.client.0.smithi062.stdout:9/381: unlink d3/d3e/d52/d58/d1c/f26 0 2024-05-09T06:29:54.350 INFO:tasks.workunit.client.0.smithi062.stdout:6/365: dread dc/d28/d46/d4a/f6b [0,4194304] 0 2024-05-09T06:29:54.352 INFO:tasks.workunit.client.0.smithi062.stdout:3/299: mkdir d1/d1e/d36/d6c 0 2024-05-09T06:29:54.352 INFO:tasks.workunit.client.0.smithi062.stdout:3/300: creat d1/d1e/d36/d3a/f6d x:0 0 0 2024-05-09T06:29:54.353 INFO:tasks.workunit.client.0.smithi062.stdout:3/301: fdatasync d1/d48/f4c 0 2024-05-09T06:29:54.353 INFO:tasks.workunit.client.0.smithi062.stdout:2/303: mkdir d0/d9/dd/d1f/d21/d29/d3d/d46/d5d 0 2024-05-09T06:29:54.358 INFO:tasks.workunit.client.0.smithi062.stdout:5/342: creat d0/d8/d1c/d2c/f7a x:0 0 0 2024-05-09T06:29:54.358 INFO:tasks.workunit.client.0.smithi062.stdout:5/343: dread - d0/d8/d18/f78 zero size 2024-05-09T06:29:54.360 INFO:tasks.workunit.client.0.smithi062.stdout:3/302: dread d1/d1e/f1d [0,4194304] 0 2024-05-09T06:29:54.361 INFO:tasks.workunit.client.0.smithi062.stdout:8/430: link da/d11/d2e/d34/l78 da/d11/l8d 0 2024-05-09T06:29:54.361 INFO:tasks.workunit.client.0.smithi062.stdout:8/431: chown da/d11/f17 6 1 2024-05-09T06:29:54.363 INFO:tasks.workunit.client.0.smithi062.stdout:9/382: creat d3/d3e/d52/d58/d1c/d1e/d41/f7f x:0 0 0 2024-05-09T06:29:54.364 INFO:tasks.workunit.client.0.smithi062.stdout:9/383: chown d3/f6 22 1 2024-05-09T06:29:54.364 INFO:tasks.workunit.client.0.smithi062.stdout:6/366: mkdir dc/d28/d46/d3a/d7f 0 2024-05-09T06:29:54.372 INFO:tasks.workunit.client.0.smithi062.stdout:2/304: unlink d0/d9/dd/l32 0 2024-05-09T06:29:54.372 INFO:tasks.workunit.client.0.smithi062.stdout:2/305: read - d0/d9/dd/d1f/f24 zero size 2024-05-09T06:29:54.374 INFO:tasks.workunit.client.0.smithi062.stdout:7/349: sync 2024-05-09T06:29:54.374 INFO:tasks.workunit.client.0.smithi062.stdout:7/350: stat d0/d3a/f47 0 2024-05-09T06:29:54.376 INFO:tasks.workunit.client.0.smithi062.stdout:5/344: symlink d0/d56/l7b 0 2024-05-09T06:29:54.386 INFO:tasks.workunit.client.0.smithi062.stdout:6/367: dwrite dc/d28/d46/d3a/f3e [0,4194304] 0 2024-05-09T06:29:54.390 INFO:tasks.workunit.client.0.smithi062.stdout:8/432: mknod da/d11/d2e/d3a/c8e 0 2024-05-09T06:29:54.390 INFO:tasks.workunit.client.0.smithi062.stdout:8/433: fsync f9 0 2024-05-09T06:29:54.398 INFO:tasks.workunit.client.0.smithi062.stdout:4/363: sync 2024-05-09T06:29:54.398 INFO:tasks.workunit.client.0.smithi062.stdout:0/268: sync 2024-05-09T06:29:54.398 INFO:tasks.workunit.client.0.smithi062.stdout:1/276: sync 2024-05-09T06:29:54.402 INFO:tasks.workunit.client.0.smithi062.stdout:2/306: unlink d0/d9/d17/f45 0 2024-05-09T06:29:54.402 INFO:tasks.workunit.client.0.smithi062.stdout:2/307: truncate d0/d9/dd/f1c 1111829 0 2024-05-09T06:29:54.402 INFO:tasks.workunit.client.0.smithi062.stdout:2/308: write d0/d9/d38/d41/d48/f4b [520455,35767] 0 2024-05-09T06:29:54.402 INFO:tasks.workunit.client.0.smithi062.stdout:2/309: chown d0/c5 6 1 2024-05-09T06:29:54.407 INFO:tasks.workunit.client.0.smithi062.stdout:7/351: getdents d0/d12/d33 0 2024-05-09T06:29:54.410 INFO:tasks.workunit.client.0.smithi062.stdout:5/345: rename d0/d56/c2b to d0/d11/c7c 0 2024-05-09T06:29:54.414 INFO:tasks.workunit.client.0.smithi062.stdout:3/303: getdents d1/d48 0 2024-05-09T06:29:54.415 INFO:tasks.workunit.client.0.smithi062.stdout:3/304: fdatasync d1/d1e/f25 0 2024-05-09T06:29:54.415 INFO:tasks.workunit.client.0.smithi062.stdout:3/305: write d1/f55 [891823,32137] 0 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:8/434: dwrite da/f57 [4194304,4194304] 0 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:6/368: truncate dc/f17 241722 0 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:6/369: chown dc/l21 58 1 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:6/370: write f1 [2388114,62262] 0 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:6/371: write dc/d28/d46/d3a/f40 [2416422,124013] 0 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:4/364: dwrite d0/d2a/f6 [0,4194304] 0 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:6/372: creat dc/d28/d46/f80 x:0 0 0 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:4/365: fsync d0/d2a/d8/f50 0 2024-05-09T06:29:54.421 INFO:tasks.workunit.client.0.smithi062.stdout:4/366: chown d0/d2a/d14/d4f 653 1 2024-05-09T06:29:54.422 INFO:tasks.workunit.client.0.smithi062.stdout:4/367: chown d0/c51 116995 1 2024-05-09T06:29:54.424 INFO:tasks.workunit.client.0.smithi062.stdout:9/384: rmdir d3/d3e/d7c 39 2024-05-09T06:29:54.427 INFO:tasks.workunit.client.0.smithi062.stdout:0/269: rmdir d1/d25/d49/d42/d5b 39 2024-05-09T06:29:54.427 INFO:tasks.workunit.client.0.smithi062.stdout:0/270: write d1/fd [258537,30023] 0 2024-05-09T06:29:54.429 INFO:tasks.workunit.client.0.smithi062.stdout:6/373: write dc/d28/d10/f4b [3565322,95826] 0 2024-05-09T06:29:54.430 INFO:tasks.workunit.client.0.smithi062.stdout:1/277: truncate d8/f1a 327889 0 2024-05-09T06:29:54.430 INFO:tasks.workunit.client.0.smithi062.stdout:1/278: write d8/d1d/f58 [465085,95010] 0 2024-05-09T06:29:54.430 INFO:tasks.workunit.client.0.smithi062.stdout:1/279: write d8/d1d/f25 [4674328,17042] 0 2024-05-09T06:29:54.430 INFO:tasks.workunit.client.0.smithi062.stdout:1/280: truncate d8/d14/d2b/d3c/d44/f3a 309530 0 2024-05-09T06:29:54.431 INFO:tasks.workunit.client.0.smithi062.stdout:2/310: getdents d0/d9/dd/d1f/d21/d29 0 2024-05-09T06:29:54.433 INFO:tasks.workunit.client.0.smithi062.stdout:7/352: creat d0/d3a/d51/f6c x:0 0 0 2024-05-09T06:29:54.433 INFO:tasks.workunit.client.0.smithi062.stdout:5/346: unlink d0/d11/l2a 0 2024-05-09T06:29:54.434 INFO:tasks.workunit.client.0.smithi062.stdout:3/306: mknod d1/d1e/d54/c6e 0 2024-05-09T06:29:54.434 INFO:tasks.workunit.client.0.smithi062.stdout:3/307: getdents d1/d1e/d26/d33/d4f 0 2024-05-09T06:29:54.438 INFO:tasks.workunit.client.0.smithi062.stdout:8/435: rename da/c1f to da/d11/d2e/d61/c8f 0 2024-05-09T06:29:54.444 INFO:tasks.workunit.client.0.smithi062.stdout:4/368: unlink d0/d2a/f6 0 2024-05-09T06:29:54.445 INFO:tasks.workunit.client.0.smithi062.stdout:9/385: mknod d3/d3e/d52/d58/d77/c80 0 2024-05-09T06:29:54.446 INFO:tasks.workunit.client.0.smithi062.stdout:0/271: symlink d1/d18/l62 0 2024-05-09T06:29:54.462 INFO:tasks.workunit.client.0.smithi062.stdout:2/311: dwrite d0/d9/dd/d1f/d21/f5b [0,4194304] 0 2024-05-09T06:29:54.462 INFO:tasks.workunit.client.0.smithi062.stdout:2/312: creat d0/d9/dd/f5e x:0 0 0 2024-05-09T06:29:54.462 INFO:tasks.workunit.client.0.smithi062.stdout:8/436: dwrite da/d11/f17 [0,4194304] 0 2024-05-09T06:29:54.462 INFO:tasks.workunit.client.0.smithi062.stdout:8/437: readlink da/d11/l75 0 2024-05-09T06:29:54.511 INFO:tasks.workunit.client.0.smithi062.stdout:7/353: getdents d0/d3a/d51/d64 0 2024-05-09T06:29:54.511 INFO:tasks.workunit.client.0.smithi062.stdout:7/354: write d0/d3a/f47 [365805,84815] 0 2024-05-09T06:29:54.511 INFO:tasks.workunit.client.0.smithi062.stdout:7/355: write d0/d12/f59 [1113149,42213] 0 2024-05-09T06:29:54.511 INFO:tasks.workunit.client.0.smithi062.stdout:7/356: readlink d0/d12/d33/l62 0 2024-05-09T06:29:54.543 INFO:tasks.workunit.client.0.smithi062.stdout:0/272: rmdir d1/d25/d49/d42/d43/d54/d61 0 2024-05-09T06:29:54.546 INFO:tasks.workunit.client.0.smithi062.stdout:4/369: write d0/d2a/d8/df/d28/f59 [1912842,119567] 0 2024-05-09T06:29:54.546 INFO:tasks.workunit.client.0.smithi062.stdout:4/370: fdatasync d0/d2a/d14/d4f/f56 0 2024-05-09T06:29:54.546 INFO:tasks.workunit.client.0.smithi062.stdout:4/371: read d0/d2a/f1d [804225,49305] 0 2024-05-09T06:29:54.547 INFO:tasks.workunit.client.0.smithi062.stdout:4/372: read d0/d2a/d14/d4f/d6b/f32 [1106818,37724] 0 2024-05-09T06:29:54.547 INFO:tasks.workunit.client.0.smithi062.stdout:4/373: creat d0/d2a/d8/df/d28/d31/f6f x:0 0 0 2024-05-09T06:29:54.547 INFO:tasks.workunit.client.0.smithi062.stdout:4/374: fsync d0/d2a/d14/d4f/f55 0 2024-05-09T06:29:54.551 INFO:tasks.workunit.client.0.smithi062.stdout:2/313: mkdir d0/d9/d38/d41/d48/d5f 0 2024-05-09T06:29:54.554 INFO:tasks.workunit.client.0.smithi062.stdout:8/438: mkdir da/d11/d2e/d34/d90 0 2024-05-09T06:29:54.563 INFO:tasks.workunit.client.0.smithi062.stdout:8/439: dread da/d11/d1c/f39 [0,4194304] 0 2024-05-09T06:29:54.567 INFO:tasks.workunit.client.0.smithi062.stdout:2/314: dwrite d0/d9/d17/f1d [0,4194304] 0 2024-05-09T06:29:54.601 INFO:tasks.workunit.client.0.smithi062.stdout:7/357: mkdir d0/d3a/d51/d64/d6d 0 2024-05-09T06:29:54.602 INFO:tasks.workunit.client.0.smithi062.stdout:7/358: fsync d0/d12/f59 0 2024-05-09T06:29:54.603 INFO:tasks.workunit.client.0.smithi062.stdout:0/273: creat d1/d32/d44/f63 x:0 0 0 2024-05-09T06:29:54.609 INFO:tasks.workunit.client.0.smithi062.stdout:2/315: creat d0/d9/d38/f60 x:0 0 0 2024-05-09T06:29:54.611 INFO:tasks.workunit.client.0.smithi062.stdout:7/359: unlink d0/d12/c2e 0 2024-05-09T06:29:54.613 INFO:tasks.workunit.client.0.smithi062.stdout:0/274: creat d1/d32/d44/d57/f64 x:0 0 0 2024-05-09T06:29:54.618 INFO:tasks.workunit.client.0.smithi062.stdout:2/316: creat d0/d9/d38/d41/d53/f61 x:0 0 0 2024-05-09T06:29:54.619 INFO:tasks.workunit.client.0.smithi062.stdout:0/275: creat d1/d25/d59/f65 x:0 0 0 2024-05-09T06:29:54.627 INFO:tasks.workunit.client.0.smithi062.stdout:7/360: dwrite d0/d12/f43 [0,4194304] 0 2024-05-09T06:29:54.641 INFO:tasks.workunit.client.0.smithi062.stdout:7/361: read d0/f20 [3456338,57993] 0 2024-05-09T06:29:54.643 INFO:tasks.workunit.client.0.smithi062.stdout:2/317: dwrite d0/d9/dd/f20 [0,4194304] 0 2024-05-09T06:29:54.643 INFO:tasks.workunit.client.0.smithi062.stdout:2/318: write d0/d9/dd/d1f/d21/d29/d3d/d46/f4d [206734,56710] 0 2024-05-09T06:29:54.643 INFO:tasks.workunit.client.0.smithi062.stdout:0/276: dwrite d1/d32/d44/f63 [0,4194304] 0 2024-05-09T06:29:54.648 INFO:tasks.workunit.client.0.smithi062.stdout:2/319: dread d0/d9/d38/d41/d48/f4c [0,4194304] 0 2024-05-09T06:29:54.648 INFO:tasks.workunit.client.0.smithi062.stdout:2/320: write d0/f6 [1921606,2325] 0 2024-05-09T06:29:54.648 INFO:tasks.workunit.client.0.smithi062.stdout:0/277: rmdir d1/d25/d49/d4f/d52 39 2024-05-09T06:29:54.649 INFO:tasks.workunit.client.0.smithi062.stdout:2/321: mknod d0/d9/dd/d1f/d21/c62 0 2024-05-09T06:29:54.649 INFO:tasks.workunit.client.0.smithi062.stdout:2/322: creat d0/d9/d38/d41/d53/f63 x:0 0 0 2024-05-09T06:29:54.658 INFO:tasks.workunit.client.0.smithi062.stdout:7/362: dwrite d0/d3a/d51/f60 [0,4194304] 0 2024-05-09T06:29:54.658 INFO:tasks.workunit.client.0.smithi062.stdout:7/363: truncate d0/d12/f5d 158838 0 2024-05-09T06:29:54.661 INFO:tasks.workunit.client.0.smithi062.stdout:7/364: write d0/d3a/d51/f23 [1184031,683] 0 2024-05-09T06:29:54.662 INFO:tasks.workunit.client.0.smithi062.stdout:7/365: getdents d0 0 2024-05-09T06:29:54.665 INFO:tasks.workunit.client.0.smithi062.stdout:0/278: read d1/f19 [547757,110878] 0 2024-05-09T06:29:54.665 INFO:tasks.workunit.client.0.smithi062.stdout:0/279: write d1/f24 [1976355,34397] 0 2024-05-09T06:29:54.665 INFO:tasks.workunit.client.0.smithi062.stdout:0/280: creat d1/d32/f66 x:0 0 0 2024-05-09T06:29:54.667 INFO:tasks.workunit.client.0.smithi062.stdout:0/281: unlink d1/d18/c27 0 2024-05-09T06:29:54.667 INFO:tasks.workunit.client.0.smithi062.stdout:0/282: creat d1/d32/f67 x:0 0 0 2024-05-09T06:29:54.681 INFO:tasks.workunit.client.0.smithi062.stdout:8/440: truncate da/f57 4058467 0 2024-05-09T06:29:54.681 INFO:tasks.workunit.client.0.smithi062.stdout:8/441: creat da/d11/d2e/f91 x:0 0 0 2024-05-09T06:29:54.686 INFO:tasks.workunit.client.0.smithi062.stdout:0/283: dwrite d1/d25/d59/f65 [0,4194304] 0 2024-05-09T06:29:54.686 INFO:tasks.workunit.client.0.smithi062.stdout:0/284: write d1/f24 [1571319,107430] 0 2024-05-09T06:29:54.693 INFO:tasks.workunit.client.0.smithi062.stdout:0/285: creat d1/d25/d49/d42/d5b/f68 x:0 0 0 2024-05-09T06:29:54.693 INFO:tasks.workunit.client.0.smithi062.stdout:0/286: creat d1/d25/d59/f69 x:0 0 0 2024-05-09T06:29:54.693 INFO:tasks.workunit.client.0.smithi062.stdout:0/287: chown d1/d32/d44 464818 1 2024-05-09T06:29:54.698 INFO:tasks.workunit.client.0.smithi062.stdout:8/442: dwrite da/d11/d1c/f3e [0,4194304] 0 2024-05-09T06:29:54.698 INFO:tasks.workunit.client.0.smithi062.stdout:8/443: dread - da/f82 zero size 2024-05-09T06:29:54.699 INFO:tasks.workunit.client.0.smithi062.stdout:6/374: mkdir dc/d28/d46/d81 0 2024-05-09T06:29:54.708 INFO:tasks.workunit.client.0.smithi062.stdout:8/444: write da/f5d [7898226,114507] 0 2024-05-09T06:29:54.708 INFO:tasks.workunit.client.0.smithi062.stdout:8/445: truncate da/d11/d2e/d34/f44 54621 0 2024-05-09T06:29:54.713 INFO:tasks.workunit.client.0.smithi062.stdout:7/366: creat d0/f6e x:0 0 0 2024-05-09T06:29:54.714 INFO:tasks.workunit.client.0.smithi062.stdout:6/375: dwrite dc/d42/f69 [0,4194304] 0 2024-05-09T06:29:54.714 INFO:tasks.workunit.client.0.smithi062.stdout:6/376: chown dc/d28/d46/f64 8871 1 2024-05-09T06:29:54.724 INFO:tasks.workunit.client.0.smithi062.stdout:6/377: write dc/d28/d34/f3d [1064086,13731] 0 2024-05-09T06:29:54.734 INFO:tasks.workunit.client.0.smithi062.stdout:1/281: rename d8/l27 to d8/d14/d2b/l5d 0 2024-05-09T06:29:54.735 INFO:tasks.workunit.client.0.smithi062.stdout:1/282: chown d8/f5a 1469 1 2024-05-09T06:29:54.738 INFO:tasks.workunit.client.0.smithi062.stdout:1/283: creat d8/d14/f5e x:0 0 0 2024-05-09T06:29:54.739 INFO:tasks.workunit.client.0.smithi062.stdout:0/288: mkdir d1/d6a 0 2024-05-09T06:29:54.739 INFO:tasks.workunit.client.0.smithi062.stdout:0/289: creat d1/d18/f6b x:0 0 0 2024-05-09T06:29:54.741 INFO:tasks.workunit.client.0.smithi062.stdout:1/284: mknod d8/d14/d2b/d3c/d44/d38/c5f 0 2024-05-09T06:29:54.741 INFO:tasks.workunit.client.0.smithi062.stdout:1/285: chown d8/c9 10142034 1 2024-05-09T06:29:54.743 INFO:tasks.workunit.client.0.smithi062.stdout:2/323: mkdir d0/d64 0 2024-05-09T06:29:54.746 INFO:tasks.workunit.client.0.smithi062.stdout:5/347: rename d0/d8/d30 to d0/d8/d1c/d2c/d7d 0 2024-05-09T06:29:54.748 INFO:tasks.workunit.client.0.smithi062.stdout:1/286: rename d8/l16 to d8/l60 0 2024-05-09T06:29:54.748 INFO:tasks.workunit.client.0.smithi062.stdout:6/378: dwrite dc/d28/d46/d3a/f4f [0,4194304] 0 2024-05-09T06:29:54.750 INFO:tasks.workunit.client.0.smithi062.stdout:9/386: unlink d3/d3e/f7b 0 2024-05-09T06:29:54.751 INFO:tasks.workunit.client.0.smithi062.stdout:4/375: rename d0/f3d to d0/d2a/d1f/f70 0 2024-05-09T06:29:54.751 INFO:tasks.workunit.client.0.smithi062.stdout:4/376: chown d0/d9/l1c 1363678534 1 2024-05-09T06:29:54.755 INFO:tasks.workunit.client.0.smithi062.stdout:1/287: symlink d8/d14/d2b/d3d/d3e/l61 0 2024-05-09T06:29:54.755 INFO:tasks.workunit.client.0.smithi062.stdout:0/290: write d1/d25/f26 [4728756,13216] 0 2024-05-09T06:29:54.756 INFO:tasks.workunit.client.0.smithi062.stdout:9/387: symlink d3/d20/l81 0 2024-05-09T06:29:54.757 INFO:tasks.workunit.client.0.smithi062.stdout:9/388: write d3/d3e/d52/d58/d1c/d1e/f5f [1126848,76008] 0 2024-05-09T06:29:54.760 INFO:tasks.workunit.client.0.smithi062.stdout:1/288: symlink d8/d14/l62 0 2024-05-09T06:29:54.762 INFO:tasks.workunit.client.0.smithi062.stdout:9/389: symlink d3/d3e/d52/d58/d1c/d1e/d60/l82 0 2024-05-09T06:29:54.764 INFO:tasks.workunit.client.0.smithi062.stdout:5/348: dread d0/d8/d1c/f25 [4194304,4194304] 0 2024-05-09T06:29:54.764 INFO:tasks.workunit.client.0.smithi062.stdout:2/324: dwrite d0/d9/dd/f1a [4194304,4194304] 0 2024-05-09T06:29:54.765 INFO:tasks.workunit.client.0.smithi062.stdout:7/367: rename d0/l31 to d0/d3a/d69/l6f 0 2024-05-09T06:29:54.766 INFO:tasks.workunit.client.0.smithi062.stdout:1/289: creat d8/d14/d2b/d3c/d44/f63 x:0 0 0 2024-05-09T06:29:54.766 INFO:tasks.workunit.client.0.smithi062.stdout:1/290: write d8/d14/d2b/f52 [720979,115668] 0 2024-05-09T06:29:54.768 INFO:tasks.workunit.client.0.smithi062.stdout:9/390: symlink d3/d3e/d52/d58/d77/l83 0 2024-05-09T06:29:54.768 INFO:tasks.workunit.client.0.smithi062.stdout:9/391: fdatasync d3/d3e/d52/d58/d1c/f5e 0 2024-05-09T06:29:54.774 INFO:tasks.workunit.client.0.smithi062.stdout:7/368: chown d0/d12/d33/d67/f6b 805 1 2024-05-09T06:29:54.776 INFO:tasks.workunit.client.0.smithi062.stdout:6/379: dwrite dc/d42/f66 [0,4194304] 0 2024-05-09T06:29:54.777 INFO:tasks.workunit.client.0.smithi062.stdout:4/377: dwrite d0/d2a/f1d [0,4194304] 0 2024-05-09T06:29:54.777 INFO:tasks.workunit.client.0.smithi062.stdout:4/378: creat d0/d2a/d8/df/d28/f71 x:0 0 0 2024-05-09T06:29:54.778 INFO:tasks.workunit.client.0.smithi062.stdout:9/392: unlink d3/f5 0 2024-05-09T06:29:54.778 INFO:tasks.workunit.client.0.smithi062.stdout:2/325: dread d0/d9/dd/d1f/d21/f5b [0,4194304] 0 2024-05-09T06:29:54.783 INFO:tasks.workunit.client.0.smithi062.stdout:5/349: dwrite d0/d8/d1c/d23/f29 [0,4194304] 0 2024-05-09T06:29:54.783 INFO:tasks.workunit.client.0.smithi062.stdout:5/350: write d0/f74 [231160,78810] 0 2024-05-09T06:29:54.783 INFO:tasks.workunit.client.0.smithi062.stdout:1/291: dread f5 [0,4194304] 0 2024-05-09T06:29:54.792 INFO:tasks.workunit.client.0.smithi062.stdout:3/308: sync 2024-05-09T06:29:54.794 INFO:tasks.workunit.client.0.smithi062.stdout:6/380: dwrite dc/d28/d46/d3a/f40 [0,4194304] 0 2024-05-09T06:29:54.794 INFO:tasks.workunit.client.0.smithi062.stdout:6/381: chown dc/d28/d46/f80 12814 1 2024-05-09T06:29:54.799 INFO:tasks.workunit.client.0.smithi062.stdout:4/379: truncate d0/d2a/d8/df/d28/d31/f39 1327075 0 2024-05-09T06:29:54.800 INFO:tasks.workunit.client.0.smithi062.stdout:4/380: dread - d0/d2a/d8/df/d28/d31/f6f zero size 2024-05-09T06:29:54.800 INFO:tasks.workunit.client.0.smithi062.stdout:4/381: read d0/d3c/f5f [169908,34866] 0 2024-05-09T06:29:54.803 INFO:tasks.workunit.client.0.smithi062.stdout:9/393: creat d3/f84 x:0 0 0 2024-05-09T06:29:54.803 INFO:tasks.workunit.client.0.smithi062.stdout:9/394: fsync d3/d3e/d52/d58/d1c/f76 0 2024-05-09T06:29:54.803 INFO:tasks.workunit.client.0.smithi062.stdout:9/395: stat d3/d3e/d52/d58/d1c/d1e/d60/f73 0 2024-05-09T06:29:54.804 INFO:tasks.workunit.client.0.smithi062.stdout:2/326: mkdir d0/d9/dd/d65 0 2024-05-09T06:29:54.804 INFO:tasks.workunit.client.0.smithi062.stdout:7/369: dwrite d0/f5c [0,4194304] 0 2024-05-09T06:29:54.813 INFO:tasks.workunit.client.0.smithi062.stdout:1/292: mkdir d8/d14/d2b/d3c/d44/d64 0 2024-05-09T06:29:54.813 INFO:tasks.workunit.client.0.smithi062.stdout:7/370: read d0/d12/d33/f3c [3452192,93152] 0 2024-05-09T06:29:54.816 INFO:tasks.workunit.client.0.smithi062.stdout:0/291: rename d1/d32 to d1/d25/d31/d6c 0 2024-05-09T06:29:54.817 INFO:tasks.workunit.client.0.smithi062.stdout:3/309: creat d1/d1e/d26/d33/d4f/f6f x:0 0 0 2024-05-09T06:29:54.822 INFO:tasks.workunit.client.0.smithi062.stdout:0/292: write d1/d25/d31/d6c/d44/f63 [2532250,49616] 0 2024-05-09T06:29:54.838 INFO:tasks.workunit.client.0.smithi062.stdout:6/382: mkdir dc/d28/d46/d82 0 2024-05-09T06:29:54.839 INFO:tasks.workunit.client.0.smithi062.stdout:4/382: creat d0/d9/f72 x:0 0 0 2024-05-09T06:29:54.841 INFO:tasks.workunit.client.0.smithi062.stdout:2/327: truncate d0/d9/dd/f54 831011 0 2024-05-09T06:29:54.841 INFO:tasks.workunit.client.0.smithi062.stdout:2/328: creat d0/d9/dd/d1f/f66 x:0 0 0 2024-05-09T06:29:54.841 INFO:tasks.workunit.client.0.smithi062.stdout:2/329: stat d0/d9/dd/f5e 0 2024-05-09T06:29:54.841 INFO:tasks.workunit.client.0.smithi062.stdout:2/330: write d0/d9/dd/d1f/f3b [751957,109113] 0 2024-05-09T06:29:54.846 INFO:tasks.workunit.client.0.smithi062.stdout:5/351: rmdir d0/d3b/d3f 39 2024-05-09T06:29:54.850 INFO:tasks.workunit.client.0.smithi062.stdout:1/293: link d8/d14/d2b/d3c/d44/d38/c5f d8/d14/c65 0 2024-05-09T06:29:54.855 INFO:tasks.workunit.client.0.smithi062.stdout:3/310: creat d1/d1e/d36/d3a/d4e/f70 x:0 0 0 2024-05-09T06:29:54.855 INFO:tasks.workunit.client.0.smithi062.stdout:3/311: truncate d1/d1e/d26/d43/d52/f53 920485 0 2024-05-09T06:29:54.855 INFO:tasks.workunit.client.0.smithi062.stdout:7/371: dread d0/f4b [0,4194304] 0 2024-05-09T06:29:54.855 INFO:tasks.workunit.client.0.smithi062.stdout:3/312: write d1/d1e/d26/f3c [866660,12961] 0 2024-05-09T06:29:54.855 INFO:tasks.workunit.client.0.smithi062.stdout:7/372: truncate d0/d12/d33/f55 1014909 0 2024-05-09T06:29:54.855 INFO:tasks.workunit.client.0.smithi062.stdout:2/331: write d0/d9/dd/f54 [889414,84167] 0 2024-05-09T06:29:54.859 INFO:tasks.workunit.client.0.smithi062.stdout:0/293: mkdir d1/d6a/d6d 0 2024-05-09T06:29:54.859 INFO:tasks.workunit.client.0.smithi062.stdout:0/294: chown d1/d25/d49/d4f 61642121 1 2024-05-09T06:29:54.861 INFO:tasks.workunit.client.0.smithi062.stdout:6/383: unlink f1 0 2024-05-09T06:29:54.861 INFO:tasks.workunit.client.0.smithi062.stdout:6/384: creat dc/d28/d34/d39/f83 x:0 0 0 2024-05-09T06:29:54.862 INFO:tasks.workunit.client.0.smithi062.stdout:2/332: write d0/d9/dd/f33 [640265,71157] 0 2024-05-09T06:29:54.862 INFO:tasks.workunit.client.0.smithi062.stdout:2/333: read - d0/d9/dd/d1f/f66 zero size 2024-05-09T06:29:54.863 INFO:tasks.workunit.client.0.smithi062.stdout:4/383: creat d0/d2a/d8/df/d28/d4c/f73 x:0 0 0 2024-05-09T06:29:54.867 INFO:tasks.workunit.client.0.smithi062.stdout:5/352: rmdir d0/d3b/d3f 39 2024-05-09T06:29:54.867 INFO:tasks.workunit.client.0.smithi062.stdout:5/353: chown d0/d8/d1c/d2c/d7d/l43 44190638 1 2024-05-09T06:29:54.872 INFO:tasks.workunit.client.0.smithi062.stdout:4/384: write d0/d2a/d8/df/f16 [3007554,65332] 0 2024-05-09T06:29:54.872 INFO:tasks.workunit.client.0.smithi062.stdout:3/313: rename d1/d1e/f1a to d1/d1e/d26/d43/d52/d6a/f71 0 2024-05-09T06:29:54.875 INFO:tasks.workunit.client.0.smithi062.stdout:0/295: mkdir d1/d25/d31/d6c/d44/d6e 0 2024-05-09T06:29:54.876 INFO:tasks.workunit.client.0.smithi062.stdout:6/385: dwrite dc/fd [0,4194304] 0 2024-05-09T06:29:54.877 INFO:tasks.workunit.client.0.smithi062.stdout:6/386: chown dc/d28/l16 0 1 2024-05-09T06:29:54.879 INFO:tasks.workunit.client.0.smithi062.stdout:2/334: creat d0/d9/dd/d1f/d21/d29/d3d/f67 x:0 0 0 2024-05-09T06:29:54.881 INFO:tasks.workunit.client.0.smithi062.stdout:5/354: truncate d0/d8/d18/f5d 337180 0 2024-05-09T06:29:54.887 INFO:tasks.workunit.client.0.smithi062.stdout:4/385: creat d0/d2a/d14/f74 x:0 0 0 2024-05-09T06:29:54.888 INFO:tasks.workunit.client.0.smithi062.stdout:7/373: truncate d0/f1e 1248501 0 2024-05-09T06:29:54.888 INFO:tasks.workunit.client.0.smithi062.stdout:7/374: fsync d0/d12/f32 0 2024-05-09T06:29:54.891 INFO:tasks.workunit.client.0.smithi062.stdout:0/296: symlink d1/d25/d49/d4f/l6f 0 2024-05-09T06:29:54.891 INFO:tasks.workunit.client.0.smithi062.stdout:0/297: dread - d1/d25/d49/d42/d5b/f68 zero size 2024-05-09T06:29:54.891 INFO:tasks.workunit.client.0.smithi062.stdout:0/298: creat d1/d25/d49/d42/d5b/f70 x:0 0 0 2024-05-09T06:29:54.898 INFO:tasks.workunit.client.0.smithi062.stdout:2/335: rmdir d0/d64 0 2024-05-09T06:29:54.899 INFO:tasks.workunit.client.0.smithi062.stdout:4/386: symlink d0/d3c/l75 0 2024-05-09T06:29:54.899 INFO:tasks.workunit.client.0.smithi062.stdout:4/387: readlink d0/d9/l1c 0 2024-05-09T06:29:54.900 INFO:tasks.workunit.client.0.smithi062.stdout:7/375: fdatasync d0/f2c 0 2024-05-09T06:29:54.902 INFO:tasks.workunit.client.0.smithi062.stdout:5/355: dwrite d0/d8/d1c/d2c/f7a [0,4194304] 0 2024-05-09T06:29:54.902 INFO:tasks.workunit.client.0.smithi062.stdout:0/299: stat d1/c12 0 2024-05-09T06:29:54.905 INFO:tasks.workunit.client.0.smithi062.stdout:6/387: rmdir dc/d28/d34/d4e 39 2024-05-09T06:29:54.909 INFO:tasks.workunit.client.0.smithi062.stdout:2/336: rename d0/d9/dd/d1f/d21/f35 to d0/d9/d17/f68 0 2024-05-09T06:29:54.910 INFO:tasks.workunit.client.0.smithi062.stdout:2/337: chown d0/d9/d17/l25 28233967 1 2024-05-09T06:29:54.910 INFO:tasks.workunit.client.0.smithi062.stdout:2/338: write d0/d9/d17/f68 [938104,127894] 0 2024-05-09T06:29:54.910 INFO:tasks.workunit.client.0.smithi062.stdout:2/339: chown d0/f30 35888589 1 2024-05-09T06:29:54.910 INFO:tasks.workunit.client.0.smithi062.stdout:4/388: mknod d0/c76 0 2024-05-09T06:29:54.914 INFO:tasks.workunit.client.0.smithi062.stdout:7/376: truncate d0/d12/d33/f3c 2643814 0 2024-05-09T06:29:54.916 INFO:tasks.workunit.client.0.smithi062.stdout:5/356: read d0/d8/d1c/d23/d3e/f4d [1404280,52575] 0 2024-05-09T06:29:54.916 INFO:tasks.workunit.client.0.smithi062.stdout:5/357: readlink d0/d8/d1c/d2c/l5a 0 2024-05-09T06:29:54.919 INFO:tasks.workunit.client.0.smithi062.stdout:0/300: rmdir d1/d25/d49/d4f 39 2024-05-09T06:29:54.921 INFO:tasks.workunit.client.0.smithi062.stdout:7/377: symlink d0/d3a/d51/l70 0 2024-05-09T06:29:54.922 INFO:tasks.workunit.client.0.smithi062.stdout:5/358: creat d0/d56/d5/f7e x:0 0 0 2024-05-09T06:29:54.924 INFO:tasks.workunit.client.0.smithi062.stdout:7/378: creat d0/d12/f71 x:0 0 0 2024-05-09T06:29:54.927 INFO:tasks.workunit.client.0.smithi062.stdout:5/359: link d0/cb d0/c7f 0 2024-05-09T06:29:54.928 INFO:tasks.workunit.client.0.smithi062.stdout:5/360: creat d0/d8/d1c/d2c/f80 x:0 0 0 2024-05-09T06:29:54.928 INFO:tasks.workunit.client.0.smithi062.stdout:5/361: stat d0/f2d 0 2024-05-09T06:29:54.928 INFO:tasks.workunit.client.0.smithi062.stdout:5/362: readlink d0/d3b/d3f/l50 0 2024-05-09T06:29:54.929 INFO:tasks.workunit.client.0.smithi062.stdout:7/379: symlink d0/d3a/d51/d64/d6d/l72 0 2024-05-09T06:29:54.935 INFO:tasks.workunit.client.0.smithi062.stdout:5/363: unlink d0/c7f 0 2024-05-09T06:29:54.935 INFO:tasks.workunit.client.0.smithi062.stdout:5/364: dread - d0/d56/d45/f76 zero size 2024-05-09T06:29:54.944 INFO:tasks.workunit.client.0.smithi062.stdout:4/389: dwrite d0/d2a/f4 [0,4194304] 0 2024-05-09T06:29:54.945 INFO:tasks.workunit.client.0.smithi062.stdout:4/390: chown d0/f57 3900391 1 2024-05-09T06:29:54.946 INFO:tasks.workunit.client.0.smithi062.stdout:4/391: link d0/d2a/d14/f26 d0/d2a/d8/df/d28/d31/f77 0 2024-05-09T06:29:54.947 INFO:tasks.workunit.client.0.smithi062.stdout:4/392: rmdir d0/d3c/d4e 39 2024-05-09T06:29:54.952 INFO:tasks.workunit.client.0.smithi062.stdout:0/301: dwrite d1/fc [0,4194304] 0 2024-05-09T06:29:54.958 INFO:tasks.workunit.client.0.smithi062.stdout:0/302: dread d1/f2a [0,4194304] 0 2024-05-09T06:29:54.959 INFO:tasks.workunit.client.0.smithi062.stdout:6/388: dwrite dc/d28/d34/d39/f83 [0,4194304] 0 2024-05-09T06:29:54.959 INFO:tasks.workunit.client.0.smithi062.stdout:2/340: dwrite d0/d9/dd/f1a [0,4194304] 0 2024-05-09T06:29:54.959 INFO:tasks.workunit.client.0.smithi062.stdout:7/380: dwrite d0/d3a/d51/f60 [4194304,4194304] 0 2024-05-09T06:29:54.959 INFO:tasks.workunit.client.0.smithi062.stdout:4/393: dread d0/d2a/d8/df/f44 [4194304,4194304] 0 2024-05-09T06:29:54.959 INFO:tasks.workunit.client.0.smithi062.stdout:4/394: stat d0/l48 0 2024-05-09T06:29:54.960 INFO:tasks.workunit.client.0.smithi062.stdout:0/303: rename d1/d25/d49/d4f/l6f to d1/d25/d49/d42/d43/l71 0 2024-05-09T06:29:54.964 INFO:tasks.workunit.client.0.smithi062.stdout:4/395: dread d0/d2a/d1f/f70 [0,4194304] 0 2024-05-09T06:29:54.964 INFO:tasks.workunit.client.0.smithi062.stdout:4/396: chown d0/d5b 53 1 2024-05-09T06:29:54.964 INFO:tasks.workunit.client.0.smithi062.stdout:4/397: chown d0/d2a/d8/df/c34 0 1 2024-05-09T06:29:54.965 INFO:tasks.workunit.client.0.smithi062.stdout:5/365: dwrite d0/f28 [0,4194304] 0 2024-05-09T06:29:54.975 INFO:tasks.workunit.client.0.smithi062.stdout:0/304: dwrite d1/d25/d31/d6c/d44/f63 [4194304,4194304] 0 2024-05-09T06:29:54.986 INFO:tasks.workunit.client.0.smithi062.stdout:6/389: mknod dc/d28/c84 0 2024-05-09T06:29:54.987 INFO:tasks.workunit.client.0.smithi062.stdout:6/390: write dc/f5e [819378,79467] 0 2024-05-09T06:29:54.987 INFO:tasks.workunit.client.0.smithi062.stdout:2/341: mkdir d0/d9/d17/d37/d69 0 2024-05-09T06:29:54.987 INFO:tasks.workunit.client.0.smithi062.stdout:2/342: creat d0/d9/d38/f6a x:0 0 0 2024-05-09T06:29:54.990 INFO:tasks.workunit.client.0.smithi062.stdout:7/381: mknod d0/d3a/c73 0 2024-05-09T06:29:54.991 INFO:tasks.workunit.client.0.smithi062.stdout:4/398: mknod d0/d2a/d14/c78 0 2024-05-09T06:29:55.002 INFO:tasks.workunit.client.0.smithi062.stdout:5/366: symlink d0/d8/d47/l81 0 2024-05-09T06:29:55.003 INFO:tasks.workunit.client.0.smithi062.stdout:5/367: stat d0/d8/d1c/d23/f5b 0 2024-05-09T06:29:55.006 INFO:tasks.workunit.client.0.smithi062.stdout:0/305: mknod d1/d25/d49/d42/d43/c72 0 2024-05-09T06:29:55.006 INFO:tasks.workunit.client.0.smithi062.stdout:0/306: truncate d1/d25/d49/d42/d5b/f68 863421 0 2024-05-09T06:29:55.006 INFO:tasks.workunit.client.0.smithi062.stdout:0/307: chown d1/d25/d31/d6c/c3e 509 1 2024-05-09T06:29:55.007 INFO:tasks.workunit.client.0.smithi062.stdout:6/391: link dc/d28/d46/f64 dc/d28/d34/d4e/f85 0 2024-05-09T06:29:55.010 INFO:tasks.workunit.client.0.smithi062.stdout:4/399: dwrite d0/d2a/d4b/f64 [0,4194304] 0 2024-05-09T06:29:55.010 INFO:tasks.workunit.client.0.smithi062.stdout:4/400: readlink d0/d2a/d8/df/d28/d31/l67 0 2024-05-09T06:29:55.015 INFO:tasks.workunit.client.0.smithi062.stdout:5/368: dread d0/d56/d5/f6f [0,4194304] 0 2024-05-09T06:29:55.016 INFO:tasks.workunit.client.0.smithi062.stdout:0/308: creat d1/f73 x:0 0 0 2024-05-09T06:29:55.016 INFO:tasks.workunit.client.0.smithi062.stdout:0/309: dread - d1/d25/d31/f4c zero size 2024-05-09T06:29:55.025 INFO:tasks.workunit.client.0.smithi062.stdout:6/392: dwrite dc/d28/f14 [0,4194304] 0 2024-05-09T06:29:55.025 INFO:tasks.workunit.client.0.smithi062.stdout:0/310: rename d1/d25/d49/c4d to d1/d25/d49/c74 0 2024-05-09T06:29:55.026 INFO:tasks.workunit.client.0.smithi062.stdout:8/446: sync 2024-05-09T06:29:55.026 INFO:tasks.workunit.client.0.smithi062.stdout:8/447: stat da/d11/d2e/d61/d64/f69 0 2024-05-09T06:29:55.027 INFO:tasks.workunit.client.0.smithi062.stdout:4/401: rmdir d0/d2a/d4b 39 2024-05-09T06:29:55.030 INFO:tasks.workunit.client.0.smithi062.stdout:7/382: rename d0/d3/c50 to d0/c74 0 2024-05-09T06:29:55.032 INFO:tasks.workunit.client.0.smithi062.stdout:0/311: mkdir d1/d25/d31/d6c/d44/d57/d75 0 2024-05-09T06:29:55.032 INFO:tasks.workunit.client.0.smithi062.stdout:0/312: chown d1/d25/d49/d4f/d52/l5a 115498872 1 2024-05-09T06:29:55.034 INFO:tasks.workunit.client.0.smithi062.stdout:4/402: creat d0/d2a/d4b/f79 x:0 0 0 2024-05-09T06:29:55.034 INFO:tasks.workunit.client.0.smithi062.stdout:4/403: write d0/d2a/d8/df/f5d [989831,70285] 0 2024-05-09T06:29:55.034 INFO:tasks.workunit.client.0.smithi062.stdout:4/404: chown d0/c68 519 1 2024-05-09T06:29:55.037 INFO:tasks.workunit.client.0.smithi062.stdout:5/369: rename d0/f1d to d0/d8/d47/f82 0 2024-05-09T06:29:55.038 INFO:tasks.workunit.client.0.smithi062.stdout:8/448: write da/d11/f17 [1275488,7602] 0 2024-05-09T06:29:55.039 INFO:tasks.workunit.client.0.smithi062.stdout:6/393: dwrite dc/d28/f24 [0,4194304] 0 2024-05-09T06:29:55.040 INFO:tasks.workunit.client.0.smithi062.stdout:6/394: fdatasync dc/d28/d34/d39/f83 0 2024-05-09T06:29:55.040 INFO:tasks.workunit.client.0.smithi062.stdout:7/383: mknod d0/d3a/d51/d64/d6d/c75 0 2024-05-09T06:29:55.040 INFO:tasks.workunit.client.0.smithi062.stdout:7/384: truncate d0/f6e 282613 0 2024-05-09T06:29:55.043 INFO:tasks.workunit.client.0.smithi062.stdout:0/313: rmdir d1/d25/d31/d6c/d44/d57 39 2024-05-09T06:29:55.049 INFO:tasks.workunit.client.0.smithi062.stdout:5/370: creat d0/d11/f83 x:0 0 0 2024-05-09T06:29:55.057 INFO:tasks.workunit.client.0.smithi062.stdout:8/449: rename da/d11/d2e/d3a to da/d11/d2e/d61/d92 0 2024-05-09T06:29:55.058 INFO:tasks.workunit.client.0.smithi062.stdout:7/385: creat d0/f76 x:0 0 0 2024-05-09T06:29:55.059 INFO:tasks.workunit.client.0.smithi062.stdout:4/405: dwrite d0/d2a/d14/d4f/f60 [4194304,4194304] 0 2024-05-09T06:29:55.059 INFO:tasks.workunit.client.0.smithi062.stdout:4/406: fsync d0/d2a/d8/f50 0 2024-05-09T06:29:55.062 INFO:tasks.workunit.client.0.smithi062.stdout:5/371: rename d0/d56/l7b to d0/d8/d1c/d2c/d7d/d4a/l84 0 2024-05-09T06:29:55.064 INFO:tasks.workunit.client.0.smithi062.stdout:8/450: mknod da/d11/d2e/d61/d64/c93 0 2024-05-09T06:29:55.065 INFO:tasks.workunit.client.0.smithi062.stdout:8/451: fsync f9 0 2024-05-09T06:29:55.065 INFO:tasks.workunit.client.0.smithi062.stdout:8/452: write da/d11/f6d [680435,118137] 0 2024-05-09T06:29:55.067 INFO:tasks.workunit.client.0.smithi062.stdout:0/314: dwrite d1/d25/d59/f65 [0,4194304] 0 2024-05-09T06:29:55.068 INFO:tasks.workunit.client.0.smithi062.stdout:7/386: creat d0/f77 x:0 0 0 2024-05-09T06:29:55.068 INFO:tasks.workunit.client.0.smithi062.stdout:7/387: readlink d0/d3a/d51/d64/d6d/l72 0 2024-05-09T06:29:55.068 INFO:tasks.workunit.client.0.smithi062.stdout:6/395: dwrite dc/f5e [0,4194304] 0 2024-05-09T06:29:55.069 INFO:tasks.workunit.client.0.smithi062.stdout:4/407: symlink d0/d2a/d8/d69/l7a 0 2024-05-09T06:29:55.069 INFO:tasks.workunit.client.0.smithi062.stdout:4/408: write d0/d2a/d8/f50 [4920256,88314] 0 2024-05-09T06:29:55.069 INFO:tasks.workunit.client.0.smithi062.stdout:8/453: creat da/d77/f94 x:0 0 0 2024-05-09T06:29:55.070 INFO:tasks.workunit.client.0.smithi062.stdout:0/315: rmdir d1/d25/d49/d42 39 2024-05-09T06:29:55.071 INFO:tasks.workunit.client.0.smithi062.stdout:0/316: chown d1/d25/d31/d6c/d44/d57/d75 10306944 1 2024-05-09T06:29:55.071 INFO:tasks.workunit.client.0.smithi062.stdout:7/388: fdatasync d0/f4 0 2024-05-09T06:29:55.075 INFO:tasks.workunit.client.0.smithi062.stdout:6/396: unlink dc/d28/d34/f50 0 2024-05-09T06:29:55.075 INFO:tasks.workunit.client.0.smithi062.stdout:6/397: write dc/d28/d10/d20/d5b/f6a [461694,39391] 0 2024-05-09T06:29:55.075 INFO:tasks.workunit.client.0.smithi062.stdout:6/398: stat dc/d28/d10/f35 0 2024-05-09T06:29:55.075 INFO:tasks.workunit.client.0.smithi062.stdout:6/399: fdatasync dc/d28/d46/d4a/d5d/f27 0 2024-05-09T06:29:55.075 INFO:tasks.workunit.client.0.smithi062.stdout:8/454: mkdir da/d95 0 2024-05-09T06:29:55.077 INFO:tasks.workunit.client.0.smithi062.stdout:0/317: mknod d1/d25/d49/d42/d43/d54/c76 0 2024-05-09T06:29:55.078 INFO:tasks.workunit.client.0.smithi062.stdout:7/389: rename d0/d3/f1f to d0/d3a/f78 0 2024-05-09T06:29:55.079 INFO:tasks.workunit.client.0.smithi062.stdout:6/400: rename dc/d28/d10/f18 to dc/d28/d10/f86 0 2024-05-09T06:29:55.079 INFO:tasks.workunit.client.0.smithi062.stdout:6/401: write dc/fd [4325653,39353] 0 2024-05-09T06:29:55.080 INFO:tasks.workunit.client.0.smithi062.stdout:8/455: rmdir da/d11/d2e/d7e 39 2024-05-09T06:29:55.080 INFO:tasks.workunit.client.0.smithi062.stdout:0/318: symlink d1/d25/d49/l77 0 2024-05-09T06:29:55.081 INFO:tasks.workunit.client.0.smithi062.stdout:7/390: creat d0/d3a/d3f/f79 x:0 0 0 2024-05-09T06:29:55.085 INFO:tasks.workunit.client.0.smithi062.stdout:0/319: truncate d1/f17 1798089 0 2024-05-09T06:29:55.085 INFO:tasks.workunit.client.0.smithi062.stdout:0/320: truncate d1/d18/f34 238078 0 2024-05-09T06:29:55.087 INFO:tasks.workunit.client.0.smithi062.stdout:5/372: dwrite d0/d8/d1c/d23/f4f [0,4194304] 0 2024-05-09T06:29:55.087 INFO:tasks.workunit.client.0.smithi062.stdout:5/373: creat d0/d8/d1c/d2c/f85 x:0 0 0 2024-05-09T06:29:55.087 INFO:tasks.workunit.client.0.smithi062.stdout:4/409: dwrite d0/d2a/d8/df/d28/f41 [0,4194304] 0 2024-05-09T06:29:55.087 INFO:tasks.workunit.client.0.smithi062.stdout:4/410: chown d0/d3c/f5e 2013 1 2024-05-09T06:29:55.087 INFO:tasks.workunit.client.0.smithi062.stdout:4/411: fdatasync d0/d2a/d14/d4f/f60 0 2024-05-09T06:29:55.088 INFO:tasks.workunit.client.0.smithi062.stdout:5/374: write d0/d8/d1c/d23/f5b [431135,30711] 0 2024-05-09T06:29:55.088 INFO:tasks.workunit.client.0.smithi062.stdout:5/375: truncate d0/d56/d5/f57 1009716 0 2024-05-09T06:29:55.088 INFO:tasks.workunit.client.0.smithi062.stdout:7/391: symlink d0/d3a/l7a 0 2024-05-09T06:29:55.092 INFO:tasks.workunit.client.0.smithi062.stdout:0/321: unlink d1/d18/l62 0 2024-05-09T06:29:55.092 INFO:tasks.workunit.client.0.smithi062.stdout:0/322: creat d1/d25/d49/d42/d5b/f78 x:0 0 0 2024-05-09T06:29:55.092 INFO:tasks.workunit.client.0.smithi062.stdout:0/323: write d1/f51 [432136,117790] 0 2024-05-09T06:29:55.092 INFO:tasks.workunit.client.0.smithi062.stdout:0/324: chown d1/d25/d31/d6c/d44/f4a 132679654 1 2024-05-09T06:29:55.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:54 smithi079 ceph-mon[35268]: pgmap v5: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail 2024-05-09T06:29:55.093 INFO:tasks.workunit.client.0.smithi062.stdout:5/376: dread d0/d8/d1c/d2c/f33 [0,4194304] 0 2024-05-09T06:29:55.093 INFO:tasks.workunit.client.0.smithi062.stdout:5/377: write d0/d8/f52 [944515,52292] 0 2024-05-09T06:29:55.093 INFO:tasks.workunit.client.0.smithi062.stdout:5/378: truncate d0/d56/f6a 292930 0 2024-05-09T06:29:55.098 INFO:tasks.workunit.client.0.smithi062.stdout:8/456: getdents da/d77 0 2024-05-09T06:29:55.098 INFO:tasks.workunit.client.0.smithi062.stdout:8/457: fsync da/d11/d1c/f39 0 2024-05-09T06:29:55.098 INFO:tasks.workunit.client.0.smithi062.stdout:8/458: fdatasync da/d11/d2e/f91 0 2024-05-09T06:29:55.098 INFO:tasks.workunit.client.0.smithi062.stdout:6/402: dwrite dc/d28/f43 [0,4194304] 0 2024-05-09T06:29:55.098 INFO:tasks.workunit.client.0.smithi062.stdout:6/403: write dc/f17 [165995,30163] 0 2024-05-09T06:29:55.107 INFO:tasks.workunit.client.0.smithi062.stdout:4/412: mknod d0/d2a/d8/df/d28/d31/c7b 0 2024-05-09T06:29:55.107 INFO:tasks.workunit.client.0.smithi062.stdout:4/413: stat d0/d3c 0 2024-05-09T06:29:55.107 INFO:tasks.workunit.client.0.smithi062.stdout:4/414: creat d0/d2a/d8/df/d28/d4c/f7c x:0 0 0 2024-05-09T06:29:55.114 INFO:tasks.workunit.client.0.smithi062.stdout:0/325: unlink d1/d25/d31/d6c/f36 0 2024-05-09T06:29:55.114 INFO:tasks.workunit.client.0.smithi062.stdout:0/326: write d1/d25/f26 [5055817,10418] 0 2024-05-09T06:29:55.115 INFO:tasks.workunit.client.0.smithi062.stdout:5/379: mkdir d0/d56/d86 0 2024-05-09T06:29:55.117 INFO:tasks.workunit.client.0.smithi062.stdout:8/459: creat da/d11/d2e/d34/d90/f96 x:0 0 0 2024-05-09T06:29:55.134 INFO:tasks.workunit.client.0.smithi062.stdout:5/380: dwrite d0/d8/d47/f82 [0,4194304] 0 2024-05-09T06:29:55.135 INFO:tasks.workunit.client.0.smithi062.stdout:5/381: fsync d0/d8/d1c/d23/d3e/f4d 0 2024-05-09T06:29:55.135 INFO:tasks.workunit.client.0.smithi062.stdout:6/404: creat dc/d28/d46/d4a/d5d/d6f/d76/f87 x:0 0 0 2024-05-09T06:29:55.140 INFO:tasks.workunit.client.0.smithi062.stdout:7/392: rmdir d0/d12/d33/d67 39 2024-05-09T06:29:55.142 INFO:tasks.workunit.client.0.smithi062.stdout:0/327: symlink d1/d25/l79 0 2024-05-09T06:29:55.145 INFO:tasks.workunit.client.0.smithi062.stdout:8/460: unlink f9 0 2024-05-09T06:29:55.150 INFO:tasks.workunit.client.0.smithi062.stdout:5/382: mknod d0/d3b/d3f/c87 0 2024-05-09T06:29:55.151 INFO:tasks.workunit.client.0.smithi062.stdout:6/405: mknod dc/d28/d10/c88 0 2024-05-09T06:29:55.154 INFO:tasks.workunit.client.0.smithi062.stdout:4/415: link d0/d3c/l75 d0/d9/l7d 0 2024-05-09T06:29:55.155 INFO:tasks.workunit.client.0.smithi062.stdout:4/416: fdatasync d0/d9/f3e 0 2024-05-09T06:29:55.157 INFO:tasks.workunit.client.0.smithi062.stdout:8/461: truncate f8 1182054 0 2024-05-09T06:29:55.157 INFO:tasks.workunit.client.0.smithi062.stdout:8/462: readlink da/d11/d2e/l59 0 2024-05-09T06:29:55.158 INFO:tasks.workunit.client.0.smithi062.stdout:1/294: sync 2024-05-09T06:29:55.158 INFO:tasks.workunit.client.0.smithi062.stdout:3/314: sync 2024-05-09T06:29:55.158 INFO:tasks.workunit.client.0.smithi062.stdout:9/396: sync 2024-05-09T06:29:55.159 INFO:tasks.workunit.client.0.smithi062.stdout:3/315: fsync d1/d1e/d26/f3c 0 2024-05-09T06:29:55.159 INFO:tasks.workunit.client.0.smithi062.stdout:3/316: write d1/d1e/d36/d3a/f6d [595624,42906] 0 2024-05-09T06:29:55.159 INFO:tasks.workunit.client.0.smithi062.stdout:2/343: sync 2024-05-09T06:29:55.159 INFO:tasks.workunit.client.0.smithi062.stdout:2/344: chown d0/d9/dd/f5e 1007490871 1 2024-05-09T06:29:55.159 INFO:tasks.workunit.client.0.smithi062.stdout:0/328: dwrite d1/d25/d31/f33 [0,4194304] 0 2024-05-09T06:29:55.160 INFO:tasks.workunit.client.0.smithi062.stdout:7/393: rename d0/f16 to d0/d3a/f7b 0 2024-05-09T06:29:55.161 INFO:tasks.workunit.client.0.smithi062.stdout:8/463: symlink da/d11/l97 0 2024-05-09T06:29:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:54 smithi062 ceph-mon[26920]: pgmap v5: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail 2024-05-09T06:29:55.178 INFO:tasks.workunit.client.0.smithi062.stdout:4/417: rmdir d0/d2a/d8/df 39 2024-05-09T06:29:55.179 INFO:tasks.workunit.client.0.smithi062.stdout:4/418: chown d0/d2a/d8/l20 82272 1 2024-05-09T06:29:55.179 INFO:tasks.workunit.client.0.smithi062.stdout:4/419: readlink d0/d3c/l66 0 2024-05-09T06:29:55.179 INFO:tasks.workunit.client.0.smithi062.stdout:9/397: symlink d3/d20/l85 0 2024-05-09T06:29:55.180 INFO:tasks.workunit.client.0.smithi062.stdout:9/398: readlink d3/l14 0 2024-05-09T06:29:55.182 INFO:tasks.workunit.client.0.smithi062.stdout:3/317: symlink d1/d1e/d36/d6c/l72 0 2024-05-09T06:29:55.186 INFO:tasks.workunit.client.0.smithi062.stdout:0/329: rmdir d1/d25/d31/d6c/d44/d57 39 2024-05-09T06:29:55.187 INFO:tasks.workunit.client.0.smithi062.stdout:7/394: creat d0/d12/d33/d67/f7c x:0 0 0 2024-05-09T06:29:55.187 INFO:tasks.workunit.client.0.smithi062.stdout:7/395: write d0/d12/d33/f46 [1128729,62954] 0 2024-05-09T06:29:55.191 INFO:tasks.workunit.client.0.smithi062.stdout:4/420: rename d0/d2a/d8/df/d28/d4c to d0/d2a/d14/d7e 0 2024-05-09T06:29:55.191 INFO:tasks.workunit.client.0.smithi062.stdout:4/421: readlink d0/d2a/d8/l20 0 2024-05-09T06:29:55.194 INFO:tasks.workunit.client.0.smithi062.stdout:9/399: unlink d3/d20/l81 0 2024-05-09T06:29:55.194 INFO:tasks.workunit.client.0.smithi062.stdout:9/400: creat d3/f86 x:0 0 0 2024-05-09T06:29:55.194 INFO:tasks.workunit.client.0.smithi062.stdout:9/401: chown d3/d3e/d52/d58/d1c/d1e/l37 5047039 1 2024-05-09T06:29:55.196 INFO:tasks.workunit.client.0.smithi062.stdout:4/422: dread d0/f46 [0,4194304] 0 2024-05-09T06:29:55.197 INFO:tasks.workunit.client.0.smithi062.stdout:4/423: stat d0/d2a/d1f/d6c 0 2024-05-09T06:29:55.197 INFO:tasks.workunit.client.0.smithi062.stdout:4/424: fsync d0/d2a/d8/df/d28/f59 0 2024-05-09T06:29:55.197 INFO:tasks.workunit.client.0.smithi062.stdout:4/425: creat d0/f7f x:0 0 0 2024-05-09T06:29:55.198 INFO:tasks.workunit.client.0.smithi062.stdout:1/295: dwrite d8/d2c/d41/f55 [4194304,4194304] 0 2024-05-09T06:29:55.198 INFO:tasks.workunit.client.0.smithi062.stdout:1/296: readlink d8/lf 0 2024-05-09T06:29:55.198 INFO:tasks.workunit.client.0.smithi062.stdout:1/297: fsync d8/f49 0 2024-05-09T06:29:55.198 INFO:tasks.workunit.client.0.smithi062.stdout:6/406: dwrite dc/d28/f11 [0,4194304] 0 2024-05-09T06:29:55.199 INFO:tasks.workunit.client.0.smithi062.stdout:2/345: dwrite d0/d9/dd/f5e [0,4194304] 0 2024-05-09T06:29:55.199 INFO:tasks.workunit.client.0.smithi062.stdout:2/346: truncate d0/d9/d38/d41/f49 675459 0 2024-05-09T06:29:55.199 INFO:tasks.workunit.client.0.smithi062.stdout:8/464: dwrite da/d11/d1c/f43 [4194304,4194304] 0 2024-05-09T06:29:55.200 INFO:tasks.workunit.client.0.smithi062.stdout:2/347: write d0/d9/dd/f33 [1840079,102003] 0 2024-05-09T06:29:55.200 INFO:tasks.workunit.client.0.smithi062.stdout:2/348: truncate d0/d9/dd/d1f/d21/f3c 876100 0 2024-05-09T06:29:55.204 INFO:tasks.workunit.client.0.smithi062.stdout:5/383: dwrite d0/d8/d1c/d2c/f80 [0,4194304] 0 2024-05-09T06:29:55.204 INFO:tasks.workunit.client.0.smithi062.stdout:9/402: dread d3/d3e/d4b/f5c [0,4194304] 0 2024-05-09T06:29:55.205 INFO:tasks.workunit.client.0.smithi062.stdout:4/426: rmdir d0/d2a/d8 39 2024-05-09T06:29:55.206 INFO:tasks.workunit.client.0.smithi062.stdout:1/298: stat d8/d14/c21 0 2024-05-09T06:29:55.206 INFO:tasks.workunit.client.0.smithi062.stdout:1/299: readlink d8/d14/d2b/d3c/l57 0 2024-05-09T06:29:55.206 INFO:tasks.workunit.client.0.smithi062.stdout:1/300: readlink d8/d14/d2b/d3d/d3e/l61 0 2024-05-09T06:29:55.207 INFO:tasks.workunit.client.0.smithi062.stdout:1/301: read - d8/f49 zero size 2024-05-09T06:29:55.213 INFO:tasks.workunit.client.0.smithi062.stdout:0/330: dwrite d1/f24 [0,4194304] 0 2024-05-09T06:29:55.213 INFO:tasks.workunit.client.0.smithi062.stdout:6/407: read dc/d28/d46/d3a/f4f [12362,62746] 0 2024-05-09T06:29:55.213 INFO:tasks.workunit.client.0.smithi062.stdout:3/318: dwrite d1/d1e/d36/d4a/f66 [0,4194304] 0 2024-05-09T06:29:55.221 INFO:tasks.workunit.client.0.smithi062.stdout:8/465: unlink da/d11/d2e/d61/d92/c87 0 2024-05-09T06:29:55.222 INFO:tasks.workunit.client.0.smithi062.stdout:1/302: dwrite f5 [0,4194304] 0 2024-05-09T06:29:55.226 INFO:tasks.workunit.client.0.smithi062.stdout:2/349: mknod d0/d9/dd/d1f/d21/d29/d3d/c6b 0 2024-05-09T06:29:55.226 INFO:tasks.workunit.client.0.smithi062.stdout:2/350: dread - d0/d9/d38/d41/d53/f63 zero size 2024-05-09T06:29:55.226 INFO:tasks.workunit.client.0.smithi062.stdout:2/351: chown d0/d9/dd/d1f/f3b 3169 1 2024-05-09T06:29:55.227 INFO:tasks.workunit.client.0.smithi062.stdout:2/352: dread d0/d9/d38/d41/d48/f4c [0,4194304] 0 2024-05-09T06:29:55.227 INFO:tasks.workunit.client.0.smithi062.stdout:2/353: truncate d0/d9/dd/d1f/d21/d29/d3d/d46/f4d 516990 0 2024-05-09T06:29:55.227 INFO:tasks.workunit.client.0.smithi062.stdout:2/354: fsync d0/d9/d38/d41/f49 0 2024-05-09T06:29:55.227 INFO:tasks.workunit.client.0.smithi062.stdout:2/355: write d0/d9/d38/d41/d53/f63 [311287,5733] 0 2024-05-09T06:29:55.231 INFO:tasks.workunit.client.0.smithi062.stdout:3/319: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:55.233 INFO:tasks.workunit.client.0.smithi062.stdout:5/384: link d0/c69 d0/d8/d18/c88 0 2024-05-09T06:29:55.233 INFO:tasks.workunit.client.0.smithi062.stdout:5/385: creat d0/d11/f89 x:0 0 0 2024-05-09T06:29:55.233 INFO:tasks.workunit.client.0.smithi062.stdout:7/396: rmdir d0/d12 39 2024-05-09T06:29:55.233 INFO:tasks.workunit.client.0.smithi062.stdout:7/397: dread - d0/d3a/d3f/f79 zero size 2024-05-09T06:29:55.239 INFO:tasks.workunit.client.0.smithi062.stdout:9/403: rename d3/d3e/d52/d58/d1c/f34 to d3/d3e/d52/d58/d1c/f87 0 2024-05-09T06:29:55.241 INFO:tasks.workunit.client.0.smithi062.stdout:4/427: symlink d0/d2a/d1f/d6c/l80 0 2024-05-09T06:29:55.241 INFO:tasks.workunit.client.0.smithi062.stdout:4/428: truncate d0/d2a/d14/d7e/f7c 918965 0 2024-05-09T06:29:55.241 INFO:tasks.workunit.client.0.smithi062.stdout:4/429: stat d0/d2a/d8/c45 0 2024-05-09T06:29:55.244 INFO:tasks.workunit.client.0.smithi062.stdout:2/356: dwrite d0/d9/d38/f60 [0,4194304] 0 2024-05-09T06:29:55.244 INFO:tasks.workunit.client.0.smithi062.stdout:2/357: write d0/d9/dd/d1f/f24 [1045250,33808] 0 2024-05-09T06:29:55.244 INFO:tasks.workunit.client.0.smithi062.stdout:2/358: write d0/fa [3624427,50989] 0 2024-05-09T06:29:55.245 INFO:tasks.workunit.client.0.smithi062.stdout:0/331: rename d1/d25/l2d to d1/d25/d31/d6c/d44/d6e/l7a 0 2024-05-09T06:29:55.245 INFO:tasks.workunit.client.0.smithi062.stdout:1/303: rename d8/d14/d2b to d8/d14/d2b/d3d/d66 22 2024-05-09T06:29:55.249 INFO:tasks.workunit.client.0.smithi062.stdout:6/408: mknod dc/d28/c89 0 2024-05-09T06:29:55.251 INFO:tasks.workunit.client.0.smithi062.stdout:2/359: fdatasync d0/d9/dd/f33 0 2024-05-09T06:29:55.251 INFO:tasks.workunit.client.0.smithi062.stdout:2/360: write d0/d9/d38/d41/f51 [387429,38056] 0 2024-05-09T06:29:55.257 INFO:tasks.workunit.client.0.smithi062.stdout:8/466: symlink da/d11/d2e/d7e/l98 0 2024-05-09T06:29:55.259 INFO:tasks.workunit.client.0.smithi062.stdout:8/467: dread da/f6c [0,4194304] 0 2024-05-09T06:29:55.262 INFO:tasks.workunit.client.0.smithi062.stdout:3/320: link d1/d1e/d26/c4b d1/d1e/d26/d43/c73 0 2024-05-09T06:29:55.264 INFO:tasks.workunit.client.0.smithi062.stdout:5/386: mknod d0/d56/d5/c8a 0 2024-05-09T06:29:55.266 INFO:tasks.workunit.client.0.smithi062.stdout:7/398: creat d0/d12/d33/d67/f7d x:0 0 0 2024-05-09T06:29:55.267 INFO:tasks.workunit.client.0.smithi062.stdout:9/404: mknod d3/d3e/d52/d58/d1c/d1e/c88 0 2024-05-09T06:29:55.267 INFO:tasks.workunit.client.0.smithi062.stdout:9/405: fsync d3/f19 0 2024-05-09T06:29:55.267 INFO:tasks.workunit.client.0.smithi062.stdout:9/406: write d3/d3e/d52/d58/d1c/d1e/f5f [1415808,70853] 0 2024-05-09T06:29:55.268 INFO:tasks.workunit.client.0.smithi062.stdout:4/430: mkdir d0/d2a/d4b/d81 0 2024-05-09T06:29:55.272 INFO:tasks.workunit.client.0.smithi062.stdout:6/409: dwrite dc/d28/d34/d4e/d57/f75 [0,4194304] 0 2024-05-09T06:29:55.273 INFO:tasks.workunit.client.0.smithi062.stdout:2/361: dwrite d0/d9/d38/d41/d48/f4c [0,4194304] 0 2024-05-09T06:29:55.277 INFO:tasks.workunit.client.0.smithi062.stdout:3/321: dread d1/d1e/f25 [4194304,4194304] 0 2024-05-09T06:29:55.282 INFO:tasks.workunit.client.0.smithi062.stdout:4/431: dwrite d0/d2a/d14/d4f/f56 [0,4194304] 0 2024-05-09T06:29:55.288 INFO:tasks.workunit.client.0.smithi062.stdout:8/468: unlink da/d11/d2e/d34/d90/f96 0 2024-05-09T06:29:55.289 INFO:tasks.workunit.client.0.smithi062.stdout:8/469: dread da/d11/d1c/f4a [0,4194304] 0 2024-05-09T06:29:55.291 INFO:tasks.workunit.client.0.smithi062.stdout:5/387: creat d0/d3b/f8b x:0 0 0 2024-05-09T06:29:55.291 INFO:tasks.workunit.client.0.smithi062.stdout:5/388: creat d0/d8/d1c/d2c/f8c x:0 0 0 2024-05-09T06:29:55.294 INFO:tasks.workunit.client.0.smithi062.stdout:7/399: link d0/d3a/f7b d0/d12/d33/d67/f7e 0 2024-05-09T06:29:55.295 INFO:tasks.workunit.client.0.smithi062.stdout:9/407: truncate d3/d3e/d52/d58/f35 111356 0 2024-05-09T06:29:55.296 INFO:tasks.workunit.client.0.smithi062.stdout:9/408: chown d3/f6 667142 1 2024-05-09T06:29:55.298 INFO:tasks.workunit.client.0.smithi062.stdout:6/410: link dc/d28/d10/d20/l44 dc/d28/d46/d82/l8a 0 2024-05-09T06:29:55.304 INFO:tasks.workunit.client.0.smithi062.stdout:2/362: unlink d0/d9/d17/c13 0 2024-05-09T06:29:55.306 INFO:tasks.workunit.client.0.smithi062.stdout:0/332: rmdir d1/d18 39 2024-05-09T06:29:55.307 INFO:tasks.workunit.client.0.smithi062.stdout:6/411: write dc/d28/f24 [980001,41780] 0 2024-05-09T06:29:55.307 INFO:tasks.workunit.client.0.smithi062.stdout:3/322: symlink d1/d1e/d26/d33/l74 0 2024-05-09T06:29:55.307 INFO:tasks.workunit.client.0.smithi062.stdout:3/323: write d1/d1e/f1d [1070687,33668] 0 2024-05-09T06:29:55.312 INFO:tasks.workunit.client.0.smithi062.stdout:4/432: mknod d0/d2a/d1f/d6c/c82 0 2024-05-09T06:29:55.312 INFO:tasks.workunit.client.0.smithi062.stdout:4/433: truncate d0/d2a/d8/df/f5d 1075878 0 2024-05-09T06:29:55.314 INFO:tasks.workunit.client.0.smithi062.stdout:8/470: link da/d11/l8d da/d11/d2e/d61/l99 0 2024-05-09T06:29:55.314 INFO:tasks.workunit.client.0.smithi062.stdout:8/471: fdatasync da/d11/f3c 0 2024-05-09T06:29:55.319 INFO:tasks.workunit.client.0.smithi062.stdout:9/409: creat d3/d3e/f89 x:0 0 0 2024-05-09T06:29:55.319 INFO:tasks.workunit.client.0.smithi062.stdout:9/410: fdatasync d3/d20/f7a 0 2024-05-09T06:29:55.319 INFO:tasks.workunit.client.0.smithi062.stdout:9/411: chown d3/d3e/d52/d58/d1c/d1e/f4c 1509877 1 2024-05-09T06:29:55.321 INFO:tasks.workunit.client.0.smithi062.stdout:2/363: dwrite d0/d9/dd/d1f/d21/f55 [0,4194304] 0 2024-05-09T06:29:55.321 INFO:tasks.workunit.client.0.smithi062.stdout:2/364: dread - d0/d9/d38/f6a zero size 2024-05-09T06:29:55.321 INFO:tasks.workunit.client.0.smithi062.stdout:2/365: creat d0/d9/dd/f6c x:0 0 0 2024-05-09T06:29:55.322 INFO:tasks.workunit.client.0.smithi062.stdout:0/333: mkdir d1/d25/d49/d4f/d52/d7b 0 2024-05-09T06:29:55.324 INFO:tasks.workunit.client.0.smithi062.stdout:6/412: creat dc/d28/d10/d20/f8b x:0 0 0 2024-05-09T06:29:55.324 INFO:tasks.workunit.client.0.smithi062.stdout:6/413: fsync dc/d42/f66 0 2024-05-09T06:29:55.329 INFO:tasks.workunit.client.0.smithi062.stdout:3/324: link d1/d1e/d54/c6e d1/d1e/d26/c75 0 2024-05-09T06:29:55.333 INFO:tasks.workunit.client.0.smithi062.stdout:3/325: dread d1/d1e/f30 [0,4194304] 0 2024-05-09T06:29:55.333 INFO:tasks.workunit.client.0.smithi062.stdout:3/326: fdatasync d1/d48/f50 0 2024-05-09T06:29:55.333 INFO:tasks.workunit.client.0.smithi062.stdout:3/327: creat d1/d1e/d36/d3a/d4e/f76 x:0 0 0 2024-05-09T06:29:55.333 INFO:tasks.workunit.client.0.smithi062.stdout:3/328: write d1/d1e/d26/f69 [927673,47902] 0 2024-05-09T06:29:55.333 INFO:tasks.workunit.client.0.smithi062.stdout:3/329: fdatasync d1/d1e/d26/f56 0 2024-05-09T06:29:55.334 INFO:tasks.workunit.client.0.smithi062.stdout:4/434: unlink d0/d2a/d8/c45 0 2024-05-09T06:29:55.334 INFO:tasks.workunit.client.0.smithi062.stdout:8/472: dwrite da/d11/f2d [0,4194304] 0 2024-05-09T06:29:55.336 INFO:tasks.workunit.client.0.smithi062.stdout:7/400: mknod d0/d3a/d51/d64/c7f 0 2024-05-09T06:29:55.336 INFO:tasks.workunit.client.0.smithi062.stdout:7/401: write d0/d12/d33/f5e [263998,58997] 0 2024-05-09T06:29:55.336 INFO:tasks.workunit.client.0.smithi062.stdout:8/473: dread da/d11/f3c [0,4194304] 0 2024-05-09T06:29:55.337 INFO:tasks.workunit.client.0.smithi062.stdout:8/474: write da/d11/f58 [417183,111048] 0 2024-05-09T06:29:55.338 INFO:tasks.workunit.client.0.smithi062.stdout:8/475: dread da/d11/f55 [0,4194304] 0 2024-05-09T06:29:55.338 INFO:tasks.workunit.client.0.smithi062.stdout:8/476: readlink da/d11/l80 0 2024-05-09T06:29:55.339 INFO:tasks.workunit.client.0.smithi062.stdout:8/477: fsync da/d11/d2e/d34/f44 0 2024-05-09T06:29:55.341 INFO:tasks.workunit.client.0.smithi062.stdout:9/412: rename d3/d3e/d52/d58/d77/c80 to d3/d3e/d7c/c8a 0 2024-05-09T06:29:55.341 INFO:tasks.workunit.client.0.smithi062.stdout:6/414: dread dc/d28/f22 [0,4194304] 0 2024-05-09T06:29:55.346 INFO:tasks.workunit.client.0.smithi062.stdout:0/334: mknod d1/d25/d59/c7c 0 2024-05-09T06:29:55.347 INFO:tasks.workunit.client.0.smithi062.stdout:4/435: dread d0/d2a/d14/d4f/f60 [0,4194304] 0 2024-05-09T06:29:55.352 INFO:tasks.workunit.client.0.smithi062.stdout:7/402: mkdir d0/d3a/d51/d64/d6d/d80 0 2024-05-09T06:29:55.352 INFO:tasks.workunit.client.0.smithi062.stdout:7/403: truncate d0/d3a/f5f 704645 0 2024-05-09T06:29:55.352 INFO:tasks.workunit.client.0.smithi062.stdout:7/404: stat d0/d3/f65 0 2024-05-09T06:29:55.354 INFO:tasks.workunit.client.0.smithi062.stdout:7/405: read d0/d12/d33/f3b [938095,59678] 0 2024-05-09T06:29:55.354 INFO:tasks.workunit.client.0.smithi062.stdout:7/406: write d0/d12/f59 [2120218,63649] 0 2024-05-09T06:29:55.361 INFO:tasks.workunit.client.0.smithi062.stdout:3/330: dwrite d1/f46 [0,4194304] 0 2024-05-09T06:29:55.361 INFO:tasks.workunit.client.0.smithi062.stdout:3/331: fdatasync d1/d1e/d36/d4a/d51/f6b 0 2024-05-09T06:29:55.361 INFO:tasks.workunit.client.0.smithi062.stdout:3/332: dread - d1/d1e/d36/f49 zero size 2024-05-09T06:29:55.361 INFO:tasks.workunit.client.0.smithi062.stdout:8/478: dwrite da/f5d [4194304,4194304] 0 2024-05-09T06:29:55.361 INFO:tasks.workunit.client.0.smithi062.stdout:7/407: dread d0/d12/d33/f3b [0,4194304] 0 2024-05-09T06:29:55.361 INFO:tasks.workunit.client.0.smithi062.stdout:7/408: fdatasync d0/f5c 0 2024-05-09T06:29:55.364 INFO:tasks.workunit.client.0.smithi062.stdout:3/333: dread d1/f55 [0,4194304] 0 2024-05-09T06:29:55.364 INFO:tasks.workunit.client.0.smithi062.stdout:3/334: chown d1/c12 19742 1 2024-05-09T06:29:55.368 INFO:tasks.workunit.client.0.smithi062.stdout:9/413: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f43 [0,4194304] 0 2024-05-09T06:29:55.369 INFO:tasks.workunit.client.0.smithi062.stdout:6/415: rename dc/d28/f24 to dc/d28/f8c 0 2024-05-09T06:29:55.369 INFO:tasks.workunit.client.0.smithi062.stdout:6/416: write dc/d42/f4d [2673732,27706] 0 2024-05-09T06:29:55.371 INFO:tasks.workunit.client.0.smithi062.stdout:0/335: getdents d1/d25/d31/d6c/d44 0 2024-05-09T06:29:55.372 INFO:tasks.workunit.client.0.smithi062.stdout:0/336: truncate d1/d25/d31/d6c/d44/d57/f64 348631 0 2024-05-09T06:29:55.372 INFO:tasks.workunit.client.0.smithi062.stdout:0/337: read - d1/f73 zero size 2024-05-09T06:29:55.372 INFO:tasks.workunit.client.0.smithi062.stdout:0/338: write d1/d18/f1d [1383587,11291] 0 2024-05-09T06:29:55.372 INFO:tasks.workunit.client.0.smithi062.stdout:4/436: creat d0/d2a/d1f/d6c/f83 x:0 0 0 2024-05-09T06:29:55.373 INFO:tasks.workunit.client.0.smithi062.stdout:4/437: chown d0/d2a/d14/d4f/f60 7531 1 2024-05-09T06:29:55.373 INFO:tasks.workunit.client.0.smithi062.stdout:4/438: fsync d0/d2a/d8/df/d28/d31/f58 0 2024-05-09T06:29:55.380 INFO:tasks.workunit.client.0.smithi062.stdout:8/479: creat da/d11/d1c/f9a x:0 0 0 2024-05-09T06:29:55.381 INFO:tasks.workunit.client.0.smithi062.stdout:7/409: creat d0/d3a/d3f/f81 x:0 0 0 2024-05-09T06:29:55.386 INFO:tasks.workunit.client.0.smithi062.stdout:3/335: mkdir d1/d2d/d77 0 2024-05-09T06:29:55.386 INFO:tasks.workunit.client.0.smithi062.stdout:3/336: fdatasync d1/f2f 0 2024-05-09T06:29:55.387 INFO:tasks.workunit.client.0.smithi062.stdout:4/439: dwrite d0/d2a/d8/df/f16 [4194304,4194304] 0 2024-05-09T06:29:55.387 INFO:tasks.workunit.client.0.smithi062.stdout:4/440: write d0/f46 [442057,36] 0 2024-05-09T06:29:55.387 INFO:tasks.workunit.client.0.smithi062.stdout:4/441: fdatasync d0/f7f 0 2024-05-09T06:29:55.387 INFO:tasks.workunit.client.0.smithi062.stdout:4/442: stat d0/d2a/d8/df/d28/d31/f58 0 2024-05-09T06:29:55.400 INFO:tasks.workunit.client.0.smithi062.stdout:9/414: symlink d3/d3e/d52/d58/d1c/d1e/l8b 0 2024-05-09T06:29:55.400 INFO:tasks.workunit.client.0.smithi062.stdout:9/415: chown d3/d3e/d7c/f7e 164 1 2024-05-09T06:29:55.401 INFO:tasks.workunit.client.0.smithi062.stdout:9/416: chown d3/d3e/d52/d58/d1c/d1e/d41/d64/f2c 126916 1 2024-05-09T06:29:55.401 INFO:tasks.workunit.client.0.smithi062.stdout:4/443: dread d0/d2a/d14/d4f/f56 [0,4194304] 0 2024-05-09T06:29:55.401 INFO:tasks.workunit.client.0.smithi062.stdout:4/444: write d0/d2a/d8/df/d28/d31/f6f [662533,83140] 0 2024-05-09T06:29:55.402 INFO:tasks.workunit.client.0.smithi062.stdout:6/417: symlink dc/d28/d34/d4e/d78/l8d 0 2024-05-09T06:29:55.402 INFO:tasks.workunit.client.0.smithi062.stdout:7/410: dwrite d0/d3a/d3f/f79 [0,4194304] 0 2024-05-09T06:29:55.403 INFO:tasks.workunit.client.0.smithi062.stdout:0/339: creat d1/d25/d49/d42/d43/f7d x:0 0 0 2024-05-09T06:29:55.405 INFO:tasks.workunit.client.0.smithi062.stdout:8/480: mknod da/d77/c9b 0 2024-05-09T06:29:55.405 INFO:tasks.workunit.client.0.smithi062.stdout:8/481: fdatasync f8 0 2024-05-09T06:29:55.405 INFO:tasks.workunit.client.0.smithi062.stdout:8/482: truncate da/f71 341163 0 2024-05-09T06:29:55.408 INFO:tasks.workunit.client.0.smithi062.stdout:8/483: dread da/f13 [0,4194304] 0 2024-05-09T06:29:55.412 INFO:tasks.workunit.client.0.smithi062.stdout:2/366: rename d0/d9/dd/d1f to d0/d9/dd/d65/d6d 0 2024-05-09T06:29:55.412 INFO:tasks.workunit.client.0.smithi062.stdout:6/418: write dc/d28/f11 [3222894,61449] 0 2024-05-09T06:29:55.415 INFO:tasks.workunit.client.0.smithi062.stdout:0/340: dread d1/d25/d31/f33 [0,4194304] 0 2024-05-09T06:29:55.419 INFO:tasks.workunit.client.0.smithi062.stdout:4/445: mkdir d0/d2a/d84 0 2024-05-09T06:29:55.419 INFO:tasks.workunit.client.0.smithi062.stdout:4/446: readlink d0/d2a/l49 0 2024-05-09T06:29:55.419 INFO:tasks.workunit.client.0.smithi062.stdout:4/447: readlink d0/d9/l1c 0 2024-05-09T06:29:55.425 INFO:tasks.workunit.client.0.smithi062.stdout:7/411: creat d0/d3a/d51/d64/f82 x:0 0 0 2024-05-09T06:29:55.426 INFO:tasks.workunit.client.0.smithi062.stdout:6/419: mkdir dc/d28/d46/d3a/d7f/d8e 0 2024-05-09T06:29:55.428 INFO:tasks.workunit.client.0.smithi062.stdout:9/417: symlink d3/d3e/d52/d58/d1c/d21/l8c 0 2024-05-09T06:29:55.432 INFO:tasks.workunit.client.0.smithi062.stdout:8/484: dwrite da/d11/d2e/d34/f7b [0,4194304] 0 2024-05-09T06:29:55.433 INFO:tasks.workunit.client.0.smithi062.stdout:2/367: dwrite d0/d9/dd/d65/d6d/d21/f42 [0,4194304] 0 2024-05-09T06:29:55.438 INFO:tasks.workunit.client.0.smithi062.stdout:0/341: mkdir d1/d25/d49/d7e 0 2024-05-09T06:29:55.441 INFO:tasks.workunit.client.0.smithi062.stdout:6/420: symlink dc/l8f 0 2024-05-09T06:29:55.442 INFO:tasks.workunit.client.0.smithi062.stdout:9/418: truncate d3/d3e/d52/d58/f35 80319 0 2024-05-09T06:29:55.443 INFO:tasks.workunit.client.0.smithi062.stdout:9/419: readlink d3/d3e/d4b/l3d 0 2024-05-09T06:29:55.447 INFO:tasks.workunit.client.0.smithi062.stdout:8/485: write da/f5d [7074675,116600] 0 2024-05-09T06:29:55.447 INFO:tasks.workunit.client.0.smithi062.stdout:4/448: dwrite d0/d9/f3e [0,4194304] 0 2024-05-09T06:29:55.447 INFO:tasks.workunit.client.0.smithi062.stdout:4/449: chown d0/d2a/d14/c29 34 1 2024-05-09T06:29:55.447 INFO:tasks.workunit.client.0.smithi062.stdout:7/412: dwrite d0/f77 [0,4194304] 0 2024-05-09T06:29:55.448 INFO:tasks.workunit.client.0.smithi062.stdout:8/486: dread da/d11/d2e/f53 [0,4194304] 0 2024-05-09T06:29:55.453 INFO:tasks.workunit.client.0.smithi062.stdout:2/368: rename d0/d9/dd/d65/d6d/d21/c59 to d0/d9/d38/d41/d48/c6e 0 2024-05-09T06:29:55.455 INFO:tasks.workunit.client.0.smithi062.stdout:6/421: creat dc/d28/d46/d3a/d7f/f90 x:0 0 0 2024-05-09T06:29:55.462 INFO:tasks.workunit.client.0.smithi062.stdout:7/413: dwrite d0/d3/f40 [0,4194304] 0 2024-05-09T06:29:55.462 INFO:tasks.workunit.client.0.smithi062.stdout:7/414: truncate d0/d3a/d3f/f5a 59795 0 2024-05-09T06:29:55.466 INFO:tasks.workunit.client.0.smithi062.stdout:8/487: unlink da/d11/c76 0 2024-05-09T06:29:55.466 INFO:tasks.workunit.client.0.smithi062.stdout:8/488: write da/d11/f55 [1744030,66447] 0 2024-05-09T06:29:55.466 INFO:tasks.workunit.client.0.smithi062.stdout:8/489: chown da/d11/d2e/l5e 10 1 2024-05-09T06:29:55.467 INFO:tasks.workunit.client.0.smithi062.stdout:6/422: dread dc/d28/d46/d3a/f40 [0,4194304] 0 2024-05-09T06:29:55.468 INFO:tasks.workunit.client.0.smithi062.stdout:2/369: rename d0/d9/dd/f54 to d0/d9/d17/d37/d69/f6f 0 2024-05-09T06:29:55.469 INFO:tasks.workunit.client.0.smithi062.stdout:2/370: chown d0/d9/dd/f4e 542091330 1 2024-05-09T06:29:55.469 INFO:tasks.workunit.client.0.smithi062.stdout:2/371: getdents d0/d9/dd/d65/d6d/d21/d29/d40 0 2024-05-09T06:29:55.470 INFO:tasks.workunit.client.0.smithi062.stdout:9/420: rmdir d3/d3e/d52/d58/d1c/d21 39 2024-05-09T06:29:55.475 INFO:tasks.workunit.client.0.smithi062.stdout:6/423: mkdir dc/d28/d46/d3a/d7f/d91 0 2024-05-09T06:29:55.475 INFO:tasks.workunit.client.0.smithi062.stdout:6/424: read dc/d28/f8c [1760713,43835] 0 2024-05-09T06:29:55.477 INFO:tasks.workunit.client.0.smithi062.stdout:4/450: rename d0/d3c/d4e to d0/d5b/d85 0 2024-05-09T06:29:55.480 INFO:tasks.workunit.client.0.smithi062.stdout:2/372: symlink d0/d9/d38/d41/d48/d5f/l70 0 2024-05-09T06:29:55.480 INFO:tasks.workunit.client.0.smithi062.stdout:2/373: fdatasync d0/d9/dd/f1c 0 2024-05-09T06:29:55.480 INFO:tasks.workunit.client.0.smithi062.stdout:2/374: write d0/d9/d38/d41/d53/f63 [435163,57092] 0 2024-05-09T06:29:55.482 INFO:tasks.workunit.client.0.smithi062.stdout:9/421: mknod d3/d3e/d52/d58/d1c/d1e/c8d 0 2024-05-09T06:29:55.489 INFO:tasks.workunit.client.0.smithi062.stdout:7/415: rename d0/d3a/d69/l6f to d0/d3a/d51/d64/d6d/l83 0 2024-05-09T06:29:55.490 INFO:tasks.workunit.client.0.smithi062.stdout:4/451: getdents d0/d2a/d14/d7e 0 2024-05-09T06:29:55.491 INFO:tasks.workunit.client.0.smithi062.stdout:9/422: rmdir d3/d3e/d52/d58/d77 39 2024-05-09T06:29:55.491 INFO:tasks.workunit.client.0.smithi062.stdout:9/423: fdatasync d3/d3e/d52/d58/d1c/d21/f24 0 2024-05-09T06:29:55.492 INFO:tasks.workunit.client.0.smithi062.stdout:9/424: readlink d3/d3e/d52/d58/d1c/l45 0 2024-05-09T06:29:55.495 INFO:tasks.workunit.client.0.smithi062.stdout:8/490: rename da/d11/d1c/f39 to da/d11/f9c 0 2024-05-09T06:29:55.495 INFO:tasks.workunit.client.0.smithi062.stdout:6/425: dwrite dc/f13 [0,4194304] 0 2024-05-09T06:29:55.496 INFO:tasks.workunit.client.0.smithi062.stdout:7/416: symlink d0/d12/d66/l84 0 2024-05-09T06:29:55.496 INFO:tasks.workunit.client.0.smithi062.stdout:7/417: truncate d0/d3a/d3f/f81 263137 0 2024-05-09T06:29:55.496 INFO:tasks.workunit.client.0.smithi062.stdout:7/418: write d0/d3a/d51/f6c [732871,30073] 0 2024-05-09T06:29:55.497 INFO:tasks.workunit.client.0.smithi062.stdout:4/452: rename d0/d2a/d84 to d0/d2a/d8/df/d86 0 2024-05-09T06:29:55.500 INFO:tasks.workunit.client.0.smithi062.stdout:6/426: symlink dc/d28/d10/d20/l92 0 2024-05-09T06:29:55.509 INFO:tasks.workunit.client.0.smithi062.stdout:7/419: getdents d0/d12/d66 0 2024-05-09T06:29:55.512 INFO:tasks.workunit.client.0.smithi062.stdout:8/491: write da/d11/d2e/d34/f7b [2786594,118359] 0 2024-05-09T06:29:55.513 INFO:tasks.workunit.client.0.smithi062.stdout:6/427: read dc/d28/f14 [1199020,38865] 0 2024-05-09T06:29:55.518 INFO:tasks.workunit.client.0.smithi062.stdout:4/453: dwrite d0/d2a/d8/df/d28/d31/f6f [0,4194304] 0 2024-05-09T06:29:55.531 INFO:tasks.workunit.client.0.smithi062.stdout:6/428: rmdir dc/d28/d34/d39 39 2024-05-09T06:29:55.531 INFO:tasks.workunit.client.0.smithi062.stdout:8/492: dwrite da/f13 [0,4194304] 0 2024-05-09T06:29:55.531 INFO:tasks.workunit.client.0.smithi062.stdout:8/493: chown da/d11/d2e/d34/l47 2 1 2024-05-09T06:29:55.531 INFO:tasks.workunit.client.0.smithi062.stdout:8/494: chown da/d11/d2e/d61/d64/c93 59163176 1 2024-05-09T06:29:55.532 INFO:tasks.workunit.client.0.smithi062.stdout:4/454: getdents d0/d3c 0 2024-05-09T06:29:55.541 INFO:tasks.workunit.client.0.smithi062.stdout:4/455: write d0/d2a/f5 [3958290,79711] 0 2024-05-09T06:29:55.546 INFO:tasks.workunit.client.0.smithi062.stdout:4/456: rename d0/d2a/d8/df/d28/d31/c7b to d0/d2a/c87 0 2024-05-09T06:29:55.549 INFO:tasks.workunit.client.0.smithi062.stdout:1/304: sync 2024-05-09T06:29:55.551 INFO:tasks.workunit.client.0.smithi062.stdout:1/305: mknod d8/d14/d2b/d3c/d44/d38/c67 0 2024-05-09T06:29:55.553 INFO:tasks.workunit.client.0.smithi062.stdout:8/495: dwrite da/d11/d2e/d61/d64/f88 [0,4194304] 0 2024-05-09T06:29:55.553 INFO:tasks.workunit.client.0.smithi062.stdout:6/429: dwrite dc/d42/f66 [0,4194304] 0 2024-05-09T06:29:55.553 INFO:tasks.workunit.client.0.smithi062.stdout:1/306: creat d8/d14/d2b/d3c/d44/d64/f68 x:0 0 0 2024-05-09T06:29:55.561 INFO:tasks.workunit.client.0.smithi062.stdout:6/430: mkdir dc/d28/d46/d3a/d7f/d91/d93 0 2024-05-09T06:29:55.563 INFO:tasks.workunit.client.0.smithi062.stdout:4/457: dwrite d0/d2a/f4 [0,4194304] 0 2024-05-09T06:29:55.563 INFO:tasks.workunit.client.0.smithi062.stdout:4/458: truncate d0/d2a/d8/df/d28/f62 1709791 0 2024-05-09T06:29:55.563 INFO:tasks.workunit.client.0.smithi062.stdout:4/459: write d0/f7f [71301,79469] 0 2024-05-09T06:29:55.564 INFO:tasks.workunit.client.0.smithi062.stdout:1/307: mknod d8/d1d/c69 0 2024-05-09T06:29:55.566 INFO:tasks.workunit.client.0.smithi062.stdout:6/431: link dc/d42/f67 dc/d28/d34/d4e/d57/f94 0 2024-05-09T06:29:55.566 INFO:tasks.workunit.client.0.smithi062.stdout:6/432: truncate dc/d28/d10/d20/f31 797784 0 2024-05-09T06:29:55.566 INFO:tasks.workunit.client.0.smithi062.stdout:6/433: chown dc/d28/f8c 3 1 2024-05-09T06:29:55.567 INFO:tasks.workunit.client.0.smithi062.stdout:6/434: write dc/d28/d10/d20/f31 [310596,851] 0 2024-05-09T06:29:55.567 INFO:tasks.workunit.client.0.smithi062.stdout:6/435: readlink dc/d28/d34/l49 0 2024-05-09T06:29:55.567 INFO:tasks.workunit.client.0.smithi062.stdout:6/436: write dc/d28/d46/d3a/f40 [1303819,118980] 0 2024-05-09T06:29:55.567 INFO:tasks.workunit.client.0.smithi062.stdout:6/437: chown dc/d28/d34/d41 2 1 2024-05-09T06:29:55.567 INFO:tasks.workunit.client.0.smithi062.stdout:6/438: fdatasync dc/d28/d34/f38 0 2024-05-09T06:29:55.571 INFO:tasks.workunit.client.0.smithi062.stdout:8/496: dwrite da/d11/d2e/d61/f63 [0,4194304] 0 2024-05-09T06:29:55.571 INFO:tasks.workunit.client.0.smithi062.stdout:8/497: readlink da/d11/d2e/d61/d92/l6a 0 2024-05-09T06:29:55.571 INFO:tasks.workunit.client.0.smithi062.stdout:8/498: chown da/d11/d2e/f4c 12703243 1 2024-05-09T06:29:55.571 INFO:tasks.workunit.client.0.smithi062.stdout:8/499: creat da/d11/d1c/f9d x:0 0 0 2024-05-09T06:29:55.574 INFO:tasks.workunit.client.0.smithi062.stdout:8/500: mkdir da/d11/d1c/d9e 0 2024-05-09T06:29:55.578 INFO:tasks.workunit.client.0.smithi062.stdout:6/439: read dc/d28/d10/d20/d5b/f6d [1853364,10226] 0 2024-05-09T06:29:55.580 INFO:tasks.workunit.client.0.smithi062.stdout:6/440: symlink dc/d28/d46/d3a/l95 0 2024-05-09T06:29:55.583 INFO:tasks.workunit.client.0.smithi062.stdout:8/501: dread da/f28 [0,4194304] 0 2024-05-09T06:29:55.583 INFO:tasks.workunit.client.0.smithi062.stdout:4/460: dwrite d0/d2a/d14/d4f/f60 [0,4194304] 0 2024-05-09T06:29:55.585 INFO:tasks.workunit.client.0.smithi062.stdout:8/502: truncate da/d11/d1c/f3e 3438316 0 2024-05-09T06:29:55.585 INFO:tasks.workunit.client.0.smithi062.stdout:8/503: getdents da/d11/d1c/d9e 0 2024-05-09T06:29:55.586 INFO:tasks.workunit.client.0.smithi062.stdout:8/504: write da/d11/d2e/f70 [361009,19870] 0 2024-05-09T06:29:55.586 INFO:tasks.workunit.client.0.smithi062.stdout:8/505: fdatasync f8 0 2024-05-09T06:29:55.586 INFO:tasks.workunit.client.0.smithi062.stdout:8/506: fdatasync da/f7a 0 2024-05-09T06:29:55.596 INFO:tasks.workunit.client.0.smithi062.stdout:6/441: dwrite dc/d28/d34/d4e/d57/f94 [0,4194304] 0 2024-05-09T06:29:55.596 INFO:tasks.workunit.client.0.smithi062.stdout:4/461: dread d0/d2a/d14/d4f/f60 [0,4194304] 0 2024-05-09T06:29:55.596 INFO:tasks.workunit.client.0.smithi062.stdout:4/462: truncate d0/d2a/d8/df/f44 8914925 0 2024-05-09T06:29:55.598 INFO:tasks.workunit.client.0.smithi062.stdout:8/507: dread da/d11/f1d [0,4194304] 0 2024-05-09T06:29:55.601 INFO:tasks.workunit.client.0.smithi062.stdout:6/442: mkdir dc/d28/d46/d3a/d7f/d91/d96 0 2024-05-09T06:29:55.601 INFO:tasks.workunit.client.0.smithi062.stdout:6/443: rename dc/d28 to dc/d28/d97 22 2024-05-09T06:29:55.601 INFO:tasks.workunit.client.0.smithi062.stdout:6/444: write dc/f17 [340303,124074] 0 2024-05-09T06:29:55.601 INFO:tasks.workunit.client.0.smithi062.stdout:6/445: fsync dc/d28/d34/d4e/d57/f75 0 2024-05-09T06:29:55.601 INFO:tasks.workunit.client.0.smithi062.stdout:4/463: dread d0/d2a/d8/df/f44 [0,4194304] 0 2024-05-09T06:29:55.601 INFO:tasks.workunit.client.0.smithi062.stdout:6/446: write dc/d28/d46/f64 [1392327,11128] 0 2024-05-09T06:29:55.601 INFO:tasks.workunit.client.0.smithi062.stdout:4/464: write d0/d2a/d4b/f79 [713749,23032] 0 2024-05-09T06:29:55.604 INFO:tasks.workunit.client.0.smithi062.stdout:6/447: mkdir dc/d28/d46/d82/d98 0 2024-05-09T06:29:55.604 INFO:tasks.workunit.client.0.smithi062.stdout:6/448: write dc/d28/d46/d3a/f4f [1217135,81472] 0 2024-05-09T06:29:55.606 INFO:tasks.workunit.client.0.smithi062.stdout:4/465: creat d0/d3c/f88 x:0 0 0 2024-05-09T06:29:55.606 INFO:tasks.workunit.client.0.smithi062.stdout:4/466: chown d0/d2a/d1f/d6c 2 1 2024-05-09T06:29:55.606 INFO:tasks.workunit.client.0.smithi062.stdout:4/467: creat d0/d2a/d4b/f89 x:0 0 0 2024-05-09T06:29:55.606 INFO:tasks.workunit.client.0.smithi062.stdout:8/508: dread da/f13 [0,4194304] 0 2024-05-09T06:29:55.607 INFO:tasks.workunit.client.0.smithi062.stdout:8/509: chown da/d11/d2e/d61/d92/l5a 1 1 2024-05-09T06:29:55.607 INFO:tasks.workunit.client.0.smithi062.stdout:6/449: mknod dc/d28/d46/d82/c99 0 2024-05-09T06:29:55.608 INFO:tasks.workunit.client.0.smithi062.stdout:6/450: dread dc/d28/d10/f35 [4194304,4194304] 0 2024-05-09T06:29:55.608 INFO:tasks.workunit.client.0.smithi062.stdout:8/510: mkdir da/d11/d1c/d9e/d9f 0 2024-05-09T06:29:55.609 INFO:tasks.workunit.client.0.smithi062.stdout:6/451: creat dc/d28/f9a x:0 0 0 2024-05-09T06:29:55.609 INFO:tasks.workunit.client.0.smithi062.stdout:6/452: write dc/d28/d46/d3a/f4f [4181913,23412] 0 2024-05-09T06:29:55.609 INFO:tasks.workunit.client.0.smithi062.stdout:4/468: dread d0/d2a/f5 [0,4194304] 0 2024-05-09T06:29:55.610 INFO:tasks.workunit.client.0.smithi062.stdout:8/511: mknod da/d95/ca0 0 2024-05-09T06:29:55.611 INFO:tasks.workunit.client.0.smithi062.stdout:6/453: fdatasync dc/f17 0 2024-05-09T06:29:55.612 INFO:tasks.workunit.client.0.smithi062.stdout:6/454: chown dc/d28/d34/f3d 0 1 2024-05-09T06:29:55.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/469: getdents d0/d2a/d8/df 0 2024-05-09T06:29:55.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/470: chown d0/d2a/f4 3 1 2024-05-09T06:29:55.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/471: dread - d0/d2a/d8/df/d28/f71 zero size 2024-05-09T06:29:55.615 INFO:tasks.workunit.client.0.smithi062.stdout:8/512: creat da/d85/d8a/fa1 x:0 0 0 2024-05-09T06:29:55.616 INFO:tasks.workunit.client.0.smithi062.stdout:8/513: dread - da/f82 zero size 2024-05-09T06:29:55.616 INFO:tasks.workunit.client.0.smithi062.stdout:8/514: write da/f13 [4932093,87661] 0 2024-05-09T06:29:55.616 INFO:tasks.workunit.client.0.smithi062.stdout:8/515: readlink da/d11/d2e/d34/l4b 0 2024-05-09T06:29:55.616 INFO:tasks.workunit.client.0.smithi062.stdout:6/455: unlink dc/f13 0 2024-05-09T06:29:55.616 INFO:tasks.workunit.client.0.smithi062.stdout:6/456: fdatasync dc/d28/d10/d20/f51 0 2024-05-09T06:29:55.658 INFO:tasks.workunit.client.0.smithi062.stdout:6/457: creat dc/d28/d46/d3a/d7f/d91/d93/f9b x:0 0 0 2024-05-09T06:29:55.660 INFO:tasks.workunit.client.0.smithi062.stdout:8/516: getdents da/d11/d1c 0 2024-05-09T06:29:55.673 INFO:tasks.workunit.client.0.smithi062.stdout:6/458: rmdir dc/d28/d46/d82 39 2024-05-09T06:29:55.681 INFO:tasks.workunit.client.0.smithi062.stdout:8/517: dwrite da/d11/f2d [0,4194304] 0 2024-05-09T06:29:55.682 INFO:tasks.workunit.client.0.smithi062.stdout:8/518: write da/d85/d8a/fa1 [305865,109954] 0 2024-05-09T06:29:55.687 INFO:tasks.workunit.client.0.smithi062.stdout:6/459: read f4 [2487985,37314] 0 2024-05-09T06:29:55.706 INFO:tasks.workunit.client.0.smithi062.stdout:8/519: dwrite f7 [0,4194304] 0 2024-05-09T06:29:55.706 INFO:tasks.workunit.client.0.smithi062.stdout:8/520: read da/d11/d2e/d34/f65 [432507,63624] 0 2024-05-09T06:29:55.706 INFO:tasks.workunit.client.0.smithi062.stdout:6/460: dwrite dc/d28/d34/d4e/f85 [0,4194304] 0 2024-05-09T06:29:55.706 INFO:tasks.workunit.client.0.smithi062.stdout:8/521: chown da/d11/f2d 3 1 2024-05-09T06:29:55.706 INFO:tasks.workunit.client.0.smithi062.stdout:6/461: chown dc/d28/d10/l1d 399 1 2024-05-09T06:29:55.707 INFO:tasks.workunit.client.0.smithi062.stdout:6/462: dread dc/d28/d34/f38 [0,4194304] 0 2024-05-09T06:29:55.709 INFO:tasks.workunit.client.0.smithi062.stdout:5/389: sync 2024-05-09T06:29:55.710 INFO:tasks.workunit.client.0.smithi062.stdout:3/337: sync 2024-05-09T06:29:55.710 INFO:tasks.workunit.client.0.smithi062.stdout:5/390: chown d0/d11/ld 0 1 2024-05-09T06:29:55.710 INFO:tasks.workunit.client.0.smithi062.stdout:3/338: dread - d1/d1e/d36/d4a/d51/f6b zero size 2024-05-09T06:29:55.717 INFO:tasks.workunit.client.0.smithi062.stdout:6/463: truncate dc/d28/d46/d3a/f4f 1996824 0 2024-05-09T06:29:55.718 INFO:tasks.workunit.client.0.smithi062.stdout:3/339: write d1/d1e/f10 [1209924,15036] 0 2024-05-09T06:29:55.721 INFO:tasks.workunit.client.0.smithi062.stdout:3/340: dread d1/d1e/d26/f69 [0,4194304] 0 2024-05-09T06:29:55.721 INFO:tasks.workunit.client.0.smithi062.stdout:3/341: fsync d1/d1e/f30 0 2024-05-09T06:29:55.725 INFO:tasks.workunit.client.0.smithi062.stdout:5/391: mknod d0/d8/c8d 0 2024-05-09T06:29:55.726 INFO:tasks.workunit.client.0.smithi062.stdout:5/392: dread d0/d8/d18/f5d [0,4194304] 0 2024-05-09T06:29:55.739 INFO:tasks.workunit.client.0.smithi062.stdout:6/464: rename dc/d28/d34/d4e/d57/f94 to dc/d28/d10/d20/d5b/d77/f9c 0 2024-05-09T06:29:55.742 INFO:tasks.workunit.client.0.smithi062.stdout:6/465: getdents dc 0 2024-05-09T06:29:55.761 INFO:tasks.workunit.client.0.smithi062.stdout:6/466: dwrite dc/d42/f67 [0,4194304] 0 2024-05-09T06:29:55.762 INFO:tasks.workunit.client.0.smithi062.stdout:6/467: symlink dc/d28/d46/d82/d98/l9d 0 2024-05-09T06:29:55.762 INFO:tasks.workunit.client.0.smithi062.stdout:6/468: creat dc/d28/d46/d4a/f9e x:0 0 0 2024-05-09T06:29:55.763 INFO:tasks.workunit.client.0.smithi062.stdout:6/469: truncate dc/f17 443595 0 2024-05-09T06:29:55.764 INFO:tasks.workunit.client.0.smithi062.stdout:6/470: symlink dc/d28/d46/d3a/d7f/d91/l9f 0 2024-05-09T06:29:55.766 INFO:tasks.workunit.client.0.smithi062.stdout:6/471: rename dc/d28/d46/d4a/l71 to dc/d28/d46/d81/la0 0 2024-05-09T06:29:55.766 INFO:tasks.workunit.client.0.smithi062.stdout:6/472: write f4 [173544,98806] 0 2024-05-09T06:29:55.766 INFO:tasks.workunit.client.0.smithi062.stdout:6/473: fsync dc/d28/d46/d3a/f4f 0 2024-05-09T06:29:55.777 INFO:tasks.workunit.client.0.smithi062.stdout:6/474: read dc/fd [1943481,96431] 0 2024-05-09T06:29:55.780 INFO:tasks.workunit.client.0.smithi062.stdout:6/475: link dc/d28/d34/l49 dc/d28/d46/d82/la1 0 2024-05-09T06:29:55.781 INFO:tasks.workunit.client.0.smithi062.stdout:5/393: dwrite d0/d8/d18/f78 [0,4194304] 0 2024-05-09T06:29:55.789 INFO:tasks.workunit.client.0.smithi062.stdout:5/394: symlink d0/d3b/l8e 0 2024-05-09T06:29:55.789 INFO:tasks.workunit.client.0.smithi062.stdout:5/395: dread - d0/d8/d1c/d2c/f85 zero size 2024-05-09T06:29:55.795 INFO:tasks.workunit.client.0.smithi062.stdout:5/396: unlink d0/d8/d1c/c2f 0 2024-05-09T06:29:55.795 INFO:tasks.workunit.client.0.smithi062.stdout:5/397: write d0/f79 [202274,18006] 0 2024-05-09T06:29:55.795 INFO:tasks.workunit.client.0.smithi062.stdout:5/398: fdatasync d0/d11/f83 0 2024-05-09T06:29:55.807 INFO:tasks.workunit.client.0.smithi062.stdout:6/476: dwrite dc/d28/d10/f35 [0,4194304] 0 2024-05-09T06:29:55.807 INFO:tasks.workunit.client.0.smithi062.stdout:6/477: write dc/d28/f22 [4776290,54805] 0 2024-05-09T06:29:55.807 INFO:tasks.workunit.client.0.smithi062.stdout:6/478: read dc/d28/d10/f86 [1992877,58919] 0 2024-05-09T06:29:55.807 INFO:tasks.workunit.client.0.smithi062.stdout:6/479: chown dc/d28/d46/d81 10 1 2024-05-09T06:29:55.807 INFO:tasks.workunit.client.0.smithi062.stdout:6/480: fdatasync dc/d28/d46/f64 0 2024-05-09T06:29:55.810 INFO:tasks.workunit.client.0.smithi062.stdout:5/399: write d0/d8/d1c/d2c/f80 [3570613,89445] 0 2024-05-09T06:29:55.810 INFO:tasks.workunit.client.0.smithi062.stdout:5/400: chown d0/d8 12 1 2024-05-09T06:29:55.815 INFO:tasks.workunit.client.0.smithi062.stdout:6/481: rename dc/d28/d46/d82/l8a to dc/d28/d46/d4a/la2 0 2024-05-09T06:29:55.815 INFO:tasks.workunit.client.0.smithi062.stdout:6/482: fdatasync dc/d28/d34/d4e/d57/f75 0 2024-05-09T06:29:55.822 INFO:tasks.workunit.client.0.smithi062.stdout:5/401: mknod d0/d8/d1c/c8f 0 2024-05-09T06:29:55.822 INFO:tasks.workunit.client.0.smithi062.stdout:5/402: write d0/f74 [240882,9593] 0 2024-05-09T06:29:55.822 INFO:tasks.workunit.client.0.smithi062.stdout:5/403: dread - d0/d11/f83 zero size 2024-05-09T06:29:55.823 INFO:tasks.workunit.client.0.smithi062.stdout:5/404: stat d0/d8/d1c/d23/d3e/l66 0 2024-05-09T06:29:55.823 INFO:tasks.workunit.client.0.smithi062.stdout:5/405: readlink d0/d56/d5/l26 0 2024-05-09T06:29:55.827 INFO:tasks.workunit.client.0.smithi062.stdout:5/406: truncate d0/d8/d1c/d23/d3e/f4d 3821000 0 2024-05-09T06:29:55.832 INFO:tasks.workunit.client.0.smithi062.stdout:5/407: rename d0/l35 to d0/d8/d18/l90 0 2024-05-09T06:29:55.832 INFO:tasks.workunit.client.0.smithi062.stdout:5/408: chown d0/d8/d1c/d2c/d7d/l43 2983818 1 2024-05-09T06:29:55.834 INFO:tasks.workunit.client.0.smithi062.stdout:5/409: mknod d0/d56/d86/c91 0 2024-05-09T06:29:55.834 INFO:tasks.workunit.client.0.smithi062.stdout:5/410: dread - d0/d56/d5/f7e zero size 2024-05-09T06:29:55.837 INFO:tasks.workunit.client.0.smithi062.stdout:6/483: dwrite dc/d28/d46/d3a/d7f/f90 [0,4194304] 0 2024-05-09T06:29:55.843 INFO:tasks.workunit.client.0.smithi062.stdout:5/411: dread d0/f79 [0,4194304] 0 2024-05-09T06:29:55.851 INFO:tasks.workunit.client.0.smithi062.stdout:5/412: mkdir d0/d56/d45/d92 0 2024-05-09T06:29:55.851 INFO:tasks.workunit.client.0.smithi062.stdout:5/413: readlink d0/d3b/d3f/l50 0 2024-05-09T06:29:55.874 INFO:tasks.workunit.client.0.smithi062.stdout:6/484: rmdir dc/d28/d34 39 2024-05-09T06:29:55.875 INFO:tasks.workunit.client.0.smithi062.stdout:5/414: dwrite d0/d8/f41 [0,4194304] 0 2024-05-09T06:29:55.876 INFO:tasks.workunit.client.0.smithi062.stdout:5/415: dread d0/d56/f6a [0,4194304] 0 2024-05-09T06:29:55.876 INFO:tasks.workunit.client.0.smithi062.stdout:5/416: truncate d0/d8/d1c/d2c/d7d/f72 543065 0 2024-05-09T06:29:55.876 INFO:tasks.workunit.client.0.smithi062.stdout:5/417: read d0/d8/d1c/d2c/d7d/f72 [68135,9352] 0 2024-05-09T06:29:55.876 INFO:tasks.workunit.client.0.smithi062.stdout:5/418: write d0/d8/d1c/d23/f48 [4117339,116568] 0 2024-05-09T06:29:55.877 INFO:tasks.workunit.client.0.smithi062.stdout:5/419: fdatasync d0/f37 0 2024-05-09T06:29:55.877 INFO:tasks.workunit.client.0.smithi062.stdout:0/342: sync 2024-05-09T06:29:55.877 INFO:tasks.workunit.client.0.smithi062.stdout:6/485: mkdir dc/d28/d10/d20/d5b/da3 0 2024-05-09T06:29:55.881 INFO:tasks.workunit.client.0.smithi062.stdout:5/420: creat d0/d8/d1c/d2c/d7d/d4a/f93 x:0 0 0 2024-05-09T06:29:55.882 INFO:tasks.workunit.client.0.smithi062.stdout:0/343: mknod d1/d25/d49/d3c/c7f 0 2024-05-09T06:29:55.885 INFO:tasks.workunit.client.0.smithi062.stdout:6/486: unlink dc/d28/d46/d81/la0 0 2024-05-09T06:29:55.887 INFO:tasks.workunit.client.0.smithi062.stdout:5/421: mknod d0/d11/c94 0 2024-05-09T06:29:55.887 INFO:tasks.workunit.client.0.smithi062.stdout:5/422: creat d0/d8/f95 x:0 0 0 2024-05-09T06:29:55.887 INFO:tasks.workunit.client.0.smithi062.stdout:5/423: chown d0/d8/d47/l81 61386759 1 2024-05-09T06:29:55.890 INFO:tasks.workunit.client.0.smithi062.stdout:6/487: mknod dc/d28/d10/d20/ca4 0 2024-05-09T06:29:55.890 INFO:tasks.workunit.client.0.smithi062.stdout:6/488: chown dc/d42/f66 12646 1 2024-05-09T06:29:55.893 INFO:tasks.workunit.client.0.smithi062.stdout:5/424: unlink d0/d3b/d3f/l54 0 2024-05-09T06:29:55.895 INFO:tasks.workunit.client.0.smithi062.stdout:5/425: truncate d0/d56/d5/f36 41551 0 2024-05-09T06:29:55.897 INFO:tasks.workunit.client.0.smithi062.stdout:5/426: mknod d0/d8/d1c/d2c/d7d/d4a/c96 0 2024-05-09T06:29:55.897 INFO:tasks.workunit.client.0.smithi062.stdout:5/427: write d0/d8/d1c/d2c/f80 [2416775,12769] 0 2024-05-09T06:29:55.900 INFO:tasks.workunit.client.0.smithi062.stdout:5/428: unlink d0/d8/d1c/d2c/d7d/c51 0 2024-05-09T06:29:55.901 INFO:tasks.workunit.client.0.smithi062.stdout:5/429: dread - d0/d11/f89 zero size 2024-05-09T06:29:55.901 INFO:tasks.workunit.client.0.smithi062.stdout:5/430: readlink d0/d11/l13 0 2024-05-09T06:29:55.939 INFO:tasks.workunit.client.0.smithi062.stdout:5/431: dwrite d0/d56/d5/f36 [0,4194304] 0 2024-05-09T06:29:55.965 INFO:tasks.workunit.client.0.smithi062.stdout:5/432: dwrite d0/d8/f52 [0,4194304] 0 2024-05-09T06:29:55.970 INFO:tasks.workunit.client.0.smithi062.stdout:5/433: link d0/d3b/f8b d0/f97 0 2024-05-09T06:29:55.970 INFO:tasks.workunit.client.0.smithi062.stdout:5/434: truncate d0/d3b/d3f/f70 115892 0 2024-05-09T06:29:55.973 INFO:tasks.workunit.client.0.smithi062.stdout:5/435: mknod d0/d8/d1c/d2c/d7d/d4a/c98 0 2024-05-09T06:29:56.042 INFO:tasks.workunit.client.0.smithi062.stdout:9/425: sync 2024-05-09T06:29:56.042 INFO:tasks.workunit.client.0.smithi062.stdout:2/375: sync 2024-05-09T06:29:56.045 INFO:tasks.workunit.client.0.smithi062.stdout:9/426: link d3/d3e/d52/d58/d1c/f76 d3/d3e/d52/d58/f8e 0 2024-05-09T06:29:56.045 INFO:tasks.workunit.client.0.smithi062.stdout:9/427: write d3/d3e/d52/d58/d1c/d21/f67 [483391,49906] 0 2024-05-09T06:29:56.048 INFO:tasks.workunit.client.0.smithi062.stdout:9/428: mknod d3/d3e/d52/d58/d1c/c8f 0 2024-05-09T06:29:56.048 INFO:tasks.workunit.client.0.smithi062.stdout:9/429: fsync d3/d3e/d52/d58/d1c/f87 0 2024-05-09T06:29:56.061 INFO:tasks.workunit.client.0.smithi062.stdout:2/376: dwrite d0/d9/d38/d41/d48/f4c [0,4194304] 0 2024-05-09T06:29:56.066 INFO:tasks.workunit.client.0.smithi062.stdout:2/377: dread d0/d9/d38/d41/d53/f63 [0,4194304] 0 2024-05-09T06:29:56.067 INFO:tasks.workunit.client.0.smithi062.stdout:2/378: rename d0/d9/d17/d37/d69/f6f to d0/d9/dd/d65/f71 0 2024-05-09T06:29:56.068 INFO:tasks.workunit.client.0.smithi062.stdout:9/430: dwrite d3/f84 [0,4194304] 0 2024-05-09T06:29:56.068 INFO:tasks.workunit.client.0.smithi062.stdout:2/379: getdents d0/d9/d17 0 2024-05-09T06:29:56.073 INFO:tasks.workunit.client.0.smithi062.stdout:9/431: link d3/d3e/d52/d58/c63 d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/c90 0 2024-05-09T06:29:56.073 INFO:tasks.workunit.client.0.smithi062.stdout:9/432: chown d3/d20 27601243 1 2024-05-09T06:29:56.074 INFO:tasks.workunit.client.0.smithi062.stdout:9/433: symlink d3/d3e/d52/d58/d1c/d1e/l91 0 2024-05-09T06:29:56.074 INFO:tasks.workunit.client.0.smithi062.stdout:9/434: fdatasync d3/f16 0 2024-05-09T06:29:56.077 INFO:tasks.workunit.client.0.smithi062.stdout:2/380: write d0/f30 [3927000,94317] 0 2024-05-09T06:29:56.079 INFO:tasks.workunit.client.0.smithi062.stdout:2/381: unlink d0/d9/dd/d65/d6d/f66 0 2024-05-09T06:29:56.081 INFO:tasks.workunit.client.0.smithi062.stdout:2/382: link d0/d9/dd/d65/d6d/d21/c50 d0/d9/c72 0 2024-05-09T06:29:56.087 INFO:tasks.workunit.client.0.smithi062.stdout:2/383: rmdir d0/d9/d38 39 2024-05-09T06:29:56.090 INFO:tasks.workunit.client.0.smithi062.stdout:2/384: creat d0/d9/d17/f73 x:0 0 0 2024-05-09T06:29:56.090 INFO:tasks.workunit.client.0.smithi062.stdout:2/385: write d0/f3a [3497369,85258] 0 2024-05-09T06:29:56.094 INFO:tasks.workunit.client.0.smithi062.stdout:9/435: dwrite d3/d3e/d52/d58/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:29:56.099 INFO:tasks.workunit.client.0.smithi062.stdout:9/436: rename d3/d20/d69 to d3/d3e/d52/d58/d77/d92 0 2024-05-09T06:29:56.107 INFO:tasks.workunit.client.0.smithi062.stdout:2/386: dwrite d0/d9/d38/d41/d53/f63 [0,4194304] 0 2024-05-09T06:29:56.116 INFO:tasks.workunit.client.0.smithi062.stdout:9/437: dwrite d3/d3e/d52/d58/d1c/d1e/d41/f4f [0,4194304] 0 2024-05-09T06:29:56.116 INFO:tasks.workunit.client.0.smithi062.stdout:9/438: stat d3/d3e/d52/d58 0 2024-05-09T06:29:56.116 INFO:tasks.workunit.client.0.smithi062.stdout:9/439: write d3/d3e/d52/d58/d1c/f6f [98559,61762] 0 2024-05-09T06:29:56.117 INFO:tasks.workunit.client.0.smithi062.stdout:9/440: read d3/d20/f7a [885776,61524] 0 2024-05-09T06:29:56.117 INFO:tasks.workunit.client.0.smithi062.stdout:9/441: unlink d3/d3e/d52/d58/d77/d92/f6e 0 2024-05-09T06:29:56.119 INFO:tasks.workunit.client.0.smithi062.stdout:9/442: creat d3/d3e/d7c/f93 x:0 0 0 2024-05-09T06:29:56.125 INFO:tasks.workunit.client.0.smithi062.stdout:2/387: dwrite d0/d9/dd/d65/d6d/f56 [0,4194304] 0 2024-05-09T06:29:56.126 INFO:tasks.workunit.client.0.smithi062.stdout:2/388: stat d0/f44 0 2024-05-09T06:29:56.126 INFO:tasks.workunit.client.0.smithi062.stdout:2/389: write d0/d9/d38/f6a [815795,126718] 0 2024-05-09T06:29:56.132 INFO:tasks.workunit.client.0.smithi062.stdout:9/443: dread d3/d3e/d52/d58/d1c/f76 [0,4194304] 0 2024-05-09T06:29:56.137 INFO:tasks.workunit.client.0.smithi062.stdout:2/390: dread d0/d9/d38/f60 [0,4194304] 0 2024-05-09T06:29:56.141 INFO:tasks.workunit.client.0.smithi062.stdout:9/444: mknod d3/d3e/d4b/c94 0 2024-05-09T06:29:56.141 INFO:tasks.workunit.client.0.smithi062.stdout:9/445: chown d3/d3e/d52/d58/f35 0 1 2024-05-09T06:29:56.146 INFO:tasks.workunit.client.0.smithi062.stdout:2/391: write d0/d9/dd/d65/d6d/d21/f28 [764302,49127] 0 2024-05-09T06:29:56.151 INFO:tasks.workunit.client.0.smithi062.stdout:9/446: dread d3/f3c [0,4194304] 0 2024-05-09T06:29:56.152 INFO:tasks.workunit.client.0.smithi062.stdout:9/447: chown d3/d20 12778053 1 2024-05-09T06:29:56.162 INFO:tasks.workunit.client.0.smithi062.stdout:2/392: truncate d0/d9/d17/f1d 3091529 0 2024-05-09T06:29:56.162 INFO:tasks.workunit.client.0.smithi062.stdout:9/448: rmdir d3/d3e 39 2024-05-09T06:29:56.165 INFO:tasks.workunit.client.0.smithi062.stdout:2/393: symlink d0/d9/dd/d65/d6d/d21/d29/d40/l74 0 2024-05-09T06:29:56.169 INFO:tasks.workunit.client.0.smithi062.stdout:2/394: creat d0/d9/dd/d65/d6d/d21/d29/d40/f75 x:0 0 0 2024-05-09T06:29:56.171 INFO:tasks.workunit.client.0.smithi062.stdout:9/449: symlink d3/d3e/d52/d58/d1c/d21/l95 0 2024-05-09T06:29:56.171 INFO:tasks.workunit.client.0.smithi062.stdout:9/450: truncate d3/d3e/d52/d58/d1c/d1e/f5b 445984 0 2024-05-09T06:29:56.174 INFO:tasks.workunit.client.0.smithi062.stdout:9/451: creat d3/d3e/d52/d58/d77/d92/f96 x:0 0 0 2024-05-09T06:29:56.184 INFO:tasks.workunit.client.0.smithi062.stdout:2/395: dwrite d0/d9/dd/d65/d6d/d21/f55 [0,4194304] 0 2024-05-09T06:29:56.185 INFO:tasks.workunit.client.0.smithi062.stdout:2/396: creat d0/d9/dd/d65/d6d/d21/d29/f76 x:0 0 0 2024-05-09T06:29:56.189 INFO:tasks.workunit.client.0.smithi062.stdout:2/397: dread d0/d9/d38/f6a [0,4194304] 0 2024-05-09T06:29:56.189 INFO:tasks.workunit.client.0.smithi062.stdout:2/398: write d0/d9/dd/f6c [206798,115460] 0 2024-05-09T06:29:56.190 INFO:tasks.workunit.client.0.smithi062.stdout:2/399: symlink d0/d9/dd/d65/d6d/d21/d29/d3d/d46/l77 0 2024-05-09T06:29:56.191 INFO:tasks.workunit.client.0.smithi062.stdout:2/400: link d0/d9/d17/f73 d0/f78 0 2024-05-09T06:29:56.192 INFO:tasks.workunit.client.0.smithi062.stdout:2/401: write d0/d9/dd/d65/d6d/f3b [5678145,102731] 0 2024-05-09T06:29:56.192 INFO:tasks.workunit.client.0.smithi062.stdout:2/402: creat d0/d9/dd/d65/d6d/d21/d29/d3d/f79 x:0 0 0 2024-05-09T06:29:56.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/452: dwrite d3/d3e/d52/d58/d1c/d1e/d60/f73 [0,4194304] 0 2024-05-09T06:29:56.197 INFO:tasks.workunit.client.0.smithi062.stdout:9/453: mknod d3/d3e/d52/c97 0 2024-05-09T06:29:56.205 INFO:tasks.workunit.client.0.smithi062.stdout:9/454: write d3/f84 [22032,107744] 0 2024-05-09T06:29:56.207 INFO:tasks.workunit.client.0.smithi062.stdout:7/420: sync 2024-05-09T06:29:56.207 INFO:tasks.workunit.client.0.smithi062.stdout:1/308: sync 2024-05-09T06:29:56.207 INFO:tasks.workunit.client.0.smithi062.stdout:1/309: dread - d8/f49 zero size 2024-05-09T06:29:56.207 INFO:tasks.workunit.client.0.smithi062.stdout:7/421: write d0/d12/d33/f3b [950417,127333] 0 2024-05-09T06:29:56.217 INFO:tasks.workunit.client.0.smithi062.stdout:9/455: link d3/d3e/d52/d58/d1c/f6f d3/f98 0 2024-05-09T06:29:56.217 INFO:tasks.workunit.client.0.smithi062.stdout:9/456: write d3/d3e/d52/d58/f71 [98151,28510] 0 2024-05-09T06:29:56.218 INFO:tasks.workunit.client.0.smithi062.stdout:9/457: write d3/d3e/d52/d58/d1c/d1e/f5f [2500319,36237] 0 2024-05-09T06:29:56.220 INFO:tasks.workunit.client.0.smithi062.stdout:9/458: getdents d3/d3e/d52/d58/d1c/d21 0 2024-05-09T06:29:56.231 INFO:tasks.workunit.client.0.smithi062.stdout:1/310: dwrite d8/d14/d2b/d3c/f46 [0,4194304] 0 2024-05-09T06:29:56.232 INFO:tasks.workunit.client.0.smithi062.stdout:7/422: dwrite d0/d3a/d51/d64/f82 [0,4194304] 0 2024-05-09T06:29:56.235 INFO:tasks.workunit.client.0.smithi062.stdout:1/311: symlink d8/d14/d2b/d3c/d44/l6a 0 2024-05-09T06:29:56.236 INFO:tasks.workunit.client.0.smithi062.stdout:9/459: dread d3/f84 [0,4194304] 0 2024-05-09T06:29:56.240 INFO:tasks.workunit.client.0.smithi062.stdout:7/423: symlink d0/d3a/d69/l85 0 2024-05-09T06:29:56.243 INFO:tasks.workunit.client.0.smithi062.stdout:1/312: creat d8/d14/d2b/d3c/f6b x:0 0 0 2024-05-09T06:29:56.246 INFO:tasks.workunit.client.0.smithi062.stdout:9/460: dread d3/d3e/d52/d58/d1c/d1e/d60/f73 [0,4194304] 0 2024-05-09T06:29:56.246 INFO:tasks.workunit.client.0.smithi062.stdout:9/461: stat d3/d3e/d52/d58/d1c/d1e/d60 0 2024-05-09T06:29:56.248 INFO:tasks.workunit.client.0.smithi062.stdout:1/313: unlink d8/d2c/f43 0 2024-05-09T06:29:56.250 INFO:tasks.workunit.client.0.smithi062.stdout:9/462: mkdir d3/d3e/d4b/d99 0 2024-05-09T06:29:56.250 INFO:tasks.workunit.client.0.smithi062.stdout:9/463: fdatasync d3/d3e/d52/d58/d1c/f6a 0 2024-05-09T06:29:56.251 INFO:tasks.workunit.client.0.smithi062.stdout:1/314: mknod d8/d14/d2b/d3c/d44/d4b/c6c 0 2024-05-09T06:29:56.256 INFO:tasks.workunit.client.0.smithi062.stdout:1/315: dread d8/f2a [0,4194304] 0 2024-05-09T06:29:56.256 INFO:tasks.workunit.client.0.smithi062.stdout:1/316: chown d8/c19 1 1 2024-05-09T06:29:56.256 INFO:tasks.workunit.client.0.smithi062.stdout:1/317: readlink d8/d14/d2b/d3d/d3e/l42 0 2024-05-09T06:29:56.256 INFO:tasks.workunit.client.0.smithi062.stdout:1/318: truncate d8/d14/d2b/d3c/d44/d64/f68 191483 0 2024-05-09T06:29:56.257 INFO:tasks.workunit.client.0.smithi062.stdout:1/319: read d8/d14/d2b/d3c/d44/d64/f68 [24167,36724] 0 2024-05-09T06:29:56.260 INFO:tasks.workunit.client.0.smithi062.stdout:1/320: dread d8/d14/d2b/f52 [0,4194304] 0 2024-05-09T06:29:56.260 INFO:tasks.workunit.client.0.smithi062.stdout:1/321: mknod d8/d1d/c6d 0 2024-05-09T06:29:56.269 INFO:tasks.workunit.client.0.smithi062.stdout:9/464: dwrite d3/d3e/d7c/f93 [0,4194304] 0 2024-05-09T06:29:56.271 INFO:tasks.workunit.client.0.smithi062.stdout:9/465: creat d3/d3e/d52/d58/d1c/d1e/d60/f9a x:0 0 0 2024-05-09T06:29:56.272 INFO:tasks.workunit.client.0.smithi062.stdout:9/466: write d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f78 [268374,1187] 0 2024-05-09T06:29:56.277 INFO:tasks.workunit.client.0.smithi062.stdout:1/322: dwrite d8/d14/d2b/f52 [0,4194304] 0 2024-05-09T06:29:56.280 INFO:tasks.workunit.client.0.smithi062.stdout:9/467: dread d3/f18 [0,4194304] 0 2024-05-09T06:29:56.280 INFO:tasks.workunit.client.0.smithi062.stdout:9/468: stat d3/d3e/d52/d58/d1c/f66 0 2024-05-09T06:29:56.282 INFO:tasks.workunit.client.0.smithi062.stdout:1/323: rename d8/d14/d2b/d3d/d3e to d8/d14/d2b/d3c/d44/d6e 0 2024-05-09T06:29:56.290 INFO:tasks.workunit.client.0.smithi062.stdout:1/324: dread d8/d2c/d41/f55 [0,4194304] 0 2024-05-09T06:29:56.290 INFO:tasks.workunit.client.0.smithi062.stdout:1/325: creat d8/d14/d2b/d3c/d44/d64/f6f x:0 0 0 2024-05-09T06:29:56.345 INFO:tasks.workunit.client.0.smithi062.stdout:8/522: sync 2024-05-09T06:29:56.346 INFO:tasks.workunit.client.0.smithi062.stdout:4/472: sync 2024-05-09T06:29:56.346 INFO:tasks.workunit.client.0.smithi062.stdout:4/473: chown d0/d2a/d14/d4f/f55 352633479 1 2024-05-09T06:29:56.350 INFO:tasks.workunit.client.0.smithi062.stdout:4/474: symlink d0/d2a/d14/l8a 0 2024-05-09T06:29:56.364 INFO:tasks.workunit.client.0.smithi062.stdout:8/523: dwrite da/d11/f1d [0,4194304] 0 2024-05-09T06:29:56.381 INFO:tasks.workunit.client.0.smithi062.stdout:8/524: dwrite da/d11/f29 [4194304,4194304] 0 2024-05-09T06:29:56.399 INFO:tasks.workunit.client.0.smithi062.stdout:8/525: dwrite da/d11/f26 [0,4194304] 0 2024-05-09T06:29:56.413 INFO:tasks.workunit.client.0.smithi062.stdout:8/526: write da/f5d [1863152,122101] 0 2024-05-09T06:29:56.413 INFO:tasks.workunit.client.0.smithi062.stdout:8/527: chown da/l10 8 1 2024-05-09T06:29:56.413 INFO:tasks.workunit.client.0.smithi062.stdout:8/528: write da/d11/d2e/d34/f7b [1958982,60031] 0 2024-05-09T06:29:56.413 INFO:tasks.workunit.client.0.smithi062.stdout:8/529: read - da/f7a zero size 2024-05-09T06:29:56.446 INFO:tasks.workunit.client.0.smithi062.stdout:8/530: creat da/d85/fa2 x:0 0 0 2024-05-09T06:29:56.458 INFO:tasks.workunit.client.0.smithi062.stdout:8/531: truncate da/d11/f23 230047 0 2024-05-09T06:29:56.458 INFO:tasks.workunit.client.0.smithi062.stdout:8/532: read - da/f82 zero size 2024-05-09T06:29:56.463 INFO:tasks.workunit.client.0.smithi062.stdout:8/533: link da/f57 da/d11/d2e/d34/d90/fa3 0 2024-05-09T06:29:56.467 INFO:tasks.workunit.client.0.smithi062.stdout:8/534: symlink da/d11/d2e/d61/d64/la4 0 2024-05-09T06:29:56.467 INFO:tasks.workunit.client.0.smithi062.stdout:8/535: fdatasync da/d11/f23 0 2024-05-09T06:29:56.475 INFO:tasks.workunit.client.0.smithi062.stdout:8/536: dread da/d11/d2e/d61/f63 [0,4194304] 0 2024-05-09T06:29:56.475 INFO:tasks.workunit.client.0.smithi062.stdout:8/537: fsync da/d11/f55 0 2024-05-09T06:29:56.475 INFO:tasks.workunit.client.0.smithi062.stdout:8/538: write da/d11/f58 [976460,17193] 0 2024-05-09T06:29:56.478 INFO:tasks.workunit.client.0.smithi062.stdout:8/539: mkdir da/d11/d2e/d61/d92/da5 0 2024-05-09T06:29:56.478 INFO:tasks.workunit.client.0.smithi062.stdout:8/540: fsync f7 0 2024-05-09T06:29:56.478 INFO:tasks.workunit.client.0.smithi062.stdout:8/541: fsync da/d11/d2e/d61/d64/f88 0 2024-05-09T06:29:56.485 INFO:tasks.workunit.client.0.smithi062.stdout:8/542: dread da/d11/f29 [4194304,4194304] 0 2024-05-09T06:29:56.487 INFO:tasks.workunit.client.0.smithi062.stdout:8/543: mknod da/d11/d2e/d61/d64/ca6 0 2024-05-09T06:29:56.487 INFO:tasks.workunit.client.0.smithi062.stdout:8/544: write da/d85/d8a/fa1 [450109,31114] 0 2024-05-09T06:29:56.487 INFO:tasks.workunit.client.0.smithi062.stdout:8/545: dread - da/d11/f89 zero size 2024-05-09T06:29:56.495 INFO:tasks.workunit.client.0.smithi062.stdout:8/546: write da/d11/f29 [3600638,70576] 0 2024-05-09T06:29:56.504 INFO:tasks.workunit.client.0.smithi062.stdout:8/547: write da/d11/d2e/d61/d64/f88 [1119609,107419] 0 2024-05-09T06:29:56.504 INFO:tasks.workunit.client.0.smithi062.stdout:8/548: chown da/d11/d1c/l42 8147934 1 2024-05-09T06:29:56.514 INFO:tasks.workunit.client.0.smithi062.stdout:8/549: write da/d11/f2d [1663806,114438] 0 2024-05-09T06:29:56.516 INFO:tasks.workunit.client.0.smithi062.stdout:6/489: sync 2024-05-09T06:29:56.516 INFO:tasks.workunit.client.0.smithi062.stdout:0/344: sync 2024-05-09T06:29:56.516 INFO:tasks.workunit.client.0.smithi062.stdout:3/342: sync 2024-05-09T06:29:56.516 INFO:tasks.workunit.client.0.smithi062.stdout:5/436: sync 2024-05-09T06:29:56.516 INFO:tasks.workunit.client.0.smithi062.stdout:6/490: chown dc/d28/d34/d39/f83 366062671 1 2024-05-09T06:29:56.516 INFO:tasks.workunit.client.0.smithi062.stdout:8/550: mkdir da/d11/d1c/d9e/d9f/da7 0 2024-05-09T06:29:56.517 INFO:tasks.workunit.client.0.smithi062.stdout:8/551: fsync da/d11/d2e/d34/f7b 0 2024-05-09T06:29:56.517 INFO:tasks.workunit.client.0.smithi062.stdout:8/552: dread - da/f7a zero size 2024-05-09T06:29:56.517 INFO:tasks.workunit.client.0.smithi062.stdout:5/437: unlink d0/d56/d5/f57 0 2024-05-09T06:29:56.519 INFO:tasks.workunit.client.0.smithi062.stdout:0/345: symlink d1/d25/d49/d42/d43/l80 0 2024-05-09T06:29:56.519 INFO:tasks.workunit.client.0.smithi062.stdout:0/346: dread - d1/d25/d31/d6c/f67 zero size 2024-05-09T06:29:56.519 INFO:tasks.workunit.client.0.smithi062.stdout:5/438: dread d0/f74 [0,4194304] 0 2024-05-09T06:29:56.520 INFO:tasks.workunit.client.0.smithi062.stdout:5/439: stat d0/d8/d1c/d23/d3e/l55 0 2024-05-09T06:29:56.520 INFO:tasks.workunit.client.0.smithi062.stdout:0/347: read d1/f51 [421929,122127] 0 2024-05-09T06:29:56.522 INFO:tasks.workunit.client.0.smithi062.stdout:6/491: symlink dc/d28/d46/d4a/d5d/d6f/d76/la5 0 2024-05-09T06:29:56.524 INFO:tasks.workunit.client.0.smithi062.stdout:3/343: creat d1/d1e/d26/d43/f78 x:0 0 0 2024-05-09T06:29:56.525 INFO:tasks.workunit.client.0.smithi062.stdout:8/553: mknod da/d11/d2e/ca8 0 2024-05-09T06:29:56.527 INFO:tasks.workunit.client.0.smithi062.stdout:6/492: creat dc/d28/d10/fa6 x:0 0 0 2024-05-09T06:29:56.527 INFO:tasks.workunit.client.0.smithi062.stdout:0/348: dread d1/d25/d31/f33 [0,4194304] 0 2024-05-09T06:29:56.527 INFO:tasks.workunit.client.0.smithi062.stdout:6/493: stat dc/d28/d46/d3a/d7f/f90 0 2024-05-09T06:29:56.527 INFO:tasks.workunit.client.0.smithi062.stdout:0/349: stat d1/d25/d49/d3c 0 2024-05-09T06:29:56.529 INFO:tasks.workunit.client.0.smithi062.stdout:3/344: rename d1/d1e/f30 to d1/d1e/d26/d33/f79 0 2024-05-09T06:29:56.531 INFO:tasks.workunit.client.0.smithi062.stdout:5/440: dread d0/d8/d1c/f25 [0,4194304] 0 2024-05-09T06:29:56.531 INFO:tasks.workunit.client.0.smithi062.stdout:5/441: rename d0/d11/d67 to d0/d11/d67/d99 22 2024-05-09T06:29:56.531 INFO:tasks.workunit.client.0.smithi062.stdout:0/350: mknod d1/d25/d49/d4f/d52/c81 0 2024-05-09T06:29:56.531 INFO:tasks.workunit.client.0.smithi062.stdout:0/351: fdatasync d1/d25/d49/d42/d43/f5e 0 2024-05-09T06:29:56.531 INFO:tasks.workunit.client.0.smithi062.stdout:0/352: chown d1/d6a 246 1 2024-05-09T06:29:56.531 INFO:tasks.workunit.client.0.smithi062.stdout:8/554: read da/f13 [1512780,89111] 0 2024-05-09T06:29:56.532 INFO:tasks.workunit.client.0.smithi062.stdout:6/494: creat dc/d28/d46/d3a/d7f/d91/fa7 x:0 0 0 2024-05-09T06:29:56.532 INFO:tasks.workunit.client.0.smithi062.stdout:6/495: write dc/d28/f8c [2224100,65683] 0 2024-05-09T06:29:56.533 INFO:tasks.workunit.client.0.smithi062.stdout:8/555: dread da/d11/d2e/f70 [0,4194304] 0 2024-05-09T06:29:56.535 INFO:tasks.workunit.client.0.smithi062.stdout:5/442: rename d0/d3b/d3f/l50 to d0/d8/d1c/d23/d42/l9a 0 2024-05-09T06:29:56.537 INFO:tasks.workunit.client.0.smithi062.stdout:0/353: symlink d1/d25/d31/d6c/d44/l82 0 2024-05-09T06:29:56.537 INFO:tasks.workunit.client.0.smithi062.stdout:0/354: write d1/d25/d49/d42/d5b/f70 [201451,107934] 0 2024-05-09T06:29:56.541 INFO:tasks.workunit.client.0.smithi062.stdout:6/496: link dc/d28/l15 dc/d28/d46/d3a/d7f/la8 0 2024-05-09T06:29:56.543 INFO:tasks.workunit.client.0.smithi062.stdout:8/556: creat da/d11/d2e/d7e/fa9 x:0 0 0 2024-05-09T06:29:56.552 INFO:tasks.workunit.client.0.smithi062.stdout:3/345: rmdir d1/d1e/d36 39 2024-05-09T06:29:56.552 INFO:tasks.workunit.client.0.smithi062.stdout:3/346: fsync d1/f46 0 2024-05-09T06:29:56.555 INFO:tasks.workunit.client.0.smithi062.stdout:5/443: creat d0/d56/d45/d92/f9b x:0 0 0 2024-05-09T06:29:56.558 INFO:tasks.workunit.client.0.smithi062.stdout:0/355: creat d1/d25/d49/d4f/d52/f83 x:0 0 0 2024-05-09T06:29:56.558 INFO:tasks.workunit.client.0.smithi062.stdout:0/356: truncate d1/d18/f34 304256 0 2024-05-09T06:29:56.559 INFO:tasks.workunit.client.0.smithi062.stdout:0/357: chown d1/d25/d49/d42/d5b/f78 503154 1 2024-05-09T06:29:56.563 INFO:tasks.workunit.client.0.smithi062.stdout:6/497: creat dc/d28/d34/d41/fa9 x:0 0 0 2024-05-09T06:29:56.566 INFO:tasks.workunit.client.0.smithi062.stdout:8/557: mkdir da/d11/d2e/daa 0 2024-05-09T06:29:56.568 INFO:tasks.workunit.client.0.smithi062.stdout:3/347: symlink d1/d1e/d3b/l7a 0 2024-05-09T06:29:56.568 INFO:tasks.workunit.client.0.smithi062.stdout:3/348: chown d1/d1e/d3b 106851 1 2024-05-09T06:29:56.568 INFO:tasks.workunit.client.0.smithi062.stdout:3/349: chown d1/d1e/c32 26 1 2024-05-09T06:29:56.574 INFO:tasks.workunit.client.0.smithi062.stdout:5/444: creat d0/f9c x:0 0 0 2024-05-09T06:29:56.584 INFO:tasks.workunit.client.0.smithi062.stdout:5/445: write d0/d8/d1c/d2c/f7a [1747287,53505] 0 2024-05-09T06:29:56.585 INFO:tasks.workunit.client.0.smithi062.stdout:0/358: mkdir d1/d25/d31/d6c/d44/d57/d84 0 2024-05-09T06:29:56.585 INFO:tasks.workunit.client.0.smithi062.stdout:5/446: dread d0/f74 [0,4194304] 0 2024-05-09T06:29:56.585 INFO:tasks.workunit.client.0.smithi062.stdout:5/447: chown d0/d8/d1c/f32 210514 1 2024-05-09T06:29:56.586 INFO:tasks.workunit.client.0.smithi062.stdout:2/403: sync 2024-05-09T06:29:56.587 INFO:tasks.workunit.client.0.smithi062.stdout:6/498: creat dc/d28/d46/d82/d98/faa x:0 0 0 2024-05-09T06:29:56.592 INFO:tasks.workunit.client.0.smithi062.stdout:3/350: rename d1/d1e/d36/d4a/f66 to d1/d2d/f7b 0 2024-05-09T06:29:56.593 INFO:tasks.workunit.client.0.smithi062.stdout:3/351: read - d1/d1e/d26/f56 zero size 2024-05-09T06:29:56.596 INFO:tasks.workunit.client.0.smithi062.stdout:0/359: mknod d1/d25/d49/d4f/d52/d7b/c85 0 2024-05-09T06:29:56.596 INFO:tasks.workunit.client.0.smithi062.stdout:9/469: sync 2024-05-09T06:29:56.596 INFO:tasks.workunit.client.0.smithi062.stdout:4/475: sync 2024-05-09T06:29:56.596 INFO:tasks.workunit.client.0.smithi062.stdout:1/326: sync 2024-05-09T06:29:56.597 INFO:tasks.workunit.client.0.smithi062.stdout:7/424: sync 2024-05-09T06:29:56.597 INFO:tasks.workunit.client.0.smithi062.stdout:7/425: stat d0/d3a/d51/f6c 0 2024-05-09T06:29:56.597 INFO:tasks.workunit.client.0.smithi062.stdout:7/426: write d0/d12/d33/f3b [1516934,62744] 0 2024-05-09T06:29:56.598 INFO:tasks.workunit.client.0.smithi062.stdout:6/499: mkdir dc/d28/d46/d82/dab 0 2024-05-09T06:29:56.598 INFO:tasks.workunit.client.0.smithi062.stdout:6/500: truncate dc/d28/d34/f59 547751 0 2024-05-09T06:29:56.602 INFO:tasks.workunit.client.0.smithi062.stdout:3/352: rename d1/d1e/d3b/l7a to d1/d1e/d26/d33/d4f/l7c 0 2024-05-09T06:29:56.607 INFO:tasks.workunit.client.0.smithi062.stdout:5/448: dwrite d0/d8/d18/f5d [0,4194304] 0 2024-05-09T06:29:56.607 INFO:tasks.workunit.client.0.smithi062.stdout:4/476: creat d0/d2a/d8/d69/f8b x:0 0 0 2024-05-09T06:29:56.608 INFO:tasks.workunit.client.0.smithi062.stdout:6/501: mknod dc/d28/d34/d4e/d78/cac 0 2024-05-09T06:29:56.609 INFO:tasks.workunit.client.0.smithi062.stdout:6/502: write dc/d28/d46/d4a/d5d/d6f/d76/f87 [830570,82606] 0 2024-05-09T06:29:56.611 INFO:tasks.workunit.client.0.smithi062.stdout:3/353: mknod d1/d1e/d26/d33/d4f/c7d 0 2024-05-09T06:29:56.614 INFO:tasks.workunit.client.0.smithi062.stdout:7/427: rename d0/d3/l27 to d0/d3a/l86 0 2024-05-09T06:29:56.619 INFO:tasks.workunit.client.0.smithi062.stdout:5/449: mkdir d0/d8/d1c/d2c/d7d/d4a/d9d 0 2024-05-09T06:29:56.619 INFO:tasks.workunit.client.0.smithi062.stdout:4/477: getdents d0/d5b 0 2024-05-09T06:29:56.619 INFO:tasks.workunit.client.0.smithi062.stdout:4/478: write d0/d9/f72 [873411,122891] 0 2024-05-09T06:29:56.621 INFO:tasks.workunit.client.0.smithi062.stdout:4/479: dread d0/f7f [0,4194304] 0 2024-05-09T06:29:56.621 INFO:tasks.workunit.client.0.smithi062.stdout:1/327: dwrite d8/d1d/f26 [0,4194304] 0 2024-05-09T06:29:56.623 INFO:tasks.workunit.client.0.smithi062.stdout:9/470: dwrite d3/d3e/d52/d58/d1c/d1e/d41/f4f [0,4194304] 0 2024-05-09T06:29:56.623 INFO:tasks.workunit.client.0.smithi062.stdout:9/471: chown d3/d3e/d52/d58/d1c/c44 197793949 1 2024-05-09T06:29:56.623 INFO:tasks.workunit.client.0.smithi062.stdout:9/472: fsync d3/d3e/d52/d58/d1c/f5e 0 2024-05-09T06:29:56.624 INFO:tasks.workunit.client.0.smithi062.stdout:6/503: mkdir dc/d28/d46/d81/dad 0 2024-05-09T06:29:56.626 INFO:tasks.workunit.client.0.smithi062.stdout:0/360: getdents d1/d25/d31/d6c/d44/d57 0 2024-05-09T06:29:56.627 INFO:tasks.workunit.client.0.smithi062.stdout:3/354: symlink d1/d1e/d36/d6c/l7e 0 2024-05-09T06:29:56.627 INFO:tasks.workunit.client.0.smithi062.stdout:3/355: fdatasync d1/d1e/d36/d3a/d4e/f76 0 2024-05-09T06:29:56.628 INFO:tasks.workunit.client.0.smithi062.stdout:5/450: rmdir d0/d11/d67 39 2024-05-09T06:29:56.636 INFO:tasks.workunit.client.0.smithi062.stdout:4/480: dread d0/d2a/f4 [0,4194304] 0 2024-05-09T06:29:56.639 INFO:tasks.workunit.client.0.smithi062.stdout:6/504: write dc/d28/d46/d3a/f3e [2969130,86492] 0 2024-05-09T06:29:56.643 INFO:tasks.workunit.client.0.smithi062.stdout:7/428: dwrite d0/d3a/d3f/f81 [0,4194304] 0 2024-05-09T06:29:56.643 INFO:tasks.workunit.client.0.smithi062.stdout:7/429: write d0/d3a/d3f/f5a [1063720,40194] 0 2024-05-09T06:29:56.644 INFO:tasks.workunit.client.0.smithi062.stdout:3/356: mknod d1/d1e/d54/c7f 0 2024-05-09T06:29:56.644 INFO:tasks.workunit.client.0.smithi062.stdout:3/357: chown d1/d1e/d36/d3a/f67 55938 1 2024-05-09T06:29:56.644 INFO:tasks.workunit.client.0.smithi062.stdout:3/358: chown d1/d1e/d26/d33/d4f 793527 1 2024-05-09T06:29:56.644 INFO:tasks.workunit.client.0.smithi062.stdout:3/359: stat d1/d1e/d26/d43 0 2024-05-09T06:29:56.645 INFO:tasks.workunit.client.0.smithi062.stdout:5/451: getdents d0/d8/d47 0 2024-05-09T06:29:56.650 INFO:tasks.workunit.client.0.smithi062.stdout:1/328: dwrite d8/d14/d2b/f52 [0,4194304] 0 2024-05-09T06:29:56.650 INFO:tasks.workunit.client.0.smithi062.stdout:1/329: stat d8/d14/d2b/d3c/d44/f4a 0 2024-05-09T06:29:56.651 INFO:tasks.workunit.client.0.smithi062.stdout:9/473: dwrite d3/d3e/d7c/f93 [4194304,4194304] 0 2024-05-09T06:29:56.655 INFO:tasks.workunit.client.0.smithi062.stdout:3/360: read d1/f27 [3208764,116279] 0 2024-05-09T06:29:56.656 INFO:tasks.workunit.client.0.smithi062.stdout:5/452: stat d0/d8/d18/l90 0 2024-05-09T06:29:56.660 INFO:tasks.workunit.client.0.smithi062.stdout:4/481: symlink d0/d9/l8c 0 2024-05-09T06:29:56.660 INFO:tasks.workunit.client.0.smithi062.stdout:3/361: dread d1/f27 [0,4194304] 0 2024-05-09T06:29:56.661 INFO:tasks.workunit.client.0.smithi062.stdout:3/362: write d1/d1e/f24 [2719910,62090] 0 2024-05-09T06:29:56.661 INFO:tasks.workunit.client.0.smithi062.stdout:3/363: write d1/d1e/d26/d43/d52/f53 [1176268,34732] 0 2024-05-09T06:29:56.663 INFO:tasks.workunit.client.0.smithi062.stdout:0/361: dwrite d1/d25/d31/f3b [0,4194304] 0 2024-05-09T06:29:56.664 INFO:tasks.workunit.client.0.smithi062.stdout:0/362: chown d1/d25/d49/d42/d43/l71 0 1 2024-05-09T06:29:56.668 INFO:tasks.workunit.client.0.smithi062.stdout:9/474: getdents d3/d3e/d4b 0 2024-05-09T06:29:56.668 INFO:tasks.workunit.client.0.smithi062.stdout:9/475: read - d3/d3e/d52/d58/d1c/d1e/f4c zero size 2024-05-09T06:29:56.673 INFO:tasks.workunit.client.0.smithi062.stdout:3/364: unlink d1/la 0 2024-05-09T06:29:56.674 INFO:tasks.workunit.client.0.smithi062.stdout:5/453: dread d0/d8/d18/f5d [0,4194304] 0 2024-05-09T06:29:56.674 INFO:tasks.workunit.client.0.smithi062.stdout:1/330: getdents d8/d14/d2b/d3c 0 2024-05-09T06:29:56.675 INFO:tasks.workunit.client.0.smithi062.stdout:6/505: dwrite dc/d28/d46/d3a/f4f [0,4194304] 0 2024-05-09T06:29:56.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/430: dwrite d0/f8 [0,4194304] 0 2024-05-09T06:29:56.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/431: truncate d0/f76 398688 0 2024-05-09T06:29:56.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/432: write d0/d3a/f7b [237975,2808] 0 2024-05-09T06:29:56.679 INFO:tasks.workunit.client.0.smithi062.stdout:0/363: creat d1/d25/f86 x:0 0 0 2024-05-09T06:29:56.685 INFO:tasks.workunit.client.0.smithi062.stdout:9/476: unlink d3/d3e/d52/d58/d1c/d1e/d41/d64/f2c 0 2024-05-09T06:29:56.685 INFO:tasks.workunit.client.0.smithi062.stdout:9/477: readlink d3/d3e/d52/d58/l4d 0 2024-05-09T06:29:56.685 INFO:tasks.workunit.client.0.smithi062.stdout:9/478: readlink d3/d3e/d4b/l3d 0 2024-05-09T06:29:56.685 INFO:tasks.workunit.client.0.smithi062.stdout:9/479: truncate d3/d3e/f89 310769 0 2024-05-09T06:29:56.686 INFO:tasks.workunit.client.0.smithi062.stdout:0/364: dread d1/d25/d31/f3b [0,4194304] 0 2024-05-09T06:29:56.687 INFO:tasks.workunit.client.0.smithi062.stdout:4/482: mkdir d0/d9/d8d 0 2024-05-09T06:29:56.690 INFO:tasks.workunit.client.0.smithi062.stdout:3/365: symlink d1/d1e/d36/d4a/d51/l80 0 2024-05-09T06:29:56.696 INFO:tasks.workunit.client.0.smithi062.stdout:5/454: creat d0/d56/f9e x:0 0 0 2024-05-09T06:29:56.697 INFO:tasks.workunit.client.0.smithi062.stdout:5/455: dread d0/f74 [0,4194304] 0 2024-05-09T06:29:56.702 INFO:tasks.workunit.client.0.smithi062.stdout:7/433: creat d0/d3a/f87 x:0 0 0 2024-05-09T06:29:56.710 INFO:tasks.workunit.client.0.smithi062.stdout:0/365: dwrite d1/d25/d59/f69 [0,4194304] 0 2024-05-09T06:29:56.710 INFO:tasks.workunit.client.0.smithi062.stdout:4/483: dwrite d0/d2a/d1f/d6c/f83 [0,4194304] 0 2024-05-09T06:29:56.711 INFO:tasks.workunit.client.0.smithi062.stdout:9/480: symlink d3/d3e/d52/d58/d1c/d1e/d41/l9b 0 2024-05-09T06:29:56.711 INFO:tasks.workunit.client.0.smithi062.stdout:4/484: dread d0/d2a/d14/d7e/f7c [0,4194304] 0 2024-05-09T06:29:56.712 INFO:tasks.workunit.client.0.smithi062.stdout:3/366: mkdir d1/d1e/d26/d43/d52/d81 0 2024-05-09T06:29:56.712 INFO:tasks.workunit.client.0.smithi062.stdout:3/367: fdatasync d1/f46 0 2024-05-09T06:29:56.721 INFO:tasks.workunit.client.0.smithi062.stdout:0/366: dread d1/d25/d31/d6c/d44/f63 [0,4194304] 0 2024-05-09T06:29:56.723 INFO:tasks.workunit.client.0.smithi062.stdout:5/456: rename d0/d8/d1c/d2c/d7d/f72 to d0/d11/d67/f9f 0 2024-05-09T06:29:56.725 INFO:tasks.workunit.client.0.smithi062.stdout:7/434: mkdir d0/d3a/d51/d64/d6d/d88 0 2024-05-09T06:29:56.735 INFO:tasks.workunit.client.0.smithi062.stdout:4/485: mkdir d0/d2a/d14/d7e/d8e 0 2024-05-09T06:29:56.736 INFO:tasks.workunit.client.0.smithi062.stdout:4/486: dread d0/f7f [0,4194304] 0 2024-05-09T06:29:56.736 INFO:tasks.workunit.client.0.smithi062.stdout:4/487: fsync d0/d2a/d14/f26 0 2024-05-09T06:29:56.738 INFO:tasks.workunit.client.0.smithi062.stdout:7/435: mknod d0/d12/c89 0 2024-05-09T06:29:56.740 INFO:tasks.workunit.client.0.smithi062.stdout:4/488: creat d0/d2a/f8f x:0 0 0 2024-05-09T06:29:56.741 INFO:tasks.workunit.client.0.smithi062.stdout:7/436: creat d0/d3a/d51/d64/d6d/d88/f8a x:0 0 0 2024-05-09T06:29:56.743 INFO:tasks.workunit.client.0.smithi062.stdout:4/489: unlink d0/d2a/d14/d4f/f56 0 2024-05-09T06:29:56.743 INFO:tasks.workunit.client.0.smithi062.stdout:4/490: creat d0/d2a/d14/d4f/f90 x:0 0 0 2024-05-09T06:29:56.744 INFO:tasks.workunit.client.0.smithi062.stdout:5/457: dread d0/d56/d5/f36 [0,4194304] 0 2024-05-09T06:29:56.746 INFO:tasks.workunit.client.0.smithi062.stdout:5/458: unlink d0/d56/d5/c59 0 2024-05-09T06:29:56.749 INFO:tasks.workunit.client.0.smithi062.stdout:9/481: dwrite d3/d3e/f89 [0,4194304] 0 2024-05-09T06:29:56.750 INFO:tasks.workunit.client.0.smithi062.stdout:0/367: dwrite d1/d25/d31/d6c/d44/d57/f64 [0,4194304] 0 2024-05-09T06:29:56.750 INFO:tasks.workunit.client.0.smithi062.stdout:3/368: dwrite d1/d1e/d26/d33/f79 [0,4194304] 0 2024-05-09T06:29:56.750 INFO:tasks.workunit.client.0.smithi062.stdout:3/369: write d1/f1c [399544,121401] 0 2024-05-09T06:29:56.753 INFO:tasks.workunit.client.0.smithi062.stdout:5/459: dread d0/d8/d18/f5d [0,4194304] 0 2024-05-09T06:29:56.754 INFO:tasks.workunit.client.0.smithi062.stdout:9/482: creat d3/d3e/d7c/f9c x:0 0 0 2024-05-09T06:29:56.760 INFO:tasks.workunit.client.0.smithi062.stdout:3/370: read d1/f1f [2461466,32994] 0 2024-05-09T06:29:56.764 INFO:tasks.workunit.client.0.smithi062.stdout:0/368: dread d1/d25/d31/d6c/d44/d57/f64 [0,4194304] 0 2024-05-09T06:29:56.765 INFO:tasks.workunit.client.0.smithi062.stdout:5/460: link d0/d56/d5/c77 d0/ca0 0 2024-05-09T06:29:56.765 INFO:tasks.workunit.client.0.smithi062.stdout:5/461: write d0/d56/d45/f75 [4574919,62416] 0 2024-05-09T06:29:56.767 INFO:tasks.workunit.client.0.smithi062.stdout:7/437: dwrite d0/d3a/f87 [0,4194304] 0 2024-05-09T06:29:56.770 INFO:tasks.workunit.client.0.smithi062.stdout:3/371: link d1/d1e/d36/d3a/d4e/l5a d1/d1e/d26/d33/d4f/l82 0 2024-05-09T06:29:56.770 INFO:tasks.workunit.client.0.smithi062.stdout:3/372: chown d1/d1e/d3b/l3d 223 1 2024-05-09T06:29:56.770 INFO:tasks.workunit.client.0.smithi062.stdout:4/491: dwrite d0/d2a/f25 [4194304,4194304] 0 2024-05-09T06:29:56.780 INFO:tasks.workunit.client.0.smithi062.stdout:7/438: link d0/d12/d33/f55 d0/d3a/d51/d64/d6d/d88/f8b 0 2024-05-09T06:29:56.780 INFO:tasks.workunit.client.0.smithi062.stdout:7/439: chown d0/d12/d33/d67/f6b 7430245 1 2024-05-09T06:29:56.780 INFO:tasks.workunit.client.0.smithi062.stdout:7/440: write d0/d12/f24 [920020,27433] 0 2024-05-09T06:29:56.785 INFO:tasks.workunit.client.0.smithi062.stdout:3/373: mkdir d1/d1e/d3b/d83 0 2024-05-09T06:29:56.788 INFO:tasks.workunit.client.0.smithi062.stdout:0/369: dwrite d1/f24 [0,4194304] 0 2024-05-09T06:29:56.788 INFO:tasks.workunit.client.0.smithi062.stdout:5/462: dwrite d0/d11/f89 [0,4194304] 0 2024-05-09T06:29:56.788 INFO:tasks.workunit.client.0.smithi062.stdout:5/463: chown d0/d56/d45/f75 9831369 1 2024-05-09T06:29:56.790 INFO:tasks.workunit.client.0.smithi062.stdout:4/492: creat d0/d9/d8d/f91 x:0 0 0 2024-05-09T06:29:56.792 INFO:tasks.workunit.client.0.smithi062.stdout:4/493: write d0/d2a/d8/f50 [4245134,94147] 0 2024-05-09T06:29:56.792 INFO:tasks.workunit.client.0.smithi062.stdout:4/494: write d0/d2a/d8/df/d28/f62 [2756383,124820] 0 2024-05-09T06:29:56.808 INFO:tasks.workunit.client.0.smithi062.stdout:3/374: dwrite d1/d1e/d36/d3a/d4e/f70 [0,4194304] 0 2024-05-09T06:29:56.808 INFO:tasks.workunit.client.0.smithi062.stdout:3/375: creat d1/d1e/d26/f84 x:0 0 0 2024-05-09T06:29:56.808 INFO:tasks.workunit.client.0.smithi062.stdout:3/376: fdatasync d1/d1e/f10 0 2024-05-09T06:29:56.809 INFO:tasks.workunit.client.0.smithi062.stdout:0/370: dwrite d1/d25/d49/d4f/d52/f83 [0,4194304] 0 2024-05-09T06:29:56.810 INFO:tasks.workunit.client.0.smithi062.stdout:0/371: read - d1/d25/d49/d42/d43/f7d zero size 2024-05-09T06:29:56.810 INFO:tasks.workunit.client.0.smithi062.stdout:0/372: chown d1/d25/f86 1 1 2024-05-09T06:29:56.812 INFO:tasks.workunit.client.0.smithi062.stdout:7/441: mknod d0/d12/d33/c8c 0 2024-05-09T06:29:56.812 INFO:tasks.workunit.client.0.smithi062.stdout:7/442: readlink d0/d3a/d51/d64/d6d/l83 0 2024-05-09T06:29:56.821 INFO:tasks.workunit.client.0.smithi062.stdout:5/464: truncate d0/d8/d1c/f25 4653895 0 2024-05-09T06:29:56.821 INFO:tasks.workunit.client.0.smithi062.stdout:5/465: write d0/d8/d1c/d23/f4f [4551975,63343] 0 2024-05-09T06:29:56.821 INFO:tasks.workunit.client.0.smithi062.stdout:5/466: write d0/d8/d1c/d23/f5b [1033356,118585] 0 2024-05-09T06:29:56.825 INFO:tasks.workunit.client.0.smithi062.stdout:4/495: truncate d0/d2a/d14/d4f/f60 1244882 0 2024-05-09T06:29:56.825 INFO:tasks.workunit.client.0.smithi062.stdout:4/496: dread - d0/d2a/d8/df/d28/f71 zero size 2024-05-09T06:29:56.825 INFO:tasks.workunit.client.0.smithi062.stdout:4/497: truncate d0/d2a/d8/df/d28/f71 812798 0 2024-05-09T06:29:56.825 INFO:tasks.workunit.client.0.smithi062.stdout:4/498: truncate d0/f46 4240951 0 2024-05-09T06:29:56.829 INFO:tasks.workunit.client.0.smithi062.stdout:8/558: sync 2024-05-09T06:29:56.835 INFO:tasks.workunit.client.0.smithi062.stdout:3/377: unlink d1/l7 0 2024-05-09T06:29:56.846 INFO:tasks.workunit.client.0.smithi062.stdout:7/443: creat d0/f8d x:0 0 0 2024-05-09T06:29:56.854 INFO:tasks.workunit.client.0.smithi062.stdout:4/499: mknod d0/d2a/d14/d7e/c92 0 2024-05-09T06:29:56.854 INFO:tasks.workunit.client.0.smithi062.stdout:4/500: fsync d0/d2a/d8/f50 0 2024-05-09T06:29:56.854 INFO:tasks.workunit.client.0.smithi062.stdout:3/378: getdents d1/d1e/d36/d3a/d4e 0 2024-05-09T06:29:56.863 INFO:tasks.workunit.client.0.smithi062.stdout:4/501: unlink d0/d2a/d8/f47 0 2024-05-09T06:29:56.865 INFO:tasks.workunit.client.0.smithi062.stdout:0/373: rename d1/d25/d49/d42/d5b to d1/d25/d49/d4f/d52/d87 0 2024-05-09T06:29:56.873 INFO:tasks.workunit.client.0.smithi062.stdout:7/444: unlink d0/f1b 0 2024-05-09T06:29:56.873 INFO:tasks.workunit.client.0.smithi062.stdout:7/445: write d0/d3a/d51/d64/d6d/d88/f8a [411348,6621] 0 2024-05-09T06:29:56.873 INFO:tasks.workunit.client.0.smithi062.stdout:7/446: fsync d0/d12/f5d 0 2024-05-09T06:29:56.873 INFO:tasks.workunit.client.0.smithi062.stdout:7/447: chown d0 32555 1 2024-05-09T06:29:56.875 INFO:tasks.workunit.client.0.smithi062.stdout:8/559: rename da/d11/d2e/f4c to da/d11/d2e/d61/d92/da5/fab 0 2024-05-09T06:29:56.875 INFO:tasks.workunit.client.0.smithi062.stdout:3/379: dwrite d1/d1e/d26/f3c [0,4194304] 0 2024-05-09T06:29:56.875 INFO:tasks.workunit.client.0.smithi062.stdout:3/380: read - d1/d1e/d36/f49 zero size 2024-05-09T06:29:56.877 INFO:tasks.workunit.client.0.smithi062.stdout:0/374: rmdir d1/d25/d49/d4f/d52/d7b 39 2024-05-09T06:29:56.879 INFO:tasks.workunit.client.0.smithi062.stdout:4/502: dwrite d0/d2a/d8/df/f16 [4194304,4194304] 0 2024-05-09T06:29:56.881 INFO:tasks.workunit.client.0.smithi062.stdout:7/448: truncate d0/d3/f17 2139713 0 2024-05-09T06:29:56.881 INFO:tasks.workunit.client.0.smithi062.stdout:7/449: truncate d0/d12/d33/f5e 1205921 0 2024-05-09T06:29:56.886 INFO:tasks.workunit.client.0.smithi062.stdout:8/560: rename da/d11/l22 to da/d11/d2e/d34/lac 0 2024-05-09T06:29:56.892 INFO:tasks.workunit.client.0.smithi062.stdout:3/381: mknod d1/d1e/d26/d43/d52/d81/c85 0 2024-05-09T06:29:56.894 INFO:tasks.workunit.client.0.smithi062.stdout:0/375: mknod d1/d18/c88 0 2024-05-09T06:29:56.894 INFO:tasks.workunit.client.0.smithi062.stdout:0/376: fdatasync d1/d25/d31/f4c 0 2024-05-09T06:29:56.900 INFO:tasks.workunit.client.0.smithi062.stdout:4/503: mknod d0/d9/d8d/c93 0 2024-05-09T06:29:56.900 INFO:tasks.workunit.client.0.smithi062.stdout:3/382: dread d1/f8 [0,4194304] 0 2024-05-09T06:29:56.900 INFO:tasks.workunit.client.0.smithi062.stdout:3/383: creat d1/d1e/d26/f86 x:0 0 0 2024-05-09T06:29:56.902 INFO:tasks.workunit.client.0.smithi062.stdout:7/450: mkdir d0/d3a/d51/d64/d6d/d80/d8e 0 2024-05-09T06:29:56.902 INFO:tasks.workunit.client.0.smithi062.stdout:0/377: dread d1/d18/d48/f53 [0,4194304] 0 2024-05-09T06:29:56.904 INFO:tasks.workunit.client.0.smithi062.stdout:8/561: symlink da/d11/d2e/d34/d90/lad 0 2024-05-09T06:29:56.904 INFO:tasks.workunit.client.0.smithi062.stdout:8/562: write da/d11/f23 [908603,7131] 0 2024-05-09T06:29:56.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:56 smithi062 ceph-mon[26920]: pgmap v6: 65 pgs: 65 active+clean; 2.5 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 35 MiB/s rd, 36 MiB/s wr, 37 op/s 2024-05-09T06:29:56.915 INFO:tasks.workunit.client.0.smithi062.stdout:4/504: mkdir d0/d2a/d8/df/d86/d94 0 2024-05-09T06:29:56.915 INFO:tasks.workunit.client.0.smithi062.stdout:4/505: chown d0/f7f 526 1 2024-05-09T06:29:56.915 INFO:tasks.workunit.client.0.smithi062.stdout:4/506: creat d0/d2a/d1f/d6c/f95 x:0 0 0 2024-05-09T06:29:56.915 INFO:tasks.workunit.client.0.smithi062.stdout:4/507: chown d0/d2a/c87 0 1 2024-05-09T06:29:56.917 INFO:tasks.workunit.client.0.smithi062.stdout:3/384: dwrite d1/d1e/f39 [0,4194304] 0 2024-05-09T06:29:56.921 INFO:tasks.workunit.client.0.smithi062.stdout:7/451: unlink d0/d3a/d51/d64/f82 0 2024-05-09T06:29:56.923 INFO:tasks.workunit.client.0.smithi062.stdout:0/378: unlink d1/d25/d31/d6c/d44/l4b 0 2024-05-09T06:29:56.927 INFO:tasks.workunit.client.0.smithi062.stdout:3/385: dread d1/f2f [0,4194304] 0 2024-05-09T06:29:56.927 INFO:tasks.workunit.client.0.smithi062.stdout:3/386: chown d1/d1e/d26/d33/d4f/f6f 314 1 2024-05-09T06:29:56.927 INFO:tasks.workunit.client.0.smithi062.stdout:8/563: rename da/d11/c18 to da/d11/d2e/d61/d92/da5/cae 0 2024-05-09T06:29:56.927 INFO:tasks.workunit.client.0.smithi062.stdout:8/564: stat da/ld 0 2024-05-09T06:29:56.927 INFO:tasks.workunit.client.0.smithi062.stdout:2/404: sync 2024-05-09T06:29:56.928 INFO:tasks.workunit.client.0.smithi062.stdout:2/405: chown d0/d9/dd/f1a 391379 1 2024-05-09T06:29:56.934 INFO:tasks.workunit.client.0.smithi062.stdout:2/406: dread d0/f3a [0,4194304] 0 2024-05-09T06:29:56.936 INFO:tasks.workunit.client.0.smithi062.stdout:7/452: mknod d0/d3a/d51/d64/d6d/d88/c8f 0 2024-05-09T06:29:56.940 INFO:tasks.workunit.client.0.smithi062.stdout:7/453: dread d0/d12/d33/f3b [0,4194304] 0 2024-05-09T06:29:56.942 INFO:tasks.workunit.client.0.smithi062.stdout:3/387: symlink d1/d1e/d36/d3a/d4e/l87 0 2024-05-09T06:29:56.945 INFO:tasks.workunit.client.0.smithi062.stdout:8/565: mkdir da/d11/d2e/d61/d92/da5/daf 0 2024-05-09T06:29:56.947 INFO:tasks.workunit.client.0.smithi062.stdout:4/508: unlink d0/d9/c1b 0 2024-05-09T06:29:56.948 INFO:tasks.workunit.client.0.smithi062.stdout:7/454: creat d0/d3a/d51/d64/d6d/f90 x:0 0 0 2024-05-09T06:29:56.948 INFO:tasks.workunit.client.0.smithi062.stdout:7/455: fdatasync d0/f2c 0 2024-05-09T06:29:56.949 INFO:tasks.workunit.client.0.smithi062.stdout:2/407: dwrite d0/fa [0,4194304] 0 2024-05-09T06:29:56.950 INFO:tasks.workunit.client.0.smithi062.stdout:2/408: write d0/f39 [13256333,118382] 0 2024-05-09T06:29:56.953 INFO:tasks.workunit.client.0.smithi062.stdout:3/388: mknod d1/d48/c88 0 2024-05-09T06:29:56.956 INFO:tasks.workunit.client.0.smithi062.stdout:4/509: dread d0/d2a/d8/df/f5d [0,4194304] 0 2024-05-09T06:29:56.963 INFO:tasks.workunit.client.0.smithi062.stdout:2/409: dread d0/d9/d38/d41/d53/f63 [0,4194304] 0 2024-05-09T06:29:56.963 INFO:tasks.workunit.client.0.smithi062.stdout:2/410: fdatasync d0/d9/dd/f1a 0 2024-05-09T06:29:56.964 INFO:tasks.workunit.client.0.smithi062.stdout:0/379: rename d1/d25/d49/d42/c47 to d1/c89 0 2024-05-09T06:29:56.968 INFO:tasks.workunit.client.0.smithi062.stdout:8/566: creat da/d11/d1c/fb0 x:0 0 0 2024-05-09T06:29:56.978 INFO:tasks.workunit.client.0.smithi062.stdout:2/411: mknod d0/d9/dd/d65/d6d/d21/d29/d3d/c7a 0 2024-05-09T06:29:56.985 INFO:tasks.workunit.client.0.smithi062.stdout:7/456: dread d0/f20 [0,4194304] 0 2024-05-09T06:29:56.985 INFO:tasks.workunit.client.0.smithi062.stdout:7/457: creat d0/d3a/f91 x:0 0 0 2024-05-09T06:29:56.993 INFO:tasks.workunit.client.0.smithi062.stdout:7/458: creat d0/f92 x:0 0 0 2024-05-09T06:29:56.993 INFO:tasks.workunit.client.0.smithi062.stdout:7/459: chown d0/f8d 30 1 2024-05-09T06:29:56.993 INFO:tasks.workunit.client.0.smithi062.stdout:3/389: dwrite d1/d1e/f1d [0,4194304] 0 2024-05-09T06:29:56.994 INFO:tasks.workunit.client.0.smithi062.stdout:4/510: dwrite d0/d2a/d1f/d6c/f95 [0,4194304] 0 2024-05-09T06:29:56.994 INFO:tasks.workunit.client.0.smithi062.stdout:3/390: mkdir d1/d1e/d36/d3a/d89 0 2024-05-09T06:29:56.995 INFO:tasks.workunit.client.0.smithi062.stdout:7/460: dread d0/d3a/d51/f44 [0,4194304] 0 2024-05-09T06:29:56.997 INFO:tasks.workunit.client.0.smithi062.stdout:8/567: dwrite da/f71 [0,4194304] 0 2024-05-09T06:29:56.999 INFO:tasks.workunit.client.0.smithi062.stdout:3/391: mknod d1/d1e/d26/d33/c8a 0 2024-05-09T06:29:57.000 INFO:tasks.workunit.client.0.smithi062.stdout:7/461: mknod d0/d3a/d51/c93 0 2024-05-09T06:29:57.001 INFO:tasks.workunit.client.0.smithi062.stdout:3/392: write d1/d48/f50 [66711,54957] 0 2024-05-09T06:29:57.015 INFO:tasks.workunit.client.0.smithi062.stdout:7/462: write d0/d3a/d3f/f79 [208006,71599] 0 2024-05-09T06:29:57.015 INFO:tasks.workunit.client.0.smithi062.stdout:7/463: stat d0/d12/c14 0 2024-05-09T06:29:57.016 INFO:tasks.workunit.client.0.smithi062.stdout:8/568: symlink da/d11/d2e/d34/d90/lb1 0 2024-05-09T06:29:57.016 INFO:tasks.workunit.client.0.smithi062.stdout:8/569: fsync da/f71 0 2024-05-09T06:29:57.016 INFO:tasks.workunit.client.0.smithi062.stdout:8/570: write da/d11/f58 [193788,124884] 0 2024-05-09T06:29:57.017 INFO:tasks.workunit.client.0.smithi062.stdout:4/511: creat d0/d2a/d8/df/d28/d31/f96 x:0 0 0 2024-05-09T06:29:57.020 INFO:tasks.workunit.client.0.smithi062.stdout:0/380: dwrite d1/d18/f1d [0,4194304] 0 2024-05-09T06:29:57.022 INFO:tasks.workunit.client.0.smithi062.stdout:2/412: dwrite d0/d9/dd/d65/d6d/f3b [0,4194304] 0 2024-05-09T06:29:57.024 INFO:tasks.workunit.client.0.smithi062.stdout:3/393: dwrite d1/d1e/f2c [0,4194304] 0 2024-05-09T06:29:57.024 INFO:tasks.workunit.client.0.smithi062.stdout:3/394: stat d1/d1e/d36/d4a/d51 0 2024-05-09T06:29:57.024 INFO:tasks.workunit.client.0.smithi062.stdout:2/413: read d0/d9/dd/d65/d6d/f3b [4733629,53533] 0 2024-05-09T06:29:57.024 INFO:tasks.workunit.client.0.smithi062.stdout:2/414: chown d0/d9/d38/d41/d53 93981 1 2024-05-09T06:29:57.024 INFO:tasks.workunit.client.0.smithi062.stdout:2/415: write d0/f78 [167280,106263] 0 2024-05-09T06:29:57.025 INFO:tasks.workunit.client.0.smithi062.stdout:4/512: dread d0/d2a/d8/df/d28/d31/f77 [4194304,4194304] 0 2024-05-09T06:29:57.025 INFO:tasks.workunit.client.0.smithi062.stdout:8/571: mkdir da/d11/d2e/d61/d92/da5/db2 0 2024-05-09T06:29:57.030 INFO:tasks.workunit.client.0.smithi062.stdout:0/381: link d1/d25/d31/l40 d1/d25/d31/d6c/l8a 0 2024-05-09T06:29:57.032 INFO:tasks.workunit.client.0.smithi062.stdout:0/382: dread d1/f51 [0,4194304] 0 2024-05-09T06:29:57.033 INFO:tasks.workunit.client.0.smithi062.stdout:9/483: sync 2024-05-09T06:29:57.033 INFO:tasks.workunit.client.0.smithi062.stdout:6/506: sync 2024-05-09T06:29:57.033 INFO:tasks.workunit.client.0.smithi062.stdout:1/331: sync 2024-05-09T06:29:57.034 INFO:tasks.workunit.client.0.smithi062.stdout:7/464: rmdir d0/d3a/d51/d64 39 2024-05-09T06:29:57.034 INFO:tasks.workunit.client.0.smithi062.stdout:7/465: readlink d0/d3a/l7a 0 2024-05-09T06:29:57.036 INFO:tasks.workunit.client.0.smithi062.stdout:0/383: write d1/d25/d31/d6c/d44/f4a [1106087,101746] 0 2024-05-09T06:29:57.040 INFO:tasks.workunit.client.0.smithi062.stdout:6/507: dread dc/d28/d46/d3a/f3c [0,4194304] 0 2024-05-09T06:29:57.046 INFO:tasks.workunit.client.0.smithi062.stdout:9/484: read d3/d3e/f89 [835935,65596] 0 2024-05-09T06:29:57.046 INFO:tasks.workunit.client.0.smithi062.stdout:7/466: write d0/f5c [327849,24850] 0 2024-05-09T06:29:57.047 INFO:tasks.workunit.client.0.smithi062.stdout:7/467: truncate d0/d12/d33/d67/f7c 129180 0 2024-05-09T06:29:57.048 INFO:tasks.workunit.client.0.smithi062.stdout:3/395: truncate d1/d2d/f40 3068278 0 2024-05-09T06:29:57.050 INFO:tasks.workunit.client.0.smithi062.stdout:7/468: dread d0/d12/f30 [0,4194304] 0 2024-05-09T06:29:57.050 INFO:tasks.workunit.client.0.smithi062.stdout:7/469: creat d0/d3a/f94 x:0 0 0 2024-05-09T06:29:57.050 INFO:tasks.workunit.client.0.smithi062.stdout:2/416: rename d0/f44 to d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/f7b 0 2024-05-09T06:29:57.053 INFO:tasks.workunit.client.0.smithi062.stdout:0/384: dwrite d1/d25/f86 [0,4194304] 0 2024-05-09T06:29:57.055 INFO:tasks.workunit.client.0.smithi062.stdout:4/513: mknod d0/d2a/d14/d4f/c97 0 2024-05-09T06:29:57.056 INFO:tasks.workunit.client.0.smithi062.stdout:4/514: creat d0/d2a/d8/df/d28/d31/f98 x:0 0 0 2024-05-09T06:29:57.057 INFO:tasks.workunit.client.0.smithi062.stdout:5/467: sync 2024-05-09T06:29:57.058 INFO:tasks.workunit.client.0.smithi062.stdout:8/572: unlink da/d11/d2e/l38 0 2024-05-09T06:29:57.064 INFO:tasks.workunit.client.0.smithi062.stdout:1/332: mkdir d8/d1d/d70 0 2024-05-09T06:29:57.065 INFO:tasks.workunit.client.0.smithi062.stdout:2/417: write d0/d9/dd/f5e [3179588,105084] 0 2024-05-09T06:29:57.065 INFO:tasks.workunit.client.0.smithi062.stdout:9/485: dwrite d3/d3e/d52/d58/d1c/f66 [0,4194304] 0 2024-05-09T06:29:57.072 INFO:tasks.workunit.client.0.smithi062.stdout:6/508: getdents dc/d28/d10/d20/d5b 0 2024-05-09T06:29:57.073 INFO:tasks.workunit.client.0.smithi062.stdout:6/509: chown dc/d42/f4d 2389 1 2024-05-09T06:29:57.076 INFO:tasks.workunit.client.0.smithi062.stdout:7/470: creat d0/f95 x:0 0 0 2024-05-09T06:29:57.079 INFO:tasks.workunit.client.0.smithi062.stdout:0/385: truncate d1/d18/f1d 2083797 0 2024-05-09T06:29:57.081 INFO:tasks.workunit.client.0.smithi062.stdout:1/333: creat d8/d14/d2b/d3d/f71 x:0 0 0 2024-05-09T06:29:57.084 INFO:tasks.workunit.client.0.smithi062.stdout:2/418: rename d0/c5 to d0/d9/d38/d41/c7c 0 2024-05-09T06:29:57.089 INFO:tasks.workunit.client.0.smithi062.stdout:3/396: getdents d1/d1e/d54 0 2024-05-09T06:29:57.090 INFO:tasks.workunit.client.0.smithi062.stdout:3/397: stat d1/d1e/d26/d43/f78 0 2024-05-09T06:29:57.091 INFO:tasks.workunit.client.0.smithi062.stdout:7/471: symlink d0/d3a/d51/l96 0 2024-05-09T06:29:57.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:56 smithi079 ceph-mon[35268]: pgmap v6: 65 pgs: 65 active+clean; 2.5 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 35 MiB/s rd, 36 MiB/s wr, 37 op/s 2024-05-09T06:29:57.096 INFO:tasks.workunit.client.0.smithi062.stdout:0/386: unlink d1/d25/d49/d4f/d52/d87/c5f 0 2024-05-09T06:29:57.100 INFO:tasks.workunit.client.0.smithi062.stdout:2/419: mknod d0/d9/dd/d65/d6d/d21/d29/d3d/d46/c7d 0 2024-05-09T06:29:57.100 INFO:tasks.workunit.client.0.smithi062.stdout:2/420: chown d0/c4 13 1 2024-05-09T06:29:57.103 INFO:tasks.workunit.client.0.smithi062.stdout:9/486: rename d3/d3e/c6d to d3/d3e/d52/d58/d1c/d1e/d60/c9d 0 2024-05-09T06:29:57.104 INFO:tasks.workunit.client.0.smithi062.stdout:9/487: chown d3/d3e/d52/d58/d1c/d1e/c27 69925 1 2024-05-09T06:29:57.104 INFO:tasks.workunit.client.0.smithi062.stdout:9/488: creat d3/d3e/d52/d58/d77/d92/f9e x:0 0 0 2024-05-09T06:29:57.105 INFO:tasks.workunit.client.0.smithi062.stdout:3/398: mknod d1/d1e/d36/d4a/d51/c8b 0 2024-05-09T06:29:57.107 INFO:tasks.workunit.client.0.smithi062.stdout:0/387: creat d1/d25/d49/d7e/f8b x:0 0 0 2024-05-09T06:29:57.108 INFO:tasks.workunit.client.0.smithi062.stdout:0/388: dread - d1/d25/d49/d42/d43/f7d zero size 2024-05-09T06:29:57.108 INFO:tasks.workunit.client.0.smithi062.stdout:0/389: chown d1/d25/d31/d6c/c3e 3929 1 2024-05-09T06:29:57.112 INFO:tasks.workunit.client.0.smithi062.stdout:9/489: unlink d3/d3e/d52/d58/d1c/f5e 0 2024-05-09T06:29:57.113 INFO:tasks.workunit.client.0.smithi062.stdout:0/390: dread d1/d25/d31/d6c/d44/d57/f64 [0,4194304] 0 2024-05-09T06:29:57.113 INFO:tasks.workunit.client.0.smithi062.stdout:0/391: write d1/d25/d31/f33 [4289271,45485] 0 2024-05-09T06:29:57.115 INFO:tasks.workunit.client.0.smithi062.stdout:3/399: mkdir d1/d1e/d54/d8c 0 2024-05-09T06:29:57.115 INFO:tasks.workunit.client.0.smithi062.stdout:3/400: dread - d1/d1e/d36/f49 zero size 2024-05-09T06:29:57.122 INFO:tasks.workunit.client.0.smithi062.stdout:6/510: dwrite dc/d28/d46/d3a/d7f/f90 [0,4194304] 0 2024-05-09T06:29:57.122 INFO:tasks.workunit.client.0.smithi062.stdout:6/511: truncate dc/d28/d46/d4a/f9e 671125 0 2024-05-09T06:29:57.122 INFO:tasks.workunit.client.0.smithi062.stdout:4/515: dwrite d0/d2a/d1f/f65 [0,4194304] 0 2024-05-09T06:29:57.125 INFO:tasks.workunit.client.0.smithi062.stdout:6/512: rmdir dc/d42/d70 39 2024-05-09T06:29:57.127 INFO:tasks.workunit.client.0.smithi062.stdout:7/472: dwrite d0/d3a/d3f/f56 [0,4194304] 0 2024-05-09T06:29:57.127 INFO:tasks.workunit.client.0.smithi062.stdout:5/468: dwrite d0/d8/d1c/d23/f4f [0,4194304] 0 2024-05-09T06:29:57.130 INFO:tasks.workunit.client.0.smithi062.stdout:3/401: dread d1/d2d/f40 [0,4194304] 0 2024-05-09T06:29:57.131 INFO:tasks.workunit.client.0.smithi062.stdout:1/334: dwrite d8/d2c/d41/f55 [4194304,4194304] 0 2024-05-09T06:29:57.131 INFO:tasks.workunit.client.0.smithi062.stdout:3/402: truncate d1/d2d/f7b 4248058 0 2024-05-09T06:29:57.131 INFO:tasks.workunit.client.0.smithi062.stdout:3/403: truncate d1/d1e/d26/d33/d4f/f6f 14699 0 2024-05-09T06:29:57.131 INFO:tasks.workunit.client.0.smithi062.stdout:1/335: creat d8/d14/f72 x:0 0 0 2024-05-09T06:29:57.133 INFO:tasks.workunit.client.0.smithi062.stdout:4/516: truncate d0/d2a/f25 6181515 0 2024-05-09T06:29:57.137 INFO:tasks.workunit.client.0.smithi062.stdout:6/513: unlink dc/d28/d34/d39/f83 0 2024-05-09T06:29:57.138 INFO:tasks.workunit.client.0.smithi062.stdout:2/421: dwrite d0/d9/dd/d65/d6d/f56 [0,4194304] 0 2024-05-09T06:29:57.142 INFO:tasks.workunit.client.0.smithi062.stdout:7/473: rename d0/d3a/d51/f60 to d0/d3a/d51/d64/d6d/f97 0 2024-05-09T06:29:57.143 INFO:tasks.workunit.client.0.smithi062.stdout:6/514: dread dc/d28/d10/d20/d5b/f6a [0,4194304] 0 2024-05-09T06:29:57.143 INFO:tasks.workunit.client.0.smithi062.stdout:6/515: write dc/f2a [47411,108328] 0 2024-05-09T06:29:57.144 INFO:tasks.workunit.client.0.smithi062.stdout:2/422: read d0/d9/d38/f60 [2766030,61220] 0 2024-05-09T06:29:57.145 INFO:tasks.workunit.client.0.smithi062.stdout:9/490: dwrite d3/f86 [0,4194304] 0 2024-05-09T06:29:57.145 INFO:tasks.workunit.client.0.smithi062.stdout:9/491: chown d3/d3e/d52/d58/d1c/d1e/d41/d64/f2d 0 1 2024-05-09T06:29:57.145 INFO:tasks.workunit.client.0.smithi062.stdout:3/404: symlink d1/d2d/d77/l8d 0 2024-05-09T06:29:57.145 INFO:tasks.workunit.client.0.smithi062.stdout:3/405: fdatasync d1/d1e/d26/f86 0 2024-05-09T06:29:57.145 INFO:tasks.workunit.client.0.smithi062.stdout:3/406: truncate d1/d1e/d26/d43/f78 351624 0 2024-05-09T06:29:57.146 INFO:tasks.workunit.client.0.smithi062.stdout:4/517: truncate d0/d2a/f4 3709397 0 2024-05-09T06:29:57.153 INFO:tasks.workunit.client.0.smithi062.stdout:0/392: dwrite d1/f14 [0,4194304] 0 2024-05-09T06:29:57.153 INFO:tasks.workunit.client.0.smithi062.stdout:5/469: dwrite d0/d11/f83 [0,4194304] 0 2024-05-09T06:29:57.153 INFO:tasks.workunit.client.0.smithi062.stdout:5/470: stat d0/d8/d1c/f32 0 2024-05-09T06:29:57.153 INFO:tasks.workunit.client.0.smithi062.stdout:5/471: stat d0/c27 0 2024-05-09T06:29:57.160 INFO:tasks.workunit.client.0.smithi062.stdout:1/336: dwrite d8/d14/f72 [0,4194304] 0 2024-05-09T06:29:57.161 INFO:tasks.workunit.client.0.smithi062.stdout:1/337: write d8/d2c/d41/f4f [102544,75636] 0 2024-05-09T06:29:57.161 INFO:tasks.workunit.client.0.smithi062.stdout:1/338: chown d8/d14/d2b/d3c/d44/f63 6857 1 2024-05-09T06:29:57.161 INFO:tasks.workunit.client.0.smithi062.stdout:1/339: truncate d8/d2c/f50 4507331 0 2024-05-09T06:29:57.161 INFO:tasks.workunit.client.0.smithi062.stdout:1/340: stat d8/d14/d2b/d3c/d44/f63 0 2024-05-09T06:29:57.166 INFO:tasks.workunit.client.0.smithi062.stdout:6/516: rmdir dc/d28/d34/d4e/d78 39 2024-05-09T06:29:57.168 INFO:tasks.workunit.client.0.smithi062.stdout:7/474: dwrite d0/f6e [0,4194304] 0 2024-05-09T06:29:57.170 INFO:tasks.workunit.client.0.smithi062.stdout:2/423: mkdir d0/d9/dd/d65/d6d/d7e 0 2024-05-09T06:29:57.172 INFO:tasks.workunit.client.0.smithi062.stdout:1/341: dread d8/d14/f72 [0,4194304] 0 2024-05-09T06:29:57.175 INFO:tasks.workunit.client.0.smithi062.stdout:9/492: rename d3/cd to d3/d3e/d52/d58/c9f 0 2024-05-09T06:29:57.179 INFO:tasks.workunit.client.0.smithi062.stdout:1/342: dread f3 [0,4194304] 0 2024-05-09T06:29:57.180 INFO:tasks.workunit.client.0.smithi062.stdout:3/407: rmdir d1/d48 39 2024-05-09T06:29:57.180 INFO:tasks.workunit.client.0.smithi062.stdout:3/408: fsync d1/d1e/d36/d3a/f4d 0 2024-05-09T06:29:57.188 INFO:tasks.workunit.client.0.smithi062.stdout:0/393: creat d1/d25/d31/d6c/d44/d57/d75/f8c x:0 0 0 2024-05-09T06:29:57.188 INFO:tasks.workunit.client.0.smithi062.stdout:0/394: fdatasync d1/d25/d49/d7e/f8b 0 2024-05-09T06:29:57.188 INFO:tasks.workunit.client.0.smithi062.stdout:0/395: stat d1/d25/d59/f69 0 2024-05-09T06:29:57.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/493: dwrite d3/d3e/d52/d58/d77/d92/f9e [0,4194304] 0 2024-05-09T06:29:57.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/494: fsync d3/d3e/d52/d58/d1c/d21/f53 0 2024-05-09T06:29:57.195 INFO:tasks.workunit.client.0.smithi062.stdout:6/517: dwrite dc/d28/d46/d3a/d7f/f90 [0,4194304] 0 2024-05-09T06:29:57.196 INFO:tasks.workunit.client.0.smithi062.stdout:6/518: fsync dc/d28/d34/d4e/f85 0 2024-05-09T06:29:57.197 INFO:tasks.workunit.client.0.smithi062.stdout:5/472: truncate d0/d8/d18/f5d 3242775 0 2024-05-09T06:29:57.197 INFO:tasks.workunit.client.0.smithi062.stdout:5/473: read d0/f74 [262074,78743] 0 2024-05-09T06:29:57.197 INFO:tasks.workunit.client.0.smithi062.stdout:5/474: chown d0/d8/d1c/d23/f5b 172682 1 2024-05-09T06:29:57.206 INFO:tasks.workunit.client.0.smithi062.stdout:5/475: dread d0/f28 [0,4194304] 0 2024-05-09T06:29:57.207 INFO:tasks.workunit.client.0.smithi062.stdout:7/475: unlink d0/f2c 0 2024-05-09T06:29:57.207 INFO:tasks.workunit.client.0.smithi062.stdout:7/476: fdatasync d0/d3/f40 0 2024-05-09T06:29:57.209 INFO:tasks.workunit.client.0.smithi062.stdout:2/424: creat d0/d9/d17/d37/f7f x:0 0 0 2024-05-09T06:29:57.212 INFO:tasks.workunit.client.0.smithi062.stdout:1/343: link d8/d14/f5e d8/d14/d2b/d3c/d44/d6e/f73 0 2024-05-09T06:29:57.214 INFO:tasks.workunit.client.0.smithi062.stdout:3/409: mknod d1/d48/c8e 0 2024-05-09T06:29:57.214 INFO:tasks.workunit.client.0.smithi062.stdout:3/410: stat d1/d1e/f14 0 2024-05-09T06:29:57.215 INFO:tasks.workunit.client.0.smithi062.stdout:7/477: write d0/d3/f2d [2789416,49437] 0 2024-05-09T06:29:57.217 INFO:tasks.workunit.client.0.smithi062.stdout:0/396: dread d1/d18/f34 [0,4194304] 0 2024-05-09T06:29:57.228 INFO:tasks.workunit.client.0.smithi062.stdout:9/495: symlink d3/d3e/d7c/la0 0 2024-05-09T06:29:57.228 INFO:tasks.workunit.client.0.smithi062.stdout:9/496: fsync d3/d3e/d52/d58/d1c/d1e/d41/f7f 0 2024-05-09T06:29:57.231 INFO:tasks.workunit.client.0.smithi062.stdout:5/476: rename d0/d8/d1c/f25 to d0/d8/d1c/d2c/d7d/fa1 0 2024-05-09T06:29:57.233 INFO:tasks.workunit.client.0.smithi062.stdout:9/497: read d3/d3e/d4b/f5c [313996,100835] 0 2024-05-09T06:29:57.238 INFO:tasks.workunit.client.0.smithi062.stdout:2/425: symlink d0/d9/d38/d41/d48/d5f/l80 0 2024-05-09T06:29:57.239 INFO:tasks.workunit.client.0.smithi062.stdout:2/426: fsync d0/d9/d38/d41/d48/f4b 0 2024-05-09T06:29:57.239 INFO:tasks.workunit.client.0.smithi062.stdout:2/427: truncate d0/d9/dd/d65/f71 1836371 0 2024-05-09T06:29:57.242 INFO:tasks.workunit.client.0.smithi062.stdout:3/411: symlink d1/d1e/d26/d33/l8f 0 2024-05-09T06:29:57.245 INFO:tasks.workunit.client.0.smithi062.stdout:0/397: link d1/d25/d49/d7e/f8b d1/d25/d49/d4f/f8d 0 2024-05-09T06:29:57.248 INFO:tasks.workunit.client.0.smithi062.stdout:6/519: rmdir dc/d28/d46/d3a/d7f/d91 39 2024-05-09T06:29:57.252 INFO:tasks.workunit.client.0.smithi062.stdout:1/344: rename d8/d14/d2b/d3c/d44/f34 to d8/d1d/f74 0 2024-05-09T06:29:57.256 INFO:tasks.workunit.client.0.smithi062.stdout:5/477: link d0/d8/d1c/d23/f48 d0/d8/d1c/d23/d3e/fa2 0 2024-05-09T06:29:57.256 INFO:tasks.workunit.client.0.smithi062.stdout:5/478: creat d0/d56/d5/fa3 x:0 0 0 2024-05-09T06:29:57.260 INFO:tasks.workunit.client.0.smithi062.stdout:9/498: symlink d3/d3e/d52/d58/la1 0 2024-05-09T06:29:57.260 INFO:tasks.workunit.client.0.smithi062.stdout:9/499: chown d3/f86 5211597 1 2024-05-09T06:29:57.279 INFO:tasks.workunit.client.0.smithi062.stdout:3/412: rmdir d1/d1e/d26/d43/d52/d6a 39 2024-05-09T06:29:57.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/478: rename d0/d3/f4f to d0/d3a/d51/d64/d6d/f98 0 2024-05-09T06:29:57.281 INFO:tasks.workunit.client.0.smithi062.stdout:7/479: write d0/d3a/d51/d64/d6d/d88/f8a [1364800,35134] 0 2024-05-09T06:29:57.283 INFO:tasks.workunit.client.0.smithi062.stdout:1/345: mknod d8/d14/d2b/d3c/d44/d4b/c75 0 2024-05-09T06:29:57.285 INFO:tasks.workunit.client.0.smithi062.stdout:5/479: truncate d0/f28 2684792 0 2024-05-09T06:29:57.286 INFO:tasks.workunit.client.0.smithi062.stdout:9/500: mkdir d3/d3e/d4b/da2 0 2024-05-09T06:29:57.294 INFO:tasks.workunit.client.0.smithi062.stdout:3/413: link d1/d1e/d26/d33/l74 d1/d2d/d77/l90 0 2024-05-09T06:29:57.300 INFO:tasks.workunit.client.0.smithi062.stdout:2/428: rename d0/d9/dd/l2d to d0/d9/d38/d41/d48/d5f/l81 0 2024-05-09T06:29:57.301 INFO:tasks.workunit.client.0.smithi062.stdout:7/480: dwrite d0/d3a/d51/f44 [0,4194304] 0 2024-05-09T06:29:57.301 INFO:tasks.workunit.client.0.smithi062.stdout:1/346: mkdir d8/d14/d2b/d3c/d76 0 2024-05-09T06:29:57.305 INFO:tasks.workunit.client.0.smithi062.stdout:2/429: dread d0/d9/dd/d65/f71 [0,4194304] 0 2024-05-09T06:29:57.305 INFO:tasks.workunit.client.0.smithi062.stdout:5/480: unlink d0/f97 0 2024-05-09T06:29:57.305 INFO:tasks.workunit.client.0.smithi062.stdout:8/573: sync 2024-05-09T06:29:57.308 INFO:tasks.workunit.client.0.smithi062.stdout:3/414: getdents d1/d1e/d36/d4a/d51 0 2024-05-09T06:29:57.308 INFO:tasks.workunit.client.0.smithi062.stdout:3/415: write d1/d1e/d36/f49 [271577,71155] 0 2024-05-09T06:29:57.309 INFO:tasks.workunit.client.0.smithi062.stdout:0/398: rename d1/d25/d49/d4f/d52/d87/f78 to d1/d25/d49/d42/d43/d54/f8e 0 2024-05-09T06:29:57.310 INFO:tasks.workunit.client.0.smithi062.stdout:7/481: dread d0/d3/fd [0,4194304] 0 2024-05-09T06:29:57.310 INFO:tasks.workunit.client.0.smithi062.stdout:7/482: truncate d0/d3a/f7b 2867705 0 2024-05-09T06:29:57.315 INFO:tasks.workunit.client.0.smithi062.stdout:3/416: write d1/d1e/d26/d43/d52/d6a/f71 [2632145,44313] 0 2024-05-09T06:29:57.316 INFO:tasks.workunit.client.0.smithi062.stdout:3/417: dread d1/d1e/d26/d43/f78 [0,4194304] 0 2024-05-09T06:29:57.316 INFO:tasks.workunit.client.0.smithi062.stdout:3/418: chown d1/d1e/l44 1894242 1 2024-05-09T06:29:57.317 INFO:tasks.workunit.client.0.smithi062.stdout:1/347: creat d8/d14/d2b/d3c/d44/d38/f77 x:0 0 0 2024-05-09T06:29:57.319 INFO:tasks.workunit.client.0.smithi062.stdout:2/430: symlink d0/d9/d17/d37/d69/l82 0 2024-05-09T06:29:57.320 INFO:tasks.workunit.client.0.smithi062.stdout:4/518: sync 2024-05-09T06:29:57.320 INFO:tasks.workunit.client.0.smithi062.stdout:4/519: chown d0/d2a/d8/df/d28/c6d 1964503 1 2024-05-09T06:29:57.323 INFO:tasks.workunit.client.0.smithi062.stdout:5/481: unlink d0/d56/f6a 0 2024-05-09T06:29:57.324 INFO:tasks.workunit.client.0.smithi062.stdout:8/574: link da/d11/d2e/d61/c8f da/d95/cb3 0 2024-05-09T06:29:57.324 INFO:tasks.workunit.client.0.smithi062.stdout:8/575: chown da/d11/l7c 1908 1 2024-05-09T06:29:57.325 INFO:tasks.workunit.client.0.smithi062.stdout:0/399: truncate d1/f2a 896890 0 2024-05-09T06:29:57.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/520: rename dc/d28/d10/d20/ca4 to dc/d28/d46/d4a/cae 0 2024-05-09T06:29:57.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/521: readlink dc/d28/d46/d3a/l54 0 2024-05-09T06:29:57.327 INFO:tasks.workunit.client.0.smithi062.stdout:7/483: creat d0/d12/f99 x:0 0 0 2024-05-09T06:29:57.329 INFO:tasks.workunit.client.0.smithi062.stdout:1/348: link d8/d2c/c4c d8/d14/d2b/d3c/d44/d64/c78 0 2024-05-09T06:29:57.333 INFO:tasks.workunit.client.0.smithi062.stdout:2/431: getdents d0/d9/d38/d41/d53 0 2024-05-09T06:29:57.335 INFO:tasks.workunit.client.0.smithi062.stdout:0/400: dread d1/f14 [0,4194304] 0 2024-05-09T06:29:57.336 INFO:tasks.workunit.client.0.smithi062.stdout:4/520: link d0/d9/f72 d0/d2a/f99 0 2024-05-09T06:29:57.336 INFO:tasks.workunit.client.0.smithi062.stdout:4/521: fsync d0/d2a/d14/f74 0 2024-05-09T06:29:57.338 INFO:tasks.workunit.client.0.smithi062.stdout:5/482: mkdir d0/d56/d86/da4 0 2024-05-09T06:29:57.342 INFO:tasks.workunit.client.0.smithi062.stdout:8/576: truncate da/d11/d2e/d61/f63 2280086 0 2024-05-09T06:29:57.342 INFO:tasks.workunit.client.0.smithi062.stdout:8/577: creat da/d11/d2e/d34/fb4 x:0 0 0 2024-05-09T06:29:57.342 INFO:tasks.workunit.client.0.smithi062.stdout:8/578: chown da/d11/d2e/d61 178413575 1 2024-05-09T06:29:57.342 INFO:tasks.workunit.client.0.smithi062.stdout:8/579: fdatasync da/d11/d2e/d34/d90/fa3 0 2024-05-09T06:29:57.346 INFO:tasks.workunit.client.0.smithi062.stdout:6/522: unlink dc/d28/d34/c73 0 2024-05-09T06:29:57.350 INFO:tasks.workunit.client.0.smithi062.stdout:1/349: dwrite f3 [8388608,4194304] 0 2024-05-09T06:29:57.350 INFO:tasks.workunit.client.0.smithi062.stdout:3/419: rename d1/d48/c62 to d1/d1e/d26/d43/d52/d81/c91 0 2024-05-09T06:29:57.352 INFO:tasks.workunit.client.0.smithi062.stdout:7/484: symlink d0/d3/l9a 0 2024-05-09T06:29:57.356 INFO:tasks.workunit.client.0.smithi062.stdout:2/432: unlink d0/d9/dd/d65/d6d/f3b 0 2024-05-09T06:29:57.362 INFO:tasks.workunit.client.0.smithi062.stdout:4/522: symlink d0/d2a/d1f/d6c/l9a 0 2024-05-09T06:29:57.366 INFO:tasks.workunit.client.0.smithi062.stdout:5/483: mkdir d0/d56/d45/da5 0 2024-05-09T06:29:57.367 INFO:tasks.workunit.client.0.smithi062.stdout:0/401: dread d1/d18/d48/f53 [0,4194304] 0 2024-05-09T06:29:57.368 INFO:tasks.workunit.client.0.smithi062.stdout:2/433: dread d0/d9/dd/f33 [0,4194304] 0 2024-05-09T06:29:57.369 INFO:tasks.workunit.client.0.smithi062.stdout:6/523: dwrite dc/d42/f67 [0,4194304] 0 2024-05-09T06:29:57.369 INFO:tasks.workunit.client.0.smithi062.stdout:6/524: chown dc/d28/d10/d20/d5b 48311445 1 2024-05-09T06:29:57.370 INFO:tasks.workunit.client.0.smithi062.stdout:7/485: dwrite d0/d12/d33/d67/f6a [0,4194304] 0 2024-05-09T06:29:57.371 INFO:tasks.workunit.client.0.smithi062.stdout:8/580: symlink da/d11/d2e/d34/d90/lb5 0 2024-05-09T06:29:57.377 INFO:tasks.workunit.client.0.smithi062.stdout:5/484: mkdir d0/d8/d18/da6 0 2024-05-09T06:29:57.378 INFO:tasks.workunit.client.0.smithi062.stdout:5/485: dread - d0/d56/d45/f76 zero size 2024-05-09T06:29:57.379 INFO:tasks.workunit.client.0.smithi062.stdout:0/402: rmdir d1/d25/d49/d42/d43/d54 39 2024-05-09T06:29:57.380 INFO:tasks.workunit.client.0.smithi062.stdout:0/403: write d1/f11 [4066453,54405] 0 2024-05-09T06:29:57.380 INFO:tasks.workunit.client.0.smithi062.stdout:0/404: truncate d1/d25/d49/d4f/f8d 136605 0 2024-05-09T06:29:57.380 INFO:tasks.workunit.client.0.smithi062.stdout:5/486: dread d0/f74 [0,4194304] 0 2024-05-09T06:29:57.380 INFO:tasks.workunit.client.0.smithi062.stdout:5/487: write d0/d8/d1c/d2c/f85 [449004,11004] 0 2024-05-09T06:29:57.380 INFO:tasks.workunit.client.0.smithi062.stdout:5/488: write d0/f9c [610683,35127] 0 2024-05-09T06:29:57.380 INFO:tasks.workunit.client.0.smithi062.stdout:5/489: chown d0/d3b/d3f 4 1 2024-05-09T06:29:57.380 INFO:tasks.workunit.client.0.smithi062.stdout:5/490: creat d0/fa7 x:0 0 0 2024-05-09T06:29:57.381 INFO:tasks.workunit.client.0.smithi062.stdout:2/434: creat d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/f83 x:0 0 0 2024-05-09T06:29:57.383 INFO:tasks.workunit.client.0.smithi062.stdout:6/525: symlink dc/d42/d70/d74/laf 0 2024-05-09T06:29:57.386 INFO:tasks.workunit.client.0.smithi062.stdout:8/581: symlink da/d77/lb6 0 2024-05-09T06:29:57.386 INFO:tasks.workunit.client.0.smithi062.stdout:8/582: write da/d11/d2e/d61/d64/f69 [272785,86553] 0 2024-05-09T06:29:57.386 INFO:tasks.workunit.client.0.smithi062.stdout:8/583: chown da/d85/d8a 92 1 2024-05-09T06:29:57.387 INFO:tasks.workunit.client.0.smithi062.stdout:1/350: rmdir d8/d2c/d41 39 2024-05-09T06:29:57.387 INFO:tasks.workunit.client.0.smithi062.stdout:1/351: chown f3 59797 1 2024-05-09T06:29:57.389 INFO:tasks.workunit.client.0.smithi062.stdout:0/405: mknod d1/d25/d49/d4f/d52/c8f 0 2024-05-09T06:29:57.389 INFO:tasks.workunit.client.0.smithi062.stdout:4/523: dwrite d0/d2a/d14/d4f/d6b/f32 [0,4194304] 0 2024-05-09T06:29:57.390 INFO:tasks.workunit.client.0.smithi062.stdout:7/486: dwrite d0/d12/f32 [4194304,4194304] 0 2024-05-09T06:29:57.391 INFO:tasks.workunit.client.0.smithi062.stdout:2/435: creat d0/d9/f84 x:0 0 0 2024-05-09T06:29:57.396 INFO:tasks.workunit.client.0.smithi062.stdout:8/584: creat da/d11/d1c/d9e/d9f/da7/fb7 x:0 0 0 2024-05-09T06:29:57.396 INFO:tasks.workunit.client.0.smithi062.stdout:1/352: symlink d8/d14/d2b/l79 0 2024-05-09T06:29:57.396 INFO:tasks.workunit.client.0.smithi062.stdout:1/353: dread - d8/d14/d2b/d3c/f6b zero size 2024-05-09T06:29:57.396 INFO:tasks.workunit.client.0.smithi062.stdout:1/354: dread - d8/d14/f5e zero size 2024-05-09T06:29:57.396 INFO:tasks.workunit.client.0.smithi062.stdout:1/355: chown d8/d14/d2b/d3c/d44/f3a 2550352 1 2024-05-09T06:29:57.396 INFO:tasks.workunit.client.0.smithi062.stdout:1/356: fsync d8/d1d/f26 0 2024-05-09T06:29:57.397 INFO:tasks.workunit.client.0.smithi062.stdout:2/436: dread d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f4d [0,4194304] 0 2024-05-09T06:29:57.398 INFO:tasks.workunit.client.0.smithi062.stdout:5/491: dread d0/d8/d1c/d23/d3e/fa2 [0,4194304] 0 2024-05-09T06:29:57.399 INFO:tasks.workunit.client.0.smithi062.stdout:8/585: dread da/d11/d1c/f4a [0,4194304] 0 2024-05-09T06:29:57.399 INFO:tasks.workunit.client.0.smithi062.stdout:8/586: chown da/d77/c9b 15 1 2024-05-09T06:29:57.399 INFO:tasks.workunit.client.0.smithi062.stdout:3/420: rename d1/d2d to d1/d1e/d26/d43/d92 0 2024-05-09T06:29:57.399 INFO:tasks.workunit.client.0.smithi062.stdout:7/487: dread d0/d3a/f7b [0,4194304] 0 2024-05-09T06:29:57.403 INFO:tasks.workunit.client.0.smithi062.stdout:5/492: mknod d0/d56/ca8 0 2024-05-09T06:29:57.403 INFO:tasks.workunit.client.0.smithi062.stdout:5/493: dread - d0/d56/d5/fa3 zero size 2024-05-09T06:29:57.404 INFO:tasks.workunit.client.0.smithi062.stdout:8/587: mkdir da/d11/d1c/d9e/d9f/db8 0 2024-05-09T06:29:57.404 INFO:tasks.workunit.client.0.smithi062.stdout:8/588: dread - da/d11/d2e/f91 zero size 2024-05-09T06:29:57.410 INFO:tasks.workunit.client.0.smithi062.stdout:4/524: mknod d0/d2a/d8/df/d86/d94/c9b 0 2024-05-09T06:29:57.411 INFO:tasks.workunit.client.0.smithi062.stdout:4/525: creat d0/d2a/d14/d4f/f9c x:0 0 0 2024-05-09T06:29:57.411 INFO:tasks.workunit.client.0.smithi062.stdout:6/526: dwrite dc/d28/d10/fa6 [0,4194304] 0 2024-05-09T06:29:57.411 INFO:tasks.workunit.client.0.smithi062.stdout:3/421: creat d1/d1e/d54/f93 x:0 0 0 2024-05-09T06:29:57.412 INFO:tasks.workunit.client.0.smithi062.stdout:0/406: dwrite d1/fd [0,4194304] 0 2024-05-09T06:29:57.417 INFO:tasks.workunit.client.0.smithi062.stdout:1/357: getdents d8/d1d 0 2024-05-09T06:29:57.419 INFO:tasks.workunit.client.0.smithi062.stdout:5/494: creat d0/d8/d1c/d2c/d7d/fa9 x:0 0 0 2024-05-09T06:29:57.427 INFO:tasks.workunit.client.0.smithi062.stdout:6/527: mkdir dc/d28/d34/db0 0 2024-05-09T06:29:57.431 INFO:tasks.workunit.client.0.smithi062.stdout:0/407: creat d1/d25/d49/d4f/f90 x:0 0 0 2024-05-09T06:29:57.431 INFO:tasks.workunit.client.0.smithi062.stdout:2/437: dwrite d0/f6 [0,4194304] 0 2024-05-09T06:29:57.432 INFO:tasks.workunit.client.0.smithi062.stdout:8/589: dwrite da/d85/fa2 [0,4194304] 0 2024-05-09T06:29:57.432 INFO:tasks.workunit.client.0.smithi062.stdout:8/590: write da/d77/f94 [534360,51139] 0 2024-05-09T06:29:57.433 INFO:tasks.workunit.client.0.smithi062.stdout:8/591: write da/d11/d2e/d34/f44 [271983,95694] 0 2024-05-09T06:29:57.434 INFO:tasks.workunit.client.0.smithi062.stdout:7/488: dwrite d0/d3a/d51/d64/d6d/f90 [0,4194304] 0 2024-05-09T06:29:57.437 INFO:tasks.workunit.client.0.smithi062.stdout:1/358: mkdir d8/d14/d2b/d3c/d44/d6e/d7a 0 2024-05-09T06:29:57.437 INFO:tasks.workunit.client.0.smithi062.stdout:1/359: fdatasync d8/d14/d2b/d3c/d44/d64/f68 0 2024-05-09T06:29:57.437 INFO:tasks.workunit.client.0.smithi062.stdout:1/360: write d8/d14/d2b/d3c/d44/f4a [1048112,116636] 0 2024-05-09T06:29:57.439 INFO:tasks.workunit.client.0.smithi062.stdout:5/495: creat d0/d8/d1c/d23/d42/faa x:0 0 0 2024-05-09T06:29:57.443 INFO:tasks.workunit.client.0.smithi062.stdout:6/528: dwrite dc/d28/d46/d3a/f40 [4194304,4194304] 0 2024-05-09T06:29:57.451 INFO:tasks.workunit.client.0.smithi062.stdout:4/526: symlink d0/d9/l9d 0 2024-05-09T06:29:57.454 INFO:tasks.workunit.client.0.smithi062.stdout:0/408: mknod d1/d25/d31/d6c/d44/d57/c91 0 2024-05-09T06:29:57.456 INFO:tasks.workunit.client.0.smithi062.stdout:0/409: dread d1/f51 [0,4194304] 0 2024-05-09T06:29:57.458 INFO:tasks.workunit.client.0.smithi062.stdout:8/592: unlink da/d11/d1c/l3b 0 2024-05-09T06:29:57.460 INFO:tasks.workunit.client.0.smithi062.stdout:0/410: read d1/f14 [2240550,23547] 0 2024-05-09T06:29:57.463 INFO:tasks.workunit.client.0.smithi062.stdout:7/489: chown d0/d3a/d3f/c45 72519 1 2024-05-09T06:29:57.463 INFO:tasks.workunit.client.0.smithi062.stdout:7/490: write d0/f4 [3567538,86315] 0 2024-05-09T06:29:57.463 INFO:tasks.workunit.client.0.smithi062.stdout:7/491: stat d0/d3/f65 0 2024-05-09T06:29:57.463 INFO:tasks.workunit.client.0.smithi062.stdout:7/492: truncate d0/d3/f65 426001 0 2024-05-09T06:29:57.465 INFO:tasks.workunit.client.0.smithi062.stdout:4/527: dread d0/d3c/f5f [0,4194304] 0 2024-05-09T06:29:57.465 INFO:tasks.workunit.client.0.smithi062.stdout:2/438: dwrite d0/d9/d17/f68 [0,4194304] 0 2024-05-09T06:29:57.465 INFO:tasks.workunit.client.0.smithi062.stdout:2/439: creat d0/d9/dd/d65/d6d/d21/d29/d40/f85 x:0 0 0 2024-05-09T06:29:57.465 INFO:tasks.workunit.client.0.smithi062.stdout:5/496: dwrite d0/d8/d1c/d2c/d7d/d4a/f93 [0,4194304] 0 2024-05-09T06:29:57.466 INFO:tasks.workunit.client.0.smithi062.stdout:1/361: unlink d8/c33 0 2024-05-09T06:29:57.466 INFO:tasks.workunit.client.0.smithi062.stdout:1/362: stat d8/d14/d2b/l79 0 2024-05-09T06:29:57.466 INFO:tasks.workunit.client.0.smithi062.stdout:1/363: readlink d8/l60 0 2024-05-09T06:29:57.468 INFO:tasks.workunit.client.0.smithi062.stdout:6/529: creat dc/d28/d34/fb1 x:0 0 0 2024-05-09T06:29:57.471 INFO:tasks.workunit.client.0.smithi062.stdout:8/593: symlink da/d11/d2e/d34/d90/lb9 0 2024-05-09T06:29:57.471 INFO:tasks.workunit.client.0.smithi062.stdout:8/594: readlink da/d11/d2e/d34/d90/lad 0 2024-05-09T06:29:57.471 INFO:tasks.workunit.client.0.smithi062.stdout:8/595: chown da/d11/d2e/ca8 28082432 1 2024-05-09T06:29:57.472 INFO:tasks.workunit.client.0.smithi062.stdout:0/411: symlink d1/d6a/d6d/l92 0 2024-05-09T06:29:57.474 INFO:tasks.workunit.client.0.smithi062.stdout:7/493: mkdir d0/d12/d66/d9b 0 2024-05-09T06:29:57.488 INFO:tasks.workunit.client.0.smithi062.stdout:2/440: symlink d0/d9/dd/d65/d6d/d7e/l86 0 2024-05-09T06:29:57.493 INFO:tasks.workunit.client.0.smithi062.stdout:1/364: link d8/f13 d8/d14/d2b/d3c/d44/d64/f7b 0 2024-05-09T06:29:57.504 INFO:tasks.workunit.client.0.smithi062.stdout:6/530: unlink dc/d28/d46/d4a/cae 0 2024-05-09T06:29:57.505 INFO:tasks.workunit.client.0.smithi062.stdout:2/441: dwrite d0/d9/d38/f60 [0,4194304] 0 2024-05-09T06:29:57.506 INFO:tasks.workunit.client.0.smithi062.stdout:8/596: creat da/d11/d2e/d61/d92/da5/daf/fba x:0 0 0 2024-05-09T06:29:57.508 INFO:tasks.workunit.client.0.smithi062.stdout:4/528: rename d0/d2a/d8/df to d0/d2a/d14/d7e/d8e/d9e 0 2024-05-09T06:29:57.508 INFO:tasks.workunit.client.0.smithi062.stdout:4/529: chown d0/c68 4165809 1 2024-05-09T06:29:57.508 INFO:tasks.workunit.client.0.smithi062.stdout:4/530: chown d0/d3c/l75 186119 1 2024-05-09T06:29:57.515 INFO:tasks.workunit.client.0.smithi062.stdout:1/365: mkdir d8/d2c/d7c 0 2024-05-09T06:29:57.519 INFO:tasks.workunit.client.0.smithi062.stdout:6/531: truncate dc/f17 65053 0 2024-05-09T06:29:57.519 INFO:tasks.workunit.client.0.smithi062.stdout:6/532: write dc/f2a [1868352,22516] 0 2024-05-09T06:29:57.520 INFO:tasks.workunit.client.0.smithi062.stdout:8/597: dwrite da/d11/d2e/d61/d92/da5/daf/fba [0,4194304] 0 2024-05-09T06:29:57.523 INFO:tasks.workunit.client.0.smithi062.stdout:2/442: creat d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f87 x:0 0 0 2024-05-09T06:29:57.523 INFO:tasks.workunit.client.0.smithi062.stdout:2/443: write d0/f30 [721493,128562] 0 2024-05-09T06:29:57.527 INFO:tasks.workunit.client.0.smithi062.stdout:0/412: rename d1/d18/d48 to d1/d6a/d6d/d93 0 2024-05-09T06:29:57.529 INFO:tasks.workunit.client.0.smithi062.stdout:6/533: write dc/d28/d34/d4e/f85 [3921508,21961] 0 2024-05-09T06:29:57.532 INFO:tasks.workunit.client.0.smithi062.stdout:1/366: mkdir d8/d14/d2b/d3c/d7d 0 2024-05-09T06:29:57.542 INFO:tasks.workunit.client.0.smithi062.stdout:8/598: mkdir da/d85/d8a/dbb 0 2024-05-09T06:29:57.543 INFO:tasks.workunit.client.0.smithi062.stdout:8/599: dread - da/d11/d1c/fb0 zero size 2024-05-09T06:29:57.545 INFO:tasks.workunit.client.0.smithi062.stdout:2/444: symlink d0/d9/d17/d37/l88 0 2024-05-09T06:29:57.547 INFO:tasks.workunit.client.0.smithi062.stdout:0/413: mkdir d1/d6a/d6d/d93/d94 0 2024-05-09T06:29:57.547 INFO:tasks.workunit.client.0.smithi062.stdout:0/414: creat d1/d25/d31/d6c/d44/d57/d75/f95 x:0 0 0 2024-05-09T06:29:57.547 INFO:tasks.workunit.client.0.smithi062.stdout:0/415: dread - d1/d25/d49/d42/d43/f7d zero size 2024-05-09T06:29:57.552 INFO:tasks.workunit.client.0.smithi062.stdout:4/531: rmdir d0/d2a/d1f 39 2024-05-09T06:29:57.554 INFO:tasks.workunit.client.0.smithi062.stdout:0/416: dread d1/f24 [0,4194304] 0 2024-05-09T06:29:57.555 INFO:tasks.workunit.client.0.smithi062.stdout:2/445: write d0/d9/d38/f60 [3612693,127029] 0 2024-05-09T06:29:57.555 INFO:tasks.workunit.client.0.smithi062.stdout:0/417: dread d1/d25/d49/d4f/d52/d87/f68 [0,4194304] 0 2024-05-09T06:29:57.562 INFO:tasks.workunit.client.0.smithi062.stdout:1/367: creat d8/d2c/d7c/f7e x:0 0 0 2024-05-09T06:29:57.564 INFO:tasks.workunit.client.0.smithi062.stdout:8/600: rmdir da/d11/d2e/daa 0 2024-05-09T06:29:57.564 INFO:tasks.workunit.client.0.smithi062.stdout:8/601: write da/d11/d1c/d9e/d9f/da7/fb7 [382775,3529] 0 2024-05-09T06:29:57.566 INFO:tasks.workunit.client.0.smithi062.stdout:7/494: rename d0/d3/c37 to d0/d3a/d3f/c9c 0 2024-05-09T06:29:57.569 INFO:tasks.workunit.client.0.smithi062.stdout:6/534: truncate dc/d28/d10/f86 2993213 0 2024-05-09T06:29:57.571 INFO:tasks.workunit.client.0.smithi062.stdout:4/532: mkdir d0/d2a/d1f/d9f 0 2024-05-09T06:29:57.571 INFO:tasks.workunit.client.0.smithi062.stdout:4/533: truncate d0/d2a/d14/d7e/d8e/d9e/d28/d31/f96 946829 0 2024-05-09T06:29:57.571 INFO:tasks.workunit.client.0.smithi062.stdout:6/535: dread dc/d28/d10/d20/f31 [0,4194304] 0 2024-05-09T06:29:57.573 INFO:tasks.workunit.client.0.smithi062.stdout:2/446: mkdir d0/d9/d17/d89 0 2024-05-09T06:29:57.574 INFO:tasks.workunit.client.0.smithi062.stdout:8/602: truncate da/d11/f17 1434765 0 2024-05-09T06:29:57.577 INFO:tasks.workunit.client.0.smithi062.stdout:4/534: mkdir d0/d2a/d4b/da0 0 2024-05-09T06:29:57.579 INFO:tasks.workunit.client.0.smithi062.stdout:6/536: unlink dc/d28/d46/d4a/d5d/f27 0 2024-05-09T06:29:57.584 INFO:tasks.workunit.client.0.smithi062.stdout:8/603: write da/f57 [1205007,14112] 0 2024-05-09T06:29:57.584 INFO:tasks.workunit.client.0.smithi062.stdout:2/447: mkdir d0/d9/d38/d41/d8a 0 2024-05-09T06:29:57.586 INFO:tasks.workunit.client.0.smithi062.stdout:0/418: rename d1/d25/d31/d6c/d44/d57/d75/f95 to d1/d25/d31/d6c/d44/d6e/f96 0 2024-05-09T06:29:57.593 INFO:tasks.workunit.client.0.smithi062.stdout:6/537: dread dc/d28/d10/f35 [0,4194304] 0 2024-05-09T06:29:57.593 INFO:tasks.workunit.client.0.smithi062.stdout:6/538: chown dc/d42/d70/d74 5047 1 2024-05-09T06:29:57.593 INFO:tasks.workunit.client.0.smithi062.stdout:2/448: unlink d0/d9/dd/c31 0 2024-05-09T06:29:57.596 INFO:tasks.workunit.client.0.smithi062.stdout:6/539: creat dc/d42/d70/d74/fb2 x:0 0 0 2024-05-09T06:29:57.597 INFO:tasks.workunit.client.0.smithi062.stdout:2/449: symlink d0/d9/dd/d65/d6d/d21/d29/d40/l8b 0 2024-05-09T06:29:57.599 INFO:tasks.workunit.client.0.smithi062.stdout:2/450: symlink d0/d9/dd/d65/d6d/d21/d29/d3d/d46/l8c 0 2024-05-09T06:29:57.599 INFO:tasks.workunit.client.0.smithi062.stdout:2/451: readlink d0/d9/dd/d65/d6d/d7e/l86 0 2024-05-09T06:29:57.599 INFO:tasks.workunit.client.0.smithi062.stdout:1/368: dwrite d8/f2a [0,4194304] 0 2024-05-09T06:29:57.599 INFO:tasks.workunit.client.0.smithi062.stdout:1/369: fdatasync d8/d14/d2b/d3c/d44/d6e/f73 0 2024-05-09T06:29:57.599 INFO:tasks.workunit.client.0.smithi062.stdout:1/370: chown d8/d14/d2b/d3d 185223868 1 2024-05-09T06:29:57.602 INFO:tasks.workunit.client.0.smithi062.stdout:2/452: mkdir d0/d9/dd/d65/d6d/d7e/d8d 0 2024-05-09T06:29:57.604 INFO:tasks.workunit.client.0.smithi062.stdout:6/540: dread dc/d28/d46/d3a/f3e [0,4194304] 0 2024-05-09T06:29:57.605 INFO:tasks.workunit.client.0.smithi062.stdout:6/541: readlink dc/d28/d10/d20/l44 0 2024-05-09T06:29:57.605 INFO:tasks.workunit.client.0.smithi062.stdout:1/371: mkdir d8/d14/d2b/d3c/d44/d7f 0 2024-05-09T06:29:57.607 INFO:tasks.workunit.client.0.smithi062.stdout:6/542: mkdir dc/d28/d46/d82/d98/db3 0 2024-05-09T06:29:57.608 INFO:tasks.workunit.client.0.smithi062.stdout:6/543: chown dc/d28/d46/d3a/l54 282628576 1 2024-05-09T06:29:57.608 INFO:tasks.workunit.client.0.smithi062.stdout:6/544: write dc/d28/d10/d20/d5b/d77/f9c [4619552,88698] 0 2024-05-09T06:29:57.610 INFO:tasks.workunit.client.0.smithi062.stdout:1/372: mkdir d8/d14/d2b/d3c/d44/d6e/d7a/d80 0 2024-05-09T06:29:57.611 INFO:tasks.workunit.client.0.smithi062.stdout:1/373: chown d8/d14/c21 1142279 1 2024-05-09T06:29:57.611 INFO:tasks.workunit.client.0.smithi062.stdout:1/374: chown d8/d14/d2b/d3c/d44/d4b/c75 0 1 2024-05-09T06:29:57.612 INFO:tasks.workunit.client.0.smithi062.stdout:2/453: write d0/d9/dd/d65/d6d/d21/f55 [3106353,36191] 0 2024-05-09T06:29:57.614 INFO:tasks.workunit.client.0.smithi062.stdout:1/375: symlink d8/d1d/l81 0 2024-05-09T06:29:57.614 INFO:tasks.workunit.client.0.smithi062.stdout:1/376: truncate d8/f54 76607 0 2024-05-09T06:29:57.616 INFO:tasks.workunit.client.0.smithi062.stdout:2/454: creat d0/d9/d17/d37/d69/f8e x:0 0 0 2024-05-09T06:29:57.616 INFO:tasks.workunit.client.0.smithi062.stdout:2/455: read d0/fa [3596346,115648] 0 2024-05-09T06:29:57.617 INFO:tasks.workunit.client.0.smithi062.stdout:1/377: mknod d8/d14/d2b/d3c/d7d/c82 0 2024-05-09T06:29:57.619 INFO:tasks.workunit.client.0.smithi062.stdout:7/495: dwrite d0/f6e [0,4194304] 0 2024-05-09T06:29:57.621 INFO:tasks.workunit.client.0.smithi062.stdout:8/604: dwrite da/d77/f94 [0,4194304] 0 2024-05-09T06:29:57.621 INFO:tasks.workunit.client.0.smithi062.stdout:8/605: readlink da/d11/d2e/d61/d64/la4 0 2024-05-09T06:29:57.622 INFO:tasks.workunit.client.0.smithi062.stdout:0/419: dwrite d1/d25/d31/d6c/f66 [0,4194304] 0 2024-05-09T06:29:57.622 INFO:tasks.workunit.client.0.smithi062.stdout:4/535: dwrite d0/d2a/f99 [0,4194304] 0 2024-05-09T06:29:57.629 INFO:tasks.workunit.client.0.smithi062.stdout:6/545: dread dc/d28/d10/d20/d5b/f6d [0,4194304] 0 2024-05-09T06:29:57.629 INFO:tasks.workunit.client.0.smithi062.stdout:6/546: readlink dc/d28/d46/d4a/d5d/d6f/l7d 0 2024-05-09T06:29:57.631 INFO:tasks.workunit.client.0.smithi062.stdout:2/456: dwrite d0/d9/d38/d41/f51 [0,4194304] 0 2024-05-09T06:29:57.635 INFO:tasks.workunit.client.0.smithi062.stdout:4/536: read d0/d2a/d14/d4f/d6b/f32 [2733865,100259] 0 2024-05-09T06:29:57.635 INFO:tasks.workunit.client.0.smithi062.stdout:4/537: chown d0/d9/l9d 311740 1 2024-05-09T06:29:57.635 INFO:tasks.workunit.client.0.smithi062.stdout:4/538: fsync d0/d9/d8d/f91 0 2024-05-09T06:29:57.639 INFO:tasks.workunit.client.0.smithi062.stdout:6/547: dread dc/d28/d10/d20/d5b/f6d [0,4194304] 0 2024-05-09T06:29:57.640 INFO:tasks.workunit.client.0.smithi062.stdout:6/548: dread dc/d28/d46/f29 [0,4194304] 0 2024-05-09T06:29:57.641 INFO:tasks.workunit.client.0.smithi062.stdout:7/496: mknod d0/d12/d33/c9d 0 2024-05-09T06:29:57.642 INFO:tasks.workunit.client.0.smithi062.stdout:4/539: write d0/d2a/d1f/f70 [1218321,69681] 0 2024-05-09T06:29:57.642 INFO:tasks.workunit.client.0.smithi062.stdout:4/540: read d0/d2a/d14/d7e/d8e/d9e/d28/d31/f39 [39157,65603] 0 2024-05-09T06:29:57.643 INFO:tasks.workunit.client.0.smithi062.stdout:8/606: creat da/d11/d2e/d61/d92/da5/db2/fbc x:0 0 0 2024-05-09T06:29:57.648 INFO:tasks.workunit.client.0.smithi062.stdout:2/457: dwrite d0/d9/dd/f5e [0,4194304] 0 2024-05-09T06:29:57.649 INFO:tasks.workunit.client.0.smithi062.stdout:8/607: read f8 [639031,61305] 0 2024-05-09T06:29:57.656 INFO:tasks.workunit.client.0.smithi062.stdout:6/549: creat dc/d28/d46/d3a/d7f/d91/fb4 x:0 0 0 2024-05-09T06:29:57.657 INFO:tasks.workunit.client.0.smithi062.stdout:7/497: getdents d0/d3a/d51/d64/d6d/d88 0 2024-05-09T06:29:57.659 INFO:tasks.workunit.client.0.smithi062.stdout:4/541: mkdir d0/d3c/da1 0 2024-05-09T06:29:57.659 INFO:tasks.workunit.client.0.smithi062.stdout:4/542: dread - d0/d2a/d14/d4f/d6b/f4d zero size 2024-05-09T06:29:57.660 INFO:tasks.workunit.client.0.smithi062.stdout:0/420: getdents d1/d25/d31/d6c/d44/d57/d75 0 2024-05-09T06:29:57.660 INFO:tasks.workunit.client.0.smithi062.stdout:0/421: creat d1/d25/d59/f97 x:0 0 0 2024-05-09T06:29:57.662 INFO:tasks.workunit.client.0.smithi062.stdout:2/458: mkdir d0/d9/d17/d89/d8f 0 2024-05-09T06:29:57.666 INFO:tasks.workunit.client.0.smithi062.stdout:7/498: mkdir d0/d12/d66/d9e 0 2024-05-09T06:29:57.668 INFO:tasks.workunit.client.0.smithi062.stdout:4/543: write d0/d9/f72 [4002142,8401] 0 2024-05-09T06:29:57.669 INFO:tasks.workunit.client.0.smithi062.stdout:0/422: link d1/d25/d31/f3b d1/d25/d31/f98 0 2024-05-09T06:29:57.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/499: dread d0/d3/f3e [0,4194304] 0 2024-05-09T06:29:57.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/500: truncate d0/f6e 4429071 0 2024-05-09T06:29:57.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/501: write d0/d3/fd [495004,106959] 0 2024-05-09T06:29:57.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/502: chown d0/d3a/d3f 45756 1 2024-05-09T06:29:57.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/503: chown d0/d3a/d51/l96 1054752898 1 2024-05-09T06:29:57.678 INFO:tasks.workunit.client.0.smithi062.stdout:0/423: write d1/d18/f35 [4553324,89167] 0 2024-05-09T06:29:57.687 INFO:tasks.workunit.client.0.smithi062.stdout:4/544: dwrite d0/f1e [8388608,4194304] 0 2024-05-09T06:29:57.687 INFO:tasks.workunit.client.0.smithi062.stdout:4/545: readlink d0/d5b/d85/l63 0 2024-05-09T06:29:57.690 INFO:tasks.workunit.client.0.smithi062.stdout:2/459: rmdir d0/d9/dd/d65/d6d 39 2024-05-09T06:29:57.694 INFO:tasks.workunit.client.0.smithi062.stdout:6/550: rename dc/d28/d34/d41 to dc/d28/d10/d20/db5 0 2024-05-09T06:29:57.694 INFO:tasks.workunit.client.0.smithi062.stdout:6/551: fdatasync f4 0 2024-05-09T06:29:57.697 INFO:tasks.workunit.client.0.smithi062.stdout:0/424: dwrite d1/d25/d49/d4f/f90 [0,4194304] 0 2024-05-09T06:29:57.697 INFO:tasks.workunit.client.0.smithi062.stdout:0/425: truncate d1/d25/d59/f97 196955 0 2024-05-09T06:29:57.699 INFO:tasks.workunit.client.0.smithi062.stdout:7/504: mkdir d0/d12/d33/d9f 0 2024-05-09T06:29:57.700 INFO:tasks.workunit.client.0.smithi062.stdout:4/546: mknod d0/d3c/ca2 0 2024-05-09T06:29:57.700 INFO:tasks.workunit.client.0.smithi062.stdout:4/547: write d0/d2a/f99 [1534964,19452] 0 2024-05-09T06:29:57.702 INFO:tasks.workunit.client.0.smithi062.stdout:2/460: read d0/d9/d38/d41/d48/f4c [1532335,43690] 0 2024-05-09T06:29:57.702 INFO:tasks.workunit.client.0.smithi062.stdout:2/461: readlink d0/d9/d17/d37/d69/l82 0 2024-05-09T06:29:57.704 INFO:tasks.workunit.client.0.smithi062.stdout:6/552: mkdir dc/d28/d46/d3a/d7f/d91/d96/db6 0 2024-05-09T06:29:57.720 INFO:tasks.workunit.client.0.smithi062.stdout:6/553: dwrite dc/d42/f67 [0,4194304] 0 2024-05-09T06:29:57.722 INFO:tasks.workunit.client.0.smithi062.stdout:7/505: creat d0/d3a/d51/d64/d6d/d80/d8e/fa0 x:0 0 0 2024-05-09T06:29:57.725 INFO:tasks.workunit.client.0.smithi062.stdout:4/548: stat d0/d2a/d14/d7e/d8e/d9e/c33 0 2024-05-09T06:29:57.725 INFO:tasks.workunit.client.0.smithi062.stdout:4/549: write d0/d2a/d14/d7e/f7c [1698770,126937] 0 2024-05-09T06:29:57.726 INFO:tasks.workunit.client.0.smithi062.stdout:4/550: chown d0/d2a/d8 113182453 1 2024-05-09T06:29:57.732 INFO:tasks.workunit.client.0.smithi062.stdout:7/506: rename d0/d3/f3e to d0/d12/d33/d67/fa1 0 2024-05-09T06:29:57.733 INFO:tasks.workunit.client.0.smithi062.stdout:4/551: link d0/d2a/d4b/f89 d0/d2a/d14/d7e/d8e/fa3 0 2024-05-09T06:29:57.735 INFO:tasks.workunit.client.0.smithi062.stdout:2/462: mkdir d0/d90 0 2024-05-09T06:29:57.739 INFO:tasks.workunit.client.0.smithi062.stdout:6/554: rmdir dc/d28/d46/d3a 39 2024-05-09T06:29:57.739 INFO:tasks.workunit.client.0.smithi062.stdout:6/555: write dc/d28/d10/f1c [1343132,79509] 0 2024-05-09T06:29:57.742 INFO:tasks.workunit.client.0.smithi062.stdout:7/507: creat d0/d3a/d51/d64/d6d/d88/fa2 x:0 0 0 2024-05-09T06:29:57.742 INFO:tasks.workunit.client.0.smithi062.stdout:7/508: dread - d0/d3a/f91 zero size 2024-05-09T06:29:57.742 INFO:tasks.workunit.client.0.smithi062.stdout:4/552: symlink d0/d3c/da1/la4 0 2024-05-09T06:29:57.747 INFO:tasks.workunit.client.0.smithi062.stdout:2/463: mkdir d0/d9/d17/d89/d8f/d91 0 2024-05-09T06:29:57.750 INFO:tasks.workunit.client.0.smithi062.stdout:6/556: rename dc/d28/d46/d82/dab to dc/d28/d34/db7 0 2024-05-09T06:29:57.751 INFO:tasks.workunit.client.0.smithi062.stdout:4/553: symlink d0/d2a/la5 0 2024-05-09T06:29:57.751 INFO:tasks.workunit.client.0.smithi062.stdout:4/554: dread - d0/d2a/d14/d7e/f73 zero size 2024-05-09T06:29:57.754 INFO:tasks.workunit.client.0.smithi062.stdout:9/501: sync 2024-05-09T06:29:57.754 INFO:tasks.workunit.client.0.smithi062.stdout:5/497: sync 2024-05-09T06:29:57.754 INFO:tasks.workunit.client.0.smithi062.stdout:3/422: sync 2024-05-09T06:29:57.754 INFO:tasks.workunit.client.0.smithi062.stdout:3/423: stat d1/f1f 0 2024-05-09T06:29:57.754 INFO:tasks.workunit.client.0.smithi062.stdout:6/557: rename dc/l19 to dc/d28/d46/d3a/d7f/d8e/lb8 0 2024-05-09T06:29:57.756 INFO:tasks.workunit.client.0.smithi062.stdout:7/509: dwrite d0/d3a/d51/d64/d6d/d88/f8a [0,4194304] 0 2024-05-09T06:29:57.763 INFO:tasks.workunit.client.0.smithi062.stdout:9/502: rename d3/d3e/d52/d58/f35 to d3/d3e/d52/d58/d1c/d1e/fa3 0 2024-05-09T06:29:57.764 INFO:tasks.workunit.client.0.smithi062.stdout:9/503: write d3/d3e/d52/d58/d1c/d1e/fa3 [435846,112669] 0 2024-05-09T06:29:57.765 INFO:tasks.workunit.client.0.smithi062.stdout:3/424: dread d1/d1e/f24 [0,4194304] 0 2024-05-09T06:29:57.765 INFO:tasks.workunit.client.0.smithi062.stdout:3/425: write d1/d1e/f25 [357529,91406] 0 2024-05-09T06:29:57.768 INFO:tasks.workunit.client.0.smithi062.stdout:2/464: dwrite d0/f3a [0,4194304] 0 2024-05-09T06:29:57.768 INFO:tasks.workunit.client.0.smithi062.stdout:2/465: write d0/d9/d38/f60 [1748068,128054] 0 2024-05-09T06:29:57.768 INFO:tasks.workunit.client.0.smithi062.stdout:2/466: creat d0/d9/dd/f92 x:0 0 0 2024-05-09T06:29:57.768 INFO:tasks.workunit.client.0.smithi062.stdout:2/467: stat d0/d9/d17/d37/d69 0 2024-05-09T06:29:57.768 INFO:tasks.workunit.client.0.smithi062.stdout:6/558: truncate dc/d28/d46/d4a/d5d/d6f/d76/f87 446728 0 2024-05-09T06:29:57.769 INFO:tasks.workunit.client.0.smithi062.stdout:6/559: creat dc/d28/d10/d20/fb9 x:0 0 0 2024-05-09T06:29:57.770 INFO:tasks.workunit.client.0.smithi062.stdout:4/555: getdents d0/d9 0 2024-05-09T06:29:57.770 INFO:tasks.workunit.client.0.smithi062.stdout:4/556: truncate d0/d2a/d14/d4f/d6b/f4d 592994 0 2024-05-09T06:29:57.770 INFO:tasks.workunit.client.0.smithi062.stdout:4/557: truncate d0/d2a/d14/d4f/f60 1593415 0 2024-05-09T06:29:57.770 INFO:tasks.workunit.client.0.smithi062.stdout:4/558: chown d0/d2a/d14/d4f/d6b/f4d 244201 1 2024-05-09T06:29:57.774 INFO:tasks.workunit.client.0.smithi062.stdout:4/559: dread d0/d2a/d14/d7e/d8e/d9e/d28/d31/f58 [0,4194304] 0 2024-05-09T06:29:57.778 INFO:tasks.workunit.client.0.smithi062.stdout:5/498: rmdir d0/d8/d18 39 2024-05-09T06:29:57.778 INFO:tasks.workunit.client.0.smithi062.stdout:5/499: creat d0/d11/fab x:0 0 0 2024-05-09T06:29:57.778 INFO:tasks.workunit.client.0.smithi062.stdout:9/504: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/f2d [0,4194304] 0 2024-05-09T06:29:57.786 INFO:tasks.workunit.client.0.smithi062.stdout:5/500: dread d0/d8/d1c/d23/f48 [0,4194304] 0 2024-05-09T06:29:57.786 INFO:tasks.workunit.client.0.smithi062.stdout:7/510: rename d0/f76 to d0/d3a/d51/d64/d6d/d80/fa3 0 2024-05-09T06:29:57.789 INFO:tasks.workunit.client.0.smithi062.stdout:3/426: symlink d1/d1e/d26/d33/d4f/l94 0 2024-05-09T06:29:57.796 INFO:tasks.workunit.client.0.smithi062.stdout:9/505: dwrite d3/d3e/d52/d58/d77/d92/f9e [0,4194304] 0 2024-05-09T06:29:57.809 INFO:tasks.workunit.client.0.smithi062.stdout:4/560: creat d0/d2a/d14/d7e/d8e/d9e/d86/fa6 x:0 0 0 2024-05-09T06:29:57.843 INFO:tasks.workunit.client.0.smithi062.stdout:5/501: truncate d0/d8/f52 2288975 0 2024-05-09T06:29:57.843 INFO:tasks.workunit.client.0.smithi062.stdout:5/502: truncate d0/d11/fab 6994 0 2024-05-09T06:29:57.851 INFO:tasks.workunit.client.0.smithi062.stdout:9/506: link d3/d3e/d52/d58/d77/l83 d3/d3e/d52/d58/d1c/d1e/la4 0 2024-05-09T06:29:57.851 INFO:tasks.workunit.client.0.smithi062.stdout:9/507: write d3/d3e/d52/d58/d1c/d1e/f4c [190385,56024] 0 2024-05-09T06:29:57.855 INFO:tasks.workunit.client.0.smithi062.stdout:4/561: mkdir d0/d2a/d14/d4f/da7 0 2024-05-09T06:29:57.858 INFO:tasks.workunit.client.0.smithi062.stdout:5/503: link d0/d56/d45/d92/f9b d0/d56/d45/d92/fac 0 2024-05-09T06:29:57.858 INFO:tasks.workunit.client.0.smithi062.stdout:7/511: rmdir d0/d3a/d3f 39 2024-05-09T06:29:57.858 INFO:tasks.workunit.client.0.smithi062.stdout:7/512: fsync d0/d12/f43 0 2024-05-09T06:29:57.863 INFO:tasks.workunit.client.0.smithi062.stdout:3/427: getdents d1/d1e/d26 0 2024-05-09T06:29:57.867 INFO:tasks.workunit.client.0.smithi062.stdout:4/562: rename d0/d2a/d1f/d6c/c82 to d0/d2a/d14/d4f/ca8 0 2024-05-09T06:29:57.868 INFO:tasks.workunit.client.0.smithi062.stdout:7/513: getdents d0/d3 0 2024-05-09T06:29:57.874 INFO:tasks.workunit.client.0.smithi062.stdout:4/563: getdents d0/d3c 0 2024-05-09T06:29:57.876 INFO:tasks.workunit.client.0.smithi062.stdout:7/514: getdents d0/d3a 0 2024-05-09T06:29:57.879 INFO:tasks.workunit.client.0.smithi062.stdout:4/564: rename d0/d2a/d1f/d9f to d0/da9 0 2024-05-09T06:29:57.882 INFO:tasks.workunit.client.0.smithi062.stdout:7/515: mknod d0/d3a/ca4 0 2024-05-09T06:29:57.886 INFO:tasks.workunit.client.0.smithi062.stdout:4/565: creat d0/d2a/d1f/faa x:0 0 0 2024-05-09T06:29:57.887 INFO:tasks.workunit.client.0.smithi062.stdout:5/504: dwrite d0/d8/d1c/d23/f4f [0,4194304] 0 2024-05-09T06:29:57.887 INFO:tasks.workunit.client.0.smithi062.stdout:3/428: dwrite d1/d1e/d36/d3a/f4d [0,4194304] 0 2024-05-09T06:29:57.887 INFO:tasks.workunit.client.0.smithi062.stdout:3/429: fsync d1/d1e/d36/d3a/f4d 0 2024-05-09T06:29:57.894 INFO:tasks.workunit.client.0.smithi062.stdout:4/566: write d0/d2a/f4 [3239064,112470] 0 2024-05-09T06:29:57.903 INFO:tasks.workunit.client.0.smithi062.stdout:7/516: dwrite d0/d12/f71 [0,4194304] 0 2024-05-09T06:29:57.904 INFO:tasks.workunit.client.0.smithi062.stdout:5/505: dwrite d0/d8/d18/f64 [0,4194304] 0 2024-05-09T06:29:57.974 INFO:tasks.workunit.client.0.smithi062.stdout:3/430: getdents d1/d1e/d26/d43/d92 0 2024-05-09T06:29:57.979 INFO:tasks.workunit.client.0.smithi062.stdout:4/567: rename d0/d2a/f5 to d0/d2a/d14/d7e/d8e/d9e/d86/d94/fab 0 2024-05-09T06:29:57.987 INFO:tasks.workunit.client.0.smithi062.stdout:5/506: mkdir d0/d8/d1c/d23/d3e/dad 0 2024-05-09T06:29:57.987 INFO:tasks.workunit.client.0.smithi062.stdout:5/507: fdatasync d0/d8/d1c/f62 0 2024-05-09T06:29:57.988 INFO:tasks.workunit.client.0.smithi062.stdout:5/508: dread d0/f74 [0,4194304] 0 2024-05-09T06:29:57.989 INFO:tasks.workunit.client.0.smithi062.stdout:5/509: write d0/d8/d18/f78 [4307806,4620] 0 2024-05-09T06:29:57.989 INFO:tasks.workunit.client.0.smithi062.stdout:5/510: write d0/d56/f9e [733881,37482] 0 2024-05-09T06:29:57.990 INFO:tasks.workunit.client.0.smithi062.stdout:3/431: link d1/f1f d1/d1e/d26/d43/d52/f95 0 2024-05-09T06:29:57.992 INFO:tasks.workunit.client.0.smithi062.stdout:4/568: rename d0/d2a/d14/d4f/f55 to d0/d9/d8d/fac 0 2024-05-09T06:29:57.992 INFO:tasks.workunit.client.0.smithi062.stdout:4/569: fdatasync d0/d2a/d8/f4a 0 2024-05-09T06:29:57.992 INFO:tasks.workunit.client.0.smithi062.stdout:4/570: chown d0/d2a/d14/d7e/d8e/d9e/d28/f41 17843 1 2024-05-09T06:29:57.997 INFO:tasks.workunit.client.0.smithi062.stdout:4/571: dread d0/d2a/d14/d7e/f7c [0,4194304] 0 2024-05-09T06:29:58.000 INFO:tasks.workunit.client.0.smithi062.stdout:5/511: dread d0/d56/d45/f75 [0,4194304] 0 2024-05-09T06:29:58.002 INFO:tasks.workunit.client.0.smithi062.stdout:4/572: rename d0/d2a/l2b to d0/d5b/d85/lad 0 2024-05-09T06:29:58.003 INFO:tasks.workunit.client.0.smithi062.stdout:5/512: mkdir d0/d56/d86/dae 0 2024-05-09T06:29:58.003 INFO:tasks.workunit.client.0.smithi062.stdout:5/513: chown d0/d8/d1c/d2c/d7d/d4a/l68 85398888 1 2024-05-09T06:29:58.004 INFO:tasks.workunit.client.0.smithi062.stdout:4/573: mkdir d0/d3c/dae 0 2024-05-09T06:29:58.004 INFO:tasks.workunit.client.0.smithi062.stdout:4/574: dread - d0/d9/d8d/f91 zero size 2024-05-09T06:29:58.005 INFO:tasks.workunit.client.0.smithi062.stdout:5/514: creat d0/d56/d45/da5/faf x:0 0 0 2024-05-09T06:29:58.010 INFO:tasks.workunit.client.0.smithi062.stdout:3/432: dwrite d1/d1e/d26/f3c [0,4194304] 0 2024-05-09T06:29:58.122 INFO:tasks.workunit.client.0.smithi062.stdout:1/378: sync 2024-05-09T06:29:58.131 INFO:tasks.workunit.client.0.smithi062.stdout:4/575: rename d0/d9/d8d to d0/d2a/d8/d69/daf 0 2024-05-09T06:29:58.131 INFO:tasks.workunit.client.0.smithi062.stdout:5/515: rename d0/d3b to d0/d3b/db0 22 2024-05-09T06:29:58.131 INFO:tasks.workunit.client.0.smithi062.stdout:5/516: truncate d0/f37 4339379 0 2024-05-09T06:29:58.136 INFO:tasks.workunit.client.0.smithi062.stdout:4/576: mkdir d0/d3c/dae/db0 0 2024-05-09T06:29:58.139 INFO:tasks.workunit.client.0.smithi062.stdout:3/433: rename d1/d1e/f2c to d1/d1e/d26/d33/d4f/f96 0 2024-05-09T06:29:58.154 INFO:tasks.workunit.client.0.smithi062.stdout:1/379: dwrite d8/f54 [0,4194304] 0 2024-05-09T06:29:58.161 INFO:tasks.workunit.client.0.smithi062.stdout:3/434: dwrite d1/d1e/d26/f3c [0,4194304] 0 2024-05-09T06:29:58.171 INFO:tasks.workunit.client.0.smithi062.stdout:1/380: link d8/d14/f1b d8/d14/d2b/d3c/d44/d64/f83 0 2024-05-09T06:29:58.171 INFO:tasks.workunit.client.0.smithi062.stdout:1/381: write d8/f31 [13629990,99821] 0 2024-05-09T06:29:58.171 INFO:tasks.workunit.client.0.smithi062.stdout:1/382: chown d8/d14/c65 341314 1 2024-05-09T06:29:58.172 INFO:tasks.workunit.client.0.smithi062.stdout:0/426: sync 2024-05-09T06:29:58.172 INFO:tasks.workunit.client.0.smithi062.stdout:6/560: sync 2024-05-09T06:29:58.172 INFO:tasks.workunit.client.0.smithi062.stdout:8/608: sync 2024-05-09T06:29:58.172 INFO:tasks.workunit.client.0.smithi062.stdout:0/427: fsync d1/d25/d49/d3c/f3f 0 2024-05-09T06:29:58.172 INFO:tasks.workunit.client.0.smithi062.stdout:0/428: chown d1/d25/f86 47348 1 2024-05-09T06:29:58.172 INFO:tasks.workunit.client.0.smithi062.stdout:2/468: sync 2024-05-09T06:29:58.172 INFO:tasks.workunit.client.0.smithi062.stdout:4/577: rmdir d0/d2a/d8 39 2024-05-09T06:29:58.173 INFO:tasks.workunit.client.0.smithi062.stdout:4/578: chown d0 297 1 2024-05-09T06:29:58.173 INFO:tasks.workunit.client.0.smithi062.stdout:4/579: chown d0/c76 7112959 1 2024-05-09T06:29:58.173 INFO:tasks.workunit.client.0.smithi062.stdout:4/580: read d0/d2a/d14/d4f/d6b/f32 [3952616,12642] 0 2024-05-09T06:29:58.173 INFO:tasks.workunit.client.0.smithi062.stdout:4/581: truncate d0/f57 4616048 0 2024-05-09T06:29:58.173 INFO:tasks.workunit.client.0.smithi062.stdout:4/582: chown d0/d2a/d14/d4f/f9c 6681 1 2024-05-09T06:29:58.173 INFO:tasks.workunit.client.0.smithi062.stdout:4/583: chown d0/d3c/dae 125 1 2024-05-09T06:29:58.184 INFO:tasks.workunit.client.0.smithi062.stdout:1/383: creat d8/d14/d2b/d3c/d44/d6e/d7a/f84 x:0 0 0 2024-05-09T06:29:58.184 INFO:tasks.workunit.client.0.smithi062.stdout:1/384: write d8/f5a [1048947,41670] 0 2024-05-09T06:29:58.184 INFO:tasks.workunit.client.0.smithi062.stdout:1/385: stat d8/d14/d2b/d3c/d44/d64/f6f 0 2024-05-09T06:29:58.184 INFO:tasks.workunit.client.0.smithi062.stdout:1/386: creat d8/d2c/d7c/f85 x:0 0 0 2024-05-09T06:29:58.185 INFO:tasks.workunit.client.0.smithi062.stdout:8/609: mknod da/d95/cbd 0 2024-05-09T06:29:58.187 INFO:tasks.workunit.client.0.smithi062.stdout:6/561: mkdir dc/d28/d46/d82/d98/db3/dba 0 2024-05-09T06:29:58.190 INFO:tasks.workunit.client.0.smithi062.stdout:2/469: unlink d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f87 0 2024-05-09T06:29:58.191 INFO:tasks.workunit.client.0.smithi062.stdout:2/470: fdatasync d0/d9/dd/f6c 0 2024-05-09T06:29:58.191 INFO:tasks.workunit.client.0.smithi062.stdout:2/471: dread - d0/d9/dd/f92 zero size 2024-05-09T06:29:58.191 INFO:tasks.workunit.client.0.smithi062.stdout:4/584: truncate d0/d2a/d14/d7e/d8e/d9e/d28/f71 731772 0 2024-05-09T06:29:58.202 INFO:tasks.workunit.client.0.smithi062.stdout:1/387: symlink d8/d14/d2b/d3c/d44/d7f/l86 0 2024-05-09T06:29:58.202 INFO:tasks.workunit.client.0.smithi062.stdout:8/610: dwrite da/d11/d2e/d34/fb4 [0,4194304] 0 2024-05-09T06:29:58.203 INFO:tasks.workunit.client.0.smithi062.stdout:6/562: mknod dc/d28/d46/d4a/cbb 0 2024-05-09T06:29:58.203 INFO:tasks.workunit.client.0.smithi062.stdout:6/563: chown dc/d28/d10/d20/d5b/f6d 276830 1 2024-05-09T06:29:58.205 INFO:tasks.workunit.client.0.smithi062.stdout:2/472: unlink d0/d9/dd/d65/d6d/c2b 0 2024-05-09T06:29:58.205 INFO:tasks.workunit.client.0.smithi062.stdout:2/473: readlink d0/d9/dd/d65/d6d/d21/d29/d40/l8b 0 2024-05-09T06:29:58.206 INFO:tasks.workunit.client.0.smithi062.stdout:2/474: fsync d0/d9/dd/d65/d6d/d21/f5b 0 2024-05-09T06:29:58.207 INFO:tasks.workunit.client.0.smithi062.stdout:4/585: creat d0/d2a/d14/d7e/d8e/d9e/d28/fb1 x:0 0 0 2024-05-09T06:29:58.207 INFO:tasks.workunit.client.0.smithi062.stdout:7/517: sync 2024-05-09T06:29:58.208 INFO:tasks.workunit.client.0.smithi062.stdout:9/508: sync 2024-05-09T06:29:58.208 INFO:tasks.workunit.client.0.smithi062.stdout:7/518: write d0/d3/f2b [844727,17699] 0 2024-05-09T06:29:58.208 INFO:tasks.workunit.client.0.smithi062.stdout:7/519: read d0/f20 [381934,91442] 0 2024-05-09T06:29:58.210 INFO:tasks.workunit.client.0.smithi062.stdout:8/611: rename da/l10 to da/d85/lbe 0 2024-05-09T06:29:58.213 INFO:tasks.workunit.client.0.smithi062.stdout:6/564: creat dc/d28/d46/d81/dad/fbc x:0 0 0 2024-05-09T06:29:58.214 INFO:tasks.workunit.client.0.smithi062.stdout:2/475: mkdir d0/d9/dd/d65/d6d/d7e/d8d/d93 0 2024-05-09T06:29:58.217 INFO:tasks.workunit.client.0.smithi062.stdout:4/586: link d0/d2a/d14/d4f/d6b/c38 d0/d2a/d4b/d81/cb2 0 2024-05-09T06:29:58.217 INFO:tasks.workunit.client.0.smithi062.stdout:4/587: truncate d0/d2a/f8f 336374 0 2024-05-09T06:29:58.218 INFO:tasks.workunit.client.0.smithi062.stdout:8/612: dread da/d11/d2e/d61/d92/da5/daf/fba [0,4194304] 0 2024-05-09T06:29:58.218 INFO:tasks.workunit.client.0.smithi062.stdout:8/613: dread - da/f82 zero size 2024-05-09T06:29:58.218 INFO:tasks.workunit.client.0.smithi062.stdout:8/614: creat da/d11/d2e/d34/d90/fbf x:0 0 0 2024-05-09T06:29:58.218 INFO:tasks.workunit.client.0.smithi062.stdout:8/615: creat da/d11/d2e/d61/d92/da5/daf/fc0 x:0 0 0 2024-05-09T06:29:58.220 INFO:tasks.workunit.client.0.smithi062.stdout:9/509: rename d3/d3e/d52/d58/d1c/d1e/d41/f4f to d3/d20/fa5 0 2024-05-09T06:29:58.252 INFO:tasks.workunit.client.0.smithi062.stdout:4/588: dwrite d0/d2a/d4b/f89 [0,4194304] 0 2024-05-09T06:29:58.261 INFO:tasks.workunit.client.0.smithi062.stdout:8/616: dwrite da/d11/d2e/d61/d92/da5/fab [0,4194304] 0 2024-05-09T06:29:58.264 INFO:tasks.workunit.client.0.smithi062.stdout:9/510: dwrite d3/d3e/d52/d58/d1c/d21/f53 [0,4194304] 0 2024-05-09T06:29:58.264 INFO:tasks.workunit.client.0.smithi062.stdout:7/520: dwrite d0/f28 [0,4194304] 0 2024-05-09T06:29:58.273 INFO:tasks.workunit.client.0.smithi062.stdout:9/511: dread d3/d3e/d52/d58/d1c/d1e/d60/f73 [0,4194304] 0 2024-05-09T06:29:58.273 INFO:tasks.workunit.client.0.smithi062.stdout:9/512: write d3/f18 [201384,11442] 0 2024-05-09T06:29:58.281 INFO:tasks.workunit.client.0.smithi062.stdout:9/513: read d3/f86 [533080,118422] 0 2024-05-09T06:29:58.286 INFO:tasks.workunit.client.0.smithi062.stdout:6/565: unlink dc/d28/d10/c3f 0 2024-05-09T06:29:58.288 INFO:tasks.workunit.client.0.smithi062.stdout:2/476: mkdir d0/d9/d38/d41/d94 0 2024-05-09T06:29:58.291 INFO:tasks.workunit.client.0.smithi062.stdout:4/589: symlink d0/d2a/d8/d69/lb3 0 2024-05-09T06:29:58.291 INFO:tasks.workunit.client.0.smithi062.stdout:4/590: fdatasync d0/d2a/d1f/d6c/f95 0 2024-05-09T06:29:58.294 INFO:tasks.workunit.client.0.smithi062.stdout:8/617: symlink da/d11/d2e/d61/d92/lc1 0 2024-05-09T06:29:58.295 INFO:tasks.workunit.client.0.smithi062.stdout:6/566: dread dc/d28/d34/d4e/d57/f65 [0,4194304] 0 2024-05-09T06:29:58.304 INFO:tasks.workunit.client.0.smithi062.stdout:9/514: truncate d3/d3e/d52/d58/f8e 2487718 0 2024-05-09T06:29:58.304 INFO:tasks.workunit.client.0.smithi062.stdout:9/515: write d3/d3e/d52/d58/f71 [189942,117490] 0 2024-05-09T06:29:58.304 INFO:tasks.workunit.client.0.smithi062.stdout:9/516: fsync d3/d3e/d52/d58/d1c/d1e/d41/f65 0 2024-05-09T06:29:58.307 INFO:tasks.workunit.client.0.smithi062.stdout:4/591: getdents d0/d2a/d14/d7e/d8e/d9e 0 2024-05-09T06:29:58.308 INFO:tasks.workunit.client.0.smithi062.stdout:8/618: mknod da/d11/d1c/d9e/d9f/cc2 0 2024-05-09T06:29:58.311 INFO:tasks.workunit.client.0.smithi062.stdout:6/567: creat dc/d28/d10/d20/d5b/d77/fbd x:0 0 0 2024-05-09T06:29:58.312 INFO:tasks.workunit.client.0.smithi062.stdout:7/521: symlink d0/d3a/d51/d64/d6d/d80/la5 0 2024-05-09T06:29:58.315 INFO:tasks.workunit.client.0.smithi062.stdout:9/517: link d3/d3e/d52/d58/d77/d92/f96 d3/d3e/d4b/d99/fa6 0 2024-05-09T06:29:58.317 INFO:tasks.workunit.client.0.smithi062.stdout:2/477: rmdir d0/d9/d17 39 2024-05-09T06:29:58.317 INFO:tasks.workunit.client.0.smithi062.stdout:2/478: fsync d0/f78 0 2024-05-09T06:29:58.318 INFO:tasks.workunit.client.0.smithi062.stdout:4/592: mknod d0/d3c/da1/cb4 0 2024-05-09T06:29:58.321 INFO:tasks.workunit.client.0.smithi062.stdout:6/568: creat dc/d28/d34/d4e/fbe x:0 0 0 2024-05-09T06:29:58.323 INFO:tasks.workunit.client.0.smithi062.stdout:9/518: dread d3/d3e/d52/d58/d1c/d1e/f5f [0,4194304] 0 2024-05-09T06:29:58.323 INFO:tasks.workunit.client.0.smithi062.stdout:9/519: write d3/d3e/d52/d58/d1c/f6a [108318,46297] 0 2024-05-09T06:29:58.324 INFO:tasks.workunit.client.0.smithi062.stdout:7/522: dread d0/d12/f71 [0,4194304] 0 2024-05-09T06:29:58.324 INFO:tasks.workunit.client.0.smithi062.stdout:7/523: write d0/f77 [5045195,35294] 0 2024-05-09T06:29:58.324 INFO:tasks.workunit.client.0.smithi062.stdout:4/593: dread d0/d2a/d8/f4a [0,4194304] 0 2024-05-09T06:29:58.324 INFO:tasks.workunit.client.0.smithi062.stdout:4/594: write d0/d2a/d1f/f22 [2247156,35404] 0 2024-05-09T06:29:58.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/569: unlink dc/d28/d10/d20/d5b/d77/fbd 0 2024-05-09T06:29:58.326 INFO:tasks.workunit.client.0.smithi062.stdout:2/479: write d0/f39 [10389030,17926] 0 2024-05-09T06:29:58.333 INFO:tasks.workunit.client.0.smithi062.stdout:9/520: getdents d3/d20 0 2024-05-09T06:29:58.336 INFO:tasks.workunit.client.0.smithi062.stdout:8/619: dwrite da/d11/d2e/d7e/fa9 [0,4194304] 0 2024-05-09T06:29:58.337 INFO:tasks.workunit.client.0.smithi062.stdout:4/595: write d0/d2a/d4b/f64 [4009213,25532] 0 2024-05-09T06:29:58.337 INFO:tasks.workunit.client.0.smithi062.stdout:4/596: write d0/d3c/f88 [334878,11293] 0 2024-05-09T06:29:58.342 INFO:tasks.workunit.client.0.smithi062.stdout:7/524: rename d0/d3a/l7a to d0/d12/d66/d9e/la6 0 2024-05-09T06:29:58.343 INFO:tasks.workunit.client.0.smithi062.stdout:9/521: getdents d3/d3e 0 2024-05-09T06:29:58.343 INFO:tasks.workunit.client.0.smithi062.stdout:9/522: fdatasync d3/d3e/d52/d58/d1c/f76 0 2024-05-09T06:29:58.343 INFO:tasks.workunit.client.0.smithi062.stdout:7/525: dread d0/d12/d33/f55 [0,4194304] 0 2024-05-09T06:29:58.346 INFO:tasks.workunit.client.0.smithi062.stdout:8/620: rename da/d11/d2e/d34/d90/lb9 to da/d11/d2e/d61/d92/lc3 0 2024-05-09T06:29:58.346 INFO:tasks.workunit.client.0.smithi062.stdout:8/621: write da/f6c [1522583,25902] 0 2024-05-09T06:29:58.346 INFO:tasks.workunit.client.0.smithi062.stdout:8/622: creat da/d11/d2e/d34/d90/fc4 x:0 0 0 2024-05-09T06:29:58.346 INFO:tasks.workunit.client.0.smithi062.stdout:8/623: stat da/d11/d2e/d61/d64/la4 0 2024-05-09T06:29:58.347 INFO:tasks.workunit.client.0.smithi062.stdout:9/523: link d3/d3e/d52/d58/d1c/d1e/d41/l9b d3/la7 0 2024-05-09T06:29:58.348 INFO:tasks.workunit.client.0.smithi062.stdout:7/526: dread d0/d3a/f5f [0,4194304] 0 2024-05-09T06:29:58.349 INFO:tasks.workunit.client.0.smithi062.stdout:8/624: mknod da/d11/d1c/d9e/d9f/cc5 0 2024-05-09T06:29:58.349 INFO:tasks.workunit.client.0.smithi062.stdout:9/524: mknod d3/d3e/d52/d58/d1c/d1e/ca8 0 2024-05-09T06:29:58.350 INFO:tasks.workunit.client.0.smithi062.stdout:7/527: mkdir d0/d12/d33/d67/da7 0 2024-05-09T06:29:58.354 INFO:tasks.workunit.client.0.smithi062.stdout:6/570: dwrite dc/d28/d10/f4b [0,4194304] 0 2024-05-09T06:29:58.358 INFO:tasks.workunit.client.0.smithi062.stdout:4/597: dwrite d0/d2a/d14/d7e/d8e/d9e/d28/f41 [4194304,4194304] 0 2024-05-09T06:29:58.375 INFO:tasks.workunit.client.0.smithi062.stdout:8/625: dwrite da/d11/d1c/f9a [0,4194304] 0 2024-05-09T06:29:58.380 INFO:tasks.workunit.client.0.smithi062.stdout:9/525: dwrite d3/d3e/d52/d58/d1c/f6a [0,4194304] 0 2024-05-09T06:29:58.384 INFO:tasks.workunit.client.0.smithi062.stdout:6/571: dwrite dc/fd [4194304,4194304] 0 2024-05-09T06:29:58.384 INFO:tasks.workunit.client.0.smithi062.stdout:9/526: dread d3/d20/f7a [0,4194304] 0 2024-05-09T06:29:58.384 INFO:tasks.workunit.client.0.smithi062.stdout:6/572: truncate dc/d28/d46/d3a/d7f/d91/d93/f9b 195479 0 2024-05-09T06:29:58.384 INFO:tasks.workunit.client.0.smithi062.stdout:6/573: chown dc/d42/d70/l7a 0 1 2024-05-09T06:29:58.384 INFO:tasks.workunit.client.0.smithi062.stdout:7/528: rmdir d0/d12 39 2024-05-09T06:29:58.385 INFO:tasks.workunit.client.0.smithi062.stdout:8/626: rename da/f57 to da/d11/d2e/d34/d90/fc6 0 2024-05-09T06:29:58.386 INFO:tasks.workunit.client.0.smithi062.stdout:8/627: write da/d85/d8a/fa1 [1338585,108212] 0 2024-05-09T06:29:58.386 INFO:tasks.workunit.client.0.smithi062.stdout:4/598: dwrite d0/d2a/d14/d7e/d8e/d9e/d28/f62 [0,4194304] 0 2024-05-09T06:29:58.387 INFO:tasks.workunit.client.0.smithi062.stdout:4/599: fdatasync d0/d2a/d14/d7e/f7c 0 2024-05-09T06:29:58.387 INFO:tasks.workunit.client.0.smithi062.stdout:4/600: fsync d0/d9/f3e 0 2024-05-09T06:29:58.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/574: dread dc/d28/d34/d4e/f85 [0,4194304] 0 2024-05-09T06:29:58.398 INFO:tasks.workunit.client.0.smithi062.stdout:9/527: unlink d3/d3e/d52/d58/d1c/d1e/c8d 0 2024-05-09T06:29:58.399 INFO:tasks.workunit.client.0.smithi062.stdout:9/528: write d3/d3e/d52/d58/d1c/d1e/f5b [1240294,41198] 0 2024-05-09T06:29:58.401 INFO:tasks.workunit.client.0.smithi062.stdout:8/628: creat da/fc7 x:0 0 0 2024-05-09T06:29:58.401 INFO:tasks.workunit.client.0.smithi062.stdout:8/629: readlink da/l6e 0 2024-05-09T06:29:58.403 INFO:tasks.workunit.client.0.smithi062.stdout:4/601: symlink d0/d3c/lb5 0 2024-05-09T06:29:58.409 INFO:tasks.workunit.client.0.smithi062.stdout:6/575: dwrite dc/d28/d46/f80 [0,4194304] 0 2024-05-09T06:29:58.409 INFO:tasks.workunit.client.0.smithi062.stdout:6/576: stat dc 0 2024-05-09T06:29:58.409 INFO:tasks.workunit.client.0.smithi062.stdout:6/577: dread - dc/d28/d10/d20/fb9 zero size 2024-05-09T06:29:58.409 INFO:tasks.workunit.client.0.smithi062.stdout:9/529: rename d3/d20/fa5 to d3/d3e/d52/d58/d1c/fa9 0 2024-05-09T06:29:58.409 INFO:tasks.workunit.client.0.smithi062.stdout:9/530: truncate d3/d3e/d4b/f5c 2397913 0 2024-05-09T06:29:58.412 INFO:tasks.workunit.client.0.smithi062.stdout:7/529: mkdir d0/da8 0 2024-05-09T06:29:58.413 INFO:tasks.workunit.client.0.smithi062.stdout:8/630: creat da/d85/d8a/dbb/fc8 x:0 0 0 2024-05-09T06:29:58.413 INFO:tasks.workunit.client.0.smithi062.stdout:9/531: dread d3/d3e/d52/d58/d1c/d1e/f5b [0,4194304] 0 2024-05-09T06:29:58.415 INFO:tasks.workunit.client.0.smithi062.stdout:4/602: creat d0/d2a/d1f/d6c/fb6 x:0 0 0 2024-05-09T06:29:58.416 INFO:tasks.workunit.client.0.smithi062.stdout:4/603: fsync d0/d2a/d8/d69/daf/fac 0 2024-05-09T06:29:58.420 INFO:tasks.workunit.client.0.smithi062.stdout:6/578: getdents dc/d28/d46/d3a/d7f/d8e 0 2024-05-09T06:29:58.421 INFO:tasks.workunit.client.0.smithi062.stdout:7/530: creat d0/d12/d66/d9e/fa9 x:0 0 0 2024-05-09T06:29:58.421 INFO:tasks.workunit.client.0.smithi062.stdout:7/531: readlink d0/d3a/d51/d64/d6d/l72 0 2024-05-09T06:29:58.422 INFO:tasks.workunit.client.0.smithi062.stdout:7/532: fsync d0/f8d 0 2024-05-09T06:29:58.423 INFO:tasks.workunit.client.0.smithi062.stdout:8/631: link da/d11/l97 da/d11/d2e/d61/d92/da5/daf/lc9 0 2024-05-09T06:29:58.423 INFO:tasks.workunit.client.0.smithi062.stdout:8/632: creat da/d11/d2e/fca x:0 0 0 2024-05-09T06:29:58.424 INFO:tasks.workunit.client.0.smithi062.stdout:6/579: mkdir dc/d28/d46/d4a/dbf 0 2024-05-09T06:29:58.428 INFO:tasks.workunit.client.0.smithi062.stdout:7/533: link d0/d3a/d51/f23 d0/d12/d66/faa 0 2024-05-09T06:29:58.428 INFO:tasks.workunit.client.0.smithi062.stdout:9/532: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f43 [4194304,4194304] 0 2024-05-09T06:29:58.431 INFO:tasks.workunit.client.0.smithi062.stdout:8/633: unlink da/d11/f6d 0 2024-05-09T06:29:58.431 INFO:tasks.workunit.client.0.smithi062.stdout:8/634: readlink da/l31 0 2024-05-09T06:29:58.441 INFO:tasks.workunit.client.0.smithi062.stdout:9/533: creat d3/d3e/d52/d58/d1c/faa x:0 0 0 2024-05-09T06:29:58.442 INFO:tasks.workunit.client.0.smithi062.stdout:8/635: creat da/d11/d2e/d61/fcb x:0 0 0 2024-05-09T06:29:58.442 INFO:tasks.workunit.client.0.smithi062.stdout:8/636: dread - da/d85/d8a/dbb/fc8 zero size 2024-05-09T06:29:58.445 INFO:tasks.workunit.client.0.smithi062.stdout:6/580: rename dc/d42 to dc/d28/d46/d3a/d7f/d91/d93/dc0 0 2024-05-09T06:29:58.445 INFO:tasks.workunit.client.0.smithi062.stdout:7/534: mkdir d0/d3a/d3f/dab 0 2024-05-09T06:29:58.448 INFO:tasks.workunit.client.0.smithi062.stdout:8/637: rename da/d85/fa2 to da/d11/d2e/d61/d92/da5/fcc 0 2024-05-09T06:29:58.448 INFO:tasks.workunit.client.0.smithi062.stdout:8/638: stat da/d77 0 2024-05-09T06:29:58.449 INFO:tasks.workunit.client.0.smithi062.stdout:6/581: dread dc/fd [0,4194304] 0 2024-05-09T06:29:58.449 INFO:tasks.workunit.client.0.smithi062.stdout:6/582: dread - dc/d28/d10/d20/fb9 zero size 2024-05-09T06:29:58.449 INFO:tasks.workunit.client.0.smithi062.stdout:7/535: mkdir d0/d3a/d51/d64/d6d/dac 0 2024-05-09T06:29:58.451 INFO:tasks.workunit.client.0.smithi062.stdout:8/639: link da/d11/d2e/f91 da/d85/d8a/fcd 0 2024-05-09T06:29:58.455 INFO:tasks.workunit.client.0.smithi062.stdout:8/640: creat da/d11/d2e/d7e/d83/fce x:0 0 0 2024-05-09T06:29:58.460 INFO:tasks.workunit.client.0.smithi062.stdout:8/641: dread da/d11/d2e/d34/f65 [0,4194304] 0 2024-05-09T06:29:58.460 INFO:tasks.workunit.client.0.smithi062.stdout:8/642: fsync da/d11/d2e/d34/d90/fa3 0 2024-05-09T06:29:58.460 INFO:tasks.workunit.client.0.smithi062.stdout:9/534: dwrite d3/d3e/d52/d58/d1c/d1e/f5f [0,4194304] 0 2024-05-09T06:29:58.460 INFO:tasks.workunit.client.0.smithi062.stdout:9/535: chown d3/d3e/d4b/f5c 591 1 2024-05-09T06:29:58.464 INFO:tasks.workunit.client.0.smithi062.stdout:6/583: write dc/d28/d46/d3a/d7f/f90 [1313873,60591] 0 2024-05-09T06:29:58.465 INFO:tasks.workunit.client.0.smithi062.stdout:8/643: rename da/d11/f23 to da/d11/d1c/d9e/d9f/db8/fcf 0 2024-05-09T06:29:58.472 INFO:tasks.workunit.client.0.smithi062.stdout:9/536: write d3/d3e/d52/d58/d1c/d21/f53 [2181424,61882] 0 2024-05-09T06:29:58.472 INFO:tasks.workunit.client.0.smithi062.stdout:7/536: dwrite d0/d3a/d51/f44 [0,4194304] 0 2024-05-09T06:29:58.484 INFO:tasks.workunit.client.0.smithi062.stdout:9/537: dread d3/d3e/d7c/f93 [0,4194304] 0 2024-05-09T06:29:58.486 INFO:tasks.workunit.client.0.smithi062.stdout:9/538: symlink d3/d3e/lab 0 2024-05-09T06:29:58.488 INFO:tasks.workunit.client.0.smithi062.stdout:9/539: rename d3/d3e/d4b/c2e to d3/d3e/d52/d58/d1c/d1e/d60/cac 0 2024-05-09T06:29:58.489 INFO:tasks.workunit.client.0.smithi062.stdout:9/540: mkdir d3/d3e/d4b/da2/dad 0 2024-05-09T06:29:58.489 INFO:tasks.workunit.client.0.smithi062.stdout:9/541: chown d3/d3e/d52/d58/c63 0 1 2024-05-09T06:29:58.490 INFO:tasks.workunit.client.0.smithi062.stdout:5/517: sync 2024-05-09T06:29:58.490 INFO:tasks.workunit.client.0.smithi062.stdout:5/518: write d0/f9c [1007704,109793] 0 2024-05-09T06:29:58.491 INFO:tasks.workunit.client.0.smithi062.stdout:9/542: symlink d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/lae 0 2024-05-09T06:29:58.492 INFO:tasks.workunit.client.0.smithi062.stdout:5/519: stat d0/d8/c1a 0 2024-05-09T06:29:58.493 INFO:tasks.workunit.client.0.smithi062.stdout:5/520: write d0/d8/d1c/d23/d3e/fa2 [3923985,111243] 0 2024-05-09T06:29:58.493 INFO:tasks.workunit.client.0.smithi062.stdout:5/521: write d0/d8/d1c/d23/d3e/f4d [3489181,61393] 0 2024-05-09T06:29:58.494 INFO:tasks.workunit.client.0.smithi062.stdout:9/543: mknod d3/d3e/d52/d58/d1c/d1e/caf 0 2024-05-09T06:29:58.495 INFO:tasks.workunit.client.0.smithi062.stdout:9/544: symlink d3/d20/lb0 0 2024-05-09T06:29:58.498 INFO:tasks.workunit.client.0.smithi062.stdout:9/545: dread d3/f75 [0,4194304] 0 2024-05-09T06:29:58.500 INFO:tasks.workunit.client.0.smithi062.stdout:9/546: rename d3/d3e/d52/d58/d1c/d1e/d60/c9d to d3/d3e/d52/d58/d77/cb1 0 2024-05-09T06:29:58.503 INFO:tasks.workunit.client.0.smithi062.stdout:9/547: dread d3/d3e/d52/d58/f8e [0,4194304] 0 2024-05-09T06:29:58.503 INFO:tasks.workunit.client.0.smithi062.stdout:9/548: readlink d3/d3e/d52/d58/d1c/l72 0 2024-05-09T06:29:58.504 INFO:tasks.workunit.client.0.smithi062.stdout:9/549: unlink d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/c90 0 2024-05-09T06:29:58.517 INFO:tasks.workunit.client.0.smithi062.stdout:5/522: dwrite d0/d8/d1c/d2c/d7d/fa1 [0,4194304] 0 2024-05-09T06:29:58.533 INFO:tasks.workunit.client.0.smithi062.stdout:5/523: dwrite d0/d8/d1c/d2c/d7d/fa9 [0,4194304] 0 2024-05-09T06:29:58.550 INFO:tasks.workunit.client.0.smithi062.stdout:5/524: dwrite d0/d8/d18/f64 [0,4194304] 0 2024-05-09T06:29:58.570 INFO:tasks.workunit.client.0.smithi062.stdout:5/525: dwrite d0/d56/d45/f76 [0,4194304] 0 2024-05-09T06:29:58.570 INFO:tasks.workunit.client.0.smithi062.stdout:5/526: fdatasync d0/d11/d67/f9f 0 2024-05-09T06:29:58.588 INFO:tasks.workunit.client.0.smithi062.stdout:3/435: sync 2024-05-09T06:29:58.589 INFO:tasks.workunit.client.0.smithi062.stdout:0/429: sync 2024-05-09T06:29:58.589 INFO:tasks.workunit.client.0.smithi062.stdout:3/436: fsync d1/d1e/d26/d33/f79 0 2024-05-09T06:29:58.589 INFO:tasks.workunit.client.0.smithi062.stdout:3/437: fsync d1/d1e/d36/d3a/d4e/f76 0 2024-05-09T06:29:58.589 INFO:tasks.workunit.client.0.smithi062.stdout:3/438: dread - d1/d1e/d54/f93 zero size 2024-05-09T06:29:58.589 INFO:tasks.workunit.client.0.smithi062.stdout:5/527: dwrite d0/d8/d18/f78 [0,4194304] 0 2024-05-09T06:29:58.590 INFO:tasks.workunit.client.0.smithi062.stdout:0/430: read d1/d25/d49/d42/d43/f5e [2906487,44211] 0 2024-05-09T06:29:58.596 INFO:tasks.workunit.client.0.smithi062.stdout:0/431: mknod d1/d25/d31/d6c/d44/d57/d75/c99 0 2024-05-09T06:29:58.597 INFO:tasks.workunit.client.0.smithi062.stdout:3/439: write d1/d1e/d26/d33/f3e [2917394,7576] 0 2024-05-09T06:29:58.597 INFO:tasks.workunit.client.0.smithi062.stdout:3/440: chown d1/d1e/f39 0 1 2024-05-09T06:29:58.607 INFO:tasks.workunit.client.0.smithi062.stdout:5/528: dwrite d0/f74 [0,4194304] 0 2024-05-09T06:29:58.607 INFO:tasks.workunit.client.0.smithi062.stdout:0/432: link d1/c2b d1/d25/d49/d42/c9a 0 2024-05-09T06:29:58.607 INFO:tasks.workunit.client.0.smithi062.stdout:0/433: creat d1/d25/d49/d4f/f9b x:0 0 0 2024-05-09T06:29:58.616 INFO:tasks.workunit.client.0.smithi062.stdout:5/529: dread d0/d8/d47/f82 [0,4194304] 0 2024-05-09T06:29:58.616 INFO:tasks.workunit.client.0.smithi062.stdout:0/434: creat d1/d6a/f9c x:0 0 0 2024-05-09T06:29:58.616 INFO:tasks.workunit.client.0.smithi062.stdout:0/435: fdatasync d1/d25/d31/d6c/d44/d6e/f96 0 2024-05-09T06:29:58.616 INFO:tasks.workunit.client.0.smithi062.stdout:0/436: write d1/f24 [1260234,122218] 0 2024-05-09T06:29:58.616 INFO:tasks.workunit.client.0.smithi062.stdout:0/437: chown d1/d25/d49 6 1 2024-05-09T06:29:58.616 INFO:tasks.workunit.client.0.smithi062.stdout:0/438: fsync d1/d25/d59/f97 0 2024-05-09T06:29:58.619 INFO:tasks.workunit.client.0.smithi062.stdout:0/439: mkdir d1/d25/d49/d42/d43/d54/d9d 0 2024-05-09T06:29:58.619 INFO:tasks.workunit.client.0.smithi062.stdout:0/440: fsync d1/d25/d31/d6c/d44/d57/d75/f8c 0 2024-05-09T06:29:58.621 INFO:tasks.workunit.client.0.smithi062.stdout:0/441: creat d1/d18/f9e x:0 0 0 2024-05-09T06:29:58.624 INFO:tasks.workunit.client.0.smithi062.stdout:0/442: link d1/d25/d49/d42/d43/f7d d1/d25/d31/d6c/d44/d57/d75/f9f 0 2024-05-09T06:29:58.628 INFO:tasks.workunit.client.0.smithi062.stdout:0/443: symlink d1/d25/d31/d6c/d44/d57/la0 0 2024-05-09T06:29:58.630 INFO:tasks.workunit.client.0.smithi062.stdout:0/444: rmdir d1/d25/d49/d42 39 2024-05-09T06:29:58.631 INFO:tasks.workunit.client.0.smithi062.stdout:0/445: getdents d1/d25/d49/d7e 0 2024-05-09T06:29:58.633 INFO:tasks.workunit.client.0.smithi062.stdout:5/530: dwrite d0/f9c [0,4194304] 0 2024-05-09T06:29:58.638 INFO:tasks.workunit.client.0.smithi062.stdout:5/531: rmdir d0/d11/d67 39 2024-05-09T06:29:58.640 INFO:tasks.workunit.client.0.smithi062.stdout:5/532: getdents d0/d8/d1c/d23/d3e 0 2024-05-09T06:29:58.661 INFO:tasks.workunit.client.0.smithi062.stdout:0/446: dwrite d1/d25/d49/d4f/d52/d87/f68 [0,4194304] 0 2024-05-09T06:29:58.661 INFO:tasks.workunit.client.0.smithi062.stdout:5/533: dwrite d0/d8/d1c/d23/f48 [0,4194304] 0 2024-05-09T06:29:58.671 INFO:tasks.workunit.client.0.smithi062.stdout:0/447: dread d1/d25/d31/f3b [0,4194304] 0 2024-05-09T06:29:58.676 INFO:tasks.workunit.client.0.smithi062.stdout:5/534: dwrite d0/d56/d45/d92/fac [0,4194304] 0 2024-05-09T06:29:58.676 INFO:tasks.workunit.client.0.smithi062.stdout:5/535: dread - d0/d56/d5/fa3 zero size 2024-05-09T06:29:58.680 INFO:tasks.workunit.client.0.smithi062.stdout:0/448: dread d1/f17 [0,4194304] 0 2024-05-09T06:29:58.681 INFO:tasks.workunit.client.0.smithi062.stdout:5/536: mknod d0/d56/d5/cb1 0 2024-05-09T06:29:58.686 INFO:tasks.workunit.client.0.smithi062.stdout:0/449: mkdir d1/d25/d49/da1 0 2024-05-09T06:29:58.686 INFO:tasks.workunit.client.0.smithi062.stdout:0/450: creat d1/d25/d59/fa2 x:0 0 0 2024-05-09T06:29:58.689 INFO:tasks.workunit.client.0.smithi062.stdout:0/451: creat d1/d25/d49/d4f/d52/d87/fa3 x:0 0 0 2024-05-09T06:29:58.699 INFO:tasks.workunit.client.0.smithi062.stdout:5/537: dwrite d0/d8/d1c/d23/f29 [0,4194304] 0 2024-05-09T06:29:58.700 INFO:tasks.workunit.client.0.smithi062.stdout:5/538: write d0/d8/d1c/f32 [1004139,20150] 0 2024-05-09T06:29:58.702 INFO:tasks.workunit.client.0.smithi062.stdout:5/539: symlink d0/d56/d5/lb2 0 2024-05-09T06:29:58.702 INFO:tasks.workunit.client.0.smithi062.stdout:0/452: write d1/f8 [951111,91478] 0 2024-05-09T06:29:58.702 INFO:tasks.workunit.client.0.smithi062.stdout:0/453: creat d1/d25/fa4 x:0 0 0 2024-05-09T06:29:58.706 INFO:tasks.workunit.client.0.smithi062.stdout:2/480: sync 2024-05-09T06:29:58.706 INFO:tasks.workunit.client.0.smithi062.stdout:4/604: sync 2024-05-09T06:29:58.706 INFO:tasks.workunit.client.0.smithi062.stdout:1/388: sync 2024-05-09T06:29:58.707 INFO:tasks.workunit.client.0.smithi062.stdout:4/605: read d0/d2a/d8/d69/daf/fac [140201,42992] 0 2024-05-09T06:29:58.707 INFO:tasks.workunit.client.0.smithi062.stdout:4/606: read - d0/d2a/d14/d4f/f9c zero size 2024-05-09T06:29:58.710 INFO:tasks.workunit.client.0.smithi062.stdout:4/607: unlink d0/d2a/d14/d7e/d8e/d9e/l42 0 2024-05-09T06:29:58.712 INFO:tasks.workunit.client.0.smithi062.stdout:5/540: dread d0/d8/d1c/d23/f29 [0,4194304] 0 2024-05-09T06:29:58.713 INFO:tasks.workunit.client.0.smithi062.stdout:0/454: write d1/d25/f86 [2057778,117974] 0 2024-05-09T06:29:58.713 INFO:tasks.workunit.client.0.smithi062.stdout:4/608: truncate d0/d2a/d14/d7e/d8e/d9e/d86/d94/fab 2463262 0 2024-05-09T06:29:58.713 INFO:tasks.workunit.client.0.smithi062.stdout:4/609: creat d0/d2a/d1f/d6c/fb7 x:0 0 0 2024-05-09T06:29:58.713 INFO:tasks.workunit.client.0.smithi062.stdout:4/610: stat d0/d2a/d1f 0 2024-05-09T06:29:58.715 INFO:tasks.workunit.client.0.smithi062.stdout:1/389: dread f5 [4194304,4194304] 0 2024-05-09T06:29:58.716 INFO:tasks.workunit.client.0.smithi062.stdout:5/541: mkdir d0/d8/d1c/d2c/db3 0 2024-05-09T06:29:58.725 INFO:tasks.workunit.client.0.smithi062.stdout:2/481: dwrite d0/d9/dd/f1a [4194304,4194304] 0 2024-05-09T06:29:58.729 INFO:tasks.workunit.client.0.smithi062.stdout:0/455: creat d1/d25/d49/fa5 x:0 0 0 2024-05-09T06:29:58.737 INFO:tasks.workunit.client.0.smithi062.stdout:1/390: rename d8/f1a to d8/d14/d2b/d3c/d7d/f87 0 2024-05-09T06:29:58.741 INFO:tasks.workunit.client.0.smithi062.stdout:5/542: mkdir d0/d11/d67/db4 0 2024-05-09T06:29:58.743 INFO:tasks.workunit.client.0.smithi062.stdout:5/543: dread d0/d8/d1c/f62 [0,4194304] 0 2024-05-09T06:29:58.746 INFO:tasks.workunit.client.0.smithi062.stdout:4/611: dwrite d0/f7f [0,4194304] 0 2024-05-09T06:29:58.746 INFO:tasks.workunit.client.0.smithi062.stdout:0/456: dread d1/f19 [0,4194304] 0 2024-05-09T06:29:58.746 INFO:tasks.workunit.client.0.smithi062.stdout:0/457: read - d1/d25/d31/d6c/d44/d6e/f96 zero size 2024-05-09T06:29:58.749 INFO:tasks.workunit.client.0.smithi062.stdout:2/482: unlink d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f4d 0 2024-05-09T06:29:58.752 INFO:tasks.workunit.client.0.smithi062.stdout:1/391: rename d8/d14/l23 to d8/d14/d2b/d3c/d44/d7f/l88 0 2024-05-09T06:29:58.755 INFO:tasks.workunit.client.0.smithi062.stdout:5/544: mknod d0/d3b/d3f/cb5 0 2024-05-09T06:29:58.756 INFO:tasks.workunit.client.0.smithi062.stdout:4/612: dread d0/d9/f3e [0,4194304] 0 2024-05-09T06:29:58.756 INFO:tasks.workunit.client.0.smithi062.stdout:4/613: read - d0/d2a/d14/d4f/f90 zero size 2024-05-09T06:29:58.769 INFO:tasks.workunit.client.0.smithi062.stdout:0/458: mkdir d1/d25/d49/d7e/da6 0 2024-05-09T06:29:58.771 INFO:tasks.workunit.client.0.smithi062.stdout:5/545: dwrite d0/f2d [0,4194304] 0 2024-05-09T06:29:58.771 INFO:tasks.workunit.client.0.smithi062.stdout:5/546: write d0/d8/d1c/d2c/f8c [567155,20441] 0 2024-05-09T06:29:58.772 INFO:tasks.workunit.client.0.smithi062.stdout:2/483: rename d0/d9/dd/d65/d6d/d21/d29/d40/f85 to d0/d9/dd/d65/d6d/d21/d29/d40/f95 0 2024-05-09T06:29:58.774 INFO:tasks.workunit.client.0.smithi062.stdout:4/614: truncate d0/d2a/d1f/f22 52119 0 2024-05-09T06:29:58.776 INFO:tasks.workunit.client.0.smithi062.stdout:0/459: creat d1/d25/d49/d42/fa7 x:0 0 0 2024-05-09T06:29:58.779 INFO:tasks.workunit.client.0.smithi062.stdout:2/484: mkdir d0/d9/dd/d65/d6d/d96 0 2024-05-09T06:29:58.782 INFO:tasks.workunit.client.0.smithi062.stdout:5/547: dread d0/d8/d1c/d23/f48 [0,4194304] 0 2024-05-09T06:29:58.786 INFO:tasks.workunit.client.0.smithi062.stdout:1/392: rmdir d8/d14/d2b 39 2024-05-09T06:29:58.788 INFO:tasks.workunit.client.0.smithi062.stdout:4/615: truncate d0/d2a/d14/d7e/d8e/d9e/d28/f41 8366485 0 2024-05-09T06:29:58.791 INFO:tasks.workunit.client.0.smithi062.stdout:0/460: symlink d1/d6a/d6d/la8 0 2024-05-09T06:29:58.793 INFO:tasks.workunit.client.0.smithi062.stdout:2/485: unlink d0/l2c 0 2024-05-09T06:29:58.796 INFO:tasks.workunit.client.0.smithi062.stdout:5/548: link d0/d11/d67/l6d d0/d56/lb6 0 2024-05-09T06:29:58.798 INFO:tasks.workunit.client.0.smithi062.stdout:1/393: link d8/d2c/f50 d8/f89 0 2024-05-09T06:29:58.801 INFO:tasks.workunit.client.0.smithi062.stdout:9/550: sync 2024-05-09T06:29:58.801 INFO:tasks.workunit.client.0.smithi062.stdout:8/644: sync 2024-05-09T06:29:58.801 INFO:tasks.workunit.client.0.smithi062.stdout:3/441: sync 2024-05-09T06:29:58.801 INFO:tasks.workunit.client.0.smithi062.stdout:6/584: sync 2024-05-09T06:29:58.802 INFO:tasks.workunit.client.0.smithi062.stdout:4/616: unlink d0/c51 0 2024-05-09T06:29:58.802 INFO:tasks.workunit.client.0.smithi062.stdout:4/617: truncate d0/d2a/d14/d7e/f73 953708 0 2024-05-09T06:29:58.802 INFO:tasks.workunit.client.0.smithi062.stdout:2/486: dread d0/d9/d38/d41/f51 [0,4194304] 0 2024-05-09T06:29:58.804 INFO:tasks.workunit.client.0.smithi062.stdout:0/461: mknod d1/d25/d49/d7e/ca9 0 2024-05-09T06:29:58.804 INFO:tasks.workunit.client.0.smithi062.stdout:5/549: dread d0/d8/d1c/d23/d3e/f4d [0,4194304] 0 2024-05-09T06:29:58.804 INFO:tasks.workunit.client.0.smithi062.stdout:0/462: chown d1/d6a/d6d/d93/f53 2213 1 2024-05-09T06:29:58.804 INFO:tasks.workunit.client.0.smithi062.stdout:5/550: write d0/d8/d47/f82 [5070959,90001] 0 2024-05-09T06:29:58.804 INFO:tasks.workunit.client.0.smithi062.stdout:5/551: creat d0/d8/d1c/d2c/d7d/fb7 x:0 0 0 2024-05-09T06:29:58.804 INFO:tasks.workunit.client.0.smithi062.stdout:5/552: fdatasync d0/f79 0 2024-05-09T06:29:58.804 INFO:tasks.workunit.client.0.smithi062.stdout:5/553: fsync d0/d8/d18/f78 0 2024-05-09T06:29:58.807 INFO:tasks.workunit.client.0.smithi062.stdout:8/645: dread da/f5d [0,4194304] 0 2024-05-09T06:29:58.811 INFO:tasks.workunit.client.0.smithi062.stdout:1/394: link d8/d1d/f74 d8/d2c/d41/f8a 0 2024-05-09T06:29:58.811 INFO:tasks.workunit.client.0.smithi062.stdout:1/395: write d8/d14/d2b/d3c/d44/d38/f77 [314379,8600] 0 2024-05-09T06:29:58.811 INFO:tasks.workunit.client.0.smithi062.stdout:7/537: sync 2024-05-09T06:29:58.813 INFO:tasks.workunit.client.0.smithi062.stdout:3/442: dread d1/f1f [0,4194304] 0 2024-05-09T06:29:58.813 INFO:tasks.workunit.client.0.smithi062.stdout:9/551: mknod d3/cb2 0 2024-05-09T06:29:58.819 INFO:tasks.workunit.client.0.smithi062.stdout:6/585: truncate dc/f2a 2969483 0 2024-05-09T06:29:58.820 INFO:tasks.workunit.client.0.smithi062.stdout:6/586: chown dc/d28/d10/d20/f31 0 1 2024-05-09T06:29:58.821 INFO:tasks.workunit.client.0.smithi062.stdout:4/618: link d0/d2a/d14/f74 d0/fb8 0 2024-05-09T06:29:58.825 INFO:tasks.workunit.client.0.smithi062.stdout:2/487: mknod d0/d9/d38/d41/d94/c97 0 2024-05-09T06:29:58.830 INFO:tasks.workunit.client.0.smithi062.stdout:8/646: symlink da/d11/d2e/d34/ld0 0 2024-05-09T06:29:58.830 INFO:tasks.workunit.client.0.smithi062.stdout:8/647: write da/d11/d2e/fca [407936,71118] 0 2024-05-09T06:29:58.834 INFO:tasks.workunit.client.0.smithi062.stdout:0/463: dwrite d1/d6a/f9c [0,4194304] 0 2024-05-09T06:29:58.834 INFO:tasks.workunit.client.0.smithi062.stdout:5/554: dwrite d0/d56/d45/f75 [4194304,4194304] 0 2024-05-09T06:29:58.834 INFO:tasks.workunit.client.0.smithi062.stdout:5/555: chown d0/cb 0 1 2024-05-09T06:29:58.834 INFO:tasks.workunit.client.0.smithi062.stdout:2/488: dread d0/d9/d38/f60 [0,4194304] 0 2024-05-09T06:29:58.834 INFO:tasks.workunit.client.0.smithi062.stdout:2/489: write d0/d9/dd/f1c [40189,101733] 0 2024-05-09T06:29:58.836 INFO:tasks.workunit.client.0.smithi062.stdout:1/396: rename d8/d14/c1c to d8/d14/d2b/d3c/d44/d6e/d7a/c8b 0 2024-05-09T06:29:58.836 INFO:tasks.workunit.client.0.smithi062.stdout:4/619: dread d0/d2a/d1f/d6c/f95 [0,4194304] 0 2024-05-09T06:29:58.836 INFO:tasks.workunit.client.0.smithi062.stdout:3/443: dwrite d1/f8 [0,4194304] 0 2024-05-09T06:29:58.836 INFO:tasks.workunit.client.0.smithi062.stdout:3/444: write d1/d1e/d36/d4a/d51/f6b [723918,55255] 0 2024-05-09T06:29:58.837 INFO:tasks.workunit.client.0.smithi062.stdout:9/552: truncate d3/d3e/d52/d58/d1c/d1e/d60/f73 2964337 0 2024-05-09T06:29:58.841 INFO:tasks.workunit.client.0.smithi062.stdout:6/587: creat dc/d28/d46/d3a/d7f/d91/d96/db6/fc1 x:0 0 0 2024-05-09T06:29:58.844 INFO:tasks.workunit.client.0.smithi062.stdout:2/490: write d0/f6 [1845616,102872] 0 2024-05-09T06:29:58.850 INFO:tasks.workunit.client.0.smithi062.stdout:5/556: symlink d0/lb8 0 2024-05-09T06:29:58.850 INFO:tasks.workunit.client.0.smithi062.stdout:5/557: write d0/d8/d1c/d2c/f80 [3237192,107566] 0 2024-05-09T06:29:58.854 INFO:tasks.workunit.client.0.smithi062.stdout:4/620: link d0/d2a/d14/d7e/d8e/d9e/d28/f71 d0/d2a/d14/d7e/d8e/d9e/d28/d31/fb9 0 2024-05-09T06:29:58.859 INFO:tasks.workunit.client.0.smithi062.stdout:2/491: dread d0/f39 [0,4194304] 0 2024-05-09T06:29:58.859 INFO:tasks.workunit.client.0.smithi062.stdout:2/492: creat d0/d9/dd/f98 x:0 0 0 2024-05-09T06:29:58.861 INFO:tasks.workunit.client.0.smithi062.stdout:1/397: dwrite d8/f13 [0,4194304] 0 2024-05-09T06:29:58.861 INFO:tasks.workunit.client.0.smithi062.stdout:1/398: dread - d8/d2c/f45 zero size 2024-05-09T06:29:58.861 INFO:tasks.workunit.client.0.smithi062.stdout:8/648: rename da/d11/d2e/d34/ld0 to da/d11/d2e/d61/d64/ld1 0 2024-05-09T06:29:58.861 INFO:tasks.workunit.client.0.smithi062.stdout:8/649: truncate da/d85/d8a/fcd 934861 0 2024-05-09T06:29:58.861 INFO:tasks.workunit.client.0.smithi062.stdout:8/650: chown da/d11/d2e/d61/d92/l45 656152 1 2024-05-09T06:29:58.863 INFO:tasks.workunit.client.0.smithi062.stdout:3/445: mkdir d1/d1e/d36/d3a/d97 0 2024-05-09T06:29:58.870 INFO:tasks.workunit.client.0.smithi062.stdout:1/399: dread f6 [0,4194304] 0 2024-05-09T06:29:58.870 INFO:tasks.workunit.client.0.smithi062.stdout:1/400: chown d8/d14/d2b/d3c/d44/f4a 59431 1 2024-05-09T06:29:58.870 INFO:tasks.workunit.client.0.smithi062.stdout:1/401: stat d8/d2c/d41/f4f 0 2024-05-09T06:29:58.871 INFO:tasks.workunit.client.0.smithi062.stdout:9/553: mknod d3/d3e/cb3 0 2024-05-09T06:29:58.872 INFO:tasks.workunit.client.0.smithi062.stdout:3/446: dread d1/d1e/d26/f29 [0,4194304] 0 2024-05-09T06:29:58.872 INFO:tasks.workunit.client.0.smithi062.stdout:3/447: fsync d1/d1e/d54/f63 0 2024-05-09T06:29:58.873 INFO:tasks.workunit.client.0.smithi062.stdout:6/588: stat dc/d28/d46/d4a/d5d/l2e 0 2024-05-09T06:29:58.876 INFO:tasks.workunit.client.0.smithi062.stdout:5/558: rmdir d0/d11/d67/db4 0 2024-05-09T06:29:58.880 INFO:tasks.workunit.client.0.smithi062.stdout:2/493: truncate d0/d9/dd/d65/d6d/d21/f55 2373758 0 2024-05-09T06:29:58.880 INFO:tasks.workunit.client.0.smithi062.stdout:2/494: truncate d0/f78 669325 0 2024-05-09T06:29:58.880 INFO:tasks.workunit.client.0.smithi062.stdout:2/495: fsync d0/f78 0 2024-05-09T06:29:58.884 INFO:tasks.workunit.client.0.smithi062.stdout:1/402: write d8/f13 [1621705,54360] 0 2024-05-09T06:29:58.887 INFO:tasks.workunit.client.0.smithi062.stdout:0/464: rename d1/d25/d49/l77 to d1/d25/d31/d6c/d44/d57/laa 0 2024-05-09T06:29:58.887 INFO:tasks.workunit.client.0.smithi062.stdout:0/465: chown d1/d25/d49/d4f/d52/f83 2 1 2024-05-09T06:29:58.888 INFO:tasks.workunit.client.0.smithi062.stdout:8/651: unlink da/d11/d2e/d34/d90/fbf 0 2024-05-09T06:29:58.888 INFO:tasks.workunit.client.0.smithi062.stdout:8/652: truncate da/d11/d2e/d34/d90/fa3 4591737 0 2024-05-09T06:29:58.889 INFO:tasks.workunit.client.0.smithi062.stdout:8/653: write da/d11/d2e/f91 [87976,102752] 0 2024-05-09T06:29:58.890 INFO:tasks.workunit.client.0.smithi062.stdout:8/654: dread da/d11/d2e/d34/d90/fa3 [4194304,4194304] 0 2024-05-09T06:29:58.890 INFO:tasks.workunit.client.0.smithi062.stdout:8/655: stat da/d11/d2e/d7e/d83/c8c 0 2024-05-09T06:29:58.890 INFO:tasks.workunit.client.0.smithi062.stdout:6/589: mkdir dc/d28/d46/d3a/d7f/d8e/dc2 0 2024-05-09T06:29:58.891 INFO:tasks.workunit.client.0.smithi062.stdout:4/621: dwrite d0/d2a/d14/d7e/d8e/d9e/d28/d31/f58 [0,4194304] 0 2024-05-09T06:29:58.891 INFO:tasks.workunit.client.0.smithi062.stdout:9/554: dwrite d3/d3e/d52/d58/d1c/d1e/f5f [0,4194304] 0 2024-05-09T06:29:58.892 INFO:tasks.workunit.client.0.smithi062.stdout:4/622: dread d0/d2a/d14/d7e/d8e/d9e/d28/f71 [0,4194304] 0 2024-05-09T06:29:58.893 INFO:tasks.workunit.client.0.smithi062.stdout:2/496: creat d0/d9/d38/d41/d53/f99 x:0 0 0 2024-05-09T06:29:58.908 INFO:tasks.workunit.client.0.smithi062.stdout:1/403: stat d8/d2c/c4c 0 2024-05-09T06:29:58.910 INFO:tasks.workunit.client.0.smithi062.stdout:3/448: rename d1/d1e/f25 to d1/d48/f98 0 2024-05-09T06:29:58.910 INFO:tasks.workunit.client.0.smithi062.stdout:3/449: fsync d1/d1e/d26/f37 0 2024-05-09T06:29:58.910 INFO:tasks.workunit.client.0.smithi062.stdout:3/450: write d1/d1e/d26/d43/d52/f95 [2268016,18319] 0 2024-05-09T06:29:58.910 INFO:tasks.workunit.client.0.smithi062.stdout:3/451: truncate d1/d1e/d26/d43/d92/f40 3465584 0 2024-05-09T06:29:58.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:58 smithi062 ceph-mon[26920]: pgmap v7: 65 pgs: 65 active+clean; 2.7 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 115 MiB/s rd, 139 MiB/s wr, 256 op/s 2024-05-09T06:29:58.914 INFO:tasks.workunit.client.0.smithi062.stdout:8/656: mkdir da/d11/dd2 0 2024-05-09T06:29:58.916 INFO:tasks.workunit.client.0.smithi062.stdout:6/590: mkdir dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/dc3 0 2024-05-09T06:29:58.923 INFO:tasks.workunit.client.0.smithi062.stdout:9/555: mkdir d3/d3e/d4b/db4 0 2024-05-09T06:29:58.927 INFO:tasks.workunit.client.0.smithi062.stdout:4/623: symlink d0/d2a/d14/d7e/d8e/d9e/d28/d31/lba 0 2024-05-09T06:29:58.927 INFO:tasks.workunit.client.0.smithi062.stdout:4/624: write d0/d2a/d14/d7e/d8e/d9e/d28/f71 [1457653,24465] 0 2024-05-09T06:29:58.927 INFO:tasks.workunit.client.0.smithi062.stdout:4/625: fdatasync d0/d2a/d14/d7e/d8e/d9e/d28/d31/f6f 0 2024-05-09T06:29:58.927 INFO:tasks.workunit.client.0.smithi062.stdout:1/404: dwrite d8/f49 [0,4194304] 0 2024-05-09T06:29:58.927 INFO:tasks.workunit.client.0.smithi062.stdout:1/405: chown d8/f3f 91 1 2024-05-09T06:29:58.931 INFO:tasks.workunit.client.0.smithi062.stdout:0/466: rename d1/d25/d49/fa5 to d1/d25/d49/d42/d43/d54/d9d/fab 0 2024-05-09T06:29:58.932 INFO:tasks.workunit.client.0.smithi062.stdout:0/467: chown d1/d25/d49/d7e/f8b 7 1 2024-05-09T06:29:58.933 INFO:tasks.workunit.client.0.smithi062.stdout:2/497: dread d0/d9/d38/d41/d48/f4c [0,4194304] 0 2024-05-09T06:29:58.935 INFO:tasks.workunit.client.0.smithi062.stdout:4/626: link d0/d2a/d8/d69/daf/f91 d0/d3c/fbb 0 2024-05-09T06:29:58.938 INFO:tasks.workunit.client.0.smithi062.stdout:3/452: rename d1/d1e/d36/d3a/d4e/f70 to d1/f99 0 2024-05-09T06:29:58.939 INFO:tasks.workunit.client.0.smithi062.stdout:0/468: symlink d1/d25/d49/d4f/d52/d87/lac 0 2024-05-09T06:29:58.940 INFO:tasks.workunit.client.0.smithi062.stdout:9/556: dwrite d3/d3e/d52/d58/d1c/d1e/f4c [0,4194304] 0 2024-05-09T06:29:58.942 INFO:tasks.workunit.client.0.smithi062.stdout:2/498: fdatasync d0/d9/dd/f4e 0 2024-05-09T06:29:58.949 INFO:tasks.workunit.client.0.smithi062.stdout:6/591: rename dc/d28/d46/d3a/d7f/la8 to dc/d28/d46/d3a/d7f/d91/d93/lc4 0 2024-05-09T06:29:58.950 INFO:tasks.workunit.client.0.smithi062.stdout:0/469: mkdir d1/d25/d49/d42/dad 0 2024-05-09T06:29:58.952 INFO:tasks.workunit.client.0.smithi062.stdout:9/557: creat d3/d3e/d52/d58/d1c/d21/fb5 x:0 0 0 2024-05-09T06:29:58.953 INFO:tasks.workunit.client.0.smithi062.stdout:9/558: read d3/d3e/d52/d58/d77/d92/f70 [158674,88598] 0 2024-05-09T06:29:58.954 INFO:tasks.workunit.client.0.smithi062.stdout:9/559: dread d3/d3e/d52/d58/d1c/d1e/d41/f65 [0,4194304] 0 2024-05-09T06:29:58.954 INFO:tasks.workunit.client.0.smithi062.stdout:2/499: creat d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f9a x:0 0 0 2024-05-09T06:29:58.954 INFO:tasks.workunit.client.0.smithi062.stdout:2/500: dread - d0/d9/d38/d41/d53/f61 zero size 2024-05-09T06:29:58.954 INFO:tasks.workunit.client.0.smithi062.stdout:2/501: chown d0/d9/dd/d65/d6d/d21/d29/l57 56 1 2024-05-09T06:29:58.956 INFO:tasks.workunit.client.0.smithi062.stdout:1/406: rename d8/c51 to d8/d14/d2b/d3c/d44/d7f/c8c 0 2024-05-09T06:29:58.957 INFO:tasks.workunit.client.0.smithi062.stdout:6/592: getdents dc/d28/d46/d4a/d5d/d6f 0 2024-05-09T06:29:58.958 INFO:tasks.workunit.client.0.smithi062.stdout:9/560: mkdir d3/d3e/d52/d58/d77/db6 0 2024-05-09T06:29:58.959 INFO:tasks.workunit.client.0.smithi062.stdout:9/561: readlink d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/l7d 0 2024-05-09T06:29:58.959 INFO:tasks.workunit.client.0.smithi062.stdout:9/562: readlink d3/d3e/d52/d58/d1c/d21/l36 0 2024-05-09T06:29:58.959 INFO:tasks.workunit.client.0.smithi062.stdout:3/453: dwrite d1/d1e/d36/d3a/d4e/f76 [0,4194304] 0 2024-05-09T06:29:58.961 INFO:tasks.workunit.client.0.smithi062.stdout:3/454: read d1/d1e/d26/d43/f78 [284934,85087] 0 2024-05-09T06:29:58.963 INFO:tasks.workunit.client.0.smithi062.stdout:1/407: rmdir d8/d2c/d41 39 2024-05-09T06:29:58.964 INFO:tasks.workunit.client.0.smithi062.stdout:6/593: mkdir dc/d28/d46/d4a/d5d/dc5 0 2024-05-09T06:29:58.965 INFO:tasks.workunit.client.0.smithi062.stdout:6/594: chown dc/d28/d34/d4e/d78/cac 2776 1 2024-05-09T06:29:58.966 INFO:tasks.workunit.client.0.smithi062.stdout:0/470: write d1/f11 [5751813,123979] 0 2024-05-09T06:29:58.967 INFO:tasks.workunit.client.0.smithi062.stdout:0/471: write d1/d25/d49/d3c/f3f [719088,33582] 0 2024-05-09T06:29:58.970 INFO:tasks.workunit.client.0.smithi062.stdout:2/502: mknod d0/c9b 0 2024-05-09T06:29:58.975 INFO:tasks.workunit.client.0.smithi062.stdout:1/408: mknod d8/d14/d2b/d3c/d44/d6e/d7a/d80/c8d 0 2024-05-09T06:29:58.979 INFO:tasks.workunit.client.0.smithi062.stdout:6/595: creat dc/d28/d10/d20/d5b/fc6 x:0 0 0 2024-05-09T06:29:58.980 INFO:tasks.workunit.client.0.smithi062.stdout:6/596: creat dc/d28/d10/fc7 x:0 0 0 2024-05-09T06:29:58.980 INFO:tasks.workunit.client.0.smithi062.stdout:6/597: write dc/d28/d34/d4e/f61 [971104,84733] 0 2024-05-09T06:29:58.980 INFO:tasks.workunit.client.0.smithi062.stdout:9/563: dwrite d3/d3e/d52/d58/d1c/d1e/f5f [0,4194304] 0 2024-05-09T06:29:58.981 INFO:tasks.workunit.client.0.smithi062.stdout:0/472: mkdir d1/d25/d31/d6c/d44/d6e/dae 0 2024-05-09T06:29:58.981 INFO:tasks.workunit.client.0.smithi062.stdout:0/473: fsync d1/d25/d31/d6c/d44/f4a 0 2024-05-09T06:29:58.984 INFO:tasks.workunit.client.0.smithi062.stdout:2/503: getdents d0/d9/dd/d65/d6d/d21/d29/d40 0 2024-05-09T06:29:58.986 INFO:tasks.workunit.client.0.smithi062.stdout:8/657: getdents da/d11/d2e/d34/d90 0 2024-05-09T06:29:58.991 INFO:tasks.workunit.client.0.smithi062.stdout:1/409: symlink d8/d14/d2b/d3c/d76/l8e 0 2024-05-09T06:29:58.994 INFO:tasks.workunit.client.0.smithi062.stdout:2/504: dread d0/d9/dd/d65/d6d/d21/f5b [0,4194304] 0 2024-05-09T06:29:58.996 INFO:tasks.workunit.client.0.smithi062.stdout:0/474: dwrite d1/d25/d49/d7e/f8b [0,4194304] 0 2024-05-09T06:29:58.996 INFO:tasks.workunit.client.0.smithi062.stdout:0/475: write d1/d25/f86 [2181548,123076] 0 2024-05-09T06:29:58.998 INFO:tasks.workunit.client.0.smithi062.stdout:6/598: mkdir dc/d28/d46/d3a/d7f/d8e/dc8 0 2024-05-09T06:29:58.998 INFO:tasks.workunit.client.0.smithi062.stdout:6/599: fdatasync dc/d28/d34/f38 0 2024-05-09T06:29:59.003 INFO:tasks.workunit.client.0.smithi062.stdout:9/564: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 x:0 0 0 2024-05-09T06:29:59.003 INFO:tasks.workunit.client.0.smithi062.stdout:9/565: chown d3/d3e/d52/d58/d77/d92/f9e 6 1 2024-05-09T06:29:59.003 INFO:tasks.workunit.client.0.smithi062.stdout:9/566: write d3/f6 [1417715,82236] 0 2024-05-09T06:29:59.003 INFO:tasks.workunit.client.0.smithi062.stdout:8/658: truncate da/d11/d2e/d61/d92/da5/daf/fba 599324 0 2024-05-09T06:29:59.008 INFO:tasks.workunit.client.0.smithi062.stdout:1/410: link d8/d14/d2b/f2e d8/d14/d2b/d3c/f8f 0 2024-05-09T06:29:59.008 INFO:tasks.workunit.client.0.smithi062.stdout:1/411: write d8/d14/d2b/d3c/f6b [321887,108643] 0 2024-05-09T06:29:59.008 INFO:tasks.workunit.client.0.smithi062.stdout:1/412: dread - d8/d14/d2b/d3c/d44/d64/f6f zero size 2024-05-09T06:29:59.009 INFO:tasks.workunit.client.0.smithi062.stdout:4/627: rename d0/d2a/d14/d7e/d8e/d9e/d28/d31 to d0/d3c/dae/db0/dbc 0 2024-05-09T06:29:59.016 INFO:tasks.workunit.client.0.smithi062.stdout:6/600: unlink dc/d28/d10/l33 0 2024-05-09T06:29:59.019 INFO:tasks.workunit.client.0.smithi062.stdout:9/567: link d3/d3e/d4b/f5c d3/d3e/d52/d58/fb8 0 2024-05-09T06:29:59.019 INFO:tasks.workunit.client.0.smithi062.stdout:9/568: dread - d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 zero size 2024-05-09T06:29:59.021 INFO:tasks.workunit.client.0.smithi062.stdout:3/455: truncate d1/d1e/d26/d43/d52/f95 2760173 0 2024-05-09T06:29:59.021 INFO:tasks.workunit.client.0.smithi062.stdout:3/456: getdents d1/d1e/d26 0 2024-05-09T06:29:59.029 INFO:tasks.workunit.client.0.smithi062.stdout:1/413: creat d8/d14/d2b/d3d/f90 x:0 0 0 2024-05-09T06:29:59.029 INFO:tasks.workunit.client.0.smithi062.stdout:1/414: chown d8/d2c 393580613 1 2024-05-09T06:29:59.031 INFO:tasks.workunit.client.0.smithi062.stdout:2/505: mknod d0/d9/d17/d89/c9c 0 2024-05-09T06:29:59.031 INFO:tasks.workunit.client.0.smithi062.stdout:3/457: dread d1/f99 [0,4194304] 0 2024-05-09T06:29:59.032 INFO:tasks.workunit.client.0.smithi062.stdout:3/458: chown d1/d1e/d3b/l3d 444 1 2024-05-09T06:29:59.033 INFO:tasks.workunit.client.0.smithi062.stdout:3/459: write d1/d1e/d36/d4a/d51/f6b [55093,32262] 0 2024-05-09T06:29:59.033 INFO:tasks.workunit.client.0.smithi062.stdout:3/460: creat d1/d1e/d54/f9a x:0 0 0 2024-05-09T06:29:59.035 INFO:tasks.workunit.client.0.smithi062.stdout:0/476: link d1/d25/d31/f98 d1/d18/faf 0 2024-05-09T06:29:59.038 INFO:tasks.workunit.client.0.smithi062.stdout:9/569: truncate d3/d3e/d52/d58/d1c/d21/f53 2936588 0 2024-05-09T06:29:59.042 INFO:tasks.workunit.client.0.smithi062.stdout:2/506: rmdir d0/d9/d17 39 2024-05-09T06:29:59.042 INFO:tasks.workunit.client.0.smithi062.stdout:2/507: truncate d0/d9/dd/d65/d6d/d21/f3c 1182640 0 2024-05-09T06:29:59.050 INFO:tasks.workunit.client.0.smithi062.stdout:6/601: getdents dc/d28/d46/d4a/d5d/d6f/d76 0 2024-05-09T06:29:59.054 INFO:tasks.workunit.client.0.smithi062.stdout:3/461: truncate d1/d1e/d36/d3a/d4e/f76 1396369 0 2024-05-09T06:29:59.057 INFO:tasks.workunit.client.0.smithi062.stdout:1/415: rename d8/d2c/d7c to d8/d1d/d91 0 2024-05-09T06:29:59.059 INFO:tasks.workunit.client.0.smithi062.stdout:2/508: dwrite d0/d9/dd/d65/d6d/d21/f3c [0,4194304] 0 2024-05-09T06:29:59.059 INFO:tasks.workunit.client.0.smithi062.stdout:2/509: fsync d0/d9/d17/d37/f7f 0 2024-05-09T06:29:59.059 INFO:tasks.workunit.client.0.smithi062.stdout:0/477: link d1/d18/c1f d1/d18/cb0 0 2024-05-09T06:29:59.059 INFO:tasks.workunit.client.0.smithi062.stdout:0/478: write d1/d25/d49/d42/fa7 [62820,92222] 0 2024-05-09T06:29:59.063 INFO:tasks.workunit.client.0.smithi062.stdout:6/602: dread dc/d28/f8c [0,4194304] 0 2024-05-09T06:29:59.065 INFO:tasks.workunit.client.0.smithi062.stdout:2/510: write d0/d9/f84 [298713,117219] 0 2024-05-09T06:29:59.065 INFO:tasks.workunit.client.0.smithi062.stdout:2/511: fsync d0/d9/dd/f33 0 2024-05-09T06:29:59.066 INFO:tasks.workunit.client.0.smithi062.stdout:4/628: rmdir d0/d2a/d14/d7e/d8e/d9e/d28 39 2024-05-09T06:29:59.067 INFO:tasks.workunit.client.0.smithi062.stdout:0/479: truncate d1/d6a/d6d/d93/f53 1195635 0 2024-05-09T06:29:59.068 INFO:tasks.workunit.client.0.smithi062.stdout:1/416: symlink d8/d14/d2b/d3d/l92 0 2024-05-09T06:29:59.069 INFO:tasks.workunit.client.0.smithi062.stdout:1/417: fsync f5 0 2024-05-09T06:29:59.071 INFO:tasks.workunit.client.0.smithi062.stdout:0/480: creat d1/d25/d31/d6c/d44/fb1 x:0 0 0 2024-05-09T06:29:59.071 INFO:tasks.workunit.client.0.smithi062.stdout:0/481: fdatasync d1/d18/faf 0 2024-05-09T06:29:59.071 INFO:tasks.workunit.client.0.smithi062.stdout:4/629: dread d0/d2a/d14/d4f/f60 [0,4194304] 0 2024-05-09T06:29:59.072 INFO:tasks.workunit.client.0.smithi062.stdout:1/418: mknod d8/d14/d2b/d3c/d76/c93 0 2024-05-09T06:29:59.074 INFO:tasks.workunit.client.0.smithi062.stdout:0/482: rename d1/d25/d49/d4f/f90 to d1/d25/d31/d6c/d44/d6e/dae/fb2 0 2024-05-09T06:29:59.082 INFO:tasks.workunit.client.0.smithi062.stdout:2/512: dwrite d0/d9/dd/d65/d6d/d21/d29/d3d/f67 [0,4194304] 0 2024-05-09T06:29:59.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:58 smithi079 ceph-mon[35268]: pgmap v7: 65 pgs: 65 active+clean; 2.7 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 115 MiB/s rd, 139 MiB/s wr, 256 op/s 2024-05-09T06:29:59.145 INFO:tasks.workunit.client.0.smithi062.stdout:4/630: rename d0/d2a/d8/d69/daf/fac to d0/d2a/d1f/d6c/fbd 0 2024-05-09T06:29:59.149 INFO:tasks.workunit.client.0.smithi062.stdout:2/513: unlink d0/d9/dd/d65/d6d/d21/d29/d40/l74 0 2024-05-09T06:29:59.153 INFO:tasks.workunit.client.0.smithi062.stdout:4/631: read d0/d2a/f36 [48569,45056] 0 2024-05-09T06:29:59.154 INFO:tasks.workunit.client.0.smithi062.stdout:0/483: unlink d1/d18/l1a 0 2024-05-09T06:29:59.156 INFO:tasks.workunit.client.0.smithi062.stdout:4/632: write d0/d2a/d14/d7e/f7c [1447698,1569] 0 2024-05-09T06:29:59.156 INFO:tasks.workunit.client.0.smithi062.stdout:2/514: creat d0/d9/d17/d37/d69/f9d x:0 0 0 2024-05-09T06:29:59.157 INFO:tasks.workunit.client.0.smithi062.stdout:4/633: creat d0/d3c/dae/fbe x:0 0 0 2024-05-09T06:29:59.159 INFO:tasks.workunit.client.0.smithi062.stdout:2/515: mknod d0/d9/d38/c9e 0 2024-05-09T06:29:59.165 INFO:tasks.workunit.client.0.smithi062.stdout:0/484: dread d1/d25/d59/f69 [0,4194304] 0 2024-05-09T06:29:59.167 INFO:tasks.workunit.client.0.smithi062.stdout:2/516: creat d0/d9/dd/d65/d6d/d7e/d8d/d93/f9f x:0 0 0 2024-05-09T06:29:59.168 INFO:tasks.workunit.client.0.smithi062.stdout:1/419: rmdir d8/d2c 39 2024-05-09T06:29:59.168 INFO:tasks.workunit.client.0.smithi062.stdout:1/420: stat d8/d14/d2b/d3c/f8f 0 2024-05-09T06:29:59.170 INFO:tasks.workunit.client.0.smithi062.stdout:0/485: truncate d1/d25/d31/f46 1225999 0 2024-05-09T06:29:59.170 INFO:tasks.workunit.client.0.smithi062.stdout:0/486: chown d1/d25/d31/d6c/d44/d57/la0 14078160 1 2024-05-09T06:29:59.172 INFO:tasks.workunit.client.0.smithi062.stdout:1/421: mknod d8/d1d/d91/c94 0 2024-05-09T06:29:59.175 INFO:tasks.workunit.client.0.smithi062.stdout:4/634: dwrite d0/d2a/d14/d7e/d8e/d9e/f16 [8388608,4194304] 0 2024-05-09T06:29:59.175 INFO:tasks.workunit.client.0.smithi062.stdout:4/635: write d0/d2a/d8/d69/daf/f91 [204223,84019] 0 2024-05-09T06:29:59.175 INFO:tasks.workunit.client.0.smithi062.stdout:0/487: rename d1/d25/d49/d4f/d52/d87/f68 to d1/d25/d49/d7e/da6/fb3 0 2024-05-09T06:29:59.175 INFO:tasks.workunit.client.0.smithi062.stdout:0/488: write d1/d25/d31/f4c [103413,47414] 0 2024-05-09T06:29:59.176 INFO:tasks.workunit.client.0.smithi062.stdout:1/422: symlink d8/d14/d2b/d3c/d44/l95 0 2024-05-09T06:29:59.179 INFO:tasks.workunit.client.0.smithi062.stdout:4/636: mkdir d0/d2a/d14/d4f/d6b/dbf 0 2024-05-09T06:29:59.179 INFO:tasks.workunit.client.0.smithi062.stdout:4/637: readlink d0/d2a/d8/l43 0 2024-05-09T06:29:59.181 INFO:tasks.workunit.client.0.smithi062.stdout:0/489: unlink d1/d25/d31/f98 0 2024-05-09T06:29:59.182 INFO:tasks.workunit.client.0.smithi062.stdout:0/490: dread d1/d25/d49/d42/fa7 [0,4194304] 0 2024-05-09T06:29:59.185 INFO:tasks.workunit.client.0.smithi062.stdout:0/491: mkdir d1/d25/d31/d6c/d44/d57/db4 0 2024-05-09T06:29:59.187 INFO:tasks.workunit.client.0.smithi062.stdout:1/423: read d8/d14/d2b/d3c/d44/d64/f83 [2098591,33227] 0 2024-05-09T06:29:59.188 INFO:tasks.workunit.client.0.smithi062.stdout:0/492: mkdir d1/d25/d31/db5 0 2024-05-09T06:29:59.188 INFO:tasks.workunit.client.0.smithi062.stdout:0/493: write d1/f17 [596612,125030] 0 2024-05-09T06:29:59.188 INFO:tasks.workunit.client.0.smithi062.stdout:0/494: read d1/d6a/d6d/d93/f53 [668572,53050] 0 2024-05-09T06:29:59.189 INFO:tasks.workunit.client.0.smithi062.stdout:1/424: symlink d8/d14/d2b/d3c/d44/d6e/d7a/l96 0 2024-05-09T06:29:59.190 INFO:tasks.workunit.client.0.smithi062.stdout:2/517: getdents d0/d9/d17/d37/d69 0 2024-05-09T06:29:59.193 INFO:tasks.workunit.client.0.smithi062.stdout:0/495: creat d1/d25/d49/d42/d43/d54/d9d/fb6 x:0 0 0 2024-05-09T06:29:59.193 INFO:tasks.workunit.client.0.smithi062.stdout:0/496: fdatasync d1/d25/d31/d6c/d44/d57/d75/f8c 0 2024-05-09T06:29:59.193 INFO:tasks.workunit.client.0.smithi062.stdout:1/425: truncate d8/f49 1703323 0 2024-05-09T06:29:59.194 INFO:tasks.workunit.client.0.smithi062.stdout:2/518: symlink d0/d9/d17/d89/d8f/la0 0 2024-05-09T06:29:59.197 INFO:tasks.workunit.client.0.smithi062.stdout:4/638: dwrite d0/d3c/fbb [0,4194304] 0 2024-05-09T06:29:59.199 INFO:tasks.workunit.client.0.smithi062.stdout:0/497: mkdir d1/d25/d49/d4f/db7 0 2024-05-09T06:29:59.199 INFO:tasks.workunit.client.0.smithi062.stdout:0/498: chown d1/fc 61986048 1 2024-05-09T06:29:59.200 INFO:tasks.workunit.client.0.smithi062.stdout:0/499: fsync d1/f19 0 2024-05-09T06:29:59.200 INFO:tasks.workunit.client.0.smithi062.stdout:2/519: dread d0/d9/dd/f33 [0,4194304] 0 2024-05-09T06:29:59.200 INFO:tasks.workunit.client.0.smithi062.stdout:2/520: write d0/f6 [3817366,91931] 0 2024-05-09T06:29:59.200 INFO:tasks.workunit.client.0.smithi062.stdout:2/521: write d0/d9/d38/d41/d53/f61 [575391,84412] 0 2024-05-09T06:29:59.207 INFO:tasks.workunit.client.0.smithi062.stdout:4/639: read d0/d2a/f25 [1237774,50376] 0 2024-05-09T06:29:59.208 INFO:tasks.workunit.client.0.smithi062.stdout:2/522: creat d0/d9/d17/d37/fa1 x:0 0 0 2024-05-09T06:29:59.208 INFO:tasks.workunit.client.0.smithi062.stdout:2/523: write d0/d9/dd/d65/d6d/f24 [1979350,105285] 0 2024-05-09T06:29:59.210 INFO:tasks.workunit.client.0.smithi062.stdout:7/538: sync 2024-05-09T06:29:59.211 INFO:tasks.workunit.client.0.smithi062.stdout:1/426: dwrite d8/d14/d2b/d3c/d44/d64/f68 [0,4194304] 0 2024-05-09T06:29:59.215 INFO:tasks.workunit.client.0.smithi062.stdout:0/500: rmdir d1/d25/d31 39 2024-05-09T06:29:59.216 INFO:tasks.workunit.client.0.smithi062.stdout:2/524: unlink d0/d9/d17/d37/d69/f8e 0 2024-05-09T06:29:59.220 INFO:tasks.workunit.client.0.smithi062.stdout:7/539: mknod d0/d12/d66/cad 0 2024-05-09T06:29:59.220 INFO:tasks.workunit.client.0.smithi062.stdout:7/540: getdents d0/d3 0 2024-05-09T06:29:59.228 INFO:tasks.workunit.client.0.smithi062.stdout:1/427: creat d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 x:0 0 0 2024-05-09T06:29:59.230 INFO:tasks.workunit.client.0.smithi062.stdout:7/541: dread d0/d12/d33/d67/f6a [0,4194304] 0 2024-05-09T06:29:59.237 INFO:tasks.workunit.client.0.smithi062.stdout:0/501: rename d1/d25/d49/d4f/f9b to d1/d25/d31/d6c/d44/d6e/fb8 0 2024-05-09T06:29:59.238 INFO:tasks.workunit.client.0.smithi062.stdout:1/428: mkdir d8/d14/d2b/d3c/d44/d6e/d98 0 2024-05-09T06:29:59.240 INFO:tasks.workunit.client.0.smithi062.stdout:7/542: creat d0/d3a/d3f/dab/fae x:0 0 0 2024-05-09T06:29:59.241 INFO:tasks.workunit.client.0.smithi062.stdout:0/502: unlink d1/d25/d31/d6c/l8a 0 2024-05-09T06:29:59.241 INFO:tasks.workunit.client.0.smithi062.stdout:2/525: dwrite d0/d9/dd/f1c [0,4194304] 0 2024-05-09T06:29:59.243 INFO:tasks.workunit.client.0.smithi062.stdout:0/503: rmdir d1/d25/d31/d6c 39 2024-05-09T06:29:59.246 INFO:tasks.workunit.client.0.smithi062.stdout:1/429: write d8/d14/f72 [1663790,85840] 0 2024-05-09T06:29:59.248 INFO:tasks.workunit.client.0.smithi062.stdout:0/504: mknod d1/d25/d49/d42/d43/d54/d9d/cb9 0 2024-05-09T06:29:59.250 INFO:tasks.workunit.client.0.smithi062.stdout:7/543: rename d0/d3a/f94 to d0/d3a/d3f/faf 0 2024-05-09T06:29:59.250 INFO:tasks.workunit.client.0.smithi062.stdout:7/544: chown d0/f4 530524 1 2024-05-09T06:29:59.255 INFO:tasks.workunit.client.0.smithi062.stdout:1/430: creat d8/d14/d2b/d3c/d44/d6e/d7a/f99 x:0 0 0 2024-05-09T06:29:59.257 INFO:tasks.workunit.client.0.smithi062.stdout:0/505: creat d1/d25/d49/d42/d43/d54/fba x:0 0 0 2024-05-09T06:29:59.262 INFO:tasks.workunit.client.0.smithi062.stdout:7/545: link d0/d12/d33/d67/f7c d0/d12/d66/d9b/fb0 0 2024-05-09T06:29:59.264 INFO:tasks.workunit.client.0.smithi062.stdout:1/431: creat d8/d14/d2b/d3d/f9a x:0 0 0 2024-05-09T06:29:59.266 INFO:tasks.workunit.client.0.smithi062.stdout:0/506: unlink d1/f1b 0 2024-05-09T06:29:59.270 INFO:tasks.workunit.client.0.smithi062.stdout:2/526: rename d0/d9/dd/d65/d6d/d7e/d8d/d93/f9f to d0/fa2 0 2024-05-09T06:29:59.273 INFO:tasks.workunit.client.0.smithi062.stdout:1/432: unlink d8/d14/d2b/d3c/d44/l6a 0 2024-05-09T06:29:59.274 INFO:tasks.workunit.client.0.smithi062.stdout:1/433: truncate d8/d14/d2b/d3d/f9a 263312 0 2024-05-09T06:29:59.274 INFO:tasks.workunit.client.0.smithi062.stdout:0/507: mknod d1/d25/d49/d7e/cbb 0 2024-05-09T06:29:59.276 INFO:tasks.workunit.client.0.smithi062.stdout:2/527: creat d0/d9/dd/d65/d6d/d21/fa3 x:0 0 0 2024-05-09T06:29:59.277 INFO:tasks.workunit.client.0.smithi062.stdout:1/434: creat d8/d2c/f9b x:0 0 0 2024-05-09T06:29:59.278 INFO:tasks.workunit.client.0.smithi062.stdout:7/546: dwrite d0/d3a/d51/d64/d6d/d88/f8a [0,4194304] 0 2024-05-09T06:29:59.279 INFO:tasks.workunit.client.0.smithi062.stdout:0/508: symlink d1/d25/d49/d3c/lbc 0 2024-05-09T06:29:59.279 INFO:tasks.workunit.client.0.smithi062.stdout:0/509: creat d1/d6a/fbd x:0 0 0 2024-05-09T06:29:59.280 INFO:tasks.workunit.client.0.smithi062.stdout:2/528: getdents d0/d9/d38 0 2024-05-09T06:29:59.286 INFO:tasks.workunit.client.0.smithi062.stdout:0/510: mkdir d1/d25/d49/d42/dad/dbe 0 2024-05-09T06:29:59.286 INFO:tasks.workunit.client.0.smithi062.stdout:0/511: stat d1/d25/d49/d4f/d52/f83 0 2024-05-09T06:29:59.287 INFO:tasks.workunit.client.0.smithi062.stdout:2/529: rename d0/d9/d17/d89/d8f/d91 to d0/d9/dd/d65/d6d/d96/da4 0 2024-05-09T06:29:59.289 INFO:tasks.workunit.client.0.smithi062.stdout:0/512: unlink d1/d25/d59/f97 0 2024-05-09T06:29:59.291 INFO:tasks.workunit.client.0.smithi062.stdout:2/530: rename d0/d9/d17/d37/l88 to d0/d9/d17/d37/la5 0 2024-05-09T06:29:59.291 INFO:tasks.workunit.client.0.smithi062.stdout:2/531: stat d0/d9/dd/d65/d6d/d21/d29/d3d/d46/l8c 0 2024-05-09T06:29:59.293 INFO:tasks.workunit.client.0.smithi062.stdout:1/435: dwrite d8/d14/d2b/d3c/d44/d6e/d7a/f99 [0,4194304] 0 2024-05-09T06:29:59.294 INFO:tasks.workunit.client.0.smithi062.stdout:0/513: rename d1/d25/d49/d42/d43/d54/c56 to d1/d25/d31/d6c/d44/d57/cbf 0 2024-05-09T06:29:59.297 INFO:tasks.workunit.client.0.smithi062.stdout:2/532: write d0/d9/d38/d41/d53/f63 [2837716,61044] 0 2024-05-09T06:29:59.300 INFO:tasks.workunit.client.0.smithi062.stdout:0/514: creat d1/d25/d31/d6c/d44/d57/db4/fc0 x:0 0 0 2024-05-09T06:29:59.301 INFO:tasks.workunit.client.0.smithi062.stdout:2/533: mknod d0/d9/dd/d65/d6d/d21/d29/ca6 0 2024-05-09T06:29:59.302 INFO:tasks.workunit.client.0.smithi062.stdout:2/534: write d0/d9/dd/d65/d6d/d21/d29/f76 [610570,66857] 0 2024-05-09T06:29:59.305 INFO:tasks.workunit.client.0.smithi062.stdout:0/515: unlink d1/d25/d31/f46 0 2024-05-09T06:29:59.306 INFO:tasks.workunit.client.0.smithi062.stdout:2/535: mknod d0/d9/dd/d65/d6d/d21/d29/ca7 0 2024-05-09T06:29:59.313 INFO:tasks.workunit.client.0.smithi062.stdout:5/559: sync 2024-05-09T06:29:59.315 INFO:tasks.workunit.client.0.smithi062.stdout:1/436: rename d8/d2c to d8/d1d/d9c 0 2024-05-09T06:29:59.319 INFO:tasks.workunit.client.0.smithi062.stdout:5/560: rename d0/cb to d0/d8/d1c/d23/d3e/dad/cb9 0 2024-05-09T06:29:59.321 INFO:tasks.workunit.client.0.smithi062.stdout:1/437: mkdir d8/d14/d2b/d9d 0 2024-05-09T06:29:59.323 INFO:tasks.workunit.client.0.smithi062.stdout:1/438: truncate f6 11099057 0 2024-05-09T06:29:59.325 INFO:tasks.workunit.client.0.smithi062.stdout:1/439: truncate d8/d1d/f74 2740537 0 2024-05-09T06:29:59.331 INFO:tasks.workunit.client.0.smithi062.stdout:0/516: dwrite d1/d6a/d6d/d93/f53 [0,4194304] 0 2024-05-09T06:29:59.331 INFO:tasks.workunit.client.0.smithi062.stdout:5/561: write d0/d8/d18/f78 [4139732,70450] 0 2024-05-09T06:29:59.334 INFO:tasks.workunit.client.0.smithi062.stdout:2/536: dwrite d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/f7b [0,4194304] 0 2024-05-09T06:29:59.334 INFO:tasks.workunit.client.0.smithi062.stdout:0/517: write d1/d25/fa4 [728378,84238] 0 2024-05-09T06:29:59.347 INFO:tasks.workunit.client.0.smithi062.stdout:2/537: rmdir d0/d9/d38/d41/d53 39 2024-05-09T06:29:59.349 INFO:tasks.workunit.client.0.smithi062.stdout:1/440: unlink d8/f31 0 2024-05-09T06:29:59.351 INFO:tasks.workunit.client.0.smithi062.stdout:2/538: creat d0/d9/dd/d65/d6d/d21/d29/d3d/fa8 x:0 0 0 2024-05-09T06:29:59.353 INFO:tasks.workunit.client.0.smithi062.stdout:1/441: dread d8/d14/d2b/d3c/f6b [0,4194304] 0 2024-05-09T06:29:59.354 INFO:tasks.workunit.client.0.smithi062.stdout:1/442: dread - d8/d14/d2b/d3c/d44/d6e/d7a/f84 zero size 2024-05-09T06:29:59.354 INFO:tasks.workunit.client.0.smithi062.stdout:1/443: fdatasync d8/d14/d2b/d3c/f4e 0 2024-05-09T06:29:59.354 INFO:tasks.workunit.client.0.smithi062.stdout:1/444: fdatasync d8/d14/d2b/d3d/f9a 0 2024-05-09T06:29:59.354 INFO:tasks.workunit.client.0.smithi062.stdout:5/562: dwrite d0/d56/d45/d92/fac [0,4194304] 0 2024-05-09T06:29:59.356 INFO:tasks.workunit.client.0.smithi062.stdout:2/539: dread d0/d9/d38/d41/d48/f4b [0,4194304] 0 2024-05-09T06:29:59.356 INFO:tasks.workunit.client.0.smithi062.stdout:2/540: dread - d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/f83 zero size 2024-05-09T06:29:59.356 INFO:tasks.workunit.client.0.smithi062.stdout:2/541: write d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f9a [842367,31693] 0 2024-05-09T06:29:59.357 INFO:tasks.workunit.client.0.smithi062.stdout:0/518: dwrite d1/d18/f34 [0,4194304] 0 2024-05-09T06:29:59.359 INFO:tasks.workunit.client.0.smithi062.stdout:5/563: mknod d0/d8/d47/cba 0 2024-05-09T06:29:59.362 INFO:tasks.workunit.client.0.smithi062.stdout:2/542: truncate d0/d9/d38/f6a 744088 0 2024-05-09T06:29:59.362 INFO:tasks.workunit.client.0.smithi062.stdout:2/543: dread - d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/f83 zero size 2024-05-09T06:29:59.368 INFO:tasks.workunit.client.0.smithi062.stdout:5/564: symlink d0/d11/d67/lbb 0 2024-05-09T06:29:59.368 INFO:tasks.workunit.client.0.smithi062.stdout:5/565: dread - d0/d8/d1c/d23/d42/faa zero size 2024-05-09T06:29:59.370 INFO:tasks.workunit.client.0.smithi062.stdout:5/566: unlink d0/d8/d1c/d2c/d7d/d4a/c96 0 2024-05-09T06:29:59.372 INFO:tasks.workunit.client.0.smithi062.stdout:5/567: mkdir d0/d3b/dbc 0 2024-05-09T06:29:59.374 INFO:tasks.workunit.client.0.smithi062.stdout:2/544: dread d0/d9/dd/f5e [0,4194304] 0 2024-05-09T06:29:59.377 INFO:tasks.workunit.client.0.smithi062.stdout:5/568: rename d0/d8/d1c/d23/d3e/dad to d0/d8/d1c/d2c/d7d/d4a/d9d/dbd 0 2024-05-09T06:29:59.379 INFO:tasks.workunit.client.0.smithi062.stdout:1/445: dwrite d8/d14/d2b/d3c/d44/f3a [0,4194304] 0 2024-05-09T06:29:59.381 INFO:tasks.workunit.client.0.smithi062.stdout:0/519: dwrite d1/d6a/fbd [0,4194304] 0 2024-05-09T06:29:59.382 INFO:tasks.workunit.client.0.smithi062.stdout:2/545: mknod d0/d9/d38/d41/d8a/ca9 0 2024-05-09T06:29:59.391 INFO:tasks.workunit.client.0.smithi062.stdout:0/520: truncate d1/fc 1522081 0 2024-05-09T06:29:59.393 INFO:tasks.workunit.client.0.smithi062.stdout:2/546: symlink d0/d9/d38/laa 0 2024-05-09T06:29:59.397 INFO:tasks.workunit.client.0.smithi062.stdout:0/521: creat d1/d25/d49/d4f/d52/fc1 x:0 0 0 2024-05-09T06:29:59.405 INFO:tasks.workunit.client.0.smithi062.stdout:0/522: link d1/d25/d31/d6c/d44/d57/f64 d1/d25/d31/d6c/fc2 0 2024-05-09T06:29:59.405 INFO:tasks.workunit.client.0.smithi062.stdout:0/523: chown d1/d18/f35 855923 1 2024-05-09T06:29:59.405 INFO:tasks.workunit.client.0.smithi062.stdout:0/524: dread - d1/d25/d49/d3c/f5c zero size 2024-05-09T06:29:59.405 INFO:tasks.workunit.client.0.smithi062.stdout:0/525: fdatasync d1/d25/d31/d6c/f66 0 2024-05-09T06:29:59.408 INFO:tasks.workunit.client.0.smithi062.stdout:5/569: dwrite d0/d3b/d3f/f70 [0,4194304] 0 2024-05-09T06:29:59.408 INFO:tasks.workunit.client.0.smithi062.stdout:5/570: stat d0/d56/f9e 0 2024-05-09T06:29:59.408 INFO:tasks.workunit.client.0.smithi062.stdout:1/446: dwrite d8/d14/d2b/d3c/d44/d6e/f73 [0,4194304] 0 2024-05-09T06:29:59.411 INFO:tasks.workunit.client.0.smithi062.stdout:2/547: dwrite d0/d9/dd/d65/d6d/d21/f5b [0,4194304] 0 2024-05-09T06:29:59.411 INFO:tasks.workunit.client.0.smithi062.stdout:2/548: chown d0/d9/d38/d41/d48/f4b 37 1 2024-05-09T06:29:59.423 INFO:tasks.workunit.client.0.smithi062.stdout:2/549: symlink d0/d9/dd/d65/d6d/d96/lab 0 2024-05-09T06:29:59.442 INFO:tasks.workunit.client.0.smithi062.stdout:0/526: dwrite d1/d25/d49/d4f/d52/d87/f70 [0,4194304] 0 2024-05-09T06:29:59.442 INFO:tasks.workunit.client.0.smithi062.stdout:0/527: fdatasync d1/d25/d49/d4f/d52/fc1 0 2024-05-09T06:29:59.442 INFO:tasks.workunit.client.0.smithi062.stdout:0/528: truncate d1/d25/d49/d42/d43/d54/fba 297558 0 2024-05-09T06:29:59.445 INFO:tasks.workunit.client.0.smithi062.stdout:5/571: dwrite d0/fa7 [0,4194304] 0 2024-05-09T06:29:59.446 INFO:tasks.workunit.client.0.smithi062.stdout:5/572: stat d0/d8/d1c/d23/d3e/l55 0 2024-05-09T06:29:59.446 INFO:tasks.workunit.client.0.smithi062.stdout:1/447: dwrite d8/d14/d2b/d3c/d44/d6e/d7a/f99 [0,4194304] 0 2024-05-09T06:29:59.446 INFO:tasks.workunit.client.0.smithi062.stdout:1/448: readlink d8/lf 0 2024-05-09T06:29:59.446 INFO:tasks.workunit.client.0.smithi062.stdout:2/550: dwrite d0/d9/dd/d65/d6d/d21/d29/d3d/f67 [0,4194304] 0 2024-05-09T06:29:59.446 INFO:tasks.workunit.client.0.smithi062.stdout:2/551: fsync d0/d9/d38/d41/d53/f63 0 2024-05-09T06:29:59.447 INFO:tasks.workunit.client.0.smithi062.stdout:2/552: write d0/d9/dd/d65/d6d/d21/fa3 [780997,74870] 0 2024-05-09T06:29:59.449 INFO:tasks.workunit.client.0.smithi062.stdout:1/449: dread d8/f3f [0,4194304] 0 2024-05-09T06:29:59.452 INFO:tasks.workunit.client.0.smithi062.stdout:1/450: dread d8/d14/d2b/d3c/d44/d38/f77 [0,4194304] 0 2024-05-09T06:29:59.465 INFO:tasks.workunit.client.0.smithi062.stdout:2/553: dwrite d0/d9/dd/d65/f71 [0,4194304] 0 2024-05-09T06:29:59.485 INFO:tasks.workunit.client.0.smithi062.stdout:0/529: mknod d1/d25/d31/d6c/d44/d57/d84/cc3 0 2024-05-09T06:29:59.507 INFO:tasks.workunit.client.0.smithi062.stdout:1/451: mknod d8/d14/d2b/d3c/d44/d7f/c9e 0 2024-05-09T06:29:59.578 INFO:tasks.workunit.client.0.smithi062.stdout:0/530: getdents d1/d25/d49 0 2024-05-09T06:29:59.578 INFO:tasks.workunit.client.0.smithi062.stdout:0/531: write d1/d25/d49/d42/d43/d54/fba [375111,68835] 0 2024-05-09T06:29:59.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/532: unlink d1/d25/d49/d3c/f3f 0 2024-05-09T06:29:59.601 INFO:tasks.workunit.client.0.smithi062.stdout:5/573: rename d0/d56 to d0/d8/d47/dbe 0 2024-05-09T06:29:59.603 INFO:tasks.workunit.client.0.smithi062.stdout:5/574: dread d0/f5c [0,4194304] 0 2024-05-09T06:29:59.605 INFO:tasks.workunit.client.0.smithi062.stdout:5/575: dread d0/f5c [0,4194304] 0 2024-05-09T06:29:59.606 INFO:tasks.workunit.client.0.smithi062.stdout:5/576: mkdir d0/d8/d47/dbe/d5/dbf 0 2024-05-09T06:29:59.607 INFO:tasks.workunit.client.0.smithi062.stdout:5/577: fsync d0/d8/d18/f78 0 2024-05-09T06:29:59.619 INFO:tasks.workunit.client.0.smithi062.stdout:0/533: dwrite d1/d25/d49/d3c/f5c [0,4194304] 0 2024-05-09T06:29:59.625 INFO:tasks.workunit.client.0.smithi062.stdout:2/554: rmdir d0/d9/d38/d41/d53 39 2024-05-09T06:29:59.629 INFO:tasks.workunit.client.0.smithi062.stdout:5/578: dwrite d0/d8/d47/dbe/d45/f76 [0,4194304] 0 2024-05-09T06:29:59.642 INFO:tasks.workunit.client.0.smithi062.stdout:1/452: write d8/d1d/f74 [807323,36525] 0 2024-05-09T06:29:59.642 INFO:tasks.workunit.client.0.smithi062.stdout:1/453: readlink d8/l11 0 2024-05-09T06:29:59.652 INFO:tasks.workunit.client.0.smithi062.stdout:5/579: dwrite d0/d11/f83 [0,4194304] 0 2024-05-09T06:29:59.652 INFO:tasks.workunit.client.0.smithi062.stdout:5/580: creat d0/fc0 x:0 0 0 2024-05-09T06:29:59.652 INFO:tasks.workunit.client.0.smithi062.stdout:5/581: readlink d0/d8/d1c/d23/d3e/l55 0 2024-05-09T06:29:59.661 INFO:tasks.workunit.client.0.smithi062.stdout:2/555: rename d0/d9/dd/f1a to d0/d9/dd/d65/fac 0 2024-05-09T06:29:59.661 INFO:tasks.workunit.client.0.smithi062.stdout:2/556: write d0/fa [162054,14558] 0 2024-05-09T06:29:59.662 INFO:tasks.workunit.client.0.smithi062.stdout:2/557: mknod d0/d9/dd/d65/d6d/d96/cad 0 2024-05-09T06:29:59.663 INFO:tasks.workunit.client.0.smithi062.stdout:5/582: write d0/d11/f89 [1347293,15816] 0 2024-05-09T06:29:59.663 INFO:tasks.workunit.client.0.smithi062.stdout:5/583: chown d0/d8/d47/dbe/d45/d92/f9b 1 1 2024-05-09T06:29:59.666 INFO:tasks.workunit.client.0.smithi062.stdout:0/534: symlink d1/d25/d49/lc4 0 2024-05-09T06:29:59.667 INFO:tasks.workunit.client.0.smithi062.stdout:5/584: symlink d0/d8/d47/d6e/lc1 0 2024-05-09T06:29:59.668 INFO:tasks.workunit.client.0.smithi062.stdout:1/454: dwrite d8/d1d/d9c/d41/f8a [0,4194304] 0 2024-05-09T06:29:59.669 INFO:tasks.workunit.client.0.smithi062.stdout:0/535: rename d1/d18/f34 to d1/d25/d31/d6c/d44/fc5 0 2024-05-09T06:29:59.671 INFO:tasks.workunit.client.0.smithi062.stdout:6/603: sync 2024-05-09T06:29:59.671 INFO:tasks.workunit.client.0.smithi062.stdout:8/659: sync 2024-05-09T06:29:59.671 INFO:tasks.workunit.client.0.smithi062.stdout:9/570: sync 2024-05-09T06:29:59.671 INFO:tasks.workunit.client.0.smithi062.stdout:3/462: sync 2024-05-09T06:29:59.671 INFO:tasks.workunit.client.0.smithi062.stdout:7/547: sync 2024-05-09T06:29:59.671 INFO:tasks.workunit.client.0.smithi062.stdout:4/640: sync 2024-05-09T06:29:59.672 INFO:tasks.workunit.client.0.smithi062.stdout:3/463: fdatasync d1/f46 0 2024-05-09T06:29:59.672 INFO:tasks.workunit.client.0.smithi062.stdout:7/548: fsync d0/d3a/d3f/f81 0 2024-05-09T06:29:59.672 INFO:tasks.workunit.client.0.smithi062.stdout:3/464: dread - d1/d1e/d54/f63 zero size 2024-05-09T06:29:59.672 INFO:tasks.workunit.client.0.smithi062.stdout:5/585: mknod d0/d8/d1c/d2c/d7d/d4a/d9d/dbd/cc2 0 2024-05-09T06:29:59.672 INFO:tasks.workunit.client.0.smithi062.stdout:5/586: write d0/d8/d47/dbe/d5/fa3 [870924,58547] 0 2024-05-09T06:29:59.673 INFO:tasks.workunit.client.0.smithi062.stdout:1/455: creat d8/d14/d2b/d3c/d7d/f9f x:0 0 0 2024-05-09T06:29:59.676 INFO:tasks.workunit.client.0.smithi062.stdout:1/456: dread d8/f5a [0,4194304] 0 2024-05-09T06:29:59.677 INFO:tasks.workunit.client.0.smithi062.stdout:0/536: mknod d1/d25/d31/d6c/d44/d57/d75/cc6 0 2024-05-09T06:29:59.678 INFO:tasks.workunit.client.0.smithi062.stdout:2/558: creat d0/d9/dd/d65/d6d/d21/d29/d3d/fae x:0 0 0 2024-05-09T06:29:59.679 INFO:tasks.workunit.client.0.smithi062.stdout:6/604: mknod dc/d28/d10/d20/cc9 0 2024-05-09T06:29:59.684 INFO:tasks.workunit.client.0.smithi062.stdout:8/660: symlink da/d11/ld3 0 2024-05-09T06:29:59.686 INFO:tasks.workunit.client.0.smithi062.stdout:9/571: rmdir d3/d3e/d52/d58/d77/db6 0 2024-05-09T06:29:59.688 INFO:tasks.workunit.client.0.smithi062.stdout:2/559: write d0/d9/dd/f5e [3454737,2687] 0 2024-05-09T06:29:59.688 INFO:tasks.workunit.client.0.smithi062.stdout:2/560: creat d0/d9/dd/d65/d6d/d7e/d8d/d93/faf x:0 0 0 2024-05-09T06:29:59.689 INFO:tasks.workunit.client.0.smithi062.stdout:1/457: write d8/d1d/f26 [1972688,24782] 0 2024-05-09T06:29:59.695 INFO:tasks.workunit.client.0.smithi062.stdout:9/572: dread d3/d3e/d52/d58/d1c/d21/f67 [0,4194304] 0 2024-05-09T06:29:59.695 INFO:tasks.workunit.client.0.smithi062.stdout:9/573: fsync d3/f18 0 2024-05-09T06:29:59.701 INFO:tasks.workunit.client.0.smithi062.stdout:6/605: creat dc/d28/d46/d4a/d5d/fca x:0 0 0 2024-05-09T06:29:59.706 INFO:tasks.workunit.client.0.smithi062.stdout:2/561: creat d0/d9/d38/d41/fb0 x:0 0 0 2024-05-09T06:29:59.707 INFO:tasks.workunit.client.0.smithi062.stdout:1/458: write d8/d14/f32 [3264418,30692] 0 2024-05-09T06:29:59.708 INFO:tasks.workunit.client.0.smithi062.stdout:6/606: dread dc/d28/d10/d20/f31 [0,4194304] 0 2024-05-09T06:29:59.712 INFO:tasks.workunit.client.0.smithi062.stdout:1/459: mknod d8/d14/d2b/d3c/d44/d7f/ca0 0 2024-05-09T06:29:59.712 INFO:tasks.workunit.client.0.smithi062.stdout:1/460: fdatasync d8/d1d/d9c/f50 0 2024-05-09T06:29:59.712 INFO:tasks.workunit.client.0.smithi062.stdout:1/461: chown d8/d1d/c6d 511 1 2024-05-09T06:29:59.712 INFO:tasks.workunit.client.0.smithi062.stdout:1/462: fdatasync d8/f13 0 2024-05-09T06:29:59.712 INFO:tasks.workunit.client.0.smithi062.stdout:1/463: fsync d8/d1d/d9c/f50 0 2024-05-09T06:29:59.712 INFO:tasks.workunit.client.0.smithi062.stdout:1/464: dread - d8/d1d/d9c/f45 zero size 2024-05-09T06:29:59.714 INFO:tasks.workunit.client.0.smithi062.stdout:6/607: unlink dc/d28/l16 0 2024-05-09T06:29:59.716 INFO:tasks.workunit.client.0.smithi062.stdout:0/537: rename d1/d25/d49/d3c to d1/d6a/d6d/d93/d94/dc7 0 2024-05-09T06:29:59.718 INFO:tasks.workunit.client.0.smithi062.stdout:0/538: mkdir d1/d25/d49/d4f/d52/d87/dc8 0 2024-05-09T06:29:59.725 INFO:tasks.workunit.client.0.smithi062.stdout:3/465: dwrite d1/d1e/d26/d43/d92/f7b [0,4194304] 0 2024-05-09T06:29:59.725 INFO:tasks.workunit.client.0.smithi062.stdout:3/466: dread - d1/d1e/d26/f56 zero size 2024-05-09T06:29:59.727 INFO:tasks.workunit.client.0.smithi062.stdout:7/549: dwrite d0/d12/d33/f46 [0,4194304] 0 2024-05-09T06:29:59.728 INFO:tasks.workunit.client.0.smithi062.stdout:7/550: mknod d0/da8/cb1 0 2024-05-09T06:29:59.733 INFO:tasks.workunit.client.0.smithi062.stdout:5/587: rename d0/d8/d1c/d2c/d7d/d4a/d9d to d0/d8/d1c/d2c/d7d/d4a/dc3 0 2024-05-09T06:29:59.733 INFO:tasks.workunit.client.0.smithi062.stdout:5/588: write d0/d8/d1c/d23/d3e/f4d [1796270,118367] 0 2024-05-09T06:29:59.736 INFO:tasks.workunit.client.0.smithi062.stdout:5/589: rename d0/d8/d1c/d23/f4f to d0/d8/fc4 0 2024-05-09T06:29:59.736 INFO:tasks.workunit.client.0.smithi062.stdout:5/590: dread - d0/d8/d47/dbe/d45/da5/faf zero size 2024-05-09T06:29:59.736 INFO:tasks.workunit.client.0.smithi062.stdout:5/591: stat d0/d8/d47/dbe/d5/f6f 0 2024-05-09T06:29:59.738 INFO:tasks.workunit.client.0.smithi062.stdout:4/641: dwrite d0/d2a/d14/d7e/d8e/d9e/f16 [0,4194304] 0 2024-05-09T06:29:59.739 INFO:tasks.workunit.client.0.smithi062.stdout:8/661: dwrite da/d11/d2e/d34/fb4 [4194304,4194304] 0 2024-05-09T06:29:59.739 INFO:tasks.workunit.client.0.smithi062.stdout:4/642: read d0/d2a/d14/d7e/d8e/d9e/d28/f59 [1471282,87496] 0 2024-05-09T06:29:59.741 INFO:tasks.workunit.client.0.smithi062.stdout:7/551: dread d0/d3/f40 [0,4194304] 0 2024-05-09T06:29:59.743 INFO:tasks.workunit.client.0.smithi062.stdout:4/643: mkdir d0/d2a/d14/d4f/d6b/dc0 0 2024-05-09T06:29:59.747 INFO:tasks.workunit.client.0.smithi062.stdout:8/662: rename da/d85/d8a to da/d11/d2e/d34/dd4 0 2024-05-09T06:29:59.748 INFO:tasks.workunit.client.0.smithi062.stdout:8/663: creat da/d11/d2e/d34/d90/fd5 x:0 0 0 2024-05-09T06:29:59.749 INFO:tasks.workunit.client.0.smithi062.stdout:4/644: dread d0/d2a/f36 [0,4194304] 0 2024-05-09T06:29:59.829 INFO:tasks.workunit.client.0.smithi062.stdout:9/574: dwrite d3/f98 [0,4194304] 0 2024-05-09T06:29:59.829 INFO:tasks.workunit.client.0.smithi062.stdout:9/575: truncate d3/d3e/d7c/f7e 263373 0 2024-05-09T06:29:59.832 INFO:tasks.workunit.client.0.smithi062.stdout:8/664: dread da/d11/f29 [0,4194304] 0 2024-05-09T06:29:59.835 INFO:tasks.workunit.client.0.smithi062.stdout:1/465: dwrite d8/f49 [0,4194304] 0 2024-05-09T06:29:59.835 INFO:tasks.workunit.client.0.smithi062.stdout:9/576: dread d3/d3e/d52/d58/d1c/d1e/d60/f73 [0,4194304] 0 2024-05-09T06:29:59.835 INFO:tasks.workunit.client.0.smithi062.stdout:1/466: readlink d8/d1d/l28 0 2024-05-09T06:29:59.835 INFO:tasks.workunit.client.0.smithi062.stdout:9/577: stat d3/f98 0 2024-05-09T06:29:59.836 INFO:tasks.workunit.client.0.smithi062.stdout:8/665: mkdir da/d11/dd2/dd6 0 2024-05-09T06:29:59.838 INFO:tasks.workunit.client.0.smithi062.stdout:2/562: dwrite d0/d9/dd/d65/fac [4194304,4194304] 0 2024-05-09T06:29:59.838 INFO:tasks.workunit.client.0.smithi062.stdout:6/608: dwrite dc/d28/d46/d81/dad/fbc [0,4194304] 0 2024-05-09T06:29:59.839 INFO:tasks.workunit.client.0.smithi062.stdout:2/563: read d0/d9/dd/d65/d6d/d21/d29/f76 [299847,31405] 0 2024-05-09T06:29:59.839 INFO:tasks.workunit.client.0.smithi062.stdout:1/467: getdents d8/d1d/d9c 0 2024-05-09T06:29:59.844 INFO:tasks.workunit.client.0.smithi062.stdout:9/578: dread d3/d3e/d52/d58/d1c/d1e/f4c [0,4194304] 0 2024-05-09T06:29:59.845 INFO:tasks.workunit.client.0.smithi062.stdout:7/552: dwrite d0/d12/d33/d67/f7e [0,4194304] 0 2024-05-09T06:29:59.845 INFO:tasks.workunit.client.0.smithi062.stdout:7/553: write d0/f20 [1155923,37208] 0 2024-05-09T06:29:59.846 INFO:tasks.workunit.client.0.smithi062.stdout:3/467: dwrite d1/d1e/f14 [0,4194304] 0 2024-05-09T06:29:59.851 INFO:tasks.workunit.client.0.smithi062.stdout:1/468: creat d8/d14/d2b/d3c/fa1 x:0 0 0 2024-05-09T06:29:59.852 INFO:tasks.workunit.client.0.smithi062.stdout:4/645: dwrite d0/d2a/d8/f50 [4194304,4194304] 0 2024-05-09T06:29:59.856 INFO:tasks.workunit.client.0.smithi062.stdout:7/554: truncate d0/d12/d33/d67/f6a 3185907 0 2024-05-09T06:29:59.856 INFO:tasks.workunit.client.0.smithi062.stdout:7/555: fsync d0/d3/f2b 0 2024-05-09T06:29:59.857 INFO:tasks.workunit.client.0.smithi062.stdout:3/468: creat d1/d1e/d36/d4a/d51/f9b x:0 0 0 2024-05-09T06:29:59.865 INFO:tasks.workunit.client.0.smithi062.stdout:1/469: mknod d8/d14/d2b/d9d/ca2 0 2024-05-09T06:29:59.867 INFO:tasks.workunit.client.0.smithi062.stdout:6/609: dwrite dc/d28/f11 [4194304,4194304] 0 2024-05-09T06:29:59.868 INFO:tasks.workunit.client.0.smithi062.stdout:9/579: dwrite d3/d3e/d52/d58/d1c/d21/f53 [0,4194304] 0 2024-05-09T06:29:59.868 INFO:tasks.workunit.client.0.smithi062.stdout:9/580: truncate d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 167778 0 2024-05-09T06:29:59.868 INFO:tasks.workunit.client.0.smithi062.stdout:9/581: stat d3/d3e/d7c/la0 0 2024-05-09T06:29:59.868 INFO:tasks.workunit.client.0.smithi062.stdout:9/582: chown d3/d20 4404 1 2024-05-09T06:29:59.870 INFO:tasks.workunit.client.0.smithi062.stdout:4/646: mkdir d0/d3c/dc1 0 2024-05-09T06:29:59.871 INFO:tasks.workunit.client.0.smithi062.stdout:4/647: readlink d0/d2a/d14/d7e/d8e/d9e/l5c 0 2024-05-09T06:29:59.875 INFO:tasks.workunit.client.0.smithi062.stdout:7/556: truncate d0/d3a/d3f/f5a 898464 0 2024-05-09T06:29:59.878 INFO:tasks.workunit.client.0.smithi062.stdout:2/564: rename d0/d9/d17/d37/d69 to d0/d9/d38/d41/db1 0 2024-05-09T06:29:59.879 INFO:tasks.workunit.client.0.smithi062.stdout:8/666: getdents da/d11/dd2 0 2024-05-09T06:29:59.882 INFO:tasks.workunit.client.0.smithi062.stdout:9/583: mknod d3/cb9 0 2024-05-09T06:29:59.882 INFO:tasks.workunit.client.0.smithi062.stdout:9/584: readlink d3/d3e/d52/d58/l4d 0 2024-05-09T06:29:59.884 INFO:tasks.workunit.client.0.smithi062.stdout:7/557: write d0/d3a/d51/d64/d6d/d88/f8a [3337552,98837] 0 2024-05-09T06:29:59.885 INFO:tasks.workunit.client.0.smithi062.stdout:4/648: rmdir d0/d2a/d14/d7e/d8e/d9e/d86 39 2024-05-09T06:29:59.886 INFO:tasks.workunit.client.0.smithi062.stdout:4/649: dread d0/d2a/d14/d4f/d6b/f4d [0,4194304] 0 2024-05-09T06:29:59.887 INFO:tasks.workunit.client.0.smithi062.stdout:6/610: dwrite dc/d28/d10/d20/d5b/fc6 [0,4194304] 0 2024-05-09T06:29:59.887 INFO:tasks.workunit.client.0.smithi062.stdout:6/611: creat dc/d28/fcb x:0 0 0 2024-05-09T06:29:59.888 INFO:tasks.workunit.client.0.smithi062.stdout:3/469: rename d1/c22 to d1/d1e/d26/c9c 0 2024-05-09T06:29:59.888 INFO:tasks.workunit.client.0.smithi062.stdout:3/470: dread - d1/d1e/d26/f84 zero size 2024-05-09T06:29:59.888 INFO:tasks.workunit.client.0.smithi062.stdout:3/471: fsync d1/d1e/d36/d3a/f67 0 2024-05-09T06:29:59.889 INFO:tasks.workunit.client.0.smithi062.stdout:2/565: mknod d0/d9/d38/d41/d94/cb2 0 2024-05-09T06:29:59.890 INFO:tasks.workunit.client.0.smithi062.stdout:8/667: truncate da/d11/d2e/d61/d92/da5/daf/fba 576595 0 2024-05-09T06:29:59.891 INFO:tasks.workunit.client.0.smithi062.stdout:8/668: readlink da/d11/d2e/d61/d92/lc1 0 2024-05-09T06:29:59.893 INFO:tasks.workunit.client.0.smithi062.stdout:6/612: dread dc/d28/d10/f86 [0,4194304] 0 2024-05-09T06:29:59.895 INFO:tasks.workunit.client.0.smithi062.stdout:7/558: link d0/d12/d33/f3b d0/d12/d33/d9f/fb2 0 2024-05-09T06:29:59.902 INFO:tasks.workunit.client.0.smithi062.stdout:3/472: getdents d1/d48 0 2024-05-09T06:29:59.904 INFO:tasks.workunit.client.0.smithi062.stdout:2/566: truncate d0/d9/d38/d41/d48/f4b 1896651 0 2024-05-09T06:29:59.904 INFO:tasks.workunit.client.0.smithi062.stdout:2/567: dread - d0/d9/dd/d65/d6d/d21/d29/d3d/f79 zero size 2024-05-09T06:29:59.906 INFO:tasks.workunit.client.0.smithi062.stdout:8/669: stat da/d11/d2e/d61/c8f 0 2024-05-09T06:29:59.906 INFO:tasks.workunit.client.0.smithi062.stdout:8/670: fsync da/d11/d2e/f70 0 2024-05-09T06:29:59.906 INFO:tasks.workunit.client.0.smithi062.stdout:8/671: fsync da/d11/d2e/d61/d64/f88 0 2024-05-09T06:29:59.906 INFO:tasks.workunit.client.0.smithi062.stdout:8/672: read da/d11/f3c [159286,84936] 0 2024-05-09T06:29:59.909 INFO:tasks.workunit.client.0.smithi062.stdout:3/473: dread d1/d1e/d26/f2b [0,4194304] 0 2024-05-09T06:29:59.909 INFO:tasks.workunit.client.0.smithi062.stdout:6/613: dwrite dc/d28/d34/f3d [4194304,4194304] 0 2024-05-09T06:29:59.909 INFO:tasks.workunit.client.0.smithi062.stdout:6/614: stat dc/d28/d10/d20/d5b 0 2024-05-09T06:29:59.909 INFO:tasks.workunit.client.0.smithi062.stdout:9/585: getdents d3/d3e/d52/d58/d1c/d21 0 2024-05-09T06:29:59.913 INFO:tasks.workunit.client.0.smithi062.stdout:7/559: creat d0/d3a/d3f/fb3 x:0 0 0 2024-05-09T06:29:59.915 INFO:tasks.workunit.client.0.smithi062.stdout:2/568: rename d0/d9/dd/d65/d6d/d21/d29/d3d/fa8 to d0/d9/dd/d65/d6d/d96/fb3 0 2024-05-09T06:29:59.919 INFO:tasks.workunit.client.0.smithi062.stdout:8/673: symlink da/d11/d2e/d61/d92/da5/ld7 0 2024-05-09T06:29:59.920 INFO:tasks.workunit.client.0.smithi062.stdout:8/674: write da/d11/d1c/d9e/d9f/da7/fb7 [689340,35072] 0 2024-05-09T06:29:59.920 INFO:tasks.workunit.client.0.smithi062.stdout:8/675: creat da/d11/d1c/d9e/d9f/da7/fd8 x:0 0 0 2024-05-09T06:29:59.920 INFO:tasks.workunit.client.0.smithi062.stdout:6/615: getdents dc/d28/d34/d4e 0 2024-05-09T06:29:59.924 INFO:tasks.workunit.client.0.smithi062.stdout:9/586: mknod d3/d3e/d52/d58/d1c/d1e/d41/cba 0 2024-05-09T06:29:59.925 INFO:tasks.workunit.client.0.smithi062.stdout:2/569: creat d0/d9/dd/d65/fb4 x:0 0 0 2024-05-09T06:29:59.925 INFO:tasks.workunit.client.0.smithi062.stdout:2/570: chown d0/d9/dd/d65/d6d/d21/d29/d3d/c6b 4 1 2024-05-09T06:29:59.925 INFO:tasks.workunit.client.0.smithi062.stdout:2/571: write d0/d9/dd/d65/d6d/f56 [4196875,48985] 0 2024-05-09T06:29:59.931 INFO:tasks.workunit.client.0.smithi062.stdout:8/676: link da/d11/d2e/l30 da/d11/d1c/ld9 0 2024-05-09T06:29:59.931 INFO:tasks.workunit.client.0.smithi062.stdout:7/560: dwrite d0/f4b [0,4194304] 0 2024-05-09T06:29:59.931 INFO:tasks.workunit.client.0.smithi062.stdout:3/474: dwrite d1/f1c [0,4194304] 0 2024-05-09T06:29:59.932 INFO:tasks.workunit.client.0.smithi062.stdout:6/616: mkdir dc/d28/d46/d3a/d7f/d91/d96/db6/dcc 0 2024-05-09T06:29:59.936 INFO:tasks.workunit.client.0.smithi062.stdout:9/587: link d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 d3/d3e/d52/d58/d1c/d1e/d41/d64/fbb 0 2024-05-09T06:29:59.939 INFO:tasks.workunit.client.0.smithi062.stdout:2/572: mknod d0/d9/d38/d41/db1/cb5 0 2024-05-09T06:29:59.941 INFO:tasks.workunit.client.0.smithi062.stdout:6/617: write dc/d28/d46/d3a/f4f [530740,76122] 0 2024-05-09T06:29:59.941 INFO:tasks.workunit.client.0.smithi062.stdout:6/618: chown dc/d28/d46/d3a/f3e 2 1 2024-05-09T06:29:59.943 INFO:tasks.workunit.client.0.smithi062.stdout:8/677: creat da/d11/d2e/d61/d92/fda x:0 0 0 2024-05-09T06:29:59.949 INFO:tasks.workunit.client.0.smithi062.stdout:7/561: truncate d0/d3a/d3f/f79 694371 0 2024-05-09T06:29:59.953 INFO:tasks.workunit.client.0.smithi062.stdout:9/588: dwrite d3/d3e/d52/d58/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:29:59.957 INFO:tasks.workunit.client.0.smithi062.stdout:3/475: creat d1/f9d x:0 0 0 2024-05-09T06:29:59.960 INFO:tasks.workunit.client.0.smithi062.stdout:2/573: creat d0/d9/dd/d65/d6d/d7e/fb6 x:0 0 0 2024-05-09T06:29:59.964 INFO:tasks.workunit.client.0.smithi062.stdout:8/678: symlink da/d11/dd2/dd6/ldb 0 2024-05-09T06:29:59.964 INFO:tasks.workunit.client.0.smithi062.stdout:8/679: fsync da/d11/d2e/d34/fb4 0 2024-05-09T06:29:59.964 INFO:tasks.workunit.client.0.smithi062.stdout:8/680: fsync da/d11/d1c/d9e/d9f/db8/fcf 0 2024-05-09T06:29:59.964 INFO:tasks.workunit.client.0.smithi062.stdout:8/681: creat da/d11/d1c/d9e/d9f/da7/fdc x:0 0 0 2024-05-09T06:29:59.966 INFO:tasks.workunit.client.0.smithi062.stdout:7/562: link d0/f20 d0/d3/fb4 0 2024-05-09T06:29:59.970 INFO:tasks.workunit.client.0.smithi062.stdout:9/589: creat d3/d3e/d4b/da2/fbc x:0 0 0 2024-05-09T06:29:59.970 INFO:tasks.workunit.client.0.smithi062.stdout:9/590: chown d3/f19 3105 1 2024-05-09T06:29:59.971 INFO:tasks.workunit.client.0.smithi062.stdout:3/476: rename d1/d1e/d26/d43/d92/f7b to d1/d1e/d26/d43/f9e 0 2024-05-09T06:29:59.971 INFO:tasks.workunit.client.0.smithi062.stdout:8/682: write da/d11/d1c/f3e [3009672,6042] 0 2024-05-09T06:29:59.993 INFO:tasks.workunit.client.0.smithi062.stdout:6/619: mkdir dc/d28/d46/d3a/d7f/d8e/dc8/dcd 0 2024-05-09T06:29:59.993 INFO:tasks.workunit.client.0.smithi062.stdout:6/620: chown dc/d28 29 1 2024-05-09T06:29:59.995 INFO:tasks.workunit.client.0.smithi062.stdout:7/563: unlink d0/da8/cb1 0 2024-05-09T06:29:59.998 INFO:tasks.workunit.client.0.smithi062.stdout:9/591: rename d3/d3e/d52/d58/d1c/d1e/d60/f9a to d3/d3e/d52/fbd 0 2024-05-09T06:30:00.002 INFO:tasks.workunit.client.0.smithi062.stdout:8/683: creat da/d11/d2e/d61/d92/da5/fdd x:0 0 0 2024-05-09T06:30:00.003 INFO:tasks.workunit.client.0.smithi062.stdout:2/574: getdents d0/d9/d38/d41 0 2024-05-09T06:30:00.005 INFO:tasks.workunit.client.0.smithi062.stdout:6/621: mknod dc/d28/d46/d3a/d7f/d8e/dc8/dcd/cce 0 2024-05-09T06:30:00.008 INFO:tasks.workunit.client.0.smithi062.stdout:7/564: creat d0/d3a/d3f/fb5 x:0 0 0 2024-05-09T06:30:00.013 INFO:tasks.workunit.client.0.smithi062.stdout:9/592: creat d3/d3e/d4b/da2/dad/fbe x:0 0 0 2024-05-09T06:30:00.014 INFO:tasks.workunit.client.0.smithi062.stdout:8/684: mknod da/d11/d2e/d61/cde 0 2024-05-09T06:30:00.017 INFO:tasks.workunit.client.0.smithi062.stdout:2/575: getdents d0/d9/d17 0 2024-05-09T06:30:00.019 INFO:tasks.workunit.client.0.smithi062.stdout:8/685: mkdir da/d11/d2e/d34/ddf 0 2024-05-09T06:30:00.021 INFO:tasks.workunit.client.0.smithi062.stdout:2/576: mkdir d0/d90/db7 0 2024-05-09T06:30:00.022 INFO:tasks.workunit.client.0.smithi062.stdout:3/477: rename d1/d1e/d26/d33 to d1/d1e/d36/d9f 0 2024-05-09T06:30:00.022 INFO:tasks.workunit.client.0.smithi062.stdout:3/478: stat d1/d48/c8e 0 2024-05-09T06:30:00.022 INFO:tasks.workunit.client.0.smithi062.stdout:3/479: stat d1/d1e/d26 0 2024-05-09T06:30:00.022 INFO:tasks.workunit.client.0.smithi062.stdout:3/480: readlink d1/d1e/d36/d4a/l60 0 2024-05-09T06:30:00.022 INFO:tasks.workunit.client.0.smithi062.stdout:3/481: readlink d1/d1e/d26/d43/d92/d77/l8d 0 2024-05-09T06:30:00.022 INFO:tasks.workunit.client.0.smithi062.stdout:3/482: write d1/d1e/d54/f93 [104619,26757] 0 2024-05-09T06:30:00.023 INFO:tasks.workunit.client.0.smithi062.stdout:8/686: mkdir da/d11/d1c/de0 0 2024-05-09T06:30:00.023 INFO:tasks.workunit.client.0.smithi062.stdout:8/687: write da/d11/f17 [1897112,40581] 0 2024-05-09T06:30:00.024 INFO:tasks.workunit.client.0.smithi062.stdout:8/688: write da/d11/d2e/f70 [1781276,85397] 0 2024-05-09T06:30:00.025 INFO:tasks.workunit.client.0.smithi062.stdout:2/577: link d0/d9/dd/d65/d6d/d21/c62 d0/d9/dd/d65/d6d/d96/cb8 0 2024-05-09T06:30:00.027 INFO:tasks.workunit.client.0.smithi062.stdout:9/593: rename d3/f86 to d3/d3e/d52/d58/d1c/fbf 0 2024-05-09T06:30:00.029 INFO:tasks.workunit.client.0.smithi062.stdout:3/483: mknod d1/d1e/d26/d43/d92/d77/ca0 0 2024-05-09T06:30:00.029 INFO:tasks.workunit.client.0.smithi062.stdout:3/484: dread - d1/d1e/d26/f86 zero size 2024-05-09T06:30:00.030 INFO:tasks.workunit.client.0.smithi062.stdout:9/594: creat d3/d3e/d4b/fc0 x:0 0 0 2024-05-09T06:30:00.031 INFO:tasks.workunit.client.0.smithi062.stdout:3/485: mknod d1/d1e/d26/d43/ca1 0 2024-05-09T06:30:00.032 INFO:tasks.workunit.client.0.smithi062.stdout:3/486: creat d1/d1e/fa2 x:0 0 0 2024-05-09T06:30:00.033 INFO:tasks.workunit.client.0.smithi062.stdout:3/487: rename d1/f46 to d1/d1e/d3b/d83/fa3 0 2024-05-09T06:30:00.035 INFO:tasks.workunit.client.0.smithi062.stdout:6/622: dwrite dc/d28/d10/d20/fb9 [0,4194304] 0 2024-05-09T06:30:00.035 INFO:tasks.workunit.client.0.smithi062.stdout:6/623: fdatasync dc/d28/d46/d3a/d7f/d91/d96/db6/fc1 0 2024-05-09T06:30:00.035 INFO:tasks.workunit.client.0.smithi062.stdout:7/565: dwrite d0/d3a/d3f/faf [0,4194304] 0 2024-05-09T06:30:00.036 INFO:tasks.workunit.client.0.smithi062.stdout:6/624: symlink dc/d28/d10/d20/d5b/d77/lcf 0 2024-05-09T06:30:00.045 INFO:tasks.workunit.client.0.smithi062.stdout:7/566: mknod d0/d3a/d51/d64/d6d/d88/cb6 0 2024-05-09T06:30:00.047 INFO:tasks.workunit.client.0.smithi062.stdout:9/595: write d3/d3e/d52/d58/d1c/d1e/d41/d64/f2d [2795115,54647] 0 2024-05-09T06:30:00.048 INFO:tasks.workunit.client.0.smithi062.stdout:9/596: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/fc1 x:0 0 0 2024-05-09T06:30:00.053 INFO:tasks.workunit.client.0.smithi062.stdout:3/488: dread d1/d1e/d36/d9f/f79 [0,4194304] 0 2024-05-09T06:30:00.053 INFO:tasks.workunit.client.0.smithi062.stdout:3/489: read - d1/d1e/d54/f9a zero size 2024-05-09T06:30:00.053 INFO:tasks.workunit.client.0.smithi062.stdout:6/625: dread dc/d28/d10/d20/f32 [0,4194304] 0 2024-05-09T06:30:00.053 INFO:tasks.workunit.client.0.smithi062.stdout:8/689: dwrite da/d11/d2e/d61/f63 [0,4194304] 0 2024-05-09T06:30:00.054 INFO:tasks.workunit.client.0.smithi062.stdout:7/567: rename d0/d12/d33/f3c to d0/da8/fb7 0 2024-05-09T06:30:00.062 INFO:tasks.workunit.client.0.smithi062.stdout:9/597: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/fc2 x:0 0 0 2024-05-09T06:30:00.064 INFO:tasks.workunit.client.0.smithi062.stdout:3/490: mkdir d1/d1e/d26/d43/d52/d6a/da4 0 2024-05-09T06:30:00.066 INFO:tasks.workunit.client.0.smithi062.stdout:6/626: mknod dc/d28/d34/db7/cd0 0 2024-05-09T06:30:00.068 INFO:tasks.workunit.client.0.smithi062.stdout:7/568: creat d0/d12/d33/d9f/fb8 x:0 0 0 2024-05-09T06:30:00.068 INFO:tasks.workunit.client.0.smithi062.stdout:8/690: dwrite da/d11/d2e/f91 [0,4194304] 0 2024-05-09T06:30:00.069 INFO:tasks.workunit.client.0.smithi062.stdout:3/491: mkdir d1/d1e/d3b/d83/da5 0 2024-05-09T06:30:00.071 INFO:tasks.workunit.client.0.smithi062.stdout:7/569: creat d0/d3a/d51/fb9 x:0 0 0 2024-05-09T06:30:00.071 INFO:tasks.workunit.client.0.smithi062.stdout:7/570: write d0/f8d [45089,44452] 0 2024-05-09T06:30:00.073 INFO:tasks.workunit.client.0.smithi062.stdout:6/627: dread dc/d28/d34/d4e/f85 [0,4194304] 0 2024-05-09T06:30:00.073 INFO:tasks.workunit.client.0.smithi062.stdout:6/628: stat dc/d28/d46/d3a/d7f/d8e/dc8 0 2024-05-09T06:30:00.075 INFO:tasks.workunit.client.0.smithi062.stdout:7/571: mknod d0/d12/cba 0 2024-05-09T06:30:00.078 INFO:tasks.workunit.client.0.smithi062.stdout:7/572: mknod d0/d12/d33/d67/cbb 0 2024-05-09T06:30:00.078 INFO:tasks.workunit.client.0.smithi062.stdout:9/598: read d3/d3e/d4b/f51 [2399297,100804] 0 2024-05-09T06:30:00.078 INFO:tasks.workunit.client.0.smithi062.stdout:9/599: fsync d3/d20/f7a 0 2024-05-09T06:30:00.078 INFO:tasks.workunit.client.0.smithi062.stdout:9/600: chown d3/d3e/d52/d58/d1c/d1e/d41/d64/d31 2906061 1 2024-05-09T06:30:00.078 INFO:tasks.workunit.client.0.smithi062.stdout:9/601: creat d3/d3e/d4b/fc3 x:0 0 0 2024-05-09T06:30:00.079 INFO:tasks.workunit.client.0.smithi062.stdout:3/492: dread d1/f2f [0,4194304] 0 2024-05-09T06:30:00.080 INFO:tasks.workunit.client.0.smithi062.stdout:7/573: creat d0/d3a/d51/d64/d6d/dac/fbc x:0 0 0 2024-05-09T06:30:00.089 INFO:tasks.workunit.client.0.smithi062.stdout:3/493: dread d1/d1e/d26/d43/f9e [0,4194304] 0 2024-05-09T06:30:00.092 INFO:tasks.workunit.client.0.smithi062.stdout:3/494: rmdir d1/d1e/d26/d43 39 2024-05-09T06:30:00.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:59 smithi079 ceph-mon[35268]: Standby manager daemon smithi062.juuasl started 2024-05-09T06:30:00.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:59 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.62:0/241778036' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi062.juuasl/crt"}]: dispatch 2024-05-09T06:30:00.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:59 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:00.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:59 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.62:0/241778036' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:30:00.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:59 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.62:0/241778036' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi062.juuasl/key"}]: dispatch 2024-05-09T06:30:00.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:59 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.62:0/241778036' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:30:00.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:29:59 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:00.093 INFO:tasks.workunit.client.0.smithi062.stdout:3/495: symlink d1/d1e/d26/d43/d52/d6a/da4/la6 0 2024-05-09T06:30:00.094 INFO:tasks.workunit.client.0.smithi062.stdout:3/496: write d1/d48/f98 [7185580,30930] 0 2024-05-09T06:30:00.095 INFO:tasks.workunit.client.0.smithi062.stdout:3/497: truncate d1/d1e/d26/d43/d52/d6a/f71 1864129 0 2024-05-09T06:30:00.095 INFO:tasks.workunit.client.0.smithi062.stdout:3/498: readlink d1/d1e/l2e 0 2024-05-09T06:30:00.099 INFO:tasks.workunit.client.0.smithi062.stdout:7/574: dwrite d0/d3/f40 [0,4194304] 0 2024-05-09T06:30:00.100 INFO:tasks.workunit.client.0.smithi062.stdout:6/629: dwrite dc/f17 [0,4194304] 0 2024-05-09T06:30:00.100 INFO:tasks.workunit.client.0.smithi062.stdout:6/630: chown dc/d28/d10/d20/l92 73 1 2024-05-09T06:30:00.101 INFO:tasks.workunit.client.0.smithi062.stdout:7/575: readlink d0/l2f 0 2024-05-09T06:30:00.102 INFO:tasks.workunit.client.0.smithi062.stdout:7/576: dread - d0/d12/d33/d67/f6b zero size 2024-05-09T06:30:00.107 INFO:tasks.workunit.client.0.smithi062.stdout:6/631: dread dc/d28/d34/d4e/f85 [0,4194304] 0 2024-05-09T06:30:00.107 INFO:tasks.workunit.client.0.smithi062.stdout:6/632: chown dc/d28/c89 86 1 2024-05-09T06:30:00.110 INFO:tasks.workunit.client.0.smithi062.stdout:6/633: symlink dc/d28/d46/d3a/d7f/d91/ld1 0 2024-05-09T06:30:00.110 INFO:tasks.workunit.client.0.smithi062.stdout:6/634: write dc/d28/d46/d3a/d7f/d91/fb4 [724464,109410] 0 2024-05-09T06:30:00.110 INFO:tasks.workunit.client.0.smithi062.stdout:6/635: chown dc/d28/d46/d4a/d5d/d6f/d76 1 1 2024-05-09T06:30:00.113 INFO:tasks.workunit.client.0.smithi062.stdout:7/577: dread d0/d3a/d51/d64/d6d/f97 [4194304,4194304] 0 2024-05-09T06:30:00.114 INFO:tasks.workunit.client.0.smithi062.stdout:6/636: symlink dc/d28/d34/db7/ld2 0 2024-05-09T06:30:00.115 INFO:tasks.workunit.client.0.smithi062.stdout:3/499: dwrite d1/d1e/d3b/d83/fa3 [0,4194304] 0 2024-05-09T06:30:00.123 INFO:tasks.workunit.client.0.smithi062.stdout:6/637: write dc/d28/d34/f3d [4666811,114892] 0 2024-05-09T06:30:00.123 INFO:tasks.workunit.client.0.smithi062.stdout:6/638: chown dc/d28/d46/d82/d98/db3/dba 63791867 1 2024-05-09T06:30:00.123 INFO:tasks.workunit.client.0.smithi062.stdout:6/639: chown dc/d28/d46/d3a/f4f 10231 1 2024-05-09T06:30:00.127 INFO:tasks.workunit.client.0.smithi062.stdout:6/640: creat dc/d28/d46/d3a/d7f/d91/d96/fd3 x:0 0 0 2024-05-09T06:30:00.129 INFO:tasks.workunit.client.0.smithi062.stdout:7/578: write d0/d3a/f87 [557178,84853] 0 2024-05-09T06:30:00.129 INFO:tasks.workunit.client.0.smithi062.stdout:7/579: chown d0/d3a/d51/d64/d6d 7378710 1 2024-05-09T06:30:00.130 INFO:tasks.workunit.client.0.smithi062.stdout:6/641: symlink dc/d28/d46/d82/d98/db3/ld4 0 2024-05-09T06:30:00.130 INFO:tasks.workunit.client.0.smithi062.stdout:6/642: stat dc/d28/d46/d3a/d7f/d91/d96/db6/dcc 0 2024-05-09T06:30:00.133 INFO:tasks.workunit.client.0.smithi062.stdout:7/580: chown d0/d3a/d69/l85 1711 1 2024-05-09T06:30:00.133 INFO:tasks.workunit.client.0.smithi062.stdout:7/581: fdatasync d0/f8d 0 2024-05-09T06:30:00.133 INFO:tasks.workunit.client.0.smithi062.stdout:7/582: truncate d0/f92 696385 0 2024-05-09T06:30:00.136 INFO:tasks.workunit.client.0.smithi062.stdout:7/583: link d0/d3a/d3f/fb3 d0/d12/d66/fbd 0 2024-05-09T06:30:00.136 INFO:tasks.workunit.client.0.smithi062.stdout:7/584: creat d0/d3a/d51/d64/d6d/dac/fbe x:0 0 0 2024-05-09T06:30:00.136 INFO:tasks.workunit.client.0.smithi062.stdout:7/585: chown d0/d3a/d51/f42 52417493 1 2024-05-09T06:30:00.137 INFO:tasks.workunit.client.0.smithi062.stdout:6/643: rmdir dc/d28/d46/d3a/d7f/d8e/dc2 0 2024-05-09T06:30:00.140 INFO:tasks.workunit.client.0.smithi062.stdout:6/644: dread dc/d28/d10/f1c [0,4194304] 0 2024-05-09T06:30:00.140 INFO:tasks.workunit.client.0.smithi062.stdout:6/645: fdatasync dc/d28/d46/d3a/d7f/d91/fa7 0 2024-05-09T06:30:00.143 INFO:tasks.workunit.client.0.smithi062.stdout:7/586: creat d0/d3a/d51/d64/d6d/d80/fbf x:0 0 0 2024-05-09T06:30:00.145 INFO:tasks.workunit.client.0.smithi062.stdout:6/646: link dc/d28/d34/d4e/c6c dc/d28/d46/d3a/d7f/cd5 0 2024-05-09T06:30:00.148 INFO:tasks.workunit.client.0.smithi062.stdout:7/587: link d0/da8/fb7 d0/d3a/d69/fc0 0 2024-05-09T06:30:00.151 INFO:tasks.workunit.client.0.smithi062.stdout:6/647: symlink dc/d28/d34/ld6 0 2024-05-09T06:30:00.153 INFO:tasks.workunit.client.0.smithi062.stdout:7/588: link d0/f92 d0/d3a/d3f/dab/fc1 0 2024-05-09T06:30:00.156 INFO:tasks.workunit.client.0.smithi062.stdout:7/589: link d0/d3a/d51/d64/d6d/l72 d0/d3a/d51/d64/d6d/dac/lc2 0 2024-05-09T06:30:00.156 INFO:tasks.workunit.client.0.smithi062.stdout:7/590: fsync d0/d12/d33/f3b 0 2024-05-09T06:30:00.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:59 smithi062 ceph-mon[26920]: Standby manager daemon smithi062.juuasl started 2024-05-09T06:30:00.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:59 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.62:0/241778036' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi062.juuasl/crt"}]: dispatch 2024-05-09T06:30:00.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:59 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:00.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:59 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.62:0/241778036' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:30:00.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:59 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.62:0/241778036' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi062.juuasl/key"}]: dispatch 2024-05-09T06:30:00.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:59 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.62:0/241778036' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:30:00.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:29:59 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:00.177 INFO:tasks.workunit.client.0.smithi062.stdout:6/648: dwrite dc/d28/d10/fc7 [0,4194304] 0 2024-05-09T06:30:00.177 INFO:tasks.workunit.client.0.smithi062.stdout:7/591: dwrite d0/d12/d33/d9f/fb2 [0,4194304] 0 2024-05-09T06:30:00.187 INFO:tasks.workunit.client.0.smithi062.stdout:7/592: write d0/d12/f32 [6481681,2991] 0 2024-05-09T06:30:00.188 INFO:tasks.workunit.client.0.smithi062.stdout:7/593: creat d0/d3a/d51/d64/d6d/d88/fc3 x:0 0 0 2024-05-09T06:30:00.188 INFO:tasks.workunit.client.0.smithi062.stdout:7/594: chown d0/d3a/d51/d64/d6d/f90 10370594 1 2024-05-09T06:30:00.201 INFO:tasks.workunit.client.0.smithi062.stdout:6/649: rename dc/d28/d46/d3a/d7f/cd5 to dc/d28/d46/d4a/cd7 0 2024-05-09T06:30:00.203 INFO:tasks.workunit.client.0.smithi062.stdout:7/595: dwrite d0/d3a/d51/d64/d6d/d80/fa3 [0,4194304] 0 2024-05-09T06:30:00.223 INFO:tasks.workunit.client.0.smithi062.stdout:7/596: dwrite d0/f20 [4194304,4194304] 0 2024-05-09T06:30:00.281 INFO:tasks.workunit.client.0.smithi062.stdout:6/650: link dc/d28/d46/d82/d98/faa dc/d28/d46/d81/dad/fd8 0 2024-05-09T06:30:00.281 INFO:tasks.workunit.client.0.smithi062.stdout:6/651: write dc/d28/d46/d3a/f3c [894227,166] 0 2024-05-09T06:30:00.281 INFO:tasks.workunit.client.0.smithi062.stdout:6/652: chown dc/d28/d46/d3a/f3c 92765897 1 2024-05-09T06:30:00.288 INFO:tasks.workunit.client.0.smithi062.stdout:0/539: sync 2024-05-09T06:30:00.291 INFO:tasks.workunit.client.0.smithi062.stdout:7/597: rename d0/d3/f40 to d0/d3a/d51/d64/d6d/d88/fc4 0 2024-05-09T06:30:00.292 INFO:tasks.workunit.client.0.smithi062.stdout:7/598: creat d0/d12/d33/d9f/fc5 x:0 0 0 2024-05-09T06:30:00.297 INFO:tasks.workunit.client.0.smithi062.stdout:6/653: mkdir dc/d28/d46/d3a/d7f/d91/d96/db6/dd9 0 2024-05-09T06:30:00.304 INFO:tasks.workunit.client.0.smithi062.stdout:6/654: mknod dc/d28/d46/d3a/d7f/d91/d96/db6/cda 0 2024-05-09T06:30:00.304 INFO:tasks.workunit.client.0.smithi062.stdout:6/655: chown dc/d28/d34/f59 515 1 2024-05-09T06:30:00.305 INFO:tasks.workunit.client.0.smithi062.stdout:0/540: dwrite d1/d25/fa4 [0,4194304] 0 2024-05-09T06:30:00.305 INFO:tasks.workunit.client.0.smithi062.stdout:0/541: creat d1/d25/d49/d42/d43/d54/d9d/fc9 x:0 0 0 2024-05-09T06:30:00.306 INFO:tasks.workunit.client.0.smithi062.stdout:0/542: fsync d1/d25/d49/d42/d43/d54/d9d/fb6 0 2024-05-09T06:30:00.307 INFO:tasks.workunit.client.0.smithi062.stdout:7/599: mknod d0/d3a/d3f/cc6 0 2024-05-09T06:30:00.307 INFO:tasks.workunit.client.0.smithi062.stdout:7/600: readlink d0/d12/l29 0 2024-05-09T06:30:00.310 INFO:tasks.workunit.client.0.smithi062.stdout:6/656: mknod dc/d28/d10/d20/d5b/d77/cdb 0 2024-05-09T06:30:00.321 INFO:tasks.workunit.client.0.smithi062.stdout:0/543: mkdir d1/d25/d31/d6c/d44/dca 0 2024-05-09T06:30:00.325 INFO:tasks.workunit.client.0.smithi062.stdout:7/601: mkdir d0/d3a/d51/d64/d6d/d88/dc7 0 2024-05-09T06:30:00.331 INFO:tasks.workunit.client.0.smithi062.stdout:6/657: creat dc/d28/d46/d4a/d5d/d6f/d76/fdc x:0 0 0 2024-05-09T06:30:00.331 INFO:tasks.workunit.client.0.smithi062.stdout:6/658: fdatasync dc/d28/d46/d3a/d7f/d91/fb4 0 2024-05-09T06:30:00.333 INFO:tasks.workunit.client.0.smithi062.stdout:0/544: symlink d1/d25/d49/d42/d43/d54/lcb 0 2024-05-09T06:30:00.334 INFO:tasks.workunit.client.0.smithi062.stdout:7/602: symlink d0/d12/d66/lc8 0 2024-05-09T06:30:00.339 INFO:tasks.workunit.client.0.smithi062.stdout:7/603: symlink d0/d12/d33/d67/lc9 0 2024-05-09T06:30:00.344 INFO:tasks.workunit.client.0.smithi062.stdout:0/545: dread d1/d6a/d6d/d93/d94/dc7/f5c [0,4194304] 0 2024-05-09T06:30:00.345 INFO:tasks.workunit.client.0.smithi062.stdout:0/546: mknod d1/d25/d31/db5/ccc 0 2024-05-09T06:30:00.345 INFO:tasks.workunit.client.0.smithi062.stdout:0/547: dread - d1/d25/d49/d4f/d52/d87/fa3 zero size 2024-05-09T06:30:00.347 INFO:tasks.workunit.client.0.smithi062.stdout:0/548: link d1/d25/d31/d6c/d44/fc5 d1/d25/d31/db5/fcd 0 2024-05-09T06:30:00.348 INFO:tasks.workunit.client.0.smithi062.stdout:0/549: read d1/d25/f86 [3199788,58904] 0 2024-05-09T06:30:00.348 INFO:tasks.workunit.client.0.smithi062.stdout:0/550: fdatasync d1/d18/f35 0 2024-05-09T06:30:00.361 INFO:tasks.workunit.client.0.smithi062.stdout:0/551: dwrite d1/d25/d49/d42/d43/f4e [4194304,4194304] 0 2024-05-09T06:30:00.364 INFO:tasks.workunit.client.0.smithi062.stdout:0/552: unlink d1/f73 0 2024-05-09T06:30:00.364 INFO:tasks.workunit.client.0.smithi062.stdout:0/553: write d1/f8 [3845676,89033] 0 2024-05-09T06:30:00.381 INFO:tasks.workunit.client.0.smithi062.stdout:0/554: dwrite d1/d25/d59/f65 [4194304,4194304] 0 2024-05-09T06:30:00.381 INFO:tasks.workunit.client.0.smithi062.stdout:0/555: creat d1/d6a/fce x:0 0 0 2024-05-09T06:30:00.395 INFO:tasks.workunit.client.0.smithi062.stdout:0/556: dwrite d1/f2a [0,4194304] 0 2024-05-09T06:30:00.403 INFO:tasks.workunit.client.0.smithi062.stdout:0/557: rename d1/d25/d49/d7e/f8b to d1/d25/d49/d42/dad/dbe/fcf 0 2024-05-09T06:30:00.457 INFO:tasks.workunit.client.0.smithi062.stdout:5/592: sync 2024-05-09T06:30:00.457 INFO:tasks.workunit.client.0.smithi062.stdout:5/593: creat d0/fc5 x:0 0 0 2024-05-09T06:30:00.458 INFO:tasks.workunit.client.0.smithi062.stdout:5/594: getdents d0/d8/d1c/d2c/db3 0 2024-05-09T06:30:00.460 INFO:tasks.workunit.client.0.smithi062.stdout:5/595: link d0/d8/d47/dbe/d5/l26 d0/d8/d47/dbe/d86/dae/lc6 0 2024-05-09T06:30:00.460 INFO:tasks.workunit.client.0.smithi062.stdout:5/596: stat d0/d8/d1c/c60 0 2024-05-09T06:30:00.462 INFO:tasks.workunit.client.0.smithi062.stdout:5/597: dread d0/d8/d1c/d2c/f8c [0,4194304] 0 2024-05-09T06:30:00.462 INFO:tasks.workunit.client.0.smithi062.stdout:5/598: chown d0/f79 39 1 2024-05-09T06:30:00.462 INFO:tasks.workunit.client.0.smithi062.stdout:5/599: write d0/d11/f89 [3744014,25639] 0 2024-05-09T06:30:00.465 INFO:tasks.workunit.client.0.smithi062.stdout:5/600: mkdir d0/d11/d67/dc7 0 2024-05-09T06:30:00.468 INFO:tasks.workunit.client.0.smithi062.stdout:5/601: rename d0/d8/d47/dbe/d45/da5/faf to d0/d8/d47/fc8 0 2024-05-09T06:30:00.468 INFO:tasks.workunit.client.0.smithi062.stdout:5/602: fdatasync d0/d8/f95 0 2024-05-09T06:30:00.468 INFO:tasks.workunit.client.0.smithi062.stdout:5/603: getdents d0/d3b/dbc 0 2024-05-09T06:30:00.469 INFO:tasks.workunit.client.0.smithi062.stdout:5/604: rmdir d0/d8/d18 39 2024-05-09T06:30:00.486 INFO:tasks.workunit.client.0.smithi062.stdout:5/605: dwrite d0/d11/f89 [0,4194304] 0 2024-05-09T06:30:00.487 INFO:tasks.workunit.client.0.smithi062.stdout:5/606: fdatasync d0/f79 0 2024-05-09T06:30:00.504 INFO:tasks.workunit.client.0.smithi062.stdout:5/607: dwrite d0/d8/d47/dbe/d45/f76 [0,4194304] 0 2024-05-09T06:30:00.533 INFO:tasks.workunit.client.0.smithi062.stdout:5/608: unlink d0/d3b/d3f/c87 0 2024-05-09T06:30:00.534 INFO:tasks.workunit.client.0.smithi062.stdout:5/609: link d0/d11/d67/l6d d0/d8/d1c/d2c/d7d/d4a/dc3/dbd/lc9 0 2024-05-09T06:30:00.543 INFO:tasks.workunit.client.0.smithi062.stdout:5/610: write d0/f9c [164468,79498] 0 2024-05-09T06:30:00.543 INFO:tasks.workunit.client.0.smithi062.stdout:5/611: truncate d0/d11/d67/f9f 879633 0 2024-05-09T06:30:00.544 INFO:tasks.workunit.client.0.smithi062.stdout:5/612: fdatasync d0/d8/d18/f5d 0 2024-05-09T06:30:00.544 INFO:tasks.workunit.client.0.smithi062.stdout:5/613: fsync d0/d8/d47/dbe/d5/f36 0 2024-05-09T06:30:00.544 INFO:tasks.workunit.client.0.smithi062.stdout:5/614: dread d0/d11/fab [0,4194304] 0 2024-05-09T06:30:00.545 INFO:tasks.workunit.client.0.smithi062.stdout:5/615: dread d0/d8/d1c/d2c/f8c [0,4194304] 0 2024-05-09T06:30:00.545 INFO:tasks.workunit.client.0.smithi062.stdout:5/616: fdatasync d0/d8/d1c/d23/f29 0 2024-05-09T06:30:00.546 INFO:tasks.workunit.client.0.smithi062.stdout:5/617: symlink d0/d8/d1c/d2c/d7d/d4a/lca 0 2024-05-09T06:30:00.555 INFO:tasks.workunit.client.0.smithi062.stdout:5/618: write d0/d3b/d3f/f70 [1030256,78329] 0 2024-05-09T06:30:00.557 INFO:tasks.workunit.client.0.smithi062.stdout:5/619: link d0/d8/d47/dbe/l2e d0/d3b/dbc/lcb 0 2024-05-09T06:30:00.558 INFO:tasks.workunit.client.0.smithi062.stdout:5/620: chown d0/d8/d47/dbe/l2e 30976 1 2024-05-09T06:30:00.573 INFO:tasks.workunit.client.0.smithi062.stdout:5/621: dwrite d0/d11/d67/f9f [0,4194304] 0 2024-05-09T06:30:00.576 INFO:tasks.workunit.client.0.smithi062.stdout:5/622: mknod d0/d8/d47/d6e/ccc 0 2024-05-09T06:30:00.576 INFO:tasks.workunit.client.0.smithi062.stdout:5/623: chown d0/d3b 8 1 2024-05-09T06:30:00.576 INFO:tasks.workunit.client.0.smithi062.stdout:5/624: symlink d0/d3b/dbc/lcd 0 2024-05-09T06:30:00.578 INFO:tasks.workunit.client.0.smithi062.stdout:5/625: unlink d0/d8/d47/l81 0 2024-05-09T06:30:00.578 INFO:tasks.workunit.client.0.smithi062.stdout:5/626: chown d0/d8/d1c/d23/l6b 2444880 1 2024-05-09T06:30:00.578 INFO:tasks.workunit.client.0.smithi062.stdout:5/627: rmdir d0/d8/d47/dbe 39 2024-05-09T06:30:00.578 INFO:tasks.workunit.client.0.smithi062.stdout:5/628: fdatasync d0/d11/f83 0 2024-05-09T06:30:00.585 INFO:tasks.workunit.client.0.smithi062.stdout:5/629: read d0/d8/d1c/d2c/d7d/fa1 [3034049,95831] 0 2024-05-09T06:30:00.587 INFO:tasks.workunit.client.0.smithi062.stdout:5/630: unlink d0/f2d 0 2024-05-09T06:30:00.599 INFO:tasks.workunit.client.0.smithi062.stdout:1/470: sync 2024-05-09T06:30:00.599 INFO:tasks.workunit.client.0.smithi062.stdout:1/471: chown d8/d1d/l81 86 1 2024-05-09T06:30:00.603 INFO:tasks.workunit.client.0.smithi062.stdout:5/631: dwrite d0/f79 [0,4194304] 0 2024-05-09T06:30:00.624 INFO:tasks.workunit.client.0.smithi062.stdout:1/472: dwrite d8/d1d/f74 [0,4194304] 0 2024-05-09T06:30:00.624 INFO:tasks.workunit.client.0.smithi062.stdout:1/473: stat d8/d14/d2b/d3c/f4e 0 2024-05-09T06:30:00.624 INFO:tasks.workunit.client.0.smithi062.stdout:1/474: write d8/d1d/f74 [4776647,23607] 0 2024-05-09T06:30:00.624 INFO:tasks.workunit.client.0.smithi062.stdout:5/632: dwrite d0/f9c [0,4194304] 0 2024-05-09T06:30:00.625 INFO:tasks.workunit.client.0.smithi062.stdout:1/475: mknod d8/d14/d2b/d3c/d76/ca3 0 2024-05-09T06:30:00.625 INFO:tasks.workunit.client.0.smithi062.stdout:1/476: fsync d8/d14/d2b/d3c/d44/d64/f7b 0 2024-05-09T06:30:00.625 INFO:tasks.workunit.client.0.smithi062.stdout:1/477: readlink d8/d14/d2b/d3c/d76/l8e 0 2024-05-09T06:30:00.625 INFO:tasks.workunit.client.0.smithi062.stdout:1/478: readlink d8/d14/d2b/d3c/d44/d7f/l86 0 2024-05-09T06:30:00.629 INFO:tasks.workunit.client.0.smithi062.stdout:5/633: rmdir d0/d8/d1c/d2c 39 2024-05-09T06:30:00.631 INFO:tasks.workunit.client.0.smithi062.stdout:5/634: truncate d0/d8/d1c/d23/f48 3678781 0 2024-05-09T06:30:00.638 INFO:tasks.workunit.client.0.smithi062.stdout:1/479: write d8/f54 [362052,100055] 0 2024-05-09T06:30:00.641 INFO:tasks.workunit.client.0.smithi062.stdout:1/480: dread d8/d14/d2b/d3c/f8f [0,4194304] 0 2024-05-09T06:30:00.646 INFO:tasks.workunit.client.0.smithi062.stdout:5/635: dwrite d0/d8/f52 [0,4194304] 0 2024-05-09T06:30:00.657 INFO:tasks.workunit.client.0.smithi062.stdout:5/636: rename d0/d8/d1c/d2c/d7d/d4a/dc3 to d0/d8/d47/dbe/d86/da4/dce 0 2024-05-09T06:30:00.657 INFO:tasks.workunit.client.0.smithi062.stdout:5/637: write d0/d8/d1c/d2c/d7d/fa9 [4203863,29532] 0 2024-05-09T06:30:00.661 INFO:tasks.workunit.client.0.smithi062.stdout:5/638: mkdir d0/d8/d47/dbe/d45/da5/dcf 0 2024-05-09T06:30:00.663 INFO:tasks.workunit.client.0.smithi062.stdout:5/639: creat d0/d8/d1c/d23/fd0 x:0 0 0 2024-05-09T06:30:00.664 INFO:tasks.workunit.client.0.smithi062.stdout:5/640: chown d0/d8/d47/dbe/d5/l26 3080 1 2024-05-09T06:30:00.665 INFO:tasks.workunit.client.0.smithi062.stdout:5/641: rmdir d0/d8/d1c/d23/d3e 39 2024-05-09T06:30:00.665 INFO:tasks.workunit.client.0.smithi062.stdout:5/642: readlink d0/d8/d47/dbe/d5/l26 0 2024-05-09T06:30:00.665 INFO:tasks.workunit.client.0.smithi062.stdout:5/643: write d0/f5c [1289567,103233] 0 2024-05-09T06:30:00.667 INFO:tasks.workunit.client.0.smithi062.stdout:5/644: symlink d0/d8/d1c/ld1 0 2024-05-09T06:30:00.667 INFO:tasks.workunit.client.0.smithi062.stdout:5/645: chown d0/d8/d47/dbe/d5 0 1 2024-05-09T06:30:00.675 INFO:tasks.workunit.client.0.smithi062.stdout:5/646: dread d0/f37 [0,4194304] 0 2024-05-09T06:30:00.677 INFO:tasks.workunit.client.0.smithi062.stdout:5/647: rename d0/d8/d1c/d2c/d7d/l61 to d0/d3b/dbc/ld2 0 2024-05-09T06:30:00.684 INFO:tasks.workunit.client.0.smithi062.stdout:5/648: write d0/d8/d18/f5d [151544,3052] 0 2024-05-09T06:30:00.684 INFO:tasks.workunit.client.0.smithi062.stdout:5/649: fsync d0/fc0 0 2024-05-09T06:30:00.702 INFO:tasks.workunit.client.0.smithi062.stdout:5/650: dwrite d0/d8/d18/f64 [0,4194304] 0 2024-05-09T06:30:00.705 INFO:tasks.workunit.client.0.smithi062.stdout:5/651: link d0/d8/d47/dbe/d5/f7e d0/d8/d1c/d2c/d7d/fd3 0 2024-05-09T06:30:00.707 INFO:tasks.workunit.client.0.smithi062.stdout:5/652: truncate d0/d8/d1c/d23/d3e/fa2 2085829 0 2024-05-09T06:30:00.724 INFO:tasks.workunit.client.0.smithi062.stdout:5/653: dwrite d0/d11/f83 [0,4194304] 0 2024-05-09T06:30:00.735 INFO:tasks.workunit.client.0.smithi062.stdout:5/654: dread d0/f74 [0,4194304] 0 2024-05-09T06:30:00.735 INFO:tasks.workunit.client.0.smithi062.stdout:5/655: chown d0/d3b/f8b 2 1 2024-05-09T06:30:00.735 INFO:tasks.workunit.client.0.smithi062.stdout:5/656: write d0/d8/d1c/f6c [791316,12114] 0 2024-05-09T06:30:00.737 INFO:tasks.workunit.client.0.smithi062.stdout:5/657: symlink d0/d8/d1c/d23/ld4 0 2024-05-09T06:30:00.737 INFO:tasks.workunit.client.0.smithi062.stdout:5/658: write d0/d8/d1c/d23/d3e/f4d [4696138,63074] 0 2024-05-09T06:30:00.739 INFO:tasks.workunit.client.0.smithi062.stdout:5/659: creat d0/d8/d47/dbe/d86/dae/fd5 x:0 0 0 2024-05-09T06:30:00.741 INFO:tasks.workunit.client.0.smithi062.stdout:5/660: creat d0/d8/d47/fd6 x:0 0 0 2024-05-09T06:30:00.742 INFO:tasks.workunit.client.0.smithi062.stdout:5/661: mkdir d0/d8/d1c/d2c/d7d/d4a/dd7 0 2024-05-09T06:30:00.742 INFO:tasks.workunit.client.0.smithi062.stdout:5/662: chown d0/d3b/d3f/c49 11050 1 2024-05-09T06:30:00.742 INFO:tasks.workunit.client.0.smithi062.stdout:5/663: chown d0/d8/d1c/f32 3902 1 2024-05-09T06:30:00.742 INFO:tasks.workunit.client.0.smithi062.stdout:5/664: chown d0/d8/d18/f64 13006 1 2024-05-09T06:30:00.742 INFO:tasks.workunit.client.0.smithi062.stdout:5/665: write d0/d8/d1c/d2c/f7a [937255,89476] 0 2024-05-09T06:30:00.757 INFO:tasks.workunit.client.0.smithi062.stdout:5/666: dwrite d0/fa7 [4194304,4194304] 0 2024-05-09T06:30:00.759 INFO:tasks.workunit.client.0.smithi062.stdout:5/667: symlink d0/d8/d47/dbe/d45/ld8 0 2024-05-09T06:30:00.763 INFO:tasks.workunit.client.0.smithi062.stdout:5/668: unlink d0/d8/d1c/ld1 0 2024-05-09T06:30:00.763 INFO:tasks.workunit.client.0.smithi062.stdout:5/669: readlink d0/d8/d1c/d23/d3e/l4e 0 2024-05-09T06:30:00.764 INFO:tasks.workunit.client.0.smithi062.stdout:5/670: truncate d0/d8/d1c/d2c/f33 4353831 0 2024-05-09T06:30:00.767 INFO:tasks.workunit.client.0.smithi062.stdout:5/671: link d0/d8/d47/dbe/d5/l63 d0/d8/d47/d6e/ld9 0 2024-05-09T06:30:00.769 INFO:tasks.workunit.client.0.smithi062.stdout:5/672: link d0/d8/d18/l90 d0/d3b/d3f/lda 0 2024-05-09T06:30:00.771 INFO:tasks.workunit.client.0.smithi062.stdout:5/673: dread d0/d8/d47/dbe/f9e [0,4194304] 0 2024-05-09T06:30:00.773 INFO:tasks.workunit.client.0.smithi062.stdout:5/674: symlink d0/d8/d47/dbe/d5/ldb 0 2024-05-09T06:30:00.775 INFO:tasks.workunit.client.0.smithi062.stdout:5/675: rename d0/d3b/d3f/c49 to d0/d8/d47/d6e/cdc 0 2024-05-09T06:30:00.776 INFO:tasks.workunit.client.0.smithi062.stdout:5/676: unlink d0/d8/d47/dbe/d5/lb2 0 2024-05-09T06:30:00.794 INFO:tasks.workunit.client.0.smithi062.stdout:5/677: dwrite d0/d8/d1c/d2c/d7d/fb7 [0,4194304] 0 2024-05-09T06:30:00.794 INFO:tasks.workunit.client.0.smithi062.stdout:5/678: getdents d0/d11/d67/dc7 0 2024-05-09T06:30:00.794 INFO:tasks.workunit.client.0.smithi062.stdout:5/679: creat d0/d8/d1c/d23/d42/fdd x:0 0 0 2024-05-09T06:30:00.811 INFO:tasks.workunit.client.0.smithi062.stdout:5/680: dwrite d0/d8/d47/dbe/d5/f7e [0,4194304] 0 2024-05-09T06:30:00.812 INFO:tasks.workunit.client.0.smithi062.stdout:5/681: readlink d0/d8/d1c/d2c/d7d/l3d 0 2024-05-09T06:30:00.815 INFO:tasks.workunit.client.0.smithi062.stdout:5/682: mknod d0/d8/d47/dbe/d86/da4/cde 0 2024-05-09T06:30:00.819 INFO:tasks.workunit.client.0.smithi062.stdout:5/683: write d0/d8/d1c/f32 [865131,130430] 0 2024-05-09T06:30:00.822 INFO:tasks.workunit.client.0.smithi062.stdout:5/684: stat d0/d3b/f8b 0 2024-05-09T06:30:00.824 INFO:tasks.workunit.client.0.smithi062.stdout:5/685: mkdir d0/d8/d18/da6/ddf 0 2024-05-09T06:30:00.824 INFO:tasks.workunit.client.0.smithi062.stdout:5/686: dread - d0/d8/d47/fc8 zero size 2024-05-09T06:30:00.824 INFO:tasks.workunit.client.0.smithi062.stdout:5/687: write d0/d8/d1c/d23/f5b [1821812,83563] 0 2024-05-09T06:30:00.824 INFO:tasks.workunit.client.0.smithi062.stdout:5/688: chown d0/d8/d47/dbe/d5/l63 5898 1 2024-05-09T06:30:00.829 INFO:tasks.workunit.client.0.smithi062.stdout:5/689: truncate d0/d8/d47/dbe/d5/f6f 1315441 0 2024-05-09T06:30:00.829 INFO:tasks.workunit.client.0.smithi062.stdout:5/690: truncate d0/d8/f95 1028900 0 2024-05-09T06:30:00.834 INFO:tasks.workunit.client.0.smithi062.stdout:5/691: creat d0/d8/d47/dbe/d86/da4/dce/dbd/fe0 x:0 0 0 2024-05-09T06:30:00.834 INFO:tasks.workunit.client.0.smithi062.stdout:5/692: read - d0/d8/d47/dbe/d86/dae/fd5 zero size 2024-05-09T06:30:00.840 INFO:tasks.workunit.client.0.smithi062.stdout:5/693: dread d0/d3b/d3f/f70 [0,4194304] 0 2024-05-09T06:30:00.845 INFO:tasks.workunit.client.0.smithi062.stdout:7/604: sync 2024-05-09T06:30:00.845 INFO:tasks.workunit.client.0.smithi062.stdout:0/558: sync 2024-05-09T06:30:00.845 INFO:tasks.workunit.client.0.smithi062.stdout:1/481: sync 2024-05-09T06:30:00.845 INFO:tasks.workunit.client.0.smithi062.stdout:9/602: sync 2024-05-09T06:30:00.845 INFO:tasks.workunit.client.0.smithi062.stdout:8/691: sync 2024-05-09T06:30:00.845 INFO:tasks.workunit.client.0.smithi062.stdout:6/659: sync 2024-05-09T06:30:00.845 INFO:tasks.workunit.client.0.smithi062.stdout:3/500: sync 2024-05-09T06:30:00.846 INFO:tasks.workunit.client.0.smithi062.stdout:2/578: sync 2024-05-09T06:30:00.846 INFO:tasks.workunit.client.0.smithi062.stdout:4/650: sync 2024-05-09T06:30:00.851 INFO:tasks.workunit.client.0.smithi062.stdout:0/559: truncate d1/d6a/d6d/d93/d94/dc7/f5c 2957292 0 2024-05-09T06:30:00.856 INFO:tasks.workunit.client.0.smithi062.stdout:1/482: truncate d8/f89 1530692 0 2024-05-09T06:30:00.856 INFO:tasks.workunit.client.0.smithi062.stdout:8/692: link da/f28 da/d77/fe1 0 2024-05-09T06:30:00.856 INFO:tasks.workunit.client.0.smithi062.stdout:8/693: chown da/d11/d2e/d34/f44 170985 1 2024-05-09T06:30:00.856 INFO:tasks.workunit.client.0.smithi062.stdout:8/694: write f7 [4678957,112359] 0 2024-05-09T06:30:00.861 INFO:tasks.workunit.client.0.smithi062.stdout:6/660: creat dc/d28/d34/fdd x:0 0 0 2024-05-09T06:30:00.862 INFO:tasks.workunit.client.0.smithi062.stdout:6/661: write dc/d28/d46/d82/d98/faa [395487,100830] 0 2024-05-09T06:30:00.862 INFO:tasks.workunit.client.0.smithi062.stdout:6/662: dread - dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/fb2 zero size 2024-05-09T06:30:00.865 INFO:tasks.workunit.client.0.smithi062.stdout:3/501: creat d1/d1e/d26/d43/fa7 x:0 0 0 2024-05-09T06:30:00.866 INFO:tasks.workunit.client.0.smithi062.stdout:3/502: fdatasync d1/d1e/d26/d43/d52/f53 0 2024-05-09T06:30:00.869 INFO:tasks.workunit.client.0.smithi062.stdout:9/603: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f43 [4194304,4194304] 0 2024-05-09T06:30:00.870 INFO:tasks.workunit.client.0.smithi062.stdout:4/651: rename d0/d2a/d14/d7e/d8e/d9e/d28/f62 to d0/d2a/d4b/d81/fc2 0 2024-05-09T06:30:00.870 INFO:tasks.workunit.client.0.smithi062.stdout:4/652: dread - d0/d2a/d14/d4f/f9c zero size 2024-05-09T06:30:00.874 INFO:tasks.workunit.client.0.smithi062.stdout:1/483: unlink d8/d14/d2b/d3c/d44/d7f/c9e 0 2024-05-09T06:30:00.878 INFO:tasks.workunit.client.0.smithi062.stdout:6/663: rmdir dc/d28/d46/d82/d98/db3/dba 0 2024-05-09T06:30:00.882 INFO:tasks.workunit.client.0.smithi062.stdout:8/695: dwrite da/f7a [0,4194304] 0 2024-05-09T06:30:00.883 INFO:tasks.workunit.client.0.smithi062.stdout:4/653: rename d0/d2a/d14/d4f/d6b/f4d to d0/d2a/d14/d7e/d8e/d9e/d86/fc3 0 2024-05-09T06:30:00.884 INFO:tasks.workunit.client.0.smithi062.stdout:5/694: dwrite d0/d8/f41 [4194304,4194304] 0 2024-05-09T06:30:00.886 INFO:tasks.workunit.client.0.smithi062.stdout:9/604: dread d3/f98 [0,4194304] 0 2024-05-09T06:30:00.886 INFO:tasks.workunit.client.0.smithi062.stdout:7/605: dwrite d0/d3a/d51/fb9 [0,4194304] 0 2024-05-09T06:30:00.888 INFO:tasks.workunit.client.0.smithi062.stdout:1/484: creat d8/d1d/fa4 x:0 0 0 2024-05-09T06:30:00.888 INFO:tasks.workunit.client.0.smithi062.stdout:2/579: dwrite d0/d9/d17/f1d [0,4194304] 0 2024-05-09T06:30:00.890 INFO:tasks.workunit.client.0.smithi062.stdout:6/664: mkdir dc/d28/d46/d3a/d7f/d91/d96/db6/dcc/dde 0 2024-05-09T06:30:00.898 INFO:tasks.workunit.client.0.smithi062.stdout:9/605: write d3/d3e/d52/d58/d1c/f76 [1479132,29228] 0 2024-05-09T06:30:00.898 INFO:tasks.workunit.client.0.smithi062.stdout:9/606: fdatasync d3/d3e/d52/d58/d1c/d21/f24 0 2024-05-09T06:30:00.901 INFO:tasks.workunit.client.0.smithi062.stdout:1/485: dread d8/d1d/f25 [0,4194304] 0 2024-05-09T06:30:00.909 INFO:tasks.workunit.client.0.smithi062.stdout:8/696: symlink da/d95/le2 0 2024-05-09T06:30:00.909 INFO:tasks.workunit.client.0.smithi062.stdout:8/697: write da/d11/d2e/d61/d92/fda [20234,40224] 0 2024-05-09T06:30:00.909 INFO:tasks.workunit.client.0.smithi062.stdout:9/607: write d3/d3e/d52/d58/d1c/f6f [857782,15434] 0 2024-05-09T06:30:00.909 INFO:tasks.workunit.client.0.smithi062.stdout:9/608: write d3/d3e/d52/d58/f71 [483770,124034] 0 2024-05-09T06:30:00.909 INFO:tasks.workunit.client.0.smithi062.stdout:4/654: unlink d0/f1e 0 2024-05-09T06:30:00.909 INFO:tasks.workunit.client.0.smithi062.stdout:4/655: write d0/d2a/f8f [720886,14150] 0 2024-05-09T06:30:00.914 INFO:tasks.workunit.client.0.smithi062.stdout:6/665: dwrite dc/d28/d34/d4e/fbe [0,4194304] 0 2024-05-09T06:30:00.915 INFO:tasks.workunit.client.0.smithi062.stdout:3/503: rename d1/d1e/d54/c59 to d1/d1e/d26/d43/d52/d6a/ca8 0 2024-05-09T06:30:00.920 INFO:tasks.workunit.client.0.smithi062.stdout:5/695: symlink d0/d8/d47/dbe/d45/da5/le1 0 2024-05-09T06:30:00.921 INFO:tasks.workunit.client.0.smithi062.stdout:8/698: read f7 [201852,10689] 0 2024-05-09T06:30:00.921 INFO:tasks.workunit.client.0.smithi062.stdout:8/699: creat da/d11/d2e/d61/d92/da5/db2/fe3 x:0 0 0 2024-05-09T06:30:00.930 INFO:tasks.workunit.client.0.smithi062.stdout:7/606: unlink d0/d3a/d51/d64/c7f 0 2024-05-09T06:30:00.937 INFO:tasks.workunit.client.0.smithi062.stdout:2/580: mknod d0/d9/d38/d41/db1/cb9 0 2024-05-09T06:30:00.937 INFO:tasks.workunit.client.0.smithi062.stdout:2/581: write d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f9a [1394820,98931] 0 2024-05-09T06:30:00.937 INFO:tasks.workunit.client.0.smithi062.stdout:2/582: write d0/d9/d38/d41/d53/f63 [4667056,114889] 0 2024-05-09T06:30:00.937 INFO:tasks.workunit.client.0.smithi062.stdout:2/583: fsync d0/d9/dd/f98 0 2024-05-09T06:30:00.944 INFO:tasks.workunit.client.0.smithi062.stdout:1/486: mkdir d8/d14/d2b/d3c/da5 0 2024-05-09T06:30:00.944 INFO:tasks.workunit.client.0.smithi062.stdout:1/487: creat d8/d14/d2b/d3c/d44/d6e/d7a/fa6 x:0 0 0 2024-05-09T06:30:00.944 INFO:tasks.workunit.client.0.smithi062.stdout:1/488: readlink d8/d14/d2b/d3c/d44/d7f/l86 0 2024-05-09T06:30:00.944 INFO:tasks.workunit.client.0.smithi062.stdout:1/489: write d8/d14/f32 [3946426,86801] 0 2024-05-09T06:30:00.945 INFO:tasks.workunit.client.0.smithi062.stdout:3/504: dwrite d1/d1e/d26/f56 [0,4194304] 0 2024-05-09T06:30:00.950 INFO:tasks.workunit.client.0.smithi062.stdout:3/505: dread d1/d1e/d36/d3a/d4e/f76 [0,4194304] 0 2024-05-09T06:30:00.954 INFO:tasks.workunit.client.0.smithi062.stdout:9/609: getdents d3/d3e/d52/d58/d1c/d1e/d41 0 2024-05-09T06:30:00.957 INFO:tasks.workunit.client.0.smithi062.stdout:4/656: mkdir d0/d3c/dc4 0 2024-05-09T06:30:00.968 INFO:tasks.workunit.client.0.smithi062.stdout:6/666: creat dc/d28/d34/db7/fdf x:0 0 0 2024-05-09T06:30:00.968 INFO:tasks.workunit.client.0.smithi062.stdout:6/667: fdatasync dc/d28/d10/d20/d5b/f6a 0 2024-05-09T06:30:00.975 INFO:tasks.workunit.client.0.smithi062.stdout:6/668: dread dc/d28/d46/d3a/d7f/d91/d93/dc0/f67 [0,4194304] 0 2024-05-09T06:30:00.981 INFO:tasks.workunit.client.0.smithi062.stdout:5/696: mknod d0/d8/d47/dbe/d86/da4/dce/dbd/ce2 0 2024-05-09T06:30:00.983 INFO:tasks.workunit.client.0.smithi062.stdout:6/669: write dc/d28/d46/d3a/d7f/d91/d93/dc0/f69 [1064433,81703] 0 2024-05-09T06:30:00.983 INFO:tasks.workunit.client.0.smithi062.stdout:6/670: write dc/d28/d34/f38 [1247728,27841] 0 2024-05-09T06:30:00.983 INFO:tasks.workunit.client.0.smithi062.stdout:6/671: fsync dc/d28/f9a 0 2024-05-09T06:30:00.983 INFO:tasks.workunit.client.0.smithi062.stdout:6/672: dread - dc/d28/d46/d4a/d5d/fca zero size 2024-05-09T06:30:00.983 INFO:tasks.workunit.client.0.smithi062.stdout:6/673: write dc/d28/f9a [602657,98180] 0 2024-05-09T06:30:00.988 INFO:tasks.workunit.client.0.smithi062.stdout:8/700: link da/d11/f17 da/d85/fe4 0 2024-05-09T06:30:00.988 INFO:tasks.workunit.client.0.smithi062.stdout:8/701: write da/d11/d2e/d34/d90/fc6 [158989,126857] 0 2024-05-09T06:30:00.993 INFO:tasks.workunit.client.0.smithi062.stdout:7/607: truncate d0/f28 387738 0 2024-05-09T06:30:00.993 INFO:tasks.workunit.client.0.smithi062.stdout:7/608: dread - d0/d12/f99 zero size 2024-05-09T06:30:00.993 INFO:tasks.workunit.client.0.smithi062.stdout:5/697: read d0/d8/d1c/d23/f29 [799239,65227] 0 2024-05-09T06:30:00.994 INFO:tasks.workunit.client.0.smithi062.stdout:2/584: mkdir d0/d9/d38/d41/db1/dba 0 2024-05-09T06:30:00.995 INFO:tasks.workunit.client.0.smithi062.stdout:2/585: write d0/d9/dd/f92 [21728,120597] 0 2024-05-09T06:30:00.995 INFO:tasks.workunit.client.0.smithi062.stdout:2/586: stat d0/d9/dd/d65/d6d/d21/d29/d3d/d46/l8c 0 2024-05-09T06:30:00.998 INFO:tasks.workunit.client.0.smithi062.stdout:1/490: symlink d8/d14/d2b/d3c/d44/d7f/la7 0 2024-05-09T06:30:01.001 INFO:tasks.workunit.client.0.smithi062.stdout:9/610: truncate d3/d3e/d52/d58/d1c/fbf 319167 0 2024-05-09T06:30:01.002 INFO:tasks.workunit.client.0.smithi062.stdout:9/611: write d3/d3e/f89 [3148987,19699] 0 2024-05-09T06:30:01.002 INFO:tasks.workunit.client.0.smithi062.stdout:9/612: readlink d3/d3e/d52/d58/d1c/d21/l36 0 2024-05-09T06:30:01.003 INFO:tasks.workunit.client.0.smithi062.stdout:4/657: rmdir d0/d3c/dc4 0 2024-05-09T06:30:01.005 INFO:tasks.workunit.client.0.smithi062.stdout:2/587: mknod d0/d9/d38/cbb 0 2024-05-09T06:30:01.007 INFO:tasks.workunit.client.0.smithi062.stdout:6/674: dwrite dc/d28/d46/d3a/f3c [4194304,4194304] 0 2024-05-09T06:30:01.007 INFO:tasks.workunit.client.0.smithi062.stdout:6/675: dread - dc/d28/d46/d3a/d7f/d91/d96/db6/fc1 zero size 2024-05-09T06:30:01.007 INFO:tasks.workunit.client.0.smithi062.stdout:1/491: rename d8/d1d/d9c/d41/f8a to d8/d14/d2b/d3c/d44/d7f/fa8 0 2024-05-09T06:30:01.009 INFO:tasks.workunit.client.0.smithi062.stdout:4/658: rmdir d0/d2a/d14/d7e/d8e/d9e 39 2024-05-09T06:30:01.012 INFO:tasks.workunit.client.0.smithi062.stdout:2/588: mknod d0/d9/dd/d65/d6d/d96/da4/cbc 0 2024-05-09T06:30:01.013 INFO:tasks.workunit.client.0.smithi062.stdout:6/676: unlink dc/d28/f22 0 2024-05-09T06:30:01.015 INFO:tasks.workunit.client.0.smithi062.stdout:4/659: mkdir d0/d5b/dc5 0 2024-05-09T06:30:01.016 INFO:tasks.workunit.client.0.smithi062.stdout:4/660: fsync d0/d3c/dae/db0/dbc/f58 0 2024-05-09T06:30:01.016 INFO:tasks.workunit.client.0.smithi062.stdout:4/661: readlink d0/d2a/d8/l43 0 2024-05-09T06:30:01.019 INFO:tasks.workunit.client.0.smithi062.stdout:2/589: dread d0/fa [0,4194304] 0 2024-05-09T06:30:01.019 INFO:tasks.workunit.client.0.smithi062.stdout:1/492: write d8/d14/d2b/d3c/d44/d6e/f73 [736362,12712] 0 2024-05-09T06:30:01.022 INFO:tasks.workunit.client.0.smithi062.stdout:7/609: dread d0/d3a/f78 [0,4194304] 0 2024-05-09T06:30:01.022 INFO:tasks.workunit.client.0.smithi062.stdout:7/610: chown d0/d3a/d69/fc0 755 1 2024-05-09T06:30:01.023 INFO:tasks.workunit.client.0.smithi062.stdout:9/613: dwrite d3/d3e/d52/d58/d1c/d1e/d41/f7f [0,4194304] 0 2024-05-09T06:30:01.025 INFO:tasks.workunit.client.0.smithi062.stdout:4/662: symlink d0/d2a/d14/lc6 0 2024-05-09T06:30:01.029 INFO:tasks.workunit.client.0.smithi062.stdout:5/698: dwrite d0/d8/d1c/f6c [0,4194304] 0 2024-05-09T06:30:01.029 INFO:tasks.workunit.client.0.smithi062.stdout:5/699: stat d0/d3b/d3f 0 2024-05-09T06:30:01.031 INFO:tasks.workunit.client.0.smithi062.stdout:1/493: mknod d8/d14/d2b/d3c/d44/d6e/d98/ca9 0 2024-05-09T06:30:01.031 INFO:tasks.workunit.client.0.smithi062.stdout:1/494: chown d8/d1d/d9c/f9b 79 1 2024-05-09T06:30:01.034 INFO:tasks.workunit.client.0.smithi062.stdout:5/700: dread d0/d8/d1c/f22 [0,4194304] 0 2024-05-09T06:30:01.038 INFO:tasks.workunit.client.0.smithi062.stdout:4/663: write d0/f7f [555506,10099] 0 2024-05-09T06:30:01.040 INFO:tasks.workunit.client.0.smithi062.stdout:9/614: mkdir d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4 0 2024-05-09T06:30:01.044 INFO:tasks.workunit.client.0.smithi062.stdout:8/702: truncate da/d11/d2e/d34/d90/fc6 2695391 0 2024-05-09T06:30:01.044 INFO:tasks.workunit.client.0.smithi062.stdout:8/703: readlink da/l31 0 2024-05-09T06:30:01.044 INFO:tasks.workunit.client.0.smithi062.stdout:8/704: stat f8 0 2024-05-09T06:30:01.048 INFO:tasks.workunit.client.0.smithi062.stdout:1/495: creat d8/d1d/d70/faa x:0 0 0 2024-05-09T06:30:01.048 INFO:tasks.workunit.client.0.smithi062.stdout:2/590: dwrite d0/f6 [0,4194304] 0 2024-05-09T06:30:01.050 INFO:tasks.workunit.client.0.smithi062.stdout:7/611: dwrite d0/d3/f2d [0,4194304] 0 2024-05-09T06:30:01.053 INFO:tasks.workunit.client.0.smithi062.stdout:6/677: rename dc/d28/d46/d82/d98 to dc/d28/d34/d39/de0 0 2024-05-09T06:30:01.054 INFO:tasks.workunit.client.0.smithi062.stdout:4/664: unlink d0/d2a/d4b/d81/cb2 0 2024-05-09T06:30:01.054 INFO:tasks.workunit.client.0.smithi062.stdout:4/665: stat d0/d3c/ca2 0 2024-05-09T06:30:01.054 INFO:tasks.workunit.client.0.smithi062.stdout:4/666: readlink d0/l3f 0 2024-05-09T06:30:01.055 INFO:tasks.workunit.client.0.smithi062.stdout:8/705: creat da/d11/d2e/fe5 x:0 0 0 2024-05-09T06:30:01.058 INFO:tasks.workunit.client.0.smithi062.stdout:7/612: symlink d0/d12/d33/d67/lca 0 2024-05-09T06:30:01.058 INFO:tasks.workunit.client.0.smithi062.stdout:7/613: write d0/d3/f65 [134842,33085] 0 2024-05-09T06:30:01.069 INFO:tasks.workunit.client.0.smithi062.stdout:6/678: readlink dc/d28/d10/d20/l92 0 2024-05-09T06:30:01.070 INFO:tasks.workunit.client.0.smithi062.stdout:5/701: rename d0/d8/d1c/f62 to d0/d8/d47/fe3 0 2024-05-09T06:30:01.071 INFO:tasks.workunit.client.0.smithi062.stdout:5/702: fdatasync d0/d8/d1c/d2c/d7d/fd3 0 2024-05-09T06:30:01.072 INFO:tasks.workunit.client.0.smithi062.stdout:4/667: mknod d0/d2a/d14/d7e/d8e/d9e/d86/cc7 0 2024-05-09T06:30:01.073 INFO:tasks.workunit.client.0.smithi062.stdout:8/706: rmdir da/d11/d1c/d9e/d9f 39 2024-05-09T06:30:01.073 INFO:tasks.workunit.client.0.smithi062.stdout:8/707: write da/d11/d2e/d61/fcb [558388,2369] 0 2024-05-09T06:30:01.075 INFO:tasks.workunit.client.0.smithi062.stdout:1/496: dwrite d8/f54 [0,4194304] 0 2024-05-09T06:30:01.075 INFO:tasks.workunit.client.0.smithi062.stdout:1/497: write d8/f3f [2481856,80530] 0 2024-05-09T06:30:01.075 INFO:tasks.workunit.client.0.smithi062.stdout:1/498: dread - d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 zero size 2024-05-09T06:30:01.075 INFO:tasks.workunit.client.0.smithi062.stdout:1/499: fsync d8/d14/d2b/f2e 0 2024-05-09T06:30:01.076 INFO:tasks.workunit.client.0.smithi062.stdout:2/591: dwrite d0/d9/dd/d65/fb4 [0,4194304] 0 2024-05-09T06:30:01.076 INFO:tasks.workunit.client.0.smithi062.stdout:6/679: rmdir dc/d28/d46/d3a/d7f/d91/d96/db6/dd9 0 2024-05-09T06:30:01.079 INFO:tasks.workunit.client.0.smithi062.stdout:5/703: rename d0/d8/d1c/d23/d42/l9a to d0/d8/d47/d6e/le4 0 2024-05-09T06:30:01.079 INFO:tasks.workunit.client.0.smithi062.stdout:5/704: chown d0/d8/d1c/d2c/f7a 242739807 1 2024-05-09T06:30:01.081 INFO:tasks.workunit.client.0.smithi062.stdout:4/668: rmdir d0/d2a/d14/d4f/d6b/dbf 0 2024-05-09T06:30:01.081 INFO:tasks.workunit.client.0.smithi062.stdout:4/669: readlink d0/d2a/d8/l43 0 2024-05-09T06:30:01.083 INFO:tasks.workunit.client.0.smithi062.stdout:8/708: unlink da/d11/d2e/d34/d90/lb1 0 2024-05-09T06:30:01.083 INFO:tasks.workunit.client.0.smithi062.stdout:8/709: truncate da/fc7 987228 0 2024-05-09T06:30:01.091 INFO:tasks.workunit.client.0.smithi062.stdout:1/500: creat d8/d14/d2b/d3c/d44/fab x:0 0 0 2024-05-09T06:30:01.091 INFO:tasks.workunit.client.0.smithi062.stdout:5/705: dread d0/d8/d1c/d2c/d7d/fb7 [0,4194304] 0 2024-05-09T06:30:01.099 INFO:tasks.workunit.client.0.smithi062.stdout:6/680: creat dc/d28/d10/d20/d5b/da3/fe1 x:0 0 0 2024-05-09T06:30:01.104 INFO:tasks.workunit.client.0.smithi062.stdout:8/710: dwrite da/d77/f94 [0,4194304] 0 2024-05-09T06:30:01.105 INFO:tasks.workunit.client.0.smithi062.stdout:4/670: creat d0/d2a/d14/d4f/d6b/fc8 x:0 0 0 2024-05-09T06:30:01.107 INFO:tasks.workunit.client.0.smithi062.stdout:1/501: link d8/d14/d2b/d3c/d44/d64/f68 d8/d14/d2b/d3c/d44/d6e/d7a/d80/fac 0 2024-05-09T06:30:01.107 INFO:tasks.workunit.client.0.smithi062.stdout:1/502: creat d8/d14/d2b/d3c/d7d/fad x:0 0 0 2024-05-09T06:30:01.108 INFO:tasks.workunit.client.0.smithi062.stdout:5/706: getdents d0/d8/d47/dbe 0 2024-05-09T06:30:01.110 INFO:tasks.workunit.client.0.smithi062.stdout:6/681: symlink dc/d28/d10/d20/db5/le2 0 2024-05-09T06:30:01.113 INFO:tasks.workunit.client.0.smithi062.stdout:6/682: dread dc/f2a [0,4194304] 0 2024-05-09T06:30:01.115 INFO:tasks.workunit.client.0.smithi062.stdout:1/503: symlink d8/d14/d2b/d3c/d44/d64/lae 0 2024-05-09T06:30:01.117 INFO:tasks.workunit.client.0.smithi062.stdout:5/707: creat d0/d8/d1c/d2c/d7d/d4a/dd7/fe5 x:0 0 0 2024-05-09T06:30:01.117 INFO:tasks.workunit.client.0.smithi062.stdout:5/708: chown d0/d8/d1c/d2c/d7d/l43 627729 1 2024-05-09T06:30:01.117 INFO:tasks.workunit.client.0.smithi062.stdout:5/709: creat d0/d8/d1c/d2c/d7d/d4a/dd7/fe6 x:0 0 0 2024-05-09T06:30:01.117 INFO:tasks.workunit.client.0.smithi062.stdout:5/710: chown d0/d8/d47/dbe/d45/f76 2185 1 2024-05-09T06:30:01.118 INFO:tasks.workunit.client.0.smithi062.stdout:6/683: symlink dc/d28/d46/d3a/d7f/d91/d96/db6/dcc/le3 0 2024-05-09T06:30:01.122 INFO:tasks.workunit.client.0.smithi062.stdout:5/711: unlink d0/d8/d47/dbe/d86/c91 0 2024-05-09T06:30:01.124 INFO:tasks.workunit.client.0.smithi062.stdout:4/671: rename d0/d2a/d4b to d0/d2a/d1f/dc9 0 2024-05-09T06:30:01.129 INFO:tasks.workunit.client.0.smithi062.stdout:5/712: dread d0/d8/f41 [0,4194304] 0 2024-05-09T06:30:01.129 INFO:tasks.workunit.client.0.smithi062.stdout:5/713: write d0/d8/d1c/d2c/f7a [1325809,123999] 0 2024-05-09T06:30:01.137 INFO:tasks.workunit.client.0.smithi062.stdout:4/672: write d0/d2a/d14/d7e/d8e/d9e/f5d [2460826,104719] 0 2024-05-09T06:30:01.137 INFO:tasks.workunit.client.0.smithi062.stdout:1/504: dwrite d8/f2a [0,4194304] 0 2024-05-09T06:30:01.142 INFO:tasks.workunit.client.0.smithi062.stdout:1/505: rmdir d8/d1d 39 2024-05-09T06:30:01.142 INFO:tasks.workunit.client.0.smithi062.stdout:1/506: readlink d8/d14/d2b/d3c/d44/d6e/l42 0 2024-05-09T06:30:01.145 INFO:tasks.workunit.client.0.smithi062.stdout:6/684: rename dc/d28/d46/d3a/d7f/d91/d96 to dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/de4 0 2024-05-09T06:30:01.146 INFO:tasks.workunit.client.0.smithi062.stdout:6/685: mknod dc/d28/d34/db0/ce5 0 2024-05-09T06:30:01.149 INFO:tasks.workunit.client.0.smithi062.stdout:6/686: rename dc/d28/d46/d3a/d7f/d91/d93/f9b to dc/d28/d46/d3a/d7f/d91/fe6 0 2024-05-09T06:30:01.151 INFO:tasks.workunit.client.0.smithi062.stdout:6/687: link dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/de4/db6/dcc/le3 dc/d28/d34/le7 0 2024-05-09T06:30:01.151 INFO:tasks.workunit.client.0.smithi062.stdout:6/688: truncate dc/d28/d34/f59 627304 0 2024-05-09T06:30:01.152 INFO:tasks.workunit.client.0.smithi062.stdout:6/689: creat dc/d28/d46/d4a/d5d/d6f/fe8 x:0 0 0 2024-05-09T06:30:01.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:00 smithi062 ceph-mon[26920]: pgmap v8: 65 pgs: 65 active+clean; 2.7 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 89 MiB/s rd, 108 MiB/s wr, 199 op/s 2024-05-09T06:30:01.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:00 smithi062 ceph-mon[26920]: mgrmap e24: smithi079.genyri(active, since 10s), standbys: smithi062.juuasl 2024-05-09T06:30:01.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:00 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:30:01.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:00 smithi062 ceph-mon[26920]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:30:01.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:00 smithi062 ceph-mon[26920]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:30:01.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:00 smithi062 ceph-mon[26920]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:30:01.163 INFO:tasks.workunit.client.0.smithi062.stdout:5/714: dwrite d0/d8/d1c/d2c/f7a [0,4194304] 0 2024-05-09T06:30:01.163 INFO:tasks.workunit.client.0.smithi062.stdout:5/715: truncate d0/d8/d1c/d2c/d7d/d4a/dd7/fe5 1027508 0 2024-05-09T06:30:01.163 INFO:tasks.workunit.client.0.smithi062.stdout:5/716: creat d0/d8/d47/dbe/d5/fe7 x:0 0 0 2024-05-09T06:30:01.163 INFO:tasks.workunit.client.0.smithi062.stdout:6/690: getdents dc/d28/d46/d3a/d7f/d91/d93/dc0/d70 0 2024-05-09T06:30:01.165 INFO:tasks.workunit.client.0.smithi062.stdout:5/717: mkdir d0/d8/d1c/d2c/de8 0 2024-05-09T06:30:01.165 INFO:tasks.workunit.client.0.smithi062.stdout:5/718: fsync d0/f5c 0 2024-05-09T06:30:01.199 INFO:tasks.workunit.client.0.smithi062.stdout:6/691: creat dc/d28/d46/d4a/d5d/dc5/fe9 x:0 0 0 2024-05-09T06:30:01.199 INFO:tasks.workunit.client.0.smithi062.stdout:6/692: write dc/d28/d10/d20/f8b [1036762,59051] 0 2024-05-09T06:30:01.207 INFO:tasks.workunit.client.0.smithi062.stdout:5/719: rmdir d0/d11/d67/dc7 0 2024-05-09T06:30:01.207 INFO:tasks.workunit.client.0.smithi062.stdout:5/720: truncate d0/d8/d1c/d23/d3e/fa2 2941572 0 2024-05-09T06:30:01.207 INFO:tasks.workunit.client.0.smithi062.stdout:5/721: write d0/d8/d47/fc8 [748899,67764] 0 2024-05-09T06:30:01.215 INFO:tasks.workunit.client.0.smithi062.stdout:6/693: dwrite dc/d28/d46/d81/dad/fd8 [0,4194304] 0 2024-05-09T06:30:01.218 INFO:tasks.workunit.client.0.smithi062.stdout:6/694: creat dc/d28/d46/d3a/d7f/d91/fea x:0 0 0 2024-05-09T06:30:01.220 INFO:tasks.workunit.client.0.smithi062.stdout:6/695: creat dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/de4/db6/dcc/feb x:0 0 0 2024-05-09T06:30:01.220 INFO:tasks.workunit.client.0.smithi062.stdout:6/696: readlink dc/d28/d46/l72 0 2024-05-09T06:30:01.220 INFO:tasks.workunit.client.0.smithi062.stdout:6/697: write dc/d28/d10/d20/f51 [295687,117064] 0 2024-05-09T06:30:01.221 INFO:tasks.workunit.client.0.smithi062.stdout:6/698: mknod dc/d28/d46/d3a/d7f/d8e/dc8/dcd/cec 0 2024-05-09T06:30:01.223 INFO:tasks.workunit.client.0.smithi062.stdout:6/699: symlink dc/d28/d46/d3a/d7f/d91/d93/led 0 2024-05-09T06:30:01.224 INFO:tasks.workunit.client.0.smithi062.stdout:6/700: mkdir dc/d28/d34/d39/dee 0 2024-05-09T06:30:01.230 INFO:tasks.workunit.client.0.smithi062.stdout:5/722: dwrite d0/d3b/d3f/f70 [4194304,4194304] 0 2024-05-09T06:30:01.230 INFO:tasks.workunit.client.0.smithi062.stdout:5/723: fsync d0/d8/d1c/d2c/d7d/d4a/dd7/fe6 0 2024-05-09T06:30:01.233 INFO:tasks.workunit.client.0.smithi062.stdout:5/724: mkdir d0/d8/d1c/d23/d3e/de9 0 2024-05-09T06:30:01.233 INFO:tasks.workunit.client.0.smithi062.stdout:5/725: chown d0/d8 396 1 2024-05-09T06:30:01.234 INFO:tasks.workunit.client.0.smithi062.stdout:5/726: stat d0/d8/d47/dbe/d86/da4/dce/dbd/cb9 0 2024-05-09T06:30:01.235 INFO:tasks.workunit.client.0.smithi062.stdout:5/727: dread - d0/d8/d1c/d23/fd0 zero size 2024-05-09T06:30:01.241 INFO:tasks.workunit.client.0.smithi062.stdout:6/701: rename dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/de4/db6 to dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def 0 2024-05-09T06:30:01.242 INFO:tasks.workunit.client.0.smithi062.stdout:5/728: dread d0/d8/fc4 [0,4194304] 0 2024-05-09T06:30:01.242 INFO:tasks.workunit.client.0.smithi062.stdout:5/729: fsync d0/fc0 0 2024-05-09T06:30:01.244 INFO:tasks.workunit.client.0.smithi062.stdout:6/702: mknod dc/d28/d46/d3a/d7f/d91/d93/cf0 0 2024-05-09T06:30:01.244 INFO:tasks.workunit.client.0.smithi062.stdout:6/703: write dc/d28/d34/fdd [357433,37923] 0 2024-05-09T06:30:01.244 INFO:tasks.workunit.client.0.smithi062.stdout:6/704: write dc/d28/d46/d4a/f6b [859030,77664] 0 2024-05-09T06:30:01.245 INFO:tasks.workunit.client.0.smithi062.stdout:5/730: creat d0/d8/fea x:0 0 0 2024-05-09T06:30:01.248 INFO:tasks.workunit.client.0.smithi062.stdout:6/705: mkdir dc/d28/df1 0 2024-05-09T06:30:01.250 INFO:tasks.workunit.client.0.smithi062.stdout:6/706: rmdir dc/d28/d34/d39 39 2024-05-09T06:30:01.253 INFO:tasks.workunit.client.0.smithi062.stdout:6/707: creat dc/d28/d46/d4a/ff2 x:0 0 0 2024-05-09T06:30:01.253 INFO:tasks.workunit.client.0.smithi062.stdout:6/708: creat dc/d28/d34/ff3 x:0 0 0 2024-05-09T06:30:01.261 INFO:tasks.workunit.client.0.smithi062.stdout:5/731: dwrite d0/d8/d1c/d23/f5b [0,4194304] 0 2024-05-09T06:30:01.265 INFO:tasks.workunit.client.0.smithi062.stdout:5/732: mknod d0/d8/d47/dbe/d45/da5/dcf/ceb 0 2024-05-09T06:30:01.267 INFO:tasks.workunit.client.0.smithi062.stdout:5/733: creat d0/d8/d18/da6/ddf/fec x:0 0 0 2024-05-09T06:30:01.268 INFO:tasks.workunit.client.0.smithi062.stdout:5/734: getdents d0/d8/d47/dbe/d45/da5 0 2024-05-09T06:30:01.268 INFO:tasks.workunit.client.0.smithi062.stdout:5/735: read - d0/d8/d1c/d2c/d7d/d4a/dd7/fe6 zero size 2024-05-09T06:30:01.268 INFO:tasks.workunit.client.0.smithi062.stdout:5/736: fsync d0/d8/fc4 0 2024-05-09T06:30:01.269 INFO:tasks.workunit.client.0.smithi062.stdout:5/737: symlink d0/d8/d47/dbe/d86/da4/dce/led 0 2024-05-09T06:30:01.275 INFO:tasks.workunit.client.0.smithi062.stdout:6/709: dwrite dc/d28/d34/d4e/f85 [0,4194304] 0 2024-05-09T06:30:01.275 INFO:tasks.workunit.client.0.smithi062.stdout:6/710: chown dc/d28/d34/d4e/fbe 6376346 1 2024-05-09T06:30:01.276 INFO:tasks.workunit.client.0.smithi062.stdout:6/711: write dc/d28/d10/d20/f8b [1583872,56198] 0 2024-05-09T06:30:01.276 INFO:tasks.workunit.client.0.smithi062.stdout:6/712: read dc/d28/d46/d4a/d5d/d6f/d76/f87 [171496,19880] 0 2024-05-09T06:30:01.281 INFO:tasks.workunit.client.0.smithi062.stdout:5/738: dread d0/d8/d47/dbe/d45/f76 [0,4194304] 0 2024-05-09T06:30:01.288 INFO:tasks.workunit.client.0.smithi062.stdout:6/713: truncate dc/d28/d34/f3d 4693848 0 2024-05-09T06:30:01.288 INFO:tasks.workunit.client.0.smithi062.stdout:6/714: stat dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def 0 2024-05-09T06:30:01.290 INFO:tasks.workunit.client.0.smithi062.stdout:5/739: mkdir d0/d8/d18/da6/dee 0 2024-05-09T06:30:01.290 INFO:tasks.workunit.client.0.smithi062.stdout:5/740: fdatasync d0/d8/d1c/d2c/d7d/d4a/f93 0 2024-05-09T06:30:01.299 INFO:tasks.workunit.client.0.smithi062.stdout:5/741: truncate d0/d8/d1c/d23/f48 2268158 0 2024-05-09T06:30:01.306 INFO:tasks.workunit.client.0.smithi062.stdout:6/715: dwrite dc/d28/d46/d4a/d5d/d6f/fe8 [0,4194304] 0 2024-05-09T06:30:01.306 INFO:tasks.workunit.client.0.smithi062.stdout:6/716: stat dc/d28/d46/d3a/d7f/d91/fea 0 2024-05-09T06:30:01.310 INFO:tasks.workunit.client.0.smithi062.stdout:5/742: write d0/d8/f52 [1900656,5544] 0 2024-05-09T06:30:01.310 INFO:tasks.workunit.client.0.smithi062.stdout:5/743: truncate d0/d8/d1c/d2c/d7d/fd3 5214825 0 2024-05-09T06:30:01.310 INFO:tasks.workunit.client.0.smithi062.stdout:5/744: getdents d0/d8/d1c/d2c/de8 0 2024-05-09T06:30:01.311 INFO:tasks.workunit.client.0.smithi062.stdout:6/717: symlink dc/d28/d46/d82/lf4 0 2024-05-09T06:30:01.314 INFO:tasks.workunit.client.0.smithi062.stdout:5/745: rmdir d0/d8/d47/dbe/d45/da5/dcf 39 2024-05-09T06:30:01.315 INFO:tasks.workunit.client.0.smithi062.stdout:6/718: write dc/d28/d10/f1c [1988548,96914] 0 2024-05-09T06:30:01.319 INFO:tasks.workunit.client.0.smithi062.stdout:5/746: rename d0/lb8 to d0/d8/d47/dbe/d45/da5/lef 0 2024-05-09T06:30:01.323 INFO:tasks.workunit.client.0.smithi062.stdout:6/719: link dc/d28/d34/d4e/fbe dc/d28/d10/d20/d5b/d77/ff5 0 2024-05-09T06:30:01.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/720: dread f4 [0,4194304] 0 2024-05-09T06:30:01.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/721: chown dc/d28/d10/f1c 364437649 1 2024-05-09T06:30:01.331 INFO:tasks.workunit.client.0.smithi062.stdout:5/747: mkdir d0/d8/d47/dbe/d45/df0 0 2024-05-09T06:30:01.335 INFO:tasks.workunit.client.0.smithi062.stdout:6/722: unlink dc/d28/d46/d4a/d5d/d6f/fe8 0 2024-05-09T06:30:01.336 INFO:tasks.workunit.client.0.smithi062.stdout:5/748: mkdir d0/d3b/dbc/df1 0 2024-05-09T06:30:01.336 INFO:tasks.workunit.client.0.smithi062.stdout:5/749: write d0/d8/d18/f5d [3955320,14729] 0 2024-05-09T06:30:01.338 INFO:tasks.workunit.client.0.smithi062.stdout:6/723: rename dc/d28/f43 to dc/d28/d34/d39/dee/ff6 0 2024-05-09T06:30:01.340 INFO:tasks.workunit.client.0.smithi062.stdout:5/750: unlink d0/d8/d47/dbe/d86/da4/cde 0 2024-05-09T06:30:01.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:00 smithi079 ceph-mon[35268]: pgmap v8: 65 pgs: 65 active+clean; 2.7 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 89 MiB/s rd, 108 MiB/s wr, 199 op/s 2024-05-09T06:30:01.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:00 smithi079 ceph-mon[35268]: mgrmap e24: smithi079.genyri(active, since 10s), standbys: smithi062.juuasl 2024-05-09T06:30:01.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:00 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:30:01.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:00 smithi079 ceph-mon[35268]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:30:01.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:00 smithi079 ceph-mon[35268]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:30:01.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:00 smithi079 ceph-mon[35268]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:30:01.343 INFO:tasks.workunit.client.0.smithi062.stdout:6/724: truncate f4 1873449 0 2024-05-09T06:30:01.358 INFO:tasks.workunit.client.0.smithi062.stdout:5/751: dwrite d0/d8/d1c/d2c/d7d/fd3 [4194304,4194304] 0 2024-05-09T06:30:01.359 INFO:tasks.workunit.client.0.smithi062.stdout:6/725: rename dc/d28/d10/f86 to dc/d28/d10/d20/d5b/d77/ff7 0 2024-05-09T06:30:01.362 INFO:tasks.workunit.client.0.smithi062.stdout:6/726: mkdir dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/df8 0 2024-05-09T06:30:01.367 INFO:tasks.workunit.client.0.smithi062.stdout:5/752: write d0/f79 [3465217,27079] 0 2024-05-09T06:30:01.369 INFO:tasks.workunit.client.0.smithi062.stdout:5/753: mknod d0/d8/d18/cf2 0 2024-05-09T06:30:01.370 INFO:tasks.workunit.client.0.smithi062.stdout:5/754: unlink d0/d8/d1c/d2c/d7d/d4a/l68 0 2024-05-09T06:30:01.372 INFO:tasks.workunit.client.0.smithi062.stdout:5/755: creat d0/d8/d47/dbe/d86/da4/dce/ff3 x:0 0 0 2024-05-09T06:30:01.373 INFO:tasks.workunit.client.0.smithi062.stdout:5/756: truncate d0/d8/d47/dbe/d5/f7e 4421178 0 2024-05-09T06:30:01.375 INFO:tasks.workunit.client.0.smithi062.stdout:5/757: symlink d0/d8/d1c/d2c/d7d/d4a/lf4 0 2024-05-09T06:30:01.377 INFO:tasks.workunit.client.0.smithi062.stdout:5/758: mkdir d0/d8/d18/da6/dee/df5 0 2024-05-09T06:30:01.377 INFO:tasks.workunit.client.0.smithi062.stdout:5/759: chown d0/d8/d1c/d2c 38465 1 2024-05-09T06:30:01.380 INFO:tasks.workunit.client.0.smithi062.stdout:5/760: unlink d0/d8/d1c/d23/d42/c73 0 2024-05-09T06:30:01.380 INFO:tasks.workunit.client.0.smithi062.stdout:5/761: truncate d0/d8/d18/da6/ddf/fec 521076 0 2024-05-09T06:30:01.380 INFO:tasks.workunit.client.0.smithi062.stdout:5/762: read - d0/fc0 zero size 2024-05-09T06:30:01.381 INFO:tasks.workunit.client.0.smithi062.stdout:5/763: fsync d0/f5c 0 2024-05-09T06:30:01.381 INFO:tasks.workunit.client.0.smithi062.stdout:5/764: stat d0/d3b/dbc/df1 0 2024-05-09T06:30:01.381 INFO:tasks.workunit.client.0.smithi062.stdout:5/765: creat d0/d8/d47/dbe/d86/dae/ff6 x:0 0 0 2024-05-09T06:30:01.384 INFO:tasks.workunit.client.0.smithi062.stdout:5/766: creat d0/d8/d1c/ff7 x:0 0 0 2024-05-09T06:30:01.386 INFO:tasks.workunit.client.0.smithi062.stdout:5/767: mknod d0/d8/d47/cf8 0 2024-05-09T06:30:01.386 INFO:tasks.workunit.client.0.smithi062.stdout:5/768: stat d0/d8/d1c/ff7 0 2024-05-09T06:30:01.393 INFO:tasks.workunit.client.0.smithi062.stdout:5/769: getdents d0/d8/d1c 0 2024-05-09T06:30:01.397 INFO:tasks.workunit.client.0.smithi062.stdout:0/560: sync 2024-05-09T06:30:01.403 INFO:tasks.workunit.client.0.smithi062.stdout:0/561: rename d1/d6a/d6d/d93/f53 to d1/d25/fd0 0 2024-05-09T06:30:01.406 INFO:tasks.workunit.client.0.smithi062.stdout:0/562: rename d1/d6a/fce to d1/d25/d49/d4f/d52/d7b/fd1 0 2024-05-09T06:30:01.412 INFO:tasks.workunit.client.0.smithi062.stdout:0/563: mkdir d1/d25/dd2 0 2024-05-09T06:30:01.412 INFO:tasks.workunit.client.0.smithi062.stdout:0/564: fdatasync d1/d25/d49/d42/d43/d54/d9d/fab 0 2024-05-09T06:30:01.414 INFO:tasks.workunit.client.0.smithi062.stdout:0/565: creat d1/d25/d31/d6c/d44/d6e/dae/fd3 x:0 0 0 2024-05-09T06:30:01.415 INFO:tasks.workunit.client.0.smithi062.stdout:0/566: symlink d1/d25/d49/d42/d43/d54/d9d/ld4 0 2024-05-09T06:30:01.417 INFO:tasks.workunit.client.0.smithi062.stdout:0/567: creat d1/d25/d49/d42/dad/fd5 x:0 0 0 2024-05-09T06:30:01.418 INFO:tasks.workunit.client.0.smithi062.stdout:0/568: truncate d1/d25/d49/d4f/d52/f83 1305706 0 2024-05-09T06:30:01.418 INFO:tasks.workunit.client.0.smithi062.stdout:0/569: creat d1/d6a/fd6 x:0 0 0 2024-05-09T06:30:01.419 INFO:tasks.workunit.client.0.smithi062.stdout:0/570: chown d1/d25/d49/d4f/db7 5 1 2024-05-09T06:30:01.419 INFO:tasks.workunit.client.0.smithi062.stdout:0/571: stat d1/d25/d31 0 2024-05-09T06:30:01.421 INFO:tasks.workunit.client.0.smithi062.stdout:0/572: unlink d1/f8 0 2024-05-09T06:30:01.423 INFO:tasks.workunit.client.0.smithi062.stdout:0/573: symlink d1/d25/d49/d4f/db7/ld7 0 2024-05-09T06:30:01.425 INFO:tasks.workunit.client.0.smithi062.stdout:0/574: creat d1/d6a/d6d/fd8 x:0 0 0 2024-05-09T06:30:01.425 INFO:tasks.workunit.client.0.smithi062.stdout:0/575: chown d1/d25/d49/d42/d43/d54/d9d 4278423 1 2024-05-09T06:30:01.426 INFO:tasks.workunit.client.0.smithi062.stdout:0/576: chown d1/d25/d49/d42/d43/f5e 0 1 2024-05-09T06:30:01.426 INFO:tasks.workunit.client.0.smithi062.stdout:0/577: chown d1/d25/d49/d4f/d52/d7b/fd1 196 1 2024-05-09T06:30:01.427 INFO:tasks.workunit.client.0.smithi062.stdout:0/578: symlink d1/d25/d31/d6c/d44/d57/db4/ld9 0 2024-05-09T06:30:01.427 INFO:tasks.workunit.client.0.smithi062.stdout:0/579: chown d1/d25/d49/d4f/d52/fc1 0 1 2024-05-09T06:30:01.443 INFO:tasks.workunit.client.0.smithi062.stdout:0/580: dwrite d1/d25/d31/d6c/f66 [0,4194304] 0 2024-05-09T06:30:01.444 INFO:tasks.workunit.client.0.smithi062.stdout:0/581: rmdir d1/d25/d49 39 2024-05-09T06:30:01.445 INFO:tasks.workunit.client.0.smithi062.stdout:0/582: symlink d1/d25/d31/lda 0 2024-05-09T06:30:01.445 INFO:tasks.workunit.client.0.smithi062.stdout:0/583: readlink d1/d25/d49/d4f/l55 0 2024-05-09T06:30:01.453 INFO:tasks.workunit.client.0.smithi062.stdout:0/584: dread d1/d25/d31/db5/fcd [0,4194304] 0 2024-05-09T06:30:01.453 INFO:tasks.workunit.client.0.smithi062.stdout:0/585: write d1/f24 [533311,20630] 0 2024-05-09T06:30:01.454 INFO:tasks.workunit.client.0.smithi062.stdout:0/586: chown d1/fc 1 1 2024-05-09T06:30:01.454 INFO:tasks.workunit.client.0.smithi062.stdout:0/587: rmdir d1/d25/d31/db5 39 2024-05-09T06:30:01.454 INFO:tasks.workunit.client.0.smithi062.stdout:0/588: dread - d1/d18/f9e zero size 2024-05-09T06:30:01.455 INFO:tasks.workunit.client.0.smithi062.stdout:0/589: mknod d1/d25/d49/d4f/db7/cdb 0 2024-05-09T06:30:01.455 INFO:tasks.workunit.client.0.smithi062.stdout:0/590: dread - d1/d25/d49/d42/d43/d54/d9d/fab zero size 2024-05-09T06:30:01.455 INFO:tasks.workunit.client.0.smithi062.stdout:0/591: chown d1/d25/f86 1 1 2024-05-09T06:30:01.459 INFO:tasks.workunit.client.0.smithi062.stdout:0/592: rename d1/d25/d31/d6c/f66 to d1/d25/fdc 0 2024-05-09T06:30:01.459 INFO:tasks.workunit.client.0.smithi062.stdout:0/593: chown d1/d25/d31/db5/fcd 8989 1 2024-05-09T06:30:01.459 INFO:tasks.workunit.client.0.smithi062.stdout:0/594: chown d1/d25/d49/d42/d43/d54/d9d/fab 2 1 2024-05-09T06:30:01.466 INFO:tasks.workunit.client.0.smithi062.stdout:0/595: read d1/f2a [1296138,51067] 0 2024-05-09T06:30:01.466 INFO:tasks.workunit.client.0.smithi062.stdout:0/596: creat d1/fdd x:0 0 0 2024-05-09T06:30:01.475 INFO:tasks.workunit.client.0.smithi062.stdout:0/597: dread d1/d25/fdc [0,4194304] 0 2024-05-09T06:30:01.478 INFO:tasks.workunit.client.0.smithi062.stdout:0/598: unlink d1/d25/d49/d4f/d52/f83 0 2024-05-09T06:30:01.481 INFO:tasks.workunit.client.0.smithi062.stdout:0/599: link d1/d18/f37 d1/d6a/d6d/d93/fde 0 2024-05-09T06:30:01.484 INFO:tasks.workunit.client.0.smithi062.stdout:0/600: rename d1/d25/d49/d42/d43/l71 to d1/d25/d49/ldf 0 2024-05-09T06:30:01.486 INFO:tasks.workunit.client.0.smithi062.stdout:0/601: creat d1/d25/d49/d4f/fe0 x:0 0 0 2024-05-09T06:30:01.489 INFO:tasks.workunit.client.0.smithi062.stdout:0/602: creat d1/d6a/d6d/d93/d94/fe1 x:0 0 0 2024-05-09T06:30:01.493 INFO:tasks.workunit.client.0.smithi062.stdout:0/603: rename d1/d25/d49/d42/d43/l80 to d1/d25/d31/d6c/le2 0 2024-05-09T06:30:01.494 INFO:tasks.workunit.client.0.smithi062.stdout:0/604: rmdir d1/d25/d31/d6c 39 2024-05-09T06:30:01.495 INFO:tasks.workunit.client.0.smithi062.stdout:0/605: chown d1/d25/d31/d6c/fc2 31 1 2024-05-09T06:30:01.497 INFO:tasks.workunit.client.0.smithi062.stdout:0/606: creat d1/d25/d49/d42/d43/fe3 x:0 0 0 2024-05-09T06:30:01.513 INFO:tasks.workunit.client.0.smithi062.stdout:0/607: dwrite d1/d6a/fd6 [0,4194304] 0 2024-05-09T06:30:01.530 INFO:tasks.workunit.client.0.smithi062.stdout:0/608: truncate d1/d18/faf 2532483 0 2024-05-09T06:30:01.530 INFO:tasks.workunit.client.0.smithi062.stdout:0/609: stat d1/fd 0 2024-05-09T06:30:01.532 INFO:tasks.workunit.client.0.smithi062.stdout:0/610: creat d1/d25/d31/d6c/d44/d57/d84/fe4 x:0 0 0 2024-05-09T06:30:01.532 INFO:tasks.workunit.client.0.smithi062.stdout:0/611: write d1/d25/d49/d42/d43/d54/d9d/fab [679354,10789] 0 2024-05-09T06:30:01.532 INFO:tasks.workunit.client.0.smithi062.stdout:0/612: chown d1/d25/d31/d6c/d44/d6e/l7a 23664301 1 2024-05-09T06:30:01.539 INFO:tasks.workunit.client.0.smithi062.stdout:0/613: rename d1/d25/d31/f3b to d1/d25/d49/d7e/da6/fe5 0 2024-05-09T06:30:01.544 INFO:tasks.workunit.client.0.smithi062.stdout:0/614: rename d1/d18 to d1/d25/d49/d4f/de6 0 2024-05-09T06:30:01.544 INFO:tasks.workunit.client.0.smithi062.stdout:0/615: dread - d1/d25/d31/d6c/d44/d57/db4/fc0 zero size 2024-05-09T06:30:01.550 INFO:tasks.workunit.client.0.smithi062.stdout:0/616: mkdir d1/d25/d59/de7 0 2024-05-09T06:30:01.552 INFO:tasks.workunit.client.0.smithi062.stdout:0/617: creat d1/d25/d49/d7e/da6/fe8 x:0 0 0 2024-05-09T06:30:01.553 INFO:tasks.workunit.client.0.smithi062.stdout:0/618: rename d1/d25/d49/d4f/fe0 to d1/d25/d49/d42/d43/d54/fe9 0 2024-05-09T06:30:01.553 INFO:tasks.workunit.client.0.smithi062.stdout:0/619: dread - d1/d25/d49/d42/d43/f7d zero size 2024-05-09T06:30:01.555 INFO:tasks.workunit.client.0.smithi062.stdout:0/620: mkdir d1/d25/d31/d6c/d44/d6e/dae/dea 0 2024-05-09T06:30:01.555 INFO:tasks.workunit.client.0.smithi062.stdout:0/621: chown d1/d25/d49/d42/d43/f4e 97 1 2024-05-09T06:30:01.557 INFO:tasks.workunit.client.0.smithi062.stdout:9/615: sync 2024-05-09T06:30:01.557 INFO:tasks.workunit.client.0.smithi062.stdout:3/506: sync 2024-05-09T06:30:01.557 INFO:tasks.workunit.client.0.smithi062.stdout:3/507: rename d1/d1e/d36/d9f to d1/d1e/d36/d9f/d4f/da9 22 2024-05-09T06:30:01.558 INFO:tasks.workunit.client.0.smithi062.stdout:9/616: write d3/d3e/d52/d58/d1c/f87 [1532056,35105] 0 2024-05-09T06:30:01.563 INFO:tasks.workunit.client.0.smithi062.stdout:3/508: dread d1/f1f [0,4194304] 0 2024-05-09T06:30:01.564 INFO:tasks.workunit.client.0.smithi062.stdout:0/622: dread d1/f19 [0,4194304] 0 2024-05-09T06:30:01.564 INFO:tasks.workunit.client.0.smithi062.stdout:0/623: write d1/d25/d49/d42/d43/d54/fba [856941,50657] 0 2024-05-09T06:30:01.564 INFO:tasks.workunit.client.0.smithi062.stdout:0/624: truncate d1/d25/d49/d4f/de6/f1d 2110236 0 2024-05-09T06:30:01.567 INFO:tasks.workunit.client.0.smithi062.stdout:0/625: unlink d1/d25/d31/d6c/d44/d57/d84/fe4 0 2024-05-09T06:30:01.567 INFO:tasks.workunit.client.0.smithi062.stdout:0/626: truncate d1/d25/d49/d4f/de6/f9e 464972 0 2024-05-09T06:30:01.567 INFO:tasks.workunit.client.0.smithi062.stdout:0/627: mknod d1/d25/d31/d6c/ceb 0 2024-05-09T06:30:01.567 INFO:tasks.workunit.client.0.smithi062.stdout:0/628: fdatasync d1/d6a/d6d/d93/d94/fe1 0 2024-05-09T06:30:01.567 INFO:tasks.workunit.client.0.smithi062.stdout:0/629: write d1/d25/d49/d4f/d52/d7b/fd1 [133740,48908] 0 2024-05-09T06:30:01.572 INFO:tasks.workunit.client.0.smithi062.stdout:3/509: dread d1/f1b [0,4194304] 0 2024-05-09T06:30:01.575 INFO:tasks.workunit.client.0.smithi062.stdout:9/617: dwrite d3/d3e/d52/d58/f32 [0,4194304] 0 2024-05-09T06:30:01.575 INFO:tasks.workunit.client.0.smithi062.stdout:9/618: write d3/d3e/d52/d58/d1c/d1e/d60/f73 [3899709,87586] 0 2024-05-09T06:30:01.575 INFO:tasks.workunit.client.0.smithi062.stdout:9/619: fdatasync d3/d3e/d52/d58/d1c/fa9 0 2024-05-09T06:30:01.575 INFO:tasks.workunit.client.0.smithi062.stdout:3/510: mkdir d1/d1e/d36/daa 0 2024-05-09T06:30:01.579 INFO:tasks.workunit.client.0.smithi062.stdout:0/630: write d1/d25/fa4 [793347,62583] 0 2024-05-09T06:30:01.583 INFO:tasks.workunit.client.0.smithi062.stdout:3/511: creat d1/d1e/d26/fab x:0 0 0 2024-05-09T06:30:01.583 INFO:tasks.workunit.client.0.smithi062.stdout:3/512: dread - d1/d1e/d26/d43/fa7 zero size 2024-05-09T06:30:01.583 INFO:tasks.workunit.client.0.smithi062.stdout:3/513: write d1/d1e/d36/d4a/d51/f9b [390965,78635] 0 2024-05-09T06:30:01.583 INFO:tasks.workunit.client.0.smithi062.stdout:3/514: fdatasync d1/d1e/f10 0 2024-05-09T06:30:01.589 INFO:tasks.workunit.client.0.smithi062.stdout:9/620: dwrite d3/d3e/d4b/da2/dad/fbe [0,4194304] 0 2024-05-09T06:30:01.589 INFO:tasks.workunit.client.0.smithi062.stdout:9/621: chown d3/f18 1006307 1 2024-05-09T06:30:01.594 INFO:tasks.workunit.client.0.smithi062.stdout:9/622: mkdir d3/d3e/d52/d58/d1c/d1e/d41/dc5 0 2024-05-09T06:30:01.595 INFO:tasks.workunit.client.0.smithi062.stdout:9/623: read d3/d3e/d52/d58/d1c/d1e/d41/f65 [456718,49519] 0 2024-05-09T06:30:01.595 INFO:tasks.workunit.client.0.smithi062.stdout:9/624: write d3/f6 [4366402,65834] 0 2024-05-09T06:30:01.595 INFO:tasks.workunit.client.0.smithi062.stdout:9/625: truncate d3/d3e/d52/d58/d1c/d1e/d41/f7f 5025436 0 2024-05-09T06:30:01.596 INFO:tasks.workunit.client.0.smithi062.stdout:9/626: symlink d3/d3e/d52/d58/d1c/lc6 0 2024-05-09T06:30:01.596 INFO:tasks.workunit.client.0.smithi062.stdout:9/627: fdatasync d3/d3e/d4b/da2/dad/fbe 0 2024-05-09T06:30:01.601 INFO:tasks.workunit.client.0.smithi062.stdout:9/628: rename d3/d3e/d4b/da2/dad to d3/d20/dc7 0 2024-05-09T06:30:01.602 INFO:tasks.workunit.client.0.smithi062.stdout:9/629: fsync d3/f3c 0 2024-05-09T06:30:01.602 INFO:tasks.workunit.client.0.smithi062.stdout:9/630: chown d3/d3e/d7c/f9c 1 1 2024-05-09T06:30:01.602 INFO:tasks.workunit.client.0.smithi062.stdout:9/631: truncate d3/d3e/d4b/fc3 747588 0 2024-05-09T06:30:01.603 INFO:tasks.workunit.client.0.smithi062.stdout:9/632: mkdir d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/dc8 0 2024-05-09T06:30:01.603 INFO:tasks.workunit.client.0.smithi062.stdout:9/633: write d3/d3e/d52/d58/d1c/fbf [817997,20832] 0 2024-05-09T06:30:01.603 INFO:tasks.workunit.client.0.smithi062.stdout:9/634: write d3/d3e/d52/d58/f71 [1386279,12955] 0 2024-05-09T06:30:01.610 INFO:tasks.workunit.client.0.smithi062.stdout:3/515: dwrite d1/d1e/d36/d3a/d4e/f76 [0,4194304] 0 2024-05-09T06:30:01.611 INFO:tasks.workunit.client.0.smithi062.stdout:3/516: write d1/d1e/d26/f37 [532847,47554] 0 2024-05-09T06:30:01.611 INFO:tasks.workunit.client.0.smithi062.stdout:3/517: write d1/d1e/d36/d3a/f67 [745299,122217] 0 2024-05-09T06:30:01.611 INFO:tasks.workunit.client.0.smithi062.stdout:0/631: dwrite d1/d25/d49/d4f/de6/f35 [0,4194304] 0 2024-05-09T06:30:01.611 INFO:tasks.workunit.client.0.smithi062.stdout:0/632: chown d1/fdd 57 1 2024-05-09T06:30:01.611 INFO:tasks.workunit.client.0.smithi062.stdout:0/633: symlink d1/d25/d31/d6c/d44/d6e/dae/lec 0 2024-05-09T06:30:01.612 INFO:tasks.workunit.client.0.smithi062.stdout:0/634: readlink d1/d6a/d6d/la8 0 2024-05-09T06:30:01.619 INFO:tasks.workunit.client.0.smithi062.stdout:0/635: dread d1/d25/f86 [0,4194304] 0 2024-05-09T06:30:01.622 INFO:tasks.workunit.client.0.smithi062.stdout:9/635: dread d3/d3e/d52/d58/d1c/d1e/d60/f73 [0,4194304] 0 2024-05-09T06:30:01.622 INFO:tasks.workunit.client.0.smithi062.stdout:9/636: chown d3/d3e/d52/d58/d1c/d1e/d41 1 1 2024-05-09T06:30:01.623 INFO:tasks.workunit.client.0.smithi062.stdout:9/637: write d3/d3e/d52/d58/d77/d92/f96 [141026,55167] 0 2024-05-09T06:30:01.629 INFO:tasks.workunit.client.0.smithi062.stdout:0/636: creat d1/d25/d49/d42/fed x:0 0 0 2024-05-09T06:30:01.630 INFO:tasks.workunit.client.0.smithi062.stdout:9/638: rename d3/d3e/d52/d58/c9f to d3/d3e/d4b/db4/cc9 0 2024-05-09T06:30:01.630 INFO:tasks.workunit.client.0.smithi062.stdout:9/639: fsync d3/d3e/d4b/fc0 0 2024-05-09T06:30:01.630 INFO:tasks.workunit.client.0.smithi062.stdout:3/518: dwrite d1/d1e/d26/d43/f9e [0,4194304] 0 2024-05-09T06:30:01.636 INFO:tasks.workunit.client.0.smithi062.stdout:9/640: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/fca x:0 0 0 2024-05-09T06:30:01.636 INFO:tasks.workunit.client.0.smithi062.stdout:9/641: truncate d3/d20/f7a 1020214 0 2024-05-09T06:30:01.638 INFO:tasks.workunit.client.0.smithi062.stdout:0/637: getdents d1/d25/d49/d7e/da6 0 2024-05-09T06:30:01.643 INFO:tasks.workunit.client.0.smithi062.stdout:0/638: mknod d1/d25/d31/d6c/cee 0 2024-05-09T06:30:01.646 INFO:tasks.workunit.client.0.smithi062.stdout:0/639: rename d1/d25/d31/d6c/d44/f4a to d1/d6a/d6d/fef 0 2024-05-09T06:30:01.647 INFO:tasks.workunit.client.0.smithi062.stdout:0/640: write d1/d25/d49/d4f/d52/d7b/fd1 [173064,90727] 0 2024-05-09T06:30:01.647 INFO:tasks.workunit.client.0.smithi062.stdout:0/641: stat d1/d25/d49/d4f/db7 0 2024-05-09T06:30:01.647 INFO:tasks.workunit.client.0.smithi062.stdout:0/642: mkdir d1/d25/d31/d6c/df0 0 2024-05-09T06:30:01.652 INFO:tasks.workunit.client.0.smithi062.stdout:3/519: dwrite d1/d1e/d26/d43/fa7 [0,4194304] 0 2024-05-09T06:30:01.658 INFO:tasks.workunit.client.0.smithi062.stdout:3/520: unlink d1/d1e/d54/c5b 0 2024-05-09T06:30:01.658 INFO:tasks.workunit.client.0.smithi062.stdout:3/521: truncate d1/d48/f57 614261 0 2024-05-09T06:30:01.658 INFO:tasks.workunit.client.0.smithi062.stdout:9/642: dwrite d3/d3e/d52/d58/d1c/f6f [0,4194304] 0 2024-05-09T06:30:01.659 INFO:tasks.workunit.client.0.smithi062.stdout:9/643: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 [0,4194304] 0 2024-05-09T06:30:01.659 INFO:tasks.workunit.client.0.smithi062.stdout:3/522: getdents d1/d1e/d3b/d83 0 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:1/507: sync 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:2/592: sync 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:7/614: sync 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:8/711: sync 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:1/508: chown d8/d1d/f74 24936 1 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:1/509: truncate d8/d14/d2b/d3c/d44/f63 347208 0 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:2/593: write d0/d9/dd/f33 [878693,49284] 0 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:7/615: write d0/d3a/f5f [1107836,114169] 0 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:7/616: chown d0/d12/d33/d9f/fb8 729439222 1 2024-05-09T06:30:01.660 INFO:tasks.workunit.client.0.smithi062.stdout:7/617: write d0/d12/d33/f5e [2009966,117441] 0 2024-05-09T06:30:01.661 INFO:tasks.workunit.client.0.smithi062.stdout:4/673: sync 2024-05-09T06:30:01.661 INFO:tasks.workunit.client.0.smithi062.stdout:1/510: dread d8/d14/d2b/d3c/d44/f63 [0,4194304] 0 2024-05-09T06:30:01.668 INFO:tasks.workunit.client.0.smithi062.stdout:8/712: write da/d11/d2e/d61/f63 [3606378,88273] 0 2024-05-09T06:30:01.668 INFO:tasks.workunit.client.0.smithi062.stdout:8/713: chown da/f6c 579225812 1 2024-05-09T06:30:01.671 INFO:tasks.workunit.client.0.smithi062.stdout:0/643: dwrite d1/d25/d31/d6c/d44/d6e/dae/fd3 [0,4194304] 0 2024-05-09T06:30:01.672 INFO:tasks.workunit.client.0.smithi062.stdout:9/644: rename d3/d3e/d52/d58/d1c/c8f to d3/d20/ccb 0 2024-05-09T06:30:01.673 INFO:tasks.workunit.client.0.smithi062.stdout:2/594: mkdir d0/d9/d38/d41/db1/dba/dbd 0 2024-05-09T06:30:01.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/618: getdents d0/d12/d66/d9b 0 2024-05-09T06:30:01.676 INFO:tasks.workunit.client.0.smithi062.stdout:7/619: fdatasync d0/d12/d33/f46 0 2024-05-09T06:30:01.677 INFO:tasks.workunit.client.0.smithi062.stdout:1/511: creat d8/d14/d2b/d9d/faf x:0 0 0 2024-05-09T06:30:01.679 INFO:tasks.workunit.client.0.smithi062.stdout:3/523: dwrite d1/d1e/d36/d4a/f68 [0,4194304] 0 2024-05-09T06:30:01.679 INFO:tasks.workunit.client.0.smithi062.stdout:4/674: dread d0/f7f [0,4194304] 0 2024-05-09T06:30:01.679 INFO:tasks.workunit.client.0.smithi062.stdout:3/524: write d1/d1e/d36/d9f/d4f/f6f [529500,48954] 0 2024-05-09T06:30:01.679 INFO:tasks.workunit.client.0.smithi062.stdout:3/525: write d1/f9d [128839,5623] 0 2024-05-09T06:30:01.680 INFO:tasks.workunit.client.0.smithi062.stdout:7/620: dread d0/f1e [0,4194304] 0 2024-05-09T06:30:01.680 INFO:tasks.workunit.client.0.smithi062.stdout:8/714: creat da/d11/d1c/de0/fe6 x:0 0 0 2024-05-09T06:30:01.684 INFO:tasks.workunit.client.0.smithi062.stdout:5/770: sync 2024-05-09T06:30:01.684 INFO:tasks.workunit.client.0.smithi062.stdout:6/727: sync 2024-05-09T06:30:01.684 INFO:tasks.workunit.client.0.smithi062.stdout:6/728: stat dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74 0 2024-05-09T06:30:01.687 INFO:tasks.workunit.client.0.smithi062.stdout:0/644: creat d1/d25/d31/d6c/d44/d57/d75/ff1 x:0 0 0 2024-05-09T06:30:01.687 INFO:tasks.workunit.client.0.smithi062.stdout:0/645: chown d1/d25/d49/d4f/d52/l5a 37770222 1 2024-05-09T06:30:01.687 INFO:tasks.workunit.client.0.smithi062.stdout:0/646: stat d1/d25 0 2024-05-09T06:30:01.694 INFO:tasks.workunit.client.0.smithi062.stdout:9/645: unlink d3/d3e/d52/d58/f48 0 2024-05-09T06:30:01.694 INFO:tasks.workunit.client.0.smithi062.stdout:9/646: creat d3/d3e/d4b/da2/fcc x:0 0 0 2024-05-09T06:30:01.695 INFO:tasks.workunit.client.0.smithi062.stdout:2/595: creat d0/d9/dd/d65/d6d/d7e/d8d/fbe x:0 0 0 2024-05-09T06:30:01.697 INFO:tasks.workunit.client.0.smithi062.stdout:1/512: mkdir d8/d14/d2b/d3c/db0 0 2024-05-09T06:30:01.698 INFO:tasks.workunit.client.0.smithi062.stdout:3/526: dwrite d1/d1e/fa2 [0,4194304] 0 2024-05-09T06:30:01.701 INFO:tasks.workunit.client.0.smithi062.stdout:4/675: mkdir d0/d2a/d14/d4f/d6b/dca 0 2024-05-09T06:30:01.703 INFO:tasks.workunit.client.0.smithi062.stdout:7/621: chown d0/d3a/f7b 466069 1 2024-05-09T06:30:01.703 INFO:tasks.workunit.client.0.smithi062.stdout:6/729: write dc/f5e [2552716,104741] 0 2024-05-09T06:30:01.704 INFO:tasks.workunit.client.0.smithi062.stdout:6/730: write dc/d28/d10/f1c [1716172,114343] 0 2024-05-09T06:30:01.705 INFO:tasks.workunit.client.0.smithi062.stdout:8/715: mknod da/d11/d1c/d9e/d9f/db8/ce7 0 2024-05-09T06:30:01.706 INFO:tasks.workunit.client.0.smithi062.stdout:0/647: symlink d1/d25/d49/d42/dad/dbe/lf2 0 2024-05-09T06:30:01.706 INFO:tasks.workunit.client.0.smithi062.stdout:0/648: dread - d1/d25/d49/d7e/da6/fe8 zero size 2024-05-09T06:30:01.713 INFO:tasks.workunit.client.0.smithi062.stdout:9/647: mkdir d3/d20/dc7/dcd 0 2024-05-09T06:30:01.715 INFO:tasks.workunit.client.0.smithi062.stdout:2/596: creat d0/d9/d38/fbf x:0 0 0 2024-05-09T06:30:01.721 INFO:tasks.workunit.client.0.smithi062.stdout:3/527: creat d1/d1e/d36/d3a/fac x:0 0 0 2024-05-09T06:30:01.723 INFO:tasks.workunit.client.0.smithi062.stdout:7/622: rmdir d0/d12/d33 39 2024-05-09T06:30:01.724 INFO:tasks.workunit.client.0.smithi062.stdout:6/731: getdents dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def 0 2024-05-09T06:30:01.726 INFO:tasks.workunit.client.0.smithi062.stdout:0/649: dwrite d1/d25/d49/d4f/d52/d87/fa3 [0,4194304] 0 2024-05-09T06:30:01.726 INFO:tasks.workunit.client.0.smithi062.stdout:1/513: dwrite f5 [4194304,4194304] 0 2024-05-09T06:30:01.726 INFO:tasks.workunit.client.0.smithi062.stdout:0/650: chown d1/d25/d31/d6c/d44/d57/db4/ld9 906 1 2024-05-09T06:30:01.726 INFO:tasks.workunit.client.0.smithi062.stdout:1/514: dread - d8/d14/d2b/d9d/faf zero size 2024-05-09T06:30:01.726 INFO:tasks.workunit.client.0.smithi062.stdout:0/651: dread - d1/d6a/d6d/fd8 zero size 2024-05-09T06:30:01.727 INFO:tasks.workunit.client.0.smithi062.stdout:9/648: dread d3/f84 [0,4194304] 0 2024-05-09T06:30:01.727 INFO:tasks.workunit.client.0.smithi062.stdout:8/716: link da/f28 da/d11/d2e/d34/dd4/dbb/fe8 0 2024-05-09T06:30:01.728 INFO:tasks.workunit.client.0.smithi062.stdout:3/528: mkdir d1/d1e/d26/d43/d52/d6a/dad 0 2024-05-09T06:30:01.729 INFO:tasks.workunit.client.0.smithi062.stdout:1/515: write d8/d14/d2b/d3c/d44/f4a [847180,34630] 0 2024-05-09T06:30:01.729 INFO:tasks.workunit.client.0.smithi062.stdout:1/516: dread - d8/d1d/d70/faa zero size 2024-05-09T06:30:01.730 INFO:tasks.workunit.client.0.smithi062.stdout:2/597: dread d0/d9/dd/d65/d6d/d21/f28 [0,4194304] 0 2024-05-09T06:30:01.738 INFO:tasks.workunit.client.0.smithi062.stdout:6/732: dread dc/d28/f11 [4194304,4194304] 0 2024-05-09T06:30:01.739 INFO:tasks.workunit.client.0.smithi062.stdout:0/652: dread d1/f2c [0,4194304] 0 2024-05-09T06:30:01.747 INFO:tasks.workunit.client.0.smithi062.stdout:3/529: symlink d1/d1e/d36/d4a/lae 0 2024-05-09T06:30:01.748 INFO:tasks.workunit.client.0.smithi062.stdout:1/517: rename d8/d14/d2b/d3c/d44/fab to d8/d14/d2b/d3c/db0/fb1 0 2024-05-09T06:30:01.749 INFO:tasks.workunit.client.0.smithi062.stdout:1/518: chown d8/d14/d2b 198800513 1 2024-05-09T06:30:01.750 INFO:tasks.workunit.client.0.smithi062.stdout:7/623: mknod d0/d3a/d3f/ccb 0 2024-05-09T06:30:01.751 INFO:tasks.workunit.client.0.smithi062.stdout:2/598: truncate d0/d9/dd/f5e 3889622 0 2024-05-09T06:30:01.752 INFO:tasks.workunit.client.0.smithi062.stdout:9/649: dwrite d3/d3e/d52/fbd [0,4194304] 0 2024-05-09T06:30:01.753 INFO:tasks.workunit.client.0.smithi062.stdout:6/733: creat dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/df8/ff9 x:0 0 0 2024-05-09T06:30:01.753 INFO:tasks.workunit.client.0.smithi062.stdout:6/734: readlink dc/d28/d10/d20/db5/l53 0 2024-05-09T06:30:01.754 INFO:tasks.workunit.client.0.smithi062.stdout:8/717: dwrite da/d11/f17 [0,4194304] 0 2024-05-09T06:30:01.756 INFO:tasks.workunit.client.0.smithi062.stdout:0/653: rename d1/f17 to d1/d25/d31/d6c/d44/ff3 0 2024-05-09T06:30:01.757 INFO:tasks.workunit.client.0.smithi062.stdout:1/519: write d8/d14/d2b/d3d/f71 [923129,28313] 0 2024-05-09T06:30:01.757 INFO:tasks.workunit.client.0.smithi062.stdout:1/520: getdents d8/d14/d2b/d3c/da5 0 2024-05-09T06:30:01.759 INFO:tasks.workunit.client.0.smithi062.stdout:2/599: getdents d0/d9/d38/d41/d8a 0 2024-05-09T06:30:01.759 INFO:tasks.workunit.client.0.smithi062.stdout:2/600: write d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f9a [2289754,81485] 0 2024-05-09T06:30:01.759 INFO:tasks.workunit.client.0.smithi062.stdout:2/601: chown d0/d9/d38/cbb 3099 1 2024-05-09T06:30:01.759 INFO:tasks.workunit.client.0.smithi062.stdout:9/650: dread d3/d3e/d52/d58/d1c/f87 [0,4194304] 0 2024-05-09T06:30:01.760 INFO:tasks.workunit.client.0.smithi062.stdout:1/521: dread d8/d14/d2b/d3c/d7d/f87 [0,4194304] 0 2024-05-09T06:30:01.760 INFO:tasks.workunit.client.0.smithi062.stdout:3/530: write d1/d1e/d26/f3c [139262,86757] 0 2024-05-09T06:30:01.761 INFO:tasks.workunit.client.0.smithi062.stdout:7/624: dread d0/f77 [0,4194304] 0 2024-05-09T06:30:01.761 INFO:tasks.workunit.client.0.smithi062.stdout:7/625: creat d0/d3a/d51/d64/d6d/d80/d8e/fcc x:0 0 0 2024-05-09T06:30:01.767 INFO:tasks.workunit.client.0.smithi062.stdout:6/735: mknod dc/d28/d46/d3a/d7f/d91/d93/dc0/cfa 0 2024-05-09T06:30:01.767 INFO:tasks.workunit.client.0.smithi062.stdout:6/736: chown dc/l1f 161741467 1 2024-05-09T06:30:01.769 INFO:tasks.workunit.client.0.smithi062.stdout:0/654: mkdir d1/d25/d49/d4f/d52/d87/dc8/df4 0 2024-05-09T06:30:01.775 INFO:tasks.workunit.client.0.smithi062.stdout:0/655: read d1/d25/d31/db5/fcd [58409,39588] 0 2024-05-09T06:30:01.775 INFO:tasks.workunit.client.0.smithi062.stdout:9/651: link d3/d3e/d52/d58/d1c/d1e/c88 d3/d3e/d52/d58/d1c/d21/cce 0 2024-05-09T06:30:01.777 INFO:tasks.workunit.client.0.smithi062.stdout:3/531: dread d1/d48/f4c [0,4194304] 0 2024-05-09T06:30:01.777 INFO:tasks.workunit.client.0.smithi062.stdout:8/718: dwrite da/d11/d2e/d34/f7b [0,4194304] 0 2024-05-09T06:30:01.780 INFO:tasks.workunit.client.0.smithi062.stdout:9/652: dread d3/d3e/d4b/f51 [0,4194304] 0 2024-05-09T06:30:01.782 INFO:tasks.workunit.client.0.smithi062.stdout:6/737: rmdir dc/d28/d46/d3a/d7f/d91/d93/dc0 39 2024-05-09T06:30:01.787 INFO:tasks.workunit.client.0.smithi062.stdout:0/656: mkdir d1/d25/d31/d6c/df5 0 2024-05-09T06:30:01.787 INFO:tasks.workunit.client.0.smithi062.stdout:0/657: fdatasync d1/d25/d31/f33 0 2024-05-09T06:30:01.794 INFO:tasks.workunit.client.0.smithi062.stdout:8/719: creat da/d11/d2e/d34/dd4/fe9 x:0 0 0 2024-05-09T06:30:01.796 INFO:tasks.workunit.client.0.smithi062.stdout:9/653: mknod d3/d3e/d52/ccf 0 2024-05-09T06:30:01.798 INFO:tasks.workunit.client.0.smithi062.stdout:9/654: dread d3/d3e/d52/d58/d1c/f87 [0,4194304] 0 2024-05-09T06:30:01.799 INFO:tasks.workunit.client.0.smithi062.stdout:9/655: readlink d3/d3e/d52/d58/d1c/d1e/d60/l82 0 2024-05-09T06:30:01.802 INFO:tasks.workunit.client.0.smithi062.stdout:6/738: dwrite dc/d28/d10/d20/f31 [0,4194304] 0 2024-05-09T06:30:01.803 INFO:tasks.workunit.client.0.smithi062.stdout:1/522: dwrite d8/d14/f5e [0,4194304] 0 2024-05-09T06:30:01.803 INFO:tasks.workunit.client.0.smithi062.stdout:7/626: dwrite d0/d12/f71 [0,4194304] 0 2024-05-09T06:30:01.811 INFO:tasks.workunit.client.0.smithi062.stdout:6/739: dread dc/d28/d46/d3a/d7f/d91/d93/dc0/f4d [0,4194304] 0 2024-05-09T06:30:01.811 INFO:tasks.workunit.client.0.smithi062.stdout:6/740: getdents dc/d28/d46/d3a/d7f/d91/d93/dc0/d70 0 2024-05-09T06:30:01.811 INFO:tasks.workunit.client.0.smithi062.stdout:6/741: fdatasync dc/d28/fcb 0 2024-05-09T06:30:01.816 INFO:tasks.workunit.client.0.smithi062.stdout:1/523: read d8/f49 [1514071,16271] 0 2024-05-09T06:30:01.821 INFO:tasks.workunit.client.0.smithi062.stdout:7/627: dwrite d0/d3/f17 [0,4194304] 0 2024-05-09T06:30:01.822 INFO:tasks.workunit.client.0.smithi062.stdout:6/742: dread dc/d28/d34/d39/dee/ff6 [0,4194304] 0 2024-05-09T06:30:01.822 INFO:tasks.workunit.client.0.smithi062.stdout:6/743: dread - dc/d28/d46/d4a/d5d/d6f/d76/fdc zero size 2024-05-09T06:30:01.822 INFO:tasks.workunit.client.0.smithi062.stdout:6/744: fsync dc/d28/d46/d4a/d5d/fca 0 2024-05-09T06:30:01.871 INFO:tasks.workunit.client.0.smithi062.stdout:9/656: mkdir d3/d3e/d52/d58/d1c/d1e/d41/d64/dd0 0 2024-05-09T06:30:01.871 INFO:tasks.workunit.client.0.smithi062.stdout:9/657: fdatasync d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f78 0 2024-05-09T06:30:01.883 INFO:tasks.workunit.client.0.smithi062.stdout:1/524: mknod d8/d14/d2b/d3c/db0/cb2 0 2024-05-09T06:30:01.883 INFO:tasks.workunit.client.0.smithi062.stdout:1/525: fsync d8/d1d/f58 0 2024-05-09T06:30:01.887 INFO:tasks.workunit.client.0.smithi062.stdout:7/628: truncate d0/f5c 2060742 0 2024-05-09T06:30:01.887 INFO:tasks.workunit.client.0.smithi062.stdout:6/745: symlink dc/d28/d34/db0/lfb 0 2024-05-09T06:30:01.891 INFO:tasks.workunit.client.0.smithi062.stdout:9/658: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/dd0/fd1 x:0 0 0 2024-05-09T06:30:01.893 INFO:tasks.workunit.client.0.smithi062.stdout:6/746: rename dc/d28/d46/d3a/d7f/d91/fea to dc/d28/d46/d4a/ffc 0 2024-05-09T06:30:01.894 INFO:tasks.workunit.client.0.smithi062.stdout:9/659: link d3/d3e/d52/d58/d1c/d1e/d60/cac d3/d20/dc7/cd2 0 2024-05-09T06:30:01.897 INFO:tasks.workunit.client.0.smithi062.stdout:9/660: rename d3/d3e/d52/d58/d77/d92/f70 to d3/d3e/d52/d58/fd3 0 2024-05-09T06:30:01.897 INFO:tasks.workunit.client.0.smithi062.stdout:7/629: write d0/f6e [2672024,104320] 0 2024-05-09T06:30:01.901 INFO:tasks.workunit.client.0.smithi062.stdout:7/630: rename d0/d12/d66/d9b to d0/d12/d33/d67/da7/dcd 0 2024-05-09T06:30:01.904 INFO:tasks.workunit.client.0.smithi062.stdout:9/661: dread d3/f75 [0,4194304] 0 2024-05-09T06:30:01.907 INFO:tasks.workunit.client.0.smithi062.stdout:8/720: rename da/d11 to da/dea 0 2024-05-09T06:30:01.907 INFO:tasks.workunit.client.0.smithi062.stdout:8/721: read da/dea/d1c/f4a [36622,120011] 0 2024-05-09T06:30:01.910 INFO:tasks.workunit.client.0.smithi062.stdout:1/526: dwrite d8/d1d/f58 [0,4194304] 0 2024-05-09T06:30:01.910 INFO:tasks.workunit.client.0.smithi062.stdout:1/527: dread - d8/d14/d2b/d3c/d44/d6e/d7a/fa6 zero size 2024-05-09T06:30:01.910 INFO:tasks.workunit.client.0.smithi062.stdout:6/747: dwrite dc/d28/d46/d3a/d7f/d91/d93/dc0/f69 [0,4194304] 0 2024-05-09T06:30:01.910 INFO:tasks.workunit.client.0.smithi062.stdout:9/662: unlink d3/d3e/d4b/da2/fcc 0 2024-05-09T06:30:01.910 INFO:tasks.workunit.client.0.smithi062.stdout:9/663: write d3/d3e/d4b/fc0 [59075,38877] 0 2024-05-09T06:30:01.911 INFO:tasks.workunit.client.0.smithi062.stdout:7/631: dread d0/d12/d33/f3b [0,4194304] 0 2024-05-09T06:30:01.913 INFO:tasks.workunit.client.0.smithi062.stdout:8/722: unlink da/dea/d1c/d9e/d9f/da7/fd8 0 2024-05-09T06:30:01.918 INFO:tasks.workunit.client.0.smithi062.stdout:1/528: link d8/d14/d2b/d3c/d7d/c82 d8/d14/d2b/cb3 0 2024-05-09T06:30:01.918 INFO:tasks.workunit.client.0.smithi062.stdout:1/529: write d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 [1046913,128129] 0 2024-05-09T06:30:01.921 INFO:tasks.workunit.client.0.smithi062.stdout:6/748: symlink dc/d28/d10/d20/d5b/d77/lfd 0 2024-05-09T06:30:01.923 INFO:tasks.workunit.client.0.smithi062.stdout:7/632: mknod d0/d12/cce 0 2024-05-09T06:30:01.923 INFO:tasks.workunit.client.0.smithi062.stdout:7/633: write d0/f6e [410470,23432] 0 2024-05-09T06:30:01.927 INFO:tasks.workunit.client.0.smithi062.stdout:8/723: creat da/dea/d2e/d61/d64/feb x:0 0 0 2024-05-09T06:30:01.928 INFO:tasks.workunit.client.0.smithi062.stdout:6/749: creat dc/d28/d34/db0/ffe x:0 0 0 2024-05-09T06:30:01.928 INFO:tasks.workunit.client.0.smithi062.stdout:6/750: readlink dc/d28/d46/d4a/d5d/d6f/l7d 0 2024-05-09T06:30:01.931 INFO:tasks.workunit.client.0.smithi062.stdout:7/634: symlink d0/d12/d66/lcf 0 2024-05-09T06:30:01.934 INFO:tasks.workunit.client.0.smithi062.stdout:6/751: rename dc/d28/d46/d3a/l54 to dc/d28/d34/d39/dee/lff 0 2024-05-09T06:30:01.935 INFO:tasks.workunit.client.0.smithi062.stdout:9/664: dwrite d3/d3e/d52/d58/d77/d92/f9e [0,4194304] 0 2024-05-09T06:30:01.935 INFO:tasks.workunit.client.0.smithi062.stdout:1/530: dwrite d8/d1d/d70/faa [0,4194304] 0 2024-05-09T06:30:01.936 INFO:tasks.workunit.client.0.smithi062.stdout:1/531: dread - d8/d14/d2b/d3c/d44/d38/f39 zero size 2024-05-09T06:30:01.938 INFO:tasks.workunit.client.0.smithi062.stdout:7/635: creat d0/d3a/d51/d64/d6d/fd0 x:0 0 0 2024-05-09T06:30:01.940 INFO:tasks.workunit.client.0.smithi062.stdout:9/665: symlink d3/d3e/d52/d58/d1c/d1e/d41/d64/ld4 0 2024-05-09T06:30:01.943 INFO:tasks.workunit.client.0.smithi062.stdout:7/636: mknod d0/d12/d33/d9f/cd1 0 2024-05-09T06:30:01.943 INFO:tasks.workunit.client.0.smithi062.stdout:7/637: chown d0/d12/d33/c9d 10195262 1 2024-05-09T06:30:01.943 INFO:tasks.workunit.client.0.smithi062.stdout:7/638: fsync d0/f6e 0 2024-05-09T06:30:01.946 INFO:tasks.workunit.client.0.smithi062.stdout:6/752: dread dc/d28/d10/d20/d5b/d77/ff5 [0,4194304] 0 2024-05-09T06:30:01.946 INFO:tasks.workunit.client.0.smithi062.stdout:6/753: fdatasync dc/d28/d10/d20/f32 0 2024-05-09T06:30:01.946 INFO:tasks.workunit.client.0.smithi062.stdout:9/666: mkdir d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5 0 2024-05-09T06:30:01.946 INFO:tasks.workunit.client.0.smithi062.stdout:6/754: write dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/fc1 [878618,15663] 0 2024-05-09T06:30:01.946 INFO:tasks.workunit.client.0.smithi062.stdout:6/755: chown dc/d28/d46/d4a/d5d/fca 44526 1 2024-05-09T06:30:01.947 INFO:tasks.workunit.client.0.smithi062.stdout:6/756: dread - dc/d28/d34/db0/ffe zero size 2024-05-09T06:30:01.947 INFO:tasks.workunit.client.0.smithi062.stdout:6/757: readlink dc/d28/d46/d4a/la2 0 2024-05-09T06:30:01.947 INFO:tasks.workunit.client.0.smithi062.stdout:8/724: dwrite da/dea/d1c/d9e/d9f/db8/fcf [0,4194304] 0 2024-05-09T06:30:01.948 INFO:tasks.workunit.client.0.smithi062.stdout:7/639: mknod d0/d3a/d69/cd2 0 2024-05-09T06:30:01.949 INFO:tasks.workunit.client.0.smithi062.stdout:6/758: symlink dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/l100 0 2024-05-09T06:30:01.949 INFO:tasks.workunit.client.0.smithi062.stdout:1/532: dread f5 [0,4194304] 0 2024-05-09T06:30:01.951 INFO:tasks.workunit.client.0.smithi062.stdout:8/725: symlink da/dea/d2e/d61/lec 0 2024-05-09T06:30:01.951 INFO:tasks.workunit.client.0.smithi062.stdout:7/640: creat d0/d12/d33/d67/da7/dcd/fd3 x:0 0 0 2024-05-09T06:30:01.952 INFO:tasks.workunit.client.0.smithi062.stdout:7/641: dread - d0/d3a/d51/d64/d6d/d80/d8e/fcc zero size 2024-05-09T06:30:01.952 INFO:tasks.workunit.client.0.smithi062.stdout:7/642: creat d0/d3a/d51/d64/d6d/d80/d8e/fd4 x:0 0 0 2024-05-09T06:30:01.953 INFO:tasks.workunit.client.0.smithi062.stdout:1/533: unlink d8/d14/d2b/d3c/d44/d6e/d7a/c8b 0 2024-05-09T06:30:01.957 INFO:tasks.workunit.client.0.smithi062.stdout:8/726: creat da/d77/fed x:0 0 0 2024-05-09T06:30:01.957 INFO:tasks.workunit.client.0.smithi062.stdout:8/727: chown da/dea/d2e/d61/d64/c93 65 1 2024-05-09T06:30:01.959 INFO:tasks.workunit.client.0.smithi062.stdout:6/759: dread dc/d28/d10/d20/fb9 [0,4194304] 0 2024-05-09T06:30:01.960 INFO:tasks.workunit.client.0.smithi062.stdout:7/643: creat d0/d12/d33/d67/da7/fd5 x:0 0 0 2024-05-09T06:30:01.961 INFO:tasks.workunit.client.0.smithi062.stdout:1/534: mkdir d8/d1d/d9c/db4 0 2024-05-09T06:30:01.964 INFO:tasks.workunit.client.0.smithi062.stdout:6/760: rmdir dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/dde 0 2024-05-09T06:30:01.965 INFO:tasks.workunit.client.0.smithi062.stdout:6/761: getdents dc/d28/d46/d3a/d7f/d8e/dc8 0 2024-05-09T06:30:01.966 INFO:tasks.workunit.client.0.smithi062.stdout:9/667: dwrite d3/d3e/d52/d58/f6b [0,4194304] 0 2024-05-09T06:30:01.970 INFO:tasks.workunit.client.0.smithi062.stdout:9/668: mknod d3/d20/cd6 0 2024-05-09T06:30:01.972 INFO:tasks.workunit.client.0.smithi062.stdout:9/669: mknod d3/d3e/d52/d58/d1c/d1e/d41/d64/cd7 0 2024-05-09T06:30:01.975 INFO:tasks.workunit.client.0.smithi062.stdout:6/762: dread dc/d28/d46/d3a/f4f [0,4194304] 0 2024-05-09T06:30:01.976 INFO:tasks.workunit.client.0.smithi062.stdout:6/763: dread dc/d28/d46/d4a/f6b [4194304,4194304] 0 2024-05-09T06:30:01.980 INFO:tasks.workunit.client.0.smithi062.stdout:6/764: rename dc/d28/d46/d4a/d5d/d6f/d76/f87 to dc/d28/d46/d81/dad/f101 0 2024-05-09T06:30:01.981 INFO:tasks.workunit.client.0.smithi062.stdout:8/728: dwrite da/dea/d2e/f70 [0,4194304] 0 2024-05-09T06:30:01.988 INFO:tasks.workunit.client.0.smithi062.stdout:8/729: truncate da/dea/d2e/d34/fb4 8265168 0 2024-05-09T06:30:01.990 INFO:tasks.workunit.client.0.smithi062.stdout:8/730: truncate da/dea/d2e/d34/dd4/fcd 3792530 0 2024-05-09T06:30:01.990 INFO:tasks.workunit.client.0.smithi062.stdout:8/731: chown da/dea/l80 64560 1 2024-05-09T06:30:01.990 INFO:tasks.workunit.client.0.smithi062.stdout:8/732: write f7 [4856126,14463] 0 2024-05-09T06:30:01.992 INFO:tasks.workunit.client.0.smithi062.stdout:8/733: mknod da/dea/d2e/d61/d92/da5/db2/cee 0 2024-05-09T06:30:01.998 INFO:tasks.workunit.client.0.smithi062.stdout:9/670: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 [0,4194304] 0 2024-05-09T06:30:01.998 INFO:tasks.workunit.client.0.smithi062.stdout:7/644: dwrite d0/d3a/d51/f6c [0,4194304] 0 2024-05-09T06:30:02.000 INFO:tasks.workunit.client.0.smithi062.stdout:6/765: dwrite dc/d28/d34/fdd [0,4194304] 0 2024-05-09T06:30:02.002 INFO:tasks.workunit.client.0.smithi062.stdout:9/671: truncate d3/d3e/d52/d58/d1c/d1e/f5f 2623684 0 2024-05-09T06:30:02.007 INFO:tasks.workunit.client.0.smithi062.stdout:8/734: dread da/dea/d2e/d34/d90/fa3 [0,4194304] 0 2024-05-09T06:30:02.007 INFO:tasks.workunit.client.0.smithi062.stdout:8/735: write da/dea/d2e/d34/f44 [1365358,46663] 0 2024-05-09T06:30:02.011 INFO:tasks.workunit.client.0.smithi062.stdout:7/645: symlink d0/d3a/d51/d64/d6d/d80/ld6 0 2024-05-09T06:30:02.020 INFO:tasks.workunit.client.0.smithi062.stdout:7/646: mkdir d0/d3a/d51/d64/d6d/d88/dc7/dd7 0 2024-05-09T06:30:02.020 INFO:tasks.workunit.client.0.smithi062.stdout:7/647: fsync d0/d12/d33/d67/f6a 0 2024-05-09T06:30:02.020 INFO:tasks.workunit.client.0.smithi062.stdout:7/648: write d0/d3a/d51/d64/d6d/f90 [4498381,111026] 0 2024-05-09T06:30:02.029 INFO:tasks.workunit.client.0.smithi062.stdout:8/736: dwrite da/fc7 [0,4194304] 0 2024-05-09T06:30:02.034 INFO:tasks.workunit.client.0.smithi062.stdout:7/649: write d0/f20 [6290928,60596] 0 2024-05-09T06:30:02.036 INFO:tasks.workunit.client.0.smithi062.stdout:8/737: creat da/dea/d2e/fef x:0 0 0 2024-05-09T06:30:02.069 INFO:tasks.workunit.client.0.smithi062.stdout:7/650: dwrite d0/f92 [0,4194304] 0 2024-05-09T06:30:02.069 INFO:tasks.workunit.client.0.smithi062.stdout:8/738: dwrite da/dea/f89 [0,4194304] 0 2024-05-09T06:30:02.069 INFO:tasks.workunit.client.0.smithi062.stdout:7/651: truncate d0/d12/d33/d67/da7/dcd/fd3 49806 0 2024-05-09T06:30:02.080 INFO:tasks.workunit.client.0.smithi062.stdout:7/652: dread d0/f8 [0,4194304] 0 2024-05-09T06:30:02.081 INFO:tasks.workunit.client.0.smithi062.stdout:6/766: rename dc/d28/d46/d81/dad to dc/d28/d34/d4e/d57/d102 0 2024-05-09T06:30:02.086 INFO:tasks.workunit.client.0.smithi062.stdout:9/672: rename d3/f18 to d3/d20/dc7/fd8 0 2024-05-09T06:30:02.087 INFO:tasks.workunit.client.0.smithi062.stdout:9/673: stat d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/fca 0 2024-05-09T06:30:02.088 INFO:tasks.workunit.client.0.smithi062.stdout:6/767: mkdir dc/d28/d10/d103 0 2024-05-09T06:30:02.088 INFO:tasks.workunit.client.0.smithi062.stdout:6/768: read - dc/d28/d46/d4a/ffc zero size 2024-05-09T06:30:02.090 INFO:tasks.workunit.client.0.smithi062.stdout:9/674: rename d3/f19 to d3/d3e/d52/d58/d1c/d1e/d41/fd9 0 2024-05-09T06:30:02.091 INFO:tasks.workunit.client.0.smithi062.stdout:9/675: creat d3/d3e/d52/d58/d1c/d1e/d41/fda x:0 0 0 2024-05-09T06:30:02.091 INFO:tasks.workunit.client.0.smithi062.stdout:9/676: fdatasync d3/d3e/d4b/fc3 0 2024-05-09T06:30:02.092 INFO:tasks.workunit.client.0.smithi062.stdout:9/677: creat d3/d3e/d52/d58/d77/d92/fdb x:0 0 0 2024-05-09T06:30:02.093 INFO:tasks.workunit.client.0.smithi062.stdout:9/678: rename d3/d3e/d52/d58/d1c/d21/fb5 to d3/d3e/d52/d58/d1c/d1e/d60/fdc 0 2024-05-09T06:30:02.093 INFO:tasks.workunit.client.0.smithi062.stdout:9/679: rename d3/d3e/d52/d58/d1c to d3/d3e/d52/d58/d1c/d1e/d41/d64/ddd 22 2024-05-09T06:30:02.094 INFO:tasks.workunit.client.0.smithi062.stdout:9/680: write d3/d20/f7a [381169,29996] 0 2024-05-09T06:30:02.095 INFO:tasks.workunit.client.0.smithi062.stdout:9/681: stat d3/d3e/f61 0 2024-05-09T06:30:02.107 INFO:tasks.workunit.client.0.smithi062.stdout:5/771: sync 2024-05-09T06:30:02.107 INFO:tasks.workunit.client.0.smithi062.stdout:5/772: write d0/d8/d1c/f22 [1628144,94290] 0 2024-05-09T06:30:02.107 INFO:tasks.workunit.client.0.smithi062.stdout:5/773: read - d0/d8/d1c/d23/d42/faa zero size 2024-05-09T06:30:02.110 INFO:tasks.workunit.client.0.smithi062.stdout:5/774: creat d0/d8/d47/dbe/d45/da5/ff9 x:0 0 0 2024-05-09T06:30:02.119 INFO:tasks.workunit.client.0.smithi062.stdout:5/775: creat d0/d3b/d3f/ffa x:0 0 0 2024-05-09T06:30:02.123 INFO:tasks.workunit.client.0.smithi062.stdout:2/602: sync 2024-05-09T06:30:02.124 INFO:tasks.workunit.client.0.smithi062.stdout:4/676: sync 2024-05-09T06:30:02.124 INFO:tasks.workunit.client.0.smithi062.stdout:2/603: fsync d0/d9/d38/d41/d53/f61 0 2024-05-09T06:30:02.124 INFO:tasks.workunit.client.0.smithi062.stdout:2/604: fsync d0/d9/d38/d41/d53/f99 0 2024-05-09T06:30:02.124 INFO:tasks.workunit.client.0.smithi062.stdout:5/776: dread d0/f79 [0,4194304] 0 2024-05-09T06:30:02.129 INFO:tasks.workunit.client.0.smithi062.stdout:4/677: creat d0/d2a/d1f/dc9/da0/fcb x:0 0 0 2024-05-09T06:30:02.133 INFO:tasks.workunit.client.0.smithi062.stdout:5/777: rename d0/d8/d47/dbe/d45/ld8 to d0/d8/d1c/d2c/d7d/lfb 0 2024-05-09T06:30:02.135 INFO:tasks.workunit.client.0.smithi062.stdout:5/778: link d0/d8/d47/dbe/d5/l26 d0/lfc 0 2024-05-09T06:30:02.137 INFO:tasks.workunit.client.0.smithi062.stdout:5/779: truncate d0/d8/f95 266329 0 2024-05-09T06:30:02.139 INFO:tasks.workunit.client.0.smithi062.stdout:5/780: creat d0/d8/d47/dbe/d86/da4/ffd x:0 0 0 2024-05-09T06:30:02.139 INFO:tasks.workunit.client.0.smithi062.stdout:4/678: read d0/d2a/d14/d7e/d8e/d9e/d28/f41 [2180547,117736] 0 2024-05-09T06:30:02.142 INFO:tasks.workunit.client.0.smithi062.stdout:2/605: dwrite d0/d9/d17/f73 [0,4194304] 0 2024-05-09T06:30:02.142 INFO:tasks.workunit.client.0.smithi062.stdout:2/606: truncate d0/fa2 371015 0 2024-05-09T06:30:02.153 INFO:tasks.workunit.client.0.smithi062.stdout:2/607: read d0/d9/dd/d65/d6d/f56 [499303,93061] 0 2024-05-09T06:30:02.153 INFO:tasks.workunit.client.0.smithi062.stdout:2/608: chown d0/d9/dd/d65/d6d/d96/fb3 7046 1 2024-05-09T06:30:02.153 INFO:tasks.workunit.client.0.smithi062.stdout:2/609: mknod d0/d9/d38/d41/d48/cc0 0 2024-05-09T06:30:02.180 INFO:tasks.workunit.client.0.smithi062.stdout:5/781: dwrite d0/d8/d1c/ff7 [0,4194304] 0 2024-05-09T06:30:02.180 INFO:tasks.workunit.client.0.smithi062.stdout:2/610: dwrite d0/d9/dd/d65/fb4 [0,4194304] 0 2024-05-09T06:30:02.180 INFO:tasks.workunit.client.0.smithi062.stdout:2/611: truncate d0/d9/d17/f1d 4687673 0 2024-05-09T06:30:02.180 INFO:tasks.workunit.client.0.smithi062.stdout:2/612: write d0/d9/dd/d65/d6d/f24 [2462688,20552] 0 2024-05-09T06:30:02.180 INFO:tasks.workunit.client.0.smithi062.stdout:4/679: dwrite d0/d2a/d1f/f22 [0,4194304] 0 2024-05-09T06:30:02.180 INFO:tasks.workunit.client.0.smithi062.stdout:4/680: chown d0/d3c/l66 5 1 2024-05-09T06:30:02.180 INFO:tasks.workunit.client.0.smithi062.stdout:4/681: write d0/d2a/f8f [1780434,114432] 0 2024-05-09T06:30:02.181 INFO:tasks.workunit.client.0.smithi062.stdout:4/682: dread d0/d3c/dae/db0/dbc/f96 [0,4194304] 0 2024-05-09T06:30:02.185 INFO:tasks.workunit.client.0.smithi062.stdout:2/613: mknod d0/d9/d17/cc1 0 2024-05-09T06:30:02.185 INFO:tasks.workunit.client.0.smithi062.stdout:2/614: write d0/f30 [3278941,79334] 0 2024-05-09T06:30:02.185 INFO:tasks.workunit.client.0.smithi062.stdout:2/615: chown d0/c5a 139160892 1 2024-05-09T06:30:02.185 INFO:tasks.workunit.client.0.smithi062.stdout:2/616: fsync d0/d9/dd/d65/d6d/d21/d29/d3d/fae 0 2024-05-09T06:30:02.187 INFO:tasks.workunit.client.0.smithi062.stdout:2/617: link d0/d9/d38/d41/db1/cb5 d0/d9/dd/d65/d6d/d21/d29/d3d/cc2 0 2024-05-09T06:30:02.189 INFO:tasks.workunit.client.0.smithi062.stdout:2/618: rename d0/d9/dd/d65/d6d/d7e/fb6 to d0/d9/dd/d65/d6d/d7e/d8d/d93/fc3 0 2024-05-09T06:30:02.189 INFO:tasks.workunit.client.0.smithi062.stdout:4/683: write d0/d2a/d1f/f22 [393414,12667] 0 2024-05-09T06:30:02.189 INFO:tasks.workunit.client.0.smithi062.stdout:4/684: write d0/d2a/d8/f4a [971940,111672] 0 2024-05-09T06:30:02.190 INFO:tasks.workunit.client.0.smithi062.stdout:2/619: symlink d0/d9/d17/d89/d8f/lc4 0 2024-05-09T06:30:02.192 INFO:tasks.workunit.client.0.smithi062.stdout:4/685: creat d0/d2a/d14/d7e/d8e/d9e/fcc x:0 0 0 2024-05-09T06:30:02.193 INFO:tasks.workunit.client.0.smithi062.stdout:4/686: creat d0/d2a/d14/fcd x:0 0 0 2024-05-09T06:30:02.195 INFO:tasks.workunit.client.0.smithi062.stdout:4/687: symlink d0/d3c/dae/db0/lce 0 2024-05-09T06:30:02.196 INFO:tasks.workunit.client.0.smithi062.stdout:4/688: mknod d0/d9/ccf 0 2024-05-09T06:30:02.197 INFO:tasks.workunit.client.0.smithi062.stdout:2/620: read d0/d9/dd/d65/fac [7099208,65351] 0 2024-05-09T06:30:02.198 INFO:tasks.workunit.client.0.smithi062.stdout:5/782: dwrite d0/d8/d1c/d23/d3e/f4d [4194304,4194304] 0 2024-05-09T06:30:02.198 INFO:tasks.workunit.client.0.smithi062.stdout:4/689: mknod d0/d2a/d8/cd0 0 2024-05-09T06:30:02.199 INFO:tasks.workunit.client.0.smithi062.stdout:2/621: creat d0/d9/fc5 x:0 0 0 2024-05-09T06:30:02.200 INFO:tasks.workunit.client.0.smithi062.stdout:5/783: mknod d0/d8/d47/dbe/d5/dbf/cfe 0 2024-05-09T06:30:02.200 INFO:tasks.workunit.client.0.smithi062.stdout:5/784: fdatasync d0/d8/d47/fe3 0 2024-05-09T06:30:02.200 INFO:tasks.workunit.client.0.smithi062.stdout:5/785: getdents d0/d8/d47/dbe 0 2024-05-09T06:30:02.200 INFO:tasks.workunit.client.0.smithi062.stdout:5/786: chown d0/d8/d47/dbe/d45/d92/f9b 65216 1 2024-05-09T06:30:02.201 INFO:tasks.workunit.client.0.smithi062.stdout:4/690: mkdir d0/d9/dd1 0 2024-05-09T06:30:02.202 INFO:tasks.workunit.client.0.smithi062.stdout:2/622: truncate d0/d9/d17/f73 3281184 0 2024-05-09T06:30:02.203 INFO:tasks.workunit.client.0.smithi062.stdout:5/787: mknod d0/d8/d18/da6/dee/df5/cff 0 2024-05-09T06:30:02.203 INFO:tasks.workunit.client.0.smithi062.stdout:5/788: write d0/d8/d1c/d2c/d7d/d4a/dd7/fe6 [452197,72643] 0 2024-05-09T06:30:02.205 INFO:tasks.workunit.client.0.smithi062.stdout:5/789: link d0/d8/d1c/d2c/d7d/d4a/dd7/fe5 d0/d8/f100 0 2024-05-09T06:30:02.207 INFO:tasks.workunit.client.0.smithi062.stdout:5/790: symlink d0/d8/d47/dbe/d45/da5/dcf/l101 0 2024-05-09T06:30:02.208 INFO:tasks.workunit.client.0.smithi062.stdout:5/791: creat d0/d8/d47/dbe/d86/da4/dce/f102 x:0 0 0 2024-05-09T06:30:02.208 INFO:tasks.workunit.client.0.smithi062.stdout:4/691: dread d0/d3c/f5f [0,4194304] 0 2024-05-09T06:30:02.208 INFO:tasks.workunit.client.0.smithi062.stdout:4/692: chown d0/d3c/dae/fbe 12506388 1 2024-05-09T06:30:02.215 INFO:tasks.workunit.client.0.smithi062.stdout:5/792: truncate d0/d8/d47/f82 5140837 0 2024-05-09T06:30:02.220 INFO:tasks.workunit.client.0.smithi062.stdout:5/793: creat d0/d8/d18/da6/f103 x:0 0 0 2024-05-09T06:30:02.224 INFO:tasks.workunit.client.0.smithi062.stdout:2/623: dwrite d0/d9/dd/d65/d6d/d21/d29/d40/f75 [0,4194304] 0 2024-05-09T06:30:02.225 INFO:tasks.workunit.client.0.smithi062.stdout:5/794: truncate d0/d8/d1c/d2c/d7d/fd3 1451462 0 2024-05-09T06:30:02.229 INFO:tasks.workunit.client.0.smithi062.stdout:4/693: dwrite d0/d2a/d1f/d6c/f83 [0,4194304] 0 2024-05-09T06:30:02.234 INFO:tasks.workunit.client.0.smithi062.stdout:4/694: dread d0/d2a/d14/d7e/d8e/d9e/d28/f59 [0,4194304] 0 2024-05-09T06:30:02.235 INFO:tasks.workunit.client.0.smithi062.stdout:2/624: write d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/f7b [1433830,91829] 0 2024-05-09T06:30:02.235 INFO:tasks.workunit.client.0.smithi062.stdout:5/795: symlink d0/d11/d67/l104 0 2024-05-09T06:30:02.235 INFO:tasks.workunit.client.0.smithi062.stdout:5/796: stat d0/f24 0 2024-05-09T06:30:02.235 INFO:tasks.workunit.client.0.smithi062.stdout:5/797: write d0/d8/d47/dbe/d45/da5/ff9 [493310,25218] 0 2024-05-09T06:30:02.237 INFO:tasks.workunit.client.0.smithi062.stdout:5/798: fdatasync d0/d8/d47/dbe/d45/da5/ff9 0 2024-05-09T06:30:02.249 INFO:tasks.workunit.client.0.smithi062.stdout:4/695: symlink d0/d2a/d1f/ld2 0 2024-05-09T06:30:02.252 INFO:tasks.workunit.client.0.smithi062.stdout:2/625: creat d0/d9/d38/d41/fc6 x:0 0 0 2024-05-09T06:30:02.254 INFO:tasks.workunit.client.0.smithi062.stdout:5/799: mkdir d0/d8/d47/dbe/d86/da4/d105 0 2024-05-09T06:30:02.257 INFO:tasks.workunit.client.0.smithi062.stdout:2/626: symlink d0/d9/d38/d41/d8a/lc7 0 2024-05-09T06:30:02.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/800: mknod d0/d8/d1c/c106 0 2024-05-09T06:30:02.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/801: chown d0/d8/d1c/d2c/d7d/fd3 4810 1 2024-05-09T06:30:02.259 INFO:tasks.workunit.client.0.smithi062.stdout:4/696: dread d0/d9/f3e [0,4194304] 0 2024-05-09T06:30:02.260 INFO:tasks.workunit.client.0.smithi062.stdout:2/627: creat d0/d9/d38/d41/d48/d5f/fc8 x:0 0 0 2024-05-09T06:30:02.260 INFO:tasks.workunit.client.0.smithi062.stdout:2/628: readlink d0/d9/d17/l25 0 2024-05-09T06:30:02.262 INFO:tasks.workunit.client.0.smithi062.stdout:5/802: truncate d0/d8/d1c/d2c/d7d/fa1 2862573 0 2024-05-09T06:30:02.262 INFO:tasks.workunit.client.0.smithi062.stdout:5/803: truncate d0/d8/d18/da6/ddf/fec 1068658 0 2024-05-09T06:30:02.264 INFO:tasks.workunit.client.0.smithi062.stdout:2/629: mknod d0/d9/dd/d65/d6d/d21/d29/d3d/cc9 0 2024-05-09T06:30:02.272 INFO:tasks.workunit.client.0.smithi062.stdout:5/804: write d0/f9c [1250698,108748] 0 2024-05-09T06:30:02.272 INFO:tasks.workunit.client.0.smithi062.stdout:5/805: chown d0/d8/d18/l90 14293675 1 2024-05-09T06:30:02.273 INFO:tasks.workunit.client.0.smithi062.stdout:5/806: write d0/f79 [3221683,122962] 0 2024-05-09T06:30:02.275 INFO:tasks.workunit.client.0.smithi062.stdout:4/697: dwrite d0/d2a/d1f/dc9/f79 [0,4194304] 0 2024-05-09T06:30:02.277 INFO:tasks.workunit.client.0.smithi062.stdout:5/807: dread d0/d8/d47/fe3 [0,4194304] 0 2024-05-09T06:30:02.279 INFO:tasks.workunit.client.0.smithi062.stdout:5/808: dread d0/d8/d47/dbe/f9e [0,4194304] 0 2024-05-09T06:30:02.279 INFO:tasks.workunit.client.0.smithi062.stdout:5/809: write d0/d8/d1c/d2c/d7d/fa9 [4818996,5527] 0 2024-05-09T06:30:02.282 INFO:tasks.workunit.client.0.smithi062.stdout:5/810: mkdir d0/d8/d107 0 2024-05-09T06:30:02.284 INFO:tasks.workunit.client.0.smithi062.stdout:5/811: symlink d0/d8/d47/dbe/d45/da5/dcf/l108 0 2024-05-09T06:30:02.285 INFO:tasks.workunit.client.0.smithi062.stdout:4/698: read d0/d3c/dae/db0/dbc/f6f [1022606,107147] 0 2024-05-09T06:30:02.286 INFO:tasks.workunit.client.0.smithi062.stdout:4/699: write d0/d2a/d14/fcd [953804,99484] 0 2024-05-09T06:30:02.288 INFO:tasks.workunit.client.0.smithi062.stdout:4/700: mknod d0/d2a/d14/d7e/d8e/cd3 0 2024-05-09T06:30:02.293 INFO:tasks.workunit.client.0.smithi062.stdout:5/812: dread d0/d11/f83 [0,4194304] 0 2024-05-09T06:30:02.294 INFO:tasks.workunit.client.0.smithi062.stdout:5/813: dread d0/d8/f95 [0,4194304] 0 2024-05-09T06:30:02.315 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:02 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:02.315 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:02 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:02.374 INFO:tasks.workunit.client.0.smithi062.stdout:3/532: sync 2024-05-09T06:30:02.374 INFO:tasks.workunit.client.0.smithi062.stdout:3/533: chown d1/d1e/c32 51973 1 2024-05-09T06:30:02.374 INFO:tasks.workunit.client.0.smithi062.stdout:3/534: write d1/d1e/d36/d9f/f65 [3144080,82745] 0 2024-05-09T06:30:02.374 INFO:tasks.workunit.client.0.smithi062.stdout:3/535: write d1/d1e/d26/f86 [745847,39986] 0 2024-05-09T06:30:02.376 INFO:tasks.workunit.client.0.smithi062.stdout:3/536: rmdir d1/d1e/d54 39 2024-05-09T06:30:02.379 INFO:tasks.workunit.client.0.smithi062.stdout:3/537: symlink d1/d1e/d36/daa/laf 0 2024-05-09T06:30:02.379 INFO:tasks.workunit.client.0.smithi062.stdout:3/538: getdents d1/d1e/d36/d3a/d89 0 2024-05-09T06:30:02.379 INFO:tasks.workunit.client.0.smithi062.stdout:3/539: fdatasync d1/f8 0 2024-05-09T06:30:02.379 INFO:tasks.workunit.client.0.smithi062.stdout:3/540: write d1/f55 [1249982,11339] 0 2024-05-09T06:30:02.379 INFO:tasks.workunit.client.0.smithi062.stdout:3/541: write d1/d1e/d36/d9f/f79 [4975132,76888] 0 2024-05-09T06:30:02.400 INFO:tasks.workunit.client.0.smithi062.stdout:3/542: dwrite d1/d1e/d36/d9f/f3e [0,4194304] 0 2024-05-09T06:30:02.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:02 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:02.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:02 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:02.420 INFO:tasks.workunit.client.0.smithi062.stdout:3/543: dwrite d1/d48/f57 [0,4194304] 0 2024-05-09T06:30:02.426 INFO:tasks.workunit.client.0.smithi062.stdout:3/544: mknod d1/d1e/d36/d9f/cb0 0 2024-05-09T06:30:02.428 INFO:tasks.workunit.client.0.smithi062.stdout:3/545: truncate d1/d1e/d36/d4a/f68 1527268 0 2024-05-09T06:30:02.466 INFO:tasks.workunit.client.0.smithi062.stdout:0/658: sync 2024-05-09T06:30:02.466 INFO:tasks.workunit.client.0.smithi062.stdout:1/535: sync 2024-05-09T06:30:02.466 INFO:tasks.workunit.client.0.smithi062.stdout:8/739: sync 2024-05-09T06:30:02.467 INFO:tasks.workunit.client.0.smithi062.stdout:1/536: dread d8/f5a [0,4194304] 0 2024-05-09T06:30:02.467 INFO:tasks.workunit.client.0.smithi062.stdout:1/537: dread - d8/d1d/d9c/f45 zero size 2024-05-09T06:30:02.469 INFO:tasks.workunit.client.0.smithi062.stdout:1/538: rmdir d8/d14/d2b/d3c/d44/d6e/d7a/d80 39 2024-05-09T06:30:02.470 INFO:tasks.workunit.client.0.smithi062.stdout:0/659: dread d1/d6a/d6d/d93/d94/dc7/f5c [0,4194304] 0 2024-05-09T06:30:02.470 INFO:tasks.workunit.client.0.smithi062.stdout:0/660: truncate d1/d25/d49/d4f/de6/f9e 1451515 0 2024-05-09T06:30:02.476 INFO:tasks.workunit.client.0.smithi062.stdout:0/661: write d1/f2c [2311911,99354] 0 2024-05-09T06:30:02.478 INFO:tasks.workunit.client.0.smithi062.stdout:0/662: creat d1/d25/d49/ff6 x:0 0 0 2024-05-09T06:30:02.478 INFO:tasks.workunit.client.0.smithi062.stdout:0/663: truncate d1/d25/d31/d6c/d44/d57/d75/f9f 349291 0 2024-05-09T06:30:02.479 INFO:tasks.workunit.client.0.smithi062.stdout:0/664: chown d1/d25/l79 37793 1 2024-05-09T06:30:02.485 INFO:tasks.workunit.client.0.smithi062.stdout:0/665: dread d1/d25/d49/d42/dad/dbe/fcf [0,4194304] 0 2024-05-09T06:30:02.493 INFO:tasks.workunit.client.0.smithi062.stdout:0/666: dread d1/d6a/fbd [0,4194304] 0 2024-05-09T06:30:02.494 INFO:tasks.workunit.client.0.smithi062.stdout:0/667: chown d1/d6a/d6d/d93/d94/dc7/lbc 1 1 2024-05-09T06:30:02.494 INFO:tasks.workunit.client.0.smithi062.stdout:0/668: creat d1/d25/d31/d6c/d44/d57/d84/ff7 x:0 0 0 2024-05-09T06:30:02.496 INFO:tasks.workunit.client.0.smithi062.stdout:0/669: symlink d1/d25/d59/lf8 0 2024-05-09T06:30:02.496 INFO:tasks.workunit.client.0.smithi062.stdout:0/670: write d1/d25/d49/d42/d43/d54/d9d/fc9 [238377,95695] 0 2024-05-09T06:30:02.498 INFO:tasks.workunit.client.0.smithi062.stdout:0/671: link d1/d25/d31/d6c/d44/d57/la0 d1/d6a/d6d/d93/d94/lf9 0 2024-05-09T06:30:02.500 INFO:tasks.workunit.client.0.smithi062.stdout:0/672: dread d1/d25/d49/d4f/d52/d7b/fd1 [0,4194304] 0 2024-05-09T06:30:02.501 INFO:tasks.workunit.client.0.smithi062.stdout:0/673: mknod d1/d25/d49/d4f/cfa 0 2024-05-09T06:30:02.501 INFO:tasks.workunit.client.0.smithi062.stdout:0/674: fsync d1/d25/d59/f65 0 2024-05-09T06:30:02.502 INFO:tasks.workunit.client.0.smithi062.stdout:0/675: readlink d1/d25/d49/d4f/l55 0 2024-05-09T06:30:02.504 INFO:tasks.workunit.client.0.smithi062.stdout:0/676: mknod d1/d6a/d6d/d93/cfb 0 2024-05-09T06:30:02.504 INFO:tasks.workunit.client.0.smithi062.stdout:0/677: write d1/d25/d49/d42/d43/d54/d9d/fb6 [649098,48121] 0 2024-05-09T06:30:02.504 INFO:tasks.workunit.client.0.smithi062.stdout:0/678: creat d1/d6a/d6d/d93/d94/ffc x:0 0 0 2024-05-09T06:30:02.504 INFO:tasks.workunit.client.0.smithi062.stdout:0/679: readlink d1/d25/d31/d6c/le2 0 2024-05-09T06:30:02.504 INFO:tasks.workunit.client.0.smithi062.stdout:0/680: fdatasync d1/d25/d49/d4f/de6/f37 0 2024-05-09T06:30:02.637 INFO:tasks.workunit.client.0.smithi062.stdout:7/653: sync 2024-05-09T06:30:02.637 INFO:tasks.workunit.client.0.smithi062.stdout:6/769: sync 2024-05-09T06:30:02.637 INFO:tasks.workunit.client.0.smithi062.stdout:6/770: write dc/d28/d10/d20/f8b [2507163,110331] 0 2024-05-09T06:30:02.642 INFO:tasks.workunit.client.0.smithi062.stdout:6/771: symlink dc/d28/d46/l104 0 2024-05-09T06:30:02.642 INFO:tasks.workunit.client.0.smithi062.stdout:6/772: readlink dc/d28/d10/d20/d5b/d77/lcf 0 2024-05-09T06:30:02.652 INFO:tasks.workunit.client.0.smithi062.stdout:7/654: dwrite d0/d12/f43 [0,4194304] 0 2024-05-09T06:30:02.719 INFO:tasks.workunit.client.0.smithi062.stdout:6/773: link dc/d28/d46/d3a/d7f/d91/d93/dc0/f4d dc/d28/d34/db7/f105 0 2024-05-09T06:30:02.735 INFO:tasks.workunit.client.0.smithi062.stdout:6/774: dwrite dc/d28/d34/d4e/d57/f75 [0,4194304] 0 2024-05-09T06:30:02.738 INFO:tasks.workunit.client.0.smithi062.stdout:6/775: symlink dc/d28/d10/d20/d5b/d77/l106 0 2024-05-09T06:30:02.739 INFO:tasks.workunit.client.0.smithi062.stdout:6/776: creat dc/d28/d46/d3a/d7f/d91/d93/f107 x:0 0 0 2024-05-09T06:30:02.740 INFO:tasks.workunit.client.0.smithi062.stdout:6/777: creat dc/d28/d46/f108 x:0 0 0 2024-05-09T06:30:02.742 INFO:tasks.workunit.client.0.smithi062.stdout:6/778: rename dc/d28/d46/d3a/d7f/d8e/dc8/dcd/cce to dc/d28/d46/d4a/dbf/c109 0 2024-05-09T06:30:02.751 INFO:tasks.workunit.client.0.smithi062.stdout:6/779: write dc/d28/d34/d4e/d57/d102/fbc [3674967,21221] 0 2024-05-09T06:30:02.752 INFO:tasks.workunit.client.0.smithi062.stdout:6/780: fsync dc/d28/d34/d4e/d57/d102/f101 0 2024-05-09T06:30:02.766 INFO:tasks.workunit.client.0.smithi062.stdout:6/781: dwrite dc/d28/d10/d20/d5b/d77/f9c [0,4194304] 0 2024-05-09T06:30:02.776 INFO:tasks.workunit.client.0.smithi062.stdout:6/782: dread dc/d28/d34/d4e/d57/f75 [0,4194304] 0 2024-05-09T06:30:02.776 INFO:tasks.workunit.client.0.smithi062.stdout:6/783: dread - dc/d28/fcb zero size 2024-05-09T06:30:02.806 INFO:tasks.workunit.client.0.smithi062.stdout:9/682: sync 2024-05-09T06:30:02.818 INFO:tasks.workunit.client.0.smithi062.stdout:6/784: creat dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/f10a x:0 0 0 2024-05-09T06:30:02.818 INFO:tasks.workunit.client.0.smithi062.stdout:6/785: write dc/d28/d10/d20/f8b [2530507,75639] 0 2024-05-09T06:30:02.819 INFO:tasks.workunit.client.0.smithi062.stdout:9/683: unlink d3/d3e/d52/d58/d1c/d21/c39 0 2024-05-09T06:30:02.835 INFO:tasks.workunit.client.0.smithi062.stdout:9/684: dwrite d3/d20/dc7/fd8 [0,4194304] 0 2024-05-09T06:30:02.835 INFO:tasks.workunit.client.0.smithi062.stdout:9/685: chown d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 2493 1 2024-05-09T06:30:02.839 INFO:tasks.workunit.client.0.smithi062.stdout:9/686: dread d3/d3e/d52/d58/f71 [0,4194304] 0 2024-05-09T06:30:02.857 INFO:tasks.workunit.client.0.smithi062.stdout:9/687: dwrite d3/d3e/d52/d58/d1c/d1e/f4c [0,4194304] 0 2024-05-09T06:30:02.862 INFO:tasks.workunit.client.0.smithi062.stdout:9/688: dread d3/d3e/d4b/f51 [0,4194304] 0 2024-05-09T06:30:02.871 INFO:tasks.workunit.client.0.smithi062.stdout:9/689: getdents d3/d3e/d52 0 2024-05-09T06:30:02.874 INFO:tasks.workunit.client.0.smithi062.stdout:9/690: mkdir d3/d3e/d52/d58/d1c/d1e/d41/dde 0 2024-05-09T06:30:02.875 INFO:tasks.workunit.client.0.smithi062.stdout:6/786: rename dc/d28/d46/d4a/d5d/dc5 to dc/d28/d10/d20/db5/d10b 0 2024-05-09T06:30:02.876 INFO:tasks.workunit.client.0.smithi062.stdout:6/787: stat dc/d28/d10/d20 0 2024-05-09T06:30:02.876 INFO:tasks.workunit.client.0.smithi062.stdout:6/788: write dc/d28/fcb [121774,1815] 0 2024-05-09T06:30:02.876 INFO:tasks.workunit.client.0.smithi062.stdout:6/789: write dc/d28/d46/d3a/d7f/d91/d93/dc0/f66 [4759900,20881] 0 2024-05-09T06:30:02.878 INFO:tasks.workunit.client.0.smithi062.stdout:9/691: rename d3/c12 to d3/d3e/d52/d58/d1c/d1e/d41/dc5/cdf 0 2024-05-09T06:30:02.879 INFO:tasks.workunit.client.0.smithi062.stdout:9/692: chown d3/d3e/lab 10586 1 2024-05-09T06:30:02.879 INFO:tasks.workunit.client.0.smithi062.stdout:9/693: fsync d3/d3e/d52/d58/d77/d92/f9e 0 2024-05-09T06:30:02.882 INFO:tasks.workunit.client.0.smithi062.stdout:9/694: mknod d3/d3e/d4b/d99/ce0 0 2024-05-09T06:30:02.882 INFO:tasks.workunit.client.0.smithi062.stdout:9/695: creat d3/d3e/d4b/fe1 x:0 0 0 2024-05-09T06:30:02.886 INFO:tasks.workunit.client.0.smithi062.stdout:9/696: mkdir d3/d3e/d52/d58/d1c/d1e/d41/d64/de2 0 2024-05-09T06:30:02.891 INFO:tasks.workunit.client.0.smithi062.stdout:9/697: dread d3/d3e/d52/d58/d1c/d1e/d60/f73 [0,4194304] 0 2024-05-09T06:30:02.891 INFO:tasks.workunit.client.0.smithi062.stdout:9/698: creat d3/d3e/d7c/fe3 x:0 0 0 2024-05-09T06:30:02.894 INFO:tasks.workunit.client.0.smithi062.stdout:6/790: dwrite dc/d28/d34/d4e/d57/f65 [0,4194304] 0 2024-05-09T06:30:02.894 INFO:tasks.workunit.client.0.smithi062.stdout:9/699: mknod d3/d3e/d52/ce4 0 2024-05-09T06:30:02.899 INFO:tasks.workunit.client.0.smithi062.stdout:6/791: unlink dc/d28/d34/d4e/c6c 0 2024-05-09T06:30:02.901 INFO:tasks.workunit.client.0.smithi062.stdout:6/792: unlink dc/d28/d46/d4a/la2 0 2024-05-09T06:30:02.910 INFO:tasks.workunit.client.0.smithi062.stdout:6/793: write dc/d28/d10/d20/d5b/fc6 [2200275,79247] 0 2024-05-09T06:30:02.910 INFO:tasks.workunit.client.0.smithi062.stdout:6/794: read dc/d28/d46/d3a/d7f/f90 [1210354,118216] 0 2024-05-09T06:30:02.912 INFO:tasks.workunit.client.0.smithi062.stdout:9/700: dwrite d3/f75 [0,4194304] 0 2024-05-09T06:30:02.912 INFO:tasks.workunit.client.0.smithi062.stdout:9/701: truncate d3/d3e/d52/d58/d1c/faa 136824 0 2024-05-09T06:30:02.912 INFO:tasks.workunit.client.0.smithi062.stdout:2/630: sync 2024-05-09T06:30:02.912 INFO:tasks.workunit.client.0.smithi062.stdout:4/701: sync 2024-05-09T06:30:02.913 INFO:tasks.workunit.client.0.smithi062.stdout:6/795: symlink dc/d28/d46/l10c 0 2024-05-09T06:30:02.920 INFO:tasks.workunit.client.0.smithi062.stdout:9/702: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/fe5 x:0 0 0 2024-05-09T06:30:02.920 INFO:tasks.workunit.client.0.smithi062.stdout:9/703: creat d3/d3e/d52/d58/d1c/d1e/d60/fe6 x:0 0 0 2024-05-09T06:30:02.923 INFO:tasks.workunit.client.0.smithi062.stdout:2/631: mkdir d0/d9/dd/d65/d6d/d7e/d8d/dca 0 2024-05-09T06:30:02.923 INFO:tasks.workunit.client.0.smithi062.stdout:2/632: chown d0/d9/d38/d41/db1/l82 17394 1 2024-05-09T06:30:02.924 INFO:tasks.workunit.client.0.smithi062.stdout:2/633: dread d0/fa2 [0,4194304] 0 2024-05-09T06:30:02.924 INFO:tasks.workunit.client.0.smithi062.stdout:2/634: chown d0/d9/d38/d41/f51 1493480 1 2024-05-09T06:30:02.924 INFO:tasks.workunit.client.0.smithi062.stdout:2/635: creat d0/d9/d38/fcb x:0 0 0 2024-05-09T06:30:02.924 INFO:tasks.workunit.client.0.smithi062.stdout:4/702: dread d0/d2a/d1f/d6c/f95 [0,4194304] 0 2024-05-09T06:30:02.924 INFO:tasks.workunit.client.0.smithi062.stdout:4/703: write d0/d2a/d14/f74 [574694,367] 0 2024-05-09T06:30:02.925 INFO:tasks.workunit.client.0.smithi062.stdout:6/796: creat dc/d28/d10/f10d x:0 0 0 2024-05-09T06:30:02.925 INFO:tasks.workunit.client.0.smithi062.stdout:6/797: write dc/d28/d34/d4e/d57/d102/fbc [477755,4733] 0 2024-05-09T06:30:02.934 INFO:tasks.workunit.client.0.smithi062.stdout:2/636: mknod d0/d9/dd/d65/ccc 0 2024-05-09T06:30:02.937 INFO:tasks.workunit.client.0.smithi062.stdout:4/704: getdents d0/d2a/d8 0 2024-05-09T06:30:02.937 INFO:tasks.workunit.client.0.smithi062.stdout:4/705: chown d0/d3c/dae/db0/dbc/f58 1 1 2024-05-09T06:30:02.937 INFO:tasks.workunit.client.0.smithi062.stdout:4/706: write d0/d2a/d1f/d6c/fb7 [150828,80091] 0 2024-05-09T06:30:02.938 INFO:tasks.workunit.client.0.smithi062.stdout:6/798: symlink dc/d28/d10/d20/d5b/d77/l10e 0 2024-05-09T06:30:02.946 INFO:tasks.workunit.client.0.smithi062.stdout:9/704: dwrite d3/f16 [0,4194304] 0 2024-05-09T06:30:02.946 INFO:tasks.workunit.client.0.smithi062.stdout:2/637: link d0/d9/dd/d65/d6d/d96/da4/cbc d0/d9/dd/d65/ccd 0 2024-05-09T06:30:02.952 INFO:tasks.workunit.client.0.smithi062.stdout:4/707: unlink d0/d2a/d14/d7e/d8e/d9e/fcc 0 2024-05-09T06:30:02.959 INFO:tasks.workunit.client.0.smithi062.stdout:6/799: truncate dc/d28/d34/f59 1444088 0 2024-05-09T06:30:02.959 INFO:tasks.workunit.client.0.smithi062.stdout:6/800: fdatasync dc/d28/d10/d20/fb9 0 2024-05-09T06:30:02.961 INFO:tasks.workunit.client.0.smithi062.stdout:2/638: dwrite d0/d9/d38/d41/fc6 [0,4194304] 0 2024-05-09T06:30:02.961 INFO:tasks.workunit.client.0.smithi062.stdout:4/708: fsync d0/fb8 0 2024-05-09T06:30:02.965 INFO:tasks.workunit.client.0.smithi062.stdout:6/801: rename dc/d28/d34/d39/dee to dc/d28/d10/d20/d5b/da3/d10f 0 2024-05-09T06:30:02.972 INFO:tasks.workunit.client.0.smithi062.stdout:4/709: dread d0/d2a/d8/f50 [0,4194304] 0 2024-05-09T06:30:02.972 INFO:tasks.workunit.client.0.smithi062.stdout:4/710: chown d0/d2a/d14/d7e/l5a 20658376 1 2024-05-09T06:30:02.972 INFO:tasks.workunit.client.0.smithi062.stdout:9/705: dwrite d3/d20/f7a [0,4194304] 0 2024-05-09T06:30:02.972 INFO:tasks.workunit.client.0.smithi062.stdout:9/706: write d3/d3e/d4b/d99/fa6 [639027,75234] 0 2024-05-09T06:30:02.973 INFO:tasks.workunit.client.0.smithi062.stdout:2/639: write d0/f6 [1673685,75439] 0 2024-05-09T06:30:02.974 INFO:tasks.workunit.client.0.smithi062.stdout:2/640: write d0/fa [3372156,33155] 0 2024-05-09T06:30:02.974 INFO:tasks.workunit.client.0.smithi062.stdout:6/802: dread dc/d28/d10/d20/d5b/f6d [0,4194304] 0 2024-05-09T06:30:02.975 INFO:tasks.workunit.client.0.smithi062.stdout:4/711: link d0/d2a/d1f/d6c/l9a d0/d2a/d8/d69/daf/ld4 0 2024-05-09T06:30:02.975 INFO:tasks.workunit.client.0.smithi062.stdout:4/712: fsync d0/d2a/d1f/d6c/fbd 0 2024-05-09T06:30:02.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/641: symlink d0/d9/d17/lce 0 2024-05-09T06:30:02.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/642: stat d0/d9/dd/d65/d6d/d21/d29/c2a 0 2024-05-09T06:30:02.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/643: write d0/d9/d38/d41/d53/f61 [1116034,8792] 0 2024-05-09T06:30:02.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/644: chown d0/d9/d38/d41/f49 224078830 1 2024-05-09T06:30:02.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/645: fsync d0/d9/dd/f6c 0 2024-05-09T06:30:02.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/646: read - d0/d9/d17/d37/f7f zero size 2024-05-09T06:30:02.981 INFO:tasks.workunit.client.0.smithi062.stdout:9/707: read d3/f3c [2683543,37573] 0 2024-05-09T06:30:02.981 INFO:tasks.workunit.client.0.smithi062.stdout:9/708: creat d3/d3e/d52/d58/d77/d92/fe7 x:0 0 0 2024-05-09T06:30:02.981 INFO:tasks.workunit.client.0.smithi062.stdout:9/709: fsync d3/d3e/d7c/f93 0 2024-05-09T06:30:02.982 INFO:tasks.workunit.client.0.smithi062.stdout:6/803: creat dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/f110 x:0 0 0 2024-05-09T06:30:02.982 INFO:tasks.workunit.client.0.smithi062.stdout:6/804: read dc/d28/d46/d3a/d7f/d91/fb4 [208050,27193] 0 2024-05-09T06:30:02.984 INFO:tasks.workunit.client.0.smithi062.stdout:4/713: rename d0/d2a/d14/d4f/d6b/dc0 to d0/d2a/d1f/dd5 0 2024-05-09T06:30:02.986 INFO:tasks.workunit.client.0.smithi062.stdout:8/740: sync 2024-05-09T06:30:02.986 INFO:tasks.workunit.client.0.smithi062.stdout:8/741: chown da/dea/f2d 24578311 1 2024-05-09T06:30:02.986 INFO:tasks.workunit.client.0.smithi062.stdout:5/814: sync 2024-05-09T06:30:02.986 INFO:tasks.workunit.client.0.smithi062.stdout:2/647: rmdir d0/d9/d38/d41/d53 39 2024-05-09T06:30:02.986 INFO:tasks.workunit.client.0.smithi062.stdout:3/546: sync 2024-05-09T06:30:02.988 INFO:tasks.workunit.client.0.smithi062.stdout:9/710: symlink d3/d3e/d52/d58/d1c/d1e/d41/dde/le8 0 2024-05-09T06:30:02.988 INFO:tasks.workunit.client.0.smithi062.stdout:9/711: read - d3/d3e/d52/d58/d1c/d1e/d41/fda zero size 2024-05-09T06:30:02.989 INFO:tasks.workunit.client.0.smithi062.stdout:6/805: truncate dc/d28/d10/d20/f51 202628 0 2024-05-09T06:30:02.989 INFO:tasks.workunit.client.0.smithi062.stdout:6/806: write dc/d28/d34/fb1 [826654,49677] 0 2024-05-09T06:30:02.991 INFO:tasks.workunit.client.0.smithi062.stdout:8/742: mkdir da/df0 0 2024-05-09T06:30:02.992 INFO:tasks.workunit.client.0.smithi062.stdout:8/743: stat da/dea/d2e/d61/d92/l5a 0 2024-05-09T06:30:02.992 INFO:tasks.workunit.client.0.smithi062.stdout:5/815: getdents d0/d8/d47/dbe/d45 0 2024-05-09T06:30:02.995 INFO:tasks.workunit.client.0.smithi062.stdout:2/648: readlink d0/d9/l43 0 2024-05-09T06:30:02.997 INFO:tasks.workunit.client.0.smithi062.stdout:3/547: creat d1/d1e/d36/d6c/fb1 x:0 0 0 2024-05-09T06:30:02.998 INFO:tasks.workunit.client.0.smithi062.stdout:3/548: write d1/d1e/d54/f63 [733134,87971] 0 2024-05-09T06:30:02.998 INFO:tasks.workunit.client.0.smithi062.stdout:3/549: stat d1/d1e/d26/d43/d52/d81/c85 0 2024-05-09T06:30:03.002 INFO:tasks.workunit.client.0.smithi062.stdout:9/712: mknod d3/d3e/d52/d58/d1c/d1e/d60/ce9 0 2024-05-09T06:30:03.004 INFO:tasks.workunit.client.0.smithi062.stdout:6/807: creat dc/d28/d10/f111 x:0 0 0 2024-05-09T06:30:03.006 INFO:tasks.workunit.client.0.smithi062.stdout:4/714: dwrite d0/d2a/d14/d4f/f90 [0,4194304] 0 2024-05-09T06:30:03.006 INFO:tasks.workunit.client.0.smithi062.stdout:4/715: write d0/d2a/d1f/dc9/d81/fc2 [3618447,116456] 0 2024-05-09T06:30:03.006 INFO:tasks.workunit.client.0.smithi062.stdout:4/716: creat d0/d2a/d1f/dc9/da0/fd6 x:0 0 0 2024-05-09T06:30:03.006 INFO:tasks.workunit.client.0.smithi062.stdout:4/717: write d0/d3c/f5e [1219708,83146] 0 2024-05-09T06:30:03.006 INFO:tasks.workunit.client.0.smithi062.stdout:4/718: chown d0/d2a/d14/d7e/d8e/d9e/d28/f71 92832 1 2024-05-09T06:30:03.007 INFO:tasks.workunit.client.0.smithi062.stdout:4/719: write d0/d2a/d1f/dc9/f64 [2547593,40695] 0 2024-05-09T06:30:03.007 INFO:tasks.workunit.client.0.smithi062.stdout:4/720: stat d0/d2a/d1f 0 2024-05-09T06:30:03.007 INFO:tasks.workunit.client.0.smithi062.stdout:5/816: mkdir d0/d8/d47/dbe/d45/da5/dcf/d109 0 2024-05-09T06:30:03.009 INFO:tasks.workunit.client.0.smithi062.stdout:3/550: creat d1/d1e/d26/d43/d92/fb2 x:0 0 0 2024-05-09T06:30:03.009 INFO:tasks.workunit.client.0.smithi062.stdout:8/744: dwrite da/dea/d2e/d7e/d83/fce [0,4194304] 0 2024-05-09T06:30:03.011 INFO:tasks.workunit.client.0.smithi062.stdout:6/808: creat dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/dc3/f112 x:0 0 0 2024-05-09T06:30:03.016 INFO:tasks.workunit.client.0.smithi062.stdout:4/721: symlink d0/d5b/dc5/ld7 0 2024-05-09T06:30:03.017 INFO:tasks.workunit.client.0.smithi062.stdout:3/551: rmdir d1/d1e/d26/d43/d52/d6a/dad 0 2024-05-09T06:30:03.017 INFO:tasks.workunit.client.0.smithi062.stdout:3/552: stat d1/d1e/d36/d9f/c8a 0 2024-05-09T06:30:03.017 INFO:tasks.workunit.client.0.smithi062.stdout:3/553: fdatasync d1/d1e/d54/f9a 0 2024-05-09T06:30:03.017 INFO:tasks.workunit.client.0.smithi062.stdout:3/554: fdatasync d1/d1e/d26/f2b 0 2024-05-09T06:30:03.017 INFO:tasks.workunit.client.0.smithi062.stdout:5/817: dread d0/d8/f52 [0,4194304] 0 2024-05-09T06:30:03.020 INFO:tasks.workunit.client.0.smithi062.stdout:2/649: dwrite d0/d9/d38/d41/d53/f99 [0,4194304] 0 2024-05-09T06:30:03.022 INFO:tasks.workunit.client.0.smithi062.stdout:6/809: creat dc/d28/d46/d3a/d7f/f113 x:0 0 0 2024-05-09T06:30:03.023 INFO:tasks.workunit.client.0.smithi062.stdout:4/722: truncate d0/d2a/d1f/d6c/f95 3095674 0 2024-05-09T06:30:03.023 INFO:tasks.workunit.client.0.smithi062.stdout:4/723: fdatasync d0/d2a/d8/f50 0 2024-05-09T06:30:03.025 INFO:tasks.workunit.client.0.smithi062.stdout:3/555: truncate d1/d1e/d36/d3a/f6d 347088 0 2024-05-09T06:30:03.026 INFO:tasks.workunit.client.0.smithi062.stdout:8/745: dwrite da/d77/fe1 [0,4194304] 0 2024-05-09T06:30:03.028 INFO:tasks.workunit.client.0.smithi062.stdout:5/818: symlink d0/d8/d1c/d23/d42/l10a 0 2024-05-09T06:30:03.035 INFO:tasks.workunit.client.0.smithi062.stdout:8/746: dread da/dea/d2e/d61/f63 [0,4194304] 0 2024-05-09T06:30:03.035 INFO:tasks.workunit.client.0.smithi062.stdout:8/747: chown da/dea/c2f 120 1 2024-05-09T06:30:03.043 INFO:tasks.workunit.client.0.smithi062.stdout:5/819: dwrite d0/d8/d1c/d2c/d7d/d4a/f93 [4194304,4194304] 0 2024-05-09T06:30:03.044 INFO:tasks.workunit.client.0.smithi062.stdout:6/810: rename dc/d28/d34/d4e/d78 to dc/d28/d46/d3a/d7f/d91/d93/d114 0 2024-05-09T06:30:03.045 INFO:tasks.workunit.client.0.smithi062.stdout:4/724: getdents d0/d2a/d14/d7e 0 2024-05-09T06:30:03.046 INFO:tasks.workunit.client.0.smithi062.stdout:3/556: mkdir d1/d1e/d26/d43/d52/d6a/da4/db3 0 2024-05-09T06:30:03.048 INFO:tasks.workunit.client.0.smithi062.stdout:6/811: write dc/d28/d10/d20/d5b/da3/d10f/ff6 [3378761,24597] 0 2024-05-09T06:30:03.058 INFO:tasks.workunit.client.0.smithi062.stdout:8/748: unlink da/dea/d2e/d34/d90/fc4 0 2024-05-09T06:30:03.059 INFO:tasks.workunit.client.0.smithi062.stdout:8/749: fsync da/dea/d2e/d61/d92/da5/daf/fba 0 2024-05-09T06:30:03.059 INFO:tasks.workunit.client.0.smithi062.stdout:8/750: readlink da/dea/d2e/d34/lac 0 2024-05-09T06:30:03.059 INFO:tasks.workunit.client.0.smithi062.stdout:8/751: dread - da/dea/d2e/fef zero size 2024-05-09T06:30:03.059 INFO:tasks.workunit.client.0.smithi062.stdout:2/650: rmdir d0/d9/d17/d37 39 2024-05-09T06:30:03.060 INFO:tasks.workunit.client.0.smithi062.stdout:5/820: creat d0/d11/f10b x:0 0 0 2024-05-09T06:30:03.065 INFO:tasks.workunit.client.0.smithi062.stdout:4/725: truncate d0/d2a/d8/f50 2753201 0 2024-05-09T06:30:03.066 INFO:tasks.workunit.client.0.smithi062.stdout:8/752: write da/d77/f94 [3120870,64065] 0 2024-05-09T06:30:03.066 INFO:tasks.workunit.client.0.smithi062.stdout:8/753: write da/dea/d2e/fe5 [537127,16386] 0 2024-05-09T06:30:03.066 INFO:tasks.workunit.client.0.smithi062.stdout:8/754: truncate da/dea/d2e/d34/f65 953847 0 2024-05-09T06:30:03.067 INFO:tasks.workunit.client.0.smithi062.stdout:8/755: chown da/dea/f1d 11289 1 2024-05-09T06:30:03.067 INFO:tasks.workunit.client.0.smithi062.stdout:8/756: stat da/dea/d2e/d61/d92/l45 0 2024-05-09T06:30:03.067 INFO:tasks.workunit.client.0.smithi062.stdout:8/757: stat da/dea/d2e/d61/d92/da5/fab 0 2024-05-09T06:30:03.069 INFO:tasks.workunit.client.0.smithi062.stdout:4/726: dread d0/d2a/d1f/f22 [0,4194304] 0 2024-05-09T06:30:03.069 INFO:tasks.workunit.client.0.smithi062.stdout:3/557: truncate d1/d1e/d26/f37 350898 0 2024-05-09T06:30:03.073 INFO:tasks.workunit.client.0.smithi062.stdout:6/812: creat dc/d28/d34/d39/de0/f115 x:0 0 0 2024-05-09T06:30:03.073 INFO:tasks.workunit.client.0.smithi062.stdout:6/813: write dc/d28/d34/ff3 [428344,70607] 0 2024-05-09T06:30:03.075 INFO:tasks.workunit.client.0.smithi062.stdout:2/651: creat d0/d90/db7/fcf x:0 0 0 2024-05-09T06:30:03.077 INFO:tasks.workunit.client.0.smithi062.stdout:5/821: creat d0/d3b/dbc/df1/f10c x:0 0 0 2024-05-09T06:30:03.095 INFO:tasks.workunit.client.0.smithi062.stdout:3/558: dwrite d1/f55 [0,4194304] 0 2024-05-09T06:30:03.095 INFO:tasks.workunit.client.0.smithi062.stdout:3/559: fdatasync d1/d48/f98 0 2024-05-09T06:30:03.096 INFO:tasks.workunit.client.0.smithi062.stdout:3/560: write d1/d1e/d26/f3c [1040080,76134] 0 2024-05-09T06:30:03.096 INFO:tasks.workunit.client.0.smithi062.stdout:3/561: read d1/d1e/d26/d43/d52/d6a/f71 [748777,48785] 0 2024-05-09T06:30:03.096 INFO:tasks.workunit.client.0.smithi062.stdout:5/822: dwrite d0/d8/d47/dbe/d5/f36 [0,4194304] 0 2024-05-09T06:30:03.125 INFO:tasks.workunit.client.0.smithi062.stdout:1/539: sync 2024-05-09T06:30:03.126 INFO:tasks.workunit.client.0.smithi062.stdout:0/681: sync 2024-05-09T06:30:03.126 INFO:tasks.workunit.client.0.smithi062.stdout:7/655: sync 2024-05-09T06:30:03.126 INFO:tasks.workunit.client.0.smithi062.stdout:1/540: fdatasync d8/d14/d2b/d3c/f6b 0 2024-05-09T06:30:03.145 INFO:tasks.workunit.client.0.smithi062.stdout:8/758: mkdir da/dea/dd2/df1 0 2024-05-09T06:30:03.162 INFO:tasks.workunit.client.0.smithi062.stdout:8/759: dwrite da/dea/d2e/d34/d90/fd5 [0,4194304] 0 2024-05-09T06:30:03.162 INFO:tasks.workunit.client.0.smithi062.stdout:8/760: creat da/d77/ff2 x:0 0 0 2024-05-09T06:30:03.165 INFO:tasks.workunit.client.0.smithi062.stdout:8/761: dread f8 [0,4194304] 0 2024-05-09T06:30:03.168 INFO:tasks.workunit.client.0.smithi062.stdout:2/652: rename d0/d9/dd/d65/d6d/d21/f28 to d0/d9/d17/d89/d8f/fd0 0 2024-05-09T06:30:03.168 INFO:tasks.workunit.client.0.smithi062.stdout:2/653: fdatasync d0/d9/dd/d65/d6d/d21/d29/d3d/fae 0 2024-05-09T06:30:03.184 INFO:tasks.workunit.client.0.smithi062.stdout:5/823: symlink d0/d8/d1c/d2c/de8/l10d 0 2024-05-09T06:30:03.189 INFO:tasks.workunit.client.0.smithi062.stdout:0/682: rmdir d1/d25/d31/d6c/df0 0 2024-05-09T06:30:03.189 INFO:tasks.workunit.client.0.smithi062.stdout:0/683: readlink d1/d25/d31/d6c/d44/d57/laa 0 2024-05-09T06:30:03.193 INFO:tasks.workunit.client.0.smithi062.stdout:7/656: mkdir d0/d3a/d51/d64/d6d/d80/dd8 0 2024-05-09T06:30:03.193 INFO:tasks.workunit.client.0.smithi062.stdout:7/657: chown d0/d3a/d69/fc0 1 1 2024-05-09T06:30:03.198 INFO:tasks.workunit.client.0.smithi062.stdout:1/541: creat d8/d14/d2b/d3c/d44/d6e/d7a/d80/fb5 x:0 0 0 2024-05-09T06:30:03.214 INFO:tasks.workunit.client.0.smithi062.stdout:4/727: rmdir d0 39 2024-05-09T06:30:03.215 INFO:tasks.workunit.client.0.smithi062.stdout:4/728: fdatasync d0/fb8 0 2024-05-09T06:30:03.218 INFO:tasks.workunit.client.0.smithi062.stdout:8/762: creat da/df0/ff3 x:0 0 0 2024-05-09T06:30:03.266 INFO:tasks.workunit.client.0.smithi062.stdout:2/654: mknod d0/d9/dd/d65/d6d/d21/d29/d3d/cd1 0 2024-05-09T06:30:03.268 INFO:tasks.workunit.client.0.smithi062.stdout:5/824: mknod d0/d8/d47/dbe/c10e 0 2024-05-09T06:30:03.268 INFO:tasks.workunit.client.0.smithi062.stdout:5/825: fdatasync d0/d8/fc4 0 2024-05-09T06:30:03.268 INFO:tasks.workunit.client.0.smithi062.stdout:5/826: readlink d0/d8/d18/l5e 0 2024-05-09T06:30:03.273 INFO:tasks.workunit.client.0.smithi062.stdout:0/684: creat d1/d25/d31/ffd x:0 0 0 2024-05-09T06:30:03.274 INFO:tasks.workunit.client.0.smithi062.stdout:7/658: symlink d0/d12/d33/d9f/ld9 0 2024-05-09T06:30:03.277 INFO:tasks.workunit.client.0.smithi062.stdout:1/542: unlink d8/d14/d2b/d3c/d44/l95 0 2024-05-09T06:30:03.279 INFO:tasks.workunit.client.0.smithi062.stdout:4/729: creat d0/d2a/d14/fd8 x:0 0 0 2024-05-09T06:30:03.279 INFO:tasks.workunit.client.0.smithi062.stdout:4/730: fsync d0/d2a/d14/d7e/d8e/d9e/d86/fa6 0 2024-05-09T06:30:03.279 INFO:tasks.workunit.client.0.smithi062.stdout:4/731: fsync d0/d3c/dae/db0/dbc/f6f 0 2024-05-09T06:30:03.282 INFO:tasks.workunit.client.0.smithi062.stdout:8/763: rename da/dea/d2e/d34/d90/fc6 to da/dea/d1c/ff4 0 2024-05-09T06:30:03.282 INFO:tasks.workunit.client.0.smithi062.stdout:2/655: mkdir d0/d9/d38/d41/d8a/dd2 0 2024-05-09T06:30:03.284 INFO:tasks.workunit.client.0.smithi062.stdout:7/659: dread d0/d12/d33/d67/f7e [0,4194304] 0 2024-05-09T06:30:03.284 INFO:tasks.workunit.client.0.smithi062.stdout:5/827: mkdir d0/d8/d47/dbe/d86/da4/dce/dbd/d10f 0 2024-05-09T06:30:03.289 INFO:tasks.workunit.client.0.smithi062.stdout:0/685: rename d1/d25/d49/d42/d43/d54/d9d/cb9 to d1/d25/d31/d6c/d44/d57/d75/cfe 0 2024-05-09T06:30:03.291 INFO:tasks.workunit.client.0.smithi062.stdout:0/686: getdents d1/d25/d49/d42/dad 0 2024-05-09T06:30:03.293 INFO:tasks.workunit.client.0.smithi062.stdout:4/732: write d0/d9/f3e [2327463,100467] 0 2024-05-09T06:30:03.297 INFO:tasks.workunit.client.0.smithi062.stdout:7/660: dread d0/f77 [0,4194304] 0 2024-05-09T06:30:03.297 INFO:tasks.workunit.client.0.smithi062.stdout:7/661: write d0/d12/d66/d9e/fa9 [240801,105787] 0 2024-05-09T06:30:03.297 INFO:tasks.workunit.client.0.smithi062.stdout:7/662: stat d0/d12/d66/fbd 0 2024-05-09T06:30:03.298 INFO:tasks.workunit.client.0.smithi062.stdout:8/764: dread da/dea/f89 [0,4194304] 0 2024-05-09T06:30:03.298 INFO:tasks.workunit.client.0.smithi062.stdout:4/733: rename d0/d2a/d14/d7e/d8e/d9e/f44 to d0/d2a/d14/d7e/d8e/fd9 0 2024-05-09T06:30:03.298 INFO:tasks.workunit.client.0.smithi062.stdout:4/734: chown d0/d2a/d14/d7e/d8e/d9e/f16 23760756 1 2024-05-09T06:30:03.299 INFO:tasks.workunit.client.0.smithi062.stdout:4/735: stat d0/d3c/da1/cb4 0 2024-05-09T06:30:03.303 INFO:tasks.workunit.client.0.smithi062.stdout:0/687: getdents d1/d25/d49/d4f/d52 0 2024-05-09T06:30:03.306 INFO:tasks.workunit.client.0.smithi062.stdout:4/736: symlink d0/d2a/d14/d7e/lda 0 2024-05-09T06:30:03.308 INFO:tasks.workunit.client.0.smithi062.stdout:0/688: mknod d1/d25/d49/d4f/db7/cff 0 2024-05-09T06:30:03.309 INFO:tasks.workunit.client.0.smithi062.stdout:0/689: truncate d1/d25/d31/d6c/d44/d6e/f96 566627 0 2024-05-09T06:30:03.309 INFO:tasks.workunit.client.0.smithi062.stdout:0/690: chown d1/d6a/d6d/d93/d94/dc7 0 1 2024-05-09T06:30:03.309 INFO:tasks.workunit.client.0.smithi062.stdout:5/828: dwrite d0/d8/d47/dbe/d86/da4/dce/dbd/fe0 [0,4194304] 0 2024-05-09T06:30:03.309 INFO:tasks.workunit.client.0.smithi062.stdout:5/829: stat d0/f9c 0 2024-05-09T06:30:03.311 INFO:tasks.workunit.client.0.smithi062.stdout:1/543: dwrite d8/d1d/d91/f7e [0,4194304] 0 2024-05-09T06:30:03.311 INFO:tasks.workunit.client.0.smithi062.stdout:2/656: dwrite d0/d9/dd/d65/d6d/d21/d29/d3d/f79 [0,4194304] 0 2024-05-09T06:30:03.313 INFO:tasks.workunit.client.0.smithi062.stdout:0/691: symlink d1/d25/d49/d4f/db7/l100 0 2024-05-09T06:30:03.313 INFO:tasks.workunit.client.0.smithi062.stdout:0/692: write d1/d6a/d6d/d93/d94/dc7/f50 [977346,104470] 0 2024-05-09T06:30:03.333 INFO:tasks.workunit.client.0.smithi062.stdout:2/657: creat d0/d9/d38/d41/d8a/fd3 x:0 0 0 2024-05-09T06:30:03.335 INFO:tasks.workunit.client.0.smithi062.stdout:0/693: link d1/d25/d31/d6c/f67 d1/d25/d49/d4f/f101 0 2024-05-09T06:30:03.335 INFO:tasks.workunit.client.0.smithi062.stdout:0/694: readlink d1/d25/d49/d4f/d52/l5a 0 2024-05-09T06:30:03.335 INFO:tasks.workunit.client.0.smithi062.stdout:0/695: dread - d1/d25/d49/d4f/d52/fc1 zero size 2024-05-09T06:30:03.336 INFO:tasks.workunit.client.0.smithi062.stdout:7/663: dwrite d0/d3a/d51/d64/d6d/d80/fa3 [0,4194304] 0 2024-05-09T06:30:03.337 INFO:tasks.workunit.client.0.smithi062.stdout:8/765: dwrite da/dea/d1c/fb0 [0,4194304] 0 2024-05-09T06:30:03.338 INFO:tasks.workunit.client.0.smithi062.stdout:4/737: dwrite d0/d3c/dae/fbe [0,4194304] 0 2024-05-09T06:30:03.339 INFO:tasks.workunit.client.0.smithi062.stdout:0/696: dread d1/d25/f86 [0,4194304] 0 2024-05-09T06:30:03.339 INFO:tasks.workunit.client.0.smithi062.stdout:0/697: stat d1/f11 0 2024-05-09T06:30:03.340 INFO:tasks.workunit.client.0.smithi062.stdout:0/698: chown d1/d25/d31/d6c/f67 594 1 2024-05-09T06:30:03.340 INFO:tasks.workunit.client.0.smithi062.stdout:0/699: fsync d1/d25/d49/d42/fed 0 2024-05-09T06:30:03.340 INFO:tasks.workunit.client.0.smithi062.stdout:1/544: dwrite d8/f13 [0,4194304] 0 2024-05-09T06:30:03.341 INFO:tasks.workunit.client.0.smithi062.stdout:5/830: rmdir d0/d8/d47/dbe/d86/da4 39 2024-05-09T06:30:03.341 INFO:tasks.workunit.client.0.smithi062.stdout:5/831: creat d0/d8/d47/f110 x:0 0 0 2024-05-09T06:30:03.341 INFO:tasks.workunit.client.0.smithi062.stdout:5/832: fsync d0/d8/d1c/d2c/d7d/d4a/f93 0 2024-05-09T06:30:03.341 INFO:tasks.workunit.client.0.smithi062.stdout:5/833: fsync d0/d8/d1c/d23/d3e/f4d 0 2024-05-09T06:30:03.342 INFO:tasks.workunit.client.0.smithi062.stdout:5/834: write d0/d8/fea [181184,55081] 0 2024-05-09T06:30:03.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:03 smithi079 ceph-mon[35268]: pgmap v9: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 135 MiB/s rd, 167 MiB/s wr, 295 op/s 2024-05-09T06:30:03.343 INFO:tasks.workunit.client.0.smithi062.stdout:0/700: dread d1/d25/d49/d42/d43/d54/fba [0,4194304] 0 2024-05-09T06:30:03.349 INFO:tasks.workunit.client.0.smithi062.stdout:8/766: dread da/dea/f2d [0,4194304] 0 2024-05-09T06:30:03.349 INFO:tasks.workunit.client.0.smithi062.stdout:8/767: chown da/dea/d2e/d61/d64/feb 1 1 2024-05-09T06:30:03.349 INFO:tasks.workunit.client.0.smithi062.stdout:8/768: dread - da/dea/d2e/d61/d92/da5/fdd zero size 2024-05-09T06:30:03.349 INFO:tasks.workunit.client.0.smithi062.stdout:2/658: creat d0/d9/d17/d89/fd4 x:0 0 0 2024-05-09T06:30:03.351 INFO:tasks.workunit.client.0.smithi062.stdout:8/769: dread da/dea/d1c/ff4 [0,4194304] 0 2024-05-09T06:30:03.353 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:03 smithi062 ceph-mon[26920]: pgmap v9: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 135 MiB/s rd, 167 MiB/s wr, 295 op/s 2024-05-09T06:30:03.360 INFO:tasks.workunit.client.0.smithi062.stdout:8/770: dread da/dea/d2e/d61/d92/da5/fab [0,4194304] 0 2024-05-09T06:30:03.360 INFO:tasks.workunit.client.0.smithi062.stdout:8/771: fdatasync da/dea/d1c/fb0 0 2024-05-09T06:30:03.363 INFO:tasks.workunit.client.0.smithi062.stdout:4/738: creat d0/d2a/d8/d69/daf/fdb x:0 0 0 2024-05-09T06:30:03.365 INFO:tasks.workunit.client.0.smithi062.stdout:4/739: read d0/d3c/dae/db0/dbc/fb9 [44778,42789] 0 2024-05-09T06:30:03.366 INFO:tasks.workunit.client.0.smithi062.stdout:4/740: chown d0/c68 4 1 2024-05-09T06:30:03.366 INFO:tasks.workunit.client.0.smithi062.stdout:4/741: write d0/d9/f15 [16788,2219] 0 2024-05-09T06:30:03.368 INFO:tasks.workunit.client.0.smithi062.stdout:5/835: creat d0/d8/d18/f111 x:0 0 0 2024-05-09T06:30:03.369 INFO:tasks.workunit.client.0.smithi062.stdout:8/772: read da/d77/fe1 [4121832,35817] 0 2024-05-09T06:30:03.369 INFO:tasks.workunit.client.0.smithi062.stdout:8/773: dread - da/dea/d2e/fef zero size 2024-05-09T06:30:03.371 INFO:tasks.workunit.client.0.smithi062.stdout:0/701: symlink d1/d25/d49/d4f/d52/d87/dc8/l102 0 2024-05-09T06:30:03.371 INFO:tasks.workunit.client.0.smithi062.stdout:0/702: dread - d1/fdd zero size 2024-05-09T06:30:03.372 INFO:tasks.workunit.client.0.smithi062.stdout:9/713: sync 2024-05-09T06:30:03.372 INFO:tasks.workunit.client.0.smithi062.stdout:6/814: sync 2024-05-09T06:30:03.374 INFO:tasks.workunit.client.0.smithi062.stdout:2/659: creat d0/d9/dd/fd5 x:0 0 0 2024-05-09T06:30:03.376 INFO:tasks.workunit.client.0.smithi062.stdout:7/664: mknod d0/d3a/cda 0 2024-05-09T06:30:03.376 INFO:tasks.workunit.client.0.smithi062.stdout:7/665: chown d0/d3a 345 1 2024-05-09T06:30:03.376 INFO:tasks.workunit.client.0.smithi062.stdout:0/703: dread d1/d25/d31/f33 [0,4194304] 0 2024-05-09T06:30:03.378 INFO:tasks.workunit.client.0.smithi062.stdout:1/545: truncate d8/d1d/d91/f7e 3161264 0 2024-05-09T06:30:03.378 INFO:tasks.workunit.client.0.smithi062.stdout:1/546: chown d8/ld 103390442 1 2024-05-09T06:30:03.378 INFO:tasks.workunit.client.0.smithi062.stdout:1/547: write d8/d14/d2b/d3d/f90 [177847,43560] 0 2024-05-09T06:30:03.379 INFO:tasks.workunit.client.0.smithi062.stdout:4/742: rename d0/d2a/d1f/dc9/d81 to d0/d2a/d14/d4f/d6b/ddc 0 2024-05-09T06:30:03.384 INFO:tasks.workunit.client.0.smithi062.stdout:3/562: sync 2024-05-09T06:30:03.389 INFO:tasks.workunit.client.0.smithi062.stdout:7/666: creat d0/d12/d66/fdb x:0 0 0 2024-05-09T06:30:03.389 INFO:tasks.workunit.client.0.smithi062.stdout:7/667: fsync d0/d12/d33/f46 0 2024-05-09T06:30:03.391 INFO:tasks.workunit.client.0.smithi062.stdout:6/815: write dc/d28/d34/f59 [873390,54579] 0 2024-05-09T06:30:03.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/816: read dc/d28/d46/d3a/f4f [1277297,103449] 0 2024-05-09T06:30:03.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/817: write dc/d28/d34/db0/ffe [1019681,15308] 0 2024-05-09T06:30:03.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/818: stat dc/d28/d10/d20/db5/l58 0 2024-05-09T06:30:03.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/819: chown dc/l55 513367 1 2024-05-09T06:30:03.392 INFO:tasks.workunit.client.0.smithi062.stdout:6/820: stat dc/d28/d10/d20/db5/fa9 0 2024-05-09T06:30:03.392 INFO:tasks.workunit.client.0.smithi062.stdout:0/704: rmdir d1/d25/d31/d6c/d44/d6e/dae/dea 0 2024-05-09T06:30:03.392 INFO:tasks.workunit.client.0.smithi062.stdout:0/705: chown d1/d25/d31/d6c/d44/d57/d84 425531901 1 2024-05-09T06:30:03.392 INFO:tasks.workunit.client.0.smithi062.stdout:0/706: creat d1/d25/d31/d6c/d44/d57/d84/f103 x:0 0 0 2024-05-09T06:30:03.393 INFO:tasks.workunit.client.0.smithi062.stdout:0/707: write d1/d25/d31/d6c/d44/d57/d84/ff7 [396932,80508] 0 2024-05-09T06:30:03.393 INFO:tasks.workunit.client.0.smithi062.stdout:1/548: stat f6 0 2024-05-09T06:30:03.394 INFO:tasks.workunit.client.0.smithi062.stdout:0/708: read d1/d25/d31/f33 [793636,12418] 0 2024-05-09T06:30:03.394 INFO:tasks.workunit.client.0.smithi062.stdout:0/709: chown d1/d25/d49/d42/d43/fe3 535151083 1 2024-05-09T06:30:03.396 INFO:tasks.workunit.client.0.smithi062.stdout:4/743: rename d0/da9 to d0/d2a/d14/d4f/d6b/ddd 0 2024-05-09T06:30:03.396 INFO:tasks.workunit.client.0.smithi062.stdout:4/744: write d0/d3c/dae/db0/dbc/f58 [4650257,110104] 0 2024-05-09T06:30:03.397 INFO:tasks.workunit.client.0.smithi062.stdout:9/714: getdents d3/d3e/d52/d58/d1c/d1e/d41/d64/d31 0 2024-05-09T06:30:03.397 INFO:tasks.workunit.client.0.smithi062.stdout:9/715: fsync d3/d3e/d4b/d99/fa6 0 2024-05-09T06:30:03.397 INFO:tasks.workunit.client.0.smithi062.stdout:9/716: chown d3/d3e/d52/d58/d77/d92 1466 1 2024-05-09T06:30:03.399 INFO:tasks.workunit.client.0.smithi062.stdout:7/668: mknod d0/d3a/d51/d64/d6d/d80/dd8/cdc 0 2024-05-09T06:30:03.404 INFO:tasks.workunit.client.0.smithi062.stdout:9/717: unlink d3/d3e/d52/d58/d1c/d1e/d41/d64/cd7 0 2024-05-09T06:30:03.404 INFO:tasks.workunit.client.0.smithi062.stdout:9/718: chown d3/d3e/d52/d58/d1c/c46 8 1 2024-05-09T06:30:03.404 INFO:tasks.workunit.client.0.smithi062.stdout:9/719: mkdir d3/d20/dc7/dcd/dea 0 2024-05-09T06:30:03.411 INFO:tasks.workunit.client.0.smithi062.stdout:0/710: dread d1/d25/fa4 [0,4194304] 0 2024-05-09T06:30:03.412 INFO:tasks.workunit.client.0.smithi062.stdout:0/711: creat d1/d25/d31/d6c/d44/d57/db4/f104 x:0 0 0 2024-05-09T06:30:03.412 INFO:tasks.workunit.client.0.smithi062.stdout:0/712: chown d1/d25/d49/d4f/d52/c81 3 1 2024-05-09T06:30:03.414 INFO:tasks.workunit.client.0.smithi062.stdout:0/713: rename d1/d25/d49/d42/d43/d54/d9d/ld4 to d1/d25/d59/l105 0 2024-05-09T06:30:03.416 INFO:tasks.workunit.client.0.smithi062.stdout:0/714: truncate d1/d25/d31/d6c/d44/d57/f64 158317 0 2024-05-09T06:30:03.419 INFO:tasks.workunit.client.0.smithi062.stdout:4/745: dread d0/d2a/d1f/f70 [0,4194304] 0 2024-05-09T06:30:03.421 INFO:tasks.workunit.client.0.smithi062.stdout:7/669: dread d0/d3a/d51/f23 [0,4194304] 0 2024-05-09T06:30:03.421 INFO:tasks.workunit.client.0.smithi062.stdout:7/670: chown d0/d12/d33/d9f/ld9 0 1 2024-05-09T06:30:03.422 INFO:tasks.workunit.client.0.smithi062.stdout:7/671: write d0/d3a/d51/d64/d6d/d80/d8e/fd4 [915228,83537] 0 2024-05-09T06:30:03.422 INFO:tasks.workunit.client.0.smithi062.stdout:7/672: chown d0/f8 33730680 1 2024-05-09T06:30:03.422 INFO:tasks.workunit.client.0.smithi062.stdout:4/746: mknod d0/d3c/da1/cde 0 2024-05-09T06:30:03.422 INFO:tasks.workunit.client.0.smithi062.stdout:4/747: stat d0/d3c/dae/db0/dbc 0 2024-05-09T06:30:03.422 INFO:tasks.workunit.client.0.smithi062.stdout:4/748: chown d0/d2a/f8f 1 1 2024-05-09T06:30:03.422 INFO:tasks.workunit.client.0.smithi062.stdout:4/749: readlink d0/d2a/l49 0 2024-05-09T06:30:03.427 INFO:tasks.workunit.client.0.smithi062.stdout:7/673: mkdir d0/d12/d33/d67/da7/dcd/ddd 0 2024-05-09T06:30:03.427 INFO:tasks.workunit.client.0.smithi062.stdout:0/715: dread d1/d25/d49/d42/d43/f4e [4194304,4194304] 0 2024-05-09T06:30:03.429 INFO:tasks.workunit.client.0.smithi062.stdout:0/716: truncate d1/d25/d49/d42/d43/d54/fba 312642 0 2024-05-09T06:30:03.429 INFO:tasks.workunit.client.0.smithi062.stdout:1/549: dwrite d8/d14/f72 [0,4194304] 0 2024-05-09T06:30:03.432 INFO:tasks.workunit.client.0.smithi062.stdout:0/717: mknod d1/d25/d49/d42/dad/dbe/c106 0 2024-05-09T06:30:03.438 INFO:tasks.workunit.client.0.smithi062.stdout:6/821: dwrite dc/d28/d46/d4a/d5d/d6f/d76/fdc [0,4194304] 0 2024-05-09T06:30:03.441 INFO:tasks.workunit.client.0.smithi062.stdout:7/674: write d0/d12/f43 [2337635,59242] 0 2024-05-09T06:30:03.442 INFO:tasks.workunit.client.0.smithi062.stdout:7/675: dread d0/d12/d33/d67/da7/dcd/fb0 [0,4194304] 0 2024-05-09T06:30:03.446 INFO:tasks.workunit.client.0.smithi062.stdout:6/822: symlink dc/d28/d46/d4a/d5d/d6f/l116 0 2024-05-09T06:30:03.446 INFO:tasks.workunit.client.0.smithi062.stdout:6/823: fsync dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/feb 0 2024-05-09T06:30:03.446 INFO:tasks.workunit.client.0.smithi062.stdout:6/824: fdatasync dc/d28/f8c 0 2024-05-09T06:30:03.448 INFO:tasks.workunit.client.0.smithi062.stdout:9/720: dwrite d3/d3e/d52/d58/d1c/d21/f53 [0,4194304] 0 2024-05-09T06:30:03.448 INFO:tasks.workunit.client.0.smithi062.stdout:9/721: chown d3/d3e/d52/d58/d1c/d1e/d60/ce9 3635 1 2024-05-09T06:30:03.450 INFO:tasks.workunit.client.0.smithi062.stdout:4/750: dwrite d0/f57 [0,4194304] 0 2024-05-09T06:30:03.452 INFO:tasks.workunit.client.0.smithi062.stdout:7/676: link d0/d3a/d51/d64/d6d/fd0 d0/d3a/d3f/dab/fde 0 2024-05-09T06:30:03.452 INFO:tasks.workunit.client.0.smithi062.stdout:7/677: fsync d0/d3a/d51/d64/d6d/d80/fa3 0 2024-05-09T06:30:03.452 INFO:tasks.workunit.client.0.smithi062.stdout:7/678: fsync d0/d3a/d51/d64/d6d/d88/f8a 0 2024-05-09T06:30:03.452 INFO:tasks.workunit.client.0.smithi062.stdout:7/679: write d0/d3a/d51/d64/d6d/d80/d8e/fa0 [677137,76591] 0 2024-05-09T06:30:03.452 INFO:tasks.workunit.client.0.smithi062.stdout:7/680: write d0/d3a/d69/fc0 [3254289,28298] 0 2024-05-09T06:30:03.453 INFO:tasks.workunit.client.0.smithi062.stdout:7/681: write d0/f95 [275721,39905] 0 2024-05-09T06:30:03.453 INFO:tasks.workunit.client.0.smithi062.stdout:1/550: dwrite d8/d14/f1b [0,4194304] 0 2024-05-09T06:30:03.456 INFO:tasks.workunit.client.0.smithi062.stdout:6/825: mkdir dc/d28/d46/d81/d117 0 2024-05-09T06:30:03.456 INFO:tasks.workunit.client.0.smithi062.stdout:6/826: dread - dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/fb2 zero size 2024-05-09T06:30:03.465 INFO:tasks.workunit.client.0.smithi062.stdout:4/751: link d0/d2a/d1f/ld2 d0/d3c/da1/ldf 0 2024-05-09T06:30:03.470 INFO:tasks.workunit.client.0.smithi062.stdout:1/551: mkdir d8/d14/d2b/d3c/d44/d38/db6 0 2024-05-09T06:30:03.470 INFO:tasks.workunit.client.0.smithi062.stdout:1/552: chown d8/f3f 6 1 2024-05-09T06:30:03.472 INFO:tasks.workunit.client.0.smithi062.stdout:6/827: creat dc/f118 x:0 0 0 2024-05-09T06:30:03.472 INFO:tasks.workunit.client.0.smithi062.stdout:6/828: write dc/d28/d46/d3a/d7f/f113 [258720,130381] 0 2024-05-09T06:30:03.472 INFO:tasks.workunit.client.0.smithi062.stdout:6/829: readlink dc/d28/d46/l10c 0 2024-05-09T06:30:03.472 INFO:tasks.workunit.client.0.smithi062.stdout:6/830: write dc/d28/d34/db7/fdf [690091,39293] 0 2024-05-09T06:30:03.472 INFO:tasks.workunit.client.0.smithi062.stdout:4/752: creat d0/d2a/d14/d4f/d6b/ddd/fe0 x:0 0 0 2024-05-09T06:30:03.473 INFO:tasks.workunit.client.0.smithi062.stdout:1/553: rmdir d8/d14 39 2024-05-09T06:30:03.474 INFO:tasks.workunit.client.0.smithi062.stdout:6/831: creat dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/f119 x:0 0 0 2024-05-09T06:30:03.475 INFO:tasks.workunit.client.0.smithi062.stdout:4/753: mkdir d0/d2a/d14/d4f/de1 0 2024-05-09T06:30:03.476 INFO:tasks.workunit.client.0.smithi062.stdout:6/832: mknod dc/d28/d46/d3a/d7f/d8e/dc8/dcd/c11a 0 2024-05-09T06:30:03.476 INFO:tasks.workunit.client.0.smithi062.stdout:6/833: fsync dc/d28/d10/d20/db5/fa9 0 2024-05-09T06:30:03.476 INFO:tasks.workunit.client.0.smithi062.stdout:0/718: dwrite d1/d25/d31/d6c/fc2 [0,4194304] 0 2024-05-09T06:30:03.477 INFO:tasks.workunit.client.0.smithi062.stdout:7/682: dwrite d0/d12/d66/faa [0,4194304] 0 2024-05-09T06:30:03.478 INFO:tasks.workunit.client.0.smithi062.stdout:6/834: symlink dc/d28/d46/d3a/d7f/d91/d93/l11b 0 2024-05-09T06:30:03.483 INFO:tasks.workunit.client.0.smithi062.stdout:0/719: write d1/d6a/fbd [4128979,79427] 0 2024-05-09T06:30:03.494 INFO:tasks.workunit.client.0.smithi062.stdout:6/835: creat dc/d28/d46/d3a/d7f/d91/d93/d114/f11c x:0 0 0 2024-05-09T06:30:03.496 INFO:tasks.workunit.client.0.smithi062.stdout:1/554: dwrite d8/d1d/f25 [0,4194304] 0 2024-05-09T06:30:03.497 INFO:tasks.workunit.client.0.smithi062.stdout:6/836: creat dc/d28/d46/d81/f11d x:0 0 0 2024-05-09T06:30:03.498 INFO:tasks.workunit.client.0.smithi062.stdout:6/837: creat dc/d28/d46/d3a/d7f/f11e x:0 0 0 2024-05-09T06:30:03.499 INFO:tasks.workunit.client.0.smithi062.stdout:1/555: unlink d8/d14/d2b/d3c/d44/d38/f39 0 2024-05-09T06:30:03.502 INFO:tasks.workunit.client.0.smithi062.stdout:6/838: creat dc/d28/d34/d39/de0/db3/f11f x:0 0 0 2024-05-09T06:30:03.505 INFO:tasks.workunit.client.0.smithi062.stdout:6/839: rename dc/d28/d10/d20/f32 to dc/d28/d10/d20/db5/d10b/f120 0 2024-05-09T06:30:03.505 INFO:tasks.workunit.client.0.smithi062.stdout:6/840: dread - dc/d28/d10/d20/db5/d10b/fe9 zero size 2024-05-09T06:30:03.516 INFO:tasks.workunit.client.0.smithi062.stdout:1/556: dread d8/d1d/d91/f7e [0,4194304] 0 2024-05-09T06:30:03.518 INFO:tasks.workunit.client.0.smithi062.stdout:1/557: mknod d8/d1d/d9c/d41/cb7 0 2024-05-09T06:30:03.520 INFO:tasks.workunit.client.0.smithi062.stdout:4/754: dwrite d0/d2a/d14/d4f/f60 [0,4194304] 0 2024-05-09T06:30:03.528 INFO:tasks.workunit.client.0.smithi062.stdout:7/683: dwrite d0/d3a/d3f/f79 [0,4194304] 0 2024-05-09T06:30:03.529 INFO:tasks.workunit.client.0.smithi062.stdout:6/841: dwrite dc/d28/d34/d4e/d57/f65 [0,4194304] 0 2024-05-09T06:30:03.529 INFO:tasks.workunit.client.0.smithi062.stdout:6/842: dread - dc/d28/d10/f111 zero size 2024-05-09T06:30:03.529 INFO:tasks.workunit.client.0.smithi062.stdout:7/684: unlink d0/d12/d66/cad 0 2024-05-09T06:30:03.530 INFO:tasks.workunit.client.0.smithi062.stdout:1/558: dread d8/d14/d2b/d3c/d44/d6e/d7a/d80/fac [0,4194304] 0 2024-05-09T06:30:03.530 INFO:tasks.workunit.client.0.smithi062.stdout:1/559: creat d8/d14/d2b/d3c/d44/d6e/d7a/fb8 x:0 0 0 2024-05-09T06:30:03.534 INFO:tasks.workunit.client.0.smithi062.stdout:7/685: creat d0/fdf x:0 0 0 2024-05-09T06:30:03.537 INFO:tasks.workunit.client.0.smithi062.stdout:6/843: dread dc/d28/d34/d4e/d57/f75 [0,4194304] 0 2024-05-09T06:30:03.537 INFO:tasks.workunit.client.0.smithi062.stdout:6/844: dread - dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/f119 zero size 2024-05-09T06:30:03.537 INFO:tasks.workunit.client.0.smithi062.stdout:6/845: chown dc/l1f 146 1 2024-05-09T06:30:03.537 INFO:tasks.workunit.client.0.smithi062.stdout:0/720: dwrite d1/d25/d49/d42/d43/f7d [0,4194304] 0 2024-05-09T06:30:03.537 INFO:tasks.workunit.client.0.smithi062.stdout:4/755: dread d0/d2a/d14/d4f/f90 [0,4194304] 0 2024-05-09T06:30:03.537 INFO:tasks.workunit.client.0.smithi062.stdout:0/721: stat d1/d25/d31/db5 0 2024-05-09T06:30:03.541 INFO:tasks.workunit.client.0.smithi062.stdout:7/686: unlink d0/d3/l9 0 2024-05-09T06:30:03.543 INFO:tasks.workunit.client.0.smithi062.stdout:6/846: unlink dc/d28/d10/d20/cc9 0 2024-05-09T06:30:03.547 INFO:tasks.workunit.client.0.smithi062.stdout:1/560: dwrite d8/f2a [4194304,4194304] 0 2024-05-09T06:30:03.549 INFO:tasks.workunit.client.0.smithi062.stdout:0/722: unlink d1/d25/d31/d6c/d44/ff3 0 2024-05-09T06:30:03.551 INFO:tasks.workunit.client.0.smithi062.stdout:6/847: creat dc/d28/d34/db7/f121 x:0 0 0 2024-05-09T06:30:03.555 INFO:tasks.workunit.client.0.smithi062.stdout:1/561: symlink d8/d14/lb9 0 2024-05-09T06:30:03.557 INFO:tasks.workunit.client.0.smithi062.stdout:6/848: symlink dc/d28/d10/d20/d5b/d77/l122 0 2024-05-09T06:30:03.557 INFO:tasks.workunit.client.0.smithi062.stdout:6/849: write dc/d28/d10/d20/d5b/fc6 [3841902,103810] 0 2024-05-09T06:30:03.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/562: getdents d8/d14/d2b/d3c/d44/d6e/d98 0 2024-05-09T06:30:03.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/563: chown d8/d1d/d9c/d41/cb7 22719041 1 2024-05-09T06:30:03.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/564: creat d8/d14/d2b/d3c/d7d/fba x:0 0 0 2024-05-09T06:30:03.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/565: write d8/d14/d2b/d3c/f8f [674214,29169] 0 2024-05-09T06:30:03.559 INFO:tasks.workunit.client.0.smithi062.stdout:6/850: creat dc/d28/d46/d82/f123 x:0 0 0 2024-05-09T06:30:03.562 INFO:tasks.workunit.client.0.smithi062.stdout:1/566: rename d8/d1d/d9c/d41/f4f to d8/fbb 0 2024-05-09T06:30:03.562 INFO:tasks.workunit.client.0.smithi062.stdout:1/567: readlink d8/d14/d2b/d3c/d44/d7f/l88 0 2024-05-09T06:30:03.563 INFO:tasks.workunit.client.0.smithi062.stdout:6/851: mkdir dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/df8/d124 0 2024-05-09T06:30:03.565 INFO:tasks.workunit.client.0.smithi062.stdout:4/756: dwrite d0/d3c/dae/db0/dbc/f58 [0,4194304] 0 2024-05-09T06:30:03.568 INFO:tasks.workunit.client.0.smithi062.stdout:1/568: write d8/d1d/d9c/f50 [246242,16765] 0 2024-05-09T06:30:03.568 INFO:tasks.workunit.client.0.smithi062.stdout:7/687: dwrite d0/d3a/d51/d64/d6d/f98 [0,4194304] 0 2024-05-09T06:30:03.569 INFO:tasks.workunit.client.0.smithi062.stdout:0/723: dwrite d1/d25/d31/d6c/d44/d57/db4/f104 [0,4194304] 0 2024-05-09T06:30:03.571 INFO:tasks.workunit.client.0.smithi062.stdout:1/569: creat d8/d1d/d70/fbc x:0 0 0 2024-05-09T06:30:03.571 INFO:tasks.workunit.client.0.smithi062.stdout:1/570: stat d8/d1d/d9c/f50 0 2024-05-09T06:30:03.571 INFO:tasks.workunit.client.0.smithi062.stdout:1/571: write d8/d14/d2b/d3c/d44/f63 [794661,110377] 0 2024-05-09T06:30:03.571 INFO:tasks.workunit.client.0.smithi062.stdout:1/572: dread - d8/d14/d2b/d3c/d44/d6e/d7a/fa6 zero size 2024-05-09T06:30:03.571 INFO:tasks.workunit.client.0.smithi062.stdout:1/573: fdatasync d8/d14/d2b/d3c/d44/d6e/d7a/fb8 0 2024-05-09T06:30:03.585 INFO:tasks.workunit.client.0.smithi062.stdout:4/757: dwrite d0/d2a/d1f/f22 [4194304,4194304] 0 2024-05-09T06:30:03.585 INFO:tasks.workunit.client.0.smithi062.stdout:4/758: read d0/d3c/f5e [53313,7995] 0 2024-05-09T06:30:03.592 INFO:tasks.workunit.client.0.smithi062.stdout:0/724: mknod d1/d25/c107 0 2024-05-09T06:30:03.594 INFO:tasks.workunit.client.0.smithi062.stdout:4/759: creat d0/d9/dd1/fe2 x:0 0 0 2024-05-09T06:30:03.594 INFO:tasks.workunit.client.0.smithi062.stdout:4/760: chown d0/d2a/d1f/dc9/da0 5502579 1 2024-05-09T06:30:03.594 INFO:tasks.workunit.client.0.smithi062.stdout:4/761: chown d0/d9/f72 6142869 1 2024-05-09T06:30:03.594 INFO:tasks.workunit.client.0.smithi062.stdout:4/762: truncate d0/d2a/d1f/faa 216268 0 2024-05-09T06:30:03.595 INFO:tasks.workunit.client.0.smithi062.stdout:0/725: rmdir d1/d25/d31/d6c/d44/d6e 39 2024-05-09T06:30:03.595 INFO:tasks.workunit.client.0.smithi062.stdout:0/726: truncate d1/d25/d59/fa2 719866 0 2024-05-09T06:30:03.596 INFO:tasks.workunit.client.0.smithi062.stdout:4/763: dread d0/d3c/dae/db0/dbc/f39 [0,4194304] 0 2024-05-09T06:30:03.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/727: creat d1/d25/d31/d6c/d44/d57/f108 x:0 0 0 2024-05-09T06:30:03.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/728: read - d1/d6a/d6d/d93/d94/ffc zero size 2024-05-09T06:30:03.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/729: chown d1/d25/d49/d42/d43/d54/d9d/fab 746514 1 2024-05-09T06:30:03.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/730: chown d1/d25/d49/d4f/l55 8494 1 2024-05-09T06:30:03.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/731: dread - d1/d25/d49/d4f/d52/fc1 zero size 2024-05-09T06:30:03.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/732: fsync d1/d25/d49/d4f/d52/d7b/fd1 0 2024-05-09T06:30:03.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/733: write d1/d25/d49/d4f/d52/d7b/fd1 [348642,120004] 0 2024-05-09T06:30:03.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/734: fsync d1/f11 0 2024-05-09T06:30:03.599 INFO:tasks.workunit.client.0.smithi062.stdout:4/764: rename d0/d2a/d8/d69/daf/c93 to d0/d2a/d14/d4f/d6b/ce3 0 2024-05-09T06:30:03.600 INFO:tasks.workunit.client.0.smithi062.stdout:7/688: dwrite d0/d12/d33/d9f/fb2 [0,4194304] 0 2024-05-09T06:30:03.600 INFO:tasks.workunit.client.0.smithi062.stdout:1/574: dwrite d8/d14/d2b/d3c/f8f [0,4194304] 0 2024-05-09T06:30:03.603 INFO:tasks.workunit.client.0.smithi062.stdout:0/735: rename d1/d25/d49/d7e/cbb to d1/d25/d31/d6c/c109 0 2024-05-09T06:30:03.609 INFO:tasks.workunit.client.0.smithi062.stdout:7/689: write d0/d12/d33/f3b [4972176,91237] 0 2024-05-09T06:30:03.610 INFO:tasks.workunit.client.0.smithi062.stdout:1/575: dread d8/d14/d2b/d3c/d44/d7f/fa8 [0,4194304] 0 2024-05-09T06:30:03.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/765: dwrite d0/d2a/d14/d4f/f9c [0,4194304] 0 2024-05-09T06:30:03.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/766: getdents d0/d3c/dc1 0 2024-05-09T06:30:03.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/767: truncate d0/d2a/d14/d4f/d6b/fc8 627343 0 2024-05-09T06:30:03.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/768: stat d0/d2a/d8/l20 0 2024-05-09T06:30:03.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/769: stat d0/d2a/d1f/dc9/da0 0 2024-05-09T06:30:03.615 INFO:tasks.workunit.client.0.smithi062.stdout:1/576: unlink d8/d14/d2b/d3c/d7d/f87 0 2024-05-09T06:30:03.622 INFO:tasks.workunit.client.0.smithi062.stdout:7/690: write d0/d12/f71 [383088,105818] 0 2024-05-09T06:30:03.622 INFO:tasks.workunit.client.0.smithi062.stdout:7/691: stat d0/d3a/d3f/fb3 0 2024-05-09T06:30:03.629 INFO:tasks.workunit.client.0.smithi062.stdout:4/770: link d0/d3c/l66 d0/d2a/d14/d4f/d6b/ddc/le4 0 2024-05-09T06:30:03.631 INFO:tasks.workunit.client.0.smithi062.stdout:1/577: rename d8/d14/d2b/d9d/faf to d8/d1d/d70/fbd 0 2024-05-09T06:30:03.631 INFO:tasks.workunit.client.0.smithi062.stdout:1/578: fsync d8/d14/f72 0 2024-05-09T06:30:03.634 INFO:tasks.workunit.client.0.smithi062.stdout:7/692: creat d0/d3a/d51/d64/d6d/d80/dd8/fe0 x:0 0 0 2024-05-09T06:30:03.636 INFO:tasks.workunit.client.0.smithi062.stdout:4/771: write d0/d3c/fbb [1514446,96541] 0 2024-05-09T06:30:03.636 INFO:tasks.workunit.client.0.smithi062.stdout:4/772: chown d0/l1 1761915634 1 2024-05-09T06:30:03.637 INFO:tasks.workunit.client.0.smithi062.stdout:1/579: mkdir d8/d14/d2b/d3c/d44/d38/dbe 0 2024-05-09T06:30:03.639 INFO:tasks.workunit.client.0.smithi062.stdout:7/693: truncate d0/f95 241501 0 2024-05-09T06:30:03.641 INFO:tasks.workunit.client.0.smithi062.stdout:4/773: link d0/d2a/d14/d4f/f60 d0/d2a/d14/d4f/d6b/ddc/fe5 0 2024-05-09T06:30:03.644 INFO:tasks.workunit.client.0.smithi062.stdout:4/774: mknod d0/d9/dd1/ce6 0 2024-05-09T06:30:03.646 INFO:tasks.workunit.client.0.smithi062.stdout:1/580: dread d8/f13 [0,4194304] 0 2024-05-09T06:30:03.648 INFO:tasks.workunit.client.0.smithi062.stdout:4/775: unlink d0/d2a/d14/d4f/f90 0 2024-05-09T06:30:03.650 INFO:tasks.workunit.client.0.smithi062.stdout:4/776: rename d0/d2a/l61 to d0/d2a/d1f/dd5/le7 0 2024-05-09T06:30:03.656 INFO:tasks.workunit.client.0.smithi062.stdout:7/694: dwrite d0/d3a/d51/d64/d6d/d80/dd8/fe0 [0,4194304] 0 2024-05-09T06:30:03.660 INFO:tasks.workunit.client.0.smithi062.stdout:1/581: write d8/f2a [7113992,94395] 0 2024-05-09T06:30:03.661 INFO:tasks.workunit.client.0.smithi062.stdout:7/695: creat d0/d3a/d51/d64/d6d/d88/dc7/fe1 x:0 0 0 2024-05-09T06:30:03.664 INFO:tasks.workunit.client.0.smithi062.stdout:4/777: dwrite d0/d3c/dae/db0/dbc/fb9 [0,4194304] 0 2024-05-09T06:30:03.665 INFO:tasks.workunit.client.0.smithi062.stdout:1/582: unlink d8/d1d/d9c/f9b 0 2024-05-09T06:30:03.671 INFO:tasks.workunit.client.0.smithi062.stdout:4/778: mkdir d0/d9/de8 0 2024-05-09T06:30:03.672 INFO:tasks.workunit.client.0.smithi062.stdout:4/779: dread d0/fb8 [0,4194304] 0 2024-05-09T06:30:03.673 INFO:tasks.workunit.client.0.smithi062.stdout:1/583: creat d8/d14/d2b/fbf x:0 0 0 2024-05-09T06:30:03.673 INFO:tasks.workunit.client.0.smithi062.stdout:1/584: fsync d8/d1d/f58 0 2024-05-09T06:30:03.676 INFO:tasks.workunit.client.0.smithi062.stdout:1/585: mkdir d8/d14/d2b/d3c/d44/d6e/d98/dc0 0 2024-05-09T06:30:03.683 INFO:tasks.workunit.client.0.smithi062.stdout:7/696: dwrite d0/d12/d33/d67/da7/dcd/fd3 [0,4194304] 0 2024-05-09T06:30:03.689 INFO:tasks.workunit.client.0.smithi062.stdout:7/697: unlink d0/d3a/d51/c57 0 2024-05-09T06:30:03.691 INFO:tasks.workunit.client.0.smithi062.stdout:7/698: creat d0/da8/fe2 x:0 0 0 2024-05-09T06:30:03.691 INFO:tasks.workunit.client.0.smithi062.stdout:4/780: dwrite d0/d2a/d14/fcd [0,4194304] 0 2024-05-09T06:30:03.691 INFO:tasks.workunit.client.0.smithi062.stdout:7/699: creat d0/d3a/d3f/dab/fe3 x:0 0 0 2024-05-09T06:30:03.692 INFO:tasks.workunit.client.0.smithi062.stdout:4/781: truncate d0/d9/f15 583960 0 2024-05-09T06:30:03.692 INFO:tasks.workunit.client.0.smithi062.stdout:7/700: fsync d0/d3a/d51/d64/d6d/fd0 0 2024-05-09T06:30:03.695 INFO:tasks.workunit.client.0.smithi062.stdout:7/701: dread d0/d12/d66/d9e/fa9 [0,4194304] 0 2024-05-09T06:30:03.696 INFO:tasks.workunit.client.0.smithi062.stdout:7/702: fsync d0/d12/d33/d67/da7/dcd/fb0 0 2024-05-09T06:30:03.696 INFO:tasks.workunit.client.0.smithi062.stdout:7/703: truncate d0/d12/f71 5183849 0 2024-05-09T06:30:03.696 INFO:tasks.workunit.client.0.smithi062.stdout:4/782: getdents d0 0 2024-05-09T06:30:03.696 INFO:tasks.workunit.client.0.smithi062.stdout:4/783: truncate d0/d9/dd1/fe2 750958 0 2024-05-09T06:30:03.698 INFO:tasks.workunit.client.0.smithi062.stdout:7/704: mkdir d0/d12/d33/d67/da7/de4 0 2024-05-09T06:30:03.700 INFO:tasks.workunit.client.0.smithi062.stdout:4/784: write d0/d2a/d1f/d6c/f95 [1725436,67703] 0 2024-05-09T06:30:03.714 INFO:tasks.workunit.client.0.smithi062.stdout:4/785: creat d0/d2a/d14/d7e/fe9 x:0 0 0 2024-05-09T06:30:03.721 INFO:tasks.workunit.client.0.smithi062.stdout:4/786: dread d0/d2a/f25 [0,4194304] 0 2024-05-09T06:30:03.722 INFO:tasks.workunit.client.0.smithi062.stdout:4/787: symlink d0/d2a/d1f/d6c/lea 0 2024-05-09T06:30:03.722 INFO:tasks.workunit.client.0.smithi062.stdout:5/836: sync 2024-05-09T06:30:03.723 INFO:tasks.workunit.client.0.smithi062.stdout:4/788: creat d0/d3c/da1/feb x:0 0 0 2024-05-09T06:30:03.724 INFO:tasks.workunit.client.0.smithi062.stdout:5/837: creat d0/d8/d47/dbe/d86/da4/f112 x:0 0 0 2024-05-09T06:30:03.727 INFO:tasks.workunit.client.0.smithi062.stdout:4/789: rename d0/d2a/d1f/d6c/fbd to d0/d2a/d1f/dc9/da0/fec 0 2024-05-09T06:30:03.727 INFO:tasks.workunit.client.0.smithi062.stdout:4/790: readlink d0/d2a/d1f/ld2 0 2024-05-09T06:30:03.728 INFO:tasks.workunit.client.0.smithi062.stdout:5/838: rmdir d0/d8/d1c/d2c 39 2024-05-09T06:30:03.728 INFO:tasks.workunit.client.0.smithi062.stdout:5/839: fdatasync d0/d8/d1c/d2c/d7d/fa9 0 2024-05-09T06:30:03.730 INFO:tasks.workunit.client.0.smithi062.stdout:5/840: symlink d0/d8/l113 0 2024-05-09T06:30:03.731 INFO:tasks.workunit.client.0.smithi062.stdout:5/841: mknod d0/d8/d1c/d23/c114 0 2024-05-09T06:30:03.735 INFO:tasks.workunit.client.0.smithi062.stdout:5/842: rename d0/d3b/d3f/cb5 to d0/d8/d107/c115 0 2024-05-09T06:30:03.738 INFO:tasks.workunit.client.0.smithi062.stdout:7/705: dwrite d0/d12/d33/f5e [0,4194304] 0 2024-05-09T06:30:03.741 INFO:tasks.workunit.client.0.smithi062.stdout:4/791: dread d0/d2a/d14/d7e/d8e/d9e/d28/f71 [0,4194304] 0 2024-05-09T06:30:03.742 INFO:tasks.workunit.client.0.smithi062.stdout:4/792: creat d0/d2a/d14/d4f/d6b/dca/fed x:0 0 0 2024-05-09T06:30:03.743 INFO:tasks.workunit.client.0.smithi062.stdout:4/793: mknod d0/d3c/dae/db0/cee 0 2024-05-09T06:30:03.743 INFO:tasks.workunit.client.0.smithi062.stdout:4/794: chown d0/d2a/d1f/d6c/fb7 38217234 1 2024-05-09T06:30:03.745 INFO:tasks.workunit.client.0.smithi062.stdout:4/795: rename d0/d2a/d14/d7e/lda to d0/d2a/d14/d7e/d8e/d9e/d86/d94/lef 0 2024-05-09T06:30:03.748 INFO:tasks.workunit.client.0.smithi062.stdout:7/706: write d0/d3a/d51/d64/d6d/f98 [3759635,9098] 0 2024-05-09T06:30:03.756 INFO:tasks.workunit.client.0.smithi062.stdout:5/843: dwrite d0/d8/fea [0,4194304] 0 2024-05-09T06:30:03.756 INFO:tasks.workunit.client.0.smithi062.stdout:5/844: creat d0/f116 x:0 0 0 2024-05-09T06:30:03.761 INFO:tasks.workunit.client.0.smithi062.stdout:4/796: rename d0/d2a/d14/d4f/de1 to d0/d5b/dc5/df0 0 2024-05-09T06:30:03.762 INFO:tasks.workunit.client.0.smithi062.stdout:7/707: write d0/d3a/d51/d64/d6d/d80/dd8/fe0 [3372746,119937] 0 2024-05-09T06:30:03.765 INFO:tasks.workunit.client.0.smithi062.stdout:5/845: mknod d0/d8/d47/dbe/d45/c117 0 2024-05-09T06:30:03.765 INFO:tasks.workunit.client.0.smithi062.stdout:5/846: dread - d0/f116 zero size 2024-05-09T06:30:03.765 INFO:tasks.workunit.client.0.smithi062.stdout:5/847: chown d0/d8/f52 24089 1 2024-05-09T06:30:03.766 INFO:tasks.workunit.client.0.smithi062.stdout:5/848: read d0/d8/f100 [232613,20661] 0 2024-05-09T06:30:03.766 INFO:tasks.workunit.client.0.smithi062.stdout:5/849: write d0/d8/d47/dbe/d45/da5/ff9 [246473,52384] 0 2024-05-09T06:30:03.768 INFO:tasks.workunit.client.0.smithi062.stdout:4/797: truncate d0/d2a/d1f/f70 1890751 0 2024-05-09T06:30:03.768 INFO:tasks.workunit.client.0.smithi062.stdout:4/798: chown d0/d2a/d1f 2118 1 2024-05-09T06:30:03.771 INFO:tasks.workunit.client.0.smithi062.stdout:7/708: unlink d0/d3a/d3f/ccb 0 2024-05-09T06:30:03.776 INFO:tasks.workunit.client.0.smithi062.stdout:7/709: creat d0/d12/fe5 x:0 0 0 2024-05-09T06:30:03.788 INFO:tasks.workunit.client.0.smithi062.stdout:5/850: dwrite d0/d3b/f8b [0,4194304] 0 2024-05-09T06:30:03.788 INFO:tasks.workunit.client.0.smithi062.stdout:5/851: fdatasync d0/d8/d47/dbe/d5/fe7 0 2024-05-09T06:30:03.807 INFO:tasks.workunit.client.0.smithi062.stdout:5/852: dwrite d0/d8/d18/f111 [0,4194304] 0 2024-05-09T06:30:03.811 INFO:tasks.workunit.client.0.smithi062.stdout:5/853: creat d0/d8/d47/dbe/d5/dbf/f118 x:0 0 0 2024-05-09T06:30:03.814 INFO:tasks.workunit.client.0.smithi062.stdout:5/854: rename d0/d8/d47/dbe/l2e to d0/d3b/d3f/l119 0 2024-05-09T06:30:03.814 INFO:tasks.workunit.client.0.smithi062.stdout:5/855: fdatasync d0/f28 0 2024-05-09T06:30:03.816 INFO:tasks.workunit.client.0.smithi062.stdout:5/856: mknod d0/d8/d1c/c11a 0 2024-05-09T06:30:03.966 INFO:tasks.workunit.client.0.smithi062.stdout:8/774: sync 2024-05-09T06:30:03.966 INFO:tasks.workunit.client.0.smithi062.stdout:8/775: readlink da/dea/d2e/d34/l81 0 2024-05-09T06:30:03.966 INFO:tasks.workunit.client.0.smithi062.stdout:8/776: fdatasync da/d85/fe4 0 2024-05-09T06:30:03.966 INFO:tasks.workunit.client.0.smithi062.stdout:8/777: write da/dea/d1c/ff4 [1607479,20501] 0 2024-05-09T06:30:03.968 INFO:tasks.workunit.client.0.smithi062.stdout:8/778: rename da/fc7 to da/dea/d2e/d7e/ff5 0 2024-05-09T06:30:03.970 INFO:tasks.workunit.client.0.smithi062.stdout:8/779: symlink da/dea/d2e/d61/lf6 0 2024-05-09T06:30:03.984 INFO:tasks.workunit.client.0.smithi062.stdout:8/780: write da/dea/d2e/f70 [707532,113902] 0 2024-05-09T06:30:03.999 INFO:tasks.workunit.client.0.smithi062.stdout:8/781: read da/dea/f29 [6638468,59101] 0 2024-05-09T06:30:04.021 INFO:tasks.workunit.client.0.smithi062.stdout:8/782: dwrite da/dea/d2e/d61/d64/f69 [0,4194304] 0 2024-05-09T06:30:04.026 INFO:tasks.workunit.client.0.smithi062.stdout:8/783: rename da/dea/d2e/d61/d64/ld1 to da/dea/d1c/d9e/d9f/da7/lf7 0 2024-05-09T06:30:04.029 INFO:tasks.workunit.client.0.smithi062.stdout:8/784: symlink da/dea/d2e/d61/d92/lf8 0 2024-05-09T06:30:04.043 INFO:tasks.workunit.client.0.smithi062.stdout:8/785: dwrite da/dea/d2e/d34/d90/fd5 [4194304,4194304] 0 2024-05-09T06:30:04.049 INFO:tasks.workunit.client.0.smithi062.stdout:8/786: link da/dea/f89 da/dea/d1c/de0/ff9 0 2024-05-09T06:30:04.052 INFO:tasks.workunit.client.0.smithi062.stdout:8/787: mknod da/dea/d2e/d34/cfa 0 2024-05-09T06:30:04.052 INFO:tasks.workunit.client.0.smithi062.stdout:8/788: stat da/dea/f58 0 2024-05-09T06:30:04.053 INFO:tasks.workunit.client.0.smithi062.stdout:8/789: write da/dea/d1c/d9e/d9f/da7/fb7 [629594,50344] 0 2024-05-09T06:30:04.053 INFO:tasks.workunit.client.0.smithi062.stdout:8/790: fdatasync da/dea/d2e/d34/dd4/dbb/fe8 0 2024-05-09T06:30:04.054 INFO:tasks.workunit.client.0.smithi062.stdout:8/791: mknod da/d85/cfb 0 2024-05-09T06:30:04.057 INFO:tasks.workunit.client.0.smithi062.stdout:8/792: creat da/dea/d1c/d9e/ffc x:0 0 0 2024-05-09T06:30:04.057 INFO:tasks.workunit.client.0.smithi062.stdout:8/793: readlink da/l50 0 2024-05-09T06:30:04.060 INFO:tasks.workunit.client.0.smithi062.stdout:8/794: mkdir da/df0/dfd 0 2024-05-09T06:30:04.060 INFO:tasks.workunit.client.0.smithi062.stdout:8/795: chown da/dea/d2e/d61/d64/c93 112820 1 2024-05-09T06:30:04.061 INFO:tasks.workunit.client.0.smithi062.stdout:8/796: mknod da/df0/cfe 0 2024-05-09T06:30:04.062 INFO:tasks.workunit.client.0.smithi062.stdout:8/797: symlink da/dea/d1c/de0/lff 0 2024-05-09T06:30:04.062 INFO:tasks.workunit.client.0.smithi062.stdout:8/798: write da/dea/d1c/ff4 [450551,5953] 0 2024-05-09T06:30:04.063 INFO:tasks.workunit.client.0.smithi062.stdout:8/799: mknod da/dea/d2e/d34/dd4/dbb/c100 0 2024-05-09T06:30:04.064 INFO:tasks.workunit.client.0.smithi062.stdout:8/800: mknod da/c101 0 2024-05-09T06:30:04.066 INFO:tasks.workunit.client.0.smithi062.stdout:8/801: creat da/dea/d2e/d34/d90/f102 x:0 0 0 2024-05-09T06:30:04.066 INFO:tasks.workunit.client.0.smithi062.stdout:8/802: write da/df0/ff3 [500549,22250] 0 2024-05-09T06:30:04.069 INFO:tasks.workunit.client.0.smithi062.stdout:8/803: rename da/dea/d2e/d61/d64/f69 to da/dea/d2e/d61/f103 0 2024-05-09T06:30:04.072 INFO:tasks.workunit.client.0.smithi062.stdout:8/804: creat da/dea/d2e/d61/d92/f104 x:0 0 0 2024-05-09T06:30:04.072 INFO:tasks.workunit.client.0.smithi062.stdout:8/805: fdatasync da/dea/d2e/fca 0 2024-05-09T06:30:04.128 INFO:tasks.workunit.client.0.smithi062.stdout:2/660: sync 2024-05-09T06:30:04.128 INFO:tasks.workunit.client.0.smithi062.stdout:2/661: fsync d0/d9/dd/f33 0 2024-05-09T06:30:04.128 INFO:tasks.workunit.client.0.smithi062.stdout:2/662: read d0/f39 [11886512,129826] 0 2024-05-09T06:30:04.128 INFO:tasks.workunit.client.0.smithi062.stdout:2/663: write d0/d9/dd/d65/d6d/d21/d29/d3d/fae [135019,75667] 0 2024-05-09T06:30:04.130 INFO:tasks.workunit.client.0.smithi062.stdout:2/664: rename d0/d9/d38/d41/db1/dba to d0/d9/d38/dd6 0 2024-05-09T06:30:04.131 INFO:tasks.workunit.client.0.smithi062.stdout:2/665: stat d0/d9/dd/d65/d6d/d96/da4/cbc 0 2024-05-09T06:30:04.131 INFO:tasks.workunit.client.0.smithi062.stdout:2/666: creat d0/d9/d38/fd7 x:0 0 0 2024-05-09T06:30:04.134 INFO:tasks.workunit.client.0.smithi062.stdout:2/667: creat d0/d9/d38/d41/d53/fd8 x:0 0 0 2024-05-09T06:30:04.134 INFO:tasks.workunit.client.0.smithi062.stdout:2/668: dread - d0/d9/d38/d41/fb0 zero size 2024-05-09T06:30:04.146 INFO:tasks.workunit.client.0.smithi062.stdout:2/669: rename d0/d9/dd/d65/d6d/d7e/d8d to d0/d9/dd9 0 2024-05-09T06:30:04.278 INFO:tasks.workunit.client.0.smithi062.stdout:6/852: sync 2024-05-09T06:30:04.278 INFO:tasks.workunit.client.0.smithi062.stdout:9/722: sync 2024-05-09T06:30:04.278 INFO:tasks.workunit.client.0.smithi062.stdout:9/723: stat d3/d3e/d52 0 2024-05-09T06:30:04.278 INFO:tasks.workunit.client.0.smithi062.stdout:3/563: sync 2024-05-09T06:30:04.278 INFO:tasks.workunit.client.0.smithi062.stdout:9/724: write d3/d3e/d7c/fe3 [328945,51619] 0 2024-05-09T06:30:04.279 INFO:tasks.workunit.client.0.smithi062.stdout:6/853: unlink dc/d28/d46/d82/f123 0 2024-05-09T06:30:04.281 INFO:tasks.workunit.client.0.smithi062.stdout:9/725: rename d3/d3e/d4b/db4 to d3/deb 0 2024-05-09T06:30:04.284 INFO:tasks.workunit.client.0.smithi062.stdout:6/854: dread dc/f2a [0,4194304] 0 2024-05-09T06:30:04.287 INFO:tasks.workunit.client.0.smithi062.stdout:6/855: fsync dc/d28/d10/f4b 0 2024-05-09T06:30:04.287 INFO:tasks.workunit.client.0.smithi062.stdout:6/856: fsync dc/d28/d46/d4a/d5d/fca 0 2024-05-09T06:30:04.294 INFO:tasks.workunit.client.0.smithi062.stdout:6/857: dread dc/d28/d34/d4e/d57/d102/fbc [0,4194304] 0 2024-05-09T06:30:04.297 INFO:tasks.workunit.client.0.smithi062.stdout:9/726: dwrite d3/d3e/d52/d58/f32 [0,4194304] 0 2024-05-09T06:30:04.300 INFO:tasks.workunit.client.0.smithi062.stdout:6/858: mknod dc/d28/d10/d20/d5b/da3/c125 0 2024-05-09T06:30:04.301 INFO:tasks.workunit.client.0.smithi062.stdout:6/859: write dc/d28/d10/d20/d5b/f6a [1537462,122670] 0 2024-05-09T06:30:04.304 INFO:tasks.workunit.client.0.smithi062.stdout:9/727: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/dc8/fec x:0 0 0 2024-05-09T06:30:04.304 INFO:tasks.workunit.client.0.smithi062.stdout:9/728: fdatasync d3/f98 0 2024-05-09T06:30:04.313 INFO:tasks.workunit.client.0.smithi062.stdout:9/729: read d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 [2083675,84124] 0 2024-05-09T06:30:04.320 INFO:tasks.workunit.client.0.smithi062.stdout:9/730: dread d3/d3e/d52/d58/f8e [0,4194304] 0 2024-05-09T06:30:04.321 INFO:tasks.workunit.client.0.smithi062.stdout:6/860: dwrite dc/d28/d46/d3a/d7f/d91/d93/dc0/f4d [0,4194304] 0 2024-05-09T06:30:04.322 INFO:tasks.workunit.client.0.smithi062.stdout:9/731: unlink d3/d3e/d52/d58/d77/cb1 0 2024-05-09T06:30:04.323 INFO:tasks.workunit.client.0.smithi062.stdout:6/861: symlink dc/d28/d10/d20/d5b/l126 0 2024-05-09T06:30:04.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/862: rename dc/d28/d46/d4a/dbf to dc/d28/d10/d103/d127 0 2024-05-09T06:30:04.332 INFO:tasks.workunit.client.0.smithi062.stdout:9/732: write d3/d3e/d52/d58/d1c/d1e/f4c [2369338,87998] 0 2024-05-09T06:30:04.332 INFO:tasks.workunit.client.0.smithi062.stdout:9/733: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/dd0/fed x:0 0 0 2024-05-09T06:30:04.335 INFO:tasks.workunit.client.0.smithi062.stdout:9/734: truncate d3/d3e/d52/d58/d1c/f87 179549 0 2024-05-09T06:30:04.337 INFO:tasks.workunit.client.0.smithi062.stdout:9/735: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/fee x:0 0 0 2024-05-09T06:30:04.337 INFO:tasks.workunit.client.0.smithi062.stdout:9/736: chown d3/d3e/d52/d58/d1c/d1e/d41/d64/c49 157817 1 2024-05-09T06:30:04.346 INFO:tasks.workunit.client.0.smithi062.stdout:6/863: dwrite dc/d28/d46/f64 [4194304,4194304] 0 2024-05-09T06:30:04.355 INFO:tasks.workunit.client.0.smithi062.stdout:6/864: dread dc/fd [0,4194304] 0 2024-05-09T06:30:04.369 INFO:tasks.workunit.client.0.smithi062.stdout:9/737: dwrite d3/d3e/d52/d58/fd3 [0,4194304] 0 2024-05-09T06:30:04.370 INFO:tasks.workunit.client.0.smithi062.stdout:6/865: write dc/d28/d10/f4b [940537,83385] 0 2024-05-09T06:30:04.378 INFO:tasks.workunit.client.0.smithi062.stdout:9/738: rename d3/f6 to d3/d3e/d52/d58/fef 0 2024-05-09T06:30:04.384 INFO:tasks.workunit.client.0.smithi062.stdout:6/866: dwrite dc/d28/d46/d3a/d7f/d91/d93/dc0/f67 [4194304,4194304] 0 2024-05-09T06:30:04.387 INFO:tasks.workunit.client.0.smithi062.stdout:6/867: mkdir dc/d28/d46/d3a/d7f/d91/d93/d114/d128 0 2024-05-09T06:30:04.388 INFO:tasks.workunit.client.0.smithi062.stdout:6/868: mknod dc/d28/d10/d20/d5b/da3/d10f/c129 0 2024-05-09T06:30:04.388 INFO:tasks.workunit.client.0.smithi062.stdout:6/869: fsync dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/f119 0 2024-05-09T06:30:04.389 INFO:tasks.workunit.client.0.smithi062.stdout:6/870: write dc/d28/d10/f111 [882864,70837] 0 2024-05-09T06:30:04.389 INFO:tasks.workunit.client.0.smithi062.stdout:6/871: stat dc/d28/d46/d81/d117 0 2024-05-09T06:30:04.390 INFO:tasks.workunit.client.0.smithi062.stdout:6/872: link dc/d28/d46/d4a/d5d/d6f/d76/fdc dc/d28/d46/d3a/d7f/f12a 0 2024-05-09T06:30:04.390 INFO:tasks.workunit.client.0.smithi062.stdout:6/873: fdatasync dc/d28/d10/d20/fb9 0 2024-05-09T06:30:04.390 INFO:tasks.workunit.client.0.smithi062.stdout:6/874: chown dc/d28/d34/db0 11 1 2024-05-09T06:30:04.390 INFO:tasks.workunit.client.0.smithi062.stdout:6/875: truncate dc/d28/d10/d20/db5/d10b/fe9 610271 0 2024-05-09T06:30:04.390 INFO:tasks.workunit.client.0.smithi062.stdout:6/876: stat dc/d28/d10/d20/c36 0 2024-05-09T06:30:04.391 INFO:tasks.workunit.client.0.smithi062.stdout:6/877: unlink dc/d28/d10/d20/d5b/l7e 0 2024-05-09T06:30:04.413 INFO:tasks.workunit.client.0.smithi062.stdout:9/739: dwrite d3/d3e/d7c/f7e [0,4194304] 0 2024-05-09T06:30:04.540 INFO:tasks.workunit.client.0.smithi062.stdout:0/736: sync 2024-05-09T06:30:04.540 INFO:tasks.workunit.client.0.smithi062.stdout:1/586: sync 2024-05-09T06:30:04.540 INFO:tasks.workunit.client.0.smithi062.stdout:1/587: write d8/d1d/d9c/d41/f55 [9272381,44869] 0 2024-05-09T06:30:04.540 INFO:tasks.workunit.client.0.smithi062.stdout:1/588: fsync d8/d14/d2b/d3c/f8f 0 2024-05-09T06:30:04.540 INFO:tasks.workunit.client.0.smithi062.stdout:1/589: fsync f6 0 2024-05-09T06:30:04.557 INFO:tasks.workunit.client.0.smithi062.stdout:0/737: dwrite d1/d25/d31/d6c/d44/d6e/fb8 [0,4194304] 0 2024-05-09T06:30:04.564 INFO:tasks.workunit.client.0.smithi062.stdout:5/857: sync 2024-05-09T06:30:04.564 INFO:tasks.workunit.client.0.smithi062.stdout:4/799: sync 2024-05-09T06:30:04.564 INFO:tasks.workunit.client.0.smithi062.stdout:7/710: sync 2024-05-09T06:30:04.564 INFO:tasks.workunit.client.0.smithi062.stdout:4/800: chown d0/d2a/d1f/d6c/lea 229340936 1 2024-05-09T06:30:04.564 INFO:tasks.workunit.client.0.smithi062.stdout:5/858: readlink d0/d8/d47/dbe/d45/da5/le1 0 2024-05-09T06:30:04.565 INFO:tasks.workunit.client.0.smithi062.stdout:4/801: chown d0/d2a/d14/d7e/d8e/d9e/c33 3198 1 2024-05-09T06:30:04.565 INFO:tasks.workunit.client.0.smithi062.stdout:7/711: truncate d0/f8d 939968 0 2024-05-09T06:30:04.565 INFO:tasks.workunit.client.0.smithi062.stdout:8/806: sync 2024-05-09T06:30:04.565 INFO:tasks.workunit.client.0.smithi062.stdout:3/564: sync 2024-05-09T06:30:04.565 INFO:tasks.workunit.client.0.smithi062.stdout:7/712: chown d0/d3a/d51/d64/d6d/d80/dd8 54164936 1 2024-05-09T06:30:04.565 INFO:tasks.workunit.client.0.smithi062.stdout:2/670: sync 2024-05-09T06:30:04.566 INFO:tasks.workunit.client.0.smithi062.stdout:5/859: creat d0/d8/d18/da6/f11b x:0 0 0 2024-05-09T06:30:04.573 INFO:tasks.workunit.client.0.smithi062.stdout:7/713: write d0/d3a/d3f/f56 [3558438,47797] 0 2024-05-09T06:30:04.668 INFO:tasks.workunit.client.0.smithi062.stdout:1/590: symlink d8/d14/d2b/d3c/d44/d7f/lc1 0 2024-05-09T06:30:04.668 INFO:tasks.workunit.client.0.smithi062.stdout:1/591: write d8/d14/d2b/d3d/f90 [584131,11523] 0 2024-05-09T06:30:04.668 INFO:tasks.workunit.client.0.smithi062.stdout:1/592: fdatasync d8/d14/d2b/d3c/db0/fb1 0 2024-05-09T06:30:04.671 INFO:tasks.workunit.client.0.smithi062.stdout:0/738: truncate d1/d25/d49/d4f/de6/f9e 1170171 0 2024-05-09T06:30:04.671 INFO:tasks.workunit.client.0.smithi062.stdout:0/739: write d1/d25/d31/ffd [616081,6795] 0 2024-05-09T06:30:04.680 INFO:tasks.workunit.client.0.smithi062.stdout:8/807: unlink da/dea/d1c/l86 0 2024-05-09T06:30:04.682 INFO:tasks.workunit.client.0.smithi062.stdout:3/565: symlink d1/d1e/d36/d6c/lb4 0 2024-05-09T06:30:04.682 INFO:tasks.workunit.client.0.smithi062.stdout:3/566: stat d1/d1e/d36/d3a/d97 0 2024-05-09T06:30:04.684 INFO:tasks.workunit.client.0.smithi062.stdout:5/860: rename d0/d8/d1c/d23/f29 to d0/d8/d1c/d2c/de8/f11c 0 2024-05-09T06:30:04.684 INFO:tasks.workunit.client.0.smithi062.stdout:5/861: fdatasync d0/d8/d47/dbe/d45/f76 0 2024-05-09T06:30:04.686 INFO:tasks.workunit.client.0.smithi062.stdout:0/740: dwrite d1/d25/d49/d42/fed [0,4194304] 0 2024-05-09T06:30:04.688 INFO:tasks.workunit.client.0.smithi062.stdout:4/802: mkdir d0/d2a/d8/df1 0 2024-05-09T06:30:04.688 INFO:tasks.workunit.client.0.smithi062.stdout:4/803: fdatasync d0/d2a/d14/d4f/d6b/ddc/fc2 0 2024-05-09T06:30:04.694 INFO:tasks.workunit.client.0.smithi062.stdout:3/567: symlink d1/d1e/d36/lb5 0 2024-05-09T06:30:04.694 INFO:tasks.workunit.client.0.smithi062.stdout:3/568: chown d1/d1e/d36/d9f/d4f/c7d 10 1 2024-05-09T06:30:04.694 INFO:tasks.workunit.client.0.smithi062.stdout:3/569: chown d1/d1e/d26/d43/d52 33661761 1 2024-05-09T06:30:04.698 INFO:tasks.workunit.client.0.smithi062.stdout:8/808: rename da/dea/l75 to da/dea/d2e/d61/d92/da5/daf/l105 0 2024-05-09T06:30:04.698 INFO:tasks.workunit.client.0.smithi062.stdout:5/862: rename d0/d8 to d0/d8/d18/d11d 22 2024-05-09T06:30:04.712 INFO:tasks.workunit.client.0.smithi062.stdout:4/804: symlink d0/d9/dd1/lf2 0 2024-05-09T06:30:04.713 INFO:tasks.workunit.client.0.smithi062.stdout:0/741: rename d1/d25/d49/d42/d43/d54/d9d/fb6 to d1/d6a/d6d/d93/d94/f10a 0 2024-05-09T06:30:04.714 INFO:tasks.workunit.client.0.smithi062.stdout:0/742: fsync d1/d25/d31/f33 0 2024-05-09T06:30:04.716 INFO:tasks.workunit.client.0.smithi062.stdout:4/805: creat d0/d2a/d14/d7e/d8e/d9e/d28/ff3 x:0 0 0 2024-05-09T06:30:04.718 INFO:tasks.workunit.client.0.smithi062.stdout:3/570: dwrite d1/d1e/d36/d9f/d4f/f6f [0,4194304] 0 2024-05-09T06:30:04.718 INFO:tasks.workunit.client.0.smithi062.stdout:5/863: dwrite d0/fa7 [8388608,4194304] 0 2024-05-09T06:30:04.719 INFO:tasks.workunit.client.0.smithi062.stdout:0/743: link d1/d6a/d6d/d93/fde d1/d25/d49/d42/dad/dbe/f10b 0 2024-05-09T06:30:04.719 INFO:tasks.workunit.client.0.smithi062.stdout:0/744: stat d1/d25/d49/d42/dad/dbe/f10b 0 2024-05-09T06:30:04.719 INFO:tasks.workunit.client.0.smithi062.stdout:0/745: chown d1/f2a 150673 1 2024-05-09T06:30:04.719 INFO:tasks.workunit.client.0.smithi062.stdout:0/746: chown d1/f11 63557237 1 2024-05-09T06:30:04.719 INFO:tasks.workunit.client.0.smithi062.stdout:0/747: readlink d1/d25/d31/d6c/d44/d6e/dae/lec 0 2024-05-09T06:30:04.724 INFO:tasks.workunit.client.0.smithi062.stdout:5/864: mknod d0/d8/d1c/d2c/de8/c11e 0 2024-05-09T06:30:04.724 INFO:tasks.workunit.client.0.smithi062.stdout:5/865: chown d0/f5c 1696 1 2024-05-09T06:30:04.727 INFO:tasks.workunit.client.0.smithi062.stdout:5/866: mknod d0/d3b/d3f/c11f 0 2024-05-09T06:30:04.727 INFO:tasks.workunit.client.0.smithi062.stdout:5/867: truncate d0/d11/fab 585595 0 2024-05-09T06:30:04.729 INFO:tasks.workunit.client.0.smithi062.stdout:4/806: dread d0/f46 [0,4194304] 0 2024-05-09T06:30:04.730 INFO:tasks.workunit.client.0.smithi062.stdout:4/807: rmdir d0/d9 39 2024-05-09T06:30:04.732 INFO:tasks.workunit.client.0.smithi062.stdout:4/808: mknod d0/d2a/d1f/cf4 0 2024-05-09T06:30:04.734 INFO:tasks.workunit.client.0.smithi062.stdout:4/809: creat d0/d2a/d1f/dc9/da0/ff5 x:0 0 0 2024-05-09T06:30:04.747 INFO:tasks.workunit.client.0.smithi062.stdout:4/810: dread d0/d3c/dae/db0/dbc/f77 [0,4194304] 0 2024-05-09T06:30:04.747 INFO:tasks.workunit.client.0.smithi062.stdout:3/571: dwrite d1/d1e/d26/d43/d92/f40 [0,4194304] 0 2024-05-09T06:30:04.747 INFO:tasks.workunit.client.0.smithi062.stdout:3/572: chown d1/d48/c61 224507 1 2024-05-09T06:30:04.747 INFO:tasks.workunit.client.0.smithi062.stdout:5/868: dwrite d0/d8/d47/dbe/d86/dae/ff6 [0,4194304] 0 2024-05-09T06:30:04.752 INFO:tasks.workunit.client.0.smithi062.stdout:3/573: dread d1/d1e/d26/f3c [0,4194304] 0 2024-05-09T06:30:04.754 INFO:tasks.workunit.client.0.smithi062.stdout:3/574: dread d1/d1e/d54/f63 [0,4194304] 0 2024-05-09T06:30:04.754 INFO:tasks.workunit.client.0.smithi062.stdout:3/575: fsync d1/d1e/d26/f3c 0 2024-05-09T06:30:04.756 INFO:tasks.workunit.client.0.smithi062.stdout:3/576: rename d1/c5f to d1/d1e/d54/cb6 0 2024-05-09T06:30:04.757 INFO:tasks.workunit.client.0.smithi062.stdout:5/869: dread d0/d3b/f8b [0,4194304] 0 2024-05-09T06:30:04.758 INFO:tasks.workunit.client.0.smithi062.stdout:3/577: unlink d1/d1e/d36/d9f/c8a 0 2024-05-09T06:30:04.760 INFO:tasks.workunit.client.0.smithi062.stdout:5/870: mkdir d0/d8/d47/d6e/d120 0 2024-05-09T06:30:04.767 INFO:tasks.workunit.client.0.smithi062.stdout:4/811: dwrite d0/d2a/d14/d7e/d8e/d9e/d86/fc3 [0,4194304] 0 2024-05-09T06:30:04.771 INFO:tasks.workunit.client.0.smithi062.stdout:5/871: mknod d0/d8/c121 0 2024-05-09T06:30:04.777 INFO:tasks.workunit.client.0.smithi062.stdout:5/872: rmdir d0/d8/d47/d6e/d120 0 2024-05-09T06:30:04.777 INFO:tasks.workunit.client.0.smithi062.stdout:5/873: creat d0/d8/d18/f122 x:0 0 0 2024-05-09T06:30:04.777 INFO:tasks.workunit.client.0.smithi062.stdout:5/874: readlink d0/d8/l113 0 2024-05-09T06:30:04.777 INFO:tasks.workunit.client.0.smithi062.stdout:5/875: fsync d0/d8/d1c/d2c/d7d/d4a/dd7/fe6 0 2024-05-09T06:30:04.777 INFO:tasks.workunit.client.0.smithi062.stdout:5/876: truncate d0/fa7 13252525 0 2024-05-09T06:30:04.777 INFO:tasks.workunit.client.0.smithi062.stdout:4/812: read d0/d2a/d1f/dc9/f79 [1136317,67040] 0 2024-05-09T06:30:04.779 INFO:tasks.workunit.client.0.smithi062.stdout:3/578: dwrite d1/d1e/f10 [0,4194304] 0 2024-05-09T06:30:04.780 INFO:tasks.workunit.client.0.smithi062.stdout:4/813: unlink d0/d2a/d8/cd0 0 2024-05-09T06:30:04.783 INFO:tasks.workunit.client.0.smithi062.stdout:3/579: rename d1/d1e/d36/d3a/f4d to d1/d1e/d26/d43/d52/d6a/fb7 0 2024-05-09T06:30:04.785 INFO:tasks.workunit.client.0.smithi062.stdout:5/877: write d0/d8/d47/dbe/d45/d92/f9b [647305,114824] 0 2024-05-09T06:30:04.785 INFO:tasks.workunit.client.0.smithi062.stdout:5/878: dread - d0/d8/d47/fd6 zero size 2024-05-09T06:30:04.786 INFO:tasks.workunit.client.0.smithi062.stdout:5/879: chown d0/d3b/d3f/c11f 447874185 1 2024-05-09T06:30:04.786 INFO:tasks.workunit.client.0.smithi062.stdout:4/814: mknod d0/d2a/d14/d7e/d8e/d9e/d28/cf6 0 2024-05-09T06:30:04.786 INFO:tasks.workunit.client.0.smithi062.stdout:7/714: symlink d0/d3a/d51/d64/le6 0 2024-05-09T06:30:04.790 INFO:tasks.workunit.client.0.smithi062.stdout:5/880: rename d0/d8/d18/da6/dee/df5/cff to d0/d8/d47/dbe/d86/da4/dce/dbd/c123 0 2024-05-09T06:30:04.791 INFO:tasks.workunit.client.0.smithi062.stdout:7/715: dread d0/d12/f24 [0,4194304] 0 2024-05-09T06:30:04.791 INFO:tasks.workunit.client.0.smithi062.stdout:7/716: dread - d0/d3a/d51/d64/d6d/d88/dc7/fe1 zero size 2024-05-09T06:30:04.791 INFO:tasks.workunit.client.0.smithi062.stdout:7/717: write d0/f95 [408851,116087] 0 2024-05-09T06:30:04.791 INFO:tasks.workunit.client.0.smithi062.stdout:7/718: dread - d0/d3a/d3f/fb3 zero size 2024-05-09T06:30:04.791 INFO:tasks.workunit.client.0.smithi062.stdout:4/815: link d0/d2a/d14/d7e/d8e/d9e/d28/ff3 d0/d3c/dae/ff7 0 2024-05-09T06:30:04.793 INFO:tasks.workunit.client.0.smithi062.stdout:7/719: read d0/d3a/f5f [713686,80113] 0 2024-05-09T06:30:04.793 INFO:tasks.workunit.client.0.smithi062.stdout:7/720: readlink d0/d3a/d51/d64/d6d/d80/ld6 0 2024-05-09T06:30:04.794 INFO:tasks.workunit.client.0.smithi062.stdout:5/881: creat d0/d8/d47/dbe/d45/df0/f124 x:0 0 0 2024-05-09T06:30:04.795 INFO:tasks.workunit.client.0.smithi062.stdout:4/816: mknod d0/d2a/d14/d7e/d8e/d9e/cf8 0 2024-05-09T06:30:04.795 INFO:tasks.workunit.client.0.smithi062.stdout:4/817: write d0/d2a/f25 [1555102,94110] 0 2024-05-09T06:30:04.799 INFO:tasks.workunit.client.0.smithi062.stdout:7/721: mkdir d0/d3a/d51/d64/d6d/dac/de7 0 2024-05-09T06:30:04.800 INFO:tasks.workunit.client.0.smithi062.stdout:3/580: dwrite d1/d1e/d36/d4a/f68 [0,4194304] 0 2024-05-09T06:30:04.803 INFO:tasks.workunit.client.0.smithi062.stdout:4/818: link d0/d2a/d14/d7e/d8e/fd9 d0/d3c/ff9 0 2024-05-09T06:30:04.803 INFO:tasks.workunit.client.0.smithi062.stdout:4/819: chown d0/d2a/d14/d4f/ca8 662198 1 2024-05-09T06:30:04.804 INFO:tasks.workunit.client.0.smithi062.stdout:7/722: link d0/d12/fe5 d0/d12/d33/d67/fe8 0 2024-05-09T06:30:04.808 INFO:tasks.workunit.client.0.smithi062.stdout:8/809: symlink da/dea/d2e/d61/d92/l106 0 2024-05-09T06:30:04.808 INFO:tasks.workunit.client.0.smithi062.stdout:8/810: read - da/dea/d1c/de0/fe6 zero size 2024-05-09T06:30:04.810 INFO:tasks.workunit.client.0.smithi062.stdout:3/581: dread d1/d1e/fa2 [0,4194304] 0 2024-05-09T06:30:04.812 INFO:tasks.workunit.client.0.smithi062.stdout:5/882: dwrite d0/fa7 [8388608,4194304] 0 2024-05-09T06:30:04.814 INFO:tasks.workunit.client.0.smithi062.stdout:4/820: creat d0/d3c/dae/ffa x:0 0 0 2024-05-09T06:30:04.814 INFO:tasks.workunit.client.0.smithi062.stdout:4/821: dread d0/d2a/d14/d4f/d6b/fc8 [0,4194304] 0 2024-05-09T06:30:04.815 INFO:tasks.workunit.client.0.smithi062.stdout:7/723: symlink d0/d3a/d69/le9 0 2024-05-09T06:30:04.816 INFO:tasks.workunit.client.0.smithi062.stdout:0/748: unlink d1/d6a/d6d/l92 0 2024-05-09T06:30:04.817 INFO:tasks.workunit.client.0.smithi062.stdout:8/811: creat da/dea/d2e/d34/ddf/f107 x:0 0 0 2024-05-09T06:30:04.817 INFO:tasks.workunit.client.0.smithi062.stdout:8/812: chown da/dea/d2e/f70 14495 1 2024-05-09T06:30:04.817 INFO:tasks.workunit.client.0.smithi062.stdout:8/813: chown da/dea/d2e/fca 940714163 1 2024-05-09T06:30:04.818 INFO:tasks.workunit.client.0.smithi062.stdout:3/582: mknod d1/d1e/d26/d43/cb8 0 2024-05-09T06:30:04.822 INFO:tasks.workunit.client.0.smithi062.stdout:5/883: creat d0/d8/d18/da6/dee/f125 x:0 0 0 2024-05-09T06:30:04.823 INFO:tasks.workunit.client.0.smithi062.stdout:7/724: creat d0/d3a/d51/d64/d6d/d80/fea x:0 0 0 2024-05-09T06:30:04.825 INFO:tasks.workunit.client.0.smithi062.stdout:0/749: mknod d1/d6a/d6d/d93/c10c 0 2024-05-09T06:30:04.827 INFO:tasks.workunit.client.0.smithi062.stdout:5/884: creat d0/d8/d47/dbe/d45/da5/dcf/d109/f126 x:0 0 0 2024-05-09T06:30:04.829 INFO:tasks.workunit.client.0.smithi062.stdout:7/725: rename d0/d3a/d51/d64/d6d/d88/cb6 to d0/d3a/d51/d64/d6d/dac/ceb 0 2024-05-09T06:30:04.830 INFO:tasks.workunit.client.0.smithi062.stdout:0/750: rmdir d1/d25/d49/d4f/d52/d87/dc8 39 2024-05-09T06:30:04.833 INFO:tasks.workunit.client.0.smithi062.stdout:5/885: unlink d0/d8/d47/d6e/ld9 0 2024-05-09T06:30:04.833 INFO:tasks.workunit.client.0.smithi062.stdout:5/886: creat d0/d8/f127 x:0 0 0 2024-05-09T06:30:04.834 INFO:tasks.workunit.client.0.smithi062.stdout:7/726: mkdir d0/d12/d66/d9e/dec 0 2024-05-09T06:30:04.834 INFO:tasks.workunit.client.0.smithi062.stdout:7/727: fsync d0/d3a/d3f/f81 0 2024-05-09T06:30:04.835 INFO:tasks.workunit.client.0.smithi062.stdout:0/751: mkdir d1/d25/d49/d4f/d10d 0 2024-05-09T06:30:04.835 INFO:tasks.workunit.client.0.smithi062.stdout:0/752: write d1/d25/d49/d4f/de6/f37 [636851,8425] 0 2024-05-09T06:30:04.837 INFO:tasks.workunit.client.0.smithi062.stdout:0/753: write d1/d25/d49/d42/d43/d54/d9d/fab [634285,110993] 0 2024-05-09T06:30:04.837 INFO:tasks.workunit.client.0.smithi062.stdout:0/754: stat d1/f51 0 2024-05-09T06:30:04.837 INFO:tasks.workunit.client.0.smithi062.stdout:0/755: truncate d1/d6a/d6d/fd8 578010 0 2024-05-09T06:30:04.839 INFO:tasks.workunit.client.0.smithi062.stdout:5/887: rename d0/d8/d47/dbe/d86/da4/dce/dbd/d10f to d0/d8/d1c/d23/d3e/de9/d128 0 2024-05-09T06:30:04.839 INFO:tasks.workunit.client.0.smithi062.stdout:5/888: chown d0/d11/d67/l104 540 1 2024-05-09T06:30:04.839 INFO:tasks.workunit.client.0.smithi062.stdout:5/889: creat d0/d8/d47/dbe/d45/da5/f129 x:0 0 0 2024-05-09T06:30:04.839 INFO:tasks.workunit.client.0.smithi062.stdout:5/890: chown d0/d8/d47/dbe/d45/da5/f129 7710 1 2024-05-09T06:30:04.839 INFO:tasks.workunit.client.0.smithi062.stdout:5/891: getdents d0/d8/d47/dbe/d86/da4/d105 0 2024-05-09T06:30:04.839 INFO:tasks.workunit.client.0.smithi062.stdout:5/892: write d0/d8/d1c/d2c/d7d/d4a/dd7/fe5 [1898482,119077] 0 2024-05-09T06:30:04.840 INFO:tasks.workunit.client.0.smithi062.stdout:0/756: dread d1/d25/d49/d42/dad/dbe/fcf [0,4194304] 0 2024-05-09T06:30:04.850 INFO:tasks.workunit.client.0.smithi062.stdout:6/878: sync 2024-05-09T06:30:04.851 INFO:tasks.workunit.client.0.smithi062.stdout:7/728: write d0/f1e [2355792,93445] 0 2024-05-09T06:30:04.855 INFO:tasks.workunit.client.0.smithi062.stdout:7/729: symlink d0/d3a/led 0 2024-05-09T06:30:04.855 INFO:tasks.workunit.client.0.smithi062.stdout:0/757: dread d1/f19 [0,4194304] 0 2024-05-09T06:30:04.859 INFO:tasks.workunit.client.0.smithi062.stdout:7/730: mknod d0/d12/d66/d9e/cee 0 2024-05-09T06:30:04.863 INFO:tasks.workunit.client.0.smithi062.stdout:4/822: dwrite d0/d2a/d14/d4f/d6b/dca/fed [0,4194304] 0 2024-05-09T06:30:04.865 INFO:tasks.workunit.client.0.smithi062.stdout:0/758: dread d1/f2a [0,4194304] 0 2024-05-09T06:30:04.870 INFO:tasks.workunit.client.0.smithi062.stdout:8/814: dwrite da/dea/d1c/f3e [0,4194304] 0 2024-05-09T06:30:04.870 INFO:tasks.workunit.client.0.smithi062.stdout:5/893: dwrite d0/f116 [0,4194304] 0 2024-05-09T06:30:04.871 INFO:tasks.workunit.client.0.smithi062.stdout:4/823: link d0/d3c/da1/feb d0/d2a/d14/d7e/ffb 0 2024-05-09T06:30:04.873 INFO:tasks.workunit.client.0.smithi062.stdout:0/759: link d1/d25/d31/d6c/d44/d57/db4/ld9 d1/d25/d49/d4f/d52/d7b/l10e 0 2024-05-09T06:30:04.875 INFO:tasks.workunit.client.0.smithi062.stdout:8/815: truncate da/dea/d2e/d34/d90/fa3 1782774 0 2024-05-09T06:30:04.875 INFO:tasks.workunit.client.0.smithi062.stdout:8/816: chown da/dea/l7c 106798340 1 2024-05-09T06:30:04.875 INFO:tasks.workunit.client.0.smithi062.stdout:8/817: fsync da/dea/d1c/de0/ff9 0 2024-05-09T06:30:04.877 INFO:tasks.workunit.client.0.smithi062.stdout:0/760: symlink d1/d25/d49/d42/l10f 0 2024-05-09T06:30:04.879 INFO:tasks.workunit.client.0.smithi062.stdout:0/761: link d1/d25/d59/f65 d1/d25/d31/d6c/d44/dca/f110 0 2024-05-09T06:30:04.883 INFO:tasks.workunit.client.0.smithi062.stdout:4/824: dread d0/d2a/d14/d7e/d8e/d9e/d28/f71 [0,4194304] 0 2024-05-09T06:30:04.886 INFO:tasks.workunit.client.0.smithi062.stdout:3/583: getdents d1/d1e/d26/d43 0 2024-05-09T06:30:04.886 INFO:tasks.workunit.client.0.smithi062.stdout:3/584: dread - d1/d1e/d26/d43/d92/fb2 zero size 2024-05-09T06:30:04.887 INFO:tasks.workunit.client.0.smithi062.stdout:3/585: readlink d1/d1e/d36/d3a/d4e/l5c 0 2024-05-09T06:30:04.887 INFO:tasks.workunit.client.0.smithi062.stdout:8/818: dread da/dea/d2e/d7e/d83/fce [0,4194304] 0 2024-05-09T06:30:04.888 INFO:tasks.workunit.client.0.smithi062.stdout:3/586: symlink d1/d1e/d36/d4a/d51/lb9 0 2024-05-09T06:30:04.889 INFO:tasks.workunit.client.0.smithi062.stdout:8/819: rename da/dea/l7c to da/dea/d2e/d7e/l108 0 2024-05-09T06:30:04.891 INFO:tasks.workunit.client.0.smithi062.stdout:7/731: dwrite d0/d3a/f7b [0,4194304] 0 2024-05-09T06:30:04.892 INFO:tasks.workunit.client.0.smithi062.stdout:8/820: rename da/dea/d2e/d61/d64/ca6 to da/dea/c109 0 2024-05-09T06:30:04.892 INFO:tasks.workunit.client.0.smithi062.stdout:0/762: write d1/d25/d31/d6c/d44/d57/db4/f104 [359594,64928] 0 2024-05-09T06:30:04.894 INFO:tasks.workunit.client.0.smithi062.stdout:8/821: mkdir da/dea/d10a 0 2024-05-09T06:30:04.895 INFO:tasks.workunit.client.0.smithi062.stdout:8/822: creat da/d77/f10b x:0 0 0 2024-05-09T06:30:04.895 INFO:tasks.workunit.client.0.smithi062.stdout:8/823: chown da/dea/d2e/d61/lec 42638493 1 2024-05-09T06:30:04.896 INFO:tasks.workunit.client.0.smithi062.stdout:6/879: dwrite dc/d28/d34/d4e/fbe [0,4194304] 0 2024-05-09T06:30:04.896 INFO:tasks.workunit.client.0.smithi062.stdout:5/894: dwrite d0/d8/d47/dbe/d45/da5/dcf/d109/f126 [0,4194304] 0 2024-05-09T06:30:04.897 INFO:tasks.workunit.client.0.smithi062.stdout:7/732: rename d0/d3a/d3f/cc6 to d0/d3a/d3f/cef 0 2024-05-09T06:30:04.900 INFO:tasks.workunit.client.0.smithi062.stdout:8/824: rename da/d95/cbd to da/dea/d2e/d7e/d83/c10c 0 2024-05-09T06:30:04.902 INFO:tasks.workunit.client.0.smithi062.stdout:6/880: symlink dc/d28/d46/d3a/d7f/d91/l12b 0 2024-05-09T06:30:04.902 INFO:tasks.workunit.client.0.smithi062.stdout:0/763: dread d1/fc [0,4194304] 0 2024-05-09T06:30:04.902 INFO:tasks.workunit.client.0.smithi062.stdout:0/764: chown d1/d25/d49/d4f/de6/faf 37133191 1 2024-05-09T06:30:04.915 INFO:tasks.workunit.client.0.smithi062.stdout:9/740: sync 2024-05-09T06:30:04.915 INFO:tasks.workunit.client.0.smithi062.stdout:2/671: sync 2024-05-09T06:30:04.916 INFO:tasks.workunit.client.0.smithi062.stdout:1/593: sync 2024-05-09T06:30:04.918 INFO:tasks.workunit.client.0.smithi062.stdout:1/594: write d8/d14/d2b/d3c/d44/d38/f77 [287929,76928] 0 2024-05-09T06:30:04.918 INFO:tasks.workunit.client.0.smithi062.stdout:1/595: creat d8/d1d/d70/fc2 x:0 0 0 2024-05-09T06:30:04.920 INFO:tasks.workunit.client.0.smithi062.stdout:9/741: dread d3/d3e/d4b/f5c [0,4194304] 0 2024-05-09T06:30:04.920 INFO:tasks.workunit.client.0.smithi062.stdout:9/742: write d3/d3e/d52/d58/d1c/d1e/d41/d64/fc1 [971583,70327] 0 2024-05-09T06:30:04.922 INFO:tasks.workunit.client.0.smithi062.stdout:7/733: rename d0/d3a/d51/d64/d6d/d88/fc3 to d0/d12/d66/ff0 0 2024-05-09T06:30:04.922 INFO:tasks.workunit.client.0.smithi062.stdout:7/734: fdatasync d0/d3a/d51/d64/d6d/f97 0 2024-05-09T06:30:04.922 INFO:tasks.workunit.client.0.smithi062.stdout:7/735: truncate d0/d12/d33/d67/da7/dcd/fb0 985752 0 2024-05-09T06:30:04.924 INFO:tasks.workunit.client.0.smithi062.stdout:2/672: dread d0/fa [0,4194304] 0 2024-05-09T06:30:04.924 INFO:tasks.workunit.client.0.smithi062.stdout:2/673: chown d0/d9/d38/d41/d48/d5f/l81 543228343 1 2024-05-09T06:30:04.924 INFO:tasks.workunit.client.0.smithi062.stdout:4/825: dwrite d0/d2a/d14/d4f/d6b/ddc/fe5 [4194304,4194304] 0 2024-05-09T06:30:04.924 INFO:tasks.workunit.client.0.smithi062.stdout:2/674: truncate d0/d9/d38/d41/d48/d5f/fc8 977140 0 2024-05-09T06:30:04.924 INFO:tasks.workunit.client.0.smithi062.stdout:4/826: dread - d0/d2a/d8/d69/f8b zero size 2024-05-09T06:30:04.924 INFO:tasks.workunit.client.0.smithi062.stdout:4/827: getdents d0/d2a/d14/d4f/da7 0 2024-05-09T06:30:04.924 INFO:tasks.workunit.client.0.smithi062.stdout:8/825: truncate da/f28 2189731 0 2024-05-09T06:30:04.929 INFO:tasks.workunit.client.0.smithi062.stdout:1/596: getdents d8/d14/d2b/d3c/d44/d6e 0 2024-05-09T06:30:04.929 INFO:tasks.workunit.client.0.smithi062.stdout:1/597: readlink d8/ld 0 2024-05-09T06:30:04.931 INFO:tasks.workunit.client.0.smithi062.stdout:3/587: dwrite d1/d1e/d26/d43/f9e [4194304,4194304] 0 2024-05-09T06:30:04.931 INFO:tasks.workunit.client.0.smithi062.stdout:0/765: dwrite d1/d6a/d6d/d93/d94/ffc [0,4194304] 0 2024-05-09T06:30:04.931 INFO:tasks.workunit.client.0.smithi062.stdout:0/766: getdents d1/d25/d49/d4f/d52 0 2024-05-09T06:30:04.931 INFO:tasks.workunit.client.0.smithi062.stdout:0/767: chown d1/d25/d31/d6c/d44/d57/f64 6745 1 2024-05-09T06:30:04.931 INFO:tasks.workunit.client.0.smithi062.stdout:0/768: fdatasync d1/d25/fa4 0 2024-05-09T06:30:04.932 INFO:tasks.workunit.client.0.smithi062.stdout:9/743: mknod d3/d3e/d4b/da2/cf0 0 2024-05-09T06:30:04.934 INFO:tasks.workunit.client.0.smithi062.stdout:1/598: dread d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 [0,4194304] 0 2024-05-09T06:30:04.934 INFO:tasks.workunit.client.0.smithi062.stdout:6/881: rename dc/d28/d34/d4e/d57/f75 to dc/d28/d46/d4a/d5d/f12c 0 2024-05-09T06:30:04.936 INFO:tasks.workunit.client.0.smithi062.stdout:8/826: truncate da/dea/d2e/d34/fb4 4324311 0 2024-05-09T06:30:04.938 INFO:tasks.workunit.client.0.smithi062.stdout:2/675: dread d0/d9/dd/d65/f71 [0,4194304] 0 2024-05-09T06:30:04.938 INFO:tasks.workunit.client.0.smithi062.stdout:2/676: fsync d0/d9/d38/d41/d48/f4b 0 2024-05-09T06:30:04.938 INFO:tasks.workunit.client.0.smithi062.stdout:2/677: fsync d0/d9/dd/d65/d6d/d21/f55 0 2024-05-09T06:30:04.938 INFO:tasks.workunit.client.0.smithi062.stdout:2/678: write d0/f78 [4031802,102890] 0 2024-05-09T06:30:04.938 INFO:tasks.workunit.client.0.smithi062.stdout:2/679: fdatasync d0/d9/dd/d65/d6d/d21/fa3 0 2024-05-09T06:30:04.938 INFO:tasks.workunit.client.0.smithi062.stdout:6/882: write dc/d28/d10/d20/f51 [135924,122133] 0 2024-05-09T06:30:04.942 INFO:tasks.workunit.client.0.smithi062.stdout:3/588: link d1/d1e/d26/d43/d92/d77/l8d d1/d1e/d36/d3a/d97/lba 0 2024-05-09T06:30:04.942 INFO:tasks.workunit.client.0.smithi062.stdout:3/589: chown d1/d1e/d36/d3a/d4e/l5c 937845020 1 2024-05-09T06:30:04.942 INFO:tasks.workunit.client.0.smithi062.stdout:3/590: chown d1/d1e/d36/d9f/l74 37 1 2024-05-09T06:30:04.942 INFO:tasks.workunit.client.0.smithi062.stdout:3/591: truncate d1/f55 4337341 0 2024-05-09T06:30:04.943 INFO:tasks.workunit.client.0.smithi062.stdout:9/744: mknod d3/d3e/d52/d58/d1c/d1e/d41/d64/cf1 0 2024-05-09T06:30:04.943 INFO:tasks.workunit.client.0.smithi062.stdout:7/736: dwrite d0/d3a/f5f [0,4194304] 0 2024-05-09T06:30:04.943 INFO:tasks.workunit.client.0.smithi062.stdout:7/737: write d0/d12/d33/d67/da7/dcd/fb0 [194338,50675] 0 2024-05-09T06:30:04.945 INFO:tasks.workunit.client.0.smithi062.stdout:0/769: rename d1/d25/d49/d4f/d52/d87/dc8/l102 to d1/d6a/d6d/d93/d94/dc7/l111 0 2024-05-09T06:30:04.946 INFO:tasks.workunit.client.0.smithi062.stdout:2/680: mknod d0/d9/d38/d41/db1/cda 0 2024-05-09T06:30:04.947 INFO:tasks.workunit.client.0.smithi062.stdout:6/883: rmdir dc/d28/d46/d4a/d5d/d6f 39 2024-05-09T06:30:04.947 INFO:tasks.workunit.client.0.smithi062.stdout:6/884: chown dc/d28/d46/d4a/d5d/d6f 39 1 2024-05-09T06:30:04.948 INFO:tasks.workunit.client.0.smithi062.stdout:1/599: dread d8/d14/d2b/d3c/d44/d64/f83 [0,4194304] 0 2024-05-09T06:30:04.949 INFO:tasks.workunit.client.0.smithi062.stdout:9/745: rename d3/d20/cd6 to d3/d20/cf2 0 2024-05-09T06:30:04.955 INFO:tasks.workunit.client.0.smithi062.stdout:7/738: mkdir d0/d3a/d51/d64/d6d/dac/de7/df1 0 2024-05-09T06:30:04.955 INFO:tasks.workunit.client.0.smithi062.stdout:7/739: truncate d0/d12/d66/d9e/fa9 561985 0 2024-05-09T06:30:04.955 INFO:tasks.workunit.client.0.smithi062.stdout:7/740: chown d0/fdf 6113856 1 2024-05-09T06:30:04.957 INFO:tasks.workunit.client.0.smithi062.stdout:3/592: rename d1/d1e/d36/d4a/f68 to d1/d1e/d36/daa/fbb 0 2024-05-09T06:30:04.957 INFO:tasks.workunit.client.0.smithi062.stdout:0/770: dread d1/d25/d49/d42/d43/f7d [0,4194304] 0 2024-05-09T06:30:04.957 INFO:tasks.workunit.client.0.smithi062.stdout:0/771: dread - d1/d25/d49/ff6 zero size 2024-05-09T06:30:04.957 INFO:tasks.workunit.client.0.smithi062.stdout:9/746: write d3/d3e/d52/d58/d1c/d1e/f5f [1596516,112359] 0 2024-05-09T06:30:04.958 INFO:tasks.workunit.client.0.smithi062.stdout:6/885: symlink dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/dc3/l12d 0 2024-05-09T06:30:04.958 INFO:tasks.workunit.client.0.smithi062.stdout:6/886: dread - dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/feb zero size 2024-05-09T06:30:04.963 INFO:tasks.workunit.client.0.smithi062.stdout:7/741: symlink d0/d3/lf2 0 2024-05-09T06:30:04.967 INFO:tasks.workunit.client.0.smithi062.stdout:3/593: unlink d1/d1e/d26/d43/d92/f40 0 2024-05-09T06:30:04.967 INFO:tasks.workunit.client.0.smithi062.stdout:1/600: dread d8/d14/d2b/f2e [0,4194304] 0 2024-05-09T06:30:04.968 INFO:tasks.workunit.client.0.smithi062.stdout:9/747: mkdir d3/d3e/d52/d58/d77/d92/df3 0 2024-05-09T06:30:04.968 INFO:tasks.workunit.client.0.smithi062.stdout:2/681: dwrite d0/d9/d38/fbf [0,4194304] 0 2024-05-09T06:30:04.968 INFO:tasks.workunit.client.0.smithi062.stdout:2/682: stat d0/d9/d38/d41/d8a/lc7 0 2024-05-09T06:30:04.970 INFO:tasks.workunit.client.0.smithi062.stdout:6/887: mknod dc/d28/d34/d4e/d57/c12e 0 2024-05-09T06:30:04.974 INFO:tasks.workunit.client.0.smithi062.stdout:1/601: symlink d8/d14/d2b/d3c/d44/d6e/d98/lc3 0 2024-05-09T06:30:04.977 INFO:tasks.workunit.client.0.smithi062.stdout:9/748: truncate d3/d3e/d52/d58/d1c/f6a 3972789 0 2024-05-09T06:30:04.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/683: creat d0/fdb x:0 0 0 2024-05-09T06:30:04.982 INFO:tasks.workunit.client.0.smithi062.stdout:1/602: dread d8/d14/d2b/d3c/d44/d64/f7b [0,4194304] 0 2024-05-09T06:30:04.983 INFO:tasks.workunit.client.0.smithi062.stdout:9/749: mkdir d3/d3e/d52/d58/d1c/d1e/d41/dde/df4 0 2024-05-09T06:30:04.984 INFO:tasks.workunit.client.0.smithi062.stdout:7/742: dwrite d0/d3/fb4 [8388608,4194304] 0 2024-05-09T06:30:04.984 INFO:tasks.workunit.client.0.smithi062.stdout:3/594: write d1/d1e/d26/f56 [2091219,35852] 0 2024-05-09T06:30:04.984 INFO:tasks.workunit.client.0.smithi062.stdout:1/603: dread d8/d14/d2b/d3d/f9a [0,4194304] 0 2024-05-09T06:30:04.985 INFO:tasks.workunit.client.0.smithi062.stdout:9/750: write d3/d3e/d52/d58/f71 [1083466,49046] 0 2024-05-09T06:30:04.986 INFO:tasks.workunit.client.0.smithi062.stdout:6/888: write dc/d28/d46/d4a/d5d/d6f/d76/fdc [2491235,30128] 0 2024-05-09T06:30:04.988 INFO:tasks.workunit.client.0.smithi062.stdout:2/684: mknod d0/d9/d38/d41/d48/d5f/cdc 0 2024-05-09T06:30:04.993 INFO:tasks.workunit.client.0.smithi062.stdout:7/743: rmdir d0/d12/d66/d9e/dec 0 2024-05-09T06:30:04.993 INFO:tasks.workunit.client.0.smithi062.stdout:7/744: chown d0/d3a/d51/d64/d6d/d88/dc7/dd7 139500029 1 2024-05-09T06:30:04.993 INFO:tasks.workunit.client.0.smithi062.stdout:7/745: chown d0/d12/c18 107 1 2024-05-09T06:30:04.995 INFO:tasks.workunit.client.0.smithi062.stdout:3/595: symlink d1/d1e/d36/lbc 0 2024-05-09T06:30:04.998 INFO:tasks.workunit.client.0.smithi062.stdout:1/604: link d8/d14/d2b/d3c/d76/l8e d8/d14/d2b/d9d/lc4 0 2024-05-09T06:30:04.998 INFO:tasks.workunit.client.0.smithi062.stdout:1/605: stat d8/d14/d2b/d3c/d44/d38/c5b 0 2024-05-09T06:30:05.004 INFO:tasks.workunit.client.0.smithi062.stdout:7/746: dread d0/d12/d33/d67/da7/dcd/fd3 [0,4194304] 0 2024-05-09T06:30:05.005 INFO:tasks.workunit.client.0.smithi062.stdout:7/747: fsync d0/d3a/d51/d64/d6d/d88/f8a 0 2024-05-09T06:30:05.057 INFO:tasks.workunit.client.0.smithi062.stdout:9/751: rmdir d3/d3e/d52/d58/d77 39 2024-05-09T06:30:05.062 INFO:tasks.workunit.client.0.smithi062.stdout:6/889: mknod dc/d28/d34/d39/de0/db3/c12f 0 2024-05-09T06:30:05.066 INFO:tasks.workunit.client.0.smithi062.stdout:1/606: rename d8/d14/d2b/d3c/l57 to d8/d14/lc5 0 2024-05-09T06:30:05.067 INFO:tasks.workunit.client.0.smithi062.stdout:2/685: dwrite d0/d9/dd/d65/d6d/d21/f42 [0,4194304] 0 2024-05-09T06:30:05.069 INFO:tasks.workunit.client.0.smithi062.stdout:7/748: mknod d0/d3a/d3f/dab/cf3 0 2024-05-09T06:30:05.070 INFO:tasks.workunit.client.0.smithi062.stdout:6/890: mkdir dc/d28/d10/d20/d5b/da3/d10f/d130 0 2024-05-09T06:30:05.071 INFO:tasks.workunit.client.0.smithi062.stdout:3/596: rmdir d1/d1e/d36/d9f 39 2024-05-09T06:30:05.072 INFO:tasks.workunit.client.0.smithi062.stdout:3/597: readlink d1/d1e/d36/d6c/l72 0 2024-05-09T06:30:05.073 INFO:tasks.workunit.client.0.smithi062.stdout:6/891: dread dc/d28/d46/f29 [0,4194304] 0 2024-05-09T06:30:05.073 INFO:tasks.workunit.client.0.smithi062.stdout:6/892: fdatasync dc/f2a 0 2024-05-09T06:30:05.074 INFO:tasks.workunit.client.0.smithi062.stdout:1/607: truncate d8/d14/d2b/f2e 2111432 0 2024-05-09T06:30:05.074 INFO:tasks.workunit.client.0.smithi062.stdout:1/608: fsync d8/d14/d2b/d3d/f71 0 2024-05-09T06:30:05.078 INFO:tasks.workunit.client.0.smithi062.stdout:2/686: symlink d0/d9/dd/d65/d6d/d7e/ldd 0 2024-05-09T06:30:05.079 INFO:tasks.workunit.client.0.smithi062.stdout:7/749: truncate d0/d3a/f47 829211 0 2024-05-09T06:30:05.081 INFO:tasks.workunit.client.0.smithi062.stdout:3/598: symlink d1/d1e/d36/d3a/d4e/lbd 0 2024-05-09T06:30:05.081 INFO:tasks.workunit.client.0.smithi062.stdout:3/599: getdents d1/d1e/d54/d8c 0 2024-05-09T06:30:05.083 INFO:tasks.workunit.client.0.smithi062.stdout:6/893: mknod dc/d28/c131 0 2024-05-09T06:30:05.083 INFO:tasks.workunit.client.0.smithi062.stdout:6/894: getdents dc/d28/d46/d3a/d7f/d8e/dc8 0 2024-05-09T06:30:05.083 INFO:tasks.workunit.client.0.smithi062.stdout:6/895: readlink dc/d28/d46/d3a/d7f/d91/d93/led 0 2024-05-09T06:30:05.083 INFO:tasks.workunit.client.0.smithi062.stdout:6/896: write dc/d28/d10/d20/d5b/d77/f9c [8629124,124444] 0 2024-05-09T06:30:05.083 INFO:tasks.workunit.client.0.smithi062.stdout:3/600: dread d1/d1e/d54/f93 [0,4194304] 0 2024-05-09T06:30:05.083 INFO:tasks.workunit.client.0.smithi062.stdout:3/601: fdatasync d1/d1e/d26/f37 0 2024-05-09T06:30:05.083 INFO:tasks.workunit.client.0.smithi062.stdout:3/602: readlink d1/d1e/d36/d6c/l72 0 2024-05-09T06:30:05.083 INFO:tasks.workunit.client.0.smithi062.stdout:3/603: fdatasync d1/f2f 0 2024-05-09T06:30:05.084 INFO:tasks.workunit.client.0.smithi062.stdout:3/604: fdatasync d1/d1e/d36/d9f/d4f/f96 0 2024-05-09T06:30:05.084 INFO:tasks.workunit.client.0.smithi062.stdout:3/605: creat d1/d1e/fbe x:0 0 0 2024-05-09T06:30:05.084 INFO:tasks.workunit.client.0.smithi062.stdout:9/752: dwrite d3/d3e/d52/d58/d77/d92/f9e [0,4194304] 0 2024-05-09T06:30:05.089 INFO:tasks.workunit.client.0.smithi062.stdout:2/687: link d0/d9/d17/d89/fd4 d0/d9/d38/dd6/dbd/fde 0 2024-05-09T06:30:05.089 INFO:tasks.workunit.client.0.smithi062.stdout:2/688: fsync d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/f7b 0 2024-05-09T06:30:05.090 INFO:tasks.workunit.client.0.smithi062.stdout:7/750: rmdir d0/d3a 39 2024-05-09T06:30:05.090 INFO:tasks.workunit.client.0.smithi062.stdout:7/751: chown d0/d3a 3709825 1 2024-05-09T06:30:05.095 INFO:tasks.workunit.client.0.smithi062.stdout:6/897: dread dc/d28/d34/d4e/d57/d102/fd8 [0,4194304] 0 2024-05-09T06:30:05.095 INFO:tasks.workunit.client.0.smithi062.stdout:6/898: write dc/d28/d46/d3a/d7f/f113 [1202600,95085] 0 2024-05-09T06:30:05.097 INFO:tasks.workunit.client.0.smithi062.stdout:3/606: mkdir d1/d1e/d36/d3a/d4e/dbf 0 2024-05-09T06:30:05.101 INFO:tasks.workunit.client.0.smithi062.stdout:9/753: rename d3/f3c to d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/ff5 0 2024-05-09T06:30:05.103 INFO:tasks.workunit.client.0.smithi062.stdout:2/689: mknod d0/d90/cdf 0 2024-05-09T06:30:05.108 INFO:tasks.workunit.client.0.smithi062.stdout:3/607: mknod d1/d1e/d26/d43/d52/d6a/da4/cc0 0 2024-05-09T06:30:05.113 INFO:tasks.workunit.client.0.smithi062.stdout:2/690: rename d0/d9/dd/d65/d6d/d21/d29/d40/l8b to d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/le0 0 2024-05-09T06:30:05.113 INFO:tasks.workunit.client.0.smithi062.stdout:2/691: write d0/d9/d38/d41/d53/fd8 [333616,122929] 0 2024-05-09T06:30:05.118 INFO:tasks.workunit.client.0.smithi062.stdout:8/827: write da/f28 [2966257,44301] 0 2024-05-09T06:30:05.119 INFO:tasks.workunit.client.0.smithi062.stdout:8/828: creat da/dea/dd2/dd6/f10d x:0 0 0 2024-05-09T06:30:05.122 INFO:tasks.workunit.client.0.smithi062.stdout:6/899: dwrite dc/d28/d46/d3a/d7f/d91/d93/f107 [0,4194304] 0 2024-05-09T06:30:05.122 INFO:tasks.workunit.client.0.smithi062.stdout:6/900: dread - dc/d28/d10/d20/db5/fa9 zero size 2024-05-09T06:30:05.124 INFO:tasks.workunit.client.0.smithi062.stdout:6/901: read dc/d28/d10/f111 [401988,75728] 0 2024-05-09T06:30:05.127 INFO:tasks.workunit.client.0.smithi062.stdout:2/692: dread d0/d9/dd/f5e [0,4194304] 0 2024-05-09T06:30:05.129 INFO:tasks.workunit.client.0.smithi062.stdout:6/902: symlink dc/d28/d10/d20/d5b/da3/l132 0 2024-05-09T06:30:05.129 INFO:tasks.workunit.client.0.smithi062.stdout:6/903: chown dc/d28/d34/db7/f105 661 1 2024-05-09T06:30:05.130 INFO:tasks.workunit.client.0.smithi062.stdout:6/904: truncate dc/d28/d46/d3a/d7f/f12a 4390098 0 2024-05-09T06:30:05.130 INFO:tasks.workunit.client.0.smithi062.stdout:6/905: chown dc/d28/d34/db0/ffe 2 1 2024-05-09T06:30:05.130 INFO:tasks.workunit.client.0.smithi062.stdout:6/906: readlink dc/d28/d46/l104 0 2024-05-09T06:30:05.132 INFO:tasks.workunit.client.0.smithi062.stdout:8/829: dread da/dea/f89 [0,4194304] 0 2024-05-09T06:30:05.138 INFO:tasks.workunit.client.0.smithi062.stdout:3/608: dwrite d1/d1e/d26/f37 [0,4194304] 0 2024-05-09T06:30:05.138 INFO:tasks.workunit.client.0.smithi062.stdout:9/754: dwrite d3/d3e/d4b/fe1 [0,4194304] 0 2024-05-09T06:30:05.143 INFO:tasks.workunit.client.0.smithi062.stdout:2/693: dread d0/d9/dd/d65/d6d/d21/d29/d3d/f67 [0,4194304] 0 2024-05-09T06:30:05.144 INFO:tasks.workunit.client.0.smithi062.stdout:6/907: dread dc/d28/d46/d3a/d7f/d91/d93/dc0/f66 [0,4194304] 0 2024-05-09T06:30:05.150 INFO:tasks.workunit.client.0.smithi062.stdout:9/755: write d3/f98 [1341013,131069] 0 2024-05-09T06:30:05.150 INFO:tasks.workunit.client.0.smithi062.stdout:9/756: chown d3/d3e/d52/d58/d1c/c44 4969053 1 2024-05-09T06:30:05.153 INFO:tasks.workunit.client.0.smithi062.stdout:8/830: dwrite da/dea/d2e/d61/d92/fda [0,4194304] 0 2024-05-09T06:30:05.154 INFO:tasks.workunit.client.0.smithi062.stdout:9/757: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/fc1 [0,4194304] 0 2024-05-09T06:30:05.160 INFO:tasks.workunit.client.0.smithi062.stdout:3/609: dwrite d1/d48/f98 [4194304,4194304] 0 2024-05-09T06:30:05.234 INFO:tasks.workunit.client.0.smithi062.stdout:7/752: getdents d0/d3 0 2024-05-09T06:30:05.236 INFO:tasks.workunit.client.0.smithi062.stdout:2/694: mkdir d0/d9/d38/d41/de1 0 2024-05-09T06:30:05.236 INFO:tasks.workunit.client.0.smithi062.stdout:2/695: fdatasync d0/fa 0 2024-05-09T06:30:05.240 INFO:tasks.workunit.client.0.smithi062.stdout:6/908: creat dc/d28/d34/d4e/f133 x:0 0 0 2024-05-09T06:30:05.249 INFO:tasks.workunit.client.0.smithi062.stdout:8/831: mknod da/dea/d2e/d34/ddf/c10e 0 2024-05-09T06:30:05.267 INFO:tasks.workunit.client.0.smithi062.stdout:9/758: mknod d3/d3e/d52/d58/d1c/d1e/d41/d64/de2/cf6 0 2024-05-09T06:30:05.270 INFO:tasks.workunit.client.0.smithi062.stdout:3/610: rmdir d1/d1e/d26/d43/d52/d6a/da4 39 2024-05-09T06:30:05.270 INFO:tasks.workunit.client.0.smithi062.stdout:3/611: stat d1/d1e/d26/d43/d92/d77/ca0 0 2024-05-09T06:30:05.274 INFO:tasks.workunit.client.0.smithi062.stdout:2/696: symlink d0/d9/dd9/le2 0 2024-05-09T06:30:05.275 INFO:tasks.workunit.client.0.smithi062.stdout:9/759: dread d3/d3e/d52/d58/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:30:05.276 INFO:tasks.workunit.client.0.smithi062.stdout:6/909: mknod dc/d28/d34/d39/de0/db3/c134 0 2024-05-09T06:30:05.276 INFO:tasks.workunit.client.0.smithi062.stdout:6/910: write dc/d28/d10/d20/d5b/d77/ff5 [4463999,36954] 0 2024-05-09T06:30:05.277 INFO:tasks.workunit.client.0.smithi062.stdout:6/911: dread dc/d28/d46/d3a/d7f/d91/fe6 [0,4194304] 0 2024-05-09T06:30:05.280 INFO:tasks.workunit.client.0.smithi062.stdout:8/832: mkdir da/dea/d2e/d61/d92/da5/daf/d10f 0 2024-05-09T06:30:05.281 INFO:tasks.workunit.client.0.smithi062.stdout:3/612: creat d1/d1e/d26/d43/d52/fc1 x:0 0 0 2024-05-09T06:30:05.283 INFO:tasks.workunit.client.0.smithi062.stdout:7/753: rename d0/d12/d33/d9f/ld9 to d0/d3a/d51/d64/d6d/dac/de7/df1/lf4 0 2024-05-09T06:30:05.285 INFO:tasks.workunit.client.0.smithi062.stdout:2/697: rmdir d0/d9/d17/d89 39 2024-05-09T06:30:05.289 INFO:tasks.workunit.client.0.smithi062.stdout:9/760: creat d3/ff7 x:0 0 0 2024-05-09T06:30:05.293 INFO:tasks.workunit.client.0.smithi062.stdout:6/912: creat dc/d28/d46/d3a/d7f/d91/f135 x:0 0 0 2024-05-09T06:30:05.293 INFO:tasks.workunit.client.0.smithi062.stdout:6/913: write dc/f2a [1263451,78645] 0 2024-05-09T06:30:05.294 INFO:tasks.workunit.client.0.smithi062.stdout:8/833: creat da/dea/d1c/de0/f110 x:0 0 0 2024-05-09T06:30:05.296 INFO:tasks.workunit.client.0.smithi062.stdout:3/613: symlink d1/d1e/d36/daa/lc2 0 2024-05-09T06:30:05.298 INFO:tasks.workunit.client.0.smithi062.stdout:9/761: dread d3/d3e/d52/d58/f6b [0,4194304] 0 2024-05-09T06:30:05.298 INFO:tasks.workunit.client.0.smithi062.stdout:9/762: fdatasync d3/d3e/d4b/f5c 0 2024-05-09T06:30:05.300 INFO:tasks.workunit.client.0.smithi062.stdout:7/754: dwrite d0/d3a/f5f [0,4194304] 0 2024-05-09T06:30:05.304 INFO:tasks.workunit.client.0.smithi062.stdout:8/834: symlink da/dea/d2e/d61/d92/da5/daf/d10f/l111 0 2024-05-09T06:30:05.306 INFO:tasks.workunit.client.0.smithi062.stdout:9/763: link d3/d3e/d52/d58/fd3 d3/d3e/d52/d58/d1c/d1e/ff8 0 2024-05-09T06:30:05.307 INFO:tasks.workunit.client.0.smithi062.stdout:9/764: readlink d3/d3e/d52/d58/d1c/d21/l95 0 2024-05-09T06:30:05.308 INFO:tasks.workunit.client.0.smithi062.stdout:9/765: write d3/d3e/d4b/d99/fa6 [116110,94852] 0 2024-05-09T06:30:05.308 INFO:tasks.workunit.client.0.smithi062.stdout:2/698: unlink d0/d9/c72 0 2024-05-09T06:30:05.308 INFO:tasks.workunit.client.0.smithi062.stdout:9/766: write d3/d3e/d52/d58/d77/d92/f9e [4319580,59196] 0 2024-05-09T06:30:05.308 INFO:tasks.workunit.client.0.smithi062.stdout:9/767: chown d3/d3e/d52/d58/d1c/d1e/d41/f7f 2 1 2024-05-09T06:30:05.308 INFO:tasks.workunit.client.0.smithi062.stdout:2/699: write d0/d9/dd/f98 [719154,14042] 0 2024-05-09T06:30:05.309 INFO:tasks.workunit.client.0.smithi062.stdout:2/700: dread - d0/d9/d38/d41/d8a/fd3 zero size 2024-05-09T06:30:05.310 INFO:tasks.workunit.client.0.smithi062.stdout:6/914: symlink dc/d28/d10/l136 0 2024-05-09T06:30:05.313 INFO:tasks.workunit.client.0.smithi062.stdout:8/835: creat da/dea/d2e/d61/f112 x:0 0 0 2024-05-09T06:30:05.316 INFO:tasks.workunit.client.0.smithi062.stdout:9/768: creat d3/d3e/d52/d58/d1c/ff9 x:0 0 0 2024-05-09T06:30:05.318 INFO:tasks.workunit.client.0.smithi062.stdout:6/915: creat dc/d28/d34/db7/f137 x:0 0 0 2024-05-09T06:30:05.323 INFO:tasks.workunit.client.0.smithi062.stdout:3/614: dwrite d1/d1e/d54/f9a [0,4194304] 0 2024-05-09T06:30:05.323 INFO:tasks.workunit.client.0.smithi062.stdout:9/769: link d3/d3e/d52/d58/d1c/faa d3/d3e/d52/ffa 0 2024-05-09T06:30:05.323 INFO:tasks.workunit.client.0.smithi062.stdout:9/770: fdatasync d3/d3e/d4b/f5c 0 2024-05-09T06:30:05.326 INFO:tasks.workunit.client.0.smithi062.stdout:6/916: dread dc/d28/d46/d3a/f40 [0,4194304] 0 2024-05-09T06:30:05.328 INFO:tasks.workunit.client.0.smithi062.stdout:2/701: rmdir d0/d9/d38 39 2024-05-09T06:30:05.329 INFO:tasks.workunit.client.0.smithi062.stdout:8/836: dwrite da/dea/d2e/d34/f44 [0,4194304] 0 2024-05-09T06:30:05.329 INFO:tasks.workunit.client.0.smithi062.stdout:8/837: fsync da/dea/d2e/d61/fcb 0 2024-05-09T06:30:05.330 INFO:tasks.workunit.client.0.smithi062.stdout:6/917: dread dc/d28/d46/d3a/d7f/d91/d93/dc0/f66 [0,4194304] 0 2024-05-09T06:30:05.331 INFO:tasks.workunit.client.0.smithi062.stdout:3/615: creat d1/d1e/d54/d8c/fc3 x:0 0 0 2024-05-09T06:30:05.333 INFO:tasks.workunit.client.0.smithi062.stdout:9/771: unlink d3/d3e/d52/d58/d1c/d1e/d41/d64/c30 0 2024-05-09T06:30:05.334 INFO:tasks.workunit.client.0.smithi062.stdout:2/702: truncate d0/d9/dd/f33 25641 0 2024-05-09T06:30:05.338 INFO:tasks.workunit.client.0.smithi062.stdout:3/616: dread d1/f1f [0,4194304] 0 2024-05-09T06:30:05.338 INFO:tasks.workunit.client.0.smithi062.stdout:3/617: chown d1/d1e/d26/d43/d52/d6a/f71 23647474 1 2024-05-09T06:30:05.339 INFO:tasks.workunit.client.0.smithi062.stdout:8/838: mkdir da/dea/d1c/d9e/d9f/da7/d113 0 2024-05-09T06:30:05.340 INFO:tasks.workunit.client.0.smithi062.stdout:8/839: fsync da/dea/f3c 0 2024-05-09T06:30:05.341 INFO:tasks.workunit.client.0.smithi062.stdout:6/918: mkdir dc/d28/d34/db7/d138 0 2024-05-09T06:30:05.341 INFO:tasks.workunit.client.0.smithi062.stdout:6/919: chown dc/d28/d34/d39/de0/db3/c134 7 1 2024-05-09T06:30:05.341 INFO:tasks.workunit.client.0.smithi062.stdout:6/920: fsync dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/dc3/f112 0 2024-05-09T06:30:05.341 INFO:tasks.workunit.client.0.smithi062.stdout:6/921: chown dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc 3223 1 2024-05-09T06:30:05.341 INFO:tasks.workunit.client.0.smithi062.stdout:9/772: rmdir d3/deb 39 2024-05-09T06:30:05.343 INFO:tasks.workunit.client.0.smithi062.stdout:9/773: dread d3/d3e/d52/d58/d1c/f87 [0,4194304] 0 2024-05-09T06:30:05.343 INFO:tasks.workunit.client.0.smithi062.stdout:2/703: mkdir d0/d9/dd/d65/d6d/d96/de3 0 2024-05-09T06:30:05.343 INFO:tasks.workunit.client.0.smithi062.stdout:2/704: readlink d0/d9/dd9/le2 0 2024-05-09T06:30:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:05 smithi079 ceph-mon[35268]: pgmap v10: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 123 MiB/s rd, 153 MiB/s wr, 270 op/s 2024-05-09T06:30:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:05 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:05.345 INFO:tasks.workunit.client.0.smithi062.stdout:3/618: truncate d1/d1e/d26/d43/f78 186314 0 2024-05-09T06:30:05.346 INFO:tasks.workunit.client.0.smithi062.stdout:8/840: rmdir da/dea/d1c/d9e/d9f 39 2024-05-09T06:30:05.347 INFO:tasks.workunit.client.0.smithi062.stdout:6/922: getdents dc/d28/d34/d39/de0 0 2024-05-09T06:30:05.353 INFO:tasks.workunit.client.0.smithi062.stdout:2/705: creat d0/d9/dd/d65/d6d/fe4 x:0 0 0 2024-05-09T06:30:05.353 INFO:tasks.workunit.client.0.smithi062.stdout:2/706: creat d0/d9/dd/fe5 x:0 0 0 2024-05-09T06:30:05.358 INFO:tasks.workunit.client.0.smithi062.stdout:8/841: creat da/dea/d2e/d61/d64/f114 x:0 0 0 2024-05-09T06:30:05.362 INFO:tasks.workunit.client.0.smithi062.stdout:8/842: mkdir da/dea/d2e/d34/d115 0 2024-05-09T06:30:05.365 INFO:tasks.workunit.client.0.smithi062.stdout:2/707: mknod d0/d9/d38/ce6 0 2024-05-09T06:30:05.365 INFO:tasks.workunit.client.0.smithi062.stdout:3/619: dwrite d1/d1e/d26/d43/d52/fc1 [0,4194304] 0 2024-05-09T06:30:05.366 INFO:tasks.workunit.client.0.smithi062.stdout:8/843: mkdir da/dea/d1c/d9e/d9f/da7/d116 0 2024-05-09T06:30:05.372 INFO:tasks.workunit.client.0.smithi062.stdout:6/923: dwrite dc/d28/f9a [0,4194304] 0 2024-05-09T06:30:05.372 INFO:tasks.workunit.client.0.smithi062.stdout:6/924: read - dc/d28/d34/db7/f121 zero size 2024-05-09T06:30:05.373 INFO:tasks.workunit.client.0.smithi062.stdout:3/620: creat d1/d1e/d3b/fc4 x:0 0 0 2024-05-09T06:30:05.373 INFO:tasks.workunit.client.0.smithi062.stdout:3/621: stat d1/d1e/d36/d3a/d4e/f76 0 2024-05-09T06:30:05.373 INFO:tasks.workunit.client.0.smithi062.stdout:3/622: creat d1/d1e/d54/d8c/fc5 x:0 0 0 2024-05-09T06:30:05.373 INFO:tasks.workunit.client.0.smithi062.stdout:3/623: write d1/d48/f4c [2594977,4784] 0 2024-05-09T06:30:05.374 INFO:tasks.workunit.client.0.smithi062.stdout:9/774: dwrite d3/d20/dc7/fbe [4194304,4194304] 0 2024-05-09T06:30:05.374 INFO:tasks.workunit.client.0.smithi062.stdout:8/844: symlink da/dea/d1c/d9e/l117 0 2024-05-09T06:30:05.374 INFO:tasks.workunit.client.0.smithi062.stdout:8/845: write da/dea/d1c/ff4 [1375316,23723] 0 2024-05-09T06:30:05.383 INFO:tasks.workunit.client.0.smithi062.stdout:2/708: dwrite d0/fa2 [0,4194304] 0 2024-05-09T06:30:05.383 INFO:tasks.workunit.client.0.smithi062.stdout:2/709: chown d0/d9/d38/d41/d8a/dd2 1330668 1 2024-05-09T06:30:05.384 INFO:tasks.workunit.client.0.smithi062.stdout:3/624: write d1/d1e/d36/d9f/f3e [2961393,78507] 0 2024-05-09T06:30:05.386 INFO:tasks.workunit.client.0.smithi062.stdout:9/775: creat d3/d20/ffb x:0 0 0 2024-05-09T06:30:05.386 INFO:tasks.workunit.client.0.smithi062.stdout:9/776: chown d3/d3e/d7c/c8a 5849 1 2024-05-09T06:30:05.387 INFO:tasks.workunit.client.0.smithi062.stdout:9/777: dread d3/d3e/d52/d58/d1c/faa [0,4194304] 0 2024-05-09T06:30:05.388 INFO:tasks.workunit.client.0.smithi062.stdout:6/925: write dc/d28/d46/f80 [2690085,58490] 0 2024-05-09T06:30:05.389 INFO:tasks.workunit.client.0.smithi062.stdout:2/710: dread d0/d9/f84 [0,4194304] 0 2024-05-09T06:30:05.389 INFO:tasks.workunit.client.0.smithi062.stdout:2/711: chown d0/f30 609054 1 2024-05-09T06:30:05.390 INFO:tasks.workunit.client.0.smithi062.stdout:8/846: link da/dea/d2e/d34/l78 da/dea/d1c/de0/l118 0 2024-05-09T06:30:05.390 INFO:tasks.workunit.client.0.smithi062.stdout:8/847: chown da/dea/d2e/d61/d92/da5/ld7 0 1 2024-05-09T06:30:05.400 INFO:tasks.workunit.client.0.smithi062.stdout:3/625: mknod d1/d1e/d26/d43/d52/cc6 0 2024-05-09T06:30:05.404 INFO:tasks.workunit.client.0.smithi062.stdout:6/926: creat dc/d28/d10/f139 x:0 0 0 2024-05-09T06:30:05.404 INFO:tasks.workunit.client.0.smithi062.stdout:6/927: write dc/d28/d34/f59 [418514,87116] 0 2024-05-09T06:30:05.405 INFO:tasks.workunit.client.0.smithi062.stdout:2/712: mknod d0/d9/dd/d65/d6d/d21/d29/ce7 0 2024-05-09T06:30:05.408 INFO:tasks.workunit.client.0.smithi062.stdout:8/848: symlink da/dea/d1c/d9e/d9f/da7/d116/l119 0 2024-05-09T06:30:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:05 smithi062 ceph-mon[26920]: pgmap v10: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 123 MiB/s rd, 153 MiB/s wr, 270 op/s 2024-05-09T06:30:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:05 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:05.413 INFO:tasks.workunit.client.0.smithi062.stdout:9/778: dwrite d3/d3e/d52/d58/d77/d92/f96 [0,4194304] 0 2024-05-09T06:30:05.413 INFO:tasks.workunit.client.0.smithi062.stdout:8/849: link da/d77/l84 da/d77/l11a 0 2024-05-09T06:30:05.417 INFO:tasks.workunit.client.0.smithi062.stdout:2/713: dread d0/d9/dd/d65/fac [4194304,4194304] 0 2024-05-09T06:30:05.420 INFO:tasks.workunit.client.0.smithi062.stdout:8/850: unlink da/dea/c25 0 2024-05-09T06:30:05.420 INFO:tasks.workunit.client.0.smithi062.stdout:8/851: readlink da/dea/d2e/d34/l78 0 2024-05-09T06:30:05.420 INFO:tasks.workunit.client.0.smithi062.stdout:8/852: fsync da/dea/f89 0 2024-05-09T06:30:05.420 INFO:tasks.workunit.client.0.smithi062.stdout:8/853: read da/dea/d1c/f4a [23638,68806] 0 2024-05-09T06:30:05.420 INFO:tasks.workunit.client.0.smithi062.stdout:8/854: creat da/dea/d2e/d34/d90/f11b x:0 0 0 2024-05-09T06:30:05.422 INFO:tasks.workunit.client.0.smithi062.stdout:2/714: rename d0/d9/d17/lce to d0/d9/dd9/le8 0 2024-05-09T06:30:05.422 INFO:tasks.workunit.client.0.smithi062.stdout:2/715: write d0/d9/dd/d65/d6d/d21/f55 [1203095,126910] 0 2024-05-09T06:30:05.423 INFO:tasks.workunit.client.0.smithi062.stdout:2/716: fsync d0/d9/d38/d41/d53/f99 0 2024-05-09T06:30:05.423 INFO:tasks.workunit.client.0.smithi062.stdout:2/717: read - d0/d9/dd/fd5 zero size 2024-05-09T06:30:05.423 INFO:tasks.workunit.client.0.smithi062.stdout:2/718: fsync d0/d9/dd/d65/d6d/d21/d29/d40/f75 0 2024-05-09T06:30:05.424 INFO:tasks.workunit.client.0.smithi062.stdout:8/855: truncate da/f71 2033720 0 2024-05-09T06:30:05.425 INFO:tasks.workunit.client.0.smithi062.stdout:2/719: creat d0/d9/dd/d65/d6d/d21/fe9 x:0 0 0 2024-05-09T06:30:05.425 INFO:tasks.workunit.client.0.smithi062.stdout:2/720: fsync d0/d9/dd/f5e 0 2024-05-09T06:30:05.426 INFO:tasks.workunit.client.0.smithi062.stdout:3/626: dwrite d1/f1c [0,4194304] 0 2024-05-09T06:30:05.426 INFO:tasks.workunit.client.0.smithi062.stdout:3/627: write d1/f1f [1633428,129278] 0 2024-05-09T06:30:05.427 INFO:tasks.workunit.client.0.smithi062.stdout:2/721: rename d0/d9/dd9/fbe to d0/d9/dd/d65/fea 0 2024-05-09T06:30:05.430 INFO:tasks.workunit.client.0.smithi062.stdout:3/628: mknod d1/d1e/d26/d43/d52/d6a/cc7 0 2024-05-09T06:30:05.430 INFO:tasks.workunit.client.0.smithi062.stdout:6/928: dwrite dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/fb2 [0,4194304] 0 2024-05-09T06:30:05.430 INFO:tasks.workunit.client.0.smithi062.stdout:6/929: read - dc/d28/d10/d20/d5b/da3/fe1 zero size 2024-05-09T06:30:05.431 INFO:tasks.workunit.client.0.smithi062.stdout:6/930: chown dc/d28/d10/d20/db5/l53 1 1 2024-05-09T06:30:05.431 INFO:tasks.workunit.client.0.smithi062.stdout:6/931: write dc/d28/d46/d3a/d7f/f12a [2706466,60307] 0 2024-05-09T06:30:05.432 INFO:tasks.workunit.client.0.smithi062.stdout:5/895: sync 2024-05-09T06:30:05.433 INFO:tasks.workunit.client.0.smithi062.stdout:3/629: dread d1/d1e/d36/d4a/d51/f6b [0,4194304] 0 2024-05-09T06:30:05.438 INFO:tasks.workunit.client.0.smithi062.stdout:8/856: write da/d85/fe4 [3331485,109110] 0 2024-05-09T06:30:05.438 INFO:tasks.workunit.client.0.smithi062.stdout:5/896: rename d0/d8/d1c/d2c/f8c to d0/d8/d1c/d2c/db3/f12a 0 2024-05-09T06:30:05.440 INFO:tasks.workunit.client.0.smithi062.stdout:8/857: getdents da/dea/d2e/d61/d92/da5 0 2024-05-09T06:30:05.442 INFO:tasks.workunit.client.0.smithi062.stdout:5/897: mknod d0/d8/d1c/d2c/d7d/d4a/dd7/c12b 0 2024-05-09T06:30:05.450 INFO:tasks.workunit.client.0.smithi062.stdout:5/898: write d0/f28 [41072,19931] 0 2024-05-09T06:30:05.451 INFO:tasks.workunit.client.0.smithi062.stdout:3/630: dread d1/d1e/d36/d9f/d4f/f6f [0,4194304] 0 2024-05-09T06:30:05.452 INFO:tasks.workunit.client.0.smithi062.stdout:2/722: dwrite d0/fa2 [0,4194304] 0 2024-05-09T06:30:05.452 INFO:tasks.workunit.client.0.smithi062.stdout:2/723: fsync d0/d90/db7/fcf 0 2024-05-09T06:30:05.452 INFO:tasks.workunit.client.0.smithi062.stdout:2/724: creat d0/d9/dd/d65/d6d/feb x:0 0 0 2024-05-09T06:30:05.452 INFO:tasks.workunit.client.0.smithi062.stdout:2/725: fdatasync d0/d9/d17/d37/f7f 0 2024-05-09T06:30:05.452 INFO:tasks.workunit.client.0.smithi062.stdout:2/726: dread - d0/d9/dd/d65/d6d/feb zero size 2024-05-09T06:30:05.453 INFO:tasks.workunit.client.0.smithi062.stdout:5/899: mknod d0/d8/d47/dbe/d86/da4/c12c 0 2024-05-09T06:30:05.462 INFO:tasks.workunit.client.0.smithi062.stdout:5/900: rename d0/d8/d47/fd6 to d0/d8/d18/f12d 0 2024-05-09T06:30:05.462 INFO:tasks.workunit.client.0.smithi062.stdout:5/901: write d0/d8/d1c/d23/d3e/fa2 [3057188,68393] 0 2024-05-09T06:30:05.462 INFO:tasks.workunit.client.0.smithi062.stdout:5/902: chown d0/d8/fc4 1031 1 2024-05-09T06:30:05.466 INFO:tasks.workunit.client.0.smithi062.stdout:5/903: mknod d0/d8/d47/dbe/d45/c12e 0 2024-05-09T06:30:05.466 INFO:tasks.workunit.client.0.smithi062.stdout:5/904: write d0/d8/d1c/d23/d42/faa [804043,91416] 0 2024-05-09T06:30:05.466 INFO:tasks.workunit.client.0.smithi062.stdout:3/631: write d1/d1e/d36/daa/fbb [372700,80779] 0 2024-05-09T06:30:05.466 INFO:tasks.workunit.client.0.smithi062.stdout:6/932: dwrite dc/d28/d46/d3a/f40 [0,4194304] 0 2024-05-09T06:30:05.467 INFO:tasks.workunit.client.0.smithi062.stdout:2/727: dread d0/f39 [8388608,4194304] 0 2024-05-09T06:30:05.469 INFO:tasks.workunit.client.0.smithi062.stdout:8/858: dwrite da/df0/ff3 [0,4194304] 0 2024-05-09T06:30:05.469 INFO:tasks.workunit.client.0.smithi062.stdout:8/859: chown da/dea/d1c/d9e/d9f/cc5 20 1 2024-05-09T06:30:05.471 INFO:tasks.workunit.client.0.smithi062.stdout:5/905: mkdir d0/d8/d1c/d2c/d12f 0 2024-05-09T06:30:05.471 INFO:tasks.workunit.client.0.smithi062.stdout:5/906: fdatasync d0/d8/d47/dbe/d5/fa3 0 2024-05-09T06:30:05.471 INFO:tasks.workunit.client.0.smithi062.stdout:5/907: readlink d0/d8/d47/dbe/d45/da5/dcf/l108 0 2024-05-09T06:30:05.471 INFO:tasks.workunit.client.0.smithi062.stdout:5/908: write d0/d8/f52 [4746543,7188] 0 2024-05-09T06:30:05.471 INFO:tasks.workunit.client.0.smithi062.stdout:5/909: creat d0/d8/d47/dbe/d5/dbf/f130 x:0 0 0 2024-05-09T06:30:05.474 INFO:tasks.workunit.client.0.smithi062.stdout:3/632: dread d1/f1b [0,4194304] 0 2024-05-09T06:30:05.474 INFO:tasks.workunit.client.0.smithi062.stdout:6/933: truncate dc/d28/d46/d3a/d7f/d91/d93/f107 262228 0 2024-05-09T06:30:05.528 INFO:tasks.workunit.client.0.smithi062.stdout:2/728: unlink d0/d9/d38/d41/d48/d5f/l70 0 2024-05-09T06:30:05.532 INFO:tasks.workunit.client.0.smithi062.stdout:8/860: truncate da/dea/d1c/f4a 155775 0 2024-05-09T06:30:05.532 INFO:tasks.workunit.client.0.smithi062.stdout:8/861: fdatasync da/dea/f58 0 2024-05-09T06:30:05.532 INFO:tasks.workunit.client.0.smithi062.stdout:8/862: fsync da/dea/d2e/d34/dd4/dbb/fc8 0 2024-05-09T06:30:05.532 INFO:tasks.workunit.client.0.smithi062.stdout:8/863: chown da/ld 75 1 2024-05-09T06:30:05.536 INFO:tasks.workunit.client.0.smithi062.stdout:3/633: truncate d1/f99 195260 0 2024-05-09T06:30:05.537 INFO:tasks.workunit.client.0.smithi062.stdout:6/934: symlink dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/l13a 0 2024-05-09T06:30:05.538 INFO:tasks.workunit.client.0.smithi062.stdout:6/935: chown dc/f17 0 1 2024-05-09T06:30:05.541 INFO:tasks.workunit.client.0.smithi062.stdout:2/729: creat d0/d9/d38/d41/d8a/dd2/fec x:0 0 0 2024-05-09T06:30:05.541 INFO:tasks.workunit.client.0.smithi062.stdout:2/730: dread - d0/d9/d17/d37/f7f zero size 2024-05-09T06:30:05.542 INFO:tasks.workunit.client.0.smithi062.stdout:2/731: dread - d0/d9/dd/fd5 zero size 2024-05-09T06:30:05.544 INFO:tasks.workunit.client.0.smithi062.stdout:3/634: symlink d1/d1e/d36/d3a/lc8 0 2024-05-09T06:30:05.544 INFO:tasks.workunit.client.0.smithi062.stdout:3/635: stat d1/d1e/d26/d43/d92/fb2 0 2024-05-09T06:30:05.545 INFO:tasks.workunit.client.0.smithi062.stdout:2/732: dread d0/d9/dd/f6c [0,4194304] 0 2024-05-09T06:30:05.545 INFO:tasks.workunit.client.0.smithi062.stdout:2/733: write d0/d9/dd/fe5 [722063,124671] 0 2024-05-09T06:30:05.547 INFO:tasks.workunit.client.0.smithi062.stdout:3/636: rename d1/l9 to d1/d1e/d36/lc9 0 2024-05-09T06:30:05.547 INFO:tasks.workunit.client.0.smithi062.stdout:3/637: creat d1/d1e/d36/d3a/fca x:0 0 0 2024-05-09T06:30:05.550 INFO:tasks.workunit.client.0.smithi062.stdout:8/864: dwrite da/dea/f1d [0,4194304] 0 2024-05-09T06:30:05.551 INFO:tasks.workunit.client.0.smithi062.stdout:6/936: mkdir dc/d28/d10/d13b 0 2024-05-09T06:30:05.556 INFO:tasks.workunit.client.0.smithi062.stdout:3/638: creat d1/d1e/d36/daa/fcb x:0 0 0 2024-05-09T06:30:05.558 INFO:tasks.workunit.client.0.smithi062.stdout:2/734: getdents d0/d9/dd 0 2024-05-09T06:30:05.558 INFO:tasks.workunit.client.0.smithi062.stdout:2/735: fsync d0/d9/dd/d65/d6d/d21/d29/d3d/f79 0 2024-05-09T06:30:05.561 INFO:tasks.workunit.client.0.smithi062.stdout:8/865: creat da/dea/d1c/f11c x:0 0 0 2024-05-09T06:30:05.563 INFO:tasks.workunit.client.0.smithi062.stdout:6/937: creat dc/d28/d10/d103/f13c x:0 0 0 2024-05-09T06:30:05.565 INFO:tasks.workunit.client.0.smithi062.stdout:2/736: rename d0/d9/dd/d65/ccc to d0/d9/dd/d65/d6d/ced 0 2024-05-09T06:30:05.570 INFO:tasks.workunit.client.0.smithi062.stdout:4/828: sync 2024-05-09T06:30:05.570 INFO:tasks.workunit.client.0.smithi062.stdout:0/772: sync 2024-05-09T06:30:05.570 INFO:tasks.workunit.client.0.smithi062.stdout:4/829: dread - d0/d2a/d14/d4f/d6b/ddd/fe0 zero size 2024-05-09T06:30:05.574 INFO:tasks.workunit.client.0.smithi062.stdout:8/866: truncate da/dea/f17 538931 0 2024-05-09T06:30:05.574 INFO:tasks.workunit.client.0.smithi062.stdout:8/867: truncate da/dea/d1c/f11c 132336 0 2024-05-09T06:30:05.580 INFO:tasks.workunit.client.0.smithi062.stdout:0/773: truncate d1/d25/d59/f65 2889764 0 2024-05-09T06:30:05.583 INFO:tasks.workunit.client.0.smithi062.stdout:4/830: creat d0/d5b/ffc x:0 0 0 2024-05-09T06:30:05.584 INFO:tasks.workunit.client.0.smithi062.stdout:8/868: dread da/dea/d2e/d7e/ff5 [0,4194304] 0 2024-05-09T06:30:05.586 INFO:tasks.workunit.client.0.smithi062.stdout:0/774: rename d1/d6a/fd6 to d1/d25/d31/d6c/df5/f112 0 2024-05-09T06:30:05.591 INFO:tasks.workunit.client.0.smithi062.stdout:2/737: dwrite d0/d9/dd/f6c [0,4194304] 0 2024-05-09T06:30:05.593 INFO:tasks.workunit.client.0.smithi062.stdout:8/869: rmdir da/df0 39 2024-05-09T06:30:05.593 INFO:tasks.workunit.client.0.smithi062.stdout:8/870: creat da/dea/dd2/dd6/f11d x:0 0 0 2024-05-09T06:30:05.594 INFO:tasks.workunit.client.0.smithi062.stdout:4/831: write d0/d2a/d14/d4f/d6b/ddc/fe5 [4397603,41348] 0 2024-05-09T06:30:05.594 INFO:tasks.workunit.client.0.smithi062.stdout:4/832: readlink d0/d3c/da1/la4 0 2024-05-09T06:30:05.594 INFO:tasks.workunit.client.0.smithi062.stdout:6/938: dwrite dc/d28/d46/d3a/d7f/d91/fb4 [0,4194304] 0 2024-05-09T06:30:05.594 INFO:tasks.workunit.client.0.smithi062.stdout:6/939: stat dc/d28/d46/d4a/d5d/l30 0 2024-05-09T06:30:05.601 INFO:tasks.workunit.client.0.smithi062.stdout:2/738: mkdir d0/d9/d38/d41/de1/dee 0 2024-05-09T06:30:05.605 INFO:tasks.workunit.client.0.smithi062.stdout:8/871: mknod da/d95/c11e 0 2024-05-09T06:30:05.609 INFO:tasks.workunit.client.0.smithi062.stdout:6/940: dwrite dc/d28/d46/d3a/d7f/f11e [0,4194304] 0 2024-05-09T06:30:05.611 INFO:tasks.workunit.client.0.smithi062.stdout:4/833: creat d0/d5b/dc5/ffd x:0 0 0 2024-05-09T06:30:05.611 INFO:tasks.workunit.client.0.smithi062.stdout:4/834: fdatasync d0/d2a/f8f 0 2024-05-09T06:30:05.611 INFO:tasks.workunit.client.0.smithi062.stdout:4/835: chown d0/d2a/d1f/f70 1658 1 2024-05-09T06:30:05.612 INFO:tasks.workunit.client.0.smithi062.stdout:0/775: dwrite d1/fc [0,4194304] 0 2024-05-09T06:30:05.614 INFO:tasks.workunit.client.0.smithi062.stdout:2/739: dread d0/d9/dd/d65/d6d/f56 [0,4194304] 0 2024-05-09T06:30:05.614 INFO:tasks.workunit.client.0.smithi062.stdout:2/740: read - d0/d9/d17/d37/fa1 zero size 2024-05-09T06:30:05.619 INFO:tasks.workunit.client.0.smithi062.stdout:8/872: dread da/dea/f17 [0,4194304] 0 2024-05-09T06:30:05.626 INFO:tasks.workunit.client.0.smithi062.stdout:4/836: link d0/d2a/d14/d7e/f73 d0/d2a/d1f/dc9/da0/ffe 0 2024-05-09T06:30:05.626 INFO:tasks.workunit.client.0.smithi062.stdout:4/837: creat d0/d2a/d14/d7e/d8e/d9e/d28/fff x:0 0 0 2024-05-09T06:30:05.627 INFO:tasks.workunit.client.0.smithi062.stdout:6/941: dwrite dc/d28/d10/d20/f51 [0,4194304] 0 2024-05-09T06:30:05.636 INFO:tasks.workunit.client.0.smithi062.stdout:0/776: rename d1/d25/d31/d6c/f67 to d1/d6a/d6d/d93/d94/dc7/f113 0 2024-05-09T06:30:05.637 INFO:tasks.workunit.client.0.smithi062.stdout:0/777: dread - d1/d25/d49/d42/d43/d54/fe9 zero size 2024-05-09T06:30:05.638 INFO:tasks.workunit.client.0.smithi062.stdout:2/741: creat d0/d9/d38/d41/d53/fef x:0 0 0 2024-05-09T06:30:05.638 INFO:tasks.workunit.client.0.smithi062.stdout:2/742: write d0/d9/d38/d41/db1/f9d [909493,112958] 0 2024-05-09T06:30:05.639 INFO:tasks.workunit.client.0.smithi062.stdout:8/873: unlink da/dea/d2e/d34/dd4/fcd 0 2024-05-09T06:30:05.640 INFO:tasks.workunit.client.0.smithi062.stdout:8/874: truncate da/dea/d2e/d34/dd4/fe9 287186 0 2024-05-09T06:30:05.640 INFO:tasks.workunit.client.0.smithi062.stdout:8/875: write da/dea/d1c/d9e/d9f/da7/fb7 [1500654,49042] 0 2024-05-09T06:30:05.640 INFO:tasks.workunit.client.0.smithi062.stdout:8/876: stat da/d77/ff2 0 2024-05-09T06:30:05.644 INFO:tasks.workunit.client.0.smithi062.stdout:8/877: dread da/dea/d2e/fe5 [0,4194304] 0 2024-05-09T06:30:05.644 INFO:tasks.workunit.client.0.smithi062.stdout:8/878: fdatasync da/dea/d1c/f9a 0 2024-05-09T06:30:05.645 INFO:tasks.workunit.client.0.smithi062.stdout:6/942: truncate dc/d28/f9a 516212 0 2024-05-09T06:30:05.646 INFO:tasks.workunit.client.0.smithi062.stdout:4/838: dwrite d0/d2a/d8/d69/daf/f91 [4194304,4194304] 0 2024-05-09T06:30:05.646 INFO:tasks.workunit.client.0.smithi062.stdout:4/839: readlink d0/d2a/d8/d69/daf/ld4 0 2024-05-09T06:30:05.646 INFO:tasks.workunit.client.0.smithi062.stdout:4/840: fsync d0/d2a/d14/d7e/fe9 0 2024-05-09T06:30:05.646 INFO:tasks.workunit.client.0.smithi062.stdout:4/841: dread - d0/d2a/d14/d7e/ffb zero size 2024-05-09T06:30:05.646 INFO:tasks.workunit.client.0.smithi062.stdout:7/755: sync 2024-05-09T06:30:05.646 INFO:tasks.workunit.client.0.smithi062.stdout:9/779: sync 2024-05-09T06:30:05.647 INFO:tasks.workunit.client.0.smithi062.stdout:1/609: sync 2024-05-09T06:30:05.647 INFO:tasks.workunit.client.0.smithi062.stdout:1/610: stat f5 0 2024-05-09T06:30:05.647 INFO:tasks.workunit.client.0.smithi062.stdout:0/778: dread - d1/d25/d49/d4f/de6/f6b zero size 2024-05-09T06:30:05.647 INFO:tasks.workunit.client.0.smithi062.stdout:0/779: write d1/d6a/d6d/d93/d94/dc7/f50 [1860954,77900] 0 2024-05-09T06:30:05.651 INFO:tasks.workunit.client.0.smithi062.stdout:2/743: creat d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/ff0 x:0 0 0 2024-05-09T06:30:05.652 INFO:tasks.workunit.client.0.smithi062.stdout:0/780: write d1/d25/d49/d42/d43/f7d [2939746,73057] 0 2024-05-09T06:30:05.657 INFO:tasks.workunit.client.0.smithi062.stdout:8/879: symlink da/dea/d1c/d9e/l11f 0 2024-05-09T06:30:05.659 INFO:tasks.workunit.client.0.smithi062.stdout:6/943: symlink dc/d28/d10/d20/l13d 0 2024-05-09T06:30:05.667 INFO:tasks.workunit.client.0.smithi062.stdout:7/756: dwrite d0/d3a/d51/d64/d6d/f98 [0,4194304] 0 2024-05-09T06:30:05.668 INFO:tasks.workunit.client.0.smithi062.stdout:4/842: rename d0/d2a/d8/d69/f8b to d0/d5b/d85/f100 0 2024-05-09T06:30:05.671 INFO:tasks.workunit.client.0.smithi062.stdout:2/744: creat d0/d9/dd/d65/d6d/d96/de3/ff1 x:0 0 0 2024-05-09T06:30:05.672 INFO:tasks.workunit.client.0.smithi062.stdout:2/745: chown d0/d9/dd/d65/d6d/d21/d29/d3d/d46/l77 12 1 2024-05-09T06:30:05.672 INFO:tasks.workunit.client.0.smithi062.stdout:2/746: write d0/d9/dd/d65/d6d/f24 [828209,14981] 0 2024-05-09T06:30:05.674 INFO:tasks.workunit.client.0.smithi062.stdout:0/781: mkdir d1/d25/d49/d4f/d52/d87/dc8/d114 0 2024-05-09T06:30:05.675 INFO:tasks.workunit.client.0.smithi062.stdout:8/880: mknod da/dea/d2e/d7e/d83/c120 0 2024-05-09T06:30:05.675 INFO:tasks.workunit.client.0.smithi062.stdout:8/881: dread - da/dea/d1c/de0/f110 zero size 2024-05-09T06:30:05.676 INFO:tasks.workunit.client.0.smithi062.stdout:8/882: write da/dea/d2e/d34/d90/f102 [759961,71227] 0 2024-05-09T06:30:05.677 INFO:tasks.workunit.client.0.smithi062.stdout:8/883: dread da/dea/d2e/fca [0,4194304] 0 2024-05-09T06:30:05.681 INFO:tasks.workunit.client.0.smithi062.stdout:0/782: dread d1/d6a/fbd [0,4194304] 0 2024-05-09T06:30:05.681 INFO:tasks.workunit.client.0.smithi062.stdout:0/783: read d1/f2a [2186475,56138] 0 2024-05-09T06:30:05.682 INFO:tasks.workunit.client.0.smithi062.stdout:1/611: rename d8/d1d/d9c/f45 to d8/d14/d2b/d3c/d44/d4b/fc6 0 2024-05-09T06:30:05.685 INFO:tasks.workunit.client.0.smithi062.stdout:4/843: mknod d0/d9/de8/c101 0 2024-05-09T06:30:05.686 INFO:tasks.workunit.client.0.smithi062.stdout:9/780: getdents d3/d3e/d52/d58/d1c/d1e/d41/d64 0 2024-05-09T06:30:05.689 INFO:tasks.workunit.client.0.smithi062.stdout:5/910: sync 2024-05-09T06:30:05.689 INFO:tasks.workunit.client.0.smithi062.stdout:5/911: dread - d0/d8/d47/f110 zero size 2024-05-09T06:30:05.690 INFO:tasks.workunit.client.0.smithi062.stdout:5/912: write d0/d8/d1c/f32 [1879912,80866] 0 2024-05-09T06:30:05.690 INFO:tasks.workunit.client.0.smithi062.stdout:2/747: mknod d0/d9/dd/d65/d6d/d21/d29/d40/cf2 0 2024-05-09T06:30:05.691 INFO:tasks.workunit.client.0.smithi062.stdout:7/757: getdents d0/d12/d66/d9e 0 2024-05-09T06:30:05.691 INFO:tasks.workunit.client.0.smithi062.stdout:7/758: fsync d0/d12/d33/d67/f7e 0 2024-05-09T06:30:05.692 INFO:tasks.workunit.client.0.smithi062.stdout:1/612: write d8/d14/f72 [2960478,51290] 0 2024-05-09T06:30:05.698 INFO:tasks.workunit.client.0.smithi062.stdout:6/944: rename dc/d28/d46/d3a/d7f/d91/d93/dc0/c7b to dc/d28/d34/db7/d138/c13e 0 2024-05-09T06:30:05.700 INFO:tasks.workunit.client.0.smithi062.stdout:2/748: dread d0/d9/dd/d65/d6d/d21/d29/d3d/f79 [0,4194304] 0 2024-05-09T06:30:05.701 INFO:tasks.workunit.client.0.smithi062.stdout:4/844: creat d0/d2a/f102 x:0 0 0 2024-05-09T06:30:05.702 INFO:tasks.workunit.client.0.smithi062.stdout:0/784: dwrite d1/d6a/f9c [0,4194304] 0 2024-05-09T06:30:05.702 INFO:tasks.workunit.client.0.smithi062.stdout:0/785: write d1/d25/d31/db5/fcd [3022209,89282] 0 2024-05-09T06:30:05.702 INFO:tasks.workunit.client.0.smithi062.stdout:0/786: readlink d1/d6a/d6d/d93/d94/dc7/l111 0 2024-05-09T06:30:05.703 INFO:tasks.workunit.client.0.smithi062.stdout:7/759: write d0/f92 [55388,111639] 0 2024-05-09T06:30:05.703 INFO:tasks.workunit.client.0.smithi062.stdout:9/781: mkdir d3/d3e/d52/d58/d1c/d21/dfc 0 2024-05-09T06:30:05.705 INFO:tasks.workunit.client.0.smithi062.stdout:5/913: rename d0/d8/d47/dbe/d86/da4/ffd to d0/d8/d18/f131 0 2024-05-09T06:30:05.705 INFO:tasks.workunit.client.0.smithi062.stdout:5/914: fsync d0/f79 0 2024-05-09T06:30:05.707 INFO:tasks.workunit.client.0.smithi062.stdout:6/945: creat dc/d28/d34/db7/d138/f13f x:0 0 0 2024-05-09T06:30:05.708 INFO:tasks.workunit.client.0.smithi062.stdout:6/946: fsync dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/fb2 0 2024-05-09T06:30:05.709 INFO:tasks.workunit.client.0.smithi062.stdout:2/749: symlink d0/d9/dd9/dca/lf3 0 2024-05-09T06:30:05.712 INFO:tasks.workunit.client.0.smithi062.stdout:7/760: mknod d0/d12/d33/d67/da7/dcd/ddd/cf5 0 2024-05-09T06:30:05.715 INFO:tasks.workunit.client.0.smithi062.stdout:5/915: symlink d0/d3b/dbc/l132 0 2024-05-09T06:30:05.717 INFO:tasks.workunit.client.0.smithi062.stdout:6/947: unlink dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/f10a 0 2024-05-09T06:30:05.719 INFO:tasks.workunit.client.0.smithi062.stdout:2/750: creat d0/d9/d17/d89/ff4 x:0 0 0 2024-05-09T06:30:05.719 INFO:tasks.workunit.client.0.smithi062.stdout:2/751: creat d0/d9/d17/d89/ff5 x:0 0 0 2024-05-09T06:30:05.721 INFO:tasks.workunit.client.0.smithi062.stdout:7/761: mknod d0/d12/d66/cf6 0 2024-05-09T06:30:05.723 INFO:tasks.workunit.client.0.smithi062.stdout:0/787: dwrite d1/d25/fdc [4194304,4194304] 0 2024-05-09T06:30:05.726 INFO:tasks.workunit.client.0.smithi062.stdout:5/916: unlink d0/d8/d18/c88 0 2024-05-09T06:30:05.732 INFO:tasks.workunit.client.0.smithi062.stdout:2/752: mkdir d0/d9/d38/d41/de1/df6 0 2024-05-09T06:30:05.736 INFO:tasks.workunit.client.0.smithi062.stdout:4/845: rename d0/d2a/d14 to d0/d2a/d1f/d103 0 2024-05-09T06:30:05.737 INFO:tasks.workunit.client.0.smithi062.stdout:5/917: unlink d0/d8/d47/dbe/d5/dbf/f118 0 2024-05-09T06:30:05.740 INFO:tasks.workunit.client.0.smithi062.stdout:5/918: dread d0/d8/d47/dbe/d45/da5/ff9 [0,4194304] 0 2024-05-09T06:30:05.747 INFO:tasks.workunit.client.0.smithi062.stdout:2/753: getdents d0/d9/dd/d65 0 2024-05-09T06:30:05.749 INFO:tasks.workunit.client.0.smithi062.stdout:4/846: dwrite d0/d2a/d1f/d103/d7e/d8e/d9e/d28/f41 [0,4194304] 0 2024-05-09T06:30:05.750 INFO:tasks.workunit.client.0.smithi062.stdout:9/782: rename d3/d3e/d52/d58/d1c/d1e/d41/f7f to d3/d3e/d52/d58/d1c/d1e/ffd 0 2024-05-09T06:30:05.750 INFO:tasks.workunit.client.0.smithi062.stdout:9/783: creat d3/d20/ffe x:0 0 0 2024-05-09T06:30:05.753 INFO:tasks.workunit.client.0.smithi062.stdout:2/754: truncate d0/d9/dd/d65/f71 1332970 0 2024-05-09T06:30:05.753 INFO:tasks.workunit.client.0.smithi062.stdout:2/755: chown d0/d9/dd/f20 74618614 1 2024-05-09T06:30:05.755 INFO:tasks.workunit.client.0.smithi062.stdout:4/847: unlink d0/d2a/d1f/cf4 0 2024-05-09T06:30:05.758 INFO:tasks.workunit.client.0.smithi062.stdout:6/948: rename dc/d28/d10/d20/d5b/d77/ff7 to dc/d28/d46/d3a/f140 0 2024-05-09T06:30:05.758 INFO:tasks.workunit.client.0.smithi062.stdout:6/949: creat dc/d28/d34/db7/d138/f141 x:0 0 0 2024-05-09T06:30:05.759 INFO:tasks.workunit.client.0.smithi062.stdout:6/950: truncate dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/de4/fd3 1003833 0 2024-05-09T06:30:05.761 INFO:tasks.workunit.client.0.smithi062.stdout:9/784: write d3/d3e/d52/d58/d1c/d21/f53 [3412715,22552] 0 2024-05-09T06:30:05.761 INFO:tasks.workunit.client.0.smithi062.stdout:5/919: getdents d0/d3b/d3f 0 2024-05-09T06:30:05.761 INFO:tasks.workunit.client.0.smithi062.stdout:5/920: stat d0/f37 0 2024-05-09T06:30:05.761 INFO:tasks.workunit.client.0.smithi062.stdout:5/921: write d0/d8/d47/dbe/d5/dbf/f130 [566531,116312] 0 2024-05-09T06:30:05.763 INFO:tasks.workunit.client.0.smithi062.stdout:0/788: truncate d1/d25/d31/d6c/d44/fc5 855384 0 2024-05-09T06:30:05.764 INFO:tasks.workunit.client.0.smithi062.stdout:6/951: dread dc/d28/d10/f1c [0,4194304] 0 2024-05-09T06:30:05.765 INFO:tasks.workunit.client.0.smithi062.stdout:2/756: link d0/d9/dd/d65/d6d/d96/cb8 d0/d90/db7/cf7 0 2024-05-09T06:30:05.765 INFO:tasks.workunit.client.0.smithi062.stdout:2/757: chown d0/d9/d17/f73 5546 1 2024-05-09T06:30:05.765 INFO:tasks.workunit.client.0.smithi062.stdout:2/758: dread - d0/d9/dd/d65/d6d/feb zero size 2024-05-09T06:30:05.765 INFO:tasks.workunit.client.0.smithi062.stdout:2/759: fsync d0/d9/dd9/d93/faf 0 2024-05-09T06:30:05.772 INFO:tasks.workunit.client.0.smithi062.stdout:4/848: link d0/d2a/d8/d69/daf/ld4 d0/d2a/d1f/d103/d4f/d6b/ddd/l104 0 2024-05-09T06:30:05.775 INFO:tasks.workunit.client.0.smithi062.stdout:7/762: rename d0/d3a/ca4 to d0/d12/cf7 0 2024-05-09T06:30:05.776 INFO:tasks.workunit.client.0.smithi062.stdout:7/763: chown d0/d3a/d3f/f4c 105784 1 2024-05-09T06:30:05.782 INFO:tasks.workunit.client.0.smithi062.stdout:9/785: rmdir d3/d3e/d52/d58/d1c/d1e/d41/dde/df4 0 2024-05-09T06:30:05.783 INFO:tasks.workunit.client.0.smithi062.stdout:5/922: truncate d0/d8/fea 2769519 0 2024-05-09T06:30:05.783 INFO:tasks.workunit.client.0.smithi062.stdout:5/923: chown d0/d8/d47/dbe/d86/da4/dce/dbd/cb9 98 1 2024-05-09T06:30:05.785 INFO:tasks.workunit.client.0.smithi062.stdout:6/952: unlink dc/d28/d10/d20/db5/fa9 0 2024-05-09T06:30:05.787 INFO:tasks.workunit.client.0.smithi062.stdout:4/849: mknod d0/d2a/d1f/d103/c105 0 2024-05-09T06:30:05.790 INFO:tasks.workunit.client.0.smithi062.stdout:4/850: dread d0/d9/f15 [0,4194304] 0 2024-05-09T06:30:05.791 INFO:tasks.workunit.client.0.smithi062.stdout:9/786: creat d3/d3e/d4b/fff x:0 0 0 2024-05-09T06:30:05.794 INFO:tasks.workunit.client.0.smithi062.stdout:6/953: creat dc/d28/d46/d4a/d5d/d6f/f142 x:0 0 0 2024-05-09T06:30:05.794 INFO:tasks.workunit.client.0.smithi062.stdout:6/954: fsync dc/d28/d34/d4e/d57/d102/fd8 0 2024-05-09T06:30:05.794 INFO:tasks.workunit.client.0.smithi062.stdout:6/955: readlink dc/d28/d46/d4a/d5d/l62 0 2024-05-09T06:30:05.795 INFO:tasks.workunit.client.0.smithi062.stdout:4/851: rename d0/d2a/d1f/d103/d7e/d8e/d9e/c33 to d0/d5b/dc5/df0/c106 0 2024-05-09T06:30:05.796 INFO:tasks.workunit.client.0.smithi062.stdout:9/787: rmdir d3/d3e/d52/d58 39 2024-05-09T06:30:05.797 INFO:tasks.workunit.client.0.smithi062.stdout:6/956: dread dc/d28/d34/db7/fdf [0,4194304] 0 2024-05-09T06:30:05.807 INFO:tasks.workunit.client.0.smithi062.stdout:9/788: dread d3/d3e/d52/d58/d1c/d1e/d41/d64/f2d [0,4194304] 0 2024-05-09T06:30:05.809 INFO:tasks.workunit.client.0.smithi062.stdout:9/789: creat d3/d3e/d4b/d99/f100 x:0 0 0 2024-05-09T06:30:05.809 INFO:tasks.workunit.client.0.smithi062.stdout:9/790: write d3/d3e/d52/d58/d1c/f87 [97172,47032] 0 2024-05-09T06:30:05.810 INFO:tasks.workunit.client.0.smithi062.stdout:9/791: truncate d3/d3e/d52/ffa 560806 0 2024-05-09T06:30:05.812 INFO:tasks.workunit.client.0.smithi062.stdout:4/852: write d0/d3c/ff9 [7156859,42627] 0 2024-05-09T06:30:05.812 INFO:tasks.workunit.client.0.smithi062.stdout:4/853: write d0/d2a/d1f/dc9/f79 [3060109,886] 0 2024-05-09T06:30:05.815 INFO:tasks.workunit.client.0.smithi062.stdout:9/792: dread d3/d3e/d52/d58/d1c/d1e/d60/f73 [0,4194304] 0 2024-05-09T06:30:05.817 INFO:tasks.workunit.client.0.smithi062.stdout:9/793: truncate d3/d3e/d52/d58/d1c/d1e/fa3 197349 0 2024-05-09T06:30:05.817 INFO:tasks.workunit.client.0.smithi062.stdout:9/794: dread - d3/d3e/d52/d58/d1c/d1e/d41/d64/dd0/fd1 zero size 2024-05-09T06:30:05.819 INFO:tasks.workunit.client.0.smithi062.stdout:9/795: dread d3/d3e/d7c/fe3 [0,4194304] 0 2024-05-09T06:30:05.819 INFO:tasks.workunit.client.0.smithi062.stdout:0/789: dwrite d1/d6a/f9c [0,4194304] 0 2024-05-09T06:30:05.820 INFO:tasks.workunit.client.0.smithi062.stdout:6/957: dread dc/f17 [0,4194304] 0 2024-05-09T06:30:05.820 INFO:tasks.workunit.client.0.smithi062.stdout:6/958: chown dc/d28/d10/f10d 10909692 1 2024-05-09T06:30:05.820 INFO:tasks.workunit.client.0.smithi062.stdout:6/959: chown dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/cda 2821 1 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:6/960: truncate dc/d28/d46/d3a/d7f/f113 2278011 0 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:6/961: chown dc/d28/d10/d20/d5b/da3/fe1 6966684 1 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:6/962: chown dc/d28/d46/f64 32579 1 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:6/963: truncate dc/d28/d34/db7/fdf 807283 0 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:7/764: dwrite d0/d3a/d51/d64/d6d/d80/fa3 [0,4194304] 0 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:7/765: write d0/d12/d66/faa [3777864,14901] 0 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:0/790: dread d1/d25/d31/d6c/d44/d6e/f96 [0,4194304] 0 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:2/760: dwrite d0/d9/d17/d89/d8f/fd0 [4194304,4194304] 0 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:5/924: dwrite d0/d8/f41 [0,4194304] 0 2024-05-09T06:30:05.821 INFO:tasks.workunit.client.0.smithi062.stdout:9/796: mknod d3/d3e/d52/d58/d77/c101 0 2024-05-09T06:30:05.822 INFO:tasks.workunit.client.0.smithi062.stdout:9/797: chown d3/d20/lb0 79046 1 2024-05-09T06:30:05.822 INFO:tasks.workunit.client.0.smithi062.stdout:9/798: write d3/d3e/d52/d58/f71 [2251239,51438] 0 2024-05-09T06:30:05.823 INFO:tasks.workunit.client.0.smithi062.stdout:3/639: sync 2024-05-09T06:30:05.825 INFO:tasks.workunit.client.0.smithi062.stdout:7/766: rename d0/d12/d66/l84 to d0/d3a/d69/lf8 0 2024-05-09T06:30:05.827 INFO:tasks.workunit.client.0.smithi062.stdout:0/791: rmdir d1/d25/dd2 0 2024-05-09T06:30:05.827 INFO:tasks.workunit.client.0.smithi062.stdout:0/792: chown d1/d25/d31/d6c/d44/d57/laa 696 1 2024-05-09T06:30:05.832 INFO:tasks.workunit.client.0.smithi062.stdout:3/640: symlink d1/d1e/d3b/d83/lcc 0 2024-05-09T06:30:05.833 INFO:tasks.workunit.client.0.smithi062.stdout:9/799: getdents d3/d3e/d52/d58/d1c/d1e/d41/dde 0 2024-05-09T06:30:05.836 INFO:tasks.workunit.client.0.smithi062.stdout:2/761: rename d0/d9/d38/d41/d48/d5f/l81 to d0/d9/d38/lf8 0 2024-05-09T06:30:05.844 INFO:tasks.workunit.client.0.smithi062.stdout:0/793: dwrite d1/d25/d31/d6c/d44/dca/f110 [0,4194304] 0 2024-05-09T06:30:05.849 INFO:tasks.workunit.client.0.smithi062.stdout:3/641: symlink d1/d1e/d36/daa/lcd 0 2024-05-09T06:30:05.849 INFO:tasks.workunit.client.0.smithi062.stdout:3/642: stat d1/d1e/d36/daa/fbb 0 2024-05-09T06:30:05.850 INFO:tasks.workunit.client.0.smithi062.stdout:9/800: symlink d3/d3e/d52/l102 0 2024-05-09T06:30:05.853 INFO:tasks.workunit.client.0.smithi062.stdout:0/794: dread d1/f11 [4194304,4194304] 0 2024-05-09T06:30:05.854 INFO:tasks.workunit.client.0.smithi062.stdout:5/925: rename d0/d8/d1c/d23/d42/l10a to d0/d8/d47/dbe/d86/da4/dce/l133 0 2024-05-09T06:30:05.854 INFO:tasks.workunit.client.0.smithi062.stdout:5/926: write d0/d8/f95 [114278,23638] 0 2024-05-09T06:30:05.855 INFO:tasks.workunit.client.0.smithi062.stdout:2/762: unlink d0/d9/d17/l25 0 2024-05-09T06:30:05.855 INFO:tasks.workunit.client.0.smithi062.stdout:2/763: dread - d0/d9/d17/d37/f7f zero size 2024-05-09T06:30:05.856 INFO:tasks.workunit.client.0.smithi062.stdout:9/801: dread d3/d3e/d52/d58/fb8 [0,4194304] 0 2024-05-09T06:30:05.856 INFO:tasks.workunit.client.0.smithi062.stdout:5/927: read d0/d8/d47/fe3 [18395,56205] 0 2024-05-09T06:30:05.859 INFO:tasks.workunit.client.0.smithi062.stdout:3/643: creat d1/d1e/d36/fce x:0 0 0 2024-05-09T06:30:05.860 INFO:tasks.workunit.client.0.smithi062.stdout:0/795: mknod d1/d25/d49/da1/c115 0 2024-05-09T06:30:05.864 INFO:tasks.workunit.client.0.smithi062.stdout:0/796: mknod d1/d25/d49/c116 0 2024-05-09T06:30:05.864 INFO:tasks.workunit.client.0.smithi062.stdout:0/797: fdatasync d1/d25/d49/d42/d43/f5e 0 2024-05-09T06:30:05.865 INFO:tasks.workunit.client.0.smithi062.stdout:5/928: getdents d0/d8/d47/dbe/d5/dbf 0 2024-05-09T06:30:05.866 INFO:tasks.workunit.client.0.smithi062.stdout:2/764: write d0/d9/dd/f20 [342814,16898] 0 2024-05-09T06:30:05.869 INFO:tasks.workunit.client.0.smithi062.stdout:2/765: mkdir d0/d9/d38/d41/d48/df9 0 2024-05-09T06:30:05.875 INFO:tasks.workunit.client.0.smithi062.stdout:5/929: write d0/d8/d1c/d2c/d7d/fd3 [733459,116795] 0 2024-05-09T06:30:05.878 INFO:tasks.workunit.client.0.smithi062.stdout:0/798: dread d1/d25/fdc [0,4194304] 0 2024-05-09T06:30:05.880 INFO:tasks.workunit.client.0.smithi062.stdout:0/799: getdents d1/d25/d49/d4f/de6 0 2024-05-09T06:30:05.880 INFO:tasks.workunit.client.0.smithi062.stdout:0/800: chown d1/d25/d31/d6c/d44/d6e/f96 44 1 2024-05-09T06:30:05.887 INFO:tasks.workunit.client.0.smithi062.stdout:9/802: dwrite d3/d3e/d52/d58/fb8 [0,4194304] 0 2024-05-09T06:30:05.887 INFO:tasks.workunit.client.0.smithi062.stdout:5/930: write d0/f74 [2778864,9428] 0 2024-05-09T06:30:05.888 INFO:tasks.workunit.client.0.smithi062.stdout:5/931: read d0/d8/f52 [586571,105410] 0 2024-05-09T06:30:05.888 INFO:tasks.workunit.client.0.smithi062.stdout:5/932: truncate d0/d8/d1c/f32 2608780 0 2024-05-09T06:30:05.888 INFO:tasks.workunit.client.0.smithi062.stdout:5/933: write d0/d8/f52 [4062868,113553] 0 2024-05-09T06:30:05.888 INFO:tasks.workunit.client.0.smithi062.stdout:3/644: dwrite d1/d1e/d26/d43/d92/fb2 [0,4194304] 0 2024-05-09T06:30:05.889 INFO:tasks.workunit.client.0.smithi062.stdout:9/803: truncate d3/d3e/d52/d58/d1c/faa 114975 0 2024-05-09T06:30:05.889 INFO:tasks.workunit.client.0.smithi062.stdout:9/804: fdatasync d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/fee 0 2024-05-09T06:30:05.890 INFO:tasks.workunit.client.0.smithi062.stdout:5/934: symlink d0/d3b/d3f/l134 0 2024-05-09T06:30:05.892 INFO:tasks.workunit.client.0.smithi062.stdout:2/766: dwrite d0/d9/dd/f1c [0,4194304] 0 2024-05-09T06:30:05.907 INFO:tasks.workunit.client.0.smithi062.stdout:3/645: mknod d1/d1e/d26/ccf 0 2024-05-09T06:30:05.908 INFO:tasks.workunit.client.0.smithi062.stdout:9/805: truncate d3/d3e/d52/d58/d1c/d1e/d41/d64/fbb 736020 0 2024-05-09T06:30:05.909 INFO:tasks.workunit.client.0.smithi062.stdout:5/935: symlink d0/d8/d107/l135 0 2024-05-09T06:30:05.909 INFO:tasks.workunit.client.0.smithi062.stdout:5/936: chown d0/d8/d47/dbe/d45/c117 910843305 1 2024-05-09T06:30:05.909 INFO:tasks.workunit.client.0.smithi062.stdout:5/937: truncate d0/d8/d47/dbe/d45/d92/fac 4378631 0 2024-05-09T06:30:05.909 INFO:tasks.workunit.client.0.smithi062.stdout:5/938: fsync d0/d11/f89 0 2024-05-09T06:30:05.911 INFO:tasks.workunit.client.0.smithi062.stdout:2/767: mknod d0/d9/d17/d89/d8f/cfa 0 2024-05-09T06:30:05.912 INFO:tasks.workunit.client.0.smithi062.stdout:9/806: getdents d3/d20/dc7 0 2024-05-09T06:30:05.914 INFO:tasks.workunit.client.0.smithi062.stdout:5/939: rename d0/d8/d47/cba to d0/d8/d1c/d23/d3e/c136 0 2024-05-09T06:30:05.914 INFO:tasks.workunit.client.0.smithi062.stdout:5/940: chown d0/d11/ld 129111 1 2024-05-09T06:30:05.915 INFO:tasks.workunit.client.0.smithi062.stdout:2/768: creat d0/d9/d38/d41/d8a/ffb x:0 0 0 2024-05-09T06:30:05.917 INFO:tasks.workunit.client.0.smithi062.stdout:9/807: truncate d3/d3e/d52/d58/d1c/d21/f53 398646 0 2024-05-09T06:30:05.920 INFO:tasks.workunit.client.0.smithi062.stdout:9/808: mkdir d3/d3e/d52/d58/d1c/d1e/d103 0 2024-05-09T06:30:05.928 INFO:tasks.workunit.client.0.smithi062.stdout:5/941: dread d0/d8/d47/dbe/d45/f76 [0,4194304] 0 2024-05-09T06:30:05.933 INFO:tasks.workunit.client.0.smithi062.stdout:5/942: rename d0/d8/d18/da6/f11b to d0/d11/d67/f137 0 2024-05-09T06:30:05.933 INFO:tasks.workunit.client.0.smithi062.stdout:5/943: fdatasync d0/d11/f89 0 2024-05-09T06:30:05.933 INFO:tasks.workunit.client.0.smithi062.stdout:5/944: chown d0/d8/d1c/d2c/d7d 39 1 2024-05-09T06:30:05.933 INFO:tasks.workunit.client.0.smithi062.stdout:5/945: dread d0/d8/d18/da6/ddf/fec [0,4194304] 0 2024-05-09T06:30:05.934 INFO:tasks.workunit.client.0.smithi062.stdout:3/646: dwrite d1/d1e/d36/daa/fcb [0,4194304] 0 2024-05-09T06:30:05.936 INFO:tasks.workunit.client.0.smithi062.stdout:5/946: rmdir d0/d8/d1c/d23/d3e/de9 39 2024-05-09T06:30:05.939 INFO:tasks.workunit.client.0.smithi062.stdout:2/769: dwrite d0/d9/dd/d65/d6d/d21/f55 [0,4194304] 0 2024-05-09T06:30:05.939 INFO:tasks.workunit.client.0.smithi062.stdout:2/770: fsync d0/d9/dd/d65/fac 0 2024-05-09T06:30:05.940 INFO:tasks.workunit.client.0.smithi062.stdout:9/809: dwrite d3/d3e/d52/d58/d1c/d1e/d60/fe6 [0,4194304] 0 2024-05-09T06:30:05.940 INFO:tasks.workunit.client.0.smithi062.stdout:3/647: rename d1/d1e/d26/fab to d1/d1e/d26/fd0 0 2024-05-09T06:30:05.940 INFO:tasks.workunit.client.0.smithi062.stdout:3/648: stat d1/d1e/d36/d9f/f79 0 2024-05-09T06:30:05.942 INFO:tasks.workunit.client.0.smithi062.stdout:5/947: truncate d0/f79 1278132 0 2024-05-09T06:30:05.945 INFO:tasks.workunit.client.0.smithi062.stdout:2/771: link d0/d9/dd/d65/d6d/d21/d29/d3d/l47 d0/d9/dd/d65/d6d/d96/da4/lfc 0 2024-05-09T06:30:05.946 INFO:tasks.workunit.client.0.smithi062.stdout:2/772: write d0/d9/dd/f98 [227280,12122] 0 2024-05-09T06:30:05.952 INFO:tasks.workunit.client.0.smithi062.stdout:9/810: mknod d3/d3e/c104 0 2024-05-09T06:30:05.955 INFO:tasks.workunit.client.0.smithi062.stdout:3/649: mkdir d1/d1e/d26/d43/d52/d81/dd1 0 2024-05-09T06:30:05.956 INFO:tasks.workunit.client.0.smithi062.stdout:5/948: truncate d0/d8/d1c/d23/f48 1916465 0 2024-05-09T06:30:05.958 INFO:tasks.workunit.client.0.smithi062.stdout:2/773: link d0/d9/dd/l16 d0/d9/d17/d89/d8f/lfd 0 2024-05-09T06:30:05.958 INFO:tasks.workunit.client.0.smithi062.stdout:2/774: write d0/d9/dd/f98 [1441464,78089] 0 2024-05-09T06:30:05.961 INFO:tasks.workunit.client.0.smithi062.stdout:9/811: read d3/d3e/d52/d58/d77/d92/f9e [1575227,48206] 0 2024-05-09T06:30:05.966 INFO:tasks.workunit.client.0.smithi062.stdout:2/775: dread d0/d9/dd/d65/d6d/d21/f55 [0,4194304] 0 2024-05-09T06:30:05.966 INFO:tasks.workunit.client.0.smithi062.stdout:2/776: chown d0/d9/dd/d65/d6d/d96/da4/lfc 1 1 2024-05-09T06:30:05.967 INFO:tasks.workunit.client.0.smithi062.stdout:2/777: chown d0/d9/dd9/d93/fc3 2044 1 2024-05-09T06:30:05.968 INFO:tasks.workunit.client.0.smithi062.stdout:3/650: mkdir d1/d1e/d36/d9f/d4f/dd2 0 2024-05-09T06:30:05.973 INFO:tasks.workunit.client.0.smithi062.stdout:5/949: link d0/d8/d1c/d2c/d7d/lfb d0/d8/d1c/d23/l138 0 2024-05-09T06:30:05.975 INFO:tasks.workunit.client.0.smithi062.stdout:2/778: creat d0/ffe x:0 0 0 2024-05-09T06:30:05.975 INFO:tasks.workunit.client.0.smithi062.stdout:2/779: fsync d0/d9/dd/d65/fea 0 2024-05-09T06:30:05.975 INFO:tasks.workunit.client.0.smithi062.stdout:2/780: chown d0/d9/dd/d65/d6d/d21/d29/d3d 119250946 1 2024-05-09T06:30:05.978 INFO:tasks.workunit.client.0.smithi062.stdout:5/950: symlink d0/d8/d47/dbe/d45/da5/dcf/d109/l139 0 2024-05-09T06:30:05.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/781: creat d0/d9/d38/fff x:0 0 0 2024-05-09T06:30:05.982 INFO:tasks.workunit.client.0.smithi062.stdout:5/951: creat d0/d8/d47/dbe/d45/f13a x:0 0 0 2024-05-09T06:30:05.982 INFO:tasks.workunit.client.0.smithi062.stdout:5/952: write d0/d8/d47/dbe/d45/d92/fac [4678719,50880] 0 2024-05-09T06:30:05.982 INFO:tasks.workunit.client.0.smithi062.stdout:5/953: write d0/d8/d18/da6/dee/f125 [414107,119952] 0 2024-05-09T06:30:05.986 INFO:tasks.workunit.client.0.smithi062.stdout:3/651: dwrite d1/f9d [0,4194304] 0 2024-05-09T06:30:05.986 INFO:tasks.workunit.client.0.smithi062.stdout:3/652: stat d1/d1e/d26/d43/d92/d77 0 2024-05-09T06:30:05.988 INFO:tasks.workunit.client.0.smithi062.stdout:9/812: dwrite d3/d3e/d52/d58/d77/d92/f9e [0,4194304] 0 2024-05-09T06:30:05.988 INFO:tasks.workunit.client.0.smithi062.stdout:9/813: readlink d3/d3e/d52/d58/d1c/d21/l8c 0 2024-05-09T06:30:05.988 INFO:tasks.workunit.client.0.smithi062.stdout:9/814: write d3/d3e/d52/d58/d1c/faa [165761,123683] 0 2024-05-09T06:30:05.992 INFO:tasks.workunit.client.0.smithi062.stdout:9/815: rmdir d3/d20/dc7 39 2024-05-09T06:30:05.992 INFO:tasks.workunit.client.0.smithi062.stdout:9/816: dread - d3/d3e/d4b/fff zero size 2024-05-09T06:30:06.021 INFO:tasks.workunit.client.0.smithi062.stdout:9/817: rename d3/d3e/d52/d58/d77/d92/fdb to d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/dc8/f105 0 2024-05-09T06:30:06.025 INFO:tasks.workunit.client.0.smithi062.stdout:9/818: rename d3/f84 to d3/d3e/d52/d58/d1c/d1e/d60/f106 0 2024-05-09T06:30:06.027 INFO:tasks.workunit.client.0.smithi062.stdout:9/819: unlink d3/d3e/d52/d58/d1c/d1e/d41/dc5/cdf 0 2024-05-09T06:30:06.029 INFO:tasks.workunit.client.0.smithi062.stdout:9/820: rename d3/d3e/d52/fbd to d3/d20/f107 0 2024-05-09T06:30:06.071 INFO:tasks.workunit.client.0.smithi062.stdout:2/782: dwrite d0/fa2 [0,4194304] 0 2024-05-09T06:30:06.071 INFO:tasks.workunit.client.0.smithi062.stdout:5/954: dwrite d0/d8/d18/f5d [4194304,4194304] 0 2024-05-09T06:30:06.077 INFO:tasks.workunit.client.0.smithi062.stdout:9/821: dwrite d3/d3e/d52/d58/d1c/f76 [0,4194304] 0 2024-05-09T06:30:06.077 INFO:tasks.workunit.client.0.smithi062.stdout:9/822: creat d3/d3e/d52/d58/d1c/d1e/d41/f108 x:0 0 0 2024-05-09T06:30:06.078 INFO:tasks.workunit.client.0.smithi062.stdout:5/955: dread d0/f9c [0,4194304] 0 2024-05-09T06:30:06.080 INFO:tasks.workunit.client.0.smithi062.stdout:5/956: dread d0/d8/d47/dbe/f9e [0,4194304] 0 2024-05-09T06:30:06.084 INFO:tasks.workunit.client.0.smithi062.stdout:9/823: rename d3/d3e/d52/d58/d1c/d1e/d41/d64/dd0/fed to d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/f109 0 2024-05-09T06:30:06.085 INFO:tasks.workunit.client.0.smithi062.stdout:8/884: sync 2024-05-09T06:30:06.087 INFO:tasks.workunit.client.0.smithi062.stdout:2/783: dwrite d0/d9/dd/d65/d6d/d21/f3c [0,4194304] 0 2024-05-09T06:30:06.088 INFO:tasks.workunit.client.0.smithi062.stdout:2/784: creat d0/d9/dd/d65/d6d/d21/f100 x:0 0 0 2024-05-09T06:30:06.088 INFO:tasks.workunit.client.0.smithi062.stdout:5/957: mkdir d0/d8/d47/dbe/d86/da4/dce/dbd/d13b 0 2024-05-09T06:30:06.088 INFO:tasks.workunit.client.0.smithi062.stdout:5/958: truncate d0/fc5 855822 0 2024-05-09T06:30:06.090 INFO:tasks.workunit.client.0.smithi062.stdout:8/885: creat da/dea/d2e/d7e/f121 x:0 0 0 2024-05-09T06:30:06.090 INFO:tasks.workunit.client.0.smithi062.stdout:8/886: chown da/dea/d2e/d7e/f121 67262 1 2024-05-09T06:30:06.094 INFO:tasks.workunit.client.0.smithi062.stdout:2/785: rmdir d0/d9/d38/d41/de1 39 2024-05-09T06:30:06.094 INFO:tasks.workunit.client.0.smithi062.stdout:2/786: readlink d0/d9/d38/laa 0 2024-05-09T06:30:06.096 INFO:tasks.workunit.client.0.smithi062.stdout:2/787: rename d0/d9/d38/fbf to d0/d9/d38/d41/f101 0 2024-05-09T06:30:06.096 INFO:tasks.workunit.client.0.smithi062.stdout:2/788: stat d0/d9/dd/d65/d6d/d96 0 2024-05-09T06:30:06.096 INFO:tasks.workunit.client.0.smithi062.stdout:2/789: fsync d0/d9/dd/f5e 0 2024-05-09T06:30:06.096 INFO:tasks.workunit.client.0.smithi062.stdout:2/790: chown d0/f39 79009728 1 2024-05-09T06:30:06.097 INFO:tasks.workunit.client.0.smithi062.stdout:5/959: dread d0/d8/d18/f78 [0,4194304] 0 2024-05-09T06:30:06.099 INFO:tasks.workunit.client.0.smithi062.stdout:2/791: unlink d0/d9/d38/d41/f51 0 2024-05-09T06:30:06.102 INFO:tasks.workunit.client.0.smithi062.stdout:5/960: truncate d0/d8/d47/dbe/d45/d92/f9b 63296 0 2024-05-09T06:30:06.102 INFO:tasks.workunit.client.0.smithi062.stdout:5/961: creat d0/d8/d47/dbe/d86/da4/f13c x:0 0 0 2024-05-09T06:30:06.106 INFO:tasks.workunit.client.0.smithi062.stdout:5/962: mknod d0/d8/d47/dbe/d86/da4/d105/c13d 0 2024-05-09T06:30:06.108 INFO:tasks.workunit.client.0.smithi062.stdout:9/824: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/f2d [0,4194304] 0 2024-05-09T06:30:06.108 INFO:tasks.workunit.client.0.smithi062.stdout:9/825: write d3/d3e/d7c/fe3 [715593,1682] 0 2024-05-09T06:30:06.108 INFO:tasks.workunit.client.0.smithi062.stdout:9/826: fdatasync d3/d3e/d52/d58/d1c/fbf 0 2024-05-09T06:30:06.108 INFO:tasks.workunit.client.0.smithi062.stdout:5/963: symlink d0/d8/d1c/d23/d3e/de9/l13e 0 2024-05-09T06:30:06.119 INFO:tasks.workunit.client.0.smithi062.stdout:2/792: dwrite d0/d9/dd/fd5 [0,4194304] 0 2024-05-09T06:30:06.120 INFO:tasks.workunit.client.0.smithi062.stdout:8/887: dwrite da/dea/d1c/de0/f110 [0,4194304] 0 2024-05-09T06:30:06.120 INFO:tasks.workunit.client.0.smithi062.stdout:8/888: fsync da/dea/d2e/fca 0 2024-05-09T06:30:06.120 INFO:tasks.workunit.client.0.smithi062.stdout:9/827: dread d3/d3e/d52/d58/d1c/f6a [0,4194304] 0 2024-05-09T06:30:06.120 INFO:tasks.workunit.client.0.smithi062.stdout:9/828: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/dc8/f10a x:0 0 0 2024-05-09T06:30:06.120 INFO:tasks.workunit.client.0.smithi062.stdout:9/829: fsync d3/f98 0 2024-05-09T06:30:06.122 INFO:tasks.workunit.client.0.smithi062.stdout:2/793: mkdir d0/d9/dd/d65/d6d/d102 0 2024-05-09T06:30:06.122 INFO:tasks.workunit.client.0.smithi062.stdout:2/794: write d0/d9/d17/d89/ff5 [745509,66134] 0 2024-05-09T06:30:06.130 INFO:tasks.workunit.client.0.smithi062.stdout:9/830: symlink d3/d20/dc7/l10b 0 2024-05-09T06:30:06.131 INFO:tasks.workunit.client.0.smithi062.stdout:2/795: rmdir d0/d9/dd/d65 39 2024-05-09T06:30:06.131 INFO:tasks.workunit.client.0.smithi062.stdout:2/796: creat d0/d9/dd/d65/d6d/f103 x:0 0 0 2024-05-09T06:30:06.132 INFO:tasks.workunit.client.0.smithi062.stdout:9/831: symlink d3/d3e/d52/d58/d1c/d1e/d103/l10c 0 2024-05-09T06:30:06.132 INFO:tasks.workunit.client.0.smithi062.stdout:9/832: chown d3/d3e 4146 1 2024-05-09T06:30:06.135 INFO:tasks.workunit.client.0.smithi062.stdout:2/797: rename d0/d9/d17/d89/ff4 to d0/d9/d38/d41/d94/f104 0 2024-05-09T06:30:06.135 INFO:tasks.workunit.client.0.smithi062.stdout:2/798: chown d0/c11 8 1 2024-05-09T06:30:06.135 INFO:tasks.workunit.client.0.smithi062.stdout:2/799: truncate d0/d9/dd/f92 722981 0 2024-05-09T06:30:06.137 INFO:tasks.workunit.client.0.smithi062.stdout:9/833: mkdir d3/d3e/d7c/d10d 0 2024-05-09T06:30:06.138 INFO:tasks.workunit.client.0.smithi062.stdout:9/834: read d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/ff5 [2450144,88874] 0 2024-05-09T06:30:06.139 INFO:tasks.workunit.client.0.smithi062.stdout:9/835: read d3/d3e/d4b/f51 [2498999,73848] 0 2024-05-09T06:30:06.140 INFO:tasks.workunit.client.0.smithi062.stdout:9/836: mkdir d3/d3e/d52/d58/d1c/d21/dfc/d10e 0 2024-05-09T06:30:06.142 INFO:tasks.workunit.client.0.smithi062.stdout:9/837: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/de2/f10f x:0 0 0 2024-05-09T06:30:06.143 INFO:tasks.workunit.client.0.smithi062.stdout:9/838: mknod d3/d3e/d52/c110 0 2024-05-09T06:30:06.143 INFO:tasks.workunit.client.0.smithi062.stdout:9/839: chown d3/d3e/d52/d58/d1c/d1e/c88 0 1 2024-05-09T06:30:06.144 INFO:tasks.workunit.client.0.smithi062.stdout:9/840: creat d3/d3e/d52/d58/d1c/d1e/d41/dde/f111 x:0 0 0 2024-05-09T06:30:06.145 INFO:tasks.workunit.client.0.smithi062.stdout:9/841: read d3/d3e/d52/d58/fef [1687722,123464] 0 2024-05-09T06:30:06.145 INFO:tasks.workunit.client.0.smithi062.stdout:9/842: fdatasync d3/d3e/d52/d58/d1c/d1e/f4c 0 2024-05-09T06:30:06.146 INFO:tasks.workunit.client.0.smithi062.stdout:9/843: creat d3/d3e/d52/d58/d1c/d21/dfc/d10e/f112 x:0 0 0 2024-05-09T06:30:06.146 INFO:tasks.workunit.client.0.smithi062.stdout:9/844: dread - d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/fca zero size 2024-05-09T06:30:06.146 INFO:tasks.workunit.client.0.smithi062.stdout:9/845: chown d3/d3e/d7c/f93 483 1 2024-05-09T06:30:06.147 INFO:tasks.workunit.client.0.smithi062.stdout:9/846: rename d3/d3e/d52/d58/d1c/d1e/d41/d64/fbb to d3/d3e/d52/d58/d1c/d1e/d41/d64/f113 0 2024-05-09T06:30:06.148 INFO:tasks.workunit.client.0.smithi062.stdout:9/847: write d3/d3e/d4b/d99/f100 [689645,101968] 0 2024-05-09T06:30:06.148 INFO:tasks.workunit.client.0.smithi062.stdout:9/848: creat d3/d3e/d52/d58/d1c/f114 x:0 0 0 2024-05-09T06:30:06.159 INFO:tasks.workunit.client.0.smithi062.stdout:9/849: dread d3/d3e/d7c/f93 [0,4194304] 0 2024-05-09T06:30:06.159 INFO:tasks.workunit.client.0.smithi062.stdout:9/850: readlink d3/d3e/d52/d58/d1c/d1e/d41/d64/ld4 0 2024-05-09T06:30:06.159 INFO:tasks.workunit.client.0.smithi062.stdout:9/851: chown d3/d3e/d52/d58/d1c/d1e/d41/d64/fb7 1 1 2024-05-09T06:30:06.167 INFO:tasks.workunit.client.0.smithi062.stdout:9/852: write d3/d3e/d52/d58/d1c/d1e/ff8 [3426992,36895] 0 2024-05-09T06:30:06.175 INFO:tasks.workunit.client.0.smithi062.stdout:5/964: dwrite d0/d8/d18/f12d [0,4194304] 0 2024-05-09T06:30:06.176 INFO:tasks.workunit.client.0.smithi062.stdout:9/853: dread d3/d3e/d52/d58/d1c/f6f [0,4194304] 0 2024-05-09T06:30:06.181 INFO:tasks.workunit.client.0.smithi062.stdout:2/800: dwrite d0/d9/d17/f73 [4194304,4194304] 0 2024-05-09T06:30:06.181 INFO:tasks.workunit.client.0.smithi062.stdout:2/801: truncate d0/d9/d38/d41/d94/f104 248268 0 2024-05-09T06:30:06.184 INFO:tasks.workunit.client.0.smithi062.stdout:5/965: mknod d0/d8/d47/dbe/d86/da4/dce/dbd/c13f 0 2024-05-09T06:30:06.184 INFO:tasks.workunit.client.0.smithi062.stdout:5/966: fsync d0/d8/d47/dbe/d86/da4/dce/f102 0 2024-05-09T06:30:06.190 INFO:tasks.workunit.client.0.smithi062.stdout:2/802: creat d0/d9/dd/d65/f105 x:0 0 0 2024-05-09T06:30:06.191 INFO:tasks.workunit.client.0.smithi062.stdout:2/803: truncate d0/fa 4259734 0 2024-05-09T06:30:06.191 INFO:tasks.workunit.client.0.smithi062.stdout:2/804: readlink d0/d9/d17/d89/d8f/lfd 0 2024-05-09T06:30:06.191 INFO:tasks.workunit.client.0.smithi062.stdout:2/805: chown d0/d9/d38/d41/d48/df9 12 1 2024-05-09T06:30:06.193 INFO:tasks.workunit.client.0.smithi062.stdout:5/967: rename d0/d8/fc4 to d0/d3b/dbc/f140 0 2024-05-09T06:30:06.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/854: dwrite d3/d3e/d52/d58/d77/d92/f9e [0,4194304] 0 2024-05-09T06:30:06.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/855: creat d3/d3e/d52/d58/d1c/d21/dfc/d10e/f115 x:0 0 0 2024-05-09T06:30:06.195 INFO:tasks.workunit.client.0.smithi062.stdout:9/856: write d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/fca [354731,113993] 0 2024-05-09T06:30:06.196 INFO:tasks.workunit.client.0.smithi062.stdout:9/857: readlink d3/d20/dc7/l10b 0 2024-05-09T06:30:06.196 INFO:tasks.workunit.client.0.smithi062.stdout:9/858: truncate d3/d3e/d52/d58/d1c/d21/f53 1241047 0 2024-05-09T06:30:06.197 INFO:tasks.workunit.client.0.smithi062.stdout:2/806: unlink d0/d9/d38/f6a 0 2024-05-09T06:30:06.199 INFO:tasks.workunit.client.0.smithi062.stdout:1/613: sync 2024-05-09T06:30:06.201 INFO:tasks.workunit.client.0.smithi062.stdout:5/968: write d0/d8/d47/dbe/d45/f75 [442552,127018] 0 2024-05-09T06:30:06.203 INFO:tasks.workunit.client.0.smithi062.stdout:9/859: link d3/d3e/d52/d58/d1c/d1e/d41/d64/c57 d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/c116 0 2024-05-09T06:30:06.204 INFO:tasks.workunit.client.0.smithi062.stdout:2/807: mkdir d0/d9/dd/d65/d6d/d21/d29/d106 0 2024-05-09T06:30:06.205 INFO:tasks.workunit.client.0.smithi062.stdout:1/614: mkdir d8/d1d/dc7 0 2024-05-09T06:30:06.205 INFO:tasks.workunit.client.0.smithi062.stdout:1/615: dread - d8/d14/d2b/d3c/d7d/f9f zero size 2024-05-09T06:30:06.206 INFO:tasks.workunit.client.0.smithi062.stdout:9/860: creat d3/d3e/d4b/da2/f117 x:0 0 0 2024-05-09T06:30:06.211 INFO:tasks.workunit.client.0.smithi062.stdout:2/808: unlink d0/d9/dd/d65/d6d/ced 0 2024-05-09T06:30:06.213 INFO:tasks.workunit.client.0.smithi062.stdout:1/616: creat d8/d14/d2b/d3c/d44/d38/db6/fc8 x:0 0 0 2024-05-09T06:30:06.213 INFO:tasks.workunit.client.0.smithi062.stdout:1/617: fdatasync f6 0 2024-05-09T06:30:06.217 INFO:tasks.workunit.client.0.smithi062.stdout:9/861: chown d3/d3e/d4b/f5c 38584 1 2024-05-09T06:30:06.217 INFO:tasks.workunit.client.0.smithi062.stdout:2/809: creat d0/d9/d38/d41/d48/df9/f107 x:0 0 0 2024-05-09T06:30:06.221 INFO:tasks.workunit.client.0.smithi062.stdout:9/862: write d3/d3e/d52/d58/d1c/d1e/d60/f73 [1009317,97816] 0 2024-05-09T06:30:06.221 INFO:tasks.workunit.client.0.smithi062.stdout:1/618: rename d8/d14/d2b/d3c/d44/d6e/d7a/f99 to d8/fc9 0 2024-05-09T06:30:06.221 INFO:tasks.workunit.client.0.smithi062.stdout:1/619: dread - d8/d1d/d70/fbd zero size 2024-05-09T06:30:06.221 INFO:tasks.workunit.client.0.smithi062.stdout:2/810: creat d0/d9/d38/d41/de1/f108 x:0 0 0 2024-05-09T06:30:06.222 INFO:tasks.workunit.client.0.smithi062.stdout:2/811: chown d0/f6 96 1 2024-05-09T06:30:06.223 INFO:tasks.workunit.client.0.smithi062.stdout:1/620: rename d8/d14/d2b/d3c/d44/d7f/c8c to d8/d1d/d9c/d41/cca 0 2024-05-09T06:30:06.225 INFO:tasks.workunit.client.0.smithi062.stdout:2/812: mknod d0/d9/d17/d89/c109 0 2024-05-09T06:30:06.228 INFO:tasks.workunit.client.0.smithi062.stdout:2/813: truncate d0/f39 3792802 0 2024-05-09T06:30:06.228 INFO:tasks.workunit.client.0.smithi062.stdout:2/814: dread - d0/d9/d38/d41/d8a/fd3 zero size 2024-05-09T06:30:06.230 INFO:tasks.workunit.client.0.smithi062.stdout:9/863: dread d3/d3e/d52/d58/f6b [0,4194304] 0 2024-05-09T06:30:06.230 INFO:tasks.workunit.client.0.smithi062.stdout:9/864: truncate d3/d3e/d7c/f9c 906649 0 2024-05-09T06:30:06.230 INFO:tasks.workunit.client.0.smithi062.stdout:2/815: unlink d0/d9/d38/d41/db1/cda 0 2024-05-09T06:30:06.230 INFO:tasks.workunit.client.0.smithi062.stdout:2/816: chown d0/d9/dd/d65/d6d/c52 1 1 2024-05-09T06:30:06.234 INFO:tasks.workunit.client.0.smithi062.stdout:9/865: link d3/d3e/d52/c97 d3/d3e/d52/d58/c118 0 2024-05-09T06:30:06.236 INFO:tasks.workunit.client.0.smithi062.stdout:2/817: rename d0/d9/d38/d41/d8a/fd3 to d0/d9/d38/d41/d8a/f10a 0 2024-05-09T06:30:06.240 INFO:tasks.workunit.client.0.smithi062.stdout:9/866: creat d3/d3e/d52/d58/d77/f119 x:0 0 0 2024-05-09T06:30:06.240 INFO:tasks.workunit.client.0.smithi062.stdout:9/867: chown d3/d3e/d52/d58/fd3 1769 1 2024-05-09T06:30:06.246 INFO:tasks.workunit.client.0.smithi062.stdout:2/818: mknod d0/d9/d38/d41/d53/c10b 0 2024-05-09T06:30:06.248 INFO:tasks.workunit.client.0.smithi062.stdout:9/868: truncate d3/d3e/d52/d58/d1c/d1e/f4c 1598442 0 2024-05-09T06:30:06.248 INFO:tasks.workunit.client.0.smithi062.stdout:9/869: write d3/d3e/d52/d58/d1c/f114 [1028,125481] 0 2024-05-09T06:30:06.250 INFO:tasks.workunit.client.0.smithi062.stdout:2/819: rmdir d0/d9 39 2024-05-09T06:30:06.252 INFO:tasks.workunit.client.0.smithi062.stdout:9/870: dread d3/d3e/d52/d58/f71 [0,4194304] 0 2024-05-09T06:30:06.252 INFO:tasks.workunit.client.0.smithi062.stdout:9/871: creat d3/d3e/d7c/f11a x:0 0 0 2024-05-09T06:30:06.255 INFO:tasks.workunit.client.0.smithi062.stdout:9/872: creat d3/d20/dc7/f11b x:0 0 0 2024-05-09T06:30:06.257 INFO:tasks.workunit.client.0.smithi062.stdout:9/873: dread d3/d3e/f61 [0,4194304] 0 2024-05-09T06:30:06.258 INFO:tasks.workunit.client.0.smithi062.stdout:9/874: symlink d3/d3e/l11c 0 2024-05-09T06:30:06.260 INFO:tasks.workunit.client.0.smithi062.stdout:9/875: mknod d3/d20/dc7/c11d 0 2024-05-09T06:30:06.260 INFO:tasks.workunit.client.0.smithi062.stdout:9/876: stat d3/d3e/d52/d58/d1c/d1e 0 2024-05-09T06:30:06.270 INFO:tasks.workunit.client.0.smithi062.stdout:4/854: sync 2024-05-09T06:30:06.270 INFO:tasks.workunit.client.0.smithi062.stdout:4/855: write d0/d2a/d1f/d103/d4f/d6b/ddc/fe5 [7048470,7266] 0 2024-05-09T06:30:06.278 INFO:tasks.workunit.client.0.smithi062.stdout:4/856: creat d0/d2a/d1f/f107 x:0 0 0 2024-05-09T06:30:06.283 INFO:tasks.workunit.client.0.smithi062.stdout:4/857: mkdir d0/d2a/d1f/dc9/d108 0 2024-05-09T06:30:06.286 INFO:tasks.workunit.client.0.smithi062.stdout:4/858: unlink d0/d3c/dae/db0/dbc/f6f 0 2024-05-09T06:30:06.288 INFO:tasks.workunit.client.0.smithi062.stdout:9/877: dwrite d3/d3e/d4b/fff [0,4194304] 0 2024-05-09T06:30:06.293 INFO:tasks.workunit.client.0.smithi062.stdout:9/878: dread d3/d3e/d52/d58/d1c/d21/f24 [0,4194304] 0 2024-05-09T06:30:06.294 INFO:tasks.workunit.client.0.smithi062.stdout:9/879: mknod d3/deb/c11e 0 2024-05-09T06:30:06.297 INFO:tasks.workunit.client.0.smithi062.stdout:9/880: creat d3/d3e/d52/f11f x:0 0 0 2024-05-09T06:30:06.297 INFO:tasks.workunit.client.0.smithi062.stdout:9/881: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f120 x:0 0 0 2024-05-09T06:30:06.297 INFO:tasks.workunit.client.0.smithi062.stdout:9/882: dread - d3/d3e/d52/d58/d77/d92/fe7 zero size 2024-05-09T06:30:06.300 INFO:tasks.workunit.client.0.smithi062.stdout:9/883: mknod d3/d20/dc7/c121 0 2024-05-09T06:30:06.301 INFO:tasks.workunit.client.0.smithi062.stdout:9/884: fdatasync d3/d3e/d52/f11f 0 2024-05-09T06:30:06.301 INFO:tasks.workunit.client.0.smithi062.stdout:9/885: truncate d3/d3e/d52/d58/d1c/d1e/d41/d64/de2/f10f 928542 0 2024-05-09T06:30:06.301 INFO:tasks.workunit.client.0.smithi062.stdout:9/886: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/de2/f122 x:0 0 0 2024-05-09T06:30:06.301 INFO:tasks.workunit.client.0.smithi062.stdout:9/887: readlink d3/d3e/lab 0 2024-05-09T06:30:06.309 INFO:tasks.workunit.client.0.smithi062.stdout:9/888: read d3/d3e/d52/d58/d77/d92/f96 [3802701,64242] 0 2024-05-09T06:30:06.309 INFO:tasks.workunit.client.0.smithi062.stdout:9/889: write d3/d3e/d52/d58/d1c/d21/f67 [1554416,32847] 0 2024-05-09T06:30:06.310 INFO:tasks.workunit.client.0.smithi062.stdout:9/890: truncate d3/d3e/d4b/fff 2847704 0 2024-05-09T06:30:06.310 INFO:tasks.workunit.client.0.smithi062.stdout:9/891: readlink d3/d3e/d52/d58/d1c/d21/l8c 0 2024-05-09T06:30:06.312 INFO:tasks.workunit.client.0.smithi062.stdout:9/892: mkdir d3/d20/d123 0 2024-05-09T06:30:06.328 INFO:tasks.workunit.client.0.smithi062.stdout:9/893: dwrite d3/d3e/d52/d58/d1c/d1e/f4c [0,4194304] 0 2024-05-09T06:30:06.332 INFO:tasks.workunit.client.0.smithi062.stdout:9/894: rename d3/d3e/d52/d58/d1c/d1e/d41/dc5 to d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/d124 0 2024-05-09T06:30:06.341 INFO:tasks.workunit.client.0.smithi062.stdout:9/895: write d3/d3e/d4b/f5c [1383767,32249] 0 2024-05-09T06:30:06.356 INFO:tasks.workunit.client.0.smithi062.stdout:9/896: dwrite d3/d3e/d4b/fc0 [0,4194304] 0 2024-05-09T06:30:06.357 INFO:tasks.workunit.client.0.smithi062.stdout:9/897: chown d3/d3e/d52/d58/d1c/d21/f67 927443 1 2024-05-09T06:30:06.433 INFO:tasks.workunit.client.0.smithi062.stdout:9/898: rename d3/d3e/d52/d58/c63 to d3/d3e/d52/d58/d77/c125 0 2024-05-09T06:30:06.433 INFO:tasks.workunit.client.0.smithi062.stdout:9/899: write d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/fe5 [1009617,32715] 0 2024-05-09T06:30:06.434 INFO:tasks.workunit.client.0.smithi062.stdout:9/900: write d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/fca [296669,104557] 0 2024-05-09T06:30:06.434 INFO:tasks.workunit.client.0.smithi062.stdout:9/901: readlink d3/d3e/d52/d58/d1c/l45 0 2024-05-09T06:30:06.434 INFO:tasks.workunit.client.0.smithi062.stdout:9/902: read d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/fe5 [987494,11276] 0 2024-05-09T06:30:06.494 INFO:tasks.workunit.client.0.smithi062.stdout:6/964: sync 2024-05-09T06:30:06.494 INFO:tasks.workunit.client.0.smithi062.stdout:0/801: sync 2024-05-09T06:30:06.496 INFO:tasks.workunit.client.0.smithi062.stdout:0/802: symlink d1/d25/d31/d6c/d44/d57/l117 0 2024-05-09T06:30:06.496 INFO:tasks.workunit.client.0.smithi062.stdout:0/803: truncate d1/d25/d31/d6c/d44/fc5 1417404 0 2024-05-09T06:30:06.497 INFO:tasks.workunit.client.0.smithi062.stdout:6/965: mkdir dc/d28/d10/d143 0 2024-05-09T06:30:06.498 INFO:tasks.workunit.client.0.smithi062.stdout:0/804: creat d1/d25/d31/d6c/d44/f118 x:0 0 0 2024-05-09T06:30:06.499 INFO:tasks.workunit.client.0.smithi062.stdout:6/966: mkdir dc/d28/d46/d3a/d7f/d91/d93/d114/d144 0 2024-05-09T06:30:06.499 INFO:tasks.workunit.client.0.smithi062.stdout:6/967: chown dc/d28/d46/d3a/d7f/d91/d93 1192 1 2024-05-09T06:30:06.499 INFO:tasks.workunit.client.0.smithi062.stdout:6/968: creat dc/d28/d46/d81/f145 x:0 0 0 2024-05-09T06:30:06.499 INFO:tasks.workunit.client.0.smithi062.stdout:0/805: truncate d1/d25/d31/d6c/fc2 2637785 0 2024-05-09T06:30:06.502 INFO:tasks.workunit.client.0.smithi062.stdout:6/969: fsync dc/d28/d46/d4a/ffc 0 2024-05-09T06:30:06.502 INFO:tasks.workunit.client.0.smithi062.stdout:6/970: readlink dc/d28/d46/l10c 0 2024-05-09T06:30:06.503 INFO:tasks.workunit.client.0.smithi062.stdout:6/971: write dc/d28/d10/f139 [527540,37304] 0 2024-05-09T06:30:06.505 INFO:tasks.workunit.client.0.smithi062.stdout:0/806: mkdir d1/d25/d49/d4f/d119 0 2024-05-09T06:30:06.505 INFO:tasks.workunit.client.0.smithi062.stdout:0/807: write d1/d25/d49/d42/d43/d54/d9d/fab [1374601,100587] 0 2024-05-09T06:30:06.506 INFO:tasks.workunit.client.0.smithi062.stdout:6/972: link dc/d28/d34/d4e/d57/d102/f101 dc/d28/d34/db7/d138/f146 0 2024-05-09T06:30:06.509 INFO:tasks.workunit.client.0.smithi062.stdout:0/808: mkdir d1/d25/d31/d6c/d44/d57/d75/d11a 0 2024-05-09T06:30:06.581 INFO:tasks.workunit.client.0.smithi062.stdout:6/973: mknod dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/d74/c147 0 2024-05-09T06:30:06.581 INFO:tasks.workunit.client.0.smithi062.stdout:6/974: creat dc/d28/d46/d4a/f148 x:0 0 0 2024-05-09T06:30:06.581 INFO:tasks.workunit.client.0.smithi062.stdout:6/975: write dc/d28/d34/f3d [539969,101328] 0 2024-05-09T06:30:06.581 INFO:tasks.workunit.client.0.smithi062.stdout:0/809: dread d1/d25/d31/d6c/d44/d6e/dae/fd3 [0,4194304] 0 2024-05-09T06:30:06.581 INFO:tasks.workunit.client.0.smithi062.stdout:0/810: write d1/d25/d31/d6c/d44/d57/f108 [486348,31871] 0 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:6/976: dread dc/d28/d34/f3d [0,4194304] 0 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:6/977: dread dc/d28/d10/d20/db5/d10b/f120 [0,4194304] 0 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:6/978: link dc/d28/l52 dc/d28/d10/d103/d127/l149 0 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:0/811: dread d1/d25/d31/d6c/d44/d57/db4/f104 [0,4194304] 0 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:0/812: chown d1/d25/d31/d6c/d44/d57/d75 15 1 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:0/813: chown d1/d25/d49/d7e 0 1 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:6/979: creat dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/f14a x:0 0 0 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:0/814: dwrite d1/fc [0,4194304] 0 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:6/980: dwrite dc/d28/d34/db0/ffe [0,4194304] 0 2024-05-09T06:30:06.582 INFO:tasks.workunit.client.0.smithi062.stdout:6/981: mknod dc/d28/d10/d20/db5/c14b 0 2024-05-09T06:30:06.583 INFO:tasks.workunit.client.0.smithi062.stdout:0/815: dwrite d1/d25/d31/d6c/d44/d57/f64 [0,4194304] 0 2024-05-09T06:30:06.583 INFO:tasks.workunit.client.0.smithi062.stdout:6/982: dwrite dc/d28/d46/d4a/f148 [0,4194304] 0 2024-05-09T06:30:06.584 INFO:tasks.workunit.client.0.smithi062.stdout:0/816: dread d1/d6a/d6d/d93/d94/dc7/f50 [0,4194304] 0 2024-05-09T06:30:06.584 INFO:tasks.workunit.client.0.smithi062.stdout:0/817: creat d1/d25/d31/d6c/d44/f11b x:0 0 0 2024-05-09T06:30:06.584 INFO:tasks.workunit.client.0.smithi062.stdout:0/818: fdatasync d1/d25/d31/d6c/d44/d57/d84/ff7 0 2024-05-09T06:30:06.584 INFO:tasks.workunit.client.0.smithi062.stdout:0/819: chown d1/d6a/d6d/la8 378782 1 2024-05-09T06:30:06.584 INFO:tasks.workunit.client.0.smithi062.stdout:0/820: write d1/f2c [696500,55594] 0 2024-05-09T06:30:06.591 INFO:tasks.workunit.client.0.smithi062.stdout:0/821: dread d1/d25/fd0 [0,4194304] 0 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: Adjusting osd_memory_target on smithi079 to 2581M 2024-05-09T06:30:06.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:06 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:06.594 INFO:tasks.workunit.client.0.smithi062.stdout:0/822: rmdir d1/d25/d31/db5 39 2024-05-09T06:30:06.594 INFO:tasks.workunit.client.0.smithi062.stdout:0/823: chown d1/d25/d49/d4f/d52/d87/dc8/d114 16748 1 2024-05-09T06:30:06.594 INFO:tasks.workunit.client.0.smithi062.stdout:0/824: dread - d1/d25/d31/d6c/d44/f11b zero size 2024-05-09T06:30:06.595 INFO:tasks.workunit.client.0.smithi062.stdout:6/983: write dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/de4/fd3 [1099836,12404] 0 2024-05-09T06:30:06.596 INFO:tasks.workunit.client.0.smithi062.stdout:0/825: symlink d1/d25/d49/d4f/d10d/l11c 0 2024-05-09T06:30:06.596 INFO:tasks.workunit.client.0.smithi062.stdout:0/826: stat d1/d25/d31/d6c/d44/d57/d84/cc3 0 2024-05-09T06:30:06.598 INFO:tasks.workunit.client.0.smithi062.stdout:0/827: creat d1/d25/d49/d4f/d52/d87/dc8/df4/f11d x:0 0 0 2024-05-09T06:30:06.607 INFO:tasks.workunit.client.0.smithi062.stdout:0/828: dread d1/d25/d31/d6c/df5/f112 [0,4194304] 0 2024-05-09T06:30:06.612 INFO:tasks.workunit.client.0.smithi062.stdout:6/984: dwrite dc/d28/f8c [0,4194304] 0 2024-05-09T06:30:06.614 INFO:tasks.workunit.client.0.smithi062.stdout:6/985: mkdir dc/d28/d46/d81/d117/d14c 0 2024-05-09T06:30:06.614 INFO:tasks.workunit.client.0.smithi062.stdout:6/986: creat dc/d28/d10/d20/d5b/d77/f14d x:0 0 0 2024-05-09T06:30:06.617 INFO:tasks.workunit.client.0.smithi062.stdout:6/987: mkdir dc/d28/d10/d20/d14e 0 2024-05-09T06:30:06.617 INFO:tasks.workunit.client.0.smithi062.stdout:6/988: chown dc/d28/d46/d3a/d7f/d91/d93/l11b 4 1 2024-05-09T06:30:06.619 INFO:tasks.workunit.client.0.smithi062.stdout:0/829: dread d1/d25/d49/d4f/d52/d87/fa3 [0,4194304] 0 2024-05-09T06:30:06.621 INFO:tasks.workunit.client.0.smithi062.stdout:0/830: mknod d1/d6a/d6d/d93/d94/c11e 0 2024-05-09T06:30:06.623 INFO:tasks.workunit.client.0.smithi062.stdout:6/989: dread dc/d28/d46/d3a/d7f/f12a [0,4194304] 0 2024-05-09T06:30:06.623 INFO:tasks.workunit.client.0.smithi062.stdout:6/990: write dc/d28/d46/d3a/d7f/d8e/dc8/dcd/def/dcc/feb [884202,70003] 0 2024-05-09T06:30:06.623 INFO:tasks.workunit.client.0.smithi062.stdout:6/991: fdatasync dc/d28/d10/f1c 0 2024-05-09T06:30:06.626 INFO:tasks.workunit.client.0.smithi062.stdout:0/831: symlink d1/d25/d49/d7e/l11f 0 2024-05-09T06:30:06.626 INFO:tasks.workunit.client.0.smithi062.stdout:3/653: sync 2024-05-09T06:30:06.627 INFO:tasks.workunit.client.0.smithi062.stdout:8/889: sync 2024-05-09T06:30:06.627 INFO:tasks.workunit.client.0.smithi062.stdout:7/767: sync 2024-05-09T06:30:06.627 INFO:tasks.workunit.client.0.smithi062.stdout:5/969: sync 2024-05-09T06:30:06.627 INFO:tasks.workunit.client.0.smithi062.stdout:8/890: readlink da/dea/d2e/d61/d92/l106 0 2024-05-09T06:30:06.631 INFO:tasks.workunit.client.0.smithi062.stdout:3/654: mkdir d1/d1e/d36/d9f/d4f/dd2/dd3 0 2024-05-09T06:30:06.631 INFO:tasks.workunit.client.0.smithi062.stdout:3/655: chown d1/d1e/d36/lb5 930351 1 2024-05-09T06:30:06.631 INFO:tasks.workunit.client.0.smithi062.stdout:3/656: read - d1/d1e/fbe zero size 2024-05-09T06:30:06.634 INFO:tasks.workunit.client.0.smithi062.stdout:8/891: mkdir da/dea/d2e/d34/dd4/dbb/d122 0 2024-05-09T06:30:06.636 INFO:tasks.workunit.client.0.smithi062.stdout:5/970: read d0/fa7 [985161,66413] 0 2024-05-09T06:30:06.640 INFO:tasks.workunit.client.0.smithi062.stdout:6/992: dread dc/d28/d10/fa6 [0,4194304] 0 2024-05-09T06:30:06.643 INFO:tasks.workunit.client.0.smithi062.stdout:0/832: dwrite d1/d25/d49/d42/fa7 [0,4194304] 0 2024-05-09T06:30:06.649 INFO:tasks.workunit.client.0.smithi062.stdout:8/892: unlink da/dea/f55 0 2024-05-09T06:30:06.650 INFO:tasks.workunit.client.0.smithi062.stdout:5/971: creat d0/d8/d1c/f141 x:0 0 0 2024-05-09T06:30:06.653 INFO:tasks.workunit.client.0.smithi062.stdout:0/833: link d1/d25/d31/d6c/d44/d6e/dae/lec d1/d25/d49/d4f/d52/l120 0 2024-05-09T06:30:06.653 INFO:tasks.workunit.client.0.smithi062.stdout:0/834: chown d1/f19 633549876 1 2024-05-09T06:30:06.653 INFO:tasks.workunit.client.0.smithi062.stdout:3/657: rmdir d1/d1e/d26/d43/d92 39 2024-05-09T06:30:06.654 INFO:tasks.workunit.client.0.smithi062.stdout:8/893: rmdir da/dea/d1c/d9e/d9f/da7 39 2024-05-09T06:30:06.654 INFO:tasks.workunit.client.0.smithi062.stdout:8/894: write da/dea/f29 [1914171,12757] 0 2024-05-09T06:30:06.655 INFO:tasks.workunit.client.0.smithi062.stdout:5/972: mknod d0/d8/d47/dbe/d45/da5/dcf/d109/c142 0 2024-05-09T06:30:06.659 INFO:tasks.workunit.client.0.smithi062.stdout:0/835: creat d1/d25/d49/d4f/d10d/f121 x:0 0 0 2024-05-09T06:30:06.659 INFO:tasks.workunit.client.0.smithi062.stdout:0/836: truncate d1/d6a/d6d/d93/d94/f10a 787516 0 2024-05-09T06:30:06.660 INFO:tasks.workunit.client.0.smithi062.stdout:5/973: dread d0/d8/f95 [0,4194304] 0 2024-05-09T06:30:06.661 INFO:tasks.workunit.client.0.smithi062.stdout:3/658: truncate d1/d48/f57 2274505 0 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: Adjusting osd_memory_target on smithi079 to 2581M 2024-05-09T06:30:06.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:06 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:06.667 INFO:tasks.workunit.client.0.smithi062.stdout:0/837: symlink d1/d25/d31/d6c/d44/d57/d75/d11a/l122 0 2024-05-09T06:30:06.669 INFO:tasks.workunit.client.0.smithi062.stdout:6/993: dwrite dc/d28/d46/f108 [0,4194304] 0 2024-05-09T06:30:06.677 INFO:tasks.workunit.client.0.smithi062.stdout:0/838: rename d1/d25/d49/d4f/d52/d87/dc8/df4/f11d to d1/d25/d31/d6c/df5/f123 0 2024-05-09T06:30:06.677 INFO:tasks.workunit.client.0.smithi062.stdout:6/994: symlink dc/d28/d46/d81/l14f 0 2024-05-09T06:30:06.677 INFO:tasks.workunit.client.0.smithi062.stdout:7/768: dwrite d0/d3a/d3f/f4c [0,4194304] 0 2024-05-09T06:30:06.677 INFO:tasks.workunit.client.0.smithi062.stdout:3/659: write d1/d1e/d36/daa/fcb [2694197,3478] 0 2024-05-09T06:30:06.678 INFO:tasks.workunit.client.0.smithi062.stdout:8/895: dwrite da/dea/d2e/d7e/f121 [0,4194304] 0 2024-05-09T06:30:06.678 INFO:tasks.workunit.client.0.smithi062.stdout:8/896: chown da/dea/d2e/d7e/d83/c120 2182868 1 2024-05-09T06:30:06.680 INFO:tasks.workunit.client.0.smithi062.stdout:5/974: dwrite d0/d3b/f8b [0,4194304] 0 2024-05-09T06:30:06.681 INFO:tasks.workunit.client.0.smithi062.stdout:7/769: mkdir d0/d3a/d3f/df9 0 2024-05-09T06:30:06.683 INFO:tasks.workunit.client.0.smithi062.stdout:0/839: dread d1/d25/d31/d6c/d44/d6e/dae/fb2 [0,4194304] 0 2024-05-09T06:30:06.695 INFO:tasks.workunit.client.0.smithi062.stdout:8/897: truncate da/dea/d2e/d34/dd4/dbb/fe8 391357 0 2024-05-09T06:30:06.695 INFO:tasks.workunit.client.0.smithi062.stdout:6/995: dread dc/d28/d46/d3a/f3c [0,4194304] 0 2024-05-09T06:30:06.695 INFO:tasks.workunit.client.0.smithi062.stdout:3/660: dread d1/d1e/d26/f56 [0,4194304] 0 2024-05-09T06:30:06.698 INFO:tasks.workunit.client.0.smithi062.stdout:5/975: mknod d0/d8/d47/dbe/d86/da4/dce/c143 0 2024-05-09T06:30:06.698 INFO:tasks.workunit.client.0.smithi062.stdout:0/840: mkdir d1/d25/d49/d42/d43/d54/d124 0 2024-05-09T06:30:06.700 INFO:tasks.workunit.client.0.smithi062.stdout:0/841: dread d1/d25/d31/d6c/d44/d57/d84/ff7 [0,4194304] 0 2024-05-09T06:30:06.700 INFO:tasks.workunit.client.0.smithi062.stdout:8/898: rmdir da/dea/d1c/d9e/d9f/da7/d113 0 2024-05-09T06:30:06.701 INFO:tasks.workunit.client.0.smithi062.stdout:8/899: dread da/dea/d1c/ff4 [0,4194304] 0 2024-05-09T06:30:06.701 INFO:tasks.workunit.client.0.smithi062.stdout:8/900: chown da/dea/d2e/d61/lf6 3 1 2024-05-09T06:30:06.702 INFO:tasks.workunit.client.0.smithi062.stdout:3/661: creat d1/d1e/d26/d43/d52/d6a/da4/fd4 x:0 0 0 2024-05-09T06:30:06.711 INFO:tasks.workunit.client.0.smithi062.stdout:7/770: rename d0/d12/d33/c9d to d0/d12/d33/d9f/cfa 0 2024-05-09T06:30:06.715 INFO:tasks.workunit.client.0.smithi062.stdout:0/842: creat d1/d25/d31/d6c/d44/d57/f125 x:0 0 0 2024-05-09T06:30:06.716 INFO:tasks.workunit.client.0.smithi062.stdout:3/662: symlink d1/d1e/d26/d43/d92/ld5 0 2024-05-09T06:30:06.722 INFO:tasks.workunit.client.0.smithi062.stdout:1/621: sync 2024-05-09T06:30:06.732 INFO:tasks.workunit.client.0.smithi062.stdout:8/901: dwrite da/dea/d2e/fef [0,4194304] 0 2024-05-09T06:30:06.736 INFO:tasks.workunit.client.0.smithi062.stdout:8/902: link da/dea/c54 da/c123 0 2024-05-09T06:30:06.736 INFO:tasks.workunit.client.0.smithi062.stdout:8/903: creat da/dea/d1c/f124 x:0 0 0 2024-05-09T06:30:06.736 INFO:tasks.workunit.client.0.smithi062.stdout:1/622: dread d8/d14/f32 [0,4194304] 0 2024-05-09T06:30:06.740 INFO:tasks.workunit.client.0.smithi062.stdout:8/904: creat da/dea/f125 x:0 0 0 2024-05-09T06:30:06.741 INFO:tasks.workunit.client.0.smithi062.stdout:8/905: truncate da/dea/d2e/d7e/fa9 1291632 0 2024-05-09T06:30:06.741 INFO:tasks.workunit.client.0.smithi062.stdout:8/906: symlink da/dea/dd2/l126 0 2024-05-09T06:30:06.742 INFO:tasks.workunit.client.0.smithi062.stdout:8/907: readlink da/dea/l80 0 2024-05-09T06:30:06.743 INFO:tasks.workunit.client.0.smithi062.stdout:8/908: mknod da/dea/d2e/d34/ddf/c127 0 2024-05-09T06:30:06.745 INFO:tasks.workunit.client.0.smithi062.stdout:8/909: rename da/dea/f2d to da/d95/f128 0 2024-05-09T06:30:06.745 INFO:tasks.workunit.client.0.smithi062.stdout:8/910: mkdir da/dea/d2e/d34/dd4/d129 0 2024-05-09T06:30:06.745 INFO:tasks.workunit.client.0.smithi062.stdout:8/911: stat da/dea/d1c/d9e 0 2024-05-09T06:30:06.746 INFO:tasks.workunit.client.0.smithi062.stdout:0/843: dwrite d1/d25/d49/d42/dad/dbe/fcf [0,4194304] 0 2024-05-09T06:30:06.748 INFO:tasks.workunit.client.0.smithi062.stdout:0/844: mknod d1/d25/d31/db5/c126 0 2024-05-09T06:30:06.760 INFO:tasks.workunit.client.0.smithi062.stdout:0/845: dread d1/d6a/d6d/fef [0,4194304] 0 2024-05-09T06:30:06.768 INFO:tasks.workunit.client.0.smithi062.stdout:3/663: dwrite d1/d1e/d26/d43/d52/d6a/da4/fd4 [0,4194304] 0 2024-05-09T06:30:06.768 INFO:tasks.workunit.client.0.smithi062.stdout:7/771: dwrite d0/d3a/d3f/dab/fae [0,4194304] 0 2024-05-09T06:30:06.768 INFO:tasks.workunit.client.0.smithi062.stdout:1/623: dwrite d8/d14/f72 [0,4194304] 0 2024-05-09T06:30:06.768 INFO:tasks.workunit.client.0.smithi062.stdout:1/624: chown d8/d14/d2b/d3c/d44/d6e/d7a/fa6 584220542 1 2024-05-09T06:30:06.769 INFO:tasks.workunit.client.0.smithi062.stdout:1/625: link d8/d14/d2b/d3c/d44/d6e/d7a/d80/fb5 d8/d14/d2b/d3c/d44/d38/dbe/fcb 0 2024-05-09T06:30:06.769 INFO:tasks.workunit.client.0.smithi062.stdout:0/846: getdents d1/d25/d31/d6c/d44/d57/d84 0 2024-05-09T06:30:06.769 INFO:tasks.workunit.client.0.smithi062.stdout:0/847: truncate d1/d25/d49/d42/d43/d54/d9d/fab 2319236 0 2024-05-09T06:30:06.769 INFO:tasks.workunit.client.0.smithi062.stdout:3/664: write d1/d1e/f24 [4201016,37406] 0 2024-05-09T06:30:06.770 INFO:tasks.workunit.client.0.smithi062.stdout:7/772: dread d0/d3/f17 [0,4194304] 0 2024-05-09T06:30:06.771 INFO:tasks.workunit.client.0.smithi062.stdout:7/773: dread - d0/d3a/d3f/fb3 zero size 2024-05-09T06:30:06.771 INFO:tasks.workunit.client.0.smithi062.stdout:7/774: dread - d0/d3a/d51/d64/d6d/fd0 zero size 2024-05-09T06:30:06.772 INFO:tasks.workunit.client.0.smithi062.stdout:1/626: read d8/d14/d2b/d3c/d44/d6e/f73 [1142129,20589] 0 2024-05-09T06:30:06.772 INFO:tasks.workunit.client.0.smithi062.stdout:1/627: creat d8/d14/d2b/d3c/d44/fcc x:0 0 0 2024-05-09T06:30:06.772 INFO:tasks.workunit.client.0.smithi062.stdout:1/628: stat d8/d14/d2b/d3c/d44/d38/f77 0 2024-05-09T06:30:06.775 INFO:tasks.workunit.client.0.smithi062.stdout:0/848: dread d1/d25/f86 [0,4194304] 0 2024-05-09T06:30:06.775 INFO:tasks.workunit.client.0.smithi062.stdout:0/849: fdatasync d1/d25/d49/d7e/da6/fb3 0 2024-05-09T06:30:06.786 INFO:tasks.workunit.client.0.smithi062.stdout:1/629: mknod d8/d1d/d91/ccd 0 2024-05-09T06:30:06.788 INFO:tasks.workunit.client.0.smithi062.stdout:1/630: creat d8/d14/d2b/d3c/d44/d7f/fce x:0 0 0 2024-05-09T06:30:06.800 INFO:tasks.workunit.client.0.smithi062.stdout:3/665: dwrite d1/f27 [0,4194304] 0 2024-05-09T06:30:06.800 INFO:tasks.workunit.client.0.smithi062.stdout:3/666: creat d1/d1e/fd6 x:0 0 0 2024-05-09T06:30:06.800 INFO:tasks.workunit.client.0.smithi062.stdout:3/667: chown d1/d1e/d36/daa/fbb 566 1 2024-05-09T06:30:06.800 INFO:tasks.workunit.client.0.smithi062.stdout:3/668: read d1/d1e/f24 [6487153,65854] 0 2024-05-09T06:30:06.800 INFO:tasks.workunit.client.0.smithi062.stdout:3/669: write d1/d1e/d36/d9f/f65 [5353533,61881] 0 2024-05-09T06:30:06.801 INFO:tasks.workunit.client.0.smithi062.stdout:3/670: truncate d1/d1e/d54/d8c/fc3 986528 0 2024-05-09T06:30:06.801 INFO:tasks.workunit.client.0.smithi062.stdout:7/775: dwrite d0/d3a/d51/d64/d6d/d88/fa2 [0,4194304] 0 2024-05-09T06:30:06.801 INFO:tasks.workunit.client.0.smithi062.stdout:7/776: read d0/f8d [457007,32514] 0 2024-05-09T06:30:06.805 INFO:tasks.workunit.client.0.smithi062.stdout:3/671: rename d1/d1e/d26/f37 to d1/d1e/d36/d9f/d4f/fd7 0 2024-05-09T06:30:06.809 INFO:tasks.workunit.client.0.smithi062.stdout:7/777: symlink d0/d3a/d3f/dab/lfb 0 2024-05-09T06:30:06.810 INFO:tasks.workunit.client.0.smithi062.stdout:1/631: dwrite d8/d14/d2b/d3c/db0/fb1 [0,4194304] 0 2024-05-09T06:30:06.815 INFO:tasks.workunit.client.0.smithi062.stdout:3/672: write d1/d1e/f14 [3401755,101228] 0 2024-05-09T06:30:06.816 INFO:tasks.workunit.client.0.smithi062.stdout:7/778: mkdir d0/d3a/d3f/dfc 0 2024-05-09T06:30:06.820 INFO:tasks.workunit.client.0.smithi062.stdout:1/632: mkdir d8/d14/d2b/d3c/da5/dcf 0 2024-05-09T06:30:06.820 INFO:tasks.workunit.client.0.smithi062.stdout:1/633: chown d8/d14/c21 5488689 1 2024-05-09T06:30:06.820 INFO:tasks.workunit.client.0.smithi062.stdout:3/673: symlink d1/d1e/d26/d43/d52/ld8 0 2024-05-09T06:30:06.820 INFO:tasks.workunit.client.0.smithi062.stdout:3/674: truncate d1/d1e/f14 5191443 0 2024-05-09T06:30:06.879 INFO:tasks.workunit.client.0.smithi062.stdout:1/634: unlink d8/d14/d2b/l37 0 2024-05-09T06:30:06.881 INFO:tasks.workunit.client.0.smithi062.stdout:3/675: unlink d1/d1e/d36/d3a/fac 0 2024-05-09T06:30:06.881 INFO:tasks.workunit.client.0.smithi062.stdout:3/676: truncate d1/d1e/d26/f86 1634740 0 2024-05-09T06:30:06.881 INFO:tasks.workunit.client.0.smithi062.stdout:3/677: chown d1/d1e/d3b/d83 6695545 1 2024-05-09T06:30:06.881 INFO:tasks.workunit.client.0.smithi062.stdout:3/678: stat d1/d1e/d3b 0 2024-05-09T06:30:06.881 INFO:tasks.workunit.client.0.smithi062.stdout:3/679: creat d1/d1e/d36/d4a/d51/fd9 x:0 0 0 2024-05-09T06:30:06.881 INFO:tasks.workunit.client.0.smithi062.stdout:3/680: truncate d1/d1e/d26/f86 2331386 0 2024-05-09T06:30:06.881 INFO:tasks.workunit.client.0.smithi062.stdout:3/681: readlink l0 0 2024-05-09T06:30:06.882 INFO:tasks.workunit.client.0.smithi062.stdout:7/779: getdents d0/d12/d33/d67/da7 0 2024-05-09T06:30:06.885 INFO:tasks.workunit.client.0.smithi062.stdout:1/635: mkdir d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0 0 2024-05-09T06:30:06.885 INFO:tasks.workunit.client.0.smithi062.stdout:3/682: dread d1/d1e/d26/d43/d52/f95 [0,4194304] 0 2024-05-09T06:30:06.890 INFO:tasks.workunit.client.0.smithi062.stdout:1/636: dread d8/f89 [0,4194304] 0 2024-05-09T06:30:06.918 INFO:tasks.workunit.client.0.smithi062.stdout:7/780: dwrite d0/d3a/d51/f44 [0,4194304] 0 2024-05-09T06:30:06.919 INFO:tasks.workunit.client.0.smithi062.stdout:3/683: dwrite d1/d1e/d36/d9f/d4f/f96 [0,4194304] 0 2024-05-09T06:30:06.919 INFO:tasks.workunit.client.0.smithi062.stdout:3/684: chown d1/d1e/d26/d43/d52/d6a/f71 42904 1 2024-05-09T06:30:06.920 INFO:tasks.workunit.client.0.smithi062.stdout:1/637: dwrite d8/d14/d2b/d3c/d44/d6e/f73 [0,4194304] 0 2024-05-09T06:30:06.924 INFO:tasks.workunit.client.0.smithi062.stdout:1/638: mknod d8/d14/d2b/cd1 0 2024-05-09T06:30:06.927 INFO:tasks.workunit.client.0.smithi062.stdout:1/639: mkdir d8/d14/d2b/d3c/d76/dd2 0 2024-05-09T06:30:06.930 INFO:tasks.workunit.client.0.smithi062.stdout:9/903: sync 2024-05-09T06:30:06.930 INFO:tasks.workunit.client.0.smithi062.stdout:4/859: sync 2024-05-09T06:30:06.930 INFO:tasks.workunit.client.0.smithi062.stdout:2/820: sync 2024-05-09T06:30:06.930 INFO:tasks.workunit.client.0.smithi062.stdout:2/821: write d0/d9/dd/d65/fac [8077133,5392] 0 2024-05-09T06:30:06.932 INFO:tasks.workunit.client.0.smithi062.stdout:7/781: dread d0/d3a/d51/d64/d6d/d88/fa2 [0,4194304] 0 2024-05-09T06:30:06.937 INFO:tasks.workunit.client.0.smithi062.stdout:4/860: mkdir d0/d9/de8/d109 0 2024-05-09T06:30:06.937 INFO:tasks.workunit.client.0.smithi062.stdout:4/861: read d0/d2a/d1f/d103/d7e/d8e/fd9 [7214954,19097] 0 2024-05-09T06:30:06.937 INFO:tasks.workunit.client.0.smithi062.stdout:4/862: chown d0/d9/dd1/lf2 70800 1 2024-05-09T06:30:06.941 INFO:tasks.workunit.client.0.smithi062.stdout:2/822: unlink d0/d9/dd/d65/d6d/d21/d29/ca7 0 2024-05-09T06:30:06.941 INFO:tasks.workunit.client.0.smithi062.stdout:4/863: truncate d0/d2a/f99 3030497 0 2024-05-09T06:30:06.943 INFO:tasks.workunit.client.0.smithi062.stdout:2/823: mkdir d0/d9/d38/d41/d48/d5f/d10c 0 2024-05-09T06:30:06.943 INFO:tasks.workunit.client.0.smithi062.stdout:2/824: truncate d0/d9/dd/d65/f71 2194528 0 2024-05-09T06:30:06.943 INFO:tasks.workunit.client.0.smithi062.stdout:2/825: dread - d0/d9/fc5 zero size 2024-05-09T06:30:06.945 INFO:tasks.workunit.client.0.smithi062.stdout:2/826: dread d0/d9/d38/d41/d48/d5f/fc8 [0,4194304] 0 2024-05-09T06:30:06.949 INFO:tasks.workunit.client.0.smithi062.stdout:7/782: write d0/d3/f2d [3157493,116188] 0 2024-05-09T06:30:06.949 INFO:tasks.workunit.client.0.smithi062.stdout:2/827: rename d0/d9/d38/d41/d8a/ca9 to d0/d9/d38/dd6/c10d 0 2024-05-09T06:30:06.949 INFO:tasks.workunit.client.0.smithi062.stdout:7/783: creat d0/d3a/d51/d64/d6d/d80/ffd x:0 0 0 2024-05-09T06:30:06.949 INFO:tasks.workunit.client.0.smithi062.stdout:2/828: truncate d0/d9/dd9/d93/faf 187064 0 2024-05-09T06:30:06.953 INFO:tasks.workunit.client.0.smithi062.stdout:7/784: symlink d0/d12/d33/d67/lfe 0 2024-05-09T06:30:06.953 INFO:tasks.workunit.client.0.smithi062.stdout:7/785: fsync d0/d3a/d51/d64/d6d/d80/dd8/fe0 0 2024-05-09T06:30:06.954 INFO:tasks.workunit.client.0.smithi062.stdout:4/864: write d0/d2a/d1f/d103/fcd [4180355,53516] 0 2024-05-09T06:30:06.956 INFO:tasks.workunit.client.0.smithi062.stdout:2/829: rename d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/le0 to d0/d9/d38/d41/d8a/dd2/l10e 0 2024-05-09T06:30:06.956 INFO:tasks.workunit.client.0.smithi062.stdout:2/830: chown d0/d9/d17/d37 7238635 1 2024-05-09T06:30:06.956 INFO:tasks.workunit.client.0.smithi062.stdout:2/831: fsync d0/d9/dd9/d93/fc3 0 2024-05-09T06:30:06.956 INFO:tasks.workunit.client.0.smithi062.stdout:2/832: chown d0/d9/d38/d41 14680241 1 2024-05-09T06:30:06.956 INFO:tasks.workunit.client.0.smithi062.stdout:2/833: read - d0/d9/d17/d89/fd4 zero size 2024-05-09T06:30:06.956 INFO:tasks.workunit.client.0.smithi062.stdout:2/834: chown d0/d9/dd/d65/d6d/d21/d29/d3d/cc2 4148147 1 2024-05-09T06:30:06.957 INFO:tasks.workunit.client.0.smithi062.stdout:2/835: truncate d0/ffe 257332 0 2024-05-09T06:30:06.957 INFO:tasks.workunit.client.0.smithi062.stdout:2/836: fdatasync d0/d9/dd/d65/d6d/d96/de3/ff1 0 2024-05-09T06:30:06.957 INFO:tasks.workunit.client.0.smithi062.stdout:4/865: rmdir d0 39 2024-05-09T06:30:06.959 INFO:tasks.workunit.client.0.smithi062.stdout:4/866: mkdir d0/d2a/d1f/d103/d7e/d8e/d9e/d86/d10a 0 2024-05-09T06:30:06.962 INFO:tasks.workunit.client.0.smithi062.stdout:3/685: dwrite d1/d1e/f24 [0,4194304] 0 2024-05-09T06:30:06.962 INFO:tasks.workunit.client.0.smithi062.stdout:1/640: dwrite d8/fc9 [0,4194304] 0 2024-05-09T06:30:06.962 INFO:tasks.workunit.client.0.smithi062.stdout:1/641: truncate d8/d1d/f58 4887530 0 2024-05-09T06:30:06.962 INFO:tasks.workunit.client.0.smithi062.stdout:1/642: chown d8/d14/d2b/d9d 27153435 1 2024-05-09T06:30:06.962 INFO:tasks.workunit.client.0.smithi062.stdout:1/643: creat d8/d14/d2b/d3c/d44/d7f/fd3 x:0 0 0 2024-05-09T06:30:06.962 INFO:tasks.workunit.client.0.smithi062.stdout:1/644: write d8/f2a [8244198,108409] 0 2024-05-09T06:30:06.962 INFO:tasks.workunit.client.0.smithi062.stdout:1/645: stat d8/d14/f5e 0 2024-05-09T06:30:06.964 INFO:tasks.workunit.client.0.smithi062.stdout:9/904: dwrite d3/d3e/d4b/da2/fbc [0,4194304] 0 2024-05-09T06:30:06.967 INFO:tasks.workunit.client.0.smithi062.stdout:1/646: dread d8/f5a [0,4194304] 0 2024-05-09T06:30:06.967 INFO:tasks.workunit.client.0.smithi062.stdout:3/686: mkdir d1/d1e/dda 0 2024-05-09T06:30:06.970 INFO:tasks.workunit.client.0.smithi062.stdout:7/786: dread d0/d3a/d51/d64/d6d/d80/fa3 [0,4194304] 0 2024-05-09T06:30:06.973 INFO:tasks.workunit.client.0.smithi062.stdout:3/687: dread d1/d1e/d36/f49 [0,4194304] 0 2024-05-09T06:30:06.975 INFO:tasks.workunit.client.0.smithi062.stdout:1/647: symlink d8/d14/d2b/d3c/d44/d4b/ld4 0 2024-05-09T06:30:06.975 INFO:tasks.workunit.client.0.smithi062.stdout:1/648: fsync f6 0 2024-05-09T06:30:06.976 INFO:tasks.workunit.client.0.smithi062.stdout:7/787: mknod d0/d3a/d3f/df9/cff 0 2024-05-09T06:30:06.976 INFO:tasks.workunit.client.0.smithi062.stdout:7/788: creat d0/d3a/d3f/dab/f100 x:0 0 0 2024-05-09T06:30:06.978 INFO:tasks.workunit.client.0.smithi062.stdout:7/789: truncate d0/f28 142089 0 2024-05-09T06:30:06.979 INFO:tasks.workunit.client.0.smithi062.stdout:7/790: dread d0/d12/f5d [0,4194304] 0 2024-05-09T06:30:06.982 INFO:tasks.workunit.client.0.smithi062.stdout:7/791: unlink d0/f4b 0 2024-05-09T06:30:06.982 INFO:tasks.workunit.client.0.smithi062.stdout:7/792: creat d0/d3a/d51/d64/d6d/d88/dc7/f101 x:0 0 0 2024-05-09T06:30:06.983 INFO:tasks.workunit.client.0.smithi062.stdout:7/793: chown d0/d3a/d51/d64/d6d/d80/ffd 6551 1 2024-05-09T06:30:06.984 INFO:tasks.workunit.client.0.smithi062.stdout:1/649: dread d8/d14/d2b/f2e [0,4194304] 0 2024-05-09T06:30:06.984 INFO:tasks.workunit.client.0.smithi062.stdout:1/650: dread - d8/d1d/d70/fbc zero size 2024-05-09T06:30:06.984 INFO:tasks.workunit.client.0.smithi062.stdout:1/651: stat d8/d14/c1f 0 2024-05-09T06:30:06.986 INFO:tasks.workunit.client.0.smithi062.stdout:2/837: dwrite d0/d9/d38/d41/fc6 [0,4194304] 0 2024-05-09T06:30:06.986 INFO:tasks.workunit.client.0.smithi062.stdout:2/838: truncate d0/d9/d38/d41/d53/fef 158036 0 2024-05-09T06:30:06.986 INFO:tasks.workunit.client.0.smithi062.stdout:2/839: fdatasync d0/d9/d17/d89/fd4 0 2024-05-09T06:30:06.986 INFO:tasks.workunit.client.0.smithi062.stdout:2/840: dread - d0/d9/d38/d41/d8a/f10a zero size 2024-05-09T06:30:06.987 INFO:tasks.workunit.client.0.smithi062.stdout:2/841: write d0/d9/dd/f20 [2172479,91883] 0 2024-05-09T06:30:06.987 INFO:tasks.workunit.client.0.smithi062.stdout:2/842: stat d0/d9/dd/d65/d6d/feb 0 2024-05-09T06:30:06.989 INFO:tasks.workunit.client.0.smithi062.stdout:4/867: dwrite d0/d2a/d1f/d103/d4f/d6b/fc8 [0,4194304] 0 2024-05-09T06:30:06.992 INFO:tasks.workunit.client.0.smithi062.stdout:9/905: dwrite d3/d20/dc7/fbe [0,4194304] 0 2024-05-09T06:30:06.993 INFO:tasks.workunit.client.0.smithi062.stdout:9/906: chown d3/deb 577 1 2024-05-09T06:30:06.995 INFO:tasks.workunit.client.0.smithi062.stdout:4/868: mknod d0/c10b 0 2024-05-09T06:30:06.998 INFO:tasks.workunit.client.0.smithi062.stdout:1/652: dread d8/d14/d2b/d3c/db0/fb1 [0,4194304] 0 2024-05-09T06:30:06.998 INFO:tasks.workunit.client.0.smithi062.stdout:9/907: rmdir d3/d3e/d52/d58/d1c/d21/dfc 39 2024-05-09T06:30:07.000 INFO:tasks.workunit.client.0.smithi062.stdout:4/869: mkdir d0/d5b/dc5/d10c 0 2024-05-09T06:30:07.002 INFO:tasks.workunit.client.0.smithi062.stdout:9/908: truncate d3/d3e/d4b/fc0 2381441 0 2024-05-09T06:30:07.005 INFO:tasks.workunit.client.0.smithi062.stdout:9/909: unlink d3/d3e/d52/d58/d1c/fa9 0 2024-05-09T06:30:07.005 INFO:tasks.workunit.client.0.smithi062.stdout:9/910: write d3/d3e/d52/d58/d1c/d21/dfc/d10e/f112 [293780,79310] 0 2024-05-09T06:30:07.006 INFO:tasks.workunit.client.0.smithi062.stdout:9/911: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/f126 x:0 0 0 2024-05-09T06:30:07.006 INFO:tasks.workunit.client.0.smithi062.stdout:9/912: fdatasync d3/d3e/d4b/fc0 0 2024-05-09T06:30:07.006 INFO:tasks.workunit.client.0.smithi062.stdout:4/870: dread d0/d2a/d1f/dc9/da0/fec [0,4194304] 0 2024-05-09T06:30:07.010 INFO:tasks.workunit.client.0.smithi062.stdout:7/794: dwrite d0/d12/f5d [0,4194304] 0 2024-05-09T06:30:07.010 INFO:tasks.workunit.client.0.smithi062.stdout:4/871: getdents d0/d2a/d1f/d103/d7e/d8e 0 2024-05-09T06:30:07.018 INFO:tasks.workunit.client.0.smithi062.stdout:3/688: dwrite d1/d1e/d54/d8c/fc3 [0,4194304] 0 2024-05-09T06:30:07.019 INFO:tasks.workunit.client.0.smithi062.stdout:3/689: write d1/d48/f57 [3216314,128789] 0 2024-05-09T06:30:07.023 INFO:tasks.workunit.client.0.smithi062.stdout:7/795: dread d0/f6e [0,4194304] 0 2024-05-09T06:30:07.034 INFO:tasks.workunit.client.0.smithi062.stdout:7/796: write d0/d12/f5d [2281686,41505] 0 2024-05-09T06:30:07.034 INFO:tasks.workunit.client.0.smithi062.stdout:7/797: stat d0/d12/d33/d67/da7/de4 0 2024-05-09T06:30:07.039 INFO:tasks.workunit.client.0.smithi062.stdout:1/653: dwrite f3 [4194304,4194304] 0 2024-05-09T06:30:07.039 INFO:tasks.workunit.client.0.smithi062.stdout:2/843: dwrite d0/d9/dd/d65/d6d/d21/d29/d3d/d46/f9a [0,4194304] 0 2024-05-09T06:30:07.040 INFO:tasks.workunit.client.0.smithi062.stdout:4/872: dwrite d0/d2a/d1f/d103/d7e/d8e/d9e/d86/d94/fab [0,4194304] 0 2024-05-09T06:30:07.040 INFO:tasks.workunit.client.0.smithi062.stdout:9/913: dwrite d3/d3e/d52/d58/d1c/d1e/d41/dde/f111 [0,4194304] 0 2024-05-09T06:30:07.041 INFO:tasks.workunit.client.0.smithi062.stdout:4/873: dread d0/d2a/d1f/dc9/da0/fec [0,4194304] 0 2024-05-09T06:30:07.053 INFO:tasks.workunit.client.0.smithi062.stdout:4/874: read d0/d2a/d1f/d103/d7e/d8e/d9e/f16 [2349483,19742] 0 2024-05-09T06:30:07.054 INFO:tasks.workunit.client.0.smithi062.stdout:1/654: dread f3 [4194304,4194304] 0 2024-05-09T06:30:07.054 INFO:tasks.workunit.client.0.smithi062.stdout:1/655: stat d8/f2a 0 2024-05-09T06:30:07.069 INFO:tasks.workunit.client.0.smithi062.stdout:7/798: symlink d0/d3a/d3f/df9/l102 0 2024-05-09T06:30:07.069 INFO:tasks.workunit.client.0.smithi062.stdout:7/799: readlink d0/d3a/d69/le9 0 2024-05-09T06:30:07.069 INFO:tasks.workunit.client.0.smithi062.stdout:7/800: fsync d0/d3a/d3f/fb5 0 2024-05-09T06:30:07.080 INFO:tasks.workunit.client.0.smithi062.stdout:9/914: dread d3/d3e/d4b/fc0 [0,4194304] 0 2024-05-09T06:30:07.096 INFO:tasks.workunit.client.0.smithi062.stdout:4/875: truncate d0/d2a/d1f/dc9/da0/ffe 82559 0 2024-05-09T06:30:07.097 INFO:tasks.workunit.client.0.smithi062.stdout:4/876: creat d0/d3c/da1/f10d x:0 0 0 2024-05-09T06:30:07.099 INFO:tasks.workunit.client.0.smithi062.stdout:1/656: rename d8/d14/d2b/d3c/d44/d4b to d8/d1d/dc7/dd5 0 2024-05-09T06:30:07.100 INFO:tasks.workunit.client.0.smithi062.stdout:7/801: chown d0/d12/d33/f55 958 1 2024-05-09T06:30:07.102 INFO:tasks.workunit.client.0.smithi062.stdout:5/976: sync 2024-05-09T06:30:07.102 INFO:tasks.workunit.client.0.smithi062.stdout:6/996: sync 2024-05-09T06:30:07.102 INFO:tasks.workunit.client.0.smithi062.stdout:6/997: stat dc/d28/d34/db0/ffe 0 2024-05-09T06:30:07.102 INFO:tasks.workunit.client.0.smithi062.stdout:6/998: write dc/d28/d10/d20/d5b/fc6 [1773320,83067] 0 2024-05-09T06:30:07.103 INFO:tasks.workunit.client.0.smithi062.stdout:2/844: getdents d0/d9/d38/d41/d48/d5f 0 2024-05-09T06:30:07.104 INFO:tasks.workunit.client.0.smithi062.stdout:3/690: write d1/d1e/d26/d43/f78 [379685,31169] 0 2024-05-09T06:30:07.111 INFO:tasks.workunit.client.0.smithi062.stdout:9/915: rename d3/ff7 to d3/d3e/d52/d58/d1c/d1e/d103/f127 0 2024-05-09T06:30:07.113 INFO:tasks.workunit.client.0.smithi062.stdout:7/802: truncate d0/d3a/f5f 1571593 0 2024-05-09T06:30:07.114 INFO:tasks.workunit.client.0.smithi062.stdout:6/999: mkdir dc/d28/d46/d3a/d7f/d91/d93/dc0/d70/de4/d150 0 2024-05-09T06:30:07.116 INFO:tasks.workunit.client.0.smithi062.stdout:2/845: creat d0/d9/d38/d41/f10f x:0 0 0 2024-05-09T06:30:07.116 INFO:tasks.workunit.client.0.smithi062.stdout:2/846: fdatasync d0/d9/dd/d65/d6d/d21/f100 0 2024-05-09T06:30:07.117 INFO:tasks.workunit.client.0.smithi062.stdout:8/912: sync 2024-05-09T06:30:07.118 INFO:tasks.workunit.client.0.smithi062.stdout:4/877: dwrite d0/d9/f3e [0,4194304] 0 2024-05-09T06:30:07.118 INFO:tasks.workunit.client.0.smithi062.stdout:3/691: mknod d1/d1e/cdb 0 2024-05-09T06:30:07.120 INFO:tasks.workunit.client.0.smithi062.stdout:9/916: truncate d3/d3e/d7c/f7e 2821209 0 2024-05-09T06:30:07.121 INFO:tasks.workunit.client.0.smithi062.stdout:9/917: fdatasync d3/d3e/d52/d58/d1c/d1e/d103/f127 0 2024-05-09T06:30:07.121 INFO:tasks.workunit.client.0.smithi062.stdout:9/918: chown d3/d20/f107 15 1 2024-05-09T06:30:07.121 INFO:tasks.workunit.client.0.smithi062.stdout:0/850: sync 2024-05-09T06:30:07.121 INFO:tasks.workunit.client.0.smithi062.stdout:0/851: chown d1/d25/d49/d4f/de6/c88 1 1 2024-05-09T06:30:07.121 INFO:tasks.workunit.client.0.smithi062.stdout:0/852: chown d1/d25/d49/d42/d43/d54/d9d/fab 8 1 2024-05-09T06:30:07.121 INFO:tasks.workunit.client.0.smithi062.stdout:0/853: dread - d1/d25/d49/d4f/de6/f6b zero size 2024-05-09T06:30:07.121 INFO:tasks.workunit.client.0.smithi062.stdout:0/854: truncate d1/d25/d31/d6c/df5/f123 558227 0 2024-05-09T06:30:07.122 INFO:tasks.workunit.client.0.smithi062.stdout:7/803: mknod d0/d3a/d51/d64/d6d/d80/d8e/c103 0 2024-05-09T06:30:07.125 INFO:tasks.workunit.client.0.smithi062.stdout:3/692: rename d1/d1e/fd6 to d1/d1e/d36/d3a/d97/fdc 0 2024-05-09T06:30:07.126 INFO:tasks.workunit.client.0.smithi062.stdout:9/919: symlink d3/d3e/d52/d58/d1c/d1e/d41/d64/l128 0 2024-05-09T06:30:07.128 INFO:tasks.workunit.client.0.smithi062.stdout:5/977: dwrite d0/d8/d1c/d2c/d7d/fa1 [0,4194304] 0 2024-05-09T06:30:07.132 INFO:tasks.workunit.client.0.smithi062.stdout:7/804: rmdir d0/d3a/d3f 39 2024-05-09T06:30:07.132 INFO:tasks.workunit.client.0.smithi062.stdout:7/805: dread - d0/d3a/d51/d64/d6d/d80/ffd zero size 2024-05-09T06:30:07.139 INFO:tasks.workunit.client.0.smithi062.stdout:2/847: dread d0/f39 [0,4194304] 0 2024-05-09T06:30:07.143 INFO:tasks.workunit.client.0.smithi062.stdout:5/978: unlink d0/d8/d47/dbe/d45/da5/dcf/l101 0 2024-05-09T06:30:07.147 INFO:tasks.workunit.client.0.smithi062.stdout:2/848: link d0/d9/d38/fcb d0/d9/d38/d41/f110 0 2024-05-09T06:30:07.150 INFO:tasks.workunit.client.0.smithi062.stdout:5/979: rename d0/d11/f10b to d0/d8/d47/dbe/d86/da4/f144 0 2024-05-09T06:30:07.150 INFO:tasks.workunit.client.0.smithi062.stdout:7/806: rmdir d0/d3a/d3f/dab 39 2024-05-09T06:30:07.150 INFO:tasks.workunit.client.0.smithi062.stdout:7/807: write d0/d3a/d51/d64/d6d/d80/dd8/fe0 [2796852,36078] 0 2024-05-09T06:30:07.151 INFO:tasks.workunit.client.0.smithi062.stdout:2/849: mknod d0/d90/db7/c111 0 2024-05-09T06:30:07.151 INFO:tasks.workunit.client.0.smithi062.stdout:2/850: read d0/d9/dd/d65/d6d/f56 [672166,121586] 0 2024-05-09T06:30:07.152 INFO:tasks.workunit.client.0.smithi062.stdout:5/980: symlink d0/d8/d47/d6e/l145 0 2024-05-09T06:30:07.152 INFO:tasks.workunit.client.0.smithi062.stdout:5/981: write d0/d8/d1c/d23/fd0 [169498,70866] 0 2024-05-09T06:30:07.152 INFO:tasks.workunit.client.0.smithi062.stdout:7/808: rmdir d0/d12/d33 39 2024-05-09T06:30:07.153 INFO:tasks.workunit.client.0.smithi062.stdout:2/851: mkdir d0/d9/d38/dd6/dbd/d112 0 2024-05-09T06:30:07.153 INFO:tasks.workunit.client.0.smithi062.stdout:2/852: getdents d0/d9/d38/dd6/dbd/d112 0 2024-05-09T06:30:07.154 INFO:tasks.workunit.client.0.smithi062.stdout:5/982: creat d0/d11/d67/f146 x:0 0 0 2024-05-09T06:30:07.154 INFO:tasks.workunit.client.0.smithi062.stdout:5/983: chown d0/d8/d47/dbe/d5/c8a 0 1 2024-05-09T06:30:07.155 INFO:tasks.workunit.client.0.smithi062.stdout:7/809: rmdir d0/d3a/d51/d64/d6d/dac/de7/df1 39 2024-05-09T06:30:07.155 INFO:tasks.workunit.client.0.smithi062.stdout:7/810: read - d0/d3a/d51/d64/d6d/d80/fea zero size 2024-05-09T06:30:07.156 INFO:tasks.workunit.client.0.smithi062.stdout:7/811: symlink d0/d12/d33/d67/da7/dcd/ddd/l104 0 2024-05-09T06:30:07.156 INFO:tasks.workunit.client.0.smithi062.stdout:7/812: write d0/d3a/d51/d64/d6d/fd0 [686977,67900] 0 2024-05-09T06:30:07.156 INFO:tasks.workunit.client.0.smithi062.stdout:7/813: rmdir d0/d3a/d3f/dab 39 2024-05-09T06:30:07.164 INFO:tasks.workunit.client.0.smithi062.stdout:0/855: dwrite d1/d6a/d6d/d93/d94/dc7/f113 [0,4194304] 0 2024-05-09T06:30:07.164 INFO:tasks.workunit.client.0.smithi062.stdout:0/856: getdents d1/d25/d49/d42/dad 0 2024-05-09T06:30:07.165 INFO:tasks.workunit.client.0.smithi062.stdout:3/693: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:30:07.165 INFO:tasks.workunit.client.0.smithi062.stdout:3/694: fdatasync d1/d1e/d36/f49 0 2024-05-09T06:30:07.166 INFO:tasks.workunit.client.0.smithi062.stdout:9/920: dwrite d3/d20/f7a [4194304,4194304] 0 2024-05-09T06:30:07.166 INFO:tasks.workunit.client.0.smithi062.stdout:9/921: write d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/f126 [705810,129870] 0 2024-05-09T06:30:07.166 INFO:tasks.workunit.client.0.smithi062.stdout:0/857: rmdir d1/d25 39 2024-05-09T06:30:07.167 INFO:tasks.workunit.client.0.smithi062.stdout:4/878: dwrite d0/d3c/dae/db0/dbc/f98 [0,4194304] 0 2024-05-09T06:30:07.167 INFO:tasks.workunit.client.0.smithi062.stdout:4/879: chown d0/d5b/dc5/d10c 6 1 2024-05-09T06:30:07.167 INFO:tasks.workunit.client.0.smithi062.stdout:4/880: fdatasync d0/d3c/dae/ffa 0 2024-05-09T06:30:07.167 INFO:tasks.workunit.client.0.smithi062.stdout:4/881: truncate d0/f7f 5148103 0 2024-05-09T06:30:07.167 INFO:tasks.workunit.client.0.smithi062.stdout:4/882: read d0/d2a/d1f/dc9/f79 [204400,127545] 0 2024-05-09T06:30:07.169 INFO:tasks.workunit.client.0.smithi062.stdout:7/814: write d0/d12/d33/d67/f6a [2131527,71260] 0 2024-05-09T06:30:07.169 INFO:tasks.workunit.client.0.smithi062.stdout:9/922: mknod d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/c129 0 2024-05-09T06:30:07.170 INFO:tasks.workunit.client.0.smithi062.stdout:8/913: dwrite da/dea/d2e/d61/d64/f88 [0,4194304] 0 2024-05-09T06:30:07.170 INFO:tasks.workunit.client.0.smithi062.stdout:2/853: dread d0/f3a [0,4194304] 0 2024-05-09T06:30:07.170 INFO:tasks.workunit.client.0.smithi062.stdout:2/854: write d0/d9/dd/d65/fac [9416225,45123] 0 2024-05-09T06:30:07.172 INFO:tasks.workunit.client.0.smithi062.stdout:0/858: creat d1/d25/d49/d4f/d52/d7b/f127 x:0 0 0 2024-05-09T06:30:07.179 INFO:tasks.workunit.client.0.smithi062.stdout:4/883: symlink d0/d2a/l10e 0 2024-05-09T06:30:07.185 INFO:tasks.workunit.client.0.smithi062.stdout:3/695: rename d1/d1e/d26/d43 to d1/d1e/d26/ddd 0 2024-05-09T06:30:07.185 INFO:tasks.workunit.client.0.smithi062.stdout:3/696: readlink d1/d1e/d26/ddd/d52/d6a/da4/la6 0 2024-05-09T06:30:07.185 INFO:tasks.workunit.client.0.smithi062.stdout:3/697: fsync d1/d1e/fa2 0 2024-05-09T06:30:07.187 INFO:tasks.workunit.client.0.smithi062.stdout:5/984: getdents d0/d11 0 2024-05-09T06:30:07.194 INFO:tasks.workunit.client.0.smithi062.stdout:0/859: write d1/d25/d31/d6c/d44/d57/f64 [42104,5366] 0 2024-05-09T06:30:07.194 INFO:tasks.workunit.client.0.smithi062.stdout:4/884: mkdir d0/d2a/d8/d69/daf/d10f 0 2024-05-09T06:30:07.194 INFO:tasks.workunit.client.0.smithi062.stdout:4/885: fdatasync d0/d2a/d8/f4a 0 2024-05-09T06:30:07.196 INFO:tasks.workunit.client.0.smithi062.stdout:5/985: dread d0/f116 [0,4194304] 0 2024-05-09T06:30:07.196 INFO:tasks.workunit.client.0.smithi062.stdout:3/698: rename d1/d48/c5e to d1/d1e/d36/d9f/d4f/dd2/dd3/cde 0 2024-05-09T06:30:07.202 INFO:tasks.workunit.client.0.smithi062.stdout:0/860: symlink d1/d25/d49/d4f/d52/l128 0 2024-05-09T06:30:07.203 INFO:tasks.workunit.client.0.smithi062.stdout:4/886: mkdir d0/d2a/d1f/dd5/d110 0 2024-05-09T06:30:07.203 INFO:tasks.workunit.client.0.smithi062.stdout:4/887: chown d0/d2a/d1f/dc9/f64 74 1 2024-05-09T06:30:07.206 INFO:tasks.workunit.client.0.smithi062.stdout:5/986: creat d0/d8/d107/f147 x:0 0 0 2024-05-09T06:30:07.208 INFO:tasks.workunit.client.0.smithi062.stdout:3/699: mkdir d1/d1e/d26/ddd/ddf 0 2024-05-09T06:30:07.212 INFO:tasks.workunit.client.0.smithi062.stdout:7/815: dwrite d0/da8/fe2 [0,4194304] 0 2024-05-09T06:30:07.213 INFO:tasks.workunit.client.0.smithi062.stdout:9/923: dwrite d3/d3e/d52/d58/d1c/d21/f67 [0,4194304] 0 2024-05-09T06:30:07.213 INFO:tasks.workunit.client.0.smithi062.stdout:8/914: dwrite da/dea/d2e/d61/f112 [0,4194304] 0 2024-05-09T06:30:07.213 INFO:tasks.workunit.client.0.smithi062.stdout:3/700: link d1/d1e/d26/ddd/cb8 d1/d1e/d36/d9f/ce0 0 2024-05-09T06:30:07.213 INFO:tasks.workunit.client.0.smithi062.stdout:3/701: chown d1/d1e/d54 306896 1 2024-05-09T06:30:07.217 INFO:tasks.workunit.client.0.smithi062.stdout:0/861: dwrite d1/d25/d31/d6c/d44/d57/d84/ff7 [0,4194304] 0 2024-05-09T06:30:07.218 INFO:tasks.workunit.client.0.smithi062.stdout:4/888: dread d0/d2a/d1f/dc9/f64 [0,4194304] 0 2024-05-09T06:30:07.225 INFO:tasks.workunit.client.0.smithi062.stdout:0/862: write d1/fd [2507037,113040] 0 2024-05-09T06:30:07.227 INFO:tasks.workunit.client.0.smithi062.stdout:9/924: mknod d3/d3e/d52/d58/d1c/d1e/d41/dde/c12a 0 2024-05-09T06:30:07.230 INFO:tasks.workunit.client.0.smithi062.stdout:8/915: rename da/dea/d2e/d61/f103 to da/dea/d2e/d61/f12a 0 2024-05-09T06:30:07.230 INFO:tasks.workunit.client.0.smithi062.stdout:8/916: write da/dea/d1c/d9e/ffc [54692,37415] 0 2024-05-09T06:30:07.231 INFO:tasks.workunit.client.0.smithi062.stdout:3/702: mkdir d1/d1e/d26/ddd/d52/d6a/da4/de1 0 2024-05-09T06:30:07.236 INFO:tasks.workunit.client.0.smithi062.stdout:4/889: unlink d0/d2a/d1f/dc9/da0/fec 0 2024-05-09T06:30:07.240 INFO:tasks.workunit.client.0.smithi062.stdout:7/816: getdents d0/d3a/d51/d64/d6d/d88/dc7 0 2024-05-09T06:30:07.243 INFO:tasks.workunit.client.0.smithi062.stdout:0/863: mknod d1/d25/d49/d42/dad/c129 0 2024-05-09T06:30:07.247 INFO:tasks.workunit.client.0.smithi062.stdout:9/925: link d3/la7 d3/d20/dc7/l12b 0 2024-05-09T06:30:07.247 INFO:tasks.workunit.client.0.smithi062.stdout:9/926: read d3/d3e/d52/d58/fb8 [3424966,7843] 0 2024-05-09T06:30:07.247 INFO:tasks.workunit.client.0.smithi062.stdout:9/927: fsync d3/f98 0 2024-05-09T06:30:07.250 INFO:tasks.workunit.client.0.smithi062.stdout:5/987: write d0/d8/d1c/d2c/f33 [3414853,77507] 0 2024-05-09T06:30:07.251 INFO:tasks.workunit.client.0.smithi062.stdout:8/917: link da/dea/d2e/d34/l5f da/dea/d2e/d34/d90/l12b 0 2024-05-09T06:30:07.251 INFO:tasks.workunit.client.0.smithi062.stdout:8/918: chown da/l7d 88377 1 2024-05-09T06:30:07.251 INFO:tasks.workunit.client.0.smithi062.stdout:3/703: creat d1/d1e/d26/ddd/d52/fe2 x:0 0 0 2024-05-09T06:30:07.253 INFO:tasks.workunit.client.0.smithi062.stdout:7/817: rename d0/d12/f5d to d0/d12/d66/d9e/f105 0 2024-05-09T06:30:07.255 INFO:tasks.workunit.client.0.smithi062.stdout:0/864: mkdir d1/d25/d49/d12a 0 2024-05-09T06:30:07.255 INFO:tasks.workunit.client.0.smithi062.stdout:0/865: read d1/d25/d49/d4f/de6/faf [1765645,121507] 0 2024-05-09T06:30:07.255 INFO:tasks.workunit.client.0.smithi062.stdout:0/866: fsync d1/d25/d31/d6c/d44/d6e/fb8 0 2024-05-09T06:30:07.255 INFO:tasks.workunit.client.0.smithi062.stdout:0/867: fsync d1/d25/d49/d42/fed 0 2024-05-09T06:30:07.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/988: getdents d0/d8/d1c/d23/d3e 0 2024-05-09T06:30:07.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/989: fsync d0/d8/d47/dbe/d86/da4/f112 0 2024-05-09T06:30:07.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/990: readlink d0/d11/l13 0 2024-05-09T06:30:07.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/991: truncate d0/d8/d47/dbe/d45/da5/f129 843545 0 2024-05-09T06:30:07.258 INFO:tasks.workunit.client.0.smithi062.stdout:5/992: fsync d0/fa7 0 2024-05-09T06:30:07.260 INFO:tasks.workunit.client.0.smithi062.stdout:3/704: link d1/d1e/d36/d4a/d51/f9b d1/d1e/d36/d3a/d4e/fe3 0 2024-05-09T06:30:07.262 INFO:tasks.workunit.client.0.smithi062.stdout:8/919: rename da/dea/d1c/d9e to da/dea/d2e/d7e/d12c 0 2024-05-09T06:30:07.262 INFO:tasks.workunit.client.0.smithi062.stdout:8/920: read - da/dea/d2e/d61/d64/feb zero size 2024-05-09T06:30:07.264 INFO:tasks.workunit.client.0.smithi062.stdout:7/818: creat d0/d12/d33/d67/da7/dcd/f106 x:0 0 0 2024-05-09T06:30:07.272 INFO:tasks.workunit.client.0.smithi062.stdout:9/928: getdents d3/d3e/d7c 0 2024-05-09T06:30:07.273 INFO:tasks.workunit.client.0.smithi062.stdout:9/929: fdatasync d3/d3e/d52/d58/d1c/d1e/d41/d64/fc1 0 2024-05-09T06:30:07.275 INFO:tasks.workunit.client.0.smithi062.stdout:3/705: mknod d1/d1e/d26/ce4 0 2024-05-09T06:30:07.275 INFO:tasks.workunit.client.0.smithi062.stdout:3/706: write d1/d1e/fa2 [4788977,94511] 0 2024-05-09T06:30:07.275 INFO:tasks.workunit.client.0.smithi062.stdout:3/707: fdatasync d1/d1e/d36/d4a/d51/f6b 0 2024-05-09T06:30:07.281 INFO:tasks.workunit.client.0.smithi062.stdout:3/708: mkdir d1/d1e/d3b/d83/de5 0 2024-05-09T06:30:07.281 INFO:tasks.workunit.client.0.smithi062.stdout:5/993: dwrite d0/d8/fea [0,4194304] 0 2024-05-09T06:30:07.287 INFO:tasks.workunit.client.0.smithi062.stdout:5/994: rename d0/d11/c7c to d0/d8/d47/dbe/d5/c148 0 2024-05-09T06:30:07.290 INFO:tasks.workunit.client.0.smithi062.stdout:5/995: rename d0/d8/d1c/d2c/c5f to d0/d8/d47/dbe/d86/da4/dce/dbd/d13b/c149 0 2024-05-09T06:30:07.291 INFO:tasks.workunit.client.0.smithi062.stdout:8/921: dwrite da/f13 [0,4194304] 0 2024-05-09T06:30:07.291 INFO:tasks.workunit.client.0.smithi062.stdout:8/922: chown da/l6e 5 1 2024-05-09T06:30:07.291 INFO:tasks.workunit.client.0.smithi062.stdout:8/923: creat da/dea/d2e/d7e/f12d x:0 0 0 2024-05-09T06:30:07.291 INFO:tasks.workunit.client.0.smithi062.stdout:8/924: truncate da/d77/fe1 1235994 0 2024-05-09T06:30:07.292 INFO:tasks.workunit.client.0.smithi062.stdout:7/819: dwrite d0/d3a/d3f/dab/fae [4194304,4194304] 0 2024-05-09T06:30:07.292 INFO:tasks.workunit.client.0.smithi062.stdout:5/996: getdents d0/d3b/d3f 0 2024-05-09T06:30:07.299 INFO:tasks.workunit.client.0.smithi062.stdout:7/820: creat d0/d12/d33/d67/da7/de4/f107 x:0 0 0 2024-05-09T06:30:07.299 INFO:tasks.workunit.client.0.smithi062.stdout:7/821: chown d0/d12/cce 19270 1 2024-05-09T06:30:07.299 INFO:tasks.workunit.client.0.smithi062.stdout:7/822: chown d0/d12/d66/lcf 199 1 2024-05-09T06:30:07.299 INFO:tasks.workunit.client.0.smithi062.stdout:7/823: fsync d0/f8 0 2024-05-09T06:30:07.300 INFO:tasks.workunit.client.0.smithi062.stdout:5/997: mknod d0/d8/d1c/d23/d3e/de9/d128/c14a 0 2024-05-09T06:30:07.302 INFO:tasks.workunit.client.0.smithi062.stdout:7/824: unlink d0/d3/l25 0 2024-05-09T06:30:07.302 INFO:tasks.workunit.client.0.smithi062.stdout:7/825: write d0/d12/d33/d67/fe8 [335638,75851] 0 2024-05-09T06:30:07.302 INFO:tasks.workunit.client.0.smithi062.stdout:7/826: fdatasync d0/d12/d33/d67/da7/fd5 0 2024-05-09T06:30:07.303 INFO:tasks.workunit.client.0.smithi062.stdout:5/998: symlink d0/d8/d47/dbe/d45/l14b 0 2024-05-09T06:30:07.305 INFO:tasks.workunit.client.0.smithi062.stdout:5/999: truncate d0/d8/d18/f111 383037 0 2024-05-09T06:30:07.319 INFO:tasks.workunit.client.0.smithi062.stdout:0/868: dwrite d1/d25/d59/fa2 [0,4194304] 0 2024-05-09T06:30:07.319 INFO:tasks.workunit.client.0.smithi062.stdout:0/869: fsync d1/d25/d49/d42/d43/d54/d9d/fc9 0 2024-05-09T06:30:07.322 INFO:tasks.workunit.client.0.smithi062.stdout:0/870: creat d1/d6a/d6d/f12b x:0 0 0 2024-05-09T06:30:07.323 INFO:tasks.workunit.client.0.smithi062.stdout:0/871: mkdir d1/d25/d31/d6c/d44/dca/d12c 0 2024-05-09T06:30:07.326 INFO:tasks.workunit.client.0.smithi062.stdout:0/872: rename d1/d25/d49/d42/dad/dbe/f10b to d1/d25/d49/d4f/d52/d7b/f12d 0 2024-05-09T06:30:07.326 INFO:tasks.workunit.client.0.smithi062.stdout:8/925: dwrite da/dea/d2e/d61/f12a [0,4194304] 0 2024-05-09T06:30:07.326 INFO:tasks.workunit.client.0.smithi062.stdout:8/926: chown da/dea/d2e/d34/d90/fd5 242913632 1 2024-05-09T06:30:07.327 INFO:tasks.workunit.client.0.smithi062.stdout:7/827: dwrite d0/d12/d33/f46 [0,4194304] 0 2024-05-09T06:30:07.327 INFO:tasks.workunit.client.0.smithi062.stdout:7/828: read - d0/d12/d66/fbd zero size 2024-05-09T06:30:07.328 INFO:tasks.workunit.client.0.smithi062.stdout:3/709: dwrite d1/f99 [0,4194304] 0 2024-05-09T06:30:07.328 INFO:tasks.workunit.client.0.smithi062.stdout:0/873: mkdir d1/d25/d49/d4f/d52/d87/dc8/d12e 0 2024-05-09T06:30:07.333 INFO:tasks.workunit.client.0.smithi062.stdout:7/829: mknod d0/d3a/d51/d64/d6d/d80/dd8/c108 0 2024-05-09T06:30:07.340 INFO:tasks.workunit.client.0.smithi062.stdout:3/710: symlink d1/d1e/d36/d3a/d4e/le6 0 2024-05-09T06:30:07.341 INFO:tasks.workunit.client.0.smithi062.stdout:0/874: symlink d1/d25/d49/d4f/d52/d87/dc8/l12f 0 2024-05-09T06:30:07.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:07 smithi079 ceph-mon[35268]: pgmap v11: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 123 MiB/s rd, 153 MiB/s wr, 270 op/s 2024-05-09T06:30:07.344 INFO:tasks.workunit.client.0.smithi062.stdout:3/711: unlink d1/d1e/l45 0 2024-05-09T06:30:07.347 INFO:tasks.workunit.client.0.smithi062.stdout:3/712: creat d1/d1e/d36/d9f/d4f/fe7 x:0 0 0 2024-05-09T06:30:07.348 INFO:tasks.workunit.client.0.smithi062.stdout:0/875: getdents d1/d25/d31/d6c/d44/d57 0 2024-05-09T06:30:07.349 INFO:tasks.workunit.client.0.smithi062.stdout:0/876: fdatasync d1/d6a/d6d/f12b 0 2024-05-09T06:30:07.350 INFO:tasks.workunit.client.0.smithi062.stdout:0/877: write d1/d6a/d6d/d93/d94/dc7/f50 [838433,36139] 0 2024-05-09T06:30:07.352 INFO:tasks.workunit.client.0.smithi062.stdout:3/713: creat d1/d1e/d26/ddd/ddf/fe8 x:0 0 0 2024-05-09T06:30:07.355 INFO:tasks.workunit.client.0.smithi062.stdout:8/927: dwrite f8 [0,4194304] 0 2024-05-09T06:30:07.355 INFO:tasks.workunit.client.0.smithi062.stdout:8/928: creat da/dea/d1c/f12e x:0 0 0 2024-05-09T06:30:07.355 INFO:tasks.workunit.client.0.smithi062.stdout:3/714: symlink d1/d1e/d36/d9f/d4f/dd2/le9 0 2024-05-09T06:30:07.355 INFO:tasks.workunit.client.0.smithi062.stdout:3/715: dread - d1/d1e/d36/d3a/d97/fdc zero size 2024-05-09T06:30:07.357 INFO:tasks.workunit.client.0.smithi062.stdout:7/830: dwrite d0/f1e [0,4194304] 0 2024-05-09T06:30:07.358 INFO:tasks.workunit.client.0.smithi062.stdout:7/831: chown d0/d3/c4e 63 1 2024-05-09T06:30:07.361 INFO:tasks.workunit.client.0.smithi062.stdout:0/878: dread d1/d25/d49/d42/d43/f4e [0,4194304] 0 2024-05-09T06:30:07.362 INFO:tasks.workunit.client.0.smithi062.stdout:8/929: symlink da/dea/d2e/d61/d64/l12f 0 2024-05-09T06:30:07.362 INFO:tasks.workunit.client.0.smithi062.stdout:0/879: dread d1/d25/d49/d42/d43/d54/fba [0,4194304] 0 2024-05-09T06:30:07.363 INFO:tasks.workunit.client.0.smithi062.stdout:3/716: rmdir d1/d1e/d26/ddd/d52/d6a 39 2024-05-09T06:30:07.367 INFO:tasks.workunit.client.0.smithi062.stdout:7/832: mkdir d0/d12/d66/d9e/d109 0 2024-05-09T06:30:07.367 INFO:tasks.workunit.client.0.smithi062.stdout:7/833: write d0/d12/fe5 [999878,11111] 0 2024-05-09T06:30:07.367 INFO:tasks.workunit.client.0.smithi062.stdout:7/834: stat d0/d3a/d51/d64/d6d/d80/fbf 0 2024-05-09T06:30:07.367 INFO:tasks.workunit.client.0.smithi062.stdout:8/930: mkdir da/d95/d130 0 2024-05-09T06:30:07.370 INFO:tasks.workunit.client.0.smithi062.stdout:3/717: symlink d1/d1e/d26/ddd/d92/lea 0 2024-05-09T06:30:07.370 INFO:tasks.workunit.client.0.smithi062.stdout:3/718: readlink d1/d1e/d36/d4a/d51/lb9 0 2024-05-09T06:30:07.371 INFO:tasks.workunit.client.0.smithi062.stdout:8/931: creat da/dea/d2e/d7e/d83/f131 x:0 0 0 2024-05-09T06:30:07.371 INFO:tasks.workunit.client.0.smithi062.stdout:8/932: chown da/dea/dd2/df1 84047 1 2024-05-09T06:30:07.372 INFO:tasks.workunit.client.0.smithi062.stdout:0/880: dread d1/d25/d31/d6c/d44/d6e/fb8 [0,4194304] 0 2024-05-09T06:30:07.374 INFO:tasks.workunit.client.0.smithi062.stdout:8/933: creat da/dea/d10a/f132 x:0 0 0 2024-05-09T06:30:07.377 INFO:tasks.workunit.client.0.smithi062.stdout:8/934: symlink da/dea/d2e/l133 0 2024-05-09T06:30:07.381 INFO:tasks.workunit.client.0.smithi062.stdout:8/935: rename da/f71 to da/dea/d2e/d7e/d12c/d9f/db8/f134 0 2024-05-09T06:30:07.387 INFO:tasks.workunit.client.0.smithi062.stdout:0/881: write d1/d6a/d6d/d93/d94/ffc [3169622,120419] 0 2024-05-09T06:30:07.387 INFO:tasks.workunit.client.0.smithi062.stdout:0/882: write d1/f24 [2416188,81861] 0 2024-05-09T06:30:07.390 INFO:tasks.workunit.client.0.smithi062.stdout:8/936: rmdir da/dea/d2e/d34/d90 39 2024-05-09T06:30:07.395 INFO:tasks.workunit.client.0.smithi062.stdout:7/835: dwrite d0/d3/f65 [0,4194304] 0 2024-05-09T06:30:07.395 INFO:tasks.workunit.client.0.smithi062.stdout:7/836: write d0/d3a/d3f/dab/fe3 [727351,45718] 0 2024-05-09T06:30:07.398 INFO:tasks.workunit.client.0.smithi062.stdout:3/719: dwrite d1/d1e/d26/ddd/fa7 [0,4194304] 0 2024-05-09T06:30:07.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:07 smithi062 ceph-mon[26920]: pgmap v11: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 123 MiB/s rd, 153 MiB/s wr, 270 op/s 2024-05-09T06:30:07.443 INFO:tasks.workunit.client.0.smithi062.stdout:7/837: creat d0/d3/f10a x:0 0 0 2024-05-09T06:30:07.454 INFO:tasks.workunit.client.0.smithi062.stdout:0/883: dwrite d1/d6a/d6d/d93/d94/dc7/f113 [0,4194304] 0 2024-05-09T06:30:07.454 INFO:tasks.workunit.client.0.smithi062.stdout:3/720: dwrite d1/d1e/f1d [0,4194304] 0 2024-05-09T06:30:07.464 INFO:tasks.workunit.client.0.smithi062.stdout:0/884: rename d1/d25/d49/l60 to d1/d25/d49/d42/dad/dbe/l130 0 2024-05-09T06:30:07.467 INFO:tasks.workunit.client.0.smithi062.stdout:7/838: rmdir d0/d3a/d51 39 2024-05-09T06:30:07.471 INFO:tasks.workunit.client.0.smithi062.stdout:0/885: dread d1/d6a/d6d/d93/d94/dc7/f5c [0,4194304] 0 2024-05-09T06:30:07.471 INFO:tasks.workunit.client.0.smithi062.stdout:0/886: creat d1/d25/d59/de7/f131 x:0 0 0 2024-05-09T06:30:07.472 INFO:tasks.workunit.client.0.smithi062.stdout:3/721: dwrite d1/d1e/d54/d8c/fc5 [0,4194304] 0 2024-05-09T06:30:07.473 INFO:tasks.workunit.client.0.smithi062.stdout:0/887: mkdir d1/d6a/d6d/d93/d94/dc7/d132 0 2024-05-09T06:30:07.477 INFO:tasks.workunit.client.0.smithi062.stdout:3/722: symlink d1/d1e/d36/leb 0 2024-05-09T06:30:07.477 INFO:tasks.workunit.client.0.smithi062.stdout:3/723: chown d1/d1e/f1d 730819 1 2024-05-09T06:30:07.480 INFO:tasks.workunit.client.0.smithi062.stdout:7/839: dread d0/d12/d66/faa [0,4194304] 0 2024-05-09T06:30:07.487 INFO:tasks.workunit.client.0.smithi062.stdout:3/724: write d1/d1e/d36/d9f/d4f/fd7 [722595,36170] 0 2024-05-09T06:30:07.488 INFO:tasks.workunit.client.0.smithi062.stdout:3/725: link d1/d1e/d36/d3a/lc8 d1/d1e/d36/d4a/lec 0 2024-05-09T06:30:07.488 INFO:tasks.workunit.client.0.smithi062.stdout:3/726: truncate d1/f55 3947029 0 2024-05-09T06:30:07.489 INFO:tasks.workunit.client.0.smithi062.stdout:7/840: read d0/d3a/d51/f6c [4076311,80775] 0 2024-05-09T06:30:07.490 INFO:tasks.workunit.client.0.smithi062.stdout:3/727: symlink d1/d1e/d26/ddd/d52/d81/dd1/led 0 2024-05-09T06:30:07.490 INFO:tasks.workunit.client.0.smithi062.stdout:3/728: creat d1/d1e/fee x:0 0 0 2024-05-09T06:30:07.490 INFO:tasks.workunit.client.0.smithi062.stdout:3/729: creat d1/d1e/fef x:0 0 0 2024-05-09T06:30:07.492 INFO:tasks.workunit.client.0.smithi062.stdout:3/730: dread d1/d1e/d26/ddd/f78 [0,4194304] 0 2024-05-09T06:30:07.492 INFO:tasks.workunit.client.0.smithi062.stdout:3/731: chown d1/d1e/d36/daa/lc2 57 1 2024-05-09T06:30:07.506 INFO:tasks.workunit.client.0.smithi062.stdout:7/841: dwrite d0/d3a/d51/f44 [0,4194304] 0 2024-05-09T06:30:07.506 INFO:tasks.workunit.client.0.smithi062.stdout:7/842: truncate d0/d12/d66/ff0 1040128 0 2024-05-09T06:30:07.509 INFO:tasks.workunit.client.0.smithi062.stdout:7/843: getdents d0/d3a 0 2024-05-09T06:30:07.509 INFO:tasks.workunit.client.0.smithi062.stdout:7/844: readlink d0/d12/l29 0 2024-05-09T06:30:07.525 INFO:tasks.workunit.client.0.smithi062.stdout:7/845: dwrite d0/d12/d66/d9e/f105 [0,4194304] 0 2024-05-09T06:30:07.528 INFO:tasks.workunit.client.0.smithi062.stdout:7/846: dread d0/d3a/d51/d64/d6d/d80/d8e/fa0 [0,4194304] 0 2024-05-09T06:30:07.549 INFO:tasks.workunit.client.0.smithi062.stdout:7/847: dwrite d0/d12/d33/f3b [0,4194304] 0 2024-05-09T06:30:07.551 INFO:tasks.workunit.client.0.smithi062.stdout:7/848: link d0/d3/f17 d0/d12/d33/d67/da7/f10b 0 2024-05-09T06:30:07.554 INFO:tasks.workunit.client.0.smithi062.stdout:7/849: truncate d0/f77 3489345 0 2024-05-09T06:30:07.561 INFO:tasks.workunit.client.0.smithi062.stdout:7/850: symlink d0/da8/l10c 0 2024-05-09T06:30:07.561 INFO:tasks.workunit.client.0.smithi062.stdout:7/851: dread - d0/d12/d33/d67/f6b zero size 2024-05-09T06:30:07.566 INFO:tasks.workunit.client.0.smithi062.stdout:7/852: rmdir d0/d12/d33/d9f 39 2024-05-09T06:30:07.573 INFO:tasks.workunit.client.0.smithi062.stdout:7/853: dread d0/d3a/d3f/dab/fc1 [0,4194304] 0 2024-05-09T06:30:07.574 INFO:tasks.workunit.client.0.smithi062.stdout:7/854: mkdir d0/d3/d10d 0 2024-05-09T06:30:07.576 INFO:tasks.workunit.client.0.smithi062.stdout:7/855: link d0/f95 d0/d12/d33/d67/f10e 0 2024-05-09T06:30:07.576 INFO:tasks.workunit.client.0.smithi062.stdout:7/856: rename d0/d12/d33 to d0/d12/d33/d67/da7/de4/d10f 22 2024-05-09T06:30:07.576 INFO:tasks.workunit.client.0.smithi062.stdout:7/857: mkdir d0/d3a/d69/d110 0 2024-05-09T06:30:07.578 INFO:tasks.workunit.client.0.smithi062.stdout:7/858: dread d0/d3/f2b [0,4194304] 0 2024-05-09T06:30:07.579 INFO:tasks.workunit.client.0.smithi062.stdout:7/859: mkdir d0/d3a/d51/d64/d6d/d88/d111 0 2024-05-09T06:30:07.580 INFO:tasks.workunit.client.0.smithi062.stdout:7/860: mkdir d0/d3a/d3f/dab/d112 0 2024-05-09T06:30:07.580 INFO:tasks.workunit.client.0.smithi062.stdout:7/861: fdatasync d0/d3a/d3f/fb3 0 2024-05-09T06:30:07.582 INFO:tasks.workunit.client.0.smithi062.stdout:7/862: symlink d0/d3a/d51/d64/d6d/dac/de7/l113 0 2024-05-09T06:30:07.590 INFO:tasks.workunit.client.0.smithi062.stdout:7/863: dread d0/d12/f71 [0,4194304] 0 2024-05-09T06:30:07.606 INFO:tasks.workunit.client.0.smithi062.stdout:7/864: dwrite d0/d12/fe5 [0,4194304] 0 2024-05-09T06:30:07.620 INFO:tasks.workunit.client.0.smithi062.stdout:1/657: sync 2024-05-09T06:30:07.627 INFO:tasks.workunit.client.0.smithi062.stdout:7/865: dwrite d0/d3a/d51/d64/d6d/f98 [0,4194304] 0 2024-05-09T06:30:07.628 INFO:tasks.workunit.client.0.smithi062.stdout:7/866: unlink d0/d3a/d51/d64/d6d/d80/ld6 0 2024-05-09T06:30:07.629 INFO:tasks.workunit.client.0.smithi062.stdout:7/867: write d0/d12/d33/f55 [587422,11279] 0 2024-05-09T06:30:07.629 INFO:tasks.workunit.client.0.smithi062.stdout:7/868: truncate d0/d12/d66/d9e/fa9 868968 0 2024-05-09T06:30:07.631 INFO:tasks.workunit.client.0.smithi062.stdout:7/869: dread d0/d3a/d3f/dab/fe3 [0,4194304] 0 2024-05-09T06:30:07.633 INFO:tasks.workunit.client.0.smithi062.stdout:7/870: symlink d0/d12/l114 0 2024-05-09T06:30:07.634 INFO:tasks.workunit.client.0.smithi062.stdout:1/658: dwrite d8/d14/d2b/d3c/d44/d64/f68 [0,4194304] 0 2024-05-09T06:30:07.636 INFO:tasks.workunit.client.0.smithi062.stdout:7/871: symlink d0/d12/l115 0 2024-05-09T06:30:07.640 INFO:tasks.workunit.client.0.smithi062.stdout:1/659: mknod d8/d14/d2b/d3c/da5/dcf/cd6 0 2024-05-09T06:30:07.642 INFO:tasks.workunit.client.0.smithi062.stdout:1/660: dread d8/f89 [0,4194304] 0 2024-05-09T06:30:07.644 INFO:tasks.workunit.client.0.smithi062.stdout:1/661: creat d8/fd7 x:0 0 0 2024-05-09T06:30:07.644 INFO:tasks.workunit.client.0.smithi062.stdout:1/662: dread - d8/d1d/d70/fbd zero size 2024-05-09T06:30:07.654 INFO:tasks.workunit.client.0.smithi062.stdout:7/872: dwrite d0/d3a/d51/f42 [0,4194304] 0 2024-05-09T06:30:07.663 INFO:tasks.workunit.client.0.smithi062.stdout:7/873: write d0/d3a/d51/d64/d6d/f90 [1244605,75530] 0 2024-05-09T06:30:07.663 INFO:tasks.workunit.client.0.smithi062.stdout:7/874: chown d0/d3a/d51/d64/d6d/d80/ffd 1862428 1 2024-05-09T06:30:07.665 INFO:tasks.workunit.client.0.smithi062.stdout:1/663: dwrite d8/d14/d2b/d3c/d44/d38/dbe/fcb [0,4194304] 0 2024-05-09T06:30:07.665 INFO:tasks.workunit.client.0.smithi062.stdout:1/664: readlink d8/d14/d2b/d3c/d44/d7f/lc1 0 2024-05-09T06:30:07.666 INFO:tasks.workunit.client.0.smithi062.stdout:7/875: unlink d0/d12/d33/f55 0 2024-05-09T06:30:07.672 INFO:tasks.workunit.client.0.smithi062.stdout:1/665: unlink d8/d1d/d70/faa 0 2024-05-09T06:30:07.672 INFO:tasks.workunit.client.0.smithi062.stdout:7/876: dread d0/d12/d33/d67/fa1 [0,4194304] 0 2024-05-09T06:30:07.672 INFO:tasks.workunit.client.0.smithi062.stdout:7/877: chown d0/d3a/d3f/faf 8107 1 2024-05-09T06:30:07.672 INFO:tasks.workunit.client.0.smithi062.stdout:7/878: chown d0/f20 6862824 1 2024-05-09T06:30:07.680 INFO:tasks.workunit.client.0.smithi062.stdout:1/666: write f5 [2016609,60620] 0 2024-05-09T06:30:07.681 INFO:tasks.workunit.client.0.smithi062.stdout:7/879: symlink d0/d3a/d3f/dfc/l116 0 2024-05-09T06:30:07.692 INFO:tasks.workunit.client.0.smithi062.stdout:7/880: write d0/d12/fe5 [2409248,31526] 0 2024-05-09T06:30:07.701 INFO:tasks.workunit.client.0.smithi062.stdout:1/667: dwrite d8/d14/d2b/f2e [0,4194304] 0 2024-05-09T06:30:07.711 INFO:tasks.workunit.client.0.smithi062.stdout:1/668: dread d8/d14/d2b/f52 [0,4194304] 0 2024-05-09T06:30:07.877 INFO:tasks.workunit.client.0.smithi062.stdout:9/930: sync 2024-05-09T06:30:07.877 INFO:tasks.workunit.client.0.smithi062.stdout:4/890: sync 2024-05-09T06:30:07.877 INFO:tasks.workunit.client.0.smithi062.stdout:2/855: sync 2024-05-09T06:30:07.877 INFO:tasks.workunit.client.0.smithi062.stdout:8/937: sync 2024-05-09T06:30:07.877 INFO:tasks.workunit.client.0.smithi062.stdout:8/938: chown da/dea/d2e/d7e/d12c/d9f/cc2 10067 1 2024-05-09T06:30:07.877 INFO:tasks.workunit.client.0.smithi062.stdout:4/891: getdents d0/d2a/d8/d69/daf/d10f 0 2024-05-09T06:30:07.877 INFO:tasks.workunit.client.0.smithi062.stdout:8/939: truncate da/dea/d2e/d61/d64/f88 4615229 0 2024-05-09T06:30:07.878 INFO:tasks.workunit.client.0.smithi062.stdout:8/940: readlink da/dea/d2e/d61/d92/l5a 0 2024-05-09T06:30:07.878 INFO:tasks.workunit.client.0.smithi062.stdout:8/941: readlink da/dea/d2e/d34/d90/lb5 0 2024-05-09T06:30:07.878 INFO:tasks.workunit.client.0.smithi062.stdout:9/931: symlink d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/d124/l12c 0 2024-05-09T06:30:07.891 INFO:tasks.workunit.client.0.smithi062.stdout:8/942: dread da/dea/d1c/de0/f110 [0,4194304] 0 2024-05-09T06:30:07.891 INFO:tasks.workunit.client.0.smithi062.stdout:2/856: dread d0/d9/dd/d65/d6d/f56 [0,4194304] 0 2024-05-09T06:30:07.891 INFO:tasks.workunit.client.0.smithi062.stdout:2/857: write d0/d9/d17/d37/f7f [153303,93038] 0 2024-05-09T06:30:07.893 INFO:tasks.workunit.client.0.smithi062.stdout:2/858: mknod d0/d9/dd9/d93/c113 0 2024-05-09T06:30:07.894 INFO:tasks.workunit.client.0.smithi062.stdout:2/859: mknod d0/d9/d17/d89/c114 0 2024-05-09T06:30:07.894 INFO:tasks.workunit.client.0.smithi062.stdout:2/860: dread - d0/d9/dd/d65/d6d/f103 zero size 2024-05-09T06:30:07.899 INFO:tasks.workunit.client.0.smithi062.stdout:9/932: dwrite d3/d3e/d52/d58/d1c/d21/f67 [0,4194304] 0 2024-05-09T06:30:07.901 INFO:tasks.workunit.client.0.smithi062.stdout:9/933: unlink d3/la7 0 2024-05-09T06:30:07.904 INFO:tasks.workunit.client.0.smithi062.stdout:9/934: creat d3/d3e/d52/d58/f12d x:0 0 0 2024-05-09T06:30:07.904 INFO:tasks.workunit.client.0.smithi062.stdout:9/935: write d3/d3e/d52/d58/f32 [4787352,101499] 0 2024-05-09T06:30:07.907 INFO:tasks.workunit.client.0.smithi062.stdout:8/943: dwrite da/dea/d1c/de0/f110 [4194304,4194304] 0 2024-05-09T06:30:07.910 INFO:tasks.workunit.client.0.smithi062.stdout:8/944: creat da/dea/d2e/d7e/d12c/d9f/da7/f135 x:0 0 0 2024-05-09T06:30:07.911 INFO:tasks.workunit.client.0.smithi062.stdout:8/945: mkdir da/d95/d130/d136 0 2024-05-09T06:30:07.913 INFO:tasks.workunit.client.0.smithi062.stdout:9/936: dread d3/d3e/f89 [0,4194304] 0 2024-05-09T06:30:07.913 INFO:tasks.workunit.client.0.smithi062.stdout:8/946: mkdir da/dea/d2e/d61/d92/da5/daf/d137 0 2024-05-09T06:30:07.913 INFO:tasks.workunit.client.0.smithi062.stdout:8/947: dread - da/dea/d1c/de0/fe6 zero size 2024-05-09T06:30:07.914 INFO:tasks.workunit.client.0.smithi062.stdout:8/948: getdents da/d85 0 2024-05-09T06:30:07.918 INFO:tasks.workunit.client.0.smithi062.stdout:8/949: creat da/dea/d2e/d34/d115/f138 x:0 0 0 2024-05-09T06:30:07.918 INFO:tasks.workunit.client.0.smithi062.stdout:8/950: readlink da/dea/d2e/d7e/l108 0 2024-05-09T06:30:07.918 INFO:tasks.workunit.client.0.smithi062.stdout:8/951: stat da/dea/d1c/c24 0 2024-05-09T06:30:07.932 INFO:tasks.workunit.client.0.smithi062.stdout:9/937: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/fca [0,4194304] 0 2024-05-09T06:30:07.936 INFO:tasks.workunit.client.0.smithi062.stdout:9/938: getdents d3/d3e/d52/d58/d1c/d1e/d41/d64/de2 0 2024-05-09T06:30:07.937 INFO:tasks.workunit.client.0.smithi062.stdout:9/939: rename d3/d3e/d52/d58/d1c/d1e/c27 to d3/d3e/d52/d58/d77/c12e 0 2024-05-09T06:30:07.938 INFO:tasks.workunit.client.0.smithi062.stdout:8/952: dwrite da/dea/d1c/ff4 [0,4194304] 0 2024-05-09T06:30:07.945 INFO:tasks.workunit.client.0.smithi062.stdout:9/940: dread d3/d3e/d52/d58/d1c/d1e/d60/f73 [0,4194304] 0 2024-05-09T06:30:07.945 INFO:tasks.workunit.client.0.smithi062.stdout:9/941: creat d3/d3e/d52/d58/d1c/d1e/d60/f12f x:0 0 0 2024-05-09T06:30:07.950 INFO:tasks.workunit.client.0.smithi062.stdout:8/953: read da/dea/d2e/d61/d64/f88 [1092708,87543] 0 2024-05-09T06:30:07.955 INFO:tasks.workunit.client.0.smithi062.stdout:8/954: creat da/df0/f139 x:0 0 0 2024-05-09T06:30:07.977 INFO:tasks.workunit.client.0.smithi062.stdout:9/942: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/ff5 [0,4194304] 0 2024-05-09T06:30:07.978 INFO:tasks.workunit.client.0.smithi062.stdout:9/943: chown d3/d3e/d52/d58/d1c/d1e 1318259371 1 2024-05-09T06:30:07.978 INFO:tasks.workunit.client.0.smithi062.stdout:8/955: dwrite da/dea/d2e/d7e/d12c/d9f/db8/fcf [0,4194304] 0 2024-05-09T06:30:07.979 INFO:tasks.workunit.client.0.smithi062.stdout:8/956: truncate da/dea/d2e/f91 604003 0 2024-05-09T06:30:08.048 INFO:tasks.workunit.client.0.smithi062.stdout:8/957: creat da/dea/d2e/d34/d90/f13a x:0 0 0 2024-05-09T06:30:08.048 INFO:tasks.workunit.client.0.smithi062.stdout:8/958: write da/dea/d2e/d34/dd4/fe9 [1103611,110344] 0 2024-05-09T06:30:08.052 INFO:tasks.workunit.client.0.smithi062.stdout:3/732: sync 2024-05-09T06:30:08.053 INFO:tasks.workunit.client.0.smithi062.stdout:0/888: sync 2024-05-09T06:30:08.053 INFO:tasks.workunit.client.0.smithi062.stdout:7/881: sync 2024-05-09T06:30:08.053 INFO:tasks.workunit.client.0.smithi062.stdout:1/669: sync 2024-05-09T06:30:08.053 INFO:tasks.workunit.client.0.smithi062.stdout:0/889: fdatasync d1/fc 0 2024-05-09T06:30:08.056 INFO:tasks.workunit.client.0.smithi062.stdout:8/959: stat da/dea/l97 0 2024-05-09T06:30:08.057 INFO:tasks.workunit.client.0.smithi062.stdout:7/882: rmdir d0/d12/d66/d9e 39 2024-05-09T06:30:08.060 INFO:tasks.workunit.client.0.smithi062.stdout:7/883: write d0/d12/d33/d9f/fb2 [4886490,78002] 0 2024-05-09T06:30:08.060 INFO:tasks.workunit.client.0.smithi062.stdout:7/884: fdatasync d0/d3a/d3f/dab/fe3 0 2024-05-09T06:30:08.060 INFO:tasks.workunit.client.0.smithi062.stdout:1/670: creat d8/d14/d2b/d3c/da5/dcf/fd8 x:0 0 0 2024-05-09T06:30:08.061 INFO:tasks.workunit.client.0.smithi062.stdout:1/671: rename d8/d1d to d8/d1d/d9c/dd9 22 2024-05-09T06:30:08.061 INFO:tasks.workunit.client.0.smithi062.stdout:3/733: mkdir d1/d1e/d36/df0 0 2024-05-09T06:30:08.064 INFO:tasks.workunit.client.0.smithi062.stdout:8/960: truncate da/dea/f17 505533 0 2024-05-09T06:30:08.066 INFO:tasks.workunit.client.0.smithi062.stdout:7/885: rmdir d0/d3a/d51/d64/d6d 39 2024-05-09T06:30:08.067 INFO:tasks.workunit.client.0.smithi062.stdout:7/886: chown d0/d3/l63 6714 1 2024-05-09T06:30:08.068 INFO:tasks.workunit.client.0.smithi062.stdout:1/672: rename d8/d14/d2b/d3c/d44/d38/c4d to d8/d14/d2b/d3c/d44/d6e/d7a/d80/cda 0 2024-05-09T06:30:08.071 INFO:tasks.workunit.client.0.smithi062.stdout:1/673: dread d8/d14/d2b/d3d/f90 [0,4194304] 0 2024-05-09T06:30:08.072 INFO:tasks.workunit.client.0.smithi062.stdout:0/890: dwrite d1/d25/d49/d42/d43/d54/d9d/fc9 [0,4194304] 0 2024-05-09T06:30:08.072 INFO:tasks.workunit.client.0.smithi062.stdout:0/891: write d1/d25/d31/d6c/d44/f11b [97647,118992] 0 2024-05-09T06:30:08.075 INFO:tasks.workunit.client.0.smithi062.stdout:8/961: rename da/dea/d2e/d7e/d12c/ffc to da/dea/d2e/d7e/d12c/d9f/da7/d116/f13b 0 2024-05-09T06:30:08.082 INFO:tasks.workunit.client.0.smithi062.stdout:0/892: truncate d1/d25/d49/d42/fed 848623 0 2024-05-09T06:30:08.082 INFO:tasks.workunit.client.0.smithi062.stdout:0/893: fdatasync d1/d25/d49/d7e/da6/fb3 0 2024-05-09T06:30:08.082 INFO:tasks.workunit.client.0.smithi062.stdout:0/894: truncate d1/d25/d31/d6c/d44/d57/f108 1196747 0 2024-05-09T06:30:08.083 INFO:tasks.workunit.client.0.smithi062.stdout:8/962: rmdir da/d95/d130 39 2024-05-09T06:30:08.083 INFO:tasks.workunit.client.0.smithi062.stdout:8/963: creat da/dea/d2e/d7e/d12c/d9f/da7/f13c x:0 0 0 2024-05-09T06:30:08.083 INFO:tasks.workunit.client.0.smithi062.stdout:1/674: write d8/d14/f1b [1416564,100882] 0 2024-05-09T06:30:08.084 INFO:tasks.workunit.client.0.smithi062.stdout:8/964: creat da/dea/d2e/d34/dd4/f13d x:0 0 0 2024-05-09T06:30:08.086 INFO:tasks.workunit.client.0.smithi062.stdout:8/965: symlink da/dea/d2e/d61/d92/da5/db2/l13e 0 2024-05-09T06:30:08.089 INFO:tasks.workunit.client.0.smithi062.stdout:3/734: dwrite d1/f99 [0,4194304] 0 2024-05-09T06:30:08.089 INFO:tasks.workunit.client.0.smithi062.stdout:7/887: dwrite d0/d12/fe5 [0,4194304] 0 2024-05-09T06:30:08.091 INFO:tasks.workunit.client.0.smithi062.stdout:3/735: mknod d1/d1e/d36/d3a/d97/cf1 0 2024-05-09T06:30:08.092 INFO:tasks.workunit.client.0.smithi062.stdout:0/895: dread d1/d25/d49/d42/fa7 [0,4194304] 0 2024-05-09T06:30:08.093 INFO:tasks.workunit.client.0.smithi062.stdout:1/675: write d8/d14/d2b/d3c/d44/d6e/f73 [709497,72929] 0 2024-05-09T06:30:08.093 INFO:tasks.workunit.client.0.smithi062.stdout:1/676: fsync d8/d14/d2b/d3c/d7d/fba 0 2024-05-09T06:30:08.094 INFO:tasks.workunit.client.0.smithi062.stdout:3/736: rename d1/d1e/d26/ddd/ca1 to d1/d1e/d36/d4a/d51/cf2 0 2024-05-09T06:30:08.098 INFO:tasks.workunit.client.0.smithi062.stdout:1/677: symlink d8/d1d/d70/ldb 0 2024-05-09T06:30:08.099 INFO:tasks.workunit.client.0.smithi062.stdout:1/678: chown d8/d14/d2b/d3c/d7d/f9f 6626819 1 2024-05-09T06:30:08.099 INFO:tasks.workunit.client.0.smithi062.stdout:1/679: write d8/d1d/dc7/dd5/fc6 [1039219,20322] 0 2024-05-09T06:30:08.100 INFO:tasks.workunit.client.0.smithi062.stdout:3/737: mkdir d1/d1e/d26/df3 0 2024-05-09T06:30:08.101 INFO:tasks.workunit.client.0.smithi062.stdout:8/966: write da/dea/d2e/d7e/ff5 [1098082,90762] 0 2024-05-09T06:30:08.103 INFO:tasks.workunit.client.0.smithi062.stdout:7/888: dread d0/d3a/d51/f44 [0,4194304] 0 2024-05-09T06:30:08.103 INFO:tasks.workunit.client.0.smithi062.stdout:7/889: truncate d0/d3a/d51/d64/d6d/f97 9224866 0 2024-05-09T06:30:08.103 INFO:tasks.workunit.client.0.smithi062.stdout:7/890: chown d0/d12/d33/d67 437 1 2024-05-09T06:30:08.103 INFO:tasks.workunit.client.0.smithi062.stdout:7/891: fdatasync d0/d3a/d3f/fb3 0 2024-05-09T06:30:08.103 INFO:tasks.workunit.client.0.smithi062.stdout:7/892: readlink d0/l2f 0 2024-05-09T06:30:08.107 INFO:tasks.workunit.client.0.smithi062.stdout:1/680: mknod d8/d14/d2b/d3c/d44/d6e/d98/cdc 0 2024-05-09T06:30:08.107 INFO:tasks.workunit.client.0.smithi062.stdout:1/681: write d8/d14/f5e [2073602,65948] 0 2024-05-09T06:30:08.107 INFO:tasks.workunit.client.0.smithi062.stdout:1/682: write d8/d14/d2b/d3c/d44/d6e/d7a/fa6 [735769,127685] 0 2024-05-09T06:30:08.110 INFO:tasks.workunit.client.0.smithi062.stdout:3/738: truncate d1/d1e/d36/d9f/d4f/f96 661957 0 2024-05-09T06:30:08.110 INFO:tasks.workunit.client.0.smithi062.stdout:8/967: dread da/dea/d1c/fb0 [0,4194304] 0 2024-05-09T06:30:08.113 INFO:tasks.workunit.client.0.smithi062.stdout:7/893: truncate d0/d12/d33/d67/f7e 1479116 0 2024-05-09T06:30:08.118 INFO:tasks.workunit.client.0.smithi062.stdout:1/683: write d8/d1d/d9c/d41/f55 [7527502,111860] 0 2024-05-09T06:30:08.118 INFO:tasks.workunit.client.0.smithi062.stdout:1/684: truncate d8/d14/d2b/d3c/d44/f63 1690264 0 2024-05-09T06:30:08.118 INFO:tasks.workunit.client.0.smithi062.stdout:1/685: stat d8/d14/d2b/d3c/d44/f63 0 2024-05-09T06:30:08.118 INFO:tasks.workunit.client.0.smithi062.stdout:1/686: readlink d8/d14/d2b/d3c/d76/l8e 0 2024-05-09T06:30:08.123 INFO:tasks.workunit.client.0.smithi062.stdout:8/968: dwrite da/dea/d2e/d34/dd4/fe9 [0,4194304] 0 2024-05-09T06:30:08.136 INFO:tasks.workunit.client.0.smithi062.stdout:3/739: mkdir d1/d1e/d54/d8c/df4 0 2024-05-09T06:30:08.136 INFO:tasks.workunit.client.0.smithi062.stdout:3/740: stat d1/d1e/c32 0 2024-05-09T06:30:08.137 INFO:tasks.workunit.client.0.smithi062.stdout:3/741: fdatasync d1/f55 0 2024-05-09T06:30:08.139 INFO:tasks.workunit.client.0.smithi062.stdout:0/896: rmdir d1/d25/d49/d4f/d52/d87/dc8/df4 0 2024-05-09T06:30:08.140 INFO:tasks.workunit.client.0.smithi062.stdout:3/742: dread d1/d1e/d36/d4a/d51/f9b [0,4194304] 0 2024-05-09T06:30:08.145 INFO:tasks.workunit.client.0.smithi062.stdout:1/687: rename d8/f54 to d8/d14/d2b/d3c/d44/d6e/d7a/d80/fdd 0 2024-05-09T06:30:08.145 INFO:tasks.workunit.client.0.smithi062.stdout:1/688: readlink d8/d14/lb9 0 2024-05-09T06:30:08.145 INFO:tasks.workunit.client.0.smithi062.stdout:1/689: fsync d8/d14/d2b/d3d/f71 0 2024-05-09T06:30:08.146 INFO:tasks.workunit.client.0.smithi062.stdout:0/897: dread d1/d25/d49/d7e/da6/fb3 [0,4194304] 0 2024-05-09T06:30:08.146 INFO:tasks.workunit.client.0.smithi062.stdout:0/898: write d1/d6a/d6d/d93/d94/fe1 [835630,81510] 0 2024-05-09T06:30:08.148 INFO:tasks.workunit.client.0.smithi062.stdout:8/969: symlink da/dea/d2e/d61/d92/da5/daf/d10f/l13f 0 2024-05-09T06:30:08.148 INFO:tasks.workunit.client.0.smithi062.stdout:8/970: chown da/d95/d130 43703 1 2024-05-09T06:30:08.152 INFO:tasks.workunit.client.0.smithi062.stdout:7/894: mkdir d0/d3a/d51/d64/d6d/d88/dc7/d117 0 2024-05-09T06:30:08.154 INFO:tasks.workunit.client.0.smithi062.stdout:3/743: mknod d1/d1e/d26/df3/cf5 0 2024-05-09T06:30:08.161 INFO:tasks.workunit.client.0.smithi062.stdout:1/690: unlink d8/d1d/d70/fbc 0 2024-05-09T06:30:08.162 INFO:tasks.workunit.client.0.smithi062.stdout:0/899: creat d1/d25/d49/d42/d43/d54/d124/f133 x:0 0 0 2024-05-09T06:30:08.166 INFO:tasks.workunit.client.0.smithi062.stdout:8/971: unlink da/dea/d2e/d61/d64/f88 0 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:7/895: rename d0/d3/f65 to d0/d3a/f118 0 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:4/892: sync 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:9/944: sync 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:2/861: sync 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:2/862: chown d0/d9/dd/d65/d6d/d21/d29/c2a 3476893 1 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:2/863: read - d0/d9/dd/d65/fea zero size 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:9/945: write d3/d3e/d52/d58/d77/d92/f96 [4429115,23768] 0 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:2/864: chown d0/d9/d38/d41/d48/df9 0 1 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:9/946: truncate d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/fc2 781251 0 2024-05-09T06:30:08.169 INFO:tasks.workunit.client.0.smithi062.stdout:9/947: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/f130 x:0 0 0 2024-05-09T06:30:08.170 INFO:tasks.workunit.client.0.smithi062.stdout:3/744: link d1/l13 d1/d1e/d36/d4a/d51/lf6 0 2024-05-09T06:30:08.171 INFO:tasks.workunit.client.0.smithi062.stdout:3/745: truncate d1/d1e/d36/d4a/d51/fd9 284821 0 2024-05-09T06:30:08.172 INFO:tasks.workunit.client.0.smithi062.stdout:1/691: link d8/d14/d2b/d3c/db0/fb1 d8/d14/d2b/d3c/d44/d6e/fde 0 2024-05-09T06:30:08.173 INFO:tasks.workunit.client.0.smithi062.stdout:0/900: creat d1/d25/f134 x:0 0 0 2024-05-09T06:30:08.174 INFO:tasks.workunit.client.0.smithi062.stdout:8/972: symlink da/dea/d2e/d61/d92/l140 0 2024-05-09T06:30:08.176 INFO:tasks.workunit.client.0.smithi062.stdout:4/893: creat d0/d2a/d8/d69/daf/d10f/f111 x:0 0 0 2024-05-09T06:30:08.182 INFO:tasks.workunit.client.0.smithi062.stdout:7/896: write d0/da8/fe2 [2330631,119822] 0 2024-05-09T06:30:08.183 INFO:tasks.workunit.client.0.smithi062.stdout:2/865: truncate d0/d9/d38/d41/f49 35468 0 2024-05-09T06:30:08.186 INFO:tasks.workunit.client.0.smithi062.stdout:3/746: rename d1/d1e/d26/f2b to d1/d1e/d54/d8c/ff7 0 2024-05-09T06:30:08.188 INFO:tasks.workunit.client.0.smithi062.stdout:1/692: read d8/f13 [2726588,67852] 0 2024-05-09T06:30:08.188 INFO:tasks.workunit.client.0.smithi062.stdout:4/894: rmdir d0/d2a/d1f/dc9/d108 0 2024-05-09T06:30:08.189 INFO:tasks.workunit.client.0.smithi062.stdout:4/895: chown d0/d2a/d1f/faa 641 1 2024-05-09T06:30:08.190 INFO:tasks.workunit.client.0.smithi062.stdout:3/747: creat d1/d1e/d36/df0/ff8 x:0 0 0 2024-05-09T06:30:08.192 INFO:tasks.workunit.client.0.smithi062.stdout:4/896: rename d0/d2a/d8/d69/daf/fdb to d0/d2a/d8/d69/f112 0 2024-05-09T06:30:08.197 INFO:tasks.workunit.client.0.smithi062.stdout:0/901: dwrite d1/d25/d31/d6c/d44/f11b [0,4194304] 0 2024-05-09T06:30:08.197 INFO:tasks.workunit.client.0.smithi062.stdout:0/902: creat d1/d6a/d6d/d93/d94/f135 x:0 0 0 2024-05-09T06:30:08.198 INFO:tasks.workunit.client.0.smithi062.stdout:4/897: mkdir d0/d2a/d1f/d103/d7e/d8e/d9e/d86/d113 0 2024-05-09T06:30:08.204 INFO:tasks.workunit.client.0.smithi062.stdout:0/903: creat d1/d25/d49/d42/dad/f136 x:0 0 0 2024-05-09T06:30:08.204 INFO:tasks.workunit.client.0.smithi062.stdout:0/904: write d1/d25/fa4 [1754119,121529] 0 2024-05-09T06:30:08.204 INFO:tasks.workunit.client.0.smithi062.stdout:0/905: chown d1/d25/d49/d42/dad 4024814 1 2024-05-09T06:30:08.204 INFO:tasks.workunit.client.0.smithi062.stdout:0/906: read - d1/d6a/d6d/f12b zero size 2024-05-09T06:30:08.206 INFO:tasks.workunit.client.0.smithi062.stdout:9/948: dwrite d3/d3e/d4b/d99/f100 [0,4194304] 0 2024-05-09T06:30:08.206 INFO:tasks.workunit.client.0.smithi062.stdout:9/949: readlink d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/l79 0 2024-05-09T06:30:08.208 INFO:tasks.workunit.client.0.smithi062.stdout:4/898: unlink d0/d2a/f1d 0 2024-05-09T06:30:08.214 INFO:tasks.workunit.client.0.smithi062.stdout:4/899: unlink d0/d2a/d1f/d103/d7e/fe9 0 2024-05-09T06:30:08.230 INFO:tasks.workunit.client.0.smithi062.stdout:9/950: dread d3/d3e/d52/d58/fb8 [0,4194304] 0 2024-05-09T06:30:08.230 INFO:tasks.workunit.client.0.smithi062.stdout:9/951: rename d3/d3e to d3/d3e/d52/d58/d77/d92/df3/d131 22 2024-05-09T06:30:08.232 INFO:tasks.workunit.client.0.smithi062.stdout:9/952: mknod d3/d3e/d52/d58/d1c/d1e/d60/c132 0 2024-05-09T06:30:08.232 INFO:tasks.workunit.client.0.smithi062.stdout:9/953: readlink d3/d3e/d52/d58/d77/l83 0 2024-05-09T06:30:08.232 INFO:tasks.workunit.client.0.smithi062.stdout:9/954: read d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/fe5 [81217,124508] 0 2024-05-09T06:30:08.232 INFO:tasks.workunit.client.0.smithi062.stdout:9/955: chown d3/d3e/d52/ce4 542158 1 2024-05-09T06:30:08.233 INFO:tasks.workunit.client.0.smithi062.stdout:9/956: write d3/d3e/d52/d58/d1c/d1e/d41/d64/fc1 [844105,54699] 0 2024-05-09T06:30:08.234 INFO:tasks.workunit.client.0.smithi062.stdout:9/957: fsync d3/d3e/d52/d58/fef 0 2024-05-09T06:30:08.234 INFO:tasks.workunit.client.0.smithi062.stdout:9/958: stat d3/d3e/d52/d58/d77 0 2024-05-09T06:30:08.237 INFO:tasks.workunit.client.0.smithi062.stdout:8/973: dwrite da/dea/d10a/f132 [0,4194304] 0 2024-05-09T06:30:08.237 INFO:tasks.workunit.client.0.smithi062.stdout:8/974: write da/dea/d2e/fca [1120060,65450] 0 2024-05-09T06:30:08.237 INFO:tasks.workunit.client.0.smithi062.stdout:8/975: chown da/dea/l97 18 1 2024-05-09T06:30:08.237 INFO:tasks.workunit.client.0.smithi062.stdout:7/897: dwrite d0/fdf [0,4194304] 0 2024-05-09T06:30:08.238 INFO:tasks.workunit.client.0.smithi062.stdout:3/748: dwrite d1/d1e/d36/d3a/d97/fdc [0,4194304] 0 2024-05-09T06:30:08.238 INFO:tasks.workunit.client.0.smithi062.stdout:2/866: dwrite d0/d9/dd/d65/d6d/d21/d29/d40/f75 [0,4194304] 0 2024-05-09T06:30:08.238 INFO:tasks.workunit.client.0.smithi062.stdout:2/867: creat d0/d9/dd/d65/d6d/f115 x:0 0 0 2024-05-09T06:30:08.238 INFO:tasks.workunit.client.0.smithi062.stdout:1/693: dwrite d8/d14/d2b/d3c/d44/d38/dbe/fcb [4194304,4194304] 0 2024-05-09T06:30:08.238 INFO:tasks.workunit.client.0.smithi062.stdout:1/694: write d8/d14/d2b/d3c/d44/fcc [771089,20309] 0 2024-05-09T06:30:08.240 INFO:tasks.workunit.client.0.smithi062.stdout:8/976: mknod da/dea/d2e/d7e/d83/c141 0 2024-05-09T06:30:08.245 INFO:tasks.workunit.client.0.smithi062.stdout:7/898: getdents d0/d3a/d51/d64/d6d/d80/d8e 0 2024-05-09T06:30:08.245 INFO:tasks.workunit.client.0.smithi062.stdout:7/899: truncate d0/d3a/d3f/fb5 437353 0 2024-05-09T06:30:08.249 INFO:tasks.workunit.client.0.smithi062.stdout:3/749: dread d1/d1e/f39 [0,4194304] 0 2024-05-09T06:30:08.250 INFO:tasks.workunit.client.0.smithi062.stdout:3/750: dread d1/d1e/d36/d3a/d4e/fe3 [0,4194304] 0 2024-05-09T06:30:08.250 INFO:tasks.workunit.client.0.smithi062.stdout:9/959: dwrite d3/d20/dc7/fd8 [0,4194304] 0 2024-05-09T06:30:08.251 INFO:tasks.workunit.client.0.smithi062.stdout:2/868: link d0/d9/d38/d41/d8a/dd2/l10e d0/d9/d38/d41/d94/l116 0 2024-05-09T06:30:08.253 INFO:tasks.workunit.client.0.smithi062.stdout:1/695: symlink d8/d14/d2b/d3c/d44/d6e/d7a/ldf 0 2024-05-09T06:30:08.255 INFO:tasks.workunit.client.0.smithi062.stdout:3/751: dread d1/d48/f50 [0,4194304] 0 2024-05-09T06:30:08.255 INFO:tasks.workunit.client.0.smithi062.stdout:3/752: fdatasync d1/d1e/d3b/fc4 0 2024-05-09T06:30:08.255 INFO:tasks.workunit.client.0.smithi062.stdout:3/753: fdatasync d1/d1e/d36/d3a/d4e/fe3 0 2024-05-09T06:30:08.256 INFO:tasks.workunit.client.0.smithi062.stdout:8/977: mknod da/d95/c142 0 2024-05-09T06:30:08.256 INFO:tasks.workunit.client.0.smithi062.stdout:8/978: write da/dea/d2e/d61/d92/da5/daf/fc0 [477714,57644] 0 2024-05-09T06:30:08.257 INFO:tasks.workunit.client.0.smithi062.stdout:7/900: mknod d0/d12/d33/d67/da7/dcd/c119 0 2024-05-09T06:30:08.257 INFO:tasks.workunit.client.0.smithi062.stdout:7/901: fsync d0/f6e 0 2024-05-09T06:30:08.260 INFO:tasks.workunit.client.0.smithi062.stdout:9/960: symlink d3/d20/dc7/dcd/dea/l133 0 2024-05-09T06:30:08.261 INFO:tasks.workunit.client.0.smithi062.stdout:2/869: getdents d0/d9/dd9/d93 0 2024-05-09T06:30:08.263 INFO:tasks.workunit.client.0.smithi062.stdout:1/696: creat d8/d14/d2b/d3c/d44/d6e/d98/fe0 x:0 0 0 2024-05-09T06:30:08.263 INFO:tasks.workunit.client.0.smithi062.stdout:1/697: chown d8/d1d/l81 2 1 2024-05-09T06:30:08.267 INFO:tasks.workunit.client.0.smithi062.stdout:3/754: creat d1/d1e/d36/d9f/d4f/dd2/dd3/ff9 x:0 0 0 2024-05-09T06:30:08.267 INFO:tasks.workunit.client.0.smithi062.stdout:3/755: truncate d1/d1e/d36/f49 896737 0 2024-05-09T06:30:08.267 INFO:tasks.workunit.client.0.smithi062.stdout:2/870: dread d0/d9/d38/d41/d48/f4c [0,4194304] 0 2024-05-09T06:30:08.269 INFO:tasks.workunit.client.0.smithi062.stdout:7/902: symlink d0/d3a/d51/d64/d6d/d88/dc7/dd7/l11a 0 2024-05-09T06:30:08.269 INFO:tasks.workunit.client.0.smithi062.stdout:9/961: write d3/d3e/d4b/da2/fbc [1588358,116938] 0 2024-05-09T06:30:08.271 INFO:tasks.workunit.client.0.smithi062.stdout:1/698: rename d8/f49 to d8/d14/d2b/d3c/fe1 0 2024-05-09T06:30:08.271 INFO:tasks.workunit.client.0.smithi062.stdout:1/699: stat d8/d14/d2b 0 2024-05-09T06:30:08.271 INFO:tasks.workunit.client.0.smithi062.stdout:1/700: write d8/fbb [901015,35761] 0 2024-05-09T06:30:08.271 INFO:tasks.workunit.client.0.smithi062.stdout:8/979: dwrite da/dea/f29 [0,4194304] 0 2024-05-09T06:30:08.275 INFO:tasks.workunit.client.0.smithi062.stdout:7/903: mkdir d0/d3a/d51/d64/d6d/dac/d11b 0 2024-05-09T06:30:08.281 INFO:tasks.workunit.client.0.smithi062.stdout:9/962: creat d3/d3e/d7c/f134 x:0 0 0 2024-05-09T06:30:08.284 INFO:tasks.workunit.client.0.smithi062.stdout:3/756: rename d1/f1f to d1/d1e/d3b/ffa 0 2024-05-09T06:30:08.285 INFO:tasks.workunit.client.0.smithi062.stdout:1/701: mknod d8/d14/d2b/d3c/d44/d6e/d7a/d80/ce2 0 2024-05-09T06:30:08.286 INFO:tasks.workunit.client.0.smithi062.stdout:8/980: creat da/d85/f143 x:0 0 0 2024-05-09T06:30:08.288 INFO:tasks.workunit.client.0.smithi062.stdout:2/871: link d0/d9/d38/fd7 d0/f117 0 2024-05-09T06:30:08.289 INFO:tasks.workunit.client.0.smithi062.stdout:8/981: dread da/dea/d2e/d7e/d12c/d9f/da7/fb7 [0,4194304] 0 2024-05-09T06:30:08.291 INFO:tasks.workunit.client.0.smithi062.stdout:9/963: symlink d3/d3e/d52/d58/d1c/d1e/d41/dde/l135 0 2024-05-09T06:30:08.297 INFO:tasks.workunit.client.0.smithi062.stdout:3/757: creat d1/d1e/d26/ddd/d52/d6a/da4/ffb x:0 0 0 2024-05-09T06:30:08.298 INFO:tasks.workunit.client.0.smithi062.stdout:1/702: creat d8/d14/d2b/d3c/d76/fe3 x:0 0 0 2024-05-09T06:30:08.299 INFO:tasks.workunit.client.0.smithi062.stdout:7/904: dwrite d0/d12/f24 [0,4194304] 0 2024-05-09T06:30:08.304 INFO:tasks.workunit.client.0.smithi062.stdout:2/872: read d0/d9/dd/d65/fb4 [421041,119764] 0 2024-05-09T06:30:08.316 INFO:tasks.workunit.client.0.smithi062.stdout:8/982: unlink da/d95/c142 0 2024-05-09T06:30:08.316 INFO:tasks.workunit.client.0.smithi062.stdout:8/983: dread - da/dea/d2e/d34/d115/f138 zero size 2024-05-09T06:30:08.317 INFO:tasks.workunit.client.0.smithi062.stdout:9/964: mknod d3/d3e/d52/d58/d1c/d1e/d41/d64/de2/c136 0 2024-05-09T06:30:08.318 INFO:tasks.workunit.client.0.smithi062.stdout:9/965: truncate d3/d20/ffe 803751 0 2024-05-09T06:30:08.320 INFO:tasks.workunit.client.0.smithi062.stdout:3/758: mkdir d1/d1e/d36/dfc 0 2024-05-09T06:30:08.322 INFO:tasks.workunit.client.0.smithi062.stdout:1/703: mkdir d8/d14/d2b/de4 0 2024-05-09T06:30:08.323 INFO:tasks.workunit.client.0.smithi062.stdout:8/984: read f8 [3061320,16207] 0 2024-05-09T06:30:08.324 INFO:tasks.workunit.client.0.smithi062.stdout:7/905: rmdir d0/d12/d33/d9f 39 2024-05-09T06:30:08.326 INFO:tasks.workunit.client.0.smithi062.stdout:3/759: dread d1/d48/f57 [0,4194304] 0 2024-05-09T06:30:08.328 INFO:tasks.workunit.client.0.smithi062.stdout:2/873: symlink d0/d9/d38/l118 0 2024-05-09T06:30:08.328 INFO:tasks.workunit.client.0.smithi062.stdout:2/874: chown d0/d9/d38/f60 1006607 1 2024-05-09T06:30:08.328 INFO:tasks.workunit.client.0.smithi062.stdout:1/704: dread d8/d14/d2b/d3d/f90 [0,4194304] 0 2024-05-09T06:30:08.328 INFO:tasks.workunit.client.0.smithi062.stdout:1/705: chown d8/d14/d2b/cb3 1 1 2024-05-09T06:30:08.328 INFO:tasks.workunit.client.0.smithi062.stdout:1/706: truncate d8/d14/d2b/d3c/f4e 574664 0 2024-05-09T06:30:08.329 INFO:tasks.workunit.client.0.smithi062.stdout:1/707: chown d8/d1d/d91/ccd 100292 1 2024-05-09T06:30:08.329 INFO:tasks.workunit.client.0.smithi062.stdout:2/875: write d0/d9/d38/d41/db1/f9d [951715,34956] 0 2024-05-09T06:30:08.329 INFO:tasks.workunit.client.0.smithi062.stdout:1/708: stat d8/d1d/d91/f85 0 2024-05-09T06:30:08.329 INFO:tasks.workunit.client.0.smithi062.stdout:2/876: creat d0/d9/d38/f119 x:0 0 0 2024-05-09T06:30:08.329 INFO:tasks.workunit.client.0.smithi062.stdout:9/966: getdents d3/d3e/d52/d58/d1c/d1e/d41/d64 0 2024-05-09T06:30:08.331 INFO:tasks.workunit.client.0.smithi062.stdout:8/985: rename da/dea/d2e/l30 to da/l144 0 2024-05-09T06:30:08.333 INFO:tasks.workunit.client.0.smithi062.stdout:3/760: creat d1/d1e/d26/df3/ffd x:0 0 0 2024-05-09T06:30:08.333 INFO:tasks.workunit.client.0.smithi062.stdout:3/761: chown d1/d1e/d36/d4a/lec 5037 1 2024-05-09T06:30:08.335 INFO:tasks.workunit.client.0.smithi062.stdout:1/709: truncate d8/d14/d2b/d3c/d44/f3a 1017777 0 2024-05-09T06:30:08.336 INFO:tasks.workunit.client.0.smithi062.stdout:1/710: dread d8/f89 [0,4194304] 0 2024-05-09T06:30:08.337 INFO:tasks.workunit.client.0.smithi062.stdout:1/711: dread - d8/d1d/fa4 zero size 2024-05-09T06:30:08.337 INFO:tasks.workunit.client.0.smithi062.stdout:1/712: chown d8/d14/f1b 151217 1 2024-05-09T06:30:08.338 INFO:tasks.workunit.client.0.smithi062.stdout:2/877: symlink d0/d9/d38/d41/l11a 0 2024-05-09T06:30:08.339 INFO:tasks.workunit.client.0.smithi062.stdout:7/906: mkdir d0/d3a/d51/d64/d6d/d88/d11c 0 2024-05-09T06:30:08.339 INFO:tasks.workunit.client.0.smithi062.stdout:7/907: dread - d0/d12/d33/d67/f6b zero size 2024-05-09T06:30:08.339 INFO:tasks.workunit.client.0.smithi062.stdout:7/908: write d0/d3a/f91 [56487,38146] 0 2024-05-09T06:30:08.344 INFO:tasks.workunit.client.0.smithi062.stdout:8/986: dread da/dea/d2e/d34/f7b [0,4194304] 0 2024-05-09T06:30:08.345 INFO:tasks.workunit.client.0.smithi062.stdout:1/713: link d8/d14/d2b/d3c/d44/d64/f83 d8/d14/d2b/d3c/d44/d6e/d98/dc0/fe5 0 2024-05-09T06:30:08.346 INFO:tasks.workunit.client.0.smithi062.stdout:3/762: write d1/d1e/d26/ddd/fa7 [3494012,23839] 0 2024-05-09T06:30:08.346 INFO:tasks.workunit.client.0.smithi062.stdout:3/763: chown d1/d1e/d36/d3a/d4e/fe3 7219 1 2024-05-09T06:30:08.347 INFO:tasks.workunit.client.0.smithi062.stdout:3/764: chown d1/d1e/fbe 0 1 2024-05-09T06:30:08.347 INFO:tasks.workunit.client.0.smithi062.stdout:1/714: dread d8/f89 [0,4194304] 0 2024-05-09T06:30:08.347 INFO:tasks.workunit.client.0.smithi062.stdout:1/715: dread - d8/d1d/d70/fbd zero size 2024-05-09T06:30:08.350 INFO:tasks.workunit.client.0.smithi062.stdout:8/987: rename da/dea/d1c/de0/lff to da/df0/dfd/l145 0 2024-05-09T06:30:08.350 INFO:tasks.workunit.client.0.smithi062.stdout:8/988: truncate da/dea/d2e/d34/d115/f138 46328 0 2024-05-09T06:30:08.352 INFO:tasks.workunit.client.0.smithi062.stdout:1/716: symlink d8/d14/d2b/d3c/d76/le6 0 2024-05-09T06:30:08.352 INFO:tasks.workunit.client.0.smithi062.stdout:1/717: write d8/d1d/f26 [1098979,127925] 0 2024-05-09T06:30:08.353 INFO:tasks.workunit.client.0.smithi062.stdout:7/909: symlink d0/l11d 0 2024-05-09T06:30:08.353 INFO:tasks.workunit.client.0.smithi062.stdout:9/967: dwrite d3/d3e/d52/d58/d1c/d1e/ff8 [0,4194304] 0 2024-05-09T06:30:08.353 INFO:tasks.workunit.client.0.smithi062.stdout:8/989: mkdir da/d95/d130/d136/d146 0 2024-05-09T06:30:08.353 INFO:tasks.workunit.client.0.smithi062.stdout:8/990: chown da/dea/d1c/f9a 3050 1 2024-05-09T06:30:08.355 INFO:tasks.workunit.client.0.smithi062.stdout:3/765: getdents d1/d1e/d26 0 2024-05-09T06:30:08.355 INFO:tasks.workunit.client.0.smithi062.stdout:3/766: write d1/d1e/d26/f84 [868634,71226] 0 2024-05-09T06:30:08.356 INFO:tasks.workunit.client.0.smithi062.stdout:1/718: mkdir d8/d1d/d9c/d41/de7 0 2024-05-09T06:30:08.357 INFO:tasks.workunit.client.0.smithi062.stdout:7/910: symlink d0/d3a/d51/d64/d6d/d88/dc7/l11e 0 2024-05-09T06:30:08.358 INFO:tasks.workunit.client.0.smithi062.stdout:3/767: write d1/d48/f57 [276002,91129] 0 2024-05-09T06:30:08.358 INFO:tasks.workunit.client.0.smithi062.stdout:7/911: chown d0/da8/fe2 11266 1 2024-05-09T06:30:08.361 INFO:tasks.workunit.client.0.smithi062.stdout:9/968: rename d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/f78 to d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/dc4/f137 0 2024-05-09T06:30:08.364 INFO:tasks.workunit.client.0.smithi062.stdout:3/768: truncate d1/d1e/f1d 669258 0 2024-05-09T06:30:08.364 INFO:tasks.workunit.client.0.smithi062.stdout:3/769: write d1/d1e/d26/ddd/d92/fb2 [5023714,108535] 0 2024-05-09T06:30:08.367 INFO:tasks.workunit.client.0.smithi062.stdout:3/770: link d1/d1e/d26/f29 d1/d1e/d26/ddd/d52/d6a/da4/db3/ffe 0 2024-05-09T06:30:08.368 INFO:tasks.workunit.client.0.smithi062.stdout:2/878: getdents d0/d9/d38 0 2024-05-09T06:30:08.368 INFO:tasks.workunit.client.0.smithi062.stdout:2/879: chown d0/d9/d17/d89/c9c 204 1 2024-05-09T06:30:08.369 INFO:tasks.workunit.client.0.smithi062.stdout:8/991: dread da/dea/f26 [0,4194304] 0 2024-05-09T06:30:08.370 INFO:tasks.workunit.client.0.smithi062.stdout:9/969: dread d3/d3e/d52/d58/d1c/f6a [0,4194304] 0 2024-05-09T06:30:08.374 INFO:tasks.workunit.client.0.smithi062.stdout:3/771: rename d1/d1e/d26/ddd/d92/l38 to d1/d1e/d26/ddd/ddf/lff 0 2024-05-09T06:30:08.374 INFO:tasks.workunit.client.0.smithi062.stdout:3/772: stat d1/d1e/cdb 0 2024-05-09T06:30:08.375 INFO:tasks.workunit.client.0.smithi062.stdout:2/880: creat d0/d9/d38/dd6/dbd/d112/f11b x:0 0 0 2024-05-09T06:30:08.379 INFO:tasks.workunit.client.0.smithi062.stdout:2/881: mkdir d0/d9/d38/d41/d48/df9/d11c 0 2024-05-09T06:30:08.380 INFO:tasks.workunit.client.0.smithi062.stdout:8/992: truncate da/dea/d2e/f91 1270254 0 2024-05-09T06:30:08.380 INFO:tasks.workunit.client.0.smithi062.stdout:8/993: creat da/dea/d2e/d7e/d12c/d9f/da7/f147 x:0 0 0 2024-05-09T06:30:08.381 INFO:tasks.workunit.client.0.smithi062.stdout:9/970: getdents d3/d3e/d7c 0 2024-05-09T06:30:08.382 INFO:tasks.workunit.client.0.smithi062.stdout:2/882: mkdir d0/d90/db7/d11d 0 2024-05-09T06:30:08.382 INFO:tasks.workunit.client.0.smithi062.stdout:2/883: chown d0/d90/db7/d11d 0 1 2024-05-09T06:30:08.382 INFO:tasks.workunit.client.0.smithi062.stdout:2/884: creat d0/d9/d38/d41/de1/f11e x:0 0 0 2024-05-09T06:30:08.383 INFO:tasks.workunit.client.0.smithi062.stdout:2/885: chown d0/c11 3 1 2024-05-09T06:30:08.383 INFO:tasks.workunit.client.0.smithi062.stdout:1/719: dwrite d8/d14/d2b/d3c/d44/d7f/fa8 [0,4194304] 0 2024-05-09T06:30:08.387 INFO:tasks.workunit.client.0.smithi062.stdout:8/994: mknod da/dea/d2e/d34/dd4/d129/c148 0 2024-05-09T06:30:08.389 INFO:tasks.workunit.client.0.smithi062.stdout:3/773: dread d1/d1e/f10 [4194304,4194304] 0 2024-05-09T06:30:08.389 INFO:tasks.workunit.client.0.smithi062.stdout:3/774: chown d1/d1e/f39 63 1 2024-05-09T06:30:08.393 INFO:tasks.workunit.client.0.smithi062.stdout:8/995: dread da/dea/d1c/fb0 [0,4194304] 0 2024-05-09T06:30:08.394 INFO:tasks.workunit.client.0.smithi062.stdout:7/912: dwrite d0/d3/f2b [0,4194304] 0 2024-05-09T06:30:08.394 INFO:tasks.workunit.client.0.smithi062.stdout:8/996: creat da/dea/d2e/d61/f149 x:0 0 0 2024-05-09T06:30:08.394 INFO:tasks.workunit.client.0.smithi062.stdout:8/997: dread - da/dea/f125 zero size 2024-05-09T06:30:08.394 INFO:tasks.workunit.client.0.smithi062.stdout:8/998: fsync da/dea/d1c/ff4 0 2024-05-09T06:30:08.397 INFO:tasks.workunit.client.0.smithi062.stdout:1/720: rmdir d8/d1d/d9c/d41/de7 0 2024-05-09T06:30:08.406 INFO:tasks.workunit.client.0.smithi062.stdout:7/913: write d0/d12/fe5 [3824386,37702] 0 2024-05-09T06:30:08.411 INFO:tasks.workunit.client.0.smithi062.stdout:8/999: mknod da/dea/d2e/d7e/d12c/d9f/db8/c14a 0 2024-05-09T06:30:08.412 INFO:tasks.workunit.client.0.smithi062.stdout:7/914: mknod d0/d3a/d69/d110/c11f 0 2024-05-09T06:30:08.414 INFO:tasks.workunit.client.0.smithi062.stdout:9/971: dwrite d3/d3e/d52/d58/d1c/d1e/d60/f106 [0,4194304] 0 2024-05-09T06:30:08.415 INFO:tasks.workunit.client.0.smithi062.stdout:2/886: dwrite d0/d9/dd/d65/d6d/d21/f55 [0,4194304] 0 2024-05-09T06:30:08.415 INFO:tasks.workunit.client.0.smithi062.stdout:2/887: chown d0/d9/d38/laa 64079634 1 2024-05-09T06:30:08.415 INFO:tasks.workunit.client.0.smithi062.stdout:2/888: dread - d0/d9/fc5 zero size 2024-05-09T06:30:08.416 INFO:tasks.workunit.client.0.smithi062.stdout:9/972: symlink d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/d124/l138 0 2024-05-09T06:30:08.418 INFO:tasks.workunit.client.0.smithi062.stdout:2/889: mknod d0/d9/dd/d65/d6d/d21/d29/d106/c11f 0 2024-05-09T06:30:08.418 INFO:tasks.workunit.client.0.smithi062.stdout:3/775: dwrite d1/d1e/d36/d9f/d4f/fd7 [0,4194304] 0 2024-05-09T06:30:08.423 INFO:tasks.workunit.client.0.smithi062.stdout:3/776: symlink d1/d1e/d26/ddd/ddf/l100 0 2024-05-09T06:30:08.425 INFO:tasks.workunit.client.0.smithi062.stdout:7/915: dread d0/d3a/d51/d64/d6d/d80/dd8/fe0 [0,4194304] 0 2024-05-09T06:30:08.426 INFO:tasks.workunit.client.0.smithi062.stdout:3/777: mknod d1/d1e/d54/c101 0 2024-05-09T06:30:08.430 INFO:tasks.workunit.client.0.smithi062.stdout:3/778: rename d1/d48 to d1/d1e/d3b/d83/da5/d102 0 2024-05-09T06:30:08.431 INFO:tasks.workunit.client.0.smithi062.stdout:3/779: fsync d1/d1e/d3b/ffa 0 2024-05-09T06:30:08.432 INFO:tasks.workunit.client.0.smithi062.stdout:7/916: link d0/d3a/d51/d64/d6d/d88/f8a d0/d3/d10d/f120 0 2024-05-09T06:30:08.434 INFO:tasks.workunit.client.0.smithi062.stdout:3/780: getdents d1/d1e/d36/d3a/d4e 0 2024-05-09T06:30:08.434 INFO:tasks.workunit.client.0.smithi062.stdout:3/781: truncate d1/d1e/d36/d9f/d4f/f96 1465557 0 2024-05-09T06:30:08.437 INFO:tasks.workunit.client.0.smithi062.stdout:9/973: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/de2/f122 [0,4194304] 0 2024-05-09T06:30:08.437 INFO:tasks.workunit.client.0.smithi062.stdout:7/917: creat d0/d3a/d51/d64/d6d/f121 x:0 0 0 2024-05-09T06:30:08.439 INFO:tasks.workunit.client.0.smithi062.stdout:3/782: creat d1/d1e/d26/ddd/d92/f103 x:0 0 0 2024-05-09T06:30:08.443 INFO:tasks.workunit.client.0.smithi062.stdout:4/900: sync 2024-05-09T06:30:08.443 INFO:tasks.workunit.client.0.smithi062.stdout:0/907: sync 2024-05-09T06:30:08.443 INFO:tasks.workunit.client.0.smithi062.stdout:0/908: write d1/f2a [1990063,89208] 0 2024-05-09T06:30:08.444 INFO:tasks.workunit.client.0.smithi062.stdout:9/974: creat d3/d20/dc7/dcd/f139 x:0 0 0 2024-05-09T06:30:08.445 INFO:tasks.workunit.client.0.smithi062.stdout:7/918: mknod d0/d3a/d51/d64/d6d/d80/dd8/c122 0 2024-05-09T06:30:08.446 INFO:tasks.workunit.client.0.smithi062.stdout:9/975: dread d3/d3e/d52/d58/d1c/fbf [0,4194304] 0 2024-05-09T06:30:08.446 INFO:tasks.workunit.client.0.smithi062.stdout:9/976: creat d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/f13a x:0 0 0 2024-05-09T06:30:08.448 INFO:tasks.workunit.client.0.smithi062.stdout:4/901: symlink d0/d2a/d8/d69/daf/d10f/l114 0 2024-05-09T06:30:08.448 INFO:tasks.workunit.client.0.smithi062.stdout:4/902: write d0/d3c/f88 [350671,12323] 0 2024-05-09T06:30:08.451 INFO:tasks.workunit.client.0.smithi062.stdout:0/909: creat d1/d25/d31/d6c/df5/f137 x:0 0 0 2024-05-09T06:30:08.451 INFO:tasks.workunit.client.0.smithi062.stdout:0/910: fdatasync d1/d25/d31/d6c/d44/f63 0 2024-05-09T06:30:08.454 INFO:tasks.workunit.client.0.smithi062.stdout:7/919: symlink d0/d3a/d51/d64/d6d/d88/dc7/d117/l123 0 2024-05-09T06:30:08.457 INFO:tasks.workunit.client.0.smithi062.stdout:9/977: symlink d3/d3e/d52/d58/d1c/d1e/d41/d64/d31/l13b 0 2024-05-09T06:30:08.458 INFO:tasks.workunit.client.0.smithi062.stdout:4/903: truncate d0/d2a/d1f/d103/d7e/d8e/d9e/d28/f71 3858055 0 2024-05-09T06:30:08.458 INFO:tasks.workunit.client.0.smithi062.stdout:4/904: stat d0/d2a/d1f/d103/d7e/d8e/d9e/f16 0 2024-05-09T06:30:08.462 INFO:tasks.workunit.client.0.smithi062.stdout:0/911: stat d1/d25/d31/d6c/c3e 0 2024-05-09T06:30:08.462 INFO:tasks.workunit.client.0.smithi062.stdout:7/920: mkdir d0/d12/d33/d67/da7/d124 0 2024-05-09T06:30:08.468 INFO:tasks.workunit.client.0.smithi062.stdout:4/905: creat d0/d3c/dae/db0/f115 x:0 0 0 2024-05-09T06:30:08.470 INFO:tasks.workunit.client.0.smithi062.stdout:0/912: unlink d1/d6a/d6d/la8 0 2024-05-09T06:30:08.472 INFO:tasks.workunit.client.0.smithi062.stdout:7/921: mkdir d0/d3a/d51/d64/d6d/dac/d11b/d125 0 2024-05-09T06:30:08.475 INFO:tasks.workunit.client.0.smithi062.stdout:7/922: symlink d0/d3a/d51/d64/d6d/d80/dd8/l126 0 2024-05-09T06:30:08.514 INFO:tasks.workunit.client.0.smithi062.stdout:4/906: dwrite d0/d2a/d1f/d103/d7e/d8e/d9e/d86/fc3 [0,4194304] 0 2024-05-09T06:30:08.515 INFO:tasks.workunit.client.0.smithi062.stdout:9/978: dwrite d3/d3e/d52/d58/d1c/d1e/fa3 [0,4194304] 0 2024-05-09T06:30:08.516 INFO:tasks.workunit.client.0.smithi062.stdout:0/913: dwrite d1/d25/d49/d42/d43/d54/d9d/fab [0,4194304] 0 2024-05-09T06:30:08.516 INFO:tasks.workunit.client.0.smithi062.stdout:0/914: chown d1/d25/d31/d6c/d44/f118 0 1 2024-05-09T06:30:08.516 INFO:tasks.workunit.client.0.smithi062.stdout:7/923: dwrite d0/d12/d66/faa [0,4194304] 0 2024-05-09T06:30:08.520 INFO:tasks.workunit.client.0.smithi062.stdout:0/915: truncate d1/d25/d49/d4f/d52/d87/f70 2979070 0 2024-05-09T06:30:08.520 INFO:tasks.workunit.client.0.smithi062.stdout:7/924: creat d0/d3a/d3f/dab/d112/f127 x:0 0 0 2024-05-09T06:30:08.523 INFO:tasks.workunit.client.0.smithi062.stdout:4/907: dread d0/d2a/d1f/d103/d4f/d6b/ddc/fc2 [0,4194304] 0 2024-05-09T06:30:08.524 INFO:tasks.workunit.client.0.smithi062.stdout:0/916: mkdir d1/d25/d31/d138 0 2024-05-09T06:30:08.526 INFO:tasks.workunit.client.0.smithi062.stdout:7/925: truncate d0/d12/d33/d67/f7e 362162 0 2024-05-09T06:30:08.526 INFO:tasks.workunit.client.0.smithi062.stdout:7/926: chown d0/d3a/d51/d64/d6d/dac 151107 1 2024-05-09T06:30:08.527 INFO:tasks.workunit.client.0.smithi062.stdout:4/908: rmdir d0/d2a/d1f/d103/d4f/d6b/dca 39 2024-05-09T06:30:08.530 INFO:tasks.workunit.client.0.smithi062.stdout:0/917: link d1/d25/d31/d6c/d44/d57/d75/cfe d1/d6a/d6d/d93/d94/dc7/c139 0 2024-05-09T06:30:08.532 INFO:tasks.workunit.client.0.smithi062.stdout:7/927: creat d0/f128 x:0 0 0 2024-05-09T06:30:08.533 INFO:tasks.workunit.client.0.smithi062.stdout:4/909: mknod d0/d2a/d8/df1/c116 0 2024-05-09T06:30:08.533 INFO:tasks.workunit.client.0.smithi062.stdout:4/910: dread - d0/d5b/d85/f100 zero size 2024-05-09T06:30:08.534 INFO:tasks.workunit.client.0.smithi062.stdout:0/918: creat d1/d25/d49/d4f/d119/f13a x:0 0 0 2024-05-09T06:30:08.537 INFO:tasks.workunit.client.0.smithi062.stdout:4/911: symlink d0/d2a/d1f/dc9/da0/l117 0 2024-05-09T06:30:08.537 INFO:tasks.workunit.client.0.smithi062.stdout:4/912: truncate d0/f46 5133634 0 2024-05-09T06:30:08.537 INFO:tasks.workunit.client.0.smithi062.stdout:4/913: chown d0/d3c/ca2 0 1 2024-05-09T06:30:08.537 INFO:tasks.workunit.client.0.smithi062.stdout:4/914: chown d0/d2a/d1f/dc9 1534 1 2024-05-09T06:30:08.539 INFO:tasks.workunit.client.0.smithi062.stdout:0/919: creat d1/d25/d49/d7e/da6/f13b x:0 0 0 2024-05-09T06:30:08.548 INFO:tasks.workunit.client.0.smithi062.stdout:4/915: dread d0/d2a/d1f/d103/d4f/d6b/dca/fed [0,4194304] 0 2024-05-09T06:30:08.548 INFO:tasks.workunit.client.0.smithi062.stdout:4/916: chown d0/d2a/d1f/d103/d4f/d6b/dca/fed 0 1 2024-05-09T06:30:08.549 INFO:tasks.workunit.client.0.smithi062.stdout:7/928: dwrite d0/d3a/f91 [0,4194304] 0 2024-05-09T06:30:08.550 INFO:tasks.workunit.client.0.smithi062.stdout:4/917: creat d0/d2a/d1f/d103/d4f/d6b/ddd/f118 x:0 0 0 2024-05-09T06:30:08.550 INFO:tasks.workunit.client.0.smithi062.stdout:4/918: write d0/d5b/d85/f100 [422333,44398] 0 2024-05-09T06:30:08.556 INFO:tasks.workunit.client.0.smithi062.stdout:7/929: link d0/d3a/d51/c53 d0/d3a/d51/d64/c129 0 2024-05-09T06:30:08.556 INFO:tasks.workunit.client.0.smithi062.stdout:7/930: write d0/d3a/d51/d64/d6d/fd0 [1534367,15717] 0 2024-05-09T06:30:08.556 INFO:tasks.workunit.client.0.smithi062.stdout:7/931: fdatasync d0/d12/f99 0 2024-05-09T06:30:08.557 INFO:tasks.workunit.client.0.smithi062.stdout:7/932: creat d0/d3a/d3f/dab/f12a x:0 0 0 2024-05-09T06:30:08.558 INFO:tasks.workunit.client.0.smithi062.stdout:7/933: truncate d0/f5c 2801979 0 2024-05-09T06:30:08.558 INFO:tasks.workunit.client.0.smithi062.stdout:0/920: dwrite d1/d25/d49/d4f/de6/faf [0,4194304] 0 2024-05-09T06:30:08.558 INFO:tasks.workunit.client.0.smithi062.stdout:0/921: truncate d1/d6a/d6d/d93/fde 1129975 0 2024-05-09T06:30:08.568 INFO:tasks.workunit.client.0.smithi062.stdout:4/919: dwrite d0/d2a/d1f/dc9/f79 [0,4194304] 0 2024-05-09T06:30:08.571 INFO:tasks.workunit.client.0.smithi062.stdout:4/920: mkdir d0/d2a/d1f/d103/d7e/d8e/d9e/d28/d119 0 2024-05-09T06:30:08.571 INFO:tasks.workunit.client.0.smithi062.stdout:4/921: dread - d0/d2a/d1f/d103/d4f/d6b/ddd/f118 zero size 2024-05-09T06:30:08.572 INFO:tasks.workunit.client.0.smithi062.stdout:4/922: creat d0/d2a/d1f/d103/d7e/d8e/d9e/f11a x:0 0 0 2024-05-09T06:30:08.573 INFO:tasks.workunit.client.0.smithi062.stdout:4/923: mkdir d0/d2a/d1f/dc9/da0/d11b 0 2024-05-09T06:30:08.590 INFO:tasks.workunit.client.0.smithi062.stdout:7/934: dwrite d0/d3a/f78 [4194304,4194304] 0 2024-05-09T06:30:08.612 INFO:tasks.workunit.client.0.smithi062.stdout:0/922: dwrite d1/d25/d49/d4f/f101 [0,4194304] 0 2024-05-09T06:30:08.612 INFO:tasks.workunit.client.0.smithi062.stdout:4/924: dwrite d0/d3c/dae/db0/dbc/f96 [0,4194304] 0 2024-05-09T06:30:08.636 INFO:tasks.workunit.client.0.smithi062.stdout:4/925: rename d0/d2a/d1f/f107 to d0/d9/de8/d109/f11c 0 2024-05-09T06:30:08.655 INFO:tasks.workunit.client.0.smithi062.stdout:7/935: creat d0/d3a/d51/d64/d6d/d88/d111/f12b x:0 0 0 2024-05-09T06:30:08.661 INFO:tasks.workunit.client.0.smithi062.stdout:0/923: rename d1/d25/d49/d42/d43/f7d to d1/d25/d49/d4f/d52/d87/dc8/d12e/f13c 0 2024-05-09T06:30:08.665 INFO:tasks.workunit.client.0.smithi062.stdout:4/926: creat d0/d2a/d8/d69/f11d x:0 0 0 2024-05-09T06:30:08.665 INFO:tasks.workunit.client.0.smithi062.stdout:4/927: creat d0/d9/dd1/f11e x:0 0 0 2024-05-09T06:30:08.667 INFO:tasks.workunit.client.0.smithi062.stdout:7/936: creat d0/d3a/d51/d64/d6d/d88/dc7/d117/f12c x:0 0 0 2024-05-09T06:30:08.669 INFO:tasks.workunit.client.0.smithi062.stdout:0/924: dread d1/f14 [0,4194304] 0 2024-05-09T06:30:08.671 INFO:tasks.workunit.client.0.smithi062.stdout:4/928: rename d0/f7f to d0/d5b/dc5/d10c/f11f 0 2024-05-09T06:30:08.672 INFO:tasks.workunit.client.0.smithi062.stdout:7/937: link d0/d3/l9a d0/d3a/d51/d64/d6d/dac/l12d 0 2024-05-09T06:30:08.672 INFO:tasks.workunit.client.0.smithi062.stdout:7/938: chown d0/f8d 15388962 1 2024-05-09T06:30:08.674 INFO:tasks.workunit.client.0.smithi062.stdout:4/929: link d0/d2a/d1f/d103/d4f/d6b/ddd/f118 d0/d9/de8/d109/f120 0 2024-05-09T06:30:08.675 INFO:tasks.workunit.client.0.smithi062.stdout:7/939: rmdir d0/d3a/d51/d64/d6d/dac/de7/df1 39 2024-05-09T06:30:08.676 INFO:tasks.workunit.client.0.smithi062.stdout:4/930: symlink d0/d9/de8/d109/l121 0 2024-05-09T06:30:08.677 INFO:tasks.workunit.client.0.smithi062.stdout:7/940: truncate d0/d3/f2b 2420771 0 2024-05-09T06:30:08.677 INFO:tasks.workunit.client.0.smithi062.stdout:7/941: dread - d0/d12/d33/d67/f7d zero size 2024-05-09T06:30:08.678 INFO:tasks.workunit.client.0.smithi062.stdout:4/931: rename d0/d3c/dae/ffa to d0/d2a/d1f/dd5/f122 0 2024-05-09T06:30:08.680 INFO:tasks.workunit.client.0.smithi062.stdout:7/942: link d0/d12/c4a d0/d3a/d51/d64/d6d/d88/d11c/c12e 0 2024-05-09T06:30:08.682 INFO:tasks.workunit.client.0.smithi062.stdout:4/932: unlink d0/d2a/d1f/d6c/f95 0 2024-05-09T06:30:08.682 INFO:tasks.workunit.client.0.smithi062.stdout:4/933: write d0/d9/de8/d109/f120 [140774,87695] 0 2024-05-09T06:30:08.682 INFO:tasks.workunit.client.0.smithi062.stdout:4/934: read d0/d2a/f36 [194648,9020] 0 2024-05-09T06:30:08.687 INFO:tasks.workunit.client.0.smithi062.stdout:0/925: dwrite d1/d25/d31/d6c/d44/d57/db4/fc0 [0,4194304] 0 2024-05-09T06:30:08.689 INFO:tasks.workunit.client.0.smithi062.stdout:4/935: symlink d0/d3c/dae/db0/l123 0 2024-05-09T06:30:08.689 INFO:tasks.workunit.client.0.smithi062.stdout:4/936: readlink d0/d9/l9d 0 2024-05-09T06:30:08.697 INFO:tasks.workunit.client.0.smithi062.stdout:7/943: dwrite d0/f77 [0,4194304] 0 2024-05-09T06:30:08.697 INFO:tasks.workunit.client.0.smithi062.stdout:0/926: creat d1/d25/d49/d42/dad/dbe/f13d x:0 0 0 2024-05-09T06:30:08.698 INFO:tasks.workunit.client.0.smithi062.stdout:0/927: chown d1/d25/d31/d6c/d44/d57/d75/ff1 1655 1 2024-05-09T06:30:08.698 INFO:tasks.workunit.client.0.smithi062.stdout:0/928: write d1/d25/d31/d6c/d44/fc5 [365294,28074] 0 2024-05-09T06:30:08.701 INFO:tasks.workunit.client.0.smithi062.stdout:0/929: mkdir d1/d6a/d6d/d93/d94/dc7/d13e 0 2024-05-09T06:30:08.702 INFO:tasks.workunit.client.0.smithi062.stdout:4/937: dread d0/d3c/f5e [0,4194304] 0 2024-05-09T06:30:08.702 INFO:tasks.workunit.client.0.smithi062.stdout:4/938: write d0/d3c/da1/f10d [613702,33813] 0 2024-05-09T06:30:08.702 INFO:tasks.workunit.client.0.smithi062.stdout:4/939: chown d0/d2a/d1f/d103/d7e/d8e/d9e/d86 1 1 2024-05-09T06:30:08.702 INFO:tasks.workunit.client.0.smithi062.stdout:4/940: write d0/d2a/d1f/dd5/f122 [987619,49443] 0 2024-05-09T06:30:08.702 INFO:tasks.workunit.client.0.smithi062.stdout:4/941: fsync d0/d2a/d1f/d103/d4f/f60 0 2024-05-09T06:30:08.702 INFO:tasks.workunit.client.0.smithi062.stdout:4/942: readlink d0/d3c/da1/ldf 0 2024-05-09T06:30:08.704 INFO:tasks.workunit.client.0.smithi062.stdout:0/930: link d1/f2c d1/d25/d49/d42/dad/dbe/f13f 0 2024-05-09T06:30:08.705 INFO:tasks.workunit.client.0.smithi062.stdout:7/944: dread d0/f20 [4194304,4194304] 0 2024-05-09T06:30:08.705 INFO:tasks.workunit.client.0.smithi062.stdout:4/943: mknod d0/d2a/d1f/dd5/c124 0 2024-05-09T06:30:08.707 INFO:tasks.workunit.client.0.smithi062.stdout:0/931: rename d1/d25/d31/d6c/cee to d1/d25/d49/d4f/d52/d7b/c140 0 2024-05-09T06:30:08.708 INFO:tasks.workunit.client.0.smithi062.stdout:7/945: mkdir d0/d12/d33/d9f/d12f 0 2024-05-09T06:30:08.729 INFO:tasks.workunit.client.0.smithi062.stdout:7/946: dwrite d0/d3a/d3f/dab/d112/f127 [0,4194304] 0 2024-05-09T06:30:08.729 INFO:tasks.workunit.client.0.smithi062.stdout:4/944: dwrite d0/d3c/dae/db0/dbc/f39 [0,4194304] 0 2024-05-09T06:30:08.731 INFO:tasks.workunit.client.0.smithi062.stdout:7/947: read d0/d3a/d3f/f5a [26062,17078] 0 2024-05-09T06:30:08.731 INFO:tasks.workunit.client.0.smithi062.stdout:4/945: symlink d0/d2a/d1f/d103/d7e/d8e/d9e/d86/d94/l125 0 2024-05-09T06:30:08.733 INFO:tasks.workunit.client.0.smithi062.stdout:7/948: symlink d0/d3a/d51/d64/d6d/dac/d11b/d125/l130 0 2024-05-09T06:30:08.733 INFO:tasks.workunit.client.0.smithi062.stdout:7/949: stat d0/d12/c41 0 2024-05-09T06:30:08.736 INFO:tasks.workunit.client.0.smithi062.stdout:7/950: chown d0/d3a/d51/d64/l68 14370760 1 2024-05-09T06:30:08.736 INFO:tasks.workunit.client.0.smithi062.stdout:7/951: dread - d0/d12/d33/d9f/fc5 zero size 2024-05-09T06:30:08.736 INFO:tasks.workunit.client.0.smithi062.stdout:7/952: chown d0/d3a/d3f/dab/d112/f127 2160887 1 2024-05-09T06:30:08.736 INFO:tasks.workunit.client.0.smithi062.stdout:7/953: stat d0/f1e 0 2024-05-09T06:30:08.736 INFO:tasks.workunit.client.0.smithi062.stdout:7/954: creat d0/d3a/d51/d64/d6d/d88/d111/f131 x:0 0 0 2024-05-09T06:30:08.736 INFO:tasks.workunit.client.0.smithi062.stdout:7/955: chown d0/d3a/d69/l85 1 1 2024-05-09T06:30:08.738 INFO:tasks.workunit.client.0.smithi062.stdout:7/956: mknod d0/d3a/d51/d64/d6d/d88/d11c/c132 0 2024-05-09T06:30:08.739 INFO:tasks.workunit.client.0.smithi062.stdout:4/946: dread d0/d2a/d1f/d103/d7e/d8e/d9e/d28/f41 [0,4194304] 0 2024-05-09T06:30:08.739 INFO:tasks.workunit.client.0.smithi062.stdout:4/947: write d0/d2a/d1f/d103/d7e/f7c [1781548,56694] 0 2024-05-09T06:30:08.739 INFO:tasks.workunit.client.0.smithi062.stdout:4/948: write d0/d3c/da1/feb [393043,8331] 0 2024-05-09T06:30:08.740 INFO:tasks.workunit.client.0.smithi062.stdout:7/957: dread d0/d3a/f7b [0,4194304] 0 2024-05-09T06:30:08.740 INFO:tasks.workunit.client.0.smithi062.stdout:4/949: mkdir d0/d2a/d126 0 2024-05-09T06:30:08.740 INFO:tasks.workunit.client.0.smithi062.stdout:7/958: getdents d0/d3a/d69/d110 0 2024-05-09T06:30:08.741 INFO:tasks.workunit.client.0.smithi062.stdout:4/950: mkdir d0/d2a/d1f/d103/d4f/d6b/d127 0 2024-05-09T06:30:08.743 INFO:tasks.workunit.client.0.smithi062.stdout:7/959: creat d0/d12/d66/f133 x:0 0 0 2024-05-09T06:30:08.743 INFO:tasks.workunit.client.0.smithi062.stdout:7/960: creat d0/d3a/d3f/dab/f134 x:0 0 0 2024-05-09T06:30:08.744 INFO:tasks.workunit.client.0.smithi062.stdout:4/951: mknod d0/d2a/d1f/dc9/c128 0 2024-05-09T06:30:08.746 INFO:tasks.workunit.client.0.smithi062.stdout:7/961: link d0/d12/d33/d9f/fc5 d0/d3/d10d/f135 0 2024-05-09T06:30:08.748 INFO:tasks.workunit.client.0.smithi062.stdout:7/962: symlink d0/d3/d10d/l136 0 2024-05-09T06:30:08.750 INFO:tasks.workunit.client.0.smithi062.stdout:7/963: mkdir d0/d3a/d51/d64/d6d/d88/dc7/d117/d137 0 2024-05-09T06:30:08.751 INFO:tasks.workunit.client.0.smithi062.stdout:4/952: dread d0/d2a/d1f/f65 [0,4194304] 0 2024-05-09T06:30:08.760 INFO:tasks.workunit.client.0.smithi062.stdout:7/964: rmdir d0/d12/d33 39 2024-05-09T06:30:08.760 INFO:tasks.workunit.client.0.smithi062.stdout:7/965: creat d0/da8/f138 x:0 0 0 2024-05-09T06:30:08.761 INFO:tasks.workunit.client.0.smithi062.stdout:7/966: read d0/d12/d33/d67/f6a [1815425,89789] 0 2024-05-09T06:30:08.765 INFO:tasks.workunit.client.0.smithi062.stdout:4/953: dwrite d0/d2a/d1f/d103/d7e/d8e/d9e/f16 [8388608,4194304] 0 2024-05-09T06:30:08.798 INFO:tasks.workunit.client.0.smithi062.stdout:4/954: dwrite d0/d2a/d1f/dc9/da0/ffe [0,4194304] 0 2024-05-09T06:30:08.799 INFO:tasks.workunit.client.0.smithi062.stdout:4/955: write d0/d2a/d1f/d103/d7e/d8e/fd9 [8750604,14007] 0 2024-05-09T06:30:08.801 INFO:tasks.workunit.client.0.smithi062.stdout:4/956: mknod d0/d2a/d1f/d103/d4f/da7/c129 0 2024-05-09T06:30:08.801 INFO:tasks.workunit.client.0.smithi062.stdout:4/957: chown d0/d3c/dae/db0/dbc/fb9 111 1 2024-05-09T06:30:08.801 INFO:tasks.workunit.client.0.smithi062.stdout:4/958: fsync d0/d2a/d1f/d103/d7e/d8e/d9e/d86/fa6 0 2024-05-09T06:30:08.809 INFO:tasks.workunit.client.0.smithi062.stdout:4/959: dread d0/d2a/d1f/f22 [4194304,4194304] 0 2024-05-09T06:30:08.893 INFO:tasks.workunit.client.0.smithi062.stdout:2/890: sync 2024-05-09T06:30:08.893 INFO:tasks.workunit.client.0.smithi062.stdout:3/783: sync 2024-05-09T06:30:08.893 INFO:tasks.workunit.client.0.smithi062.stdout:1/721: sync 2024-05-09T06:30:08.893 INFO:tasks.workunit.client.0.smithi062.stdout:1/722: fsync d8/d14/d2b/d3c/d44/d6e/d7a/f84 0 2024-05-09T06:30:08.893 INFO:tasks.workunit.client.0.smithi062.stdout:9/979: sync 2024-05-09T06:30:08.896 INFO:tasks.workunit.client.0.smithi062.stdout:3/784: symlink d1/d1e/d36/d3a/d4e/dbf/l104 0 2024-05-09T06:30:08.897 INFO:tasks.workunit.client.0.smithi062.stdout:1/723: creat d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/fe8 x:0 0 0 2024-05-09T06:30:08.897 INFO:tasks.workunit.client.0.smithi062.stdout:3/785: dread d1/d1e/d54/f93 [0,4194304] 0 2024-05-09T06:30:08.902 INFO:tasks.workunit.client.0.smithi062.stdout:1/724: rename d8/d14/d2b/f52 to d8/d14/d2b/d3c/d7d/fe9 0 2024-05-09T06:30:08.902 INFO:tasks.workunit.client.0.smithi062.stdout:1/725: truncate d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/fe8 608083 0 2024-05-09T06:30:08.904 INFO:tasks.workunit.client.0.smithi062.stdout:1/726: mknod d8/d14/d2b/de4/cea 0 2024-05-09T06:30:08.904 INFO:tasks.workunit.client.0.smithi062.stdout:1/727: chown d8/d1d/d9c/c4c 558 1 2024-05-09T06:30:08.905 INFO:tasks.workunit.client.0.smithi062.stdout:2/891: write d0/d9/dd/d65/d6d/d21/d29/d40/f75 [892517,71740] 0 2024-05-09T06:30:08.905 INFO:tasks.workunit.client.0.smithi062.stdout:2/892: truncate d0/d9/d38/d41/d48/d5f/fc8 1893000 0 2024-05-09T06:30:08.906 INFO:tasks.workunit.client.0.smithi062.stdout:1/728: mkdir d8/d14/d2b/d3c/d7d/deb 0 2024-05-09T06:30:08.907 INFO:tasks.workunit.client.0.smithi062.stdout:2/893: link d0/d9/dd/d65/d6d/d21/c62 d0/d9/dd/d65/d6d/d21/d29/c120 0 2024-05-09T06:30:08.910 INFO:tasks.workunit.client.0.smithi062.stdout:1/729: symlink d8/lec 0 2024-05-09T06:30:08.911 INFO:tasks.workunit.client.0.smithi062.stdout:3/786: write d1/f27 [81407,72812] 0 2024-05-09T06:30:08.913 INFO:tasks.workunit.client.0.smithi062.stdout:2/894: link d0/d9/d38/d41/d48/d5f/fc8 d0/d9/d38/d41/de1/dee/f121 0 2024-05-09T06:30:08.913 INFO:tasks.workunit.client.0.smithi062.stdout:2/895: getdents d0/d9/d38/d41/d48/df9/d11c 0 2024-05-09T06:30:08.918 INFO:tasks.workunit.client.0.smithi062.stdout:3/787: creat d1/d1e/d26/ddd/d52/d81/f105 x:0 0 0 2024-05-09T06:30:08.920 INFO:tasks.workunit.client.0.smithi062.stdout:9/980: dwrite d3/d3e/d52/d58/d1c/d1e/d60/f106 [0,4194304] 0 2024-05-09T06:30:08.922 INFO:tasks.workunit.client.0.smithi062.stdout:3/788: mknod d1/d1e/d36/daa/c106 0 2024-05-09T06:30:08.927 INFO:tasks.workunit.client.0.smithi062.stdout:2/896: dread d0/d9/d17/d89/d8f/fd0 [0,4194304] 0 2024-05-09T06:30:08.927 INFO:tasks.workunit.client.0.smithi062.stdout:3/789: symlink d1/d1e/d36/d3a/d4e/l107 0 2024-05-09T06:30:08.930 INFO:tasks.workunit.client.0.smithi062.stdout:9/981: rename d3/d3e/d4b/c94 to d3/d3e/d4b/da2/c13c 0 2024-05-09T06:30:08.932 INFO:tasks.workunit.client.0.smithi062.stdout:3/790: dread d1/d1e/d26/ddd/d52/f53 [0,4194304] 0 2024-05-09T06:30:08.932 INFO:tasks.workunit.client.0.smithi062.stdout:3/791: fdatasync d1/d1e/d36/d9f/d4f/fd7 0 2024-05-09T06:30:08.945 INFO:tasks.workunit.client.0.smithi062.stdout:9/982: write d3/d3e/d52/d58/d1c/d1e/d60/f106 [570598,51320] 0 2024-05-09T06:30:08.945 INFO:tasks.workunit.client.0.smithi062.stdout:9/983: dread - d3/d3e/d52/d58/d1c/d1e/d41/fda zero size 2024-05-09T06:30:08.949 INFO:tasks.workunit.client.0.smithi062.stdout:2/897: dwrite d0/d9/dd/f5e [4194304,4194304] 0 2024-05-09T06:30:08.953 INFO:tasks.workunit.client.0.smithi062.stdout:2/898: unlink d0/d9/d17/l2e 0 2024-05-09T06:30:08.956 INFO:tasks.workunit.client.0.smithi062.stdout:2/899: mkdir d0/d9/d38/d41/d48/d5f/d10c/d122 0 2024-05-09T06:30:08.958 INFO:tasks.workunit.client.0.smithi062.stdout:2/900: unlink d0/d9/d38/d41/d48/d5f/cdc 0 2024-05-09T06:30:08.959 INFO:tasks.workunit.client.0.smithi062.stdout:2/901: creat d0/d9/dd/d65/d6d/d96/f123 x:0 0 0 2024-05-09T06:30:08.960 INFO:tasks.workunit.client.0.smithi062.stdout:2/902: getdents d0/d9/dd/d65/d6d/d96/da4 0 2024-05-09T06:30:08.960 INFO:tasks.workunit.client.0.smithi062.stdout:2/903: creat d0/d9/d38/d41/d53/f124 x:0 0 0 2024-05-09T06:30:08.962 INFO:tasks.workunit.client.0.smithi062.stdout:2/904: link d0/d9/dd/d65/d6d/f115 d0/d9/dd/d65/d6d/d96/da4/f125 0 2024-05-09T06:30:08.962 INFO:tasks.workunit.client.0.smithi062.stdout:2/905: stat d0/d90/db7/cf7 0 2024-05-09T06:30:08.967 INFO:tasks.workunit.client.0.smithi062.stdout:9/984: dwrite d3/d20/ffb [0,4194304] 0 2024-05-09T06:30:08.967 INFO:tasks.workunit.client.0.smithi062.stdout:9/985: fdatasync d3/d3e/d52/d58/d1c/d1e/d41/f108 0 2024-05-09T06:30:08.967 INFO:tasks.workunit.client.0.smithi062.stdout:9/986: readlink d3/d3e/d52/d58/d1c/d1e/l8b 0 2024-05-09T06:30:08.967 INFO:tasks.workunit.client.0.smithi062.stdout:9/987: write d3/d3e/d52/d58/d1c/d21/f53 [1116738,54083] 0 2024-05-09T06:30:08.982 INFO:tasks.workunit.client.0.smithi062.stdout:9/988: unlink d3/d3e/d4b/c50 0 2024-05-09T06:30:08.990 INFO:tasks.workunit.client.0.smithi062.stdout:2/906: dwrite d0/d9/dd/d65/fea [0,4194304] 0 2024-05-09T06:30:08.990 INFO:tasks.workunit.client.0.smithi062.stdout:2/907: write d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/ff0 [151985,97268] 0 2024-05-09T06:30:09.052 INFO:tasks.workunit.client.0.smithi062.stdout:0/932: sync 2024-05-09T06:30:09.053 INFO:tasks.workunit.client.0.smithi062.stdout:0/933: fsync d1/d25/d31/db5/fcd 0 2024-05-09T06:30:09.075 INFO:tasks.workunit.client.0.smithi062.stdout:0/934: mkdir d1/d25/d49/d7e/da6/d141 0 2024-05-09T06:30:09.082 INFO:tasks.workunit.client.0.smithi062.stdout:0/935: dread d1/d25/d31/d6c/d44/dca/f110 [0,4194304] 0 2024-05-09T06:30:09.082 INFO:tasks.workunit.client.0.smithi062.stdout:0/936: rename d1 to d1/d25/d31/d6c/d142 22 2024-05-09T06:30:09.082 INFO:tasks.workunit.client.0.smithi062.stdout:0/937: fdatasync d1/d25/d59/f69 0 2024-05-09T06:30:09.082 INFO:tasks.workunit.client.0.smithi062.stdout:0/938: stat d1/d25/d31/d6c/d44/d57/d84 0 2024-05-09T06:30:09.083 INFO:tasks.workunit.client.0.smithi062.stdout:0/939: fsync d1/d25/d31/d6c/d44/d6e/dae/fb2 0 2024-05-09T06:30:09.083 INFO:tasks.workunit.client.0.smithi062.stdout:0/940: mkdir d1/d25/d59/de7/d143 0 2024-05-09T06:30:09.083 INFO:tasks.workunit.client.0.smithi062.stdout:0/941: creat d1/d6a/d6d/d93/d94/f144 x:0 0 0 2024-05-09T06:30:09.083 INFO:tasks.workunit.client.0.smithi062.stdout:0/942: chown d1/d25/d49/d42/d43/fe3 758680 1 2024-05-09T06:30:09.085 INFO:tasks.workunit.client.0.smithi062.stdout:0/943: rmdir d1/d25/d49/d42/d43/d54/d9d 39 2024-05-09T06:30:09.091 INFO:tasks.workunit.client.0.smithi062.stdout:0/944: rename d1/f11 to d1/f145 0 2024-05-09T06:30:09.188 INFO:tasks.workunit.client.0.smithi062.stdout:4/960: sync 2024-05-09T06:30:09.188 INFO:tasks.workunit.client.0.smithi062.stdout:7/967: sync 2024-05-09T06:30:09.188 INFO:tasks.workunit.client.0.smithi062.stdout:4/961: write d0/d2a/d1f/d103/f74 [1317346,52353] 0 2024-05-09T06:30:09.188 INFO:tasks.workunit.client.0.smithi062.stdout:4/962: readlink d0/d3c/dae/db0/lce 0 2024-05-09T06:30:09.189 INFO:tasks.workunit.client.0.smithi062.stdout:7/968: creat d0/d12/d33/d67/da7/f139 x:0 0 0 2024-05-09T06:30:09.190 INFO:tasks.workunit.client.0.smithi062.stdout:4/963: link d0/d2a/d1f/d103/d7e/d8e/d9e/d86/d94/c9b d0/d9/c12a 0 2024-05-09T06:30:09.197 INFO:tasks.workunit.client.0.smithi062.stdout:4/964: dread d0/d2a/d1f/d103/d7e/d8e/d9e/f5d [0,4194304] 0 2024-05-09T06:30:09.197 INFO:tasks.workunit.client.0.smithi062.stdout:4/965: write d0/d2a/d8/d69/f11d [73853,17133] 0 2024-05-09T06:30:09.197 INFO:tasks.workunit.client.0.smithi062.stdout:4/966: fdatasync d0/d2a/d8/f4a 0 2024-05-09T06:30:09.199 INFO:tasks.workunit.client.0.smithi062.stdout:4/967: creat d0/d2a/d8/f12b x:0 0 0 2024-05-09T06:30:09.200 INFO:tasks.workunit.client.0.smithi062.stdout:7/969: read d0/f77 [3681338,936] 0 2024-05-09T06:30:09.202 INFO:tasks.workunit.client.0.smithi062.stdout:7/970: dread d0/f95 [0,4194304] 0 2024-05-09T06:30:09.202 INFO:tasks.workunit.client.0.smithi062.stdout:4/968: getdents d0/d2a/d1f/d6c 0 2024-05-09T06:30:09.204 INFO:tasks.workunit.client.0.smithi062.stdout:7/971: symlink d0/d3a/d51/d64/d6d/d80/d8e/l13a 0 2024-05-09T06:30:09.206 INFO:tasks.workunit.client.0.smithi062.stdout:4/969: rename d0/d3c/dae/db0/dbc/l67 to d0/d3c/dc1/l12c 0 2024-05-09T06:30:09.209 INFO:tasks.workunit.client.0.smithi062.stdout:7/972: dread d0/f6e [0,4194304] 0 2024-05-09T06:30:09.209 INFO:tasks.workunit.client.0.smithi062.stdout:4/970: link d0/d3c/dae/db0/dbc/f39 d0/d3c/dae/f12d 0 2024-05-09T06:30:09.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/973: mkdir d0/d12/d33/d67/da7/dcd/d13b 0 2024-05-09T06:30:09.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/974: write d0/d3a/d51/d64/d6d/f121 [723500,68039] 0 2024-05-09T06:30:09.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/975: chown d0/d3/f17 0 1 2024-05-09T06:30:09.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/976: chown d0/d3a/f118 7544133 1 2024-05-09T06:30:09.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/977: fdatasync d0/d12/d66/fdb 0 2024-05-09T06:30:09.211 INFO:tasks.workunit.client.0.smithi062.stdout:7/978: stat d0/l2f 0 2024-05-09T06:30:09.212 INFO:tasks.workunit.client.0.smithi062.stdout:7/979: readlink d0/d12/d33/l48 0 2024-05-09T06:30:09.213 INFO:tasks.workunit.client.0.smithi062.stdout:7/980: rmdir d0/d3a/d3f 39 2024-05-09T06:30:09.227 INFO:tasks.workunit.client.0.smithi062.stdout:4/971: dwrite d0/d3c/dae/db0/f115 [0,4194304] 0 2024-05-09T06:30:09.229 INFO:tasks.workunit.client.0.smithi062.stdout:4/972: creat d0/d2a/d1f/d103/d7e/d8e/d9e/d28/d119/f12e x:0 0 0 2024-05-09T06:30:09.229 INFO:tasks.workunit.client.0.smithi062.stdout:4/973: write d0/d2a/d1f/d103/d7e/d8e/d9e/f5d [2275299,128366] 0 2024-05-09T06:30:09.230 INFO:tasks.workunit.client.0.smithi062.stdout:4/974: getdents d0 0 2024-05-09T06:30:09.230 INFO:tasks.workunit.client.0.smithi062.stdout:4/975: write d0/d2a/d1f/f70 [1634710,40796] 0 2024-05-09T06:30:09.247 INFO:tasks.workunit.client.0.smithi062.stdout:4/976: dwrite d0/d2a/d1f/d103/d7e/d8e/d9e/d28/fff [0,4194304] 0 2024-05-09T06:30:09.325 INFO:tasks.workunit.client.0.smithi062.stdout:4/977: dread d0/d2a/d1f/faa [0,4194304] 0 2024-05-09T06:30:09.326 INFO:tasks.workunit.client.0.smithi062.stdout:4/978: chown d0/d5b/dc5/d10c/f11f 1121 1 2024-05-09T06:30:09.332 INFO:tasks.workunit.client.0.smithi062.stdout:4/979: dread d0/d3c/fbb [4194304,4194304] 0 2024-05-09T06:30:09.332 INFO:tasks.workunit.client.0.smithi062.stdout:4/980: creat d0/d3c/da1/f12f x:0 0 0 2024-05-09T06:30:09.342 INFO:tasks.workunit.client.0.smithi062.stdout:4/981: mknod d0/d2a/d1f/d103/d7e/c130 0 2024-05-09T06:30:09.359 INFO:tasks.workunit.client.0.smithi062.stdout:4/982: dwrite d0/d3c/da1/f12f [0,4194304] 0 2024-05-09T06:30:09.361 INFO:tasks.workunit.client.0.smithi062.stdout:4/983: creat d0/d2a/d1f/d103/d4f/d6b/dca/f131 x:0 0 0 2024-05-09T06:30:09.370 INFO:tasks.workunit.client.0.smithi062.stdout:4/984: dread d0/d2a/d1f/d103/d7e/d8e/fa3 [0,4194304] 0 2024-05-09T06:30:09.370 INFO:tasks.workunit.client.0.smithi062.stdout:4/985: chown d0/d2a/d1f/d103/d7e/d8e/d9e/f16 62 1 2024-05-09T06:30:09.376 INFO:tasks.workunit.client.0.smithi062.stdout:1/730: sync 2024-05-09T06:30:09.376 INFO:tasks.workunit.client.0.smithi062.stdout:1/731: truncate d8/d14/d2b/d3c/fa1 493240 0 2024-05-09T06:30:09.378 INFO:tasks.workunit.client.0.smithi062.stdout:1/732: mknod d8/d14/d2b/d3c/d44/d6e/d98/ced 0 2024-05-09T06:30:09.381 INFO:tasks.workunit.client.0.smithi062.stdout:1/733: creat d8/d1d/d9c/db4/fee x:0 0 0 2024-05-09T06:30:09.381 INFO:tasks.workunit.client.0.smithi062.stdout:4/986: write d0/d9/f72 [2107258,48957] 0 2024-05-09T06:30:09.381 INFO:tasks.workunit.client.0.smithi062.stdout:1/734: dread d8/d14/d2b/d3c/fa1 [0,4194304] 0 2024-05-09T06:30:09.383 INFO:tasks.workunit.client.0.smithi062.stdout:4/987: link d0/c54 d0/d2a/c132 0 2024-05-09T06:30:09.383 INFO:tasks.workunit.client.0.smithi062.stdout:1/735: dread d8/d14/d2b/d3c/d44/f63 [0,4194304] 0 2024-05-09T06:30:09.384 INFO:tasks.workunit.client.0.smithi062.stdout:4/988: rename d0/d9/de8/d109/f11c to d0/d2a/d1f/dc9/f133 0 2024-05-09T06:30:09.386 INFO:tasks.workunit.client.0.smithi062.stdout:4/989: symlink d0/d2a/l134 0 2024-05-09T06:30:09.390 INFO:tasks.workunit.client.0.smithi062.stdout:1/736: write d8/d14/d2b/d3c/f4e [962611,14046] 0 2024-05-09T06:30:09.392 INFO:tasks.workunit.client.0.smithi062.stdout:1/737: symlink d8/d14/d2b/d3c/lef 0 2024-05-09T06:30:09.392 INFO:tasks.workunit.client.0.smithi062.stdout:1/738: dread - d8/d1d/d70/fbd zero size 2024-05-09T06:30:09.409 INFO:tasks.workunit.client.0.smithi062.stdout:1/739: dwrite d8/d14/d2b/d3c/f6b [0,4194304] 0 2024-05-09T06:30:09.410 INFO:tasks.workunit.client.0.smithi062.stdout:4/990: dwrite d0/d3c/da1/f12f [0,4194304] 0 2024-05-09T06:30:09.418 INFO:tasks.workunit.client.0.smithi062.stdout:1/740: dread d8/d1d/d91/f7e [0,4194304] 0 2024-05-09T06:30:09.418 INFO:tasks.workunit.client.0.smithi062.stdout:4/991: creat d0/d3c/dae/db0/dbc/f135 x:0 0 0 2024-05-09T06:30:09.418 INFO:tasks.workunit.client.0.smithi062.stdout:1/741: creat d8/d14/d2b/d3c/d44/ff0 x:0 0 0 2024-05-09T06:30:09.420 INFO:tasks.workunit.client.0.smithi062.stdout:4/992: mkdir d0/d5b/d85/d136 0 2024-05-09T06:30:09.420 INFO:tasks.workunit.client.0.smithi062.stdout:4/993: stat d0/d2a/d1f/d103/d4f/d6b/dca/fed 0 2024-05-09T06:30:09.424 INFO:tasks.workunit.client.0.smithi062.stdout:4/994: link d0/d5b/dc5/ffd d0/d3c/dae/db0/dbc/f137 0 2024-05-09T06:30:09.425 INFO:tasks.workunit.client.0.smithi062.stdout:1/742: write d8/d14/d2b/d3c/f46 [3451654,106679] 0 2024-05-09T06:30:09.426 INFO:tasks.workunit.client.0.smithi062.stdout:4/995: creat d0/d2a/d1f/d103/d4f/da7/f138 x:0 0 0 2024-05-09T06:30:09.427 INFO:tasks.workunit.client.0.smithi062.stdout:1/743: fsync d8/d14/d2b/d3c/f46 0 2024-05-09T06:30:09.429 INFO:tasks.workunit.client.0.smithi062.stdout:1/744: dread d8/d14/d2b/d3c/d44/f63 [0,4194304] 0 2024-05-09T06:30:09.430 INFO:tasks.workunit.client.0.smithi062.stdout:2/908: sync 2024-05-09T06:30:09.430 INFO:tasks.workunit.client.0.smithi062.stdout:3/792: sync 2024-05-09T06:30:09.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/989: sync 2024-05-09T06:30:09.430 INFO:tasks.workunit.client.0.smithi062.stdout:9/990: fsync d3/d20/dc7/fd8 0 2024-05-09T06:30:09.431 INFO:tasks.workunit.client.0.smithi062.stdout:1/745: getdents d8/d1d/dc7 0 2024-05-09T06:30:09.439 INFO:tasks.workunit.client.0.smithi062.stdout:4/996: read d0/d2a/d1f/d103/d4f/d6b/fc8 [169210,38580] 0 2024-05-09T06:30:09.441 INFO:tasks.workunit.client.0.smithi062.stdout:7/981: sync 2024-05-09T06:30:09.441 INFO:tasks.workunit.client.0.smithi062.stdout:0/945: sync 2024-05-09T06:30:09.441 INFO:tasks.workunit.client.0.smithi062.stdout:0/946: read - d1/d25/d49/d42/dad/dbe/f13d zero size 2024-05-09T06:30:09.441 INFO:tasks.workunit.client.0.smithi062.stdout:0/947: write d1/d25/d31/d6c/d44/d57/f108 [1483790,19119] 0 2024-05-09T06:30:09.442 INFO:tasks.workunit.client.0.smithi062.stdout:3/793: write d1/d1e/d36/d3a/d97/fdc [3140845,128188] 0 2024-05-09T06:30:09.442 INFO:tasks.workunit.client.0.smithi062.stdout:4/997: mkdir d0/d2a/d1f/dc9/da0/d11b/d139 0 2024-05-09T06:30:09.447 INFO:tasks.workunit.client.0.smithi062.stdout:7/982: mknod d0/d3a/d51/d64/d6d/dac/c13c 0 2024-05-09T06:30:09.447 INFO:tasks.workunit.client.0.smithi062.stdout:7/983: fsync d0/d12/d33/d67/f7e 0 2024-05-09T06:30:09.449 INFO:tasks.workunit.client.0.smithi062.stdout:0/948: mkdir d1/d25/d49/d4f/d52/d87/dc8/d146 0 2024-05-09T06:30:09.449 INFO:tasks.workunit.client.0.smithi062.stdout:0/949: truncate d1/d25/d31/d6c/d44/d57/d75/f8c 186276 0 2024-05-09T06:30:09.449 INFO:tasks.workunit.client.0.smithi062.stdout:0/950: chown d1/d25/d31/d6c/le2 205779295 1 2024-05-09T06:30:09.451 INFO:tasks.workunit.client.0.smithi062.stdout:9/991: dwrite d3/d3e/d52/d58/d1c/d1e/d41/d64/dd0/fd1 [0,4194304] 0 2024-05-09T06:30:09.451 INFO:tasks.workunit.client.0.smithi062.stdout:1/746: dwrite d8/d14/d2b/d3c/da5/dcf/fd8 [0,4194304] 0 2024-05-09T06:30:09.452 INFO:tasks.workunit.client.0.smithi062.stdout:1/747: chown f3 6965054 1 2024-05-09T06:30:09.460 INFO:tasks.workunit.client.0.smithi062.stdout:4/998: dwrite d0/d2a/d1f/d103/d4f/d6b/fc8 [0,4194304] 0 2024-05-09T06:30:09.478 INFO:tasks.workunit.client.0.smithi062.stdout:4/999: dwrite d0/fb8 [0,4194304] 0 2024-05-09T06:30:09.482 INFO:tasks.workunit.client.0.smithi062.stdout:0/951: creat d1/d25/d31/d6c/d44/d57/d75/d11a/f147 x:0 0 0 2024-05-09T06:30:09.482 INFO:tasks.workunit.client.0.smithi062.stdout:0/952: dread - d1/d25/d59/de7/f131 zero size 2024-05-09T06:30:09.482 INFO:tasks.workunit.client.0.smithi062.stdout:0/953: fsync d1/d25/d49/d4f/d52/d87/f70 0 2024-05-09T06:30:09.492 INFO:tasks.workunit.client.0.smithi062.stdout:1/748: truncate d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/fe8 119184 0 2024-05-09T06:30:09.504 INFO:tasks.workunit.client.0.smithi062.stdout:0/954: dwrite d1/d6a/d6d/d93/d94/dc7/f113 [0,4194304] 0 2024-05-09T06:30:09.509 INFO:tasks.workunit.client.0.smithi062.stdout:3/794: mknod d1/d1e/d26/ddd/d52/d6a/c108 0 2024-05-09T06:30:09.512 INFO:tasks.workunit.client.0.smithi062.stdout:1/749: dwrite d8/d14/d2b/d3c/d44/d6e/d7a/fb8 [0,4194304] 0 2024-05-09T06:30:09.512 INFO:tasks.workunit.client.0.smithi062.stdout:1/750: fsync d8/d14/d2b/d3c/d44/d7f/fce 0 2024-05-09T06:30:09.512 INFO:tasks.workunit.client.0.smithi062.stdout:1/751: write d8/d14/d2b/d3c/d44/f4a [620520,29716] 0 2024-05-09T06:30:09.515 INFO:tasks.workunit.client.0.smithi062.stdout:1/752: dread d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 [0,4194304] 0 2024-05-09T06:30:09.525 INFO:tasks.workunit.client.0.smithi062.stdout:3/795: dwrite d1/d1e/d3b/ffa [0,4194304] 0 2024-05-09T06:30:09.536 INFO:tasks.workunit.client.0.smithi062.stdout:3/796: dread d1/f55 [0,4194304] 0 2024-05-09T06:30:09.547 INFO:tasks.workunit.client.0.smithi062.stdout:3/797: dwrite d1/d1e/d36/d9f/f65 [4194304,4194304] 0 2024-05-09T06:30:09.562 INFO:tasks.workunit.client.0.smithi062.stdout:3/798: dread d1/d1e/d36/d9f/d4f/fd7 [0,4194304] 0 2024-05-09T06:30:09.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:09 smithi079 ceph-mon[35268]: pgmap v12: 65 pgs: 65 active+clean; 2.7 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 170 MiB/s rd, 200 MiB/s wr, 386 op/s 2024-05-09T06:30:09.603 INFO:tasks.workunit.client.0.smithi062.stdout:7/984: mknod d0/d3a/d3f/c13d 0 2024-05-09T06:30:09.603 INFO:tasks.workunit.client.0.smithi062.stdout:7/985: truncate d0/d3a/d3f/dab/f100 645828 0 2024-05-09T06:30:09.609 INFO:tasks.workunit.client.0.smithi062.stdout:1/753: mknod d8/d14/cf1 0 2024-05-09T06:30:09.616 INFO:tasks.workunit.client.0.smithi062.stdout:3/799: mknod d1/d1e/d36/d3a/c109 0 2024-05-09T06:30:09.620 INFO:tasks.workunit.client.0.smithi062.stdout:1/754: symlink d8/d14/d2b/d3c/d76/lf2 0 2024-05-09T06:30:09.621 INFO:tasks.workunit.client.0.smithi062.stdout:1/755: dread d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/fe8 [0,4194304] 0 2024-05-09T06:30:09.621 INFO:tasks.workunit.client.0.smithi062.stdout:1/756: write d8/d14/d2b/d3c/d44/d6e/d7a/fa6 [1648308,9490] 0 2024-05-09T06:30:09.622 INFO:tasks.workunit.client.0.smithi062.stdout:3/800: mknod d1/d1e/d54/d8c/c10a 0 2024-05-09T06:30:09.624 INFO:tasks.workunit.client.0.smithi062.stdout:3/801: write d1/d1e/f1d [624140,107130] 0 2024-05-09T06:30:09.647 INFO:tasks.workunit.client.0.smithi062.stdout:3/802: dwrite d1/d1e/d3b/fc4 [0,4194304] 0 2024-05-09T06:30:09.650 INFO:tasks.workunit.client.0.smithi062.stdout:3/803: creat d1/d1e/d54/f10b x:0 0 0 2024-05-09T06:30:09.652 INFO:tasks.workunit.client.0.smithi062.stdout:3/804: mkdir d1/d10c 0 2024-05-09T06:30:09.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:09 smithi062 ceph-mon[26920]: pgmap v12: 65 pgs: 65 active+clean; 2.7 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 170 MiB/s rd, 200 MiB/s wr, 386 op/s 2024-05-09T06:30:09.670 INFO:tasks.workunit.client.0.smithi062.stdout:3/805: dwrite d1/d1e/d36/d9f/d4f/f96 [0,4194304] 0 2024-05-09T06:30:09.675 INFO:tasks.workunit.client.0.smithi062.stdout:9/992: symlink d3/d20/l13d 0 2024-05-09T06:30:09.675 INFO:tasks.workunit.client.0.smithi062.stdout:9/993: stat d3/d3e/d52/d58/d1c/f87 0 2024-05-09T06:30:09.679 INFO:tasks.workunit.client.0.smithi062.stdout:9/994: creat d3/d20/d123/f13e x:0 0 0 2024-05-09T06:30:09.679 INFO:tasks.workunit.client.0.smithi062.stdout:9/995: fdatasync d3/d3e/d52/d58/d1c/d21/f24 0 2024-05-09T06:30:09.679 INFO:tasks.workunit.client.0.smithi062.stdout:9/996: creat d3/f13f x:0 0 0 2024-05-09T06:30:09.679 INFO:tasks.workunit.client.0.smithi062.stdout:9/997: stat d3/d3e/d52/d58/d1c/d21/dfc 0 2024-05-09T06:30:09.680 INFO:tasks.workunit.client.0.smithi062.stdout:0/955: rename d1/d25/d49/d4f/d52/d87/lac to d1/d25/d49/d4f/d52/d87/dc8/d146/l148 0 2024-05-09T06:30:09.684 INFO:tasks.workunit.client.0.smithi062.stdout:1/757: rename d8/d14/d2b/d3c/d44/d38/c5f to d8/d14/d2b/d3c/d7d/deb/cf3 0 2024-05-09T06:30:09.684 INFO:tasks.workunit.client.0.smithi062.stdout:1/758: fdatasync f5 0 2024-05-09T06:30:09.686 INFO:tasks.workunit.client.0.smithi062.stdout:3/806: dwrite d1/d1e/d36/d3a/d97/fdc [0,4194304] 0 2024-05-09T06:30:09.688 INFO:tasks.workunit.client.0.smithi062.stdout:9/998: rename d3/d20/l13d to d3/d3e/d52/d58/d1c/d1e/d41/d64/dd5/l140 0 2024-05-09T06:30:09.689 INFO:tasks.workunit.client.0.smithi062.stdout:1/759: link d8/fbb d8/d1d/d9c/db4/ff4 0 2024-05-09T06:30:09.689 INFO:tasks.workunit.client.0.smithi062.stdout:1/760: dread - d8/d14/d2b/d3c/d44/d7f/fd3 zero size 2024-05-09T06:30:09.690 INFO:tasks.workunit.client.0.smithi062.stdout:0/956: dread d1/f145 [0,4194304] 0 2024-05-09T06:30:09.694 INFO:tasks.workunit.client.0.smithi062.stdout:3/807: link d1/d1e/d36/d4a/d51/fd9 d1/d1e/d36/d9f/f10d 0 2024-05-09T06:30:09.694 INFO:tasks.workunit.client.0.smithi062.stdout:3/808: chown d1/d1e/d26/ddd/d52/d6a/da4 0 1 2024-05-09T06:30:09.694 INFO:tasks.workunit.client.0.smithi062.stdout:1/761: dread d8/d14/f32 [0,4194304] 0 2024-05-09T06:30:09.695 INFO:tasks.workunit.client.0.smithi062.stdout:1/762: readlink d8/d14/d2b/d3c/lef 0 2024-05-09T06:30:09.698 INFO:tasks.workunit.client.0.smithi062.stdout:9/999: dread d3/d3e/d52/d58/d1c/d1e/d41/fd9 [0,4194304] 0 2024-05-09T06:30:09.699 INFO:tasks.workunit.client.0.smithi062.stdout:0/957: truncate d1/d25/d31/d6c/df5/f123 51044 0 2024-05-09T06:30:09.699 INFO:tasks.workunit.client.0.smithi062.stdout:2/909: sync 2024-05-09T06:30:09.699 INFO:tasks.workunit.client.0.smithi062.stdout:3/809: dread d1/d1e/d36/d9f/f65 [0,4194304] 0 2024-05-09T06:30:09.701 INFO:tasks.workunit.client.0.smithi062.stdout:1/763: symlink d8/d14/d2b/d3d/lf5 0 2024-05-09T06:30:09.701 INFO:tasks.workunit.client.0.smithi062.stdout:1/764: truncate d8/d14/d2b/d3c/d44/ff0 51137 0 2024-05-09T06:30:09.707 INFO:tasks.workunit.client.0.smithi062.stdout:2/910: dread d0/fa [0,4194304] 0 2024-05-09T06:30:09.709 INFO:tasks.workunit.client.0.smithi062.stdout:3/810: dread d1/d1e/d54/d8c/fc5 [0,4194304] 0 2024-05-09T06:30:09.709 INFO:tasks.workunit.client.0.smithi062.stdout:2/911: creat d0/d9/d38/dd6/f126 x:0 0 0 2024-05-09T06:30:09.712 INFO:tasks.workunit.client.0.smithi062.stdout:3/811: truncate d1/d1e/f24 7974281 0 2024-05-09T06:30:09.712 INFO:tasks.workunit.client.0.smithi062.stdout:3/812: write d1/d1e/d36/d4a/d51/f9b [1115815,82729] 0 2024-05-09T06:30:09.714 INFO:tasks.workunit.client.0.smithi062.stdout:2/912: mknod d0/d9/c127 0 2024-05-09T06:30:09.715 INFO:tasks.workunit.client.0.smithi062.stdout:2/913: dread - d0/d9/dd/d65/d6d/d21/fe9 zero size 2024-05-09T06:30:09.718 INFO:tasks.workunit.client.0.smithi062.stdout:3/813: dread d1/d1e/d36/d4a/d51/f9b [0,4194304] 0 2024-05-09T06:30:09.719 INFO:tasks.workunit.client.0.smithi062.stdout:3/814: truncate d1/d1e/d26/ddd/d52/d81/f105 354228 0 2024-05-09T06:30:09.726 INFO:tasks.workunit.client.0.smithi062.stdout:3/815: rename d1/d1e/d36/d4a/d51 to d1/d1e/d26/ddd/ddf/d10e 0 2024-05-09T06:30:09.727 INFO:tasks.workunit.client.0.smithi062.stdout:3/816: mknod d1/d1e/d36/d6c/c10f 0 2024-05-09T06:30:09.729 INFO:tasks.workunit.client.0.smithi062.stdout:3/817: symlink d1/d1e/d54/l110 0 2024-05-09T06:30:09.730 INFO:tasks.workunit.client.0.smithi062.stdout:3/818: symlink d1/d1e/d36/d3a/l111 0 2024-05-09T06:30:09.731 INFO:tasks.workunit.client.0.smithi062.stdout:3/819: read - d1/d1e/d36/fce zero size 2024-05-09T06:30:09.731 INFO:tasks.workunit.client.0.smithi062.stdout:3/820: truncate d1/d1e/f10 1279196 0 2024-05-09T06:30:09.732 INFO:tasks.workunit.client.0.smithi062.stdout:2/914: dwrite d0/fdb [0,4194304] 0 2024-05-09T06:30:09.733 INFO:tasks.workunit.client.0.smithi062.stdout:3/821: unlink d1/d1e/d36/d9f/d4f/dd2/dd3/ff9 0 2024-05-09T06:30:09.737 INFO:tasks.workunit.client.0.smithi062.stdout:2/915: creat d0/d9/dd/d65/d6d/d96/f128 x:0 0 0 2024-05-09T06:30:09.739 INFO:tasks.workunit.client.0.smithi062.stdout:3/822: unlink d1/d1e/d36/d3a/lc8 0 2024-05-09T06:30:09.740 INFO:tasks.workunit.client.0.smithi062.stdout:3/823: truncate d1/d1e/d26/ddd/ddf/d10e/fd9 71158 0 2024-05-09T06:30:09.740 INFO:tasks.workunit.client.0.smithi062.stdout:3/824: chown d1/d1e/d36/daa/lcd 255 1 2024-05-09T06:30:09.741 INFO:tasks.workunit.client.0.smithi062.stdout:3/825: creat d1/f112 x:0 0 0 2024-05-09T06:30:09.744 INFO:tasks.workunit.client.0.smithi062.stdout:3/826: creat d1/d1e/d26/ddd/d52/d6a/da4/de1/f113 x:0 0 0 2024-05-09T06:30:09.746 INFO:tasks.workunit.client.0.smithi062.stdout:2/916: dread d0/d9/dd/d65/d6d/d21/d29/d3d/f79 [0,4194304] 0 2024-05-09T06:30:09.750 INFO:tasks.workunit.client.0.smithi062.stdout:2/917: mknod d0/d9/dd/d65/d6d/d21/d29/d3d/d46/c129 0 2024-05-09T06:30:09.752 INFO:tasks.workunit.client.0.smithi062.stdout:3/827: dread d1/f2f [0,4194304] 0 2024-05-09T06:30:09.752 INFO:tasks.workunit.client.0.smithi062.stdout:3/828: creat d1/d1e/d26/df3/f114 x:0 0 0 2024-05-09T06:30:09.752 INFO:tasks.workunit.client.0.smithi062.stdout:3/829: readlink d1/d1e/d26/ddd/d52/d6a/da4/la6 0 2024-05-09T06:30:09.752 INFO:tasks.workunit.client.0.smithi062.stdout:3/830: chown d1/d1e/d26/ddd/d52/d6a/da4/db3 827 1 2024-05-09T06:30:09.754 INFO:tasks.workunit.client.0.smithi062.stdout:2/918: symlink d0/d9/dd9/d93/l12a 0 2024-05-09T06:30:09.754 INFO:tasks.workunit.client.0.smithi062.stdout:2/919: truncate d0/d9/d38/dd6/f126 647993 0 2024-05-09T06:30:09.758 INFO:tasks.workunit.client.0.smithi062.stdout:3/831: mkdir d1/d1e/d36/d9f/d4f/d115 0 2024-05-09T06:30:09.758 INFO:tasks.workunit.client.0.smithi062.stdout:3/832: readlink d1/d1e/d26/ddd/d92/d77/l8d 0 2024-05-09T06:30:09.762 INFO:tasks.workunit.client.0.smithi062.stdout:3/833: write d1/d1e/d54/d8c/ff7 [849463,49264] 0 2024-05-09T06:30:09.762 INFO:tasks.workunit.client.0.smithi062.stdout:3/834: fsync d1/d1e/d36/f49 0 2024-05-09T06:30:09.765 INFO:tasks.workunit.client.0.smithi062.stdout:2/920: mkdir d0/d9/dd/d65/d6d/d96/da4/d12b 0 2024-05-09T06:30:09.767 INFO:tasks.workunit.client.0.smithi062.stdout:3/835: link d1/d1e/d26/ddd/ddf/d10e/f9b d1/d1e/d26/f116 0 2024-05-09T06:30:09.771 INFO:tasks.workunit.client.0.smithi062.stdout:2/921: mkdir d0/d12c 0 2024-05-09T06:30:09.771 INFO:tasks.workunit.client.0.smithi062.stdout:2/922: read - d0/d9/d38/d41/de1/f108 zero size 2024-05-09T06:30:09.772 INFO:tasks.workunit.client.0.smithi062.stdout:2/923: rename d0/d9/d38/d41/f49 to d0/d9/d38/d41/d48/d5f/d10c/f12d 0 2024-05-09T06:30:09.774 INFO:tasks.workunit.client.0.smithi062.stdout:2/924: creat d0/d9/dd/d65/d6d/f12e x:0 0 0 2024-05-09T06:30:09.776 INFO:tasks.workunit.client.0.smithi062.stdout:2/925: mknod d0/d9/d38/c12f 0 2024-05-09T06:30:09.782 INFO:tasks.workunit.client.0.smithi062.stdout:2/926: getdents d0/d9/d17 0 2024-05-09T06:30:09.784 INFO:tasks.workunit.client.0.smithi062.stdout:3/836: dwrite d1/d1e/d26/ddd/ddf/fe8 [0,4194304] 0 2024-05-09T06:30:09.791 INFO:tasks.workunit.client.0.smithi062.stdout:2/927: write d0/fdb [1350584,105408] 0 2024-05-09T06:30:09.791 INFO:tasks.workunit.client.0.smithi062.stdout:3/837: symlink d1/d1e/d36/df0/l117 0 2024-05-09T06:30:09.801 INFO:tasks.workunit.client.0.smithi062.stdout:2/928: rename d0/d9/d38/d41/d53/c10b to d0/d9/dd/d65/d6d/d96/da4/d12b/c130 0 2024-05-09T06:30:09.801 INFO:tasks.workunit.client.0.smithi062.stdout:2/929: fdatasync d0/d9/dd/d65/d6d/d21/f55 0 2024-05-09T06:30:09.804 INFO:tasks.workunit.client.0.smithi062.stdout:3/838: truncate d1/d1e/d26/f56 2080807 0 2024-05-09T06:30:09.808 INFO:tasks.workunit.client.0.smithi062.stdout:2/930: creat d0/d9/dd/d65/d6d/d21/d29/d106/f131 x:0 0 0 2024-05-09T06:30:09.810 INFO:tasks.workunit.client.0.smithi062.stdout:2/931: creat d0/d12c/f132 x:0 0 0 2024-05-09T06:30:09.811 INFO:tasks.workunit.client.0.smithi062.stdout:3/839: dread d1/f9d [0,4194304] 0 2024-05-09T06:30:09.813 INFO:tasks.workunit.client.0.smithi062.stdout:3/840: rename d1/d1e/d36/lbc to d1/d1e/d26/ddd/d52/d81/l118 0 2024-05-09T06:30:09.819 INFO:tasks.workunit.client.0.smithi062.stdout:2/932: write d0/d9/dd/f1c [1318260,128608] 0 2024-05-09T06:30:09.819 INFO:tasks.workunit.client.0.smithi062.stdout:2/933: chown d0/d9/d38/d41/d8a 27951469 1 2024-05-09T06:30:09.819 INFO:tasks.workunit.client.0.smithi062.stdout:2/934: write d0/d9/dd/d65/d6d/d96/fb3 [829596,37508] 0 2024-05-09T06:30:09.819 INFO:tasks.workunit.client.0.smithi062.stdout:2/935: write d0/d9/dd/d65/d6d/d21/fe9 [28648,83003] 0 2024-05-09T06:30:09.823 INFO:tasks.workunit.client.0.smithi062.stdout:2/936: rename d0/d9/dd/d65/d6d/d21/d29/d3d/d46/c4f to d0/d9/d38/dd6/dbd/d112/c133 0 2024-05-09T06:30:09.823 INFO:tasks.workunit.client.0.smithi062.stdout:2/937: chown d0/d9/dd/d65/d6d/d96/da4/d12b/c130 5171624 1 2024-05-09T06:30:09.823 INFO:tasks.workunit.client.0.smithi062.stdout:2/938: chown d0/d9/d38/d41/fc6 3063137 1 2024-05-09T06:30:09.833 INFO:tasks.workunit.client.0.smithi062.stdout:3/841: dwrite d1/d1e/d3b/d83/da5/d102/f50 [0,4194304] 0 2024-05-09T06:30:09.833 INFO:tasks.workunit.client.0.smithi062.stdout:3/842: dread - d1/f112 zero size 2024-05-09T06:30:09.836 INFO:tasks.workunit.client.0.smithi062.stdout:3/843: symlink d1/d1e/d3b/d83/da5/l119 0 2024-05-09T06:30:09.837 INFO:tasks.workunit.client.0.smithi062.stdout:3/844: symlink d1/d1e/d36/d3a/d97/l11a 0 2024-05-09T06:30:09.838 INFO:tasks.workunit.client.0.smithi062.stdout:3/845: truncate d1/d1e/d3b/d83/fa3 4647014 0 2024-05-09T06:30:09.838 INFO:tasks.workunit.client.0.smithi062.stdout:3/846: chown d1/d1e/d26/ddd/d52/d6a/f71 16 1 2024-05-09T06:30:09.838 INFO:tasks.workunit.client.0.smithi062.stdout:3/847: fdatasync d1/d1e/d26/ddd/d92/f103 0 2024-05-09T06:30:09.838 INFO:tasks.workunit.client.0.smithi062.stdout:3/848: truncate d1/d1e/d3b/fc4 2315377 0 2024-05-09T06:30:09.839 INFO:tasks.workunit.client.0.smithi062.stdout:3/849: symlink d1/d1e/d3b/l11b 0 2024-05-09T06:30:09.839 INFO:tasks.workunit.client.0.smithi062.stdout:3/850: write d1/d1e/d26/ddd/d52/d6a/da4/de1/f113 [567692,60050] 0 2024-05-09T06:30:09.853 INFO:tasks.workunit.client.0.smithi062.stdout:3/851: dwrite d1/d1e/f1d [0,4194304] 0 2024-05-09T06:30:09.879 INFO:tasks.workunit.client.0.smithi062.stdout:3/852: write d1/d1e/d36/d3a/f6d [1067666,100930] 0 2024-05-09T06:30:09.881 INFO:tasks.workunit.client.0.smithi062.stdout:3/853: symlink d1/d1e/d36/d4a/l11c 0 2024-05-09T06:30:09.883 INFO:tasks.workunit.client.0.smithi062.stdout:3/854: mkdir d1/d1e/d36/d3a/d89/d11d 0 2024-05-09T06:30:09.887 INFO:tasks.workunit.client.0.smithi062.stdout:3/855: rename d1/d1e/c35 to d1/d1e/d26/ddd/ddf/c11e 0 2024-05-09T06:30:09.887 INFO:tasks.workunit.client.0.smithi062.stdout:3/856: chown d1/d1e/d36/daa/lc2 14337195 1 2024-05-09T06:30:09.893 INFO:tasks.workunit.client.0.smithi062.stdout:3/857: read d1/f9d [56152,58284] 0 2024-05-09T06:30:09.893 INFO:tasks.workunit.client.0.smithi062.stdout:3/858: fdatasync d1/d1e/d54/d8c/fc5 0 2024-05-09T06:30:09.917 INFO:tasks.workunit.client.0.smithi062.stdout:3/859: dwrite d1/d1e/d26/ddd/f9e [4194304,4194304] 0 2024-05-09T06:30:09.920 INFO:tasks.workunit.client.0.smithi062.stdout:3/860: symlink d1/d1e/d26/ddd/d52/l11f 0 2024-05-09T06:30:09.921 INFO:tasks.workunit.client.0.smithi062.stdout:3/861: chown d1/d1e/d36/d3a/d4e/l107 2793410 1 2024-05-09T06:30:09.921 INFO:tasks.workunit.client.0.smithi062.stdout:3/862: write d1/d1e/d3b/d83/fa3 [4516672,89528] 0 2024-05-09T06:30:09.925 INFO:tasks.workunit.client.0.smithi062.stdout:3/863: symlink d1/d1e/d26/ddd/d52/d6a/da4/db3/l120 0 2024-05-09T06:30:09.928 INFO:tasks.workunit.client.0.smithi062.stdout:3/864: mkdir d1/d1e/d26/ddd/d52/d121 0 2024-05-09T06:30:09.950 INFO:tasks.workunit.client.0.smithi062.stdout:3/865: dwrite d1/d1e/fee [0,4194304] 0 2024-05-09T06:30:09.958 INFO:tasks.workunit.client.0.smithi062.stdout:3/866: mknod d1/d1e/d26/ddd/d52/d6a/da4/db3/c122 0 2024-05-09T06:30:09.966 INFO:tasks.workunit.client.0.smithi062.stdout:3/867: write d1/d1e/d26/ddd/d52/fc1 [1557332,99246] 0 2024-05-09T06:30:09.969 INFO:tasks.workunit.client.0.smithi062.stdout:3/868: dread d1/d1e/d36/d3a/f6d [0,4194304] 0 2024-05-09T06:30:09.972 INFO:tasks.workunit.client.0.smithi062.stdout:3/869: link d1/d1e/d36/d3a/f6d d1/d1e/d26/ddd/d52/d6a/f123 0 2024-05-09T06:30:09.972 INFO:tasks.workunit.client.0.smithi062.stdout:3/870: fdatasync d1/d1e/d26/ddd/d52/d6a/f123 0 2024-05-09T06:30:09.980 INFO:tasks.workunit.client.0.smithi062.stdout:3/871: dread d1/d1e/d26/f3c [0,4194304] 0 2024-05-09T06:30:09.980 INFO:tasks.workunit.client.0.smithi062.stdout:3/872: creat d1/d1e/d26/ddd/d52/d6a/da4/f124 x:0 0 0 2024-05-09T06:30:09.983 INFO:tasks.workunit.client.0.smithi062.stdout:3/873: mkdir d1/d1e/d26/ddd/ddf/d125 0 2024-05-09T06:30:09.983 INFO:tasks.workunit.client.0.smithi062.stdout:3/874: creat d1/d1e/d54/f126 x:0 0 0 2024-05-09T06:30:09.985 INFO:tasks.workunit.client.0.smithi062.stdout:3/875: dread d1/d1e/d26/ddd/ddf/d10e/f6b [0,4194304] 0 2024-05-09T06:30:09.985 INFO:tasks.workunit.client.0.smithi062.stdout:3/876: mknod d1/d1e/d36/d9f/d4f/dd2/dd3/c127 0 2024-05-09T06:30:09.987 INFO:tasks.workunit.client.0.smithi062.stdout:3/877: creat d1/d1e/d36/d3a/d4e/f128 x:0 0 0 2024-05-09T06:30:09.992 INFO:tasks.workunit.client.0.smithi062.stdout:3/878: dread d1/d1e/d26/f29 [0,4194304] 0 2024-05-09T06:30:09.993 INFO:tasks.workunit.client.0.smithi062.stdout:3/879: mkdir d1/d1e/d3b/d83/da5/d129 0 2024-05-09T06:30:09.999 INFO:tasks.workunit.client.0.smithi062.stdout:7/986: sync 2024-05-09T06:30:10.000 INFO:tasks.workunit.client.0.smithi062.stdout:7/987: mkdir d0/d3a/d69/d13e 0 2024-05-09T06:30:10.002 INFO:tasks.workunit.client.0.smithi062.stdout:7/988: rename d0/d3a/d3f/f4c to d0/d3a/d51/d64/d6d/d80/f13f 0 2024-05-09T06:30:10.002 INFO:tasks.workunit.client.0.smithi062.stdout:7/989: fsync d0/d3a/f91 0 2024-05-09T06:30:10.004 INFO:tasks.workunit.client.0.smithi062.stdout:7/990: mknod d0/d3a/d51/d64/d6d/d88/c140 0 2024-05-09T06:30:10.004 INFO:tasks.workunit.client.0.smithi062.stdout:7/991: chown d0/d12/d33/d67/fe8 223831624 1 2024-05-09T06:30:10.005 INFO:tasks.workunit.client.0.smithi062.stdout:7/992: link d0/d12/d33/d67/f7c d0/da8/f141 0 2024-05-09T06:30:10.008 INFO:tasks.workunit.client.0.smithi062.stdout:3/880: dwrite d1/d1e/d36/d9f/f10d [0,4194304] 0 2024-05-09T06:30:10.008 INFO:tasks.workunit.client.0.smithi062.stdout:3/881: stat d1/d1e/fef 0 2024-05-09T06:30:10.008 INFO:tasks.workunit.client.0.smithi062.stdout:3/882: stat d1/d1e/d26/ddd/d92/d77 0 2024-05-09T06:30:10.008 INFO:tasks.workunit.client.0.smithi062.stdout:7/993: symlink d0/d12/d33/d67/da7/de4/l142 0 2024-05-09T06:30:10.008 INFO:tasks.workunit.client.0.smithi062.stdout:7/994: chown d0/d12/d33/f5e 558664 1 2024-05-09T06:30:10.008 INFO:tasks.workunit.client.0.smithi062.stdout:7/995: chown d0/d3a/d51/d64/d6d/d80/ffd 294105 1 2024-05-09T06:30:10.008 INFO:tasks.workunit.client.0.smithi062.stdout:7/996: chown d0/d12/d66/fdb 96 1 2024-05-09T06:30:10.010 INFO:tasks.workunit.client.0.smithi062.stdout:3/883: symlink d1/d10c/l12a 0 2024-05-09T06:30:10.012 INFO:tasks.workunit.client.0.smithi062.stdout:3/884: rename d1/d1e/d26/f56 to d1/d1e/d26/df3/f12b 0 2024-05-09T06:30:10.016 INFO:tasks.workunit.client.0.smithi062.stdout:7/997: dread d0/d12/d66/faa [0,4194304] 0 2024-05-09T06:30:10.018 INFO:tasks.workunit.client.0.smithi062.stdout:7/998: creat d0/d3a/d3f/dfc/f143 x:0 0 0 2024-05-09T06:30:10.020 INFO:tasks.workunit.client.0.smithi062.stdout:3/885: write d1/d1e/d3b/ffa [4174817,118324] 0 2024-05-09T06:30:10.021 INFO:tasks.workunit.client.0.smithi062.stdout:7/999: getdents d0/d3a/d51/d64/d6d/d80 0 2024-05-09T06:30:10.041 INFO:tasks.workunit.client.0.smithi062.stdout:3/886: dwrite d1/d1e/d36/d3a/d4e/fe3 [0,4194304] 0 2024-05-09T06:30:10.041 INFO:tasks.workunit.client.0.smithi062.stdout:3/887: fdatasync d1/f1b 0 2024-05-09T06:30:10.041 INFO:tasks.workunit.client.0.smithi062.stdout:3/888: chown d1/d1e/d26/ddd/d52/d6a 1 1 2024-05-09T06:30:10.042 INFO:tasks.workunit.client.0.smithi062.stdout:3/889: mkdir d1/d1e/d3b/d83/d12c 0 2024-05-09T06:30:10.055 INFO:tasks.workunit.client.0.smithi062.stdout:3/890: dwrite d1/d1e/fbe [0,4194304] 0 2024-05-09T06:30:10.057 INFO:tasks.workunit.client.0.smithi062.stdout:3/891: creat d1/d1e/d36/dfc/f12d x:0 0 0 2024-05-09T06:30:10.057 INFO:tasks.workunit.client.0.smithi062.stdout:3/892: write d1/d1e/d26/ddd/fa7 [1896719,127653] 0 2024-05-09T06:30:10.059 INFO:tasks.workunit.client.0.smithi062.stdout:3/893: rename d1/d1e/d54/f10b to d1/d1e/d3b/d83/d12c/f12e 0 2024-05-09T06:30:10.060 INFO:tasks.workunit.client.0.smithi062.stdout:3/894: creat d1/d1e/d36/d3a/d89/d11d/f12f x:0 0 0 2024-05-09T06:30:10.065 INFO:tasks.workunit.client.0.smithi062.stdout:0/958: sync 2024-05-09T06:30:10.065 INFO:tasks.workunit.client.0.smithi062.stdout:1/765: sync 2024-05-09T06:30:10.065 INFO:tasks.workunit.client.0.smithi062.stdout:2/939: sync 2024-05-09T06:30:10.065 INFO:tasks.workunit.client.0.smithi062.stdout:1/766: truncate d8/d14/d2b/d3c/d44/f4a 1416503 0 2024-05-09T06:30:10.065 INFO:tasks.workunit.client.0.smithi062.stdout:0/959: write d1/d25/d49/d42/d43/f5e [493806,7831] 0 2024-05-09T06:30:10.066 INFO:tasks.workunit.client.0.smithi062.stdout:1/767: write d8/fbb [550030,43667] 0 2024-05-09T06:30:10.067 INFO:tasks.workunit.client.0.smithi062.stdout:2/940: symlink d0/d9/dd/d65/d6d/d21/d29/d3d/l134 0 2024-05-09T06:30:10.068 INFO:tasks.workunit.client.0.smithi062.stdout:3/895: dread d1/f1b [0,4194304] 0 2024-05-09T06:30:10.068 INFO:tasks.workunit.client.0.smithi062.stdout:1/768: stat d8/d14/c65 0 2024-05-09T06:30:10.068 INFO:tasks.workunit.client.0.smithi062.stdout:1/769: chown d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/fe8 845024 1 2024-05-09T06:30:10.070 INFO:tasks.workunit.client.0.smithi062.stdout:2/941: mknod d0/d9/d38/d41/db1/c135 0 2024-05-09T06:30:10.070 INFO:tasks.workunit.client.0.smithi062.stdout:2/942: chown d0/d9/dd/d65/fb4 0 1 2024-05-09T06:30:10.073 INFO:tasks.workunit.client.0.smithi062.stdout:2/943: truncate d0/d9/dd/d65/fac 6382543 0 2024-05-09T06:30:10.075 INFO:tasks.workunit.client.0.smithi062.stdout:1/770: getdents d8/d1d/d9c/db4 0 2024-05-09T06:30:10.077 INFO:tasks.workunit.client.0.smithi062.stdout:3/896: dread d1/d1e/d36/d3a/d97/fdc [0,4194304] 0 2024-05-09T06:30:10.081 INFO:tasks.workunit.client.0.smithi062.stdout:1/771: mkdir d8/d14/d2b/d3c/d7d/df6 0 2024-05-09T06:30:10.082 INFO:tasks.workunit.client.0.smithi062.stdout:3/897: chown d1/d1e/d36/d4a/lec 0 1 2024-05-09T06:30:10.088 INFO:tasks.workunit.client.0.smithi062.stdout:3/898: creat d1/d1e/d3b/d83/de5/f130 x:0 0 0 2024-05-09T06:30:10.088 INFO:tasks.workunit.client.0.smithi062.stdout:3/899: chown d1/d1e/d26/ddd/d52/d6a/da4/cc0 619 1 2024-05-09T06:30:10.096 INFO:tasks.workunit.client.0.smithi062.stdout:0/960: dwrite d1/d25/d49/d42/d43/d54/d9d/fab [0,4194304] 0 2024-05-09T06:30:10.099 INFO:tasks.workunit.client.0.smithi062.stdout:0/961: dread d1/d25/d31/f4c [0,4194304] 0 2024-05-09T06:30:10.099 INFO:tasks.workunit.client.0.smithi062.stdout:0/962: truncate d1/d25/d49/d4f/de6/f37 1562022 0 2024-05-09T06:30:10.100 INFO:tasks.workunit.client.0.smithi062.stdout:3/900: dread d1/d1e/d3b/d83/da5/d102/f4c [4194304,4194304] 0 2024-05-09T06:30:10.101 INFO:tasks.workunit.client.0.smithi062.stdout:0/963: mkdir d1/d25/d59/de7/d143/d149 0 2024-05-09T06:30:10.102 INFO:tasks.workunit.client.0.smithi062.stdout:0/964: mknod d1/d25/d31/d6c/d44/d57/d84/c14a 0 2024-05-09T06:30:10.103 INFO:tasks.workunit.client.0.smithi062.stdout:0/965: rmdir d1/d25/d31/d6c/d44/d57/d75/d11a 39 2024-05-09T06:30:10.103 INFO:tasks.workunit.client.0.smithi062.stdout:0/966: chown d1/d25/d49/d42/dad/dbe/fcf 253451 1 2024-05-09T06:30:10.105 INFO:tasks.workunit.client.0.smithi062.stdout:0/967: symlink d1/d25/d49/d4f/d52/d87/dc8/l14b 0 2024-05-09T06:30:10.105 INFO:tasks.workunit.client.0.smithi062.stdout:0/968: mknod d1/d6a/d6d/d93/d94/dc7/c14c 0 2024-05-09T06:30:10.113 INFO:tasks.workunit.client.0.smithi062.stdout:2/944: dwrite d0/f117 [0,4194304] 0 2024-05-09T06:30:10.114 INFO:tasks.workunit.client.0.smithi062.stdout:1/772: dwrite d8/d14/d2b/d3c/d44/d6e/d7a/d80/fdd [0,4194304] 0 2024-05-09T06:30:10.116 INFO:tasks.workunit.client.0.smithi062.stdout:3/901: write d1/d1e/d3b/d83/da5/d102/f98 [3423327,90940] 0 2024-05-09T06:30:10.120 INFO:tasks.workunit.client.0.smithi062.stdout:2/945: mknod d0/d9/d38/d41/d48/df9/d11c/c136 0 2024-05-09T06:30:10.120 INFO:tasks.workunit.client.0.smithi062.stdout:0/969: write d1/d25/d31/d6c/d44/d6e/fb8 [3142652,13429] 0 2024-05-09T06:30:10.125 INFO:tasks.workunit.client.0.smithi062.stdout:2/946: mknod d0/d9/dd/d65/d6d/d21/d29/d3d/c137 0 2024-05-09T06:30:10.129 INFO:tasks.workunit.client.0.smithi062.stdout:0/970: creat d1/d25/d31/d6c/d44/d57/f14d x:0 0 0 2024-05-09T06:30:10.129 INFO:tasks.workunit.client.0.smithi062.stdout:0/971: rename d1/d25/d49 to d1/d25/d49/d42/dad/dbe/d14e 22 2024-05-09T06:30:10.133 INFO:tasks.workunit.client.0.smithi062.stdout:0/972: symlink d1/d25/d49/d4f/d52/d87/dc8/l14f 0 2024-05-09T06:30:10.133 INFO:tasks.workunit.client.0.smithi062.stdout:0/973: write d1/d6a/d6d/d93/d94/dc7/f5c [3645272,104136] 0 2024-05-09T06:30:10.140 INFO:tasks.workunit.client.0.smithi062.stdout:2/947: dread d0/d9/d38/d41/f101 [0,4194304] 0 2024-05-09T06:30:10.140 INFO:tasks.workunit.client.0.smithi062.stdout:2/948: creat d0/d9/d17/d89/f138 x:0 0 0 2024-05-09T06:30:10.140 INFO:tasks.workunit.client.0.smithi062.stdout:3/902: dwrite d1/d1e/d26/f3c [0,4194304] 0 2024-05-09T06:30:10.140 INFO:tasks.workunit.client.0.smithi062.stdout:3/903: stat d1/d1e/d26/ddd/ddf/d10e 0 2024-05-09T06:30:10.143 INFO:tasks.workunit.client.0.smithi062.stdout:2/949: unlink d0/d9/d38/d41/db1/c135 0 2024-05-09T06:30:10.143 INFO:tasks.workunit.client.0.smithi062.stdout:2/950: readlink d0/d9/d38/d41/l11a 0 2024-05-09T06:30:10.143 INFO:tasks.workunit.client.0.smithi062.stdout:2/951: write d0/d9/f84 [390298,20761] 0 2024-05-09T06:30:10.143 INFO:tasks.workunit.client.0.smithi062.stdout:2/952: creat d0/d9/d38/dd6/dbd/d112/f139 x:0 0 0 2024-05-09T06:30:10.149 INFO:tasks.workunit.client.0.smithi062.stdout:3/904: unlink d1/d1e/d26/ddd/d52/d6a/da4/de1/f113 0 2024-05-09T06:30:10.159 INFO:tasks.workunit.client.0.smithi062.stdout:2/953: creat d0/d9/d38/d41/de1/dee/f13a x:0 0 0 2024-05-09T06:30:10.162 INFO:tasks.workunit.client.0.smithi062.stdout:2/954: rename d0/d9/d38/d41/db1/cb9 to d0/d9/d17/d89/d8f/c13b 0 2024-05-09T06:30:10.167 INFO:tasks.workunit.client.0.smithi062.stdout:3/905: dwrite d1/d1e/d26/ddd/ddf/d10e/fd9 [0,4194304] 0 2024-05-09T06:30:10.168 INFO:tasks.workunit.client.0.smithi062.stdout:0/974: dwrite d1/d25/d31/d6c/d44/d57/d75/f9f [4194304,4194304] 0 2024-05-09T06:30:10.168 INFO:tasks.workunit.client.0.smithi062.stdout:0/975: chown d1/d25/f134 1913 1 2024-05-09T06:30:10.168 INFO:tasks.workunit.client.0.smithi062.stdout:0/976: fsync d1/d25/d31/ffd 0 2024-05-09T06:30:10.168 INFO:tasks.workunit.client.0.smithi062.stdout:3/906: symlink d1/d1e/d26/ddd/d52/d81/l131 0 2024-05-09T06:30:10.171 INFO:tasks.workunit.client.0.smithi062.stdout:0/977: creat d1/d25/d49/d4f/f150 x:0 0 0 2024-05-09T06:30:10.171 INFO:tasks.workunit.client.0.smithi062.stdout:0/978: fdatasync d1/d25/d49/d42/d43/f4e 0 2024-05-09T06:30:10.172 INFO:tasks.workunit.client.0.smithi062.stdout:3/907: mknod d1/d1e/d54/d8c/df4/c132 0 2024-05-09T06:30:10.172 INFO:tasks.workunit.client.0.smithi062.stdout:3/908: truncate d1/f112 1023440 0 2024-05-09T06:30:10.174 INFO:tasks.workunit.client.0.smithi062.stdout:3/909: symlink d1/d1e/d26/ddd/ddf/d125/l133 0 2024-05-09T06:30:10.178 INFO:tasks.workunit.client.0.smithi062.stdout:2/955: dwrite d0/d9/d17/d89/d8f/fd0 [0,4194304] 0 2024-05-09T06:30:10.182 INFO:tasks.workunit.client.0.smithi062.stdout:2/956: truncate d0/d9/d38/d41/d48/f4c 789256 0 2024-05-09T06:30:10.185 INFO:tasks.workunit.client.0.smithi062.stdout:3/910: rmdir d1/d1e/d36/d3a 39 2024-05-09T06:30:10.185 INFO:tasks.workunit.client.0.smithi062.stdout:3/911: fdatasync d1/d1e/d54/d8c/fc5 0 2024-05-09T06:30:10.191 INFO:tasks.workunit.client.0.smithi062.stdout:3/912: dread d1/d1e/d36/d9f/f65 [0,4194304] 0 2024-05-09T06:30:10.191 INFO:tasks.workunit.client.0.smithi062.stdout:2/957: getdents d0/d9/dd/d65/d6d/d21/d29 0 2024-05-09T06:30:10.195 INFO:tasks.workunit.client.0.smithi062.stdout:0/979: dwrite d1/d25/d31/d6c/d44/d6e/fb8 [0,4194304] 0 2024-05-09T06:30:10.197 INFO:tasks.workunit.client.0.smithi062.stdout:0/980: symlink d1/d25/d49/d7e/da6/l151 0 2024-05-09T06:30:10.205 INFO:tasks.workunit.client.0.smithi062.stdout:0/981: dread d1/d25/d31/d6c/d44/f63 [4194304,4194304] 0 2024-05-09T06:30:10.212 INFO:tasks.workunit.client.0.smithi062.stdout:0/982: dread d1/d6a/f9c [0,4194304] 0 2024-05-09T06:30:10.213 INFO:tasks.workunit.client.0.smithi062.stdout:3/913: dwrite d1/d1e/d26/ddd/d52/d6a/f123 [0,4194304] 0 2024-05-09T06:30:10.215 INFO:tasks.workunit.client.0.smithi062.stdout:0/983: creat d1/d6a/d6d/d93/d94/f152 x:0 0 0 2024-05-09T06:30:10.218 INFO:tasks.workunit.client.0.smithi062.stdout:0/984: symlink d1/d25/d59/l153 0 2024-05-09T06:30:10.218 INFO:tasks.workunit.client.0.smithi062.stdout:0/985: fsync d1/f2a 0 2024-05-09T06:30:10.233 INFO:tasks.workunit.client.0.smithi062.stdout:3/914: dwrite d1/d1e/d54/f93 [0,4194304] 0 2024-05-09T06:30:10.233 INFO:tasks.workunit.client.0.smithi062.stdout:3/915: write d1/d1e/d3b/fc4 [2712314,84746] 0 2024-05-09T06:30:10.233 INFO:tasks.workunit.client.0.smithi062.stdout:3/916: readlink d1/l13 0 2024-05-09T06:30:10.237 INFO:tasks.workunit.client.0.smithi062.stdout:3/917: rename d1/d1e/d36/d3a/d97 to d1/d1e/d36/d134 0 2024-05-09T06:30:10.237 INFO:tasks.workunit.client.0.smithi062.stdout:3/918: write d1/d1e/d26/ddd/f78 [629783,130493] 0 2024-05-09T06:30:10.238 INFO:tasks.workunit.client.0.smithi062.stdout:3/919: symlink d1/d1e/d26/ddd/d52/d6a/l135 0 2024-05-09T06:30:10.238 INFO:tasks.workunit.client.0.smithi062.stdout:3/920: creat d1/d1e/d54/f136 x:0 0 0 2024-05-09T06:30:10.239 INFO:tasks.workunit.client.0.smithi062.stdout:0/986: dwrite d1/d25/d31/d6c/d44/d57/d75/ff1 [0,4194304] 0 2024-05-09T06:30:10.242 INFO:tasks.workunit.client.0.smithi062.stdout:0/987: unlink d1/d25/d49/d42/d43/d54/f8e 0 2024-05-09T06:30:10.242 INFO:tasks.workunit.client.0.smithi062.stdout:0/988: write d1/d25/d49/d4f/de6/f6b [169913,102887] 0 2024-05-09T06:30:10.245 INFO:tasks.workunit.client.0.smithi062.stdout:0/989: rename d1/d25/d49/c116 to d1/d25/d59/de7/d143/c154 0 2024-05-09T06:30:10.245 INFO:tasks.workunit.client.0.smithi062.stdout:3/921: dread d1/d1e/d36/d9f/d4f/fd7 [0,4194304] 0 2024-05-09T06:30:10.245 INFO:tasks.workunit.client.0.smithi062.stdout:3/922: chown d1/d1e/d54/c6e 26672 1 2024-05-09T06:30:10.246 INFO:tasks.workunit.client.0.smithi062.stdout:0/990: symlink d1/d25/d49/d4f/d52/d87/l155 0 2024-05-09T06:30:10.248 INFO:tasks.workunit.client.0.smithi062.stdout:3/923: mkdir d1/d1e/d36/d3a/d89/d137 0 2024-05-09T06:30:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:3/924: unlink d1/d1e/d26/ddd/d52/f53 0 2024-05-09T06:30:10.255 INFO:tasks.workunit.client.0.smithi062.stdout:0/991: write d1/fc [1079428,5948] 0 2024-05-09T06:30:10.258 INFO:tasks.workunit.client.0.smithi062.stdout:0/992: creat d1/d25/d31/d6c/d44/dca/d12c/f156 x:0 0 0 2024-05-09T06:30:10.260 INFO:tasks.workunit.client.0.smithi062.stdout:3/925: write d1/f1c [1742380,83062] 0 2024-05-09T06:30:10.264 INFO:tasks.workunit.client.0.smithi062.stdout:3/926: rename d1/d1e/d36/d3a/d89/d11d to d1/d1e/d36/d3a/d89/d137/d138 0 2024-05-09T06:30:10.268 INFO:tasks.workunit.client.0.smithi062.stdout:3/927: mknod d1/d1e/d36/d4a/c139 0 2024-05-09T06:30:10.269 INFO:tasks.workunit.client.0.smithi062.stdout:3/928: mknod d1/d1e/d3b/d83/da5/d102/c13a 0 2024-05-09T06:30:10.270 INFO:tasks.workunit.client.0.smithi062.stdout:3/929: creat d1/d1e/d36/d4a/f13b x:0 0 0 2024-05-09T06:30:10.272 INFO:tasks.workunit.client.0.smithi062.stdout:3/930: symlink d1/d1e/d3b/d83/da5/d102/l13c 0 2024-05-09T06:30:10.277 INFO:tasks.workunit.client.0.smithi062.stdout:0/993: dwrite d1/d25/d31/d6c/d44/dca/d12c/f156 [0,4194304] 0 2024-05-09T06:30:10.277 INFO:tasks.workunit.client.0.smithi062.stdout:0/994: dread - d1/d25/d49/d42/d43/fe3 zero size 2024-05-09T06:30:10.277 INFO:tasks.workunit.client.0.smithi062.stdout:0/995: write d1/f51 [161303,86832] 0 2024-05-09T06:30:10.277 INFO:tasks.workunit.client.0.smithi062.stdout:0/996: fdatasync d1/d25/d31/d6c/d44/d57/db4/fc0 0 2024-05-09T06:30:10.277 INFO:tasks.workunit.client.0.smithi062.stdout:0/997: dread - d1/d25/d49/d4f/f150 zero size 2024-05-09T06:30:10.280 INFO:tasks.workunit.client.0.smithi062.stdout:0/998: mknod d1/d25/d31/d6c/c157 0 2024-05-09T06:30:10.281 INFO:tasks.workunit.client.0.smithi062.stdout:3/931: write d1/d1e/d26/ddd/d52/d6a/fb7 [1250174,8367] 0 2024-05-09T06:30:10.284 INFO:tasks.workunit.client.0.smithi062.stdout:3/932: rename d1/d1e/d36/d6c/fb1 to d1/d1e/d36/d134/f13d 0 2024-05-09T06:30:10.297 INFO:tasks.workunit.client.0.smithi062.stdout:0/999: dwrite d1/d25/d49/d4f/d52/d87/fa3 [0,4194304] 0 2024-05-09T06:30:10.314 INFO:tasks.workunit.client.0.smithi062.stdout:3/933: dwrite d1/d1e/d26/ddd/d52/d6a/fb7 [0,4194304] 0 2024-05-09T06:30:10.326 INFO:tasks.workunit.client.0.smithi062.stdout:3/934: write d1/d1e/fee [1918190,1376] 0 2024-05-09T06:30:10.326 INFO:tasks.workunit.client.0.smithi062.stdout:3/935: fsync d1/d1e/d26/ddd/d52/d6a/da4/f124 0 2024-05-09T06:30:10.326 INFO:tasks.workunit.client.0.smithi062.stdout:3/936: truncate d1/d1e/d36/d9f/d4f/fe7 927354 0 2024-05-09T06:30:10.342 INFO:tasks.workunit.client.0.smithi062.stdout:3/937: dwrite d1/f9d [0,4194304] 0 2024-05-09T06:30:10.343 INFO:tasks.workunit.client.0.smithi062.stdout:3/938: mkdir d1/d1e/d36/d9f/d4f/dd2/dd3/d13e 0 2024-05-09T06:30:10.345 INFO:tasks.workunit.client.0.smithi062.stdout:3/939: unlink d1/d1e/d36/d9f/f79 0 2024-05-09T06:30:10.353 INFO:tasks.workunit.client.0.smithi062.stdout:3/940: dread d1/d1e/d26/ddd/d52/d6a/da4/fd4 [0,4194304] 0 2024-05-09T06:30:10.355 INFO:tasks.workunit.client.0.smithi062.stdout:3/941: truncate d1/d1e/d26/ddd/ddf/d10e/f9b 1114344 0 2024-05-09T06:30:10.373 INFO:tasks.workunit.client.0.smithi062.stdout:3/942: rename d1/d1e/d36/daa to d1/d1e/d26/d13f 0 2024-05-09T06:30:10.374 INFO:tasks.workunit.client.0.smithi062.stdout:3/943: creat d1/d1e/d36/df0/f140 x:0 0 0 2024-05-09T06:30:10.380 INFO:tasks.workunit.client.0.smithi062.stdout:3/944: write d1/f2f [2081547,698] 0 2024-05-09T06:30:10.385 INFO:tasks.workunit.client.0.smithi062.stdout:3/945: truncate d1/d1e/d36/d3a/f67 3539876 0 2024-05-09T06:30:10.385 INFO:tasks.workunit.client.0.smithi062.stdout:3/946: chown d1/d1e/d26/ddd/d52/d6a/da4/de1 31924289 1 2024-05-09T06:30:10.409 INFO:tasks.workunit.client.0.smithi062.stdout:3/947: dwrite d1/d1e/d3b/d83/da5/d102/f50 [0,4194304] 0 2024-05-09T06:30:10.409 INFO:tasks.workunit.client.0.smithi062.stdout:3/948: read d1/d1e/d26/df3/f12b [1206537,44961] 0 2024-05-09T06:30:10.422 INFO:tasks.workunit.client.0.smithi062.stdout:3/949: dread d1/d1e/d26/ddd/d52/d6a/f123 [0,4194304] 0 2024-05-09T06:30:10.423 INFO:tasks.workunit.client.0.smithi062.stdout:3/950: write d1/d1e/d26/ddd/f78 [473904,43808] 0 2024-05-09T06:30:10.425 INFO:tasks.workunit.client.0.smithi062.stdout:3/951: rename d1/d1e/d26/ddd/ddf/d10e/lf6 to d1/d1e/d36/d9f/d4f/l141 0 2024-05-09T06:30:10.427 INFO:tasks.workunit.client.0.smithi062.stdout:3/952: mkdir d1/d10c/d142 0 2024-05-09T06:30:10.428 INFO:tasks.workunit.client.0.smithi062.stdout:3/953: mknod d1/d1e/d36/d9f/d4f/c143 0 2024-05-09T06:30:10.430 INFO:tasks.workunit.client.0.smithi062.stdout:3/954: creat d1/d10c/d142/f144 x:0 0 0 2024-05-09T06:30:10.432 INFO:tasks.workunit.client.0.smithi062.stdout:3/955: rmdir d1/d1e/dda 0 2024-05-09T06:30:10.433 INFO:tasks.workunit.client.0.smithi062.stdout:3/956: dread - d1/d1e/d36/d3a/d89/d137/d138/f12f zero size 2024-05-09T06:30:10.434 INFO:tasks.workunit.client.0.smithi062.stdout:3/957: mkdir d1/d1e/d36/d9f/d4f/d145 0 2024-05-09T06:30:10.435 INFO:tasks.workunit.client.0.smithi062.stdout:3/958: rmdir d1/d1e/d36/d9f/d4f/dd2/dd3/d13e 0 2024-05-09T06:30:10.435 INFO:tasks.workunit.client.0.smithi062.stdout:3/959: dread - d1/d1e/d36/dfc/f12d zero size 2024-05-09T06:30:10.437 INFO:tasks.workunit.client.0.smithi062.stdout:3/960: rmdir d1/d1e/d36/dfc 39 2024-05-09T06:30:10.439 INFO:tasks.workunit.client.0.smithi062.stdout:3/961: unlink d1/d1e/d26/d13f/c106 0 2024-05-09T06:30:10.440 INFO:tasks.workunit.client.0.smithi062.stdout:3/962: mkdir d1/d1e/d36/d9f/d4f/dd2/dd3/d146 0 2024-05-09T06:30:10.445 INFO:tasks.workunit.client.0.smithi062.stdout:3/963: mkdir d1/d10c/d142/d147 0 2024-05-09T06:30:10.445 INFO:tasks.workunit.client.0.smithi062.stdout:3/964: creat d1/d1e/d26/ddd/d52/d6a/da4/de1/f148 x:0 0 0 2024-05-09T06:30:10.450 INFO:tasks.workunit.client.0.smithi062.stdout:3/965: mknod d1/d1e/d36/d9f/d4f/dd2/c149 0 2024-05-09T06:30:10.452 INFO:tasks.workunit.client.0.smithi062.stdout:3/966: truncate d1/d1e/d36/d9f/f65 418918 0 2024-05-09T06:30:10.456 INFO:tasks.workunit.client.0.smithi062.stdout:3/967: creat d1/d10c/f14a x:0 0 0 2024-05-09T06:30:10.459 INFO:tasks.workunit.client.0.smithi062.stdout:1/773: sync 2024-05-09T06:30:10.459 INFO:tasks.workunit.client.0.smithi062.stdout:2/958: sync 2024-05-09T06:30:10.459 INFO:tasks.workunit.client.0.smithi062.stdout:2/959: fsync d0/d9/d17/d89/f138 0 2024-05-09T06:30:10.459 INFO:tasks.workunit.client.0.smithi062.stdout:2/960: fdatasync d0/d9/dd/d65/d6d/d21/d29/d40/f95 0 2024-05-09T06:30:10.460 INFO:tasks.workunit.client.0.smithi062.stdout:3/968: getdents d1/d1e/d3b/d83 0 2024-05-09T06:30:10.460 INFO:tasks.workunit.client.0.smithi062.stdout:3/969: creat d1/d1e/d26/ddd/ddf/f14b x:0 0 0 2024-05-09T06:30:10.460 INFO:tasks.workunit.client.0.smithi062.stdout:3/970: stat d1/d1e/d26/ddd/d52/d6a/cc7 0 2024-05-09T06:30:10.466 INFO:tasks.workunit.client.0.smithi062.stdout:3/971: getdents d1/d1e/d3b/d83/de5 0 2024-05-09T06:30:10.466 INFO:tasks.workunit.client.0.smithi062.stdout:3/972: write d1/d1e/d3b/d83/da5/d102/f57 [430597,26541] 0 2024-05-09T06:30:10.467 INFO:tasks.workunit.client.0.smithi062.stdout:3/973: stat d1/d1e/d26 0 2024-05-09T06:30:10.467 INFO:tasks.workunit.client.0.smithi062.stdout:3/974: fdatasync d1/d1e/d3b/d83/da5/d102/f4c 0 2024-05-09T06:30:10.467 INFO:tasks.workunit.client.0.smithi062.stdout:3/975: readlink d1/d1e/d36/d9f/d4f/l94 0 2024-05-09T06:30:10.468 INFO:tasks.workunit.client.0.smithi062.stdout:2/961: dread d0/d9/dd/f5e [0,4194304] 0 2024-05-09T06:30:10.468 INFO:tasks.workunit.client.0.smithi062.stdout:2/962: fsync d0/d9/d38/d41/d53/f63 0 2024-05-09T06:30:10.470 INFO:tasks.workunit.client.0.smithi062.stdout:3/976: stat d1/d1e/d54/c6e 0 2024-05-09T06:30:10.470 INFO:tasks.workunit.client.0.smithi062.stdout:3/977: fsync d1/f112 0 2024-05-09T06:30:10.472 INFO:tasks.workunit.client.0.smithi062.stdout:2/963: mknod d0/d90/db7/d11d/c13c 0 2024-05-09T06:30:10.472 INFO:tasks.workunit.client.0.smithi062.stdout:2/964: readlink d0/d9/dd9/d93/l12a 0 2024-05-09T06:30:10.473 INFO:tasks.workunit.client.0.smithi062.stdout:1/774: dwrite d8/d14/d2b/d3c/d44/ff0 [0,4194304] 0 2024-05-09T06:30:10.474 INFO:tasks.workunit.client.0.smithi062.stdout:3/978: truncate d1/d1e/d26/ddd/d52/d6a/f71 1154438 0 2024-05-09T06:30:10.474 INFO:tasks.workunit.client.0.smithi062.stdout:3/979: chown d1/d1e/d36/d9f/d4f/l94 149809460 1 2024-05-09T06:30:10.474 INFO:tasks.workunit.client.0.smithi062.stdout:3/980: rename d1/d10c/d142/d147 to d1/d10c/d142/d147/d14c 22 2024-05-09T06:30:10.479 INFO:tasks.workunit.client.0.smithi062.stdout:1/775: creat d8/d14/d2b/d3c/d44/ff7 x:0 0 0 2024-05-09T06:30:10.479 INFO:tasks.workunit.client.0.smithi062.stdout:1/776: write d8/d14/d2b/d3c/d44/d6e/f73 [1749921,78832] 0 2024-05-09T06:30:10.482 INFO:tasks.workunit.client.0.smithi062.stdout:2/965: write d0/d9/dd/fd5 [1275331,32262] 0 2024-05-09T06:30:10.484 INFO:tasks.workunit.client.0.smithi062.stdout:3/981: mkdir d1/d1e/d36/d3a/d4e/d14d 0 2024-05-09T06:30:10.484 INFO:tasks.workunit.client.0.smithi062.stdout:3/982: dread - d1/d1e/d36/d134/f13d zero size 2024-05-09T06:30:10.489 INFO:tasks.workunit.client.0.smithi062.stdout:1/777: dread d8/d14/d2b/d3c/d44/f3a [0,4194304] 0 2024-05-09T06:30:10.493 INFO:tasks.workunit.client.0.smithi062.stdout:2/966: symlink d0/d9/d38/d41/d48/d5f/d10c/l13d 0 2024-05-09T06:30:10.493 INFO:tasks.workunit.client.0.smithi062.stdout:2/967: readlink d0/d9/dd/d65/d6d/d21/d29/d3d/l134 0 2024-05-09T06:30:10.493 INFO:tasks.workunit.client.0.smithi062.stdout:3/983: write d1/f99 [1123247,60903] 0 2024-05-09T06:30:10.493 INFO:tasks.workunit.client.0.smithi062.stdout:3/984: chown d1/d1e/d36/d9f/f65 5951 1 2024-05-09T06:30:10.494 INFO:tasks.workunit.client.0.smithi062.stdout:2/968: mkdir d0/d9/d38/d41/d53/d13e 0 2024-05-09T06:30:10.495 INFO:tasks.workunit.client.0.smithi062.stdout:2/969: rmdir d0/d9/dd/d65/d6d/d21 39 2024-05-09T06:30:10.495 INFO:tasks.workunit.client.0.smithi062.stdout:2/970: write d0/d90/db7/fcf [213652,105441] 0 2024-05-09T06:30:10.497 INFO:tasks.workunit.client.0.smithi062.stdout:1/778: dread d8/d14/d2b/d3c/d44/d64/f68 [0,4194304] 0 2024-05-09T06:30:10.498 INFO:tasks.workunit.client.0.smithi062.stdout:1/779: creat d8/d14/d2b/d3c/d44/ff8 x:0 0 0 2024-05-09T06:30:10.502 INFO:tasks.workunit.client.0.smithi062.stdout:1/780: mkdir d8/d14/d2b/de4/df9 0 2024-05-09T06:30:10.503 INFO:tasks.workunit.client.0.smithi062.stdout:1/781: symlink d8/d14/lfa 0 2024-05-09T06:30:10.514 INFO:tasks.workunit.client.0.smithi062.stdout:3/985: dwrite d1/d1e/d54/d8c/ff7 [0,4194304] 0 2024-05-09T06:30:10.514 INFO:tasks.workunit.client.0.smithi062.stdout:3/986: creat d1/d1e/d54/f14e x:0 0 0 2024-05-09T06:30:10.516 INFO:tasks.workunit.client.0.smithi062.stdout:3/987: mkdir d1/d1e/d36/d3a/d89/d137/d138/d14f 0 2024-05-09T06:30:10.516 INFO:tasks.workunit.client.0.smithi062.stdout:3/988: write d1/d1e/d26/ddd/ddf/d10e/f6b [1528915,65701] 0 2024-05-09T06:30:10.522 INFO:tasks.workunit.client.0.smithi062.stdout:2/971: dwrite d0/d9/d38/d41/d48/f4b [0,4194304] 0 2024-05-09T06:30:10.523 INFO:tasks.workunit.client.0.smithi062.stdout:1/782: dwrite d8/d1d/f74 [4194304,4194304] 0 2024-05-09T06:30:10.523 INFO:tasks.workunit.client.0.smithi062.stdout:1/783: fdatasync d8/d14/d2b/d3c/d44/f63 0 2024-05-09T06:30:10.526 INFO:tasks.workunit.client.0.smithi062.stdout:1/784: symlink d8/d14/d2b/lfb 0 2024-05-09T06:30:10.527 INFO:tasks.workunit.client.0.smithi062.stdout:2/972: getdents d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d 0 2024-05-09T06:30:10.535 INFO:tasks.workunit.client.0.smithi062.stdout:3/989: dwrite d1/d1e/d36/f49 [0,4194304] 0 2024-05-09T06:30:10.535 INFO:tasks.workunit.client.0.smithi062.stdout:3/990: write d1/d1e/d36/d3a/d89/d137/d138/f12f [897258,60139] 0 2024-05-09T06:30:10.556 INFO:tasks.workunit.client.0.smithi062.stdout:1/785: dwrite d8/d14/d2b/d3c/f46 [0,4194304] 0 2024-05-09T06:30:10.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/786: mkdir d8/d1d/dc7/dd5/dfc 0 2024-05-09T06:30:10.558 INFO:tasks.workunit.client.0.smithi062.stdout:1/787: stat d8/d14/f72 0 2024-05-09T06:30:10.558 INFO:tasks.workunit.client.0.smithi062.stdout:3/991: dwrite d1/d1e/d26/f3c [0,4194304] 0 2024-05-09T06:30:10.559 INFO:tasks.workunit.client.0.smithi062.stdout:1/788: link d8/d14/d2b/l5d d8/d14/d2b/d3c/d44/d64/lfd 0 2024-05-09T06:30:10.560 INFO:tasks.workunit.client.0.smithi062.stdout:3/992: symlink d1/d1e/d36/d9f/d4f/d115/l150 0 2024-05-09T06:30:10.561 INFO:tasks.workunit.client.0.smithi062.stdout:1/789: mknod d8/d1d/d70/cfe 0 2024-05-09T06:30:10.562 INFO:tasks.workunit.client.0.smithi062.stdout:1/790: creat d8/d1d/fff x:0 0 0 2024-05-09T06:30:10.564 INFO:tasks.workunit.client.0.smithi062.stdout:3/993: dread d1/d1e/d54/d8c/fc5 [0,4194304] 0 2024-05-09T06:30:10.564 INFO:tasks.workunit.client.0.smithi062.stdout:3/994: fsync d1/d1e/d3b/d83/d12c/f12e 0 2024-05-09T06:30:10.564 INFO:tasks.workunit.client.0.smithi062.stdout:3/995: fsync d1/d1e/d54/f93 0 2024-05-09T06:30:10.564 INFO:tasks.workunit.client.0.smithi062.stdout:3/996: mkdir d1/d1e/d36/d6c/d151 0 2024-05-09T06:30:10.566 INFO:tasks.workunit.client.0.smithi062.stdout:3/997: mkdir d1/d1e/d26/ddd/d152 0 2024-05-09T06:30:10.568 INFO:tasks.workunit.client.0.smithi062.stdout:3/998: symlink d1/d1e/d26/ddd/ddf/d10e/l153 0 2024-05-09T06:30:10.570 INFO:tasks.workunit.client.0.smithi062.stdout:3/999: rmdir d1/d1e/d3b 39 2024-05-09T06:30:10.571 INFO:tasks.workunit.client.0.smithi062.stdout:1/791: write f5 [6402075,94114] 0 2024-05-09T06:30:10.573 INFO:tasks.workunit.client.0.smithi062.stdout:1/792: mknod d8/d14/d2b/d3c/d44/d38/c100 0 2024-05-09T06:30:10.575 INFO:tasks.workunit.client.0.smithi062.stdout:1/793: rmdir d8/d1d/d9c/d41 39 2024-05-09T06:30:10.575 INFO:tasks.workunit.client.0.smithi062.stdout:1/794: chown d8/d14/d2b/d3c/d44/d38/dbe/fcb 208796 1 2024-05-09T06:30:10.590 INFO:tasks.workunit.client.0.smithi062.stdout:1/795: dwrite d8/d14/d2b/d3c/d44/d6e/d7a/d80/fac [0,4194304] 0 2024-05-09T06:30:10.590 INFO:tasks.workunit.client.0.smithi062.stdout:1/796: creat d8/f101 x:0 0 0 2024-05-09T06:30:10.595 INFO:tasks.workunit.client.0.smithi062.stdout:1/797: mknod d8/d14/d2b/d3c/d44/c102 0 2024-05-09T06:30:10.598 INFO:tasks.workunit.client.0.smithi062.stdout:1/798: mkdir d8/d14/d2b/d3c/d44/d6e/d98/dc0/d103 0 2024-05-09T06:30:10.598 INFO:tasks.workunit.client.0.smithi062.stdout:1/799: read d8/d14/d2b/d3c/d44/d6e/d98/dc0/fe5 [3348363,125555] 0 2024-05-09T06:30:10.598 INFO:tasks.workunit.client.0.smithi062.stdout:1/800: dread - d8/d14/d2b/d3c/d7d/fba zero size 2024-05-09T06:30:10.600 INFO:tasks.workunit.client.0.smithi062.stdout:1/801: creat d8/d14/d2b/d3c/d44/d6e/f104 x:0 0 0 2024-05-09T06:30:10.602 INFO:tasks.workunit.client.0.smithi062.stdout:1/802: creat d8/d14/d2b/d3c/da5/f105 x:0 0 0 2024-05-09T06:30:10.606 INFO:tasks.workunit.client.0.smithi062.stdout:1/803: mkdir d8/d14/d2b/d106 0 2024-05-09T06:30:10.608 INFO:tasks.workunit.client.0.smithi062.stdout:1/804: creat d8/d14/d2b/de4/df9/f107 x:0 0 0 2024-05-09T06:30:10.622 INFO:tasks.workunit.client.0.smithi062.stdout:1/805: dwrite d8/d14/f72 [0,4194304] 0 2024-05-09T06:30:10.624 INFO:tasks.workunit.client.0.smithi062.stdout:1/806: rmdir d8/d14/d2b/d3c/d44/d7f 39 2024-05-09T06:30:10.624 INFO:tasks.workunit.client.0.smithi062.stdout:1/807: chown d8/d14/d2b/d3c/d76/dd2 290 1 2024-05-09T06:30:10.626 INFO:tasks.workunit.client.0.smithi062.stdout:1/808: mknod d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/c108 0 2024-05-09T06:30:10.626 INFO:tasks.workunit.client.0.smithi062.stdout:1/809: chown d8/l60 2313 1 2024-05-09T06:30:10.626 INFO:tasks.workunit.client.0.smithi062.stdout:1/810: dread - d8/d14/d2b/d3c/da5/f105 zero size 2024-05-09T06:30:10.632 INFO:tasks.workunit.client.0.smithi062.stdout:1/811: dread d8/d14/f1b [0,4194304] 0 2024-05-09T06:30:10.633 INFO:tasks.workunit.client.0.smithi062.stdout:1/812: symlink d8/d14/d2b/d106/l109 0 2024-05-09T06:30:10.633 INFO:tasks.workunit.client.0.smithi062.stdout:1/813: write d8/d14/d2b/d3c/d44/fcc [1735112,84262] 0 2024-05-09T06:30:10.633 INFO:tasks.workunit.client.0.smithi062.stdout:1/814: creat d8/f10a x:0 0 0 2024-05-09T06:30:10.634 INFO:tasks.workunit.client.0.smithi062.stdout:1/815: mknod d8/d14/d2b/d9d/c10b 0 2024-05-09T06:30:10.637 INFO:tasks.workunit.client.0.smithi062.stdout:1/816: rmdir d8/d14/d2b/d3c/da5/dcf 39 2024-05-09T06:30:10.638 INFO:tasks.workunit.client.0.smithi062.stdout:1/817: mknod d8/d14/d2b/d3c/d44/d38/c10c 0 2024-05-09T06:30:10.638 INFO:tasks.workunit.client.0.smithi062.stdout:1/818: write d8/d14/d2b/d3c/d44/d6e/d7a/f84 [738527,54886] 0 2024-05-09T06:30:10.638 INFO:tasks.workunit.client.0.smithi062.stdout:1/819: write d8/d14/d2b/de4/df9/f107 [336138,23967] 0 2024-05-09T06:30:10.638 INFO:tasks.workunit.client.0.smithi062.stdout:1/820: creat d8/d1d/d70/f10d x:0 0 0 2024-05-09T06:30:10.640 INFO:tasks.workunit.client.0.smithi062.stdout:1/821: symlink d8/d14/d2b/d3c/d44/d38/db6/l10e 0 2024-05-09T06:30:10.641 INFO:tasks.workunit.client.0.smithi062.stdout:1/822: dread - d8/d14/d2b/d3c/d44/d7f/fce zero size 2024-05-09T06:30:10.641 INFO:tasks.workunit.client.0.smithi062.stdout:1/823: fsync f5 0 2024-05-09T06:30:10.641 INFO:tasks.workunit.client.0.smithi062.stdout:1/824: symlink d8/d14/d2b/d3c/d44/d38/db6/l10f 0 2024-05-09T06:30:10.646 INFO:tasks.workunit.client.0.smithi062.stdout:1/825: dread d8/d14/d2b/d3c/d44/d6e/d98/dc0/fe5 [0,4194304] 0 2024-05-09T06:30:10.646 INFO:tasks.workunit.client.0.smithi062.stdout:1/826: stat d8/lf 0 2024-05-09T06:30:10.648 INFO:tasks.workunit.client.0.smithi062.stdout:1/827: read d8/d1d/dc7/dd5/fc6 [279572,103563] 0 2024-05-09T06:30:10.650 INFO:tasks.workunit.client.0.smithi062.stdout:1/828: rename d8/d14/d2b/d3c/d44/d64/f68 to d8/d14/d2b/d3c/d44/d38/dbe/f110 0 2024-05-09T06:30:10.650 INFO:tasks.workunit.client.0.smithi062.stdout:1/829: dread - d8/d14/d2b/d3c/d7d/fad zero size 2024-05-09T06:30:10.651 INFO:tasks.workunit.client.0.smithi062.stdout:1/830: mknod d8/d14/d2b/d3c/d76/dd2/c111 0 2024-05-09T06:30:10.653 INFO:tasks.workunit.client.0.smithi062.stdout:1/831: rename d8/fd7 to d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/f112 0 2024-05-09T06:30:10.666 INFO:tasks.workunit.client.0.smithi062.stdout:1/832: dwrite d8/f5a [0,4194304] 0 2024-05-09T06:30:10.666 INFO:tasks.workunit.client.0.smithi062.stdout:1/833: stat d8/d14/d2b/de4 0 2024-05-09T06:30:10.673 INFO:tasks.workunit.client.0.smithi062.stdout:1/834: rmdir d8/d14 39 2024-05-09T06:30:10.673 INFO:tasks.workunit.client.0.smithi062.stdout:1/835: creat d8/d14/d2b/d3c/f113 x:0 0 0 2024-05-09T06:30:10.684 INFO:tasks.workunit.client.0.smithi062.stdout:2/973: sync 2024-05-09T06:30:10.684 INFO:tasks.workunit.client.0.smithi062.stdout:2/974: fdatasync d0/d9/d38/d41/fb0 0 2024-05-09T06:30:10.691 INFO:tasks.workunit.client.0.smithi062.stdout:1/836: dwrite d8/d1d/f25 [0,4194304] 0 2024-05-09T06:30:10.691 INFO:tasks.workunit.client.0.smithi062.stdout:1/837: truncate d8/d1d/dc7/dd5/fc6 2104110 0 2024-05-09T06:30:10.694 INFO:tasks.workunit.client.0.smithi062.stdout:1/838: getdents d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0 0 2024-05-09T06:30:10.694 INFO:tasks.workunit.client.0.smithi062.stdout:1/839: readlink d8/d14/d2b/d3c/d44/d38/db6/l10e 0 2024-05-09T06:30:10.694 INFO:tasks.workunit.client.0.smithi062.stdout:1/840: chown d8/d14/d2b/d3c/d44/ff8 4121323 1 2024-05-09T06:30:10.695 INFO:tasks.workunit.client.0.smithi062.stdout:1/841: creat d8/d14/d2b/d106/f114 x:0 0 0 2024-05-09T06:30:10.697 INFO:tasks.workunit.client.0.smithi062.stdout:1/842: symlink d8/d14/d2b/d3c/d44/d7f/l115 0 2024-05-09T06:30:10.698 INFO:tasks.workunit.client.0.smithi062.stdout:1/843: mkdir d8/d14/d2b/d3c/d7d/deb/d116 0 2024-05-09T06:30:10.699 INFO:tasks.workunit.client.0.smithi062.stdout:2/975: dwrite d0/d9/dd/d65/d6d/f103 [0,4194304] 0 2024-05-09T06:30:10.700 INFO:tasks.workunit.client.0.smithi062.stdout:2/976: chown d0/d9/dd/d65/f71 938 1 2024-05-09T06:30:10.709 INFO:tasks.workunit.client.0.smithi062.stdout:1/844: dread d8/d1d/f25 [0,4194304] 0 2024-05-09T06:30:10.719 INFO:tasks.workunit.client.0.smithi062.stdout:2/977: dwrite d0/d9/dd9/d93/fc3 [0,4194304] 0 2024-05-09T06:30:10.720 INFO:tasks.workunit.client.0.smithi062.stdout:2/978: creat d0/d9/dd/d65/f13f x:0 0 0 2024-05-09T06:30:10.726 INFO:tasks.workunit.client.0.smithi062.stdout:2/979: symlink d0/d9/dd/d65/d6d/d96/da4/l140 0 2024-05-09T06:30:10.980 INFO:tasks.workunit.client.0.smithi062.stdout:1/845: sync 2024-05-09T06:30:10.980 INFO:tasks.workunit.client.0.smithi062.stdout:2/980: sync 2024-05-09T06:30:10.980 INFO:tasks.workunit.client.0.smithi062.stdout:1/846: chown d8/d14/d2b/d3c/d44/d6e 45149 1 2024-05-09T06:30:10.980 INFO:tasks.workunit.client.0.smithi062.stdout:1/847: chown d8/d14/d2b/d3c/d44/d6e/d7a/d80/ce2 422781 1 2024-05-09T06:30:10.981 INFO:tasks.workunit.client.0.smithi062.stdout:1/848: dread d8/d14/d2b/de4/df9/f107 [0,4194304] 0 2024-05-09T06:30:10.981 INFO:tasks.workunit.client.0.smithi062.stdout:1/849: fdatasync d8/d14/d2b/d3c/d44/ff7 0 2024-05-09T06:30:10.982 INFO:tasks.workunit.client.0.smithi062.stdout:2/981: mkdir d0/d9/dd/d65/d6d/d96/da4/d141 0 2024-05-09T06:30:10.982 INFO:tasks.workunit.client.0.smithi062.stdout:2/982: chown d0/d9/d38/d41/d94 122622668 1 2024-05-09T06:30:10.982 INFO:tasks.workunit.client.0.smithi062.stdout:2/983: chown d0/d9/d17/f73 0 1 2024-05-09T06:30:10.983 INFO:tasks.workunit.client.0.smithi062.stdout:1/850: mknod d8/d14/d2b/d3c/da5/c117 0 2024-05-09T06:30:10.983 INFO:tasks.workunit.client.0.smithi062.stdout:1/851: write d8/d14/d2b/d3c/d44/d6e/d98/dc0/fe5 [3879265,60745] 0 2024-05-09T06:30:10.985 INFO:tasks.workunit.client.0.smithi062.stdout:2/984: creat d0/d9/dd/d65/d6d/d21/d29/d3d/d46/d5d/f142 x:0 0 0 2024-05-09T06:30:10.988 INFO:tasks.workunit.client.0.smithi062.stdout:1/852: rmdir d8/d14/d2b/d9d 39 2024-05-09T06:30:10.990 INFO:tasks.workunit.client.0.smithi062.stdout:1/853: getdents d8/d14/d2b/de4 0 2024-05-09T06:30:10.996 INFO:tasks.workunit.client.0.smithi062.stdout:1/854: rmdir d8/d14/d2b/d3c/d44/d6e 39 2024-05-09T06:30:10.998 INFO:tasks.workunit.client.0.smithi062.stdout:1/855: rename d8/d1d/dc7/dd5 to d8/d1d/d9c/d41/d118 0 2024-05-09T06:30:10.998 INFO:tasks.workunit.client.0.smithi062.stdout:1/856: stat d8/d14/d2b/d3c/db0 0 2024-05-09T06:30:10.998 INFO:tasks.workunit.client.0.smithi062.stdout:1/857: creat d8/d14/d2b/d3c/d44/d38/db6/f119 x:0 0 0 2024-05-09T06:30:10.999 INFO:tasks.workunit.client.0.smithi062.stdout:1/858: creat d8/d14/d2b/d3c/d44/d7f/f11a x:0 0 0 2024-05-09T06:30:11.000 INFO:tasks.workunit.client.0.smithi062.stdout:1/859: mkdir d8/d14/d2b/d3c/d7d/d11b 0 2024-05-09T06:30:11.000 INFO:tasks.workunit.client.0.smithi062.stdout:1/860: stat d8/d1d/f74 0 2024-05-09T06:30:11.002 INFO:tasks.workunit.client.0.smithi062.stdout:1/861: write d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 [504506,88706] 0 2024-05-09T06:30:11.003 INFO:tasks.workunit.client.0.smithi062.stdout:2/985: dwrite d0/d9/d17/d89/ff5 [0,4194304] 0 2024-05-09T06:30:11.003 INFO:tasks.workunit.client.0.smithi062.stdout:2/986: write d0/d9/d17/f1d [8780026,68749] 0 2024-05-09T06:30:11.004 INFO:tasks.workunit.client.0.smithi062.stdout:2/987: dread d0/d9/d38/d41/d48/d5f/fc8 [0,4194304] 0 2024-05-09T06:30:11.004 INFO:tasks.workunit.client.0.smithi062.stdout:2/988: fsync d0/d9/dd/d65/d6d/d21/d29/d40/f75 0 2024-05-09T06:30:11.004 INFO:tasks.workunit.client.0.smithi062.stdout:1/862: rename d8/d14/d2b/d3c/db0/fb1 to d8/d14/f11c 0 2024-05-09T06:30:11.004 INFO:tasks.workunit.client.0.smithi062.stdout:1/863: write f6 [1233013,73558] 0 2024-05-09T06:30:11.006 INFO:tasks.workunit.client.0.smithi062.stdout:2/989: mknod d0/d9/dd/d65/d6d/d96/c143 0 2024-05-09T06:30:11.008 INFO:tasks.workunit.client.0.smithi062.stdout:2/990: dread d0/d9/dd/f33 [0,4194304] 0 2024-05-09T06:30:11.008 INFO:tasks.workunit.client.0.smithi062.stdout:2/991: creat d0/d9/d38/dd6/f144 x:0 0 0 2024-05-09T06:30:11.011 INFO:tasks.workunit.client.0.smithi062.stdout:1/864: creat d8/d14/d2b/d3c/d44/d6e/d7a/f11d x:0 0 0 2024-05-09T06:30:11.011 INFO:tasks.workunit.client.0.smithi062.stdout:1/865: write d8/d14/d2b/d3c/d44/d64/f7b [3324743,123632] 0 2024-05-09T06:30:11.014 INFO:tasks.workunit.client.0.smithi062.stdout:2/992: creat d0/d9/d38/d41/d48/d5f/d10c/f145 x:0 0 0 2024-05-09T06:30:11.014 INFO:tasks.workunit.client.0.smithi062.stdout:2/993: fdatasync d0/d9/dd/f5e 0 2024-05-09T06:30:11.014 INFO:tasks.workunit.client.0.smithi062.stdout:2/994: truncate d0/ffe 842842 0 2024-05-09T06:30:11.018 INFO:tasks.workunit.client.0.smithi062.stdout:2/995: creat d0/d9/d38/d41/de1/df6/f146 x:0 0 0 2024-05-09T06:30:11.021 INFO:tasks.workunit.client.0.smithi062.stdout:2/996: creat d0/d9/dd/d65/d6d/d21/d29/d40/f147 x:0 0 0 2024-05-09T06:30:11.025 INFO:tasks.workunit.client.0.smithi062.stdout:2/997: creat d0/d9/d17/d89/d8f/f148 x:0 0 0 2024-05-09T06:30:11.025 INFO:tasks.workunit.client.0.smithi062.stdout:1/866: dwrite d8/d14/d2b/d3c/d44/ff0 [0,4194304] 0 2024-05-09T06:30:11.025 INFO:tasks.workunit.client.0.smithi062.stdout:1/867: write d8/d14/d2b/d3c/d44/d6e/d7a/f84 [1061799,95195] 0 2024-05-09T06:30:11.025 INFO:tasks.workunit.client.0.smithi062.stdout:1/868: stat d8/d14/d2b/d3d/lf5 0 2024-05-09T06:30:11.028 INFO:tasks.workunit.client.0.smithi062.stdout:1/869: fsync d8/d14/f1b 0 2024-05-09T06:30:11.028 INFO:tasks.workunit.client.0.smithi062.stdout:1/870: read - d8/d14/d2b/d3c/d44/ff8 zero size 2024-05-09T06:30:11.028 INFO:tasks.workunit.client.0.smithi062.stdout:2/998: rename d0/d9/d38/d41/de1/dee/f13a to d0/d9/d38/d41/d48/f149 0 2024-05-09T06:30:11.030 INFO:tasks.workunit.client.0.smithi062.stdout:1/871: dread d8/d1d/d9c/d41/d118/fc6 [0,4194304] 0 2024-05-09T06:30:11.031 INFO:tasks.workunit.client.0.smithi062.stdout:2/999: symlink d0/d9/d38/d41/d48/l14a 0 2024-05-09T06:30:11.033 INFO:tasks.workunit.client.0.smithi062.stdout:1/872: mkdir d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/d11e 0 2024-05-09T06:30:11.033 INFO:tasks.workunit.client.0.smithi062.stdout:1/873: fsync d8/d1d/d70/f10d 0 2024-05-09T06:30:11.327 INFO:tasks.workunit.client.0.smithi062.stdout:1/874: sync 2024-05-09T06:30:11.327 INFO:tasks.workunit.client.0.smithi062.stdout:1/875: write d8/d14/d2b/d3c/d44/d6e/d98/fe0 [235580,50282] 0 2024-05-09T06:30:11.330 INFO:tasks.workunit.client.0.smithi062.stdout:1/876: mknod d8/d1d/d9c/d41/d118/dfc/c11f 0 2024-05-09T06:30:11.331 INFO:tasks.workunit.client.0.smithi062.stdout:1/877: symlink d8/d14/d2b/d3c/d7d/df6/l120 0 2024-05-09T06:30:11.333 INFO:tasks.workunit.client.0.smithi062.stdout:1/878: rename d8/d1d/d9c/d41/d118/fc6 to d8/d14/d2b/d3c/d76/dd2/f121 0 2024-05-09T06:30:11.334 INFO:tasks.workunit.client.0.smithi062.stdout:1/879: symlink d8/d14/d2b/d3c/d44/d6e/d98/dc0/d103/l122 0 2024-05-09T06:30:11.341 INFO:tasks.workunit.client.0.smithi062.stdout:1/880: dread d8/d14/d2b/d3c/da5/dcf/fd8 [0,4194304] 0 2024-05-09T06:30:11.355 INFO:tasks.workunit.client.0.smithi062.stdout:1/881: dwrite d8/d14/d2b/d3c/d44/d7f/fd3 [0,4194304] 0 2024-05-09T06:30:11.357 INFO:tasks.workunit.client.0.smithi062.stdout:1/882: symlink d8/d14/d2b/l123 0 2024-05-09T06:30:11.360 INFO:tasks.workunit.client.0.smithi062.stdout:1/883: mknod d8/d1d/d91/c124 0 2024-05-09T06:30:11.363 INFO:tasks.workunit.client.0.smithi062.stdout:1/884: rename d8/d1d/f58 to d8/d14/d2b/d3c/d44/d6e/d98/f125 0 2024-05-09T06:30:11.363 INFO:tasks.workunit.client.0.smithi062.stdout:1/885: fsync d8/fc9 0 2024-05-09T06:30:11.363 INFO:tasks.workunit.client.0.smithi062.stdout:1/886: write d8/d14/d2b/d3c/d44/d6e/d98/fe0 [674361,67083] 0 2024-05-09T06:30:11.366 INFO:tasks.workunit.client.0.smithi062.stdout:1/887: creat d8/d1d/d9c/d41/d118/dfc/f126 x:0 0 0 2024-05-09T06:30:11.367 INFO:tasks.workunit.client.0.smithi062.stdout:1/888: getdents d8/d14/d2b/d3c/d44/d64 0 2024-05-09T06:30:11.375 INFO:tasks.workunit.client.0.smithi062.stdout:1/889: dread d8/d14/d2b/d3c/d44/d64/f7b [0,4194304] 0 2024-05-09T06:30:11.381 INFO:tasks.workunit.client.0.smithi062.stdout:1/890: dread d8/d14/d2b/f2e [0,4194304] 0 2024-05-09T06:30:11.385 INFO:tasks.workunit.client.0.smithi062.stdout:1/891: write d8/d14/d2b/f2e [2459222,53993] 0 2024-05-09T06:30:11.387 INFO:tasks.workunit.client.0.smithi062.stdout:1/892: creat d8/d14/d2b/d3c/d7d/deb/d116/f127 x:0 0 0 2024-05-09T06:30:11.387 INFO:tasks.workunit.client.0.smithi062.stdout:1/893: fdatasync d8/d14/d2b/d3c/d44/d38/f77 0 2024-05-09T06:30:11.387 INFO:tasks.workunit.client.0.smithi062.stdout:1/894: mknod d8/d14/d2b/d3c/d76/c128 0 2024-05-09T06:30:11.388 INFO:tasks.workunit.client.0.smithi062.stdout:1/895: write d8/d14/d2b/d3c/d44/ff7 [865486,16459] 0 2024-05-09T06:30:11.389 INFO:tasks.workunit.client.0.smithi062.stdout:1/896: dread d8/d14/d2b/d3c/d44/f3a [0,4194304] 0 2024-05-09T06:30:11.406 INFO:tasks.workunit.client.0.smithi062.stdout:1/897: dwrite d8/d1d/d9c/d41/f55 [4194304,4194304] 0 2024-05-09T06:30:11.407 INFO:tasks.workunit.client.0.smithi062.stdout:1/898: mknod d8/d14/d2b/d3c/d44/d6e/c129 0 2024-05-09T06:30:11.407 INFO:tasks.workunit.client.0.smithi062.stdout:1/899: write d8/d14/d2b/d106/f114 [415602,122825] 0 2024-05-09T06:30:11.407 INFO:tasks.workunit.client.0.smithi062.stdout:1/900: fsync d8/d1d/d91/f85 0 2024-05-09T06:30:11.410 INFO:tasks.workunit.client.0.smithi062.stdout:1/901: getdents d8/d1d 0 2024-05-09T06:30:11.432 INFO:tasks.workunit.client.0.smithi062.stdout:1/902: dwrite d8/d14/d2b/d3c/d44/ff8 [0,4194304] 0 2024-05-09T06:30:11.432 INFO:tasks.workunit.client.0.smithi062.stdout:1/903: stat d8/d1d/d70/ldb 0 2024-05-09T06:30:11.447 INFO:tasks.workunit.client.0.smithi062.stdout:1/904: dwrite d8/d1d/d70/f10d [0,4194304] 0 2024-05-09T06:30:11.451 INFO:tasks.workunit.client.0.smithi062.stdout:1/905: creat d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/d11e/f12a x:0 0 0 2024-05-09T06:30:11.455 INFO:tasks.workunit.client.0.smithi062.stdout:1/906: unlink d8/d14/f5e 0 2024-05-09T06:30:11.463 INFO:tasks.workunit.client.0.smithi062.stdout:1/907: dread d8/d14/f11c [0,4194304] 0 2024-05-09T06:30:11.463 INFO:tasks.workunit.client.0.smithi062.stdout:1/908: write d8/d14/d2b/d3c/d76/dd2/f121 [643914,100441] 0 2024-05-09T06:30:11.466 INFO:tasks.workunit.client.0.smithi062.stdout:1/909: dread d8/d14/d2b/d3c/d44/fcc [0,4194304] 0 2024-05-09T06:30:11.466 INFO:tasks.workunit.client.0.smithi062.stdout:1/910: readlink d8/d14/d2b/l5d 0 2024-05-09T06:30:11.473 INFO:tasks.workunit.client.0.smithi062.stdout:1/911: symlink d8/d14/d2b/d3c/d44/d6e/l12b 0 2024-05-09T06:30:11.477 INFO:tasks.workunit.client.0.smithi062.stdout:1/912: link d8/d14/d2b/f2e d8/d14/f12c 0 2024-05-09T06:30:11.493 INFO:tasks.workunit.client.0.smithi062.stdout:1/913: dwrite d8/d14/d2b/d3c/d44/d6e/d7a/d80/fdd [4194304,4194304] 0 2024-05-09T06:30:11.493 INFO:tasks.workunit.client.0.smithi062.stdout:1/914: write d8/d1d/fa4 [67610,126756] 0 2024-05-09T06:30:11.493 INFO:tasks.workunit.client.0.smithi062.stdout:1/915: chown d8/l60 188414 1 2024-05-09T06:30:11.494 INFO:tasks.workunit.client.0.smithi062.stdout:1/916: fsync d8/d14/d2b/d3c/da5/dcf/fd8 0 2024-05-09T06:30:11.502 INFO:tasks.workunit.client.0.smithi062.stdout:1/917: dread d8/f2a [0,4194304] 0 2024-05-09T06:30:11.502 INFO:tasks.workunit.client.0.smithi062.stdout:1/918: readlink d8/d14/d2b/d3c/d44/d7f/l86 0 2024-05-09T06:30:11.517 INFO:tasks.workunit.client.0.smithi062.stdout:1/919: dwrite d8/d14/d2b/d3c/d44/d38/f77 [0,4194304] 0 2024-05-09T06:30:11.521 INFO:tasks.workunit.client.0.smithi062.stdout:1/920: mknod d8/d14/d2b/d3c/d44/d38/c12d 0 2024-05-09T06:30:11.521 INFO:tasks.workunit.client.0.smithi062.stdout:1/921: fsync d8/d14/d2b/d3c/da5/dcf/fd8 0 2024-05-09T06:30:11.522 INFO:tasks.workunit.client.0.smithi062.stdout:1/922: creat d8/d14/d2b/d3c/db0/f12e x:0 0 0 2024-05-09T06:30:11.544 INFO:tasks.workunit.client.0.smithi062.stdout:1/923: dwrite d8/d1d/fff [0,4194304] 0 2024-05-09T06:30:11.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:11 smithi079 ceph-mon[35268]: pgmap v13: 65 pgs: 65 active+clean; 2.7 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 118 MiB/s rd, 135 MiB/s wr, 252 op/s 2024-05-09T06:30:11.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:11 smithi062 ceph-mon[26920]: pgmap v13: 65 pgs: 65 active+clean; 2.7 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 118 MiB/s rd, 135 MiB/s wr, 252 op/s 2024-05-09T06:30:11.699 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T06:30:11.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-09T06:30:11.914 INFO:tasks.workunit.client.0.smithi062.stdout:1/924: sync 2024-05-09T06:30:11.918 INFO:tasks.workunit.client.0.smithi062.stdout:1/925: getdents d8/d14/d2b/d3c/d44/d38 0 2024-05-09T06:30:11.936 INFO:tasks.workunit.client.0.smithi062.stdout:1/926: dread d8/d14/d2b/d3c/d44/ff0 [0,4194304] 0 2024-05-09T06:30:11.939 INFO:tasks.workunit.client.0.smithi062.stdout:1/927: symlink d8/l12f 0 2024-05-09T06:30:11.945 INFO:tasks.workunit.client.0.smithi062.stdout:1/928: link d8/d1d/d9c/db4/fee d8/d14/d2b/d3d/f130 0 2024-05-09T06:30:12.215 INFO:tasks.workunit.client.0.smithi062.stdout:1/929: sync 2024-05-09T06:30:12.216 INFO:tasks.workunit.client.0.smithi062.stdout:1/930: mknod d8/d1d/d9c/c131 0 2024-05-09T06:30:12.216 INFO:tasks.workunit.client.0.smithi062.stdout:1/931: creat d8/d14/d2b/d3c/d44/d38/db6/f132 x:0 0 0 2024-05-09T06:30:12.217 INFO:tasks.workunit.client.0.smithi062.stdout:1/932: truncate d8/d14/d2b/d3c/f6b 3006827 0 2024-05-09T06:30:12.217 INFO:tasks.workunit.client.0.smithi062.stdout:1/933: chown d8/d1d/dc7 14791 1 2024-05-09T06:30:12.239 INFO:tasks.workunit.client.0.smithi062.stdout:1/934: dwrite d8/f10a [0,4194304] 0 2024-05-09T06:30:12.244 INFO:tasks.workunit.client.0.smithi062.stdout:1/935: truncate d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 1115001 0 2024-05-09T06:30:12.246 INFO:tasks.workunit.client.0.smithi062.stdout:1/936: symlink d8/d14/d2b/d3c/d44/d64/l133 0 2024-05-09T06:30:12.246 INFO:tasks.workunit.client.0.smithi062.stdout:1/937: write d8/d14/d2b/d3c/d44/d38/db6/f132 [252938,10641] 0 2024-05-09T06:30:12.254 INFO:tasks.workunit.client.0.smithi062.stdout:1/938: read d8/d1d/d91/f7e [133277,110697] 0 2024-05-09T06:30:12.257 INFO:tasks.workunit.client.0.smithi062.stdout:1/939: creat d8/d1d/d91/f134 x:0 0 0 2024-05-09T06:30:12.278 INFO:tasks.workunit.client.0.smithi062.stdout:1/940: dwrite d8/d14/f1b [0,4194304] 0 2024-05-09T06:30:12.279 INFO:tasks.workunit.client.0.smithi062.stdout:1/941: stat d8/d1d/f26 0 2024-05-09T06:30:12.284 INFO:tasks.workunit.client.0.smithi062.stdout:1/942: mkdir d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/d11e/d135 0 2024-05-09T06:30:12.305 INFO:tasks.workunit.client.0.smithi062.stdout:1/943: dwrite d8/d14/d2b/f2e [0,4194304] 0 2024-05-09T06:30:12.305 INFO:tasks.workunit.client.0.smithi062.stdout:1/944: stat d8/d14/d2b/d3c/fe1 0 2024-05-09T06:30:12.319 INFO:tasks.workunit.client.0.smithi062.stdout:1/945: dwrite d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 [0,4194304] 0 2024-05-09T06:30:12.327 INFO:tasks.workunit.client.0.smithi062.stdout:1/946: link d8/d14/f1b d8/d14/d2b/d9d/f136 0 2024-05-09T06:30:12.327 INFO:tasks.workunit.client.0.smithi062.stdout:1/947: chown d8/d14/d2b/cb3 2 1 2024-05-09T06:30:12.327 INFO:tasks.workunit.client.0.smithi062.stdout:1/948: fdatasync d8/d14/d2b/d3c/d76/dd2/f121 0 2024-05-09T06:30:12.327 INFO:tasks.workunit.client.0.smithi062.stdout:1/949: chown d8/d14/d2b/d3c/d44/d64/f7b 0 1 2024-05-09T06:30:12.329 INFO:tasks.workunit.client.0.smithi062.stdout:1/950: dread d8/d1d/d9c/d41/f55 [8388608,4194304] 0 2024-05-09T06:30:12.329 INFO:tasks.workunit.client.0.smithi062.stdout:1/951: readlink d8/d1d/l81 0 2024-05-09T06:30:12.330 INFO:tasks.workunit.client.0.smithi062.stdout:1/952: truncate d8/d14/d2b/d3c/d44/d6e/fde 4293084 0 2024-05-09T06:30:12.330 INFO:tasks.workunit.client.0.smithi062.stdout:1/953: chown d8/d1d/d9c/d41/d118/c6c 233407043 1 2024-05-09T06:30:12.332 INFO:tasks.workunit.client.0.smithi062.stdout:1/954: fsync d8/d14/d2b/d3c/d44/d6e/d98/dc0/fe5 0 2024-05-09T06:30:12.332 INFO:tasks.workunit.client.0.smithi062.stdout:1/955: creat d8/d14/d2b/d3c/da5/f137 x:0 0 0 2024-05-09T06:30:12.334 INFO:tasks.workunit.client.0.smithi062.stdout:1/956: truncate d8/d14/f1b 505130 0 2024-05-09T06:30:12.337 INFO:tasks.workunit.client.0.smithi062.stdout:1/957: symlink d8/d14/d2b/d3c/d7d/df6/l138 0 2024-05-09T06:30:12.339 INFO:tasks.workunit.client.0.smithi062.stdout:1/958: mknod d8/d14/d2b/d9d/c139 0 2024-05-09T06:30:12.342 INFO:tasks.workunit.client.0.smithi062.stdout:1/959: mkdir d8/d14/d2b/d3c/d44/d13a 0 2024-05-09T06:30:12.342 INFO:tasks.workunit.client.0.smithi062.stdout:1/960: write d8/d14/d2b/d3c/d44/d64/f83 [909268,101485] 0 2024-05-09T06:30:12.357 INFO:tasks.workunit.client.0.smithi062.stdout:1/961: dwrite d8/d14/d2b/d3c/d44/d38/db6/fc8 [0,4194304] 0 2024-05-09T06:30:12.381 INFO:tasks.workunit.client.0.smithi062.stdout:1/962: dwrite d8/d14/d2b/d3c/d76/dd2/f121 [0,4194304] 0 2024-05-09T06:30:12.382 INFO:tasks.workunit.client.0.smithi062.stdout:1/963: truncate d8/d14/d2b/d9d/f136 1719487 0 2024-05-09T06:30:12.383 INFO:tasks.workunit.client.0.smithi062.stdout:1/964: creat d8/d14/d2b/d3c/d7d/df6/f13b x:0 0 0 2024-05-09T06:30:12.384 INFO:tasks.workunit.client.0.smithi062.stdout:1/965: mknod d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/c13c 0 2024-05-09T06:30:12.386 INFO:tasks.workunit.client.0.smithi062.stdout:1/966: link d8/d1d/d9c/c4c d8/d14/d2b/d3c/d7d/deb/d116/c13d 0 2024-05-09T06:30:12.387 INFO:tasks.workunit.client.0.smithi062.stdout:1/967: truncate d8/d14/d2b/d3c/fa1 1299788 0 2024-05-09T06:30:12.388 INFO:tasks.workunit.client.0.smithi062.stdout:1/968: getdents d8/d14/d2b/de4/df9 0 2024-05-09T06:30:12.695 INFO:tasks.workunit.client.0.smithi062.stdout:1/969: sync 2024-05-09T06:30:12.695 INFO:tasks.workunit.client.0.smithi062.stdout:1/970: chown d8/d14/d2b/d3c/d44/d7f/la7 9665 1 2024-05-09T06:30:12.716 INFO:tasks.workunit.client.0.smithi062.stdout:1/971: dwrite d8/d1d/d70/fbd [0,4194304] 0 2024-05-09T06:30:12.720 INFO:tasks.workunit.client.0.smithi062.stdout:1/972: mkdir d8/d14/d2b/d3c/d44/d38/db6/d13e 0 2024-05-09T06:30:12.720 INFO:tasks.workunit.client.0.smithi062.stdout:1/973: chown d8/d1d/d9c/d41/d118 37139 1 2024-05-09T06:30:12.722 INFO:tasks.workunit.client.0.smithi062.stdout:1/974: creat d8/d14/f13f x:0 0 0 2024-05-09T06:30:12.723 INFO:tasks.workunit.client.0.smithi062.stdout:1/975: write d8/d1d/d9c/db4/ff4 [1089960,45377] 0 2024-05-09T06:30:12.739 INFO:tasks.workunit.client.0.smithi062.stdout:1/976: dwrite d8/d14/d2b/d3c/d44/d38/dbe/f110 [4194304,4194304] 0 2024-05-09T06:30:12.742 INFO:tasks.workunit.client.0.smithi062.stdout:1/977: dread d8/d14/d2b/d3c/d44/d6e/d98/fe0 [0,4194304] 0 2024-05-09T06:30:12.742 INFO:tasks.workunit.client.0.smithi062.stdout:1/978: chown d8/d1d/l81 876 1 2024-05-09T06:30:12.745 INFO:tasks.workunit.client.0.smithi062.stdout:1/979: symlink d8/d14/d2b/d3c/d44/d6e/d7a/d80/dd0/l140 0 2024-05-09T06:30:12.745 INFO:tasks.workunit.client.0.smithi062.stdout:1/980: readlink d8/lf 0 2024-05-09T06:30:12.747 INFO:tasks.workunit.client.0.smithi062.stdout:1/981: mknod d8/d14/d2b/d3c/d7d/d11b/c141 0 2024-05-09T06:30:12.750 INFO:tasks.workunit.client.0.smithi062.stdout:1/982: creat d8/d14/d2b/d3c/d76/dd2/f142 x:0 0 0 2024-05-09T06:30:12.766 INFO:tasks.workunit.client.0.smithi062.stdout:1/983: dwrite d8/d14/d2b/d3c/d44/d6e/d7a/d80/f97 [4194304,4194304] 0 2024-05-09T06:30:12.782 INFO:tasks.workunit.client.0.smithi062.stdout:1/984: dwrite d8/d14/d2b/d3c/db0/f12e [0,4194304] 0 2024-05-09T06:30:12.959 INFO:tasks.workunit.client.0.smithi062.stdout:1/985: sync 2024-05-09T06:30:12.960 INFO:tasks.workunit.client.0.smithi062.stdout:1/986: mknod d8/d14/d2b/d3c/da5/dcf/c143 0 2024-05-09T06:30:12.965 INFO:tasks.workunit.client.0.smithi062.stdout:1/987: unlink d8/d14/d2b/d3c/d44/d6e/d7a/fa6 0 2024-05-09T06:30:12.968 INFO:tasks.workunit.client.0.smithi062.stdout:1/988: link d8/d14/d2b/d3c/d44/d6e/d7a/l96 d8/d14/d2b/d3c/d7d/d11b/l144 0 2024-05-09T06:30:12.972 INFO:tasks.workunit.client.0.smithi062.stdout:1/989: link d8/d1d/d91/f7e d8/d14/d2b/d106/f145 0 2024-05-09T06:30:12.982 INFO:tasks.workunit.client.0.smithi062.stdout:1/990: dread d8/d14/f12c [0,4194304] 0 2024-05-09T06:30:12.995 INFO:tasks.workunit.client.0.smithi062.stdout:1/991: dread d8/d14/d2b/d3c/d44/d6e/d98/f125 [0,4194304] 0 2024-05-09T06:30:12.997 INFO:tasks.workunit.client.0.smithi062.stdout:1/992: symlink d8/d14/d2b/l146 0 2024-05-09T06:30:12.999 INFO:tasks.workunit.client.0.smithi062.stdout:1/993: truncate d8/d14/d2b/d3c/d44/d6e/d7a/fb8 1936449 0 2024-05-09T06:30:13.000 INFO:tasks.workunit.client.0.smithi062.stdout:1/994: symlink d8/d14/d2b/d106/l147 0 2024-05-09T06:30:13.006 INFO:tasks.workunit.client.0.smithi062.stdout:1/995: write d8/d14/d2b/f2e [3678659,38507] 0 2024-05-09T06:30:13.008 INFO:tasks.workunit.client.0.smithi062.stdout:1/996: symlink d8/d14/d2b/d3c/d44/l148 0 2024-05-09T06:30:13.015 INFO:tasks.workunit.client.0.smithi062.stdout:1/997: dread d8/d14/f1b [0,4194304] 0 2024-05-09T06:30:13.018 INFO:tasks.workunit.client.0.smithi062.stdout:1/998: creat d8/d14/d2b/d3c/d44/d64/f149 x:0 0 0 2024-05-09T06:30:13.018 INFO:tasks.workunit.client.0.smithi062.stdout:1/999: readlink d8/d14/d2b/d3c/d44/d6e/d7a/ldf 0 2024-05-09T06:30:13.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ rm -rf -- ./tmp.J3rG3Vk4Ur 2024-05-09T06:30:13.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:13 smithi062 ceph-mon[26920]: pgmap v14: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 179 MiB/s rd, 201 MiB/s wr, 374 op/s 2024-05-09T06:30:13.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:13 smithi079 ceph-mon[35268]: pgmap v14: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 179 MiB/s rd, 201 MiB/s wr, 374 op/s 2024-05-09T06:30:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:14 smithi079 ceph-mon[35268]: pgmap v15: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 122 MiB/s rd, 129 MiB/s wr, 252 op/s 2024-05-09T06:30:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:14 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:14 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:15.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:14 smithi062 ceph-mon[26920]: pgmap v15: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 122 MiB/s rd, 129 MiB/s wr, 252 op/s 2024-05-09T06:30:15.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:14 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:15.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:14 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:16.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:16.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:16.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:16.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:30:16.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:16 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:30:16.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:16.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:16.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:16.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:16.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:30:16.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:16 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:30:17.385 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Adjusting osd_memory_target on smithi062 to 1557M 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: pgmap v16: 65 pgs: 65 active+clean; 2.4 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 125 MiB/s rd, 131 MiB/s wr, 275 op/s 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.387 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.387 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.387 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.387 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.387 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:17 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Adjusting osd_memory_target on smithi062 to 1557M 2024-05-09T06:30:17.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:30:17.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: pgmap v16: 65 pgs: 65 active+clean; 2.4 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 125 MiB/s rd, 131 MiB/s wr, 275 op/s 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:17.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:17 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:18.564 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:18 smithi062 ceph-mon[26920]: Reconfiguring node-exporter.smithi062 (dependencies changed)... 2024-05-09T06:30:18.564 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:18 smithi062 ceph-mon[26920]: Reconfiguring daemon node-exporter.smithi062 on smithi062 2024-05-09T06:30:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:18 smithi079 ceph-mon[35268]: Reconfiguring node-exporter.smithi062 (dependencies changed)... 2024-05-09T06:30:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:18 smithi079 ceph-mon[35268]: Reconfiguring daemon node-exporter.smithi062 on smithi062 2024-05-09T06:30:19.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:19 smithi062 ceph-mon[26920]: pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 127 MiB/s rd, 136 MiB/s wr, 365 op/s 2024-05-09T06:30:19.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:19 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:19.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:19 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:19.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:19 smithi062 ceph-mon[26920]: Reconfiguring alertmanager.smithi062 (dependencies changed)... 2024-05-09T06:30:19.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:19 smithi062 ceph-mon[26920]: Reconfiguring daemon alertmanager.smithi062 on smithi062 2024-05-09T06:30:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:19 smithi079 ceph-mon[35268]: pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 127 MiB/s rd, 136 MiB/s wr, 365 op/s 2024-05-09T06:30:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:19 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:19 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:19 smithi079 ceph-mon[35268]: Reconfiguring alertmanager.smithi062 (dependencies changed)... 2024-05-09T06:30:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:19 smithi079 ceph-mon[35268]: Reconfiguring daemon alertmanager.smithi062 on smithi062 2024-05-09T06:30:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.749+0000 7f65ad3fd700 1 -- 172.21.15.62:0/1128867142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65a80fbcb0 msgr2=0x7f65a80fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.749+0000 7f65ad3fd700 1 --2- 172.21.15.62:0/1128867142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65a80fbcb0 0x7f65a80fc0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6598004940 tx=0x7f6598009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.749+0000 7f65ad3fd700 1 -- 172.21.15.62:0/1128867142 shutdown_connections 2024-05-09T06:30:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.749+0000 7f65ad3fd700 1 --2- 172.21.15.62:0/1128867142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a80fcf60 0x7f65a80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.749+0000 7f65ad3fd700 1 --2- 172.21.15.62:0/1128867142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65a80fbcb0 0x7f65a80fc0c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:19.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.749+0000 7f65ad3fd700 1 -- 172.21.15.62:0/1128867142 >> 172.21.15.62:0/1128867142 conn(0x7f65a80f7430 msgr2=0x7f65a80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.749+0000 7f65ad3fd700 1 -- 172.21.15.62:0/1128867142 shutdown_connections 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.749+0000 7f65ad3fd700 1 -- 172.21.15.62:0/1128867142 wait complete. 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.750+0000 7f65ad3fd700 1 Processor -- start 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.750+0000 7f65ad3fd700 1 -- start start 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.750+0000 7f65ad3fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a80fbcb0 0x7f65a8110720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65ad3fd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65a80fcf60 0x7f65a8112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65ad3fd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8066330 con 0x7f65a80fcf60 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65ad3fd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8066470 con 0x7f65a80fbcb0 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a80fbcb0 0x7f65a8110720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a80fbcb0 0x7f65a8110720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:38594/0 (socket says 172.21.15.62:38594) 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65a6ffd700 1 -- 172.21.15.62:0/3118377156 learned_addr learned my addr 172.21.15.62:0/3118377156 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65a67fc700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65a80fcf60 0x7f65a8112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65a6ffd700 1 -- 172.21.15.62:0/3118377156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65a80fcf60 msgr2=0x7f65a8112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:19.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65a6ffd700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65a80fcf60 0x7f65a8112c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65a6ffd700 1 -- 172.21.15.62:0/3118377156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6598005040 con 0x7f65a80fbcb0 2024-05-09T06:30:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.751+0000 7f65a6ffd700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a80fbcb0 0x7f65a8110720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6598009150 tx=0x7f6598009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.752+0000 7f658f7fe700 1 -- 172.21.15.62:0/3118377156 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659800e040 con 0x7f65a80fbcb0 2024-05-09T06:30:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.752+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a81131b0 con 0x7f65a80fbcb0 2024-05-09T06:30:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.752+0000 7f658f7fe700 1 -- 172.21.15.62:0/3118377156 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f659800bbf0 con 0x7f65a80fbcb0 2024-05-09T06:30:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.752+0000 7f658f7fe700 1 -- 172.21.15.62:0/3118377156 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f659801c630 con 0x7f65a80fbcb0 2024-05-09T06:30:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.752+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a8113770 con 0x7f65a80fbcb0 2024-05-09T06:30:19.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.753+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a805f5c0 con 0x7f65a80fbcb0 2024-05-09T06:30:19.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.754+0000 7f658f7fe700 1 -- 172.21.15.62:0/3118377156 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7f659800bd60 con 0x7f65a80fbcb0 2024-05-09T06:30:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.755+0000 7f658f7fe700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f6590070bb0 0x7f6590073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.755+0000 7f658f7fe700 1 -- 172.21.15.62:0/3118377156 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f65980915a0 con 0x7f65a80fbcb0 2024-05-09T06:30:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.755+0000 7f65a67fc700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f6590070bb0 0x7f6590073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:19.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.756+0000 7f65a67fc700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f6590070bb0 0x7f6590073060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f659c004f40 tx=0x7f659c00b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:19.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:19.761+0000 7f658f7fe700 1 -- 172.21.15.62:0/3118377156 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f6598059b40 con 0x7f65a80fbcb0 2024-05-09T06:30:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.108+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 --> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65a81012c0 con 0x7f6590070bb0 2024-05-09T06:30:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.109+0000 7f658f7fe700 1 -- 172.21.15.62:0/3118377156 <== mgr.24377 v2:172.21.15.79:6828/2392096050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f65a81012c0 con 0x7f6590070bb0 2024-05-09T06:30:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f6590070bb0 msgr2=0x7f6590073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f6590070bb0 0x7f6590073060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f659c004f40 tx=0x7f659c00b040 comp rx=0 tx=0).stop 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a80fbcb0 msgr2=0x7f65a8110720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a80fbcb0 0x7f65a8110720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6598009150 tx=0x7f6598009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 shutdown_connections 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f6590070bb0 0x7f6590073060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65a80fbcb0 0x7f65a8110720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 --2- 172.21.15.62:0/3118377156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65a80fcf60 0x7f65a8112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 >> 172.21.15.62:0/3118377156 conn(0x7f65a80f7430 msgr2=0x7f65a80f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 shutdown_connections 2024-05-09T06:30:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.113+0000 7f65ad3fd700 1 -- 172.21.15.62:0/3118377156 wait complete. 2024-05-09T06:30:20.106 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:30:20.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.272+0000 7f14baffd700 1 -- 172.21.15.62:0/106069956 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b400e070 con 0x7f14bc1033f0 2024-05-09T06:30:20.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.273+0000 7f14c2304700 1 -- 172.21.15.62:0/106069956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14bc1033f0 msgr2=0x7f14bc103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.273+0000 7f14c2304700 1 --2- 172.21.15.62:0/106069956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14bc1033f0 0x7f14bc103800 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009ce0 tx=0x7f14b4004d10 comp rx=0 tx=0).stop 2024-05-09T06:30:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.273+0000 7f14c2304700 1 -- 172.21.15.62:0/106069956 shutdown_connections 2024-05-09T06:30:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.273+0000 7f14c2304700 1 --2- 172.21.15.62:0/106069956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14bc1046a0 0x7f14bc104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.273+0000 7f14c2304700 1 --2- 172.21.15.62:0/106069956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14bc1033f0 0x7f14bc103800 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.273+0000 7f14c2304700 1 -- 172.21.15.62:0/106069956 >> 172.21.15.62:0/106069956 conn(0x7f14bc0725e0 msgr2=0x7f14bc074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.273+0000 7f14c2304700 1 -- 172.21.15.62:0/106069956 shutdown_connections 2024-05-09T06:30:20.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.273+0000 7f14c2304700 1 -- 172.21.15.62:0/106069956 wait complete. 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.274+0000 7f14c2304700 1 Processor -- start 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.274+0000 7f14c2304700 1 -- start start 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.275+0000 7f14c2304700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14bc1046a0 0x7f14bc1140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.275+0000 7f14c2304700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14bc114610 0x7f14bc119640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.275+0000 7f14c2304700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc114b60 con 0x7f14bc114610 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.275+0000 7f14c2304700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc114ca0 con 0x7f14bc1046a0 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.275+0000 7f14bbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14bc1046a0 0x7f14bc1140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.275+0000 7f14bbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14bc1046a0 0x7f14bc1140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:38620/0 (socket says 172.21.15.62:38620) 2024-05-09T06:30:20.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.275+0000 7f14bbfff700 1 -- 172.21.15.62:0/1503493012 learned_addr learned my addr 172.21.15.62:0/1503493012 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.275+0000 7f14bb7fe700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14bc114610 0x7f14bc119640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14bbfff700 1 -- 172.21.15.62:0/1503493012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14bc114610 msgr2=0x7f14bc119640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14bbfff700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14bc114610 0x7f14bc119640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14bbfff700 1 -- 172.21.15.62:0/1503493012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4009940 con 0x7f14bc1046a0 2024-05-09T06:30:20.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14bbfff700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14bc1046a0 0x7f14bc1140d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14b4000f80 tx=0x7f14b4004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14b8ff9700 1 -- 172.21.15.62:0/1503493012 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b400e040 con 0x7f14bc1046a0 2024-05-09T06:30:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14b8ff9700 1 -- 172.21.15.62:0/1503493012 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14b400be70 con 0x7f14bc1046a0 2024-05-09T06:30:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc119be0 con 0x7f14bc1046a0 2024-05-09T06:30:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14b8ff9700 1 -- 172.21.15.62:0/1503493012 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b401c960 con 0x7f14bc1046a0 2024-05-09T06:30:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.276+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc11a120 con 0x7f14bc1046a0 2024-05-09T06:30:20.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.278+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc04c710 con 0x7f14bc1046a0 2024-05-09T06:30:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.280+0000 7f14b8ff9700 1 -- 172.21.15.62:0/1503493012 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7f14b40125f0 con 0x7f14bc1046a0 2024-05-09T06:30:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.281+0000 7f14b8ff9700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f14a4070bc0 0x7f14a4073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.281+0000 7f14bb7fe700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f14a4070bc0 0x7f14a4073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.281+0000 7f14b8ff9700 1 -- 172.21.15.62:0/1503493012 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f14b405b020 con 0x7f14bc1046a0 2024-05-09T06:30:20.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.282+0000 7f14bb7fe700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f14a4070bc0 0x7f14a4073070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f14b0006fd0 tx=0x7f14b0008040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:20.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.287+0000 7f14b8ff9700 1 -- 172.21.15.62:0/1503493012 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f14b405b2e0 con 0x7f14bc1046a0 2024-05-09T06:30:20.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:20 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:20.598 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:20 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:20.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.734+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 --> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14bc11a3d0 con 0x7f14a4070bc0 2024-05-09T06:30:20.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.735+0000 7f14b8ff9700 1 -- 172.21.15.62:0/1503493012 <== mgr.24377 v2:172.21.15.79:6828/2392096050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f14bc11a3d0 con 0x7f14a4070bc0 2024-05-09T06:30:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f14a4070bc0 msgr2=0x7f14a4073070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f14a4070bc0 0x7f14a4073070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f14b0006fd0 tx=0x7f14b0008040 comp rx=0 tx=0).stop 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14bc1046a0 msgr2=0x7f14bc1140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14bc1046a0 0x7f14bc1140d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14b4000f80 tx=0x7f14b4004d10 comp rx=0 tx=0).stop 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 shutdown_connections 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f14a4070bc0 0x7f14a4073070 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14bc1046a0 0x7f14bc1140d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 --2- 172.21.15.62:0/1503493012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14bc114610 0x7f14bc119640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 >> 172.21.15.62:0/1503493012 conn(0x7f14bc0725e0 msgr2=0x7f14bc073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 shutdown_connections 2024-05-09T06:30:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.739+0000 7f14c2304700 1 -- 172.21.15.62:0/1503493012 wait complete. 2024-05-09T06:30:20.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.857+0000 7fedc46f6700 1 -- 172.21.15.62:0/3864278852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 msgr2=0x7fedbc0fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:20.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.857+0000 7fedc46f6700 1 --2- 172.21.15.62:0/3864278852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 0x7fedbc0fe4f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fedac004940 tx=0x7fedac009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:20.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.857+0000 7fedc46f6700 1 -- 172.21.15.62:0/3864278852 shutdown_connections 2024-05-09T06:30:20.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.857+0000 7fedc46f6700 1 --2- 172.21.15.62:0/3864278852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 0x7fedbc0fe4f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.857+0000 7fedc46f6700 1 --2- 172.21.15.62:0/3864278852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedbc0fcf10 0x7fedbc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.857+0000 7fedc46f6700 1 -- 172.21.15.62:0/3864278852 >> 172.21.15.62:0/3864278852 conn(0x7fedbc0f8560 msgr2=0x7fedbc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:20.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.857+0000 7fedc46f6700 1 -- 172.21.15.62:0/3864278852 shutdown_connections 2024-05-09T06:30:20.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.857+0000 7fedc46f6700 1 -- 172.21.15.62:0/3864278852 wait complete. 2024-05-09T06:30:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc46f6700 1 Processor -- start 2024-05-09T06:30:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc46f6700 1 -- start start 2024-05-09T06:30:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc46f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedbc0fcf10 0x7fedbc071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc46f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 0x7fedbc0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc46f6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc070860 con 0x7fedbc0fe080 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc46f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc0709d0 con 0x7fedbc0fcf10 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc1c91700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 0x7fedbc0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc1c91700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 0x7fedbc0702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55260/0 (socket says 172.21.15.62:55260) 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.858+0000 7fedc1c91700 1 -- 172.21.15.62:0/2087505598 learned_addr learned my addr 172.21.15.62:0/2087505598 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedc2492700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedbc0fcf10 0x7fedbc071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedc1c91700 1 -- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedbc0fcf10 msgr2=0x7fedbc071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedc1c91700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedbc0fcf10 0x7fedbc071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedc1c91700 1 -- 172.21.15.62:0/2087505598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac005040 con 0x7fedbc0fe080 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedc1c91700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 0x7fedbc0702b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fedac00b0d0 tx=0x7fedac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedb2ffd700 1 -- 172.21.15.62:0/2087505598 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedac00e030 con 0x7fedbc0fe080 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedb2ffd700 1 -- 172.21.15.62:0/2087505598 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedac01c400 con 0x7fedbc0fe080 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedbc070c50 con 0x7fedbc0fe080 2024-05-09T06:30:20.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedb2ffd700 1 -- 172.21.15.62:0/2087505598 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedac00b630 con 0x7fedbc0fe080 2024-05-09T06:30:20.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.859+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc1159b0 con 0x7fedbc0fe080 2024-05-09T06:30:20.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.860+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedbc05f5c0 con 0x7fedbc0fe080 2024-05-09T06:30:20.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.861+0000 7fedb2ffd700 1 -- 172.21.15.62:0/2087505598 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7fedac01c570 con 0x7fedbc0fe080 2024-05-09T06:30:20.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.862+0000 7fedb2ffd700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7feda8070bb0 0x7feda8073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:20.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.862+0000 7fedb2ffd700 1 -- 172.21.15.62:0/2087505598 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fedac0921b0 con 0x7fedbc0fe080 2024-05-09T06:30:20.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.862+0000 7fedc2492700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7feda8070bb0 0x7feda8073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:20.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.862+0000 7fedc2492700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7feda8070bb0 0x7feda8073060 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fedbc071b70 tx=0x7fedb800b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:20.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:20.867+0000 7fedb2ffd700 1 -- 172.21.15.62:0/2087505598 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fedac05a7f0 con 0x7fedbc0fe080 2024-05-09T06:30:21.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.181+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 --> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fedbc102320 con 0x7feda8070bb0 2024-05-09T06:30:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.200+0000 7fedb2ffd700 1 -- 172.21.15.62:0/2087505598 <== mgr.24377 v2:172.21.15.79:6828/2392096050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fedbc102320 con 0x7feda8070bb0 2024-05-09T06:30:21.182 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:30:21.182 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (7m) 7s ago 8m 24.9M - 0.25.0 c8568f914cd2 b9c4737eec20 2024-05-09T06:30:21.182 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (9m) 7s ago 9m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:30:21.182 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (7m) 21s ago 7m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:30:21.182 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (7m) 7s ago 8m 86.1M - 9.4.7 954c08fa6188 06a19fe449ea 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (2m) 7s ago 2m 13.4M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (3m) 7s ago 3m 216M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (2m) 21s ago 2m 13.3M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (2m) 21s ago 2m 13.3M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:9283 running (10m) 7s ago 10m 333M - 17.2.7-933-g4ba5a836 b96134859c76 f1bb37d51b2f 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283 running (45s) 21s ago 7m 501M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5fe8e477d847 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (10m) 7s ago 10m 51.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (7m) 21s ago 7m 39.1M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 starting - - - - 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (7m) 21s ago 7m 15.6M - 1.5.0 0da6a335fe13 9d423500267f 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (6m) 7s ago 6m 227M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (6m) 7s ago 6m 269M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (5m) 7s ago 5m 208M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:30:21.183 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (5m) 21s ago 5m 266M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:30:21.184 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (4m) 21s ago 4m 228M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:30:21.184 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (4m) 21s ago 4m 252M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:30:21.184 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (6m) 7s ago 8m 60.6M - 2.43.0 a07b618ecd1d c90458655289 2024-05-09T06:30:21.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.204+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7feda8070bb0 msgr2=0x7feda8073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:21.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.204+0000 7fedc46f6700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7feda8070bb0 0x7feda8073060 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fedbc071b70 tx=0x7fedb800b040 comp rx=0 tx=0).stop 2024-05-09T06:30:21.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.204+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 msgr2=0x7fedbc0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:21.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.204+0000 7fedc46f6700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 0x7fedbc0702b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fedac00b0d0 tx=0x7fedac009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.205+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 shutdown_connections 2024-05-09T06:30:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.205+0000 7fedc46f6700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7feda8070bb0 0x7feda8073060 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.205+0000 7fedc46f6700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fedbc0fcf10 0x7fedbc071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.205+0000 7fedc46f6700 1 --2- 172.21.15.62:0/2087505598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedbc0fe080 0x7fedbc0702b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.205+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 >> 172.21.15.62:0/2087505598 conn(0x7fedbc0f8560 msgr2=0x7fedbc0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.205+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 shutdown_connections 2024-05-09T06:30:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.205+0000 7fedc46f6700 1 -- 172.21.15.62:0/2087505598 wait complete. 2024-05-09T06:30:21.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.327+0000 7fcb1daaa700 1 -- 172.21.15.62:0/3627319538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb18066240 msgr2=0x7fcb180ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:21.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.328+0000 7fcb1daaa700 1 --2- 172.21.15.62:0/3627319538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb18066240 0x7fcb180ffa20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcb08004940 tx=0x7fcb08009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.328+0000 7fcb1daaa700 1 -- 172.21.15.62:0/3627319538 shutdown_connections 2024-05-09T06:30:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.328+0000 7fcb1daaa700 1 --2- 172.21.15.62:0/3627319538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb180fff60 0x7fcb18102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.328+0000 7fcb1daaa700 1 --2- 172.21.15.62:0/3627319538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb18066240 0x7fcb180ffa20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.328+0000 7fcb1daaa700 1 -- 172.21.15.62:0/3627319538 >> 172.21.15.62:0/3627319538 conn(0x7fcb180f7430 msgr2=0x7fcb180f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.328+0000 7fcb1daaa700 1 -- 172.21.15.62:0/3627319538 shutdown_connections 2024-05-09T06:30:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.328+0000 7fcb1daaa700 1 -- 172.21.15.62:0/3627319538 wait complete. 2024-05-09T06:30:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.328+0000 7fcb1daaa700 1 Processor -- start 2024-05-09T06:30:21.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb1daaa700 1 -- start start 2024-05-09T06:30:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb1daaa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb18066240 0x7fcb180fd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb1daaa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb180fff60 0x7fcb180fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb1daaa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180fbeb0 con 0x7fcb180fff60 2024-05-09T06:30:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb1daaa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180fbff0 con 0x7fcb18066240 2024-05-09T06:30:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb16ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb180fff60 0x7fcb180fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb177fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb18066240 0x7fcb180fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb177fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb18066240 0x7fcb180fd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:38654/0 (socket says 172.21.15.62:38654) 2024-05-09T06:30:21.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb16ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb180fff60 0x7fcb180fb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55276/0 (socket says 172.21.15.62:55276) 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb177fe700 1 -- 172.21.15.62:0/2035842646 learned_addr learned my addr 172.21.15.62:0/2035842646 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb177fe700 1 -- 172.21.15.62:0/2035842646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb180fff60 msgr2=0x7fcb180fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb177fe700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb180fff60 0x7fcb180fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.329+0000 7fcb177fe700 1 -- 172.21.15.62:0/2035842646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08005040 con 0x7fcb18066240 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.330+0000 7fcb177fe700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb18066240 0x7fcb180fd400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb08000c00 tx=0x7fcb08009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.330+0000 7fcafffff700 1 -- 172.21.15.62:0/2035842646 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb0800e030 con 0x7fcb18066240 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.330+0000 7fcafffff700 1 -- 172.21.15.62:0/2035842646 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb08013de0 con 0x7fcb18066240 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.330+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb180fc270 con 0x7fcb18066240 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.330+0000 7fcafffff700 1 -- 172.21.15.62:0/2035842646 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb0801ce50 con 0x7fcb18066240 2024-05-09T06:30:21.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.330+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb180fc760 con 0x7fcb18066240 2024-05-09T06:30:21.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.331+0000 7fcafffff700 1 -- 172.21.15.62:0/2035842646 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7fcb08013910 con 0x7fcb18066240 2024-05-09T06:30:21.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.331+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1805f5c0 con 0x7fcb18066240 2024-05-09T06:30:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.332+0000 7fcafffff700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7fcb00070bb0 0x7fcb00073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.332+0000 7fcafffff700 1 -- 172.21.15.62:0/2035842646 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fcb08092350 con 0x7fcb18066240 2024-05-09T06:30:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.332+0000 7fcb16ffd700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7fcb00070bb0 0x7fcb00073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:21.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.333+0000 7fcb16ffd700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7fcb00070bb0 0x7fcb00073060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb180fd9e0 tx=0x7fcb0c00b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:21.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.337+0000 7fcafffff700 1 -- 172.21.15.62:0/2035842646 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fcb0805a850 con 0x7fcb18066240 2024-05-09T06:30:21.469 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:21 smithi062 ceph-mon[26920]: pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 73 MiB/s wr, 234 op/s 2024-05-09T06:30:21.470 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:21 smithi062 ceph-mon[26920]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:21.470 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:21 smithi062 ceph-mon[26920]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:21.470 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:21 smithi062 ceph-mon[26920]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:21.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:21 smithi079 ceph-mon[35268]: pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 73 MiB/s wr, 234 op/s 2024-05-09T06:30:21.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:21 smithi079 ceph-mon[35268]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:21.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:21 smithi079 ceph-mon[35268]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:21.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:21 smithi079 ceph-mon[35268]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:21.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.715+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb181058a0 con 0x7fcb18066240 2024-05-09T06:30:21.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.716+0000 7fcafffff700 1 -- 172.21.15.62:0/2035842646 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fcb0805a1f0 con 0x7fcb18066240 2024-05-09T06:30:21.697 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:30:21.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:30:21.699 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:30:21.699 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 13, 2024-05-09T06:30:21.699 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:30:21.699 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:30:21.699 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:30:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7fcb00070bb0 msgr2=0x7fcb00073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7fcb00070bb0 0x7fcb00073060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb180fd9e0 tx=0x7fcb0c00b040 comp rx=0 tx=0).stop 2024-05-09T06:30:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb18066240 msgr2=0x7fcb180fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb18066240 0x7fcb180fd400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb08000c00 tx=0x7fcb08009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 shutdown_connections 2024-05-09T06:30:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7fcb00070bb0 0x7fcb00073060 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb18066240 0x7fcb180fd400 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 --2- 172.21.15.62:0/2035842646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb180fff60 0x7fcb180fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 >> 172.21.15.62:0/2035842646 conn(0x7fcb180f7430 msgr2=0x7fcb180f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:21.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 shutdown_connections 2024-05-09T06:30:21.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.718+0000 7fcb1daaa700 1 -- 172.21.15.62:0/2035842646 wait complete. 2024-05-09T06:30:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.831+0000 7f51d34a2700 1 -- 172.21.15.62:0/1124995036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 msgr2=0x7f51cc1026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.831+0000 7f51d34a2700 1 --2- 172.21.15.62:0/1124995036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 0x7f51cc1026c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f51bc004940 tx=0x7f51bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.831+0000 7f51d34a2700 1 -- 172.21.15.62:0/1124995036 shutdown_connections 2024-05-09T06:30:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.831+0000 7f51d34a2700 1 --2- 172.21.15.62:0/1124995036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 0x7f51cc1026c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.831+0000 7f51d34a2700 1 --2- 172.21.15.62:0/1124995036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0fd9c0 0x7f51cc0ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.831+0000 7f51d34a2700 1 -- 172.21.15.62:0/1124995036 >> 172.21.15.62:0/1124995036 conn(0x7f51cc0f7440 msgr2=0x7f51cc0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.831+0000 7f51d34a2700 1 -- 172.21.15.62:0/1124995036 shutdown_connections 2024-05-09T06:30:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.831+0000 7f51d34a2700 1 -- 172.21.15.62:0/1124995036 wait complete. 2024-05-09T06:30:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d34a2700 1 Processor -- start 2024-05-09T06:30:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d34a2700 1 -- start start 2024-05-09T06:30:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d34a2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0fd9c0 0x7f51cc1071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:21.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d34a2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 0x7f51cc1076e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d34a2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc107d30 con 0x7f51cc1002e0 2024-05-09T06:30:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d123e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0fd9c0 0x7f51cc1071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d0a3d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 0x7f51cc1076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d123e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0fd9c0 0x7f51cc1071a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:38666/0 (socket says 172.21.15.62:38666) 2024-05-09T06:30:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d123e700 1 -- 172.21.15.62:0/1860937169 learned_addr learned my addr 172.21.15.62:0/1860937169 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc108530 con 0x7f51cc0fd9c0 2024-05-09T06:30:21.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.832+0000 7f51d0a3d700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 0x7f51cc1076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55286/0 (socket says 172.21.15.62:55286) 2024-05-09T06:30:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.833+0000 7f51d0a3d700 1 -- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0fd9c0 msgr2=0x7f51cc1071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.833+0000 7f51d0a3d700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0fd9c0 0x7f51cc1071a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.833+0000 7f51d0a3d700 1 -- 172.21.15.62:0/1860937169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc005040 con 0x7f51cc1002e0 2024-05-09T06:30:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.833+0000 7f51d0a3d700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 0x7f51cc1076e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c00 tx=0x7f51bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.833+0000 7f51c1ffb700 1 -- 172.21.15.62:0/1860937169 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51bc00e030 con 0x7f51cc1002e0 2024-05-09T06:30:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.833+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc1087b0 con 0x7f51cc1002e0 2024-05-09T06:30:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.833+0000 7f51c1ffb700 1 -- 172.21.15.62:0/1860937169 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51bc01c400 con 0x7f51cc1002e0 2024-05-09T06:30:21.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.833+0000 7f51c1ffb700 1 -- 172.21.15.62:0/1860937169 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51bc00b650 con 0x7f51cc1002e0 2024-05-09T06:30:21.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.834+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc108cf0 con 0x7f51cc1002e0 2024-05-09T06:30:21.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.835+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc05f5c0 con 0x7f51cc1002e0 2024-05-09T06:30:21.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.836+0000 7f51c1ffb700 1 -- 172.21.15.62:0/1860937169 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7f51bc01ca90 con 0x7f51cc1002e0 2024-05-09T06:30:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.836+0000 7f51c1ffb700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f51b8070bb0 0x7f51b8073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.837+0000 7f51c1ffb700 1 -- 172.21.15.62:0/1860937169 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f51bc0921a0 con 0x7f51cc1002e0 2024-05-09T06:30:21.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.837+0000 7f51d123e700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f51b8070bb0 0x7f51b8073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:21.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.837+0000 7f51d123e700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f51b8070bb0 0x7f51b8073060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f51cc106f30 tx=0x7f51c800b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:21.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:21.841+0000 7f51c1ffb700 1 -- 172.21.15.62:0/1860937169 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f51bc05a8a0 con 0x7f51cc1002e0 2024-05-09T06:30:22.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.186+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 --> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51cc109020 con 0x7f51b8070bb0 2024-05-09T06:30:22.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.188+0000 7f51c1ffb700 1 -- 172.21.15.62:0/1860937169 <== mgr.24377 v2:172.21.15.79:6828/2392096050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f51cc109020 con 0x7f51b8070bb0 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "1/2 daemons upgraded", 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "", 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:30:22.171 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:30:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.194+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f51b8070bb0 msgr2=0x7f51b8073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.194+0000 7f51d34a2700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f51b8070bb0 0x7f51b8073060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f51cc106f30 tx=0x7f51c800b040 comp rx=0 tx=0).stop 2024-05-09T06:30:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.194+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 msgr2=0x7f51cc1076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:22.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.194+0000 7f51d34a2700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 0x7f51cc1076e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c00 tx=0x7f51bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.196+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 shutdown_connections 2024-05-09T06:30:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.196+0000 7f51d34a2700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f51b8070bb0 0x7f51b8073060 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:22.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.196+0000 7f51d34a2700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51cc0fd9c0 0x7f51cc1071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.196+0000 7f51d34a2700 1 --2- 172.21.15.62:0/1860937169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51cc1002e0 0x7f51cc1076e0 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c00 tx=0x7f51bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.196+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 >> 172.21.15.62:0/1860937169 conn(0x7f51cc0f7440 msgr2=0x7f51cc0fba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.197+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 shutdown_connections 2024-05-09T06:30:22.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:22.199+0000 7f51d34a2700 1 -- 172.21.15.62:0/1860937169 wait complete. 2024-05-09T06:30:22.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:22 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2035842646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:30:22.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:22 smithi079 ceph-mon[35268]: pgmap v19: 65 pgs: 65 active+clean; 1.8 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 74 MiB/s wr, 283 op/s 2024-05-09T06:30:22.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:22 smithi079 ceph-mon[35268]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:22.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:22 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2035842646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:30:22.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:22 smithi062 ceph-mon[26920]: pgmap v19: 65 pgs: 65 active+clean; 1.8 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 74 MiB/s wr, 283 op/s 2024-05-09T06:30:22.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:22 smithi062 ceph-mon[26920]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:25.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:24 smithi079 ceph-mon[35268]: pgmap v20: 65 pgs: 65 active+clean; 1.8 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 161 op/s 2024-05-09T06:30:25.100 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:24 smithi062 ceph-mon[26920]: pgmap v20: 65 pgs: 65 active+clean; 1.8 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 161 op/s 2024-05-09T06:30:26.144 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:26 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:26.144 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:26 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:26.144 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:26 smithi062 ceph-mon[26920]: Reconfiguring grafana.smithi062 (dependencies changed)... 2024-05-09T06:30:26.144 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:26 smithi062 ceph-mon[26920]: Reconfiguring daemon grafana.smithi062 on smithi062 2024-05-09T06:30:26.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:26 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:26.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:26 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:26.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:26 smithi079 ceph-mon[35268]: Reconfiguring grafana.smithi062 (dependencies changed)... 2024-05-09T06:30:26.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:26 smithi079 ceph-mon[35268]: Reconfiguring daemon grafana.smithi062 on smithi062 2024-05-09T06:30:27.228 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:27 smithi062 ceph-mon[26920]: pgmap v21: 65 pgs: 65 active+clean; 1.7 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 189 op/s 2024-05-09T06:30:27.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:27 smithi079 ceph-mon[35268]: pgmap v21: 65 pgs: 65 active+clean; 1.7 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 4.2 MiB/s rd, 8.0 MiB/s wr, 189 op/s 2024-05-09T06:30:29.319 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:29 smithi062 ceph-mon[26920]: pgmap v22: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 261 op/s 2024-05-09T06:30:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:29 smithi079 ceph-mon[35268]: pgmap v22: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 261 op/s 2024-05-09T06:30:31.587 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:31 smithi062 ceph-mon[26920]: pgmap v23: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 17 KiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-05-09T06:30:31.588 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:31 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:31.588 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:31 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:31.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:31 smithi079 ceph-mon[35268]: pgmap v23: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 17 KiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-05-09T06:30:31.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:31 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:31.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:31 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:32.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:32 smithi079 ceph-mon[35268]: Reconfiguring prometheus.smithi062 (dependencies changed)... 2024-05-09T06:30:32.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:32 smithi079 ceph-mon[35268]: Reconfiguring daemon prometheus.smithi062 on smithi062 2024-05-09T06:30:32.593 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:32 smithi062 ceph-mon[26920]: Reconfiguring prometheus.smithi062 (dependencies changed)... 2024-05-09T06:30:32.593 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:32 smithi062 ceph-mon[26920]: Reconfiguring daemon prometheus.smithi062 on smithi062 2024-05-09T06:30:33.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:33 smithi079 ceph-mon[35268]: pgmap v24: 65 pgs: 65 active+clean; 805 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 31 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-05-09T06:30:33.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:33 smithi062 ceph-mon[26920]: pgmap v24: 65 pgs: 65 active+clean; 805 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 31 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-05-09T06:30:34.818 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T06:30:34.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T06:30:35.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:35 smithi062 ceph-mon[26920]: pgmap v25: 65 pgs: 65 active+clean; 805 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 230 op/s 2024-05-09T06:30:35.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:35 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:35 smithi079 ceph-mon[35268]: pgmap v25: 65 pgs: 65 active+clean; 805 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 230 op/s 2024-05-09T06:30:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:35 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:36 smithi062 ceph-mon[26920]: pgmap v26: 65 pgs: 65 active+clean; 660 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 261 op/s 2024-05-09T06:30:36.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:36 smithi079 ceph-mon[35268]: pgmap v26: 65 pgs: 65 active+clean; 660 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 261 op/s 2024-05-09T06:30:39.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:38 smithi079 ceph-mon[35268]: pgmap v27: 65 pgs: 65 active+clean; 415 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-05-09T06:30:39.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:38 smithi062 ceph-mon[26920]: pgmap v27: 65 pgs: 65 active+clean; 415 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-05-09T06:30:41.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:40 smithi062 ceph-mon[26920]: pgmap v28: 65 pgs: 65 active+clean; 415 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 230 op/s 2024-05-09T06:30:41.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:40 smithi079 ceph-mon[35268]: pgmap v28: 65 pgs: 65 active+clean; 415 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 230 op/s 2024-05-09T06:30:42.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:42 smithi062 ceph-mon[26920]: pgmap v29: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 381 op/s 2024-05-09T06:30:43.349 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:42 smithi079 ceph-mon[35268]: pgmap v29: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 381 op/s 2024-05-09T06:30:44.990 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:44 smithi062 ceph-mon[26920]: pgmap v30: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-05-09T06:30:45.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:44 smithi079 ceph-mon[35268]: pgmap v30: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-05-09T06:30:47.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:46 smithi062 ceph-mon[26920]: pgmap v31: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 332 op/s 2024-05-09T06:30:47.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:46 smithi079 ceph-mon[35268]: pgmap v31: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 332 op/s 2024-05-09T06:30:49.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:48 smithi062 ceph-mon[26920]: pgmap v32: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.0 MiB/s wr, 390 op/s 2024-05-09T06:30:49.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:48 smithi079 ceph-mon[35268]: pgmap v32: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.0 MiB/s wr, 390 op/s 2024-05-09T06:30:50.694 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:50 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:50.694 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:50 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:50.694 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:50 smithi079 ceph-mon[35268]: Reconfiguring node-exporter.smithi079 (dependencies changed)... 2024-05-09T06:30:50.694 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:50 smithi079 ceph-mon[35268]: Reconfiguring daemon node-exporter.smithi079 on smithi079 2024-05-09T06:30:50.694 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:50 smithi079 ceph-mon[35268]: pgmap v33: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 298 op/s 2024-05-09T06:30:50.695 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:50 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:50.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:50 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:50.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:50 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:50.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:50 smithi062 ceph-mon[26920]: Reconfiguring node-exporter.smithi079 (dependencies changed)... 2024-05-09T06:30:50.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:50 smithi062 ceph-mon[26920]: Reconfiguring daemon node-exporter.smithi079 on smithi079 2024-05-09T06:30:50.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:50 smithi062 ceph-mon[26920]: pgmap v33: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 298 op/s 2024-05-09T06:30:50.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:50 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.342+0000 7f05bb9da700 1 -- 172.21.15.62:0/3827388114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b4066260 msgr2=0x7f05b40ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.342+0000 7f05bb9da700 1 --2- 172.21.15.62:0/3827388114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b4066260 0x7f05b40ffa00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f05b0004940 tx=0x7f05b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.342+0000 7f05bb9da700 1 -- 172.21.15.62:0/3827388114 shutdown_connections 2024-05-09T06:30:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.342+0000 7f05bb9da700 1 --2- 172.21.15.62:0/3827388114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40fff40 0x7f05b4102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.342+0000 7f05bb9da700 1 --2- 172.21.15.62:0/3827388114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b4066260 0x7f05b40ffa00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.342+0000 7f05bb9da700 1 -- 172.21.15.62:0/3827388114 >> 172.21.15.62:0/3827388114 conn(0x7f05b40f7430 msgr2=0x7f05b40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.342+0000 7f05bb9da700 1 -- 172.21.15.62:0/3827388114 shutdown_connections 2024-05-09T06:30:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.342+0000 7f05bb9da700 1 -- 172.21.15.62:0/3827388114 wait complete. 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05bb9da700 1 Processor -- start 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05bb9da700 1 -- start start 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05bb9da700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b4066260 0x7f05b410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05bb9da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40fff40 0x7f05b410df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05bb9da700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b410e540 con 0x7f05b4066260 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05bb9da700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b410ed40 con 0x7f05b40fff40 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05b8f75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40fff40 0x7f05b410df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05b8f75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40fff40 0x7f05b410df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:35132/0 (socket says 172.21.15.62:35132) 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.343+0000 7f05b8f75700 1 -- 172.21.15.62:0/1302976567 learned_addr learned my addr 172.21.15.62:0/1302976567 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.344+0000 7f05b8f75700 1 -- 172.21.15.62:0/1302976567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b4066260 msgr2=0x7f05b410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.344+0000 7f05b8f75700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b4066260 0x7f05b410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.344+0000 7f05b8f75700 1 -- 172.21.15.62:0/1302976567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0005040 con 0x7f05b40fff40 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.344+0000 7f05b8f75700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40fff40 0x7f05b410df40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05a400eb40 tx=0x7f05a400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:52.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.344+0000 7f05a9ffb700 1 -- 172.21.15.62:0/1302976567 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a4007cc0 con 0x7f05b40fff40 2024-05-09T06:30:52.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.344+0000 7f05a9ffb700 1 -- 172.21.15.62:0/1302976567 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05a400f040 con 0x7f05b40fff40 2024-05-09T06:30:52.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.344+0000 7f05a9ffb700 1 -- 172.21.15.62:0/1302976567 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a4009620 con 0x7f05b40fff40 2024-05-09T06:30:52.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.344+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b410efc0 con 0x7f05b40fff40 2024-05-09T06:30:52.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.345+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b410f500 con 0x7f05b40fff40 2024-05-09T06:30:52.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.346+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b405f5c0 con 0x7f05b40fff40 2024-05-09T06:30:52.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.346+0000 7f05a9ffb700 1 -- 172.21.15.62:0/1302976567 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7f05a4009780 con 0x7f05b40fff40 2024-05-09T06:30:52.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.347+0000 7f05a9ffb700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f05a0070bb0 0x7f05a0073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:52.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.347+0000 7f05a9ffb700 1 -- 172.21.15.62:0/1302976567 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f05a4090650 con 0x7f05b40fff40 2024-05-09T06:30:52.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.347+0000 7f05b9776700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f05a0070bb0 0x7f05a0073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:52.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.348+0000 7f05b9776700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f05a0070bb0 0x7f05a0073060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009b30 tx=0x7f05b0009e30 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:52.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.352+0000 7f05a9ffb700 1 -- 172.21.15.62:0/1302976567 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f05a40516c0 con 0x7f05b40fff40 2024-05-09T06:30:52.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.657+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 --> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05b410f830 con 0x7f05a0070bb0 2024-05-09T06:30:52.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.659+0000 7f05a9ffb700 1 -- 172.21.15.62:0/1302976567 <== mgr.24377 v2:172.21.15.79:6828/2392096050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f05b410f830 con 0x7f05a0070bb0 2024-05-09T06:30:52.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f05a0070bb0 msgr2=0x7f05a0073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:52.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f05a0070bb0 0x7f05a0073060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009b30 tx=0x7f05b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:52.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40fff40 msgr2=0x7f05b410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40fff40 0x7f05b410df40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f05a400eb40 tx=0x7f05a400b040 comp rx=0 tx=0).stop 2024-05-09T06:30:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 shutdown_connections 2024-05-09T06:30:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f05a0070bb0 0x7f05a0073060 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05b4066260 0x7f05b410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 --2- 172.21.15.62:0/1302976567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b40fff40 0x7f05b410df40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 >> 172.21.15.62:0/1302976567 conn(0x7f05b40f7430 msgr2=0x7f05b40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 shutdown_connections 2024-05-09T06:30:52.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.662+0000 7f05bb9da700 1 -- 172.21.15.62:0/1302976567 wait complete. 2024-05-09T06:30:52.657 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:30:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 -- 172.21.15.62:0/3398314133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 msgr2=0x7f07380fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 --2- 172.21.15.62:0/3398314133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 0x7f07380fc0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0734004940 tx=0x7f0734009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 -- 172.21.15.62:0/3398314133 shutdown_connections 2024-05-09T06:30:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 --2- 172.21.15.62:0/3398314133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07380fcf60 0x7f07380fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 --2- 172.21.15.62:0/3398314133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 0x7f07380fc0c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 -- 172.21.15.62:0/3398314133 >> 172.21.15.62:0/3398314133 conn(0x7f07380f7430 msgr2=0x7f07380f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 -- 172.21.15.62:0/3398314133 shutdown_connections 2024-05-09T06:30:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 -- 172.21.15.62:0/3398314133 wait complete. 2024-05-09T06:30:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 Processor -- start 2024-05-09T06:30:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.778+0000 7f074034c700 1 -- start start 2024-05-09T06:30:52.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f074034c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 0x7f07380ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:52.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f074034c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07380fcf60 0x7f07380fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:52.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f074034c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380fe7e0 con 0x7f07380fbcb0 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f074034c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380fe920 con 0x7f07380fcf60 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f073e0e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 0x7f07380ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f073e0e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 0x7f07380ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50680/0 (socket says 172.21.15.62:50680) 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f073e0e8700 1 -- 172.21.15.62:0/1648774266 learned_addr learned my addr 172.21.15.62:0/1648774266 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f073d8e7700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07380fcf60 0x7f07380fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f073e0e8700 1 -- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07380fcf60 msgr2=0x7f07380fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f073e0e8700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07380fcf60 0x7f07380fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f073e0e8700 1 -- 172.21.15.62:0/1648774266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0734005040 con 0x7f07380fbcb0 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.779+0000 7f073e0e8700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 0x7f07380ffd30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f073400b3b0 tx=0x7f0734009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.780+0000 7f072effd700 1 -- 172.21.15.62:0/1648774266 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073400e040 con 0x7f07380fbcb0 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.780+0000 7f072effd700 1 -- 172.21.15.62:0/1648774266 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f073400bbf0 con 0x7f07380fbcb0 2024-05-09T06:30:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.780+0000 7f072effd700 1 -- 172.21.15.62:0/1648774266 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073401c630 con 0x7f07380fbcb0 2024-05-09T06:30:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.780+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07380feba0 con 0x7f07380fbcb0 2024-05-09T06:30:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.780+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07380ff110 con 0x7f07380fbcb0 2024-05-09T06:30:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.781+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0738101af0 con 0x7f07380fbcb0 2024-05-09T06:30:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.782+0000 7f072effd700 1 -- 172.21.15.62:0/1648774266 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7f073400bd60 con 0x7f07380fbcb0 2024-05-09T06:30:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.782+0000 7f072effd700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f0724070bb0 0x7f0724073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.782+0000 7f072effd700 1 -- 172.21.15.62:0/1648774266 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f07340913f0 con 0x7f07380fbcb0 2024-05-09T06:30:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.782+0000 7f073d8e7700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f0724070bb0 0x7f0724073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:52.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.783+0000 7f073d8e7700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f0724070bb0 0x7f0724073060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0728004f40 tx=0x7f072800b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:52.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:52.791+0000 7f072effd700 1 -- 172.21.15.62:0/1648774266 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f0734059990 con 0x7f07380fbcb0 2024-05-09T06:30:53.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.123+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 --> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07380ff110 con 0x7f0724070bb0 2024-05-09T06:30:53.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.125+0000 7f072effd700 1 -- 172.21.15.62:0/1648774266 <== mgr.24377 v2:172.21.15.79:6828/2392096050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f07380ff110 con 0x7f0724070bb0 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f0724070bb0 msgr2=0x7f0724073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f0724070bb0 0x7f0724073060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0728004f40 tx=0x7f072800b040 comp rx=0 tx=0).stop 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 msgr2=0x7f07380ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 0x7f07380ffd30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f073400b3b0 tx=0x7f0734009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 shutdown_connections 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f0724070bb0 0x7f0724073060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07380fbcb0 0x7f07380ffd30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 --2- 172.21.15.62:0/1648774266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07380fcf60 0x7f07380fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 >> 172.21.15.62:0/1648774266 conn(0x7f07380f7430 msgr2=0x7f0738065b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 shutdown_connections 2024-05-09T06:30:53.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.128+0000 7f074034c700 1 -- 172.21.15.62:0/1648774266 wait complete. 2024-05-09T06:30:53.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: pgmap v34: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.1 MiB/s wr, 425 op/s 2024-05-09T06:30:53.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:53.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:53.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:30:53.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:30:53.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:30:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:30:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:30:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:30:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:30:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: Upgrade: Need to upgrade myself (mgr.smithi079.genyri) 2024-05-09T06:30:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:52 smithi062 ceph-mon[26920]: Upgrade: Need to upgrade myself (mgr.smithi079.genyri) 2024-05-09T06:30:53.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.246+0000 7f394d1ea700 1 -- 172.21.15.62:0/3269174909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 msgr2=0x7f39480fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:53.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.246+0000 7f394d1ea700 1 --2- 172.21.15.62:0/3269174909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 0x7f39480fc0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3938004940 tx=0x7f3938009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:53.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.246+0000 7f394d1ea700 1 -- 172.21.15.62:0/3269174909 shutdown_connections 2024-05-09T06:30:53.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.246+0000 7f394d1ea700 1 --2- 172.21.15.62:0/3269174909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39480fcf60 0x7f39480fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.246+0000 7f394d1ea700 1 --2- 172.21.15.62:0/3269174909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 0x7f39480fc0c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.246+0000 7f394d1ea700 1 -- 172.21.15.62:0/3269174909 >> 172.21.15.62:0/3269174909 conn(0x7f39480f7430 msgr2=0x7f39480f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:53.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.246+0000 7f394d1ea700 1 -- 172.21.15.62:0/3269174909 shutdown_connections 2024-05-09T06:30:53.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.246+0000 7f394d1ea700 1 -- 172.21.15.62:0/3269174909 wait complete. 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f394d1ea700 1 Processor -- start 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f394d1ea700 1 -- start start 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f394d1ea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 0x7f394810da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f394d1ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39480fcf60 0x7f394810dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f394d1ea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394810e5a0 con 0x7f39480fbcb0 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f394d1ea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394810ed50 con 0x7f39480fcf60 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f3946d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 0x7f394810da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f3946d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 0x7f394810da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50690/0 (socket says 172.21.15.62:50690) 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f3946d9d700 1 -- 172.21.15.62:0/199251264 learned_addr learned my addr 172.21.15.62:0/199251264 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f394659c700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39480fcf60 0x7f394810dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f3946d9d700 1 -- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39480fcf60 msgr2=0x7f394810dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f3946d9d700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39480fcf60 0x7f394810dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.247+0000 7f3946d9d700 1 -- 172.21.15.62:0/199251264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938005040 con 0x7f39480fbcb0 2024-05-09T06:30:53.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.248+0000 7f3946d9d700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 0x7f394810da60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f393800b0d0 tx=0x7f3938009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:53.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.248+0000 7f392f7fe700 1 -- 172.21.15.62:0/199251264 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f393800e030 con 0x7f39480fbcb0 2024-05-09T06:30:53.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.248+0000 7f392f7fe700 1 -- 172.21.15.62:0/199251264 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f393801c400 con 0x7f39480fbcb0 2024-05-09T06:30:53.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.248+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394810efd0 con 0x7f39480fbcb0 2024-05-09T06:30:53.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.248+0000 7f392f7fe700 1 -- 172.21.15.62:0/199251264 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f393800b630 con 0x7f39480fbcb0 2024-05-09T06:30:53.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.248+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394810f510 con 0x7f39480fbcb0 2024-05-09T06:30:53.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.249+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3948101af0 con 0x7f39480fbcb0 2024-05-09T06:30:53.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.250+0000 7f392f7fe700 1 -- 172.21.15.62:0/199251264 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7f393801c570 con 0x7f39480fbcb0 2024-05-09T06:30:53.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.250+0000 7f392f7fe700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3930070bb0 0x7f3930073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:53.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.251+0000 7f392f7fe700 1 -- 172.21.15.62:0/199251264 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3938092670 con 0x7f39480fbcb0 2024-05-09T06:30:53.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.251+0000 7f394659c700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3930070bb0 0x7f3930073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:53.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.251+0000 7f394659c700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3930070bb0 0x7f3930073060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f393c009b80 tx=0x7f393c00b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:53.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.256+0000 7f392f7fe700 1 -- 172.21.15.62:0/199251264 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f393805acb0 con 0x7f39480fbcb0 2024-05-09T06:30:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: pgmap v34: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.1 MiB/s wr, 425 op/s 2024-05-09T06:30:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:30:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:30:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:30:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:30:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:30:53.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:30:53.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:30:53.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: Upgrade: Need to upgrade myself (mgr.smithi079.genyri) 2024-05-09T06:30:53.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:52 smithi079 ceph-mon[35268]: Upgrade: Need to upgrade myself (mgr.smithi079.genyri) 2024-05-09T06:30:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.564+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 --> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f394810f780 con 0x7f3930070bb0 2024-05-09T06:30:53.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.574+0000 7f392f7fe700 1 -- 172.21.15.62:0/199251264 <== mgr.24377 v2:172.21.15.79:6828/2392096050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f394810f780 con 0x7f3930070bb0 2024-05-09T06:30:53.556 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:30:53.556 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 starting - - - - 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (9m) 39s ago 9m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (8m) 53s ago 8m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 starting - - - - 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (3m) 39s ago 3m 13.4M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (3m) 39s ago 3m 216M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (3m) 53s ago 3m 13.3M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (3m) 53s ago 3m 13.3M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:9283 running (10m) 39s ago 10m 333M - 17.2.7-933-g4ba5a836 b96134859c76 f1bb37d51b2f 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283 running (77s) 53s ago 8m 501M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5fe8e477d847 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (10m) 39s ago 10m 51.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (8m) 53s ago 7m 39.1M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 starting - - - - 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 starting - - - - 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (7m) 39s ago 7m 227M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:30:53.557 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (6m) 39s ago 6m 269M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:30:53.558 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (6m) 39s ago 6m 208M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:30:53.558 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (5m) 53s ago 5m 266M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:30:53.558 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (5m) 53s ago 5m 228M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:30:53.558 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (5m) 53s ago 5m 252M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:30:53.558 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 starting - - - - 2024-05-09T06:30:53.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.576+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3930070bb0 msgr2=0x7f3930073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.576+0000 7f394d1ea700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3930070bb0 0x7f3930073060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f393c009b80 tx=0x7f393c00b040 comp rx=0 tx=0).stop 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 msgr2=0x7f394810da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 0x7f394810da60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f393800b0d0 tx=0x7f3938009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 shutdown_connections 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3930070bb0 0x7f3930073060 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39480fbcb0 0x7f394810da60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 --2- 172.21.15.62:0/199251264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39480fcf60 0x7f394810dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 >> 172.21.15.62:0/199251264 conn(0x7f39480f7430 msgr2=0x7f3948065b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:53.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 shutdown_connections 2024-05-09T06:30:53.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.577+0000 7f394d1ea700 1 -- 172.21.15.62:0/199251264 wait complete. 2024-05-09T06:30:53.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.687+0000 7f3a34ce4700 1 -- 172.21.15.62:0/2979310211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 msgr2=0x7f3a300fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:53.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.687+0000 7f3a34ce4700 1 --2- 172.21.15.62:0/2979310211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 0x7f3a300fc0d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3a20004940 tx=0x7f3a20009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:53.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.687+0000 7f3a34ce4700 1 -- 172.21.15.62:0/2979310211 shutdown_connections 2024-05-09T06:30:53.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.687+0000 7f3a34ce4700 1 --2- 172.21.15.62:0/2979310211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300fcf70 0x7f3a300fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.687+0000 7f3a34ce4700 1 --2- 172.21.15.62:0/2979310211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 0x7f3a300fc0d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.688+0000 7f3a34ce4700 1 -- 172.21.15.62:0/2979310211 >> 172.21.15.62:0/2979310211 conn(0x7f3a300f7420 msgr2=0x7f3a300f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:53.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.688+0000 7f3a34ce4700 1 -- 172.21.15.62:0/2979310211 shutdown_connections 2024-05-09T06:30:53.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.688+0000 7f3a34ce4700 1 -- 172.21.15.62:0/2979310211 wait complete. 2024-05-09T06:30:53.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.688+0000 7f3a34ce4700 1 Processor -- start 2024-05-09T06:30:53.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.688+0000 7f3a34ce4700 1 -- start start 2024-05-09T06:30:53.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a34ce4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 0x7f3a3010c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a34ce4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300fcf70 0x7f3a3010cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a34ce4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3010d3d0 con 0x7f3a300fbcc0 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a34ce4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3010dc20 con 0x7f3a300fcf70 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300fcf70 0x7f3a3010cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300fcf70 0x7f3a3010cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:45888/0 (socket says 172.21.15.62:45888) 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2dd9b700 1 -- 172.21.15.62:0/1391348994 learned_addr learned my addr 172.21.15.62:0/1391348994 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2e59c700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 0x7f3a3010c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2dd9b700 1 -- 172.21.15.62:0/1391348994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 msgr2=0x7f3a3010c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2dd9b700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 0x7f3a3010c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2dd9b700 1 -- 172.21.15.62:0/1391348994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20005040 con 0x7f3a300fcf70 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2e59c700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 0x7f3a3010c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.689+0000 7f3a2dd9b700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300fcf70 0x7f3a3010cdd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3a24010d50 tx=0x7f3a2400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.690+0000 7f3a1effd700 1 -- 172.21.15.62:0/1391348994 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a2400ed60 con 0x7f3a300fcf70 2024-05-09T06:30:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.690+0000 7f3a1effd700 1 -- 172.21.15.62:0/1391348994 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a240090d0 con 0x7f3a300fcf70 2024-05-09T06:30:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.690+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3010dea0 con 0x7f3a300fcf70 2024-05-09T06:30:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.690+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3010e3e0 con 0x7f3a300fcf70 2024-05-09T06:30:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.690+0000 7f3a1effd700 1 -- 172.21.15.62:0/1391348994 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a24012670 con 0x7f3a300fcf70 2024-05-09T06:30:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.691+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3005f5c0 con 0x7f3a300fcf70 2024-05-09T06:30:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.692+0000 7f3a1effd700 1 -- 172.21.15.62:0/1391348994 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7f3a24018030 con 0x7f3a300fcf70 2024-05-09T06:30:53.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.693+0000 7f3a1effd700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3a18070c80 0x7f3a18073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:53.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.693+0000 7f3a1effd700 1 -- 172.21.15.62:0/1391348994 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3a24016070 con 0x7f3a300fcf70 2024-05-09T06:30:53.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.693+0000 7f3a2e59c700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3a18070c80 0x7f3a18073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:53.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.694+0000 7f3a2e59c700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3a18070c80 0x7f3a18073130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009b30 tx=0x7f3a20009e30 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:53.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:53.697+0000 7f3a1effd700 1 -- 172.21.15.62:0/1391348994 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f3a2405b7e0 con 0x7f3a300fcf70 2024-05-09T06:30:54.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.082+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a3004bed0 con 0x7f3a300fcf70 2024-05-09T06:30:54.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.083+0000 7f3a1effd700 1 -- 172.21.15.62:0/1391348994 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f3a2405b180 con 0x7f3a300fcf70 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:30:54.065 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:30:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 13, 2024-05-09T06:30:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:30:54.066 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:30:54.066 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:30:54.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.086+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3a18070c80 msgr2=0x7f3a18073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:54.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3a18070c80 0x7f3a18073130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009b30 tx=0x7f3a20009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:54.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300fcf70 msgr2=0x7f3a3010cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300fcf70 0x7f3a3010cdd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3a24010d50 tx=0x7f3a2400b040 comp rx=0 tx=0).stop 2024-05-09T06:30:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 shutdown_connections 2024-05-09T06:30:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7f3a18070c80 0x7f3a18073130 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a300fbcc0 0x7f3a3010c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 --2- 172.21.15.62:0/1391348994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a300fcf70 0x7f3a3010cdd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 >> 172.21.15.62:0/1391348994 conn(0x7f3a300f7420 msgr2=0x7f3a300f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 shutdown_connections 2024-05-09T06:30:54.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.087+0000 7f3a34ce4700 1 -- 172.21.15.62:0/1391348994 wait complete. 2024-05-09T06:30:54.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:53 smithi062 ceph-mon[26920]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:54.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:53 smithi062 ceph-mon[26920]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:54.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.201+0000 7f0009d8a700 1 -- 172.21.15.62:0/961723987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 msgr2=0x7f00040ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:54.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.201+0000 7f0009d8a700 1 --2- 172.21.15.62:0/961723987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 0x7f00040ff9a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efff4004940 tx=0x7efff4009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:54.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.201+0000 7f0009d8a700 1 -- 172.21.15.62:0/961723987 shutdown_connections 2024-05-09T06:30:54.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.201+0000 7f0009d8a700 1 --2- 172.21.15.62:0/961723987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040ffee0 0x7f0004102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:54.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.201+0000 7f0009d8a700 1 --2- 172.21.15.62:0/961723987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 0x7f00040ff9a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:54.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.201+0000 7f0009d8a700 1 -- 172.21.15.62:0/961723987 >> 172.21.15.62:0/961723987 conn(0x7f00040f7430 msgr2=0x7f00040f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:54.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.201+0000 7f0009d8a700 1 -- 172.21.15.62:0/961723987 shutdown_connections 2024-05-09T06:30:54.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.201+0000 7f0009d8a700 1 -- 172.21.15.62:0/961723987 wait complete. 2024-05-09T06:30:54.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.202+0000 7f0009d8a700 1 Processor -- start 2024-05-09T06:30:54.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.202+0000 7f0009d8a700 1 -- start start 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.202+0000 7f0009d8a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 0x7f000410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.202+0000 7f0009d8a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040ffee0 0x7f000410df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.202+0000 7f0009d8a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000410e540 con 0x7f00040662c0 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.202+0000 7f0009d8a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000410ed40 con 0x7f00040ffee0 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f00037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 0x7f000410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f0002ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040ffee0 0x7f000410df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f0002ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040ffee0 0x7f000410df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:45910/0 (socket says 172.21.15.62:45910) 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f00037fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 0x7f000410da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56918/0 (socket says 172.21.15.62:56918) 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f0002ffd700 1 -- 172.21.15.62:0/1178144543 learned_addr learned my addr 172.21.15.62:0/1178144543 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f0002ffd700 1 -- 172.21.15.62:0/1178144543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 msgr2=0x7f000410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f0002ffd700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 0x7f000410da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f0002ffd700 1 -- 172.21.15.62:0/1178144543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4005040 con 0x7f00040ffee0 2024-05-09T06:30:54.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.203+0000 7f0002ffd700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040ffee0 0x7f000410df40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efff800eb40 tx=0x7efff800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:54.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.204+0000 7effebfff700 1 -- 172.21.15.62:0/1178144543 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efff8007cc0 con 0x7f00040ffee0 2024-05-09T06:30:54.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.204+0000 7f0009d8a700 1 -- 172.21.15.62:0/1178144543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000410efc0 con 0x7f00040ffee0 2024-05-09T06:30:54.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.204+0000 7effebfff700 1 -- 172.21.15.62:0/1178144543 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efff800f040 con 0x7f00040ffee0 2024-05-09T06:30:54.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.204+0000 7effebfff700 1 -- 172.21.15.62:0/1178144543 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efff800ca10 con 0x7f00040ffee0 2024-05-09T06:30:54.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.204+0000 7f0009d8a700 1 -- 172.21.15.62:0/1178144543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000410f500 con 0x7f00040ffee0 2024-05-09T06:30:54.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.205+0000 7f0009d8a700 1 -- 172.21.15.62:0/1178144543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000405f5c0 con 0x7f00040ffee0 2024-05-09T06:30:54.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.206+0000 7effebfff700 1 -- 172.21.15.62:0/1178144543 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) v1 ==== 93314+0+0 (secure 0 0 0) 0x7efff800cb70 con 0x7f00040ffee0 2024-05-09T06:30:54.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.206+0000 7effebfff700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7effec070bb0 0x7effec073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:54.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.207+0000 7effebfff700 1 -- 172.21.15.62:0/1178144543 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7efff8054ee0 con 0x7f00040ffee0 2024-05-09T06:30:54.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.207+0000 7f00037fe700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7effec070bb0 0x7effec073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.207+0000 7f00037fe700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7effec070bb0 0x7effec073060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efff4013870 tx=0x7efff4009e30 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:54.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.212+0000 7effebfff700 1 -- 172.21.15.62:0/1178144543 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7efff80516c0 con 0x7f00040ffee0 2024-05-09T06:30:54.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:53 smithi079 ceph-mon[35268]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:54.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:53 smithi079 ceph-mon[35268]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:54.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.592+0000 7f0009d8a700 1 -- 172.21.15.62:0/1178144543 --> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f000410f880 con 0x7effec070bb0 2024-05-09T06:30:54.579 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:30:54.579 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:30:54.579 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:30:54.579 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:30:54.579 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-05-09T06:30:54.580 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "1/2 daemons upgraded", 2024-05-09T06:30:54.580 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mgr daemons", 2024-05-09T06:30:54.580 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:30:54.580 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:30:54.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.596+0000 7effebfff700 1 -- 172.21.15.62:0/1178144543 <== mgr.24377 v2:172.21.15.79:6828/2392096050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f000410f880 con 0x7effec070bb0 2024-05-09T06:30:54.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 -- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7effec070bb0 msgr2=0x7effec073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:54.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7effec070bb0 0x7effec073060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efff4013870 tx=0x7efff4009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:54.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 -- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040ffee0 msgr2=0x7f000410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:54.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040ffee0 0x7f000410df40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efff800eb40 tx=0x7efff800b040 comp rx=0 tx=0).stop 2024-05-09T06:30:54.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 -- 172.21.15.62:0/1178144543 shutdown_connections 2024-05-09T06:30:54.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:6828/2392096050,v1:172.21.15.79:6829/2392096050] conn(0x7effec070bb0 0x7effec073060 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efff4013870 tx=0x7efff4009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:54.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00040662c0 0x7f000410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:54.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 --2- 172.21.15.62:0/1178144543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00040ffee0 0x7f000410df40 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efff800eb40 tx=0x7efff800b040 comp rx=0 tx=0).stop 2024-05-09T06:30:54.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.602+0000 7effe9ffb700 1 -- 172.21.15.62:0/1178144543 >> 172.21.15.62:0/1178144543 conn(0x7f00040f7430 msgr2=0x7f00040f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:54.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.603+0000 7effe9ffb700 1 -- 172.21.15.62:0/1178144543 shutdown_connections 2024-05-09T06:30:54.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:30:54.604+0000 7effe9ffb700 1 -- 172.21.15.62:0/1178144543 wait complete. 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: pgmap v35: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.5 MiB/s wr, 274 op/s 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: Upgrade: Updating mgr.smithi062.juuasl 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi062.juuasl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi062.juuasl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:30:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: Deploying daemon mgr.smithi062.juuasl on smithi062 2024-05-09T06:30:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:54 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1391348994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: pgmap v35: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.5 MiB/s wr, 274 op/s 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: Upgrade: Updating mgr.smithi062.juuasl 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi062.juuasl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi062.juuasl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: Deploying daemon mgr.smithi062.juuasl on smithi062 2024-05-09T06:30:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:54 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1391348994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:30:56.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:55 smithi062 ceph-mon[26920]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:56.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:55 smithi079 ceph-mon[35268]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:57.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:56 smithi079 ceph-mon[35268]: pgmap v36: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.8 MiB/s wr, 341 op/s 2024-05-09T06:30:57.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:56 smithi062 ceph-mon[26920]: pgmap v36: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.8 MiB/s wr, 341 op/s 2024-05-09T06:30:59.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:30:58 smithi079 ceph-mon[35268]: pgmap v37: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 429 op/s 2024-05-09T06:30:59.376 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:30:58 smithi062 ceph-mon[26920]: pgmap v37: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 429 op/s 2024-05-09T06:31:01.035 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:00 smithi062 ceph-mon[26920]: pgmap v38: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 340 op/s 2024-05-09T06:31:01.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:00 smithi079 ceph-mon[35268]: pgmap v38: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 340 op/s 2024-05-09T06:31:02.515 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:02 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:02.515 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:02 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:02.515 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:02 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:02.515 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:02 smithi062 ceph-mon[26920]: pgmap v39: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 2.4 MiB/s wr, 501 op/s 2024-05-09T06:31:02.515 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:02 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:02.515 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:02 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:02 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:02 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:02 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:02 smithi079 ceph-mon[35268]: pgmap v39: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 2.4 MiB/s wr, 501 op/s 2024-05-09T06:31:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:02 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:02 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:05.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:04 smithi062 ceph-mon[26920]: pgmap v40: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.6 MiB/s wr, 375 op/s 2024-05-09T06:31:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:04 smithi079 ceph-mon[35268]: pgmap v40: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.6 MiB/s wr, 375 op/s 2024-05-09T06:31:06.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:05 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:06.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:05 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:06.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:05 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:05 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:05 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:05 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:07.134 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:07 smithi062 ceph-mon[26920]: pgmap v41: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 2.0 MiB/s wr, 621 op/s 2024-05-09T06:31:07.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:07 smithi079 ceph-mon[35268]: pgmap v41: 65 pgs: 65 active+clean; 315 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 2.0 MiB/s wr, 621 op/s 2024-05-09T06:31:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:09 smithi079 ceph-mon[35268]: pgmap v42: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 1.03k op/s 2024-05-09T06:31:09.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:09 smithi062 ceph-mon[26920]: pgmap v42: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 1.03k op/s 2024-05-09T06:31:11.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:11 smithi079 ceph-mon[35268]: pgmap v43: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 888 op/s 2024-05-09T06:31:11.323 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:11 smithi062 ceph-mon[26920]: pgmap v43: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 888 op/s 2024-05-09T06:31:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:12 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:12 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:12 smithi079 ceph-mon[35268]: Standby manager daemon smithi062.juuasl restarted 2024-05-09T06:31:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:12 smithi079 ceph-mon[35268]: Standby manager daemon smithi062.juuasl started 2024-05-09T06:31:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:12 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi062.juuasl/crt"}]: dispatch 2024-05-09T06:31:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:12 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:31:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:12 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi062.juuasl/key"}]: dispatch 2024-05-09T06:31:12.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:12 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:31:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:12 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:12 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:12 smithi062 ceph-mon[26920]: Standby manager daemon smithi062.juuasl restarted 2024-05-09T06:31:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:12 smithi062 ceph-mon[26920]: Standby manager daemon smithi062.juuasl started 2024-05-09T06:31:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:12 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi062.juuasl/crt"}]: dispatch 2024-05-09T06:31:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:12 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:31:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:12 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi062.juuasl/key"}]: dispatch 2024-05-09T06:31:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:12 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:31:13.552 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:13 smithi062 ceph-mon[26920]: pgmap v44: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.0 MiB/s wr, 1.09k op/s 2024-05-09T06:31:13.552 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:13 smithi062 ceph-mon[26920]: mgrmap e25: smithi079.genyri(active, since 82s), standbys: smithi062.juuasl 2024-05-09T06:31:13.552 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:13 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:13.552 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:13 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:13.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:13 smithi079 ceph-mon[35268]: pgmap v44: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.0 MiB/s wr, 1.09k op/s 2024-05-09T06:31:13.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:13 smithi079 ceph-mon[35268]: mgrmap e25: smithi079.genyri(active, since 82s), standbys: smithi062.juuasl 2024-05-09T06:31:13.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:13 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:13.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:13 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:15 smithi079 ceph-mon[35268]: pgmap v45: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 932 op/s 2024-05-09T06:31:15.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:15 smithi062 ceph-mon[26920]: pgmap v45: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 932 op/s 2024-05-09T06:31:17.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:17 smithi079 ceph-mon[35268]: pgmap v46: 65 pgs: 65 active+clean; 287 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 959 op/s 2024-05-09T06:31:17.633 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:17 smithi062 ceph-mon[26920]: pgmap v46: 65 pgs: 65 active+clean; 287 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 959 op/s 2024-05-09T06:31:19.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:19 smithi062 ceph-mon[26920]: pgmap v47: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 845 op/s 2024-05-09T06:31:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:19 smithi079 ceph-mon[35268]: pgmap v47: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 845 op/s 2024-05-09T06:31:20.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr fail", "who": "smithi079.genyri"}]: dispatch 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr fail", "who": "smithi079.genyri"}]: dispatch 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: Activating manager daemon smithi062.juuasl 2024-05-09T06:31:20.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd='[{"prefix": "mgr fail", "who": "smithi079.genyri"}]': finished 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: mgrmap e26: smithi062.juuasl(active, starting, since 0.00989504s) 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:31:20.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: Manager daemon smithi062.juuasl is now available 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:20.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/trash_purge_schedule"}]: dispatch 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 172.21.15.79:0/4098000481' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr fail", "who": "smithi079.genyri"}]: dispatch 2024-05-09T06:31:20.876 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd=[{"prefix": "mgr fail", "who": "smithi079.genyri"}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: Activating manager daemon smithi062.juuasl 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.24377 ' entity='mgr.smithi079.genyri' cmd='[{"prefix": "mgr fail", "who": "smithi079.genyri"}]': finished 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: mgrmap e26: smithi062.juuasl(active, starting, since 0.00989504s) 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:31:20.877 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: Manager daemon smithi062.juuasl is now available 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:20.878 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/trash_purge_schedule"}]: dispatch 2024-05-09T06:31:22.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:21 smithi079 ceph-mon[35268]: [09/May/2024:06:31:20] ENGINE Bus STARTING 2024-05-09T06:31:22.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:21 smithi079 ceph-mon[35268]: [09/May/2024:06:31:20] ENGINE Serving on https://172.21.15.62:7150 2024-05-09T06:31:22.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:21 smithi079 ceph-mon[35268]: [09/May/2024:06:31:20] ENGINE Serving on http://172.21.15.62:8765 2024-05-09T06:31:22.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:21 smithi079 ceph-mon[35268]: [09/May/2024:06:31:20] ENGINE Bus STARTED 2024-05-09T06:31:22.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:21 smithi079 ceph-mon[35268]: mgrmap e27: smithi062.juuasl(active, since 1.0129s) 2024-05-09T06:31:22.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:21 smithi079 ceph-mon[35268]: pgmap v3: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:21 smithi062 ceph-mon[26920]: [09/May/2024:06:31:20] ENGINE Bus STARTING 2024-05-09T06:31:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:21 smithi062 ceph-mon[26920]: [09/May/2024:06:31:20] ENGINE Serving on https://172.21.15.62:7150 2024-05-09T06:31:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:21 smithi062 ceph-mon[26920]: [09/May/2024:06:31:20] ENGINE Serving on http://172.21.15.62:8765 2024-05-09T06:31:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:21 smithi062 ceph-mon[26920]: [09/May/2024:06:31:20] ENGINE Bus STARTED 2024-05-09T06:31:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:21 smithi062 ceph-mon[26920]: mgrmap e27: smithi062.juuasl(active, since 1.0129s) 2024-05-09T06:31:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:21 smithi062 ceph-mon[26920]: pgmap v3: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:22.985 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:22 smithi079 ceph-mon[35268]: pgmap v4: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:22.986 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:22 smithi079 ceph-mon[35268]: mgrmap e28: smithi062.juuasl(active, since 2s) 2024-05-09T06:31:23.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:22 smithi062 ceph-mon[26920]: pgmap v4: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:23.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:22 smithi062 ceph-mon[26920]: mgrmap e28: smithi062.juuasl(active, since 2s) 2024-05-09T06:31:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.752+0000 7f296c082700 1 -- 172.21.15.62:0/3492434990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29640ffef0 msgr2=0x7f2964102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.752+0000 7f296c082700 1 --2- 172.21.15.62:0/3492434990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29640ffef0 0x7f2964102310 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2954004940 tx=0x7f2954009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.752+0000 7f296c082700 1 -- 172.21.15.62:0/3492434990 shutdown_connections 2024-05-09T06:31:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.752+0000 7f296c082700 1 --2- 172.21.15.62:0/3492434990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29640ffef0 0x7f2964102310 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.752+0000 7f296c082700 1 --2- 172.21.15.62:0/3492434990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2964066b50 0x7f29640ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.752+0000 7f296c082700 1 -- 172.21.15.62:0/3492434990 >> 172.21.15.62:0/3492434990 conn(0x7f29640f7420 msgr2=0x7f29640f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.752+0000 7f296c082700 1 -- 172.21.15.62:0/3492434990 shutdown_connections 2024-05-09T06:31:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.752+0000 7f296c082700 1 -- 172.21.15.62:0/3492434990 wait complete. 2024-05-09T06:31:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f296c082700 1 Processor -- start 2024-05-09T06:31:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f296c082700 1 -- start start 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f296c082700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2964066b50 0x7f29640fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f296c082700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640ffef0 0x7f29640fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f296c082700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29640fbdf0 con 0x7f2964066b50 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f296c082700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29640fbf30 con 0x7f29640ffef0 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f2969e1e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2964066b50 0x7f29640fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f2969e1e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2964066b50 0x7f29640fd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56030/0 (socket says 172.21.15.62:56030) 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f2969e1e700 1 -- 172.21.15.62:0/1711316377 learned_addr learned my addr 172.21.15.62:0/1711316377 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f296961d700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640ffef0 0x7f29640fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f2969e1e700 1 -- 172.21.15.62:0/1711316377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640ffef0 msgr2=0x7f29640fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f2969e1e700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640ffef0 0x7f29640fb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f2969e1e700 1 -- 172.21.15.62:0/1711316377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954005040 con 0x7f2964066b50 2024-05-09T06:31:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.753+0000 7f296961d700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640ffef0 0x7f29640fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:31:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.754+0000 7f2969e1e700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2964066b50 0x7f29640fd340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f296000eb40 tx=0x7f296000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.754+0000 7f295a7fc700 1 -- 172.21.15.62:0/1711316377 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2960007cc0 con 0x7f2964066b50 2024-05-09T06:31:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.754+0000 7f295a7fc700 1 -- 172.21.15.62:0/1711316377 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f296000f040 con 0x7f2964066b50 2024-05-09T06:31:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.754+0000 7f295a7fc700 1 -- 172.21.15.62:0/1711316377 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29600095e0 con 0x7f2964066b50 2024-05-09T06:31:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.754+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29640fc1b0 con 0x7f2964066b50 2024-05-09T06:31:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.754+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29640fc6f0 con 0x7f2964066b50 2024-05-09T06:31:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.755+0000 7f295a7fc700 1 -- 172.21.15.62:0/1711316377 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 29) v1 ==== 50230+0+0 (secure 0 0 0) 0x7f2960009740 con 0x7f2964066b50 2024-05-09T06:31:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.756+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296405f5c0 con 0x7f2964066b50 2024-05-09T06:31:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.756+0000 7f295a7fc700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f295003e330 0x7f29500407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.756+0000 7f295a7fc700 1 -- 172.21.15.62:0/1711316377 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2960054e30 con 0x7f2964066b50 2024-05-09T06:31:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.756+0000 7f296961d700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f295003e330 0x7f29500407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.756+0000 7f296961d700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f295003e330 0x7f29500407e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2954009b30 tx=0x7f2954009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:24.763+0000 7f295a7fc700 1 -- 172.21.15.62:0/1711316377 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f2960058060 con 0x7f2964066b50 2024-05-09T06:31:25.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.096+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29640f8f60 con 0x7f295003e330 2024-05-09T06:31:25.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:25.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:25.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:24 smithi062 ceph-mon[26920]: pgmap v5: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:25.078 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:24 smithi062 ceph-mon[26920]: mgrmap e29: smithi062.juuasl(active, since 4s) 2024-05-09T06:31:25.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.098+0000 7f295a7fc700 1 -- 172.21.15.62:0/1711316377 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f29640f8f60 con 0x7f295003e330 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f295003e330 msgr2=0x7f29500407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f295003e330 0x7f29500407e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2954009b30 tx=0x7f2954009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2964066b50 msgr2=0x7f29640fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2964066b50 0x7f29640fd340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f296000eb40 tx=0x7f296000b040 comp rx=0 tx=0).stop 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 shutdown_connections 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f295003e330 0x7f29500407e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2964066b50 0x7f29640fd340 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 --2- 172.21.15.62:0/1711316377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29640ffef0 0x7f29640fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 >> 172.21.15.62:0/1711316377 conn(0x7f29640f7420 msgr2=0x7f29640f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:25.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.101+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 shutdown_connections 2024-05-09T06:31:25.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.102+0000 7f296c082700 1 -- 172.21.15.62:0/1711316377 wait complete. 2024-05-09T06:31:25.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:25.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:25.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:24 smithi079 ceph-mon[35268]: pgmap v5: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:25.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:24 smithi079 ceph-mon[35268]: mgrmap e29: smithi062.juuasl(active, since 4s) 2024-05-09T06:31:25.095 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:31:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.241+0000 7f25e4281700 1 -- 172.21.15.62:0/1363704715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fdfd0 msgr2=0x7f25dc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.241+0000 7f25e4281700 1 --2- 172.21.15.62:0/1363704715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fdfd0 0x7f25dc0fe440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f25cc004940 tx=0x7f25cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.241+0000 7f25e4281700 1 -- 172.21.15.62:0/1363704715 shutdown_connections 2024-05-09T06:31:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.241+0000 7f25e4281700 1 --2- 172.21.15.62:0/1363704715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fdfd0 0x7f25dc0fe440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.241+0000 7f25e4281700 1 --2- 172.21.15.62:0/1363704715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25dc0fce60 0x7f25dc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.241+0000 7f25e4281700 1 -- 172.21.15.62:0/1363704715 >> 172.21.15.62:0/1363704715 conn(0x7f25dc0f8540 msgr2=0x7f25dc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.241+0000 7f25e4281700 1 -- 172.21.15.62:0/1363704715 shutdown_connections 2024-05-09T06:31:25.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.241+0000 7f25e4281700 1 -- 172.21.15.62:0/1363704715 wait complete. 2024-05-09T06:31:25.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e4281700 1 Processor -- start 2024-05-09T06:31:25.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e4281700 1 -- start start 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e4281700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fce60 0x7f25dc071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e4281700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25dc0fdfd0 0x7f25dc0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e4281700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc072200 con 0x7f25dc0fce60 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e4281700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0707f0 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e201d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fce60 0x7f25dc071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e201d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fce60 0x7f25dc071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56058/0 (socket says 172.21.15.62:56058) 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e201d700 1 -- 172.21.15.62:0/3771009345 learned_addr learned my addr 172.21.15.62:0/3771009345 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.242+0000 7f25e181c700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25dc0fdfd0 0x7f25dc0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25e181c700 1 -- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fce60 msgr2=0x7f25dc071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25e181c700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fce60 0x7f25dc071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25e181c700 1 -- 172.21.15.62:0/3771009345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc005040 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25e201d700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fce60 0x7f25dc071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:31:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25e181c700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25dc0fdfd0 0x7f25dc0702b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25cc000c00 tx=0x7f25cc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25d2ffd700 1 -- 172.21.15.62:0/3771009345 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25cc00e030 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc070a40 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25d2ffd700 1 -- 172.21.15.62:0/3771009345 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25cc01c400 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25d2ffd700 1 -- 172.21.15.62:0/3771009345 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25cc00b650 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.243+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc070f80 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.244+0000 7f25d2ffd700 1 -- 172.21.15.62:0/3771009345 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 29) v1 ==== 50230+0+0 (secure 0 0 0) 0x7f25cc00b840 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.245+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc04c710 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.245+0000 7f25d2ffd700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25c803e340 0x7f25c80407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.245+0000 7f25d2ffd700 1 -- 172.21.15.62:0/3771009345 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f25cc054b80 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.245+0000 7f25e201d700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25c803e340 0x7f25c80407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:25.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.246+0000 7f25e201d700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25c803e340 0x7f25c80407f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007fd0 tx=0x7f25d800b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:25.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.250+0000 7f25d2ffd700 1 -- 172.21.15.62:0/3771009345 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f25cc023580 con 0x7f25dc0fdfd0 2024-05-09T06:31:25.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.610+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25dc1022a0 con 0x7f25c803e340 2024-05-09T06:31:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.612+0000 7f25d2ffd700 1 -- 172.21.15.62:0/3771009345 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f25dc1022a0 con 0x7f25c803e340 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25c803e340 msgr2=0x7f25c80407f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25c803e340 0x7f25c80407f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007fd0 tx=0x7f25d800b040 comp rx=0 tx=0).stop 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25dc0fdfd0 msgr2=0x7f25dc0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25dc0fdfd0 0x7f25dc0702b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25cc000c00 tx=0x7f25cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 shutdown_connections 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25c803e340 0x7f25c80407f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25dc0fce60 0x7f25dc071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 --2- 172.21.15.62:0/3771009345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25dc0fdfd0 0x7f25dc0702b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 >> 172.21.15.62:0/3771009345 conn(0x7f25dc0f8540 msgr2=0x7f25dc0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:25.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 shutdown_connections 2024-05-09T06:31:25.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.615+0000 7f25e4281700 1 -- 172.21.15.62:0/3771009345 wait complete. 2024-05-09T06:31:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.750+0000 7feb883fc700 1 -- 172.21.15.62:0/745347308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb800ffef0 msgr2=0x7feb80102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.750+0000 7feb883fc700 1 --2- 172.21.15.62:0/745347308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb800ffef0 0x7feb80102310 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feb70004940 tx=0x7feb70009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.750+0000 7feb883fc700 1 -- 172.21.15.62:0/745347308 shutdown_connections 2024-05-09T06:31:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.750+0000 7feb883fc700 1 --2- 172.21.15.62:0/745347308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb800ffef0 0x7feb80102310 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.750+0000 7feb883fc700 1 --2- 172.21.15.62:0/745347308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb80066b50 0x7feb800ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.750+0000 7feb883fc700 1 -- 172.21.15.62:0/745347308 >> 172.21.15.62:0/745347308 conn(0x7feb800f7420 msgr2=0x7feb800f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:25.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.750+0000 7feb883fc700 1 -- 172.21.15.62:0/745347308 shutdown_connections 2024-05-09T06:31:25.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.751+0000 7feb883fc700 1 -- 172.21.15.62:0/745347308 wait complete. 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.751+0000 7feb883fc700 1 Processor -- start 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.751+0000 7feb883fc700 1 -- start start 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.751+0000 7feb883fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb80066b50 0x7feb800fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.751+0000 7feb883fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb800ffef0 0x7feb800fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb883fc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800fbe60 con 0x7feb80066b50 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb883fc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800fbfd0 con 0x7feb800ffef0 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb86198700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb80066b50 0x7feb800fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb85997700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb800ffef0 0x7feb800fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb86198700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb80066b50 0x7feb800fd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56078/0 (socket says 172.21.15.62:56078) 2024-05-09T06:31:25.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb86198700 1 -- 172.21.15.62:0/2641546963 learned_addr learned my addr 172.21.15.62:0/2641546963 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb85997700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb800ffef0 0x7feb800fb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:42002/0 (socket says 172.21.15.62:42002) 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb85997700 1 -- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb80066b50 msgr2=0x7feb800fd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb85997700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb80066b50 0x7feb800fd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb85997700 1 -- 172.21.15.62:0/2641546963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70005040 con 0x7feb800ffef0 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb85997700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb800ffef0 0x7feb800fb8b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb70000c00 tx=0x7feb70009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.752+0000 7feb76ffd700 1 -- 172.21.15.62:0/2641546963 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb7000e030 con 0x7feb800ffef0 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.753+0000 7feb76ffd700 1 -- 172.21.15.62:0/2641546963 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb70013de0 con 0x7feb800ffef0 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.753+0000 7feb76ffd700 1 -- 172.21.15.62:0/2641546963 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb7001ce50 con 0x7feb800ffef0 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.753+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb800fc250 con 0x7feb800ffef0 2024-05-09T06:31:25.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.753+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb800fc680 con 0x7feb800ffef0 2024-05-09T06:31:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.754+0000 7feb76ffd700 1 -- 172.21.15.62:0/2641546963 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 29) v1 ==== 50230+0+0 (secure 0 0 0) 0x7feb7000b4a0 con 0x7feb800ffef0 2024-05-09T06:31:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.754+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8005f5c0 con 0x7feb800ffef0 2024-05-09T06:31:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.754+0000 7feb76ffd700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb6c03e320 0x7feb6c0407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.754+0000 7feb76ffd700 1 -- 172.21.15.62:0/2641546963 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7feb70054b90 con 0x7feb800ffef0 2024-05-09T06:31:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.755+0000 7feb86198700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb6c03e320 0x7feb6c0407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:25.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.755+0000 7feb86198700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb6c03e320 0x7feb6c0407d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb800fd170 tx=0x7feb7c00b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:25.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:25.759+0000 7feb76ffd700 1 -- 172.21.15.62:0/2641546963 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7feb70025400 con 0x7feb800ffef0 2024-05-09T06:31:26.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.069+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb800f8f60 con 0x7feb6c03e320 2024-05-09T06:31:26.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.092+0000 7feb76ffd700 1 -- 172.21.15.62:0/2641546963 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7feb800f8f60 con 0x7feb6c03e320 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (61s) 14s ago 9m 23.8M - 0.25.0 c8568f914cd2 3e6fb3c83327 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (10m) 14s ago 10m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (8m) 2s ago 8m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (56s) 14s ago 9m 79.9M - 9.4.7 954c08fa6188 93e460121fb3 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (4m) 14s ago 4m 13.9M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (4m) 14s ago 4m 209M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (3m) 2s ago 3m 14.0M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (4m) 2s ago 4m 14.0M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (25s) 14s ago 11m 101M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283 running (109s) 2s ago 8m 83.5M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5fe8e477d847 2024-05-09T06:31:26.074 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (11m) 14s ago 11m 53.8M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (8m) 2s ago 8m 42.9M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (67s) 14s ago 10m 15.4M - 1.5.0 0da6a335fe13 d00a1671f6a3 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (34s) 2s ago 8m 8456k - 1.5.0 0da6a335fe13 8cbfce49709c 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (7m) 14s ago 7m 207M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (7m) 14s ago 7m 228M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (6m) 14s ago 6m 189M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (6m) 2s ago 6m 271M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (6m) 2s ago 6m 239M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (5m) 2s ago 5m 232M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:31:26.075 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (40s) 14s ago 9m 44.3M - 2.43.0 a07b618ecd1d 4350cb0e42b0 2024-05-09T06:31:26.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.096+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb6c03e320 msgr2=0x7feb6c0407d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:26.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.096+0000 7feb883fc700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb6c03e320 0x7feb6c0407d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb800fd170 tx=0x7feb7c00b040 comp rx=0 tx=0).stop 2024-05-09T06:31:26.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.096+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb800ffef0 msgr2=0x7feb800fb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:26.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.096+0000 7feb883fc700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb800ffef0 0x7feb800fb8b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb70000c00 tx=0x7feb70009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:26.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.096+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 shutdown_connections 2024-05-09T06:31:26.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.097+0000 7feb883fc700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb6c03e320 0x7feb6c0407d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.097+0000 7feb883fc700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb80066b50 0x7feb800fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.097+0000 7feb883fc700 1 --2- 172.21.15.62:0/2641546963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb800ffef0 0x7feb800fb8b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.097+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 >> 172.21.15.62:0/2641546963 conn(0x7feb800f7420 msgr2=0x7feb800f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:26.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.097+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 shutdown_connections 2024-05-09T06:31:26.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.097+0000 7feb883fc700 1 -- 172.21.15.62:0/2641546963 wait complete. 2024-05-09T06:31:26.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.281+0000 7fa043f82700 1 -- 172.21.15.62:0/1651940146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fcf60 msgr2=0x7fa03c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:26.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.281+0000 7fa043f82700 1 --2- 172.21.15.62:0/1651940146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fcf60 0x7fa03c0fd3d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0049c0 tx=0x7fa02c009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:26.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.282+0000 7fa043f82700 1 -- 172.21.15.62:0/1651940146 shutdown_connections 2024-05-09T06:31:26.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.282+0000 7fa043f82700 1 --2- 172.21.15.62:0/1651940146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fcf60 0x7fa03c0fd3d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.282+0000 7fa043f82700 1 --2- 172.21.15.62:0/1651940146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03c0fbcb0 0x7fa03c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.282+0000 7fa043f82700 1 -- 172.21.15.62:0/1651940146 >> 172.21.15.62:0/1651940146 conn(0x7fa03c0f7430 msgr2=0x7fa03c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:26.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.282+0000 7fa043f82700 1 -- 172.21.15.62:0/1651940146 shutdown_connections 2024-05-09T06:31:26.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.283+0000 7fa043f82700 1 -- 172.21.15.62:0/1651940146 wait complete. 2024-05-09T06:31:26.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.284+0000 7fa043f82700 1 Processor -- start 2024-05-09T06:31:26.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.284+0000 7fa043f82700 1 -- start start 2024-05-09T06:31:26.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.284+0000 7fa043f82700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fbcb0 0x7fa03c067d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.284+0000 7fa043f82700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03c0fcf60 0x7fa03c068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.284+0000 7fa043f82700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0688c0 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.284+0000 7fa043f82700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0690c0 con 0x7fa03c0fcf60 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.285+0000 7fa041d1e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fbcb0 0x7fa03c067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.285+0000 7fa041d1e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fbcb0 0x7fa03c067d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56088/0 (socket says 172.21.15.62:56088) 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.285+0000 7fa041d1e700 1 -- 172.21.15.62:0/2349853657 learned_addr learned my addr 172.21.15.62:0/2349853657 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.285+0000 7fa04151d700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03c0fcf60 0x7fa03c068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.285+0000 7fa041d1e700 1 -- 172.21.15.62:0/2349853657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03c0fcf60 msgr2=0x7fa03c068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.285+0000 7fa041d1e700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03c0fcf60 0x7fa03c068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.285+0000 7fa041d1e700 1 -- 172.21.15.62:0/2349853657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c005040 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.286+0000 7fa041d1e700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fbcb0 0x7fa03c067d30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa03800cb10 tx=0x7fa038007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:26.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.286+0000 7fa0327fc700 1 -- 172.21.15.62:0/2349853657 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa038004200 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.286+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c0693a0 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.286+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c069960 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.286+0000 7fa0327fc700 1 -- 172.21.15.62:0/2349853657 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa03800ac70 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.286+0000 7fa0327fc700 1 -- 172.21.15.62:0/2349853657 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa038003cc0 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.288+0000 7fa0327fc700 1 -- 172.21.15.62:0/2349853657 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 29) v1 ==== 50230+0+0 (secure 0 0 0) 0x7fa03800a7a0 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.288+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0200052e0 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.289+0000 7fa0327fc700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa02803e3d0 0x7fa028040880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.289+0000 7fa0327fc700 1 -- 172.21.15.62:0/2349853657 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa038053630 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.289+0000 7fa04151d700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa02803e3d0 0x7fa028040880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:26.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.290+0000 7fa04151d700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa02803e3d0 0x7fa028040880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa02c000c00 tx=0x7fa02c009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:26.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.299+0000 7fa0327fc700 1 -- 172.21.15.62:0/2349853657 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fa038011e10 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:26 smithi079 ceph-mon[35268]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:26.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:26 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:26.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:26 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:26.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:26 smithi062 ceph-mon[26920]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:26.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:26 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:26.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:26 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:26.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.701+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa020005860 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.702+0000 7fa0327fc700 1 -- 172.21.15.62:0/2349853657 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fa038011e10 con 0x7fa03c0fbcb0 2024-05-09T06:31:26.683 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:31:26.683 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:31:26.683 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:31:26.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:31:26.684 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:31:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa02803e3d0 msgr2=0x7fa028040880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa02803e3d0 0x7fa028040880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa02c000c00 tx=0x7fa02c009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fbcb0 msgr2=0x7fa03c067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fbcb0 0x7fa03c067d30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa03800cb10 tx=0x7fa038007f90 comp rx=0 tx=0).stop 2024-05-09T06:31:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 shutdown_connections 2024-05-09T06:31:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa02803e3d0 0x7fa028040880 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa03c0fbcb0 0x7fa03c067d30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 --2- 172.21.15.62:0/2349853657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa03c0fcf60 0x7fa03c068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 >> 172.21.15.62:0/2349853657 conn(0x7fa03c0f7430 msgr2=0x7fa03c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 shutdown_connections 2024-05-09T06:31:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.705+0000 7fa043f82700 1 -- 172.21.15.62:0/2349853657 wait complete. 2024-05-09T06:31:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 -- 172.21.15.62:0/2364455057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 msgr2=0x7fe2840fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 --2- 172.21.15.62:0/2364455057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 0x7fe2840fd320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe280004940 tx=0x7fe280009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 -- 172.21.15.62:0/2364455057 shutdown_connections 2024-05-09T06:31:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 --2- 172.21.15.62:0/2364455057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2840fe080 0x7fe2840fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 --2- 172.21.15.62:0/2364455057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 0x7fe2840fd320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 -- 172.21.15.62:0/2364455057 >> 172.21.15.62:0/2364455057 conn(0x7fe2840f8560 msgr2=0x7fe2840fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 -- 172.21.15.62:0/2364455057 shutdown_connections 2024-05-09T06:31:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 -- 172.21.15.62:0/2364455057 wait complete. 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.835+0000 7fe28b679700 1 Processor -- start 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe28b679700 1 -- start start 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe28b679700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 0x7fe28410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe28b679700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2840fe080 0x7fe28410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe28b679700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28410e4a0 con 0x7fe2840fcf10 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe28b679700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28410ecf0 con 0x7fe2840fe080 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe289415700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 0x7fe28410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe289415700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 0x7fe28410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56100/0 (socket says 172.21.15.62:56100) 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe289415700 1 -- 172.21.15.62:0/1822144420 learned_addr learned my addr 172.21.15.62:0/1822144420 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe288c14700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2840fe080 0x7fe28410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe289415700 1 -- 172.21.15.62:0/1822144420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2840fe080 msgr2=0x7fe28410dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe289415700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2840fe080 0x7fe28410dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.836+0000 7fe289415700 1 -- 172.21.15.62:0/1822144420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280005040 con 0x7fe2840fcf10 2024-05-09T06:31:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.837+0000 7fe289415700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 0x7fe28410d960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe280013870 tx=0x7fe280009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.837+0000 7fe279ffb700 1 -- 172.21.15.62:0/1822144420 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe280021070 con 0x7fe2840fcf10 2024-05-09T06:31:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.837+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28410ef70 con 0x7fe2840fcf10 2024-05-09T06:31:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.837+0000 7fe279ffb700 1 -- 172.21.15.62:0/1822144420 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe280009430 con 0x7fe2840fcf10 2024-05-09T06:31:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.837+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28410f4b0 con 0x7fe2840fcf10 2024-05-09T06:31:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.838+0000 7fe279ffb700 1 -- 172.21.15.62:0/1822144420 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe28000e070 con 0x7fe2840fcf10 2024-05-09T06:31:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.839+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28405f5c0 con 0x7fe2840fcf10 2024-05-09T06:31:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.839+0000 7fe279ffb700 1 -- 172.21.15.62:0/1822144420 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 29) v1 ==== 50230+0+0 (secure 0 0 0) 0x7fe280026410 con 0x7fe2840fcf10 2024-05-09T06:31:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.839+0000 7fe279ffb700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fe27003e330 0x7fe2700407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.840+0000 7fe279ffb700 1 -- 172.21.15.62:0/1822144420 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe280054570 con 0x7fe2840fcf10 2024-05-09T06:31:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.840+0000 7fe288c14700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fe27003e330 0x7fe2700407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.840+0000 7fe288c14700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fe27003e330 0x7fe2700407e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe274009b80 tx=0x7fe27400b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:26.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:26.845+0000 7fe279ffb700 1 -- 172.21.15.62:0/1822144420 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fe2800123c0 con 0x7fe2840fcf10 2024-05-09T06:31:27.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.220+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe28410f7e0 con 0x7fe27003e330 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "2/2 daemons upgraded", 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "", 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:31:27.204 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:31:27.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.222+0000 7fe279ffb700 1 -- 172.21.15.62:0/1822144420 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fe28410f7e0 con 0x7fe27003e330 2024-05-09T06:31:27.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fe27003e330 msgr2=0x7fe2700407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:27.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fe27003e330 0x7fe2700407e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe274009b80 tx=0x7fe27400b040 comp rx=0 tx=0).stop 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 msgr2=0x7fe28410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 0x7fe28410d960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe280013870 tx=0x7fe280009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 shutdown_connections 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fe27003e330 0x7fe2700407e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2840fcf10 0x7fe28410d960 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 --2- 172.21.15.62:0/1822144420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2840fe080 0x7fe28410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 >> 172.21.15.62:0/1822144420 conn(0x7fe2840f8560 msgr2=0x7fe2840f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 shutdown_connections 2024-05-09T06:31:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:27.225+0000 7fe28b679700 1 -- 172.21.15.62:0/1822144420 wait complete. 2024-05-09T06:31:27.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:27 smithi079 ceph-mon[35268]: from='client.24495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:27.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:27 smithi079 ceph-mon[35268]: pgmap v6: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:27.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:27 smithi079 ceph-mon[35268]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:27.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:27 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2349853657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:31:27.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:27 smithi062 ceph-mon[26920]: from='client.24495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:27.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:27 smithi062 ceph-mon[26920]: pgmap v6: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:27.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:27 smithi062 ceph-mon[26920]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:27.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:27 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2349853657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:31:28.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:28 smithi079 ceph-mon[35268]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:28.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:28 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:28.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:28 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:28.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:28 smithi079 ceph-mon[35268]: Standby manager daemon smithi079.genyri started 2024-05-09T06:31:28.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:28 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/4090807165' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:31:28.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:28 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/4090807165' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:31:28.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:28 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/4090807165' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:31:28.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:28 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/4090807165' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:31:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:28 smithi062 ceph-mon[26920]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:28 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:28 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:28 smithi062 ceph-mon[26920]: Standby manager daemon smithi079.genyri started 2024-05-09T06:31:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:28 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/4090807165' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:31:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:28 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/4090807165' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:31:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:28 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/4090807165' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:31:28.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:28 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/4090807165' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:31:29.572 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:29 smithi062 ceph-mon[26920]: pgmap v7: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.1 MiB/s wr, 230 op/s 2024-05-09T06:31:29.572 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:29 smithi062 ceph-mon[26920]: mgrmap e30: smithi062.juuasl(active, since 8s), standbys: smithi079.genyri 2024-05-09T06:31:29.572 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:29 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi079.genyri", "id": "smithi079.genyri"}]: dispatch 2024-05-09T06:31:29.572 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:29 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:29.572 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:29 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:29.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:29 smithi079 ceph-mon[35268]: pgmap v7: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.1 MiB/s wr, 230 op/s 2024-05-09T06:31:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:29 smithi079 ceph-mon[35268]: mgrmap e30: smithi062.juuasl(active, since 8s), standbys: smithi079.genyri 2024-05-09T06:31:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:29 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi079.genyri", "id": "smithi079.genyri"}]: dispatch 2024-05-09T06:31:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:29 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:29 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:31 smithi062 ceph-mon[26920]: pgmap v8: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 856 KiB/s wr, 178 op/s 2024-05-09T06:31:31.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:31 smithi079 ceph-mon[35268]: pgmap v8: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 856 KiB/s wr, 178 op/s 2024-05-09T06:31:33.549 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:33 smithi079 ceph-mon[35268]: pgmap v9: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.4 MiB/s wr, 546 op/s 2024-05-09T06:31:33.549 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:33 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:33.549 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:33 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:33.550 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:33 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:33.550 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:33 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:31:33.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:33 smithi062 ceph-mon[26920]: pgmap v9: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.4 MiB/s wr, 546 op/s 2024-05-09T06:31:33.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:33 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:33.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:33 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:33.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:33 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:33.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:33 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:34 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:34.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:34 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:35.492 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-05-09T06:31:35.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-09T06:31:35.529 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:35 smithi062 ceph-mon[26920]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:31:35.529 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:35 smithi062 ceph-mon[26920]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:31:35.529 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:35 smithi062 ceph-mon[26920]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:31:35.529 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:35 smithi062 ceph-mon[26920]: pgmap v10: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.3 MiB/s wr, 500 op/s 2024-05-09T06:31:35.529 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:35 smithi062 ceph-mon[26920]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:31:35.529 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:35 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:35 smithi079 ceph-mon[35268]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:31:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:35 smithi079 ceph-mon[35268]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:31:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:35 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:31:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:35 smithi079 ceph-mon[35268]: pgmap v10: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.3 MiB/s wr, 500 op/s 2024-05-09T06:31:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:35 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:31:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:35 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:35.799 DEBUG:teuthology.parallel:result is None 2024-05-09T06:31:36.533 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:36 smithi062 ceph-mon[26920]: Reconfiguring prometheus.smithi062 (dependencies changed)... 2024-05-09T06:31:36.533 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:36 smithi062 ceph-mon[26920]: Reconfiguring daemon prometheus.smithi062 on smithi062 2024-05-09T06:31:36.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:36 smithi079 ceph-mon[35268]: Reconfiguring prometheus.smithi062 (dependencies changed)... 2024-05-09T06:31:36.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:36 smithi079 ceph-mon[35268]: Reconfiguring daemon prometheus.smithi062 on smithi062 2024-05-09T06:31:37.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:37 smithi079 ceph-mon[35268]: pgmap v11: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.3 MiB/s wr, 500 op/s 2024-05-09T06:31:37.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:37 smithi062 ceph-mon[26920]: pgmap v11: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.3 MiB/s wr, 500 op/s 2024-05-09T06:31:39.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:39 smithi079 ceph-mon[35268]: pgmap v12: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.9 MiB/s wr, 736 op/s 2024-05-09T06:31:39.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:39 smithi062 ceph-mon[26920]: pgmap v12: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.9 MiB/s wr, 736 op/s 2024-05-09T06:31:41.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:41 smithi079 ceph-mon[35268]: pgmap v13: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 602 op/s 2024-05-09T06:31:41.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:41 smithi062 ceph-mon[26920]: pgmap v13: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 602 op/s 2024-05-09T06:31:43.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:43 smithi079 ceph-mon[35268]: pgmap v14: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.9 MiB/s wr, 774 op/s 2024-05-09T06:31:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:43 smithi062 ceph-mon[26920]: pgmap v14: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.9 MiB/s wr, 774 op/s 2024-05-09T06:31:45.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:45 smithi079 ceph-mon[35268]: pgmap v15: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 407 op/s 2024-05-09T06:31:45.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:45 smithi062 ceph-mon[26920]: pgmap v15: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 407 op/s 2024-05-09T06:31:47.407 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-05-09T06:31:47.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T06:31:47.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:47 smithi079 ceph-mon[35268]: pgmap v16: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 407 op/s 2024-05-09T06:31:47.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:47 smithi062 ceph-mon[26920]: pgmap v16: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 407 op/s 2024-05-09T06:31:47.731 DEBUG:teuthology.parallel:result is None 2024-05-09T06:31:47.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T06:31:47.765 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T06:31:47.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T06:31:47.797 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T06:31:47.797 DEBUG:teuthology.parallel:result is None 2024-05-09T06:31:49.579 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:49 smithi062 ceph-mon[26920]: pgmap v17: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.8 MiB/s wr, 580 op/s 2024-05-09T06:31:49.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:49 smithi079 ceph-mon[35268]: pgmap v17: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.8 MiB/s wr, 580 op/s 2024-05-09T06:31:50.551 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:50 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:50.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:50 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:51.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:51 smithi079 ceph-mon[35268]: pgmap v18: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 344 op/s 2024-05-09T06:31:51.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:51 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:51.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:51 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:51.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:51 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:31:51.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:51 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:51.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:51 smithi062 ceph-mon[26920]: pgmap v18: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 344 op/s 2024-05-09T06:31:51.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:51 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:51.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:51 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:51.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:51 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:31:51.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:51 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:52.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:52 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:31:52.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:52 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:31:53.518 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:53 smithi079 ceph-mon[35268]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 415 op/s 2024-05-09T06:31:53.518 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:53 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:31:53.518 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:53 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:31:53.519 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:53 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:53.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:53 smithi062 ceph-mon[26920]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 415 op/s 2024-05-09T06:31:53.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:53 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:31:53.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:53 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:31:53.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:53 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:54.564 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:54 smithi079 ceph-mon[35268]: Upgrade: Updating mgr.smithi079.genyri 2024-05-09T06:31:54.564 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:54 smithi079 ceph-mon[35268]: Deploying daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:31:54.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:54 smithi062 ceph-mon[26920]: Upgrade: Updating mgr.smithi079.genyri 2024-05-09T06:31:54.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:54 smithi062 ceph-mon[26920]: Deploying daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:31:55.518 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:55 smithi079 ceph-mon[35268]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 759 KiB/s wr, 244 op/s 2024-05-09T06:31:55.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:55 smithi062 ceph-mon[26920]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 759 KiB/s wr, 244 op/s 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.345+0000 7f080d6e9700 1 -- 172.21.15.62:0/1055997360 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 msgr2=0x7f08080ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.345+0000 7f080d6e9700 1 --2- 172.21.15.62:0/1055997360 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 0x7f08080ff9a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0800004940 tx=0x7f0800009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.345+0000 7f080d6e9700 1 -- 172.21.15.62:0/1055997360 shutdown_connections 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.345+0000 7f080d6e9700 1 --2- 172.21.15.62:0/1055997360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080ffee0 0x7f0808102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.345+0000 7f080d6e9700 1 --2- 172.21.15.62:0/1055997360 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 0x7f08080ff9a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.345+0000 7f080d6e9700 1 -- 172.21.15.62:0/1055997360 >> 172.21.15.62:0/1055997360 conn(0x7f08080f7430 msgr2=0x7f08080f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.345+0000 7f080d6e9700 1 -- 172.21.15.62:0/1055997360 shutdown_connections 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.345+0000 7f080d6e9700 1 -- 172.21.15.62:0/1055997360 wait complete. 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f080d6e9700 1 Processor -- start 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f080d6e9700 1 -- start start 2024-05-09T06:31:57.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f080d6e9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 0x7f080810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f080d6e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080ffee0 0x7f080810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f080d6e9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080810e570 con 0x7f08080662c0 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f080d6e9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080810edc0 con 0x7f08080ffee0 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f0806ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 0x7f080810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f0806ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 0x7f080810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47622/0 (socket says 172.21.15.62:47622) 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f0806ffd700 1 -- 172.21.15.62:0/323555430 learned_addr learned my addr 172.21.15.62:0/323555430 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.346+0000 7f08067fc700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080ffee0 0x7f080810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f0806ffd700 1 -- 172.21.15.62:0/323555430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080ffee0 msgr2=0x7f080810df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f0806ffd700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080ffee0 0x7f080810df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f0806ffd700 1 -- 172.21.15.62:0/323555430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800005040 con 0x7f08080662c0 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f0806ffd700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 0x7f080810da30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0800000c00 tx=0x7f0800009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f07ff7fe700 1 -- 172.21.15.62:0/323555430 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f080000e040 con 0x7f08080662c0 2024-05-09T06:31:57.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080810f040 con 0x7f08080662c0 2024-05-09T06:31:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f07ff7fe700 1 -- 172.21.15.62:0/323555430 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f080000bbf0 con 0x7f08080662c0 2024-05-09T06:31:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080810f580 con 0x7f08080662c0 2024-05-09T06:31:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.347+0000 7f07ff7fe700 1 -- 172.21.15.62:0/323555430 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f080001c630 con 0x7f08080662c0 2024-05-09T06:31:57.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.348+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e80052e0 con 0x7f08080662c0 2024-05-09T06:31:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.349+0000 7f07ff7fe700 1 -- 172.21.15.62:0/323555430 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 30) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f080000bd60 con 0x7f08080662c0 2024-05-09T06:31:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.349+0000 7f07ff7fe700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f07f40783a0 0x7f07f407a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.349+0000 7f07ff7fe700 1 -- 172.21.15.62:0/323555430 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f080009b170 con 0x7f08080662c0 2024-05-09T06:31:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.349+0000 7f08067fc700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f07f40783a0 0x7f07f407a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:57.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.350+0000 7f08067fc700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f07f40783a0 0x7f07f407a850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07f0004f40 tx=0x7f07f000b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.354+0000 7f07ff7fe700 1 -- 172.21.15.62:0/323555430 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f0800063530 con 0x7f08080662c0 2024-05-09T06:31:57.550 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:57 smithi079 ceph-mon[35268]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 759 KiB/s wr, 244 op/s 2024-05-09T06:31:57.550 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:57 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:57.550 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:57 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:57.550 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:57 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:57.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.589+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07e8000bf0 con 0x7f07f40783a0 2024-05-09T06:31:57.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:57 smithi062 ceph-mon[26920]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 759 KiB/s wr, 244 op/s 2024-05-09T06:31:57.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:57 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:57.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:57 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:31:57.571 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:57 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:57.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.590+0000 7f07ff7fe700 1 -- 172.21.15.62:0/323555430 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f07e8000bf0 con 0x7f07f40783a0 2024-05-09T06:31:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f07f40783a0 msgr2=0x7f07f407a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f07f40783a0 0x7f07f407a850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07f0004f40 tx=0x7f07f000b040 comp rx=0 tx=0).stop 2024-05-09T06:31:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 msgr2=0x7f080810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 0x7f080810da30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0800000c00 tx=0x7f0800009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 shutdown_connections 2024-05-09T06:31:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f07f40783a0 0x7f07f407a850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08080662c0 0x7f080810da30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 --2- 172.21.15.62:0/323555430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08080ffee0 0x7f080810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 >> 172.21.15.62:0/323555430 conn(0x7f08080f7430 msgr2=0x7f08080f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:57.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.592+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 shutdown_connections 2024-05-09T06:31:57.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.593+0000 7f080d6e9700 1 -- 172.21.15.62:0/323555430 wait complete. 2024-05-09T06:31:57.584 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:31:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.700+0000 7f567f49e700 1 -- 172.21.15.62:0/928832965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 msgr2=0x7f56780fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.700+0000 7f567f49e700 1 --2- 172.21.15.62:0/928832965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 0x7f56780fd320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5674004940 tx=0x7f5674009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.700+0000 7f567f49e700 1 -- 172.21.15.62:0/928832965 shutdown_connections 2024-05-09T06:31:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.700+0000 7f567f49e700 1 --2- 172.21.15.62:0/928832965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56780fe080 0x7f56780fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.700+0000 7f567f49e700 1 --2- 172.21.15.62:0/928832965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 0x7f56780fd320 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.700+0000 7f567f49e700 1 -- 172.21.15.62:0/928832965 >> 172.21.15.62:0/928832965 conn(0x7f56780f8560 msgr2=0x7f56780fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.700+0000 7f567f49e700 1 -- 172.21.15.62:0/928832965 shutdown_connections 2024-05-09T06:31:57.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.700+0000 7f567f49e700 1 -- 172.21.15.62:0/928832965 wait complete. 2024-05-09T06:31:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567f49e700 1 Processor -- start 2024-05-09T06:31:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567f49e700 1 -- start start 2024-05-09T06:31:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567f49e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 0x7f5678071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:57.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567f49e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56780fe080 0x7f56780702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567f49e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5678070860 con 0x7f56780fcf10 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567f49e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780709d0 con 0x7f56780fe080 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567d23a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 0x7f5678071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567d23a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 0x7f5678071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47640/0 (socket says 172.21.15.62:47640) 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567d23a700 1 -- 172.21.15.62:0/690765488 learned_addr learned my addr 172.21.15.62:0/690765488 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.701+0000 7f567ca39700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56780fe080 0x7f56780702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f567d23a700 1 -- 172.21.15.62:0/690765488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56780fe080 msgr2=0x7f56780702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f567d23a700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56780fe080 0x7f56780702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f567d23a700 1 -- 172.21.15.62:0/690765488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674005040 con 0x7f56780fcf10 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f567d23a700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 0x7f5678071de0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5674013870 tx=0x7f5674009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f5669ffb700 1 -- 172.21.15.62:0/690765488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5674021070 con 0x7f56780fcf10 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f5669ffb700 1 -- 172.21.15.62:0/690765488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5674009430 con 0x7f56780fcf10 2024-05-09T06:31:57.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5678070c50 con 0x7f56780fcf10 2024-05-09T06:31:57.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f5669ffb700 1 -- 172.21.15.62:0/690765488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f567400e070 con 0x7f56780fcf10 2024-05-09T06:31:57.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.702+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5678115990 con 0x7f56780fcf10 2024-05-09T06:31:57.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.703+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567805f5c0 con 0x7f56780fcf10 2024-05-09T06:31:57.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.704+0000 7f5669ffb700 1 -- 172.21.15.62:0/690765488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 30) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f567401c750 con 0x7f56780fcf10 2024-05-09T06:31:57.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.704+0000 7f5669ffb700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f5664078330 0x7f566407a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:57.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.704+0000 7f5669ffb700 1 -- 172.21.15.62:0/690765488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f567409b1c0 con 0x7f56780fcf10 2024-05-09T06:31:57.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.705+0000 7f567ca39700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f5664078330 0x7f566407a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:57.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.705+0000 7f567ca39700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f5664078330 0x7f566407a7e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f566c004fd0 tx=0x7f566c00b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:57.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.709+0000 7f5669ffb700 1 -- 172.21.15.62:0/690765488 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f56740634e0 con 0x7f56780fcf10 2024-05-09T06:31:57.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.951+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5678102320 con 0x7f5664078330 2024-05-09T06:31:57.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.952+0000 7f5669ffb700 1 -- 172.21.15.62:0/690765488 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f5678102320 con 0x7f5664078330 2024-05-09T06:31:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f5664078330 msgr2=0x7f566407a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f5664078330 0x7f566407a7e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f566c004fd0 tx=0x7f566c00b040 comp rx=0 tx=0).stop 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 msgr2=0x7f5678071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 0x7f5678071de0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5674013870 tx=0x7f5674009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 shutdown_connections 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f5664078330 0x7f566407a7e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56780fcf10 0x7f5678071de0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 --2- 172.21.15.62:0/690765488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56780fe080 0x7f56780702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 >> 172.21.15.62:0/690765488 conn(0x7f56780f8560 msgr2=0x7f56780f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 shutdown_connections 2024-05-09T06:31:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:57.955+0000 7f567f49e700 1 -- 172.21.15.62:0/690765488 wait complete. 2024-05-09T06:31:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.065+0000 7f7d741a4700 1 -- 172.21.15.62:0/1304946979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 msgr2=0x7f7d6c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.065+0000 7f7d741a4700 1 --2- 172.21.15.62:0/1304946979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 0x7f7d6c0fe440 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7d68004940 tx=0x7f7d68009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.065+0000 7f7d741a4700 1 -- 172.21.15.62:0/1304946979 shutdown_connections 2024-05-09T06:31:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.065+0000 7f7d741a4700 1 --2- 172.21.15.62:0/1304946979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 0x7f7d6c0fe440 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.065+0000 7f7d741a4700 1 --2- 172.21.15.62:0/1304946979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d6c0fce60 0x7f7d6c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.065+0000 7f7d741a4700 1 -- 172.21.15.62:0/1304946979 >> 172.21.15.62:0/1304946979 conn(0x7f7d6c0f8540 msgr2=0x7f7d6c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.065+0000 7f7d741a4700 1 -- 172.21.15.62:0/1304946979 shutdown_connections 2024-05-09T06:31:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.065+0000 7f7d741a4700 1 -- 172.21.15.62:0/1304946979 wait complete. 2024-05-09T06:31:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d741a4700 1 Processor -- start 2024-05-09T06:31:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d741a4700 1 -- start start 2024-05-09T06:31:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d741a4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d6c0fce60 0x7f7d6c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d741a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 0x7f7d6c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d741a4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c072200 con 0x7f7d6c0fdfd0 2024-05-09T06:31:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d741a4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0707f0 con 0x7f7d6c0fce60 2024-05-09T06:31:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d7173f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 0x7f7d6c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d71f40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d6c0fce60 0x7f7d6c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d7173f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 0x7f7d6c0702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47670/0 (socket says 172.21.15.62:47670) 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.066+0000 7f7d7173f700 1 -- 172.21.15.62:0/2106892613 learned_addr learned my addr 172.21.15.62:0/2106892613 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d71f40700 1 -- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 msgr2=0x7f7d6c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d71f40700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 0x7f7d6c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d71f40700 1 -- 172.21.15.62:0/2106892613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68005040 con 0x7f7d6c0fce60 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d7173f700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 0x7f7d6c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d71f40700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d6c0fce60 0x7f7d6c071c00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d60002820 tx=0x7f7d60004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d5e7fc700 1 -- 172.21.15.62:0/2106892613 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d60007cc0 con 0x7f7d6c0fce60 2024-05-09T06:31:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d5e7fc700 1 -- 172.21.15.62:0/2106892613 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d6000f040 con 0x7f7d6c0fce60 2024-05-09T06:31:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c070aa0 con 0x7f7d6c0fce60 2024-05-09T06:31:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d5e7fc700 1 -- 172.21.15.62:0/2106892613 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d60013920 con 0x7f7d6c0fce60 2024-05-09T06:31:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.067+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c071060 con 0x7f7d6c0fce60 2024-05-09T06:31:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.068+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6c04c710 con 0x7f7d6c0fce60 2024-05-09T06:31:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.069+0000 7f7d5e7fc700 1 -- 172.21.15.62:0/2106892613 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 30) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f7d6001c400 con 0x7f7d6c0fce60 2024-05-09T06:31:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.069+0000 7f7d5e7fc700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f7d580783a0 0x7f7d5807a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.069+0000 7f7d5e7fc700 1 -- 172.21.15.62:0/2106892613 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7d60099d00 con 0x7f7d6c0fce60 2024-05-09T06:31:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.069+0000 7f7d7173f700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f7d580783a0 0x7f7d5807a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.070+0000 7f7d7173f700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f7d580783a0 0x7f7d5807a850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800b3b0 tx=0x7f7d68009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:58.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.074+0000 7f7d5e7fc700 1 -- 172.21.15.62:0/2106892613 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f7d60061f40 con 0x7f7d6c0fce60 2024-05-09T06:31:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.298+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d6c1023e0 con 0x7f7d580783a0 2024-05-09T06:31:58.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.309+0000 7f7d5e7fc700 1 -- 172.21.15.62:0/2106892613 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7d6c1023e0 con 0x7f7d580783a0 2024-05-09T06:31:58.290 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:31:58.290 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (93s) 31s ago 10m 28.0M - 0.25.0 c8568f914cd2 3e6fb3c83327 2024-05-09T06:31:58.290 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (10m) 31s ago 10m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (9m) 34s ago 9m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (88s) 31s ago 10m 80.0M - 9.4.7 954c08fa6188 93e460121fb3 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (4m) 31s ago 4m 14.1M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (4m) 31s ago 4m 226M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (4m) 34s ago 4m 14.0M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (4m) 34s ago 4m 14.0M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (57s) 31s ago 11m 493M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 starting - - - - 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (11m) 31s ago 12m 56.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (9m) 34s ago 9m 42.9M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (99s) 31s ago 10m 15.5M - 1.5.0 0da6a335fe13 d00a1671f6a3 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (66s) 34s ago 9m 8456k - 1.5.0 0da6a335fe13 8cbfce49709c 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (8m) 31s ago 8m 225M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:31:58.291 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (7m) 31s ago 7m 245M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:31:58.292 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (7m) 31s ago 7m 201M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:31:58.292 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (6m) 34s ago 6m 271M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:31:58.292 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (6m) 34s ago 6m 239M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:31:58.292 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (6m) 34s ago 6m 232M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:31:58.292 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 starting - - - - 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f7d580783a0 msgr2=0x7f7d5807a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f7d580783a0 0x7f7d5807a850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800b3b0 tx=0x7f7d68009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d6c0fce60 msgr2=0x7f7d6c071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d6c0fce60 0x7f7d6c071c00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d60002820 tx=0x7f7d60004570 comp rx=0 tx=0).stop 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 shutdown_connections 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f7d580783a0 0x7f7d5807a850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d6c0fce60 0x7f7d6c071c00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 --2- 172.21.15.62:0/2106892613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d6c0fdfd0 0x7f7d6c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 >> 172.21.15.62:0/2106892613 conn(0x7f7d6c0f8540 msgr2=0x7f7d6c0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 shutdown_connections 2024-05-09T06:31:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.311+0000 7f7d741a4700 1 -- 172.21.15.62:0/2106892613 wait complete. 2024-05-09T06:31:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.416+0000 7feb7b723700 1 -- 172.21.15.62:0/3017549713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fcff0 msgr2=0x7feb740fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.416+0000 7feb7b723700 1 --2- 172.21.15.62:0/3017549713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fcff0 0x7feb740fd460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feb68004940 tx=0x7feb68009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.416+0000 7feb7b723700 1 -- 172.21.15.62:0/3017549713 shutdown_connections 2024-05-09T06:31:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.416+0000 7feb7b723700 1 --2- 172.21.15.62:0/3017549713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fcff0 0x7feb740fd460 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.416+0000 7feb7b723700 1 --2- 172.21.15.62:0/3017549713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb740fbd40 0x7feb740fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.416+0000 7feb7b723700 1 -- 172.21.15.62:0/3017549713 >> 172.21.15.62:0/3017549713 conn(0x7feb740f74c0 msgr2=0x7feb740f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.416+0000 7feb7b723700 1 -- 172.21.15.62:0/3017549713 shutdown_connections 2024-05-09T06:31:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.416+0000 7feb7b723700 1 -- 172.21.15.62:0/3017549713 wait complete. 2024-05-09T06:31:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb7b723700 1 Processor -- start 2024-05-09T06:31:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb7b723700 1 -- start start 2024-05-09T06:31:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb7b723700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fbd40 0x7feb741106b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb7b723700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb740fcff0 0x7feb74112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb7b723700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74066bc0 con 0x7feb740fbd40 2024-05-09T06:31:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb7b723700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74066d00 con 0x7feb740fcff0 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb794bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fbd40 0x7feb741106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb794bf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fbd40 0x7feb741106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47688/0 (socket says 172.21.15.62:47688) 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb794bf700 1 -- 172.21.15.62:0/3906780638 learned_addr learned my addr 172.21.15.62:0/3906780638 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb78cbe700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb740fcff0 0x7feb74112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb794bf700 1 -- 172.21.15.62:0/3906780638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb740fcff0 msgr2=0x7feb74112c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb794bf700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb740fcff0 0x7feb74112c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb794bf700 1 -- 172.21.15.62:0/3906780638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68005040 con 0x7feb740fbd40 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.417+0000 7feb794bf700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fbd40 0x7feb741106b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb6400ec90 tx=0x7feb6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.418+0000 7feb71ffb700 1 -- 172.21.15.62:0/3906780638 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb64007b30 con 0x7feb740fbd40 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.418+0000 7feb71ffb700 1 -- 172.21.15.62:0/3906780638 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb6400f040 con 0x7feb740fbd40 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.418+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb741131a0 con 0x7feb740fbd40 2024-05-09T06:31:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.418+0000 7feb71ffb700 1 -- 172.21.15.62:0/3906780638 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb6400cc80 con 0x7feb740fbd40 2024-05-09T06:31:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.418+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb741136e0 con 0x7feb740fbd40 2024-05-09T06:31:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.419+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7405f5c0 con 0x7feb740fbd40 2024-05-09T06:31:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.419+0000 7feb71ffb700 1 -- 172.21.15.62:0/3906780638 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 30) v1 ==== 99904+0+0 (secure 0 0 0) 0x7feb64007c90 con 0x7feb740fbd40 2024-05-09T06:31:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.420+0000 7feb71ffb700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb5c0783a0 0x7feb5c07a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.420+0000 7feb71ffb700 1 -- 172.21.15.62:0/3906780638 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7feb6409a370 con 0x7feb740fbd40 2024-05-09T06:31:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.420+0000 7feb78cbe700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb5c0783a0 0x7feb5c07a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.421+0000 7feb78cbe700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb5c0783a0 0x7feb5c07a850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb68009b30 tx=0x7feb68009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.425+0000 7feb71ffb700 1 -- 172.21.15.62:0/3906780638 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7feb64062690 con 0x7feb740fbd40 2024-05-09T06:31:58.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.778+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb741047c0 con 0x7feb740fbd40 2024-05-09T06:31:58.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.779+0000 7feb71ffb700 1 -- 172.21.15.62:0/3906780638 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7feb64062030 con 0x7feb740fbd40 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:31:58.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:31:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:31:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:31:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:31:58.762 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:31:58.762 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb5c0783a0 msgr2=0x7feb5c07a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb5c0783a0 0x7feb5c07a850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb68009b30 tx=0x7feb68009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fbd40 msgr2=0x7feb741106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fbd40 0x7feb741106b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb6400ec90 tx=0x7feb6400b040 comp rx=0 tx=0).stop 2024-05-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 shutdown_connections 2024-05-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7feb5c0783a0 0x7feb5c07a850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb740fbd40 0x7feb741106b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 --2- 172.21.15.62:0/3906780638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb740fcff0 0x7feb74112c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.781+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 >> 172.21.15.62:0/3906780638 conn(0x7feb740f74c0 msgr2=0x7feb740f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:58.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.782+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 shutdown_connections 2024-05-09T06:31:58.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.782+0000 7feb7b723700 1 -- 172.21.15.62:0/3906780638 wait complete. 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 -- 172.21.15.62:0/1988434788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fdfd0 msgr2=0x7f91f40fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 --2- 172.21.15.62:0/1988434788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fdfd0 0x7f91f40fe440 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91dc004940 tx=0x7f91dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 -- 172.21.15.62:0/1988434788 shutdown_connections 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 --2- 172.21.15.62:0/1988434788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fdfd0 0x7f91f40fe440 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 --2- 172.21.15.62:0/1988434788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91f40fce60 0x7f91f40fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 -- 172.21.15.62:0/1988434788 >> 172.21.15.62:0/1988434788 conn(0x7f91f40f8540 msgr2=0x7f91f40fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 -- 172.21.15.62:0/1988434788 shutdown_connections 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 -- 172.21.15.62:0/1988434788 wait complete. 2024-05-09T06:31:58.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.889+0000 7f91fa13a700 1 Processor -- start 2024-05-09T06:31:58.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91fa13a700 1 -- start start 2024-05-09T06:31:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91fa13a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fce60 0x7f91f410d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91fa13a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91f40fdfd0 0x7f91f410ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91fa13a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f410e3c0 con 0x7f91f40fce60 2024-05-09T06:31:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91fa13a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f410e530 con 0x7f91f40fdfd0 2024-05-09T06:31:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91f37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fce60 0x7f91f410d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91f37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fce60 0x7f91f410d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47700/0 (socket says 172.21.15.62:47700) 2024-05-09T06:31:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91f37fe700 1 -- 172.21.15.62:0/2827103731 learned_addr learned my addr 172.21.15.62:0/2827103731 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:31:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91f2ffd700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91f40fdfd0 0x7f91f410ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91f37fe700 1 -- 172.21.15.62:0/2827103731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91f40fdfd0 msgr2=0x7f91f410ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91f37fe700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91f40fdfd0 0x7f91f410ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91f37fe700 1 -- 172.21.15.62:0/2827103731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc005040 con 0x7f91f40fce60 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.890+0000 7f91f37fe700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fce60 0x7f91f410d880 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f91e400ec90 tx=0x7f91e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.891+0000 7f91ebfff700 1 -- 172.21.15.62:0/2827103731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e4007b30 con 0x7f91f40fce60 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.891+0000 7f91ebfff700 1 -- 172.21.15.62:0/2827103731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91e400f040 con 0x7f91f40fce60 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.891+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f4112f90 con 0x7f91f40fce60 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.891+0000 7f91ebfff700 1 -- 172.21.15.62:0/2827103731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e400cc80 con 0x7f91f40fce60 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.891+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f4113440 con 0x7f91f40fce60 2024-05-09T06:31:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.892+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f404c710 con 0x7f91f40fce60 2024-05-09T06:31:58.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.892+0000 7f91ebfff700 1 -- 172.21.15.62:0/2827103731 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 30) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f91e4007c90 con 0x7f91f40fce60 2024-05-09T06:31:58.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.893+0000 7f91ebfff700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f91e00783a0 0x7f91e007a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:58.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.893+0000 7f91ebfff700 1 -- 172.21.15.62:0/2827103731 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f91e409a470 con 0x7f91f40fce60 2024-05-09T06:31:58.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.893+0000 7f91f2ffd700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f91e00783a0 0x7f91e007a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:58.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.893+0000 7f91f2ffd700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f91e00783a0 0x7f91e007a850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009b30 tx=0x7f91dc009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:58.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:58.897+0000 7f91ebfff700 1 -- 172.21.15.62:0/2827103731 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f91e4062710 con 0x7f91f40fce60 2024-05-09T06:31:59.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.140+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91f4113630 con 0x7f91e00783a0 2024-05-09T06:31:59.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.141+0000 7f91ebfff700 1 -- 172.21.15.62:0/2827103731 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f91f4113630 con 0x7f91e00783a0 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "", 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mgr daemons", 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:31:59.123 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:31:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f91e00783a0 msgr2=0x7f91e007a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f91e00783a0 0x7f91e007a850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009b30 tx=0x7f91dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fce60 msgr2=0x7f91f410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fce60 0x7f91f410d880 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f91e400ec90 tx=0x7f91e400b040 comp rx=0 tx=0).stop 2024-05-09T06:31:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 shutdown_connections 2024-05-09T06:31:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f91e00783a0 0x7f91e007a850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91f40fce60 0x7f91f410d880 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 --2- 172.21.15.62:0/2827103731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91f40fdfd0 0x7f91f410ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 >> 172.21.15.62:0/2827103731 conn(0x7f91f40f8540 msgr2=0x7f91f40f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 shutdown_connections 2024-05-09T06:31:59.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:31:59.144+0000 7f91fa13a700 1 -- 172.21.15.62:0/2827103731 wait complete. 2024-05-09T06:31:59.546 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:59 smithi079 ceph-mon[35268]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:59.546 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:59 smithi079 ceph-mon[35268]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 759 KiB/s wr, 245 op/s 2024-05-09T06:31:59.546 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:59 smithi079 ceph-mon[35268]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:59.546 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:59 smithi079 ceph-mon[35268]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:59.546 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:31:59 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/3906780638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:31:59.644 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:59 smithi062 ceph-mon[26920]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:59.644 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:59 smithi062 ceph-mon[26920]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 759 KiB/s wr, 245 op/s 2024-05-09T06:31:59.645 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:59 smithi062 ceph-mon[26920]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:59.645 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:59 smithi062 ceph-mon[26920]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:59.645 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:31:59 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/3906780638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:00.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:00 smithi079 ceph-mon[35268]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:00.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:00.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:00.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:00 smithi062 ceph-mon[26920]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:00.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:00.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:01.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:01 smithi079 ceph-mon[35268]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.4 KiB/s rd, 205 KiB/s wr, 72 op/s 2024-05-09T06:32:01.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:01 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:01.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:01 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:01 smithi062 ceph-mon[26920]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.4 KiB/s rd, 205 KiB/s wr, 72 op/s 2024-05-09T06:32:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:01 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:01 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:02.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:02 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:02 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:02 smithi079 ceph-mon[35268]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.4 KiB/s rd, 205 KiB/s wr, 72 op/s 2024-05-09T06:32:03.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:02 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:03.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:02 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:03.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:02 smithi062 ceph-mon[26920]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.4 KiB/s rd, 205 KiB/s wr, 72 op/s 2024-05-09T06:32:04.272 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:03 smithi079 ceph-mon[35268]: Standby manager daemon smithi079.genyri restarted 2024-05-09T06:32:04.272 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:03 smithi079 ceph-mon[35268]: Standby manager daemon smithi079.genyri started 2024-05-09T06:32:04.272 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:03 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/83058846' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:32:04.272 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:03 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/83058846' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:32:04.273 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:03 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/83058846' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:32:04.273 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:03 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/83058846' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:32:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:03 smithi062 ceph-mon[26920]: Standby manager daemon smithi079.genyri restarted 2024-05-09T06:32:04.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:03 smithi062 ceph-mon[26920]: Standby manager daemon smithi079.genyri started 2024-05-09T06:32:04.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:03 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/83058846' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:32:04.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:03 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/83058846' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:32:04.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:03 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/83058846' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:32:04.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:03 smithi062 ceph-mon[26920]: from='mgr.? 172.21.15.79:0/83058846' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:32:05.185 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 511 B/s wr, 0 op/s 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: mgrmap e31: smithi062.juuasl(active, since 44s), standbys: smithi079.genyri 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.186 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi062.juuasl"}]: dispatch 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi062.juuasl"}]': finished 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi079.genyri"}]: dispatch 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi079.genyri"}]': finished 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.188 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.188 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.188 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:04 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 511 B/s wr, 0 op/s 2024-05-09T06:32:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: mgrmap e31: smithi062.juuasl(active, since 44s), standbys: smithi079.genyri 2024-05-09T06:32:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi062.juuasl"}]: dispatch 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi062.juuasl"}]': finished 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi079.genyri"}]: dispatch 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi079.genyri"}]': finished 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:05.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:04 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all mgr 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all rgw 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all iscsi 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all nfs 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all nvmeof 2024-05-09T06:32:06.232 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:05 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all mgr 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all rgw 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all iscsi 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all nfs 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all nvmeof 2024-05-09T06:32:06.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:05 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:07.271 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:06 smithi062 ceph-mon[26920]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 511 B/s wr, 0 op/s 2024-05-09T06:32:07.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:06 smithi079 ceph-mon[35268]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 511 B/s wr, 0 op/s 2024-05-09T06:32:08.133 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:07 smithi062 ceph-mon[26920]: Upgrade: Updating node-exporter.smithi062 (1/2) 2024-05-09T06:32:08.133 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:07 smithi062 ceph-mon[26920]: Deploying daemon node-exporter.smithi062 on smithi062 2024-05-09T06:32:08.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:07 smithi079 ceph-mon[35268]: Upgrade: Updating node-exporter.smithi062 (1/2) 2024-05-09T06:32:08.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:07 smithi079 ceph-mon[35268]: Deploying daemon node-exporter.smithi062 on smithi062 2024-05-09T06:32:09.086 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:08 smithi062 ceph-mon[26920]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 511 B/s wr, 0 op/s 2024-05-09T06:32:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:08 smithi079 ceph-mon[35268]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 511 B/s wr, 0 op/s 2024-05-09T06:32:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:10 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:10 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:10.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:10 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:10.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:10 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:11.401 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:11 smithi062 ceph-mon[26920]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:11.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:11 smithi079 ceph-mon[35268]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:12.175 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:12 smithi079 ceph-mon[35268]: Upgrade: Updating node-exporter.smithi079 (2/2) 2024-05-09T06:32:12.175 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:12 smithi079 ceph-mon[35268]: Deploying daemon node-exporter.smithi079 on smithi079 2024-05-09T06:32:12.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:12 smithi062 ceph-mon[26920]: Upgrade: Updating node-exporter.smithi079 (2/2) 2024-05-09T06:32:12.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:12 smithi062 ceph-mon[26920]: Deploying daemon node-exporter.smithi079 on smithi079 2024-05-09T06:32:13.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:13 smithi079 ceph-mon[35268]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:13.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:13 smithi062 ceph-mon[26920]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:14 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:14 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:14 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:14.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:14 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:14.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:14 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:14.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:14 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:15.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:15 smithi079 ceph-mon[35268]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:15.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:15 smithi062 ceph-mon[26920]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:17.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:17 smithi079 ceph-mon[35268]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:17.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:17 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:17.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:17 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:17.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:17 smithi062 ceph-mon[26920]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:17.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:17 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:17.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:17 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:18 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:18 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:18.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:18 smithi079 ceph-mon[35268]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:18.640 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:18 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:18.640 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:18 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:18.640 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:18 smithi062 ceph-mon[26920]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:19.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:19 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:19.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:19 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:20.091 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:19 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:20.091 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:19 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:20.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:20.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:20.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:20 smithi079 ceph-mon[35268]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:20.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:21.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:21.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:21.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:20 smithi062 ceph-mon[26920]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:21.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:22.258 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:22 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:22.258 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:22 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:22 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:22.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:22 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:23.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:23 smithi079 ceph-mon[35268]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:23.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:23 smithi062 ceph-mon[26920]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:24.618 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:24.618 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:24.618 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.619 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:24 smithi062 ceph-mon[26920]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:24 smithi079 ceph-mon[35268]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:27.289 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:27 smithi062 ceph-mon[26920]: Upgrade: Updating prometheus.smithi062 2024-05-09T06:32:27.289 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:27 smithi062 ceph-mon[26920]: Deploying daemon prometheus.smithi062 on smithi062 2024-05-09T06:32:27.289 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:27 smithi062 ceph-mon[26920]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:27.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:27 smithi079 ceph-mon[35268]: Upgrade: Updating prometheus.smithi062 2024-05-09T06:32:27.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:27 smithi079 ceph-mon[35268]: Deploying daemon prometheus.smithi062 on smithi062 2024-05-09T06:32:27.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:27 smithi079 ceph-mon[35268]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:29.128 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:29 smithi062 ceph-mon[26920]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.265+0000 7f780601c700 1 -- 172.21.15.62:0/3453197184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fed80 msgr2=0x7f78000faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.265+0000 7f780601c700 1 --2- 172.21.15.62:0/3453197184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fed80 0x7f78000faec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f77e8004940 tx=0x7f77e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.265+0000 7f780601c700 1 -- 172.21.15.62:0/3453197184 shutdown_connections 2024-05-09T06:32:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.265+0000 7f780601c700 1 --2- 172.21.15.62:0/3453197184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fed80 0x7f78000faec0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.265+0000 7f780601c700 1 --2- 172.21.15.62:0/3453197184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78000fe430 0x7f78000fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.265+0000 7f780601c700 1 -- 172.21.15.62:0/3453197184 >> 172.21.15.62:0/3453197184 conn(0x7f78000f6bd0 msgr2=0x7f78000f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.265+0000 7f780601c700 1 -- 172.21.15.62:0/3453197184 shutdown_connections 2024-05-09T06:32:29.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.265+0000 7f780601c700 1 -- 172.21.15.62:0/3453197184 wait complete. 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f780601c700 1 Processor -- start 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f780601c700 1 -- start start 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f780601c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fe430 0x7f780010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f780601c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78000fed80 0x7f780010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f780601c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780010e4e0 con 0x7f78000fe430 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f780601c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7800112e80 con 0x7f78000fed80 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f77ff7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fe430 0x7f780010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f77ff7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fe430 0x7f780010d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55456/0 (socket says 172.21.15.62:55456) 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.266+0000 7f77ff7fe700 1 -- 172.21.15.62:0/3333937175 learned_addr learned my addr 172.21.15.62:0/3333937175 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f77feffd700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78000fed80 0x7f780010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f77ff7fe700 1 -- 172.21.15.62:0/3333937175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78000fed80 msgr2=0x7f780010de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f77ff7fe700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78000fed80 0x7f780010de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f77ff7fe700 1 -- 172.21.15.62:0/3333937175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8005040 con 0x7f78000fe430 2024-05-09T06:32:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f77ff7fe700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fe430 0x7f780010d910 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f77f000bbb0 tx=0x7f77f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:29.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f77f7fff700 1 -- 172.21.15.62:0/3333937175 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77f00092e0 con 0x7f78000fe430 2024-05-09T06:32:29.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f77f7fff700 1 -- 172.21.15.62:0/3333937175 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77f000cbd0 con 0x7f78000fe430 2024-05-09T06:32:29.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78001130e0 con 0x7f78000fe430 2024-05-09T06:32:29.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f77f7fff700 1 -- 172.21.15.62:0/3333937175 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77f0007400 con 0x7f78000fe430 2024-05-09T06:32:29.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.267+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7800113650 con 0x7f78000fe430 2024-05-09T06:32:29.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.268+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780004c710 con 0x7f78000fe430 2024-05-09T06:32:29.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.269+0000 7f77f7fff700 1 -- 172.21.15.62:0/3333937175 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f77f0012070 con 0x7f78000fe430 2024-05-09T06:32:29.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.270+0000 7f77f7fff700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f77ec0783a0 0x7f77ec07a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.270+0000 7f77f7fff700 1 -- 172.21.15.62:0/3333937175 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f77f0099bf0 con 0x7f78000fe430 2024-05-09T06:32:29.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.270+0000 7f77feffd700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f77ec0783a0 0x7f77ec07a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.270+0000 7f77feffd700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f77ec0783a0 0x7f77ec07a850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f77e800b3b0 tx=0x7f77e8009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:29.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.274+0000 7f77f7fff700 1 -- 172.21.15.62:0/3333937175 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f77f0061fa0 con 0x7f78000fe430 2024-05-09T06:32:29.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:29 smithi079 ceph-mon[35268]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.523+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78001024d0 con 0x7f77ec0783a0 2024-05-09T06:32:29.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.524+0000 7f77f7fff700 1 -- 172.21.15.62:0/3333937175 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f78001024d0 con 0x7f77ec0783a0 2024-05-09T06:32:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f77ec0783a0 msgr2=0x7f77ec07a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f77ec0783a0 0x7f77ec07a850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f77e800b3b0 tx=0x7f77e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fe430 msgr2=0x7f780010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fe430 0x7f780010d910 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f77f000bbb0 tx=0x7f77f0009840 comp rx=0 tx=0).stop 2024-05-09T06:32:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 shutdown_connections 2024-05-09T06:32:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f77ec0783a0 0x7f77ec07a850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78000fe430 0x7f780010d910 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 --2- 172.21.15.62:0/3333937175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78000fed80 0x7f780010de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.526+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 >> 172.21.15.62:0/3333937175 conn(0x7f78000f6bd0 msgr2=0x7f78000f8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:29.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.527+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 shutdown_connections 2024-05-09T06:32:29.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.527+0000 7f780601c700 1 -- 172.21.15.62:0/3333937175 wait complete. 2024-05-09T06:32:29.520 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.640+0000 7f1378487700 1 -- 172.21.15.62:0/428308182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fcbe0 msgr2=0x7f13700fd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.640+0000 7f1378487700 1 --2- 172.21.15.62:0/428308182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fcbe0 0x7f13700fd050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1360004940 tx=0x7f1360009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.640+0000 7f1378487700 1 -- 172.21.15.62:0/428308182 shutdown_connections 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.640+0000 7f1378487700 1 --2- 172.21.15.62:0/428308182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fcbe0 0x7f13700fd050 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.640+0000 7f1378487700 1 --2- 172.21.15.62:0/428308182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13700fc290 0x7f13700fc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.640+0000 7f1378487700 1 -- 172.21.15.62:0/428308182 >> 172.21.15.62:0/428308182 conn(0x7f13700f6b80 msgr2=0x7f13700f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.640+0000 7f1378487700 1 -- 172.21.15.62:0/428308182 shutdown_connections 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.640+0000 7f1378487700 1 -- 172.21.15.62:0/428308182 wait complete. 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1378487700 1 Processor -- start 2024-05-09T06:32:29.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1378487700 1 -- start start 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1378487700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fc290 0x7f13700ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1378487700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13700fcbe0 0x7f13700fe390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1378487700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700fe920 con 0x7f13700fc290 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1378487700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700fea60 con 0x7f13700fcbe0 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1376223700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fc290 0x7f13700ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1376223700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fc290 0x7f13700ffe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55474/0 (socket says 172.21.15.62:55474) 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.641+0000 7f1376223700 1 -- 172.21.15.62:0/602163908 learned_addr learned my addr 172.21.15.62:0/602163908 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1375a22700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13700fcbe0 0x7f13700fe390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1376223700 1 -- 172.21.15.62:0/602163908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13700fcbe0 msgr2=0x7f13700fe390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1376223700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13700fcbe0 0x7f13700fe390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1376223700 1 -- 172.21.15.62:0/602163908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360005040 con 0x7f13700fc290 2024-05-09T06:32:29.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1376223700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fc290 0x7f13700ffe70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f136c002a80 tx=0x7f136c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1366ffd700 1 -- 172.21.15.62:0/602163908 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136c007cc0 con 0x7f13700fc290 2024-05-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13700fed40 con 0x7f13700fc290 2024-05-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1366ffd700 1 -- 172.21.15.62:0/602163908 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f136c00f040 con 0x7f13700fc290 2024-05-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1366ffd700 1 -- 172.21.15.62:0/602163908 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136c00da30 con 0x7f13700fc290 2024-05-09T06:32:29.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.642+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1370115a90 con 0x7f13700fc290 2024-05-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.644+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1370101be0 con 0x7f13700fc290 2024-05-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.644+0000 7f1366ffd700 1 -- 172.21.15.62:0/602163908 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f136c00db90 con 0x7f13700fc290 2024-05-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.645+0000 7f1366ffd700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f135c0783a0 0x7f135c07a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.645+0000 7f1366ffd700 1 -- 172.21.15.62:0/602163908 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f136c099d40 con 0x7f13700fc290 2024-05-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.645+0000 7f1375a22700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f135c0783a0 0x7f135c07a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.645+0000 7f1375a22700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f135c0783a0 0x7f135c07a850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f136000b970 tx=0x7f1360009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:29.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.650+0000 7f1366ffd700 1 -- 172.21.15.62:0/602163908 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f136c061fe0 con 0x7f13700fc290 2024-05-09T06:32:29.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.896+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f137005e3a0 con 0x7f135c0783a0 2024-05-09T06:32:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.897+0000 7f1366ffd700 1 -- 172.21.15.62:0/602163908 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f137005e3a0 con 0x7f135c0783a0 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.899+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f135c0783a0 msgr2=0x7f135c07a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.899+0000 7f1378487700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f135c0783a0 0x7f135c07a850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f136000b970 tx=0x7f1360009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.899+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fc290 msgr2=0x7f13700ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.899+0000 7f1378487700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fc290 0x7f13700ffe70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f136c002a80 tx=0x7f136c004600 comp rx=0 tx=0).stop 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.899+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 shutdown_connections 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.900+0000 7f1378487700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f135c0783a0 0x7f135c07a850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.900+0000 7f1378487700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f13700fc290 0x7f13700ffe70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.900+0000 7f1378487700 1 --2- 172.21.15.62:0/602163908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13700fcbe0 0x7f13700fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.900+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 >> 172.21.15.62:0/602163908 conn(0x7f13700f6b80 msgr2=0x7f13700fb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:29.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.900+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 shutdown_connections 2024-05-09T06:32:29.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:29.900+0000 7f1378487700 1 -- 172.21.15.62:0/602163908 wait complete. 2024-05-09T06:32:29.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.006+0000 7f8c8c786700 1 -- 172.21.15.62:0/278896853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fdfd0 msgr2=0x7f8c840fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.006+0000 7f8c8c786700 1 --2- 172.21.15.62:0/278896853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fdfd0 0x7f8c840fe440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8c74004940 tx=0x7f8c74009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:29.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.006+0000 7f8c8c786700 1 -- 172.21.15.62:0/278896853 shutdown_connections 2024-05-09T06:32:29.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.006+0000 7f8c8c786700 1 --2- 172.21.15.62:0/278896853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fdfd0 0x7f8c840fe440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.006+0000 7f8c8c786700 1 --2- 172.21.15.62:0/278896853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c840fce60 0x7f8c840fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.006+0000 7f8c8c786700 1 -- 172.21.15.62:0/278896853 >> 172.21.15.62:0/278896853 conn(0x7f8c840f8540 msgr2=0x7f8c840fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:29.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8c786700 1 -- 172.21.15.62:0/278896853 shutdown_connections 2024-05-09T06:32:29.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8c786700 1 -- 172.21.15.62:0/278896853 wait complete. 2024-05-09T06:32:29.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8c786700 1 Processor -- start 2024-05-09T06:32:29.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8c786700 1 -- start start 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8c786700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fce60 0x7f8c8410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8c786700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c840fdfd0 0x7f8c8410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8c786700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8410e450 con 0x7f8c840fce60 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8c786700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8410e5c0 con 0x7f8c840fdfd0 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.007+0000 7f8c8a522700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fce60 0x7f8c8410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c8a522700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fce60 0x7f8c8410d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55496/0 (socket says 172.21.15.62:55496) 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c8a522700 1 -- 172.21.15.62:0/2059512357 learned_addr learned my addr 172.21.15.62:0/2059512357 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c89d21700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c840fdfd0 0x7f8c8410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c8a522700 1 -- 172.21.15.62:0/2059512357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c840fdfd0 msgr2=0x7f8c8410de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c8a522700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c840fdfd0 0x7f8c8410de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c8a522700 1 -- 172.21.15.62:0/2059512357 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c74005040 con 0x7f8c840fce60 2024-05-09T06:32:29.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c8a522700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fce60 0x7f8c8410d910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8c80002a50 tx=0x7f8c800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c7affd700 1 -- 172.21.15.62:0/2059512357 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c80007cc0 con 0x7f8c840fce60 2024-05-09T06:32:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c7affd700 1 -- 172.21.15.62:0/2059512357 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c8000f040 con 0x7f8c840fce60 2024-05-09T06:32:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c84112fc0 con 0x7f8c840fce60 2024-05-09T06:32:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c7affd700 1 -- 172.21.15.62:0/2059512357 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c8000da30 con 0x7f8c840fce60 2024-05-09T06:32:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.008+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c84113550 con 0x7f8c840fce60 2024-05-09T06:32:29.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.009+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8404c710 con 0x7f8c840fce60 2024-05-09T06:32:29.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.010+0000 7f8c7affd700 1 -- 172.21.15.62:0/2059512357 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f8c8000db90 con 0x7f8c840fce60 2024-05-09T06:32:29.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.011+0000 7f8c7affd700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c700783a0 0x7f8c7007a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:29.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.011+0000 7f8c89d21700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c700783a0 0x7f8c7007a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:29.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.011+0000 7f8c89d21700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c700783a0 0x7f8c7007a850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400b970 tx=0x7f8c74009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:29.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.011+0000 7f8c7affd700 1 -- 172.21.15.62:0/2059512357 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8c80061d90 con 0x7f8c840fce60 2024-05-09T06:32:29.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.016+0000 7f8c7affd700 1 -- 172.21.15.62:0/2059512357 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f8c80062050 con 0x7f8c840fce60 2024-05-09T06:32:30.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.240+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c841023e0 con 0x7f8c700783a0 2024-05-09T06:32:30.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.251+0000 7f8c7affd700 1 -- 172.21.15.62:0/2059512357 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8c841023e0 con 0x7f8c700783a0 2024-05-09T06:32:30.232 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:32:30.232 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (2m) 11s ago 10m 28.0M - 0.25.0 c8568f914cd2 3e6fb3c83327 2024-05-09T06:32:30.232 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (11m) 11s ago 11m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (9m) 13s ago 9m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (2m) 11s ago 10m 79.5M - 9.4.7 954c08fa6188 93e460121fb3 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (5m) 11s ago 5m 14.5M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (5m) 11s ago 5m 153M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (5m) 13s ago 5m 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (5m) 13s ago 5m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (89s) 11s ago 12m 510M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (34s) 13s ago 9m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (12m) 11s ago 12m 57.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (9m) 13s ago 9m 43.6M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (21s) 11s ago 11m 7084k - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (17s) 13s ago 9m 5708k - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (8m) 11s ago 8m 245M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (8m) 11s ago 8m 260M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:32:30.233 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (7m) 11s ago 7m 218M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:32:30.234 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (7m) 13s ago 7m 280M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:32:30.234 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (7m) 13s ago 7m 251M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:32:30.234 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (6m) 13s ago 6m 245M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:32:30.234 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (39s) 11s ago 10m 45.2M - 2.43.0 a07b618ecd1d 85da132b9494 2024-05-09T06:32:30.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c700783a0 msgr2=0x7f8c7007a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:30.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c700783a0 0x7f8c7007a850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400b970 tx=0x7f8c74009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:30.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fce60 msgr2=0x7f8c8410d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:30.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fce60 0x7f8c8410d910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8c80002a50 tx=0x7f8c800046b0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 shutdown_connections 2024-05-09T06:32:30.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c700783a0 0x7f8c7007a850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c840fce60 0x7f8c8410d910 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 --2- 172.21.15.62:0/2059512357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c840fdfd0 0x7f8c8410de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 >> 172.21.15.62:0/2059512357 conn(0x7f8c840f8540 msgr2=0x7f8c840f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:30.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 shutdown_connections 2024-05-09T06:32:30.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.253+0000 7f8c8c786700 1 -- 172.21.15.62:0/2059512357 wait complete. 2024-05-09T06:32:30.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 -- 172.21.15.62:0/2914910827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 msgr2=0x7f46b40ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:30.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 --2- 172.21.15.62:0/2914910827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 0x7f46b40ff9b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46a8004940 tx=0x7f46a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:30.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 -- 172.21.15.62:0/2914910827 shutdown_connections 2024-05-09T06:32:30.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 --2- 172.21.15.62:0/2914910827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40ffef0 0x7f46b4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 --2- 172.21.15.62:0/2914910827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 0x7f46b40ff9b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 -- 172.21.15.62:0/2914910827 >> 172.21.15.62:0/2914910827 conn(0x7f46b40f7420 msgr2=0x7f46b40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:30.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 -- 172.21.15.62:0/2914910827 shutdown_connections 2024-05-09T06:32:30.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 -- 172.21.15.62:0/2914910827 wait complete. 2024-05-09T06:32:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.367+0000 7f46bb14e700 1 Processor -- start 2024-05-09T06:32:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46bb14e700 1 -- start start 2024-05-09T06:32:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46bb14e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 0x7f46b410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46bb14e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40ffef0 0x7f46b410df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46bb14e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b410e570 con 0x7f46b4066b50 2024-05-09T06:32:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46bb14e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b410edc0 con 0x7f46b40ffef0 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46b8eea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 0x7f46b410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46b8eea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 0x7f46b410da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55520/0 (socket says 172.21.15.62:55520) 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46b8eea700 1 -- 172.21.15.62:0/1370469499 learned_addr learned my addr 172.21.15.62:0/1370469499 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.368+0000 7f46b3fff700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40ffef0 0x7f46b410df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46b8eea700 1 -- 172.21.15.62:0/1370469499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40ffef0 msgr2=0x7f46b410df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46b8eea700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40ffef0 0x7f46b410df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46b8eea700 1 -- 172.21.15.62:0/1370469499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8005040 con 0x7f46b4066b50 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46b8eea700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 0x7f46b410da30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f46a800b970 tx=0x7f46a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46b17fa700 1 -- 172.21.15.62:0/1370469499 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a800e040 con 0x7f46b4066b50 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46b17fa700 1 -- 172.21.15.62:0/1370469499 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46a8004290 con 0x7f46b4066b50 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46b17fa700 1 -- 172.21.15.62:0/1370469499 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a801c3f0 con 0x7f46b4066b50 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b410f040 con 0x7f46b4066b50 2024-05-09T06:32:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.369+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b410f520 con 0x7f46b4066b50 2024-05-09T06:32:30.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.370+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b405f5c0 con 0x7f46b4066b50 2024-05-09T06:32:30.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.371+0000 7f46b17fa700 1 -- 172.21.15.62:0/1370469499 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f46a800bbf0 con 0x7f46b4066b50 2024-05-09T06:32:30.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.371+0000 7f46b17fa700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f46a40783a0 0x7f46a407a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:30.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.372+0000 7f46b3fff700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f46a40783a0 0x7f46a407a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:30.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.372+0000 7f46b17fa700 1 -- 172.21.15.62:0/1370469499 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f46a809b240 con 0x7f46b4066b50 2024-05-09T06:32:30.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.372+0000 7f46b3fff700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f46a40783a0 0x7f46a407a850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f46a0004f40 tx=0x7f46a000b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.380+0000 7f46b17fa700 1 -- 172.21.15.62:0/1370469499 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f46a8063580 con 0x7f46b4066b50 2024-05-09T06:32:30.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.745+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46b41058b0 con 0x7f46b4066b50 2024-05-09T06:32:30.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.745+0000 7f46b17fa700 1 -- 172.21.15.62:0/1370469499 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f46a8062f20 con 0x7f46b4066b50 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:32:30.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:32:30.728 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:32:30.728 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:32:30.728 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:32:30.728 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:32:30.728 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:32:30.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f46a40783a0 msgr2=0x7f46a407a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:30.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f46a40783a0 0x7f46a407a850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f46a0004f40 tx=0x7f46a000b040 comp rx=0 tx=0).stop 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 msgr2=0x7f46b410da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 0x7f46b410da30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f46a800b970 tx=0x7f46a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 shutdown_connections 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f46a40783a0 0x7f46a407a850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46b4066b50 0x7f46b410da30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 --2- 172.21.15.62:0/1370469499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b40ffef0 0x7f46b410df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 >> 172.21.15.62:0/1370469499 conn(0x7f46b40f7420 msgr2=0x7f46b40f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 shutdown_connections 2024-05-09T06:32:30.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.748+0000 7f46bb14e700 1 -- 172.21.15.62:0/1370469499 wait complete. 2024-05-09T06:32:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.864+0000 7f26068a4700 1 -- 172.21.15.62:0/2779171884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 msgr2=0x7f26000fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.864+0000 7f26068a4700 1 --2- 172.21.15.62:0/2779171884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 0x7f26000fe7f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f25f0004940 tx=0x7f25f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.864+0000 7f26068a4700 1 -- 172.21.15.62:0/2779171884 shutdown_connections 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.864+0000 7f26068a4700 1 --2- 172.21.15.62:0/2779171884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26000fed30 0x7f26000fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.864+0000 7f26068a4700 1 --2- 172.21.15.62:0/2779171884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 0x7f26000fe7f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.864+0000 7f26068a4700 1 -- 172.21.15.62:0/2779171884 >> 172.21.15.62:0/2779171884 conn(0x7f26000f6b80 msgr2=0x7f26000f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.864+0000 7f26068a4700 1 -- 172.21.15.62:0/2779171884 shutdown_connections 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.864+0000 7f26068a4700 1 -- 172.21.15.62:0/2779171884 wait complete. 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f26068a4700 1 Processor -- start 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f26068a4700 1 -- start start 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f26068a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 0x7f26000fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f26068a4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26000fed30 0x7f26000fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f26068a4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000fc650 con 0x7f26000fe3e0 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f26068a4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000fc7c0 con 0x7f26000fed30 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f25fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 0x7f26000fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f25fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 0x7f26000fdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55532/0 (socket says 172.21.15.62:55532) 2024-05-09T06:32:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.865+0000 7f25fffff700 1 -- 172.21.15.62:0/1718749131 learned_addr learned my addr 172.21.15.62:0/1718749131 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f25ff7fe700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26000fed30 0x7f26000fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f25fffff700 1 -- 172.21.15.62:0/1718749131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26000fed30 msgr2=0x7f26000fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f25fffff700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26000fed30 0x7f26000fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f25fffff700 1 -- 172.21.15.62:0/1718749131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0005040 con 0x7f26000fe3e0 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f25fffff700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 0x7f26000fdbd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f25f0013870 tx=0x7f25f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f25fcff9700 1 -- 172.21.15.62:0/1718749131 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f0021070 con 0x7f26000fe3e0 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26000fca40 con 0x7f26000fe3e0 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f25fcff9700 1 -- 172.21.15.62:0/1718749131 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25f001c400 con 0x7f26000fe3e0 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2600115990 con 0x7f26000fe3e0 2024-05-09T06:32:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.866+0000 7f25fcff9700 1 -- 172.21.15.62:0/1718749131 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f000e070 con 0x7f26000fe3e0 2024-05-09T06:32:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.867+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260005f5c0 con 0x7f26000fe3e0 2024-05-09T06:32:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.868+0000 7f25fcff9700 1 -- 172.21.15.62:0/1718749131 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f25f001ca20 con 0x7f26000fe3e0 2024-05-09T06:32:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.869+0000 7f25fcff9700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25e80783a0 0x7f25e807a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.869+0000 7f25fcff9700 1 -- 172.21.15.62:0/1718749131 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f25f009b210 con 0x7f26000fe3e0 2024-05-09T06:32:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.869+0000 7f25ff7fe700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25e80783a0 0x7f25e807a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:30.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.869+0000 7f25ff7fe700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25e80783a0 0x7f25e807a850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009fd0 tx=0x7f25f400b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:30.873+0000 7f25fcff9700 1 -- 172.21.15.62:0/1718749131 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f25f0063530 con 0x7f26000fe3e0 2024-05-09T06:32:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.130+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2600102430 con 0x7f25e80783a0 2024-05-09T06:32:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.131+0000 7f25fcff9700 1 -- 172.21.15.62:0/1718749131 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f2600102430 con 0x7f25e80783a0 2024-05-09T06:32:31.112 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:32:31.112 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:32:31.112 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:32:31.113 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:32:31.113 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:32:31.113 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:32:31.113 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:32:31.113 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "2/2 daemons upgraded", 2024-05-09T06:32:31.113 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading prometheus daemons", 2024-05-09T06:32:31.113 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:32:31.113 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25e80783a0 msgr2=0x7f25e807a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25e80783a0 0x7f25e807a850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009fd0 tx=0x7f25f400b040 comp rx=0 tx=0).stop 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 msgr2=0x7f26000fdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 0x7f26000fdbd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f25f0013870 tx=0x7f25f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 shutdown_connections 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f25e80783a0 0x7f25e807a850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26000fe3e0 0x7f26000fdbd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 --2- 172.21.15.62:0/1718749131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f26000fed30 0x7f26000fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 >> 172.21.15.62:0/1718749131 conn(0x7f26000f6b80 msgr2=0x7f26000f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 shutdown_connections 2024-05-09T06:32:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:32:31.133+0000 7f26068a4700 1 -- 172.21.15.62:0/1718749131 wait complete. 2024-05-09T06:32:31.340 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:31 smithi062 ceph-mon[26920]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:31.340 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:31 smithi062 ceph-mon[26920]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:31.340 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:31 smithi062 ceph-mon[26920]: pgmap v38: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:31.340 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:31 smithi062 ceph-mon[26920]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:31.340 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:31 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1370469499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:31 smithi079 ceph-mon[35268]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:31 smithi079 ceph-mon[35268]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:31 smithi079 ceph-mon[35268]: pgmap v38: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:31.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:31 smithi079 ceph-mon[35268]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:31.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:31 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1370469499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:32.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:32 smithi079 ceph-mon[35268]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:32.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:32 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:32.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:32 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:32.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:32 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:32.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:32 smithi062 ceph-mon[26920]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:32.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:32 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:32.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:32 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:32.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:32 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:33.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:33 smithi079 ceph-mon[35268]: pgmap v39: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:33.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:33 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:33.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:33 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:33 smithi062 ceph-mon[26920]: pgmap v39: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:33.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:33 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:33.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:33 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:35.406 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:35 smithi062 ceph-mon[26920]: pgmap v40: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:35.407 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:35 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:35 smithi079 ceph-mon[35268]: pgmap v40: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:35 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:37 smithi062 ceph-mon[26920]: pgmap v41: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:37.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:37 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:37.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:37 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:37.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:37 smithi079 ceph-mon[35268]: pgmap v41: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:37.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:37 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:37.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:37 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:39.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:38 smithi079 ceph-mon[35268]: pgmap v42: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:39.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:38 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:39.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:38 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:38 smithi062 ceph-mon[26920]: pgmap v42: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:38 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:38 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:41.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:40 smithi079 ceph-mon[35268]: pgmap v43: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:41.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:40 smithi062 ceph-mon[26920]: pgmap v43: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:42.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:42 smithi062 ceph-mon[26920]: pgmap v44: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:43.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:42 smithi079 ceph-mon[35268]: pgmap v44: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:45.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:45 smithi062 ceph-mon[26920]: Upgrade: Updating alertmanager.smithi062 2024-05-09T06:32:45.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:45 smithi062 ceph-mon[26920]: Deploying daemon alertmanager.smithi062 on smithi062 2024-05-09T06:32:45.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:45 smithi062 ceph-mon[26920]: pgmap v45: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:45.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:45 smithi079 ceph-mon[35268]: Upgrade: Updating alertmanager.smithi062 2024-05-09T06:32:45.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:45 smithi079 ceph-mon[35268]: Deploying daemon alertmanager.smithi062 on smithi062 2024-05-09T06:32:45.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:45 smithi079 ceph-mon[35268]: pgmap v45: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:47.228 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:47 smithi062 ceph-mon[26920]: pgmap v46: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:47.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:47 smithi079 ceph-mon[35268]: pgmap v46: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:49.085 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:49 smithi062 ceph-mon[26920]: pgmap v47: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:49 smithi079 ceph-mon[35268]: pgmap v47: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:50.312 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:50 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:50.312 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:50 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:50.312 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:50 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:50.312 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:50 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:50.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:50 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:50.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:50 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:50.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:50 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:50.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:50 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:51.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:51 smithi062 ceph-mon[26920]: pgmap v48: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:51.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:51 smithi079 ceph-mon[35268]: pgmap v48: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:32:53.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:53 smithi079 ceph-mon[35268]: pgmap v49: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:32:53.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:53 smithi079 ceph-mon[35268]: mgrmap e32: smithi062.juuasl(active, since 92s), standbys: smithi079.genyri 2024-05-09T06:32:53.599 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:53 smithi062 ceph-mon[26920]: pgmap v49: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:32:53.599 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:53 smithi062 ceph-mon[26920]: mgrmap e32: smithi062.juuasl(active, since 92s), standbys: smithi079.genyri 2024-05-09T06:32:55.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:55 smithi079 ceph-mon[35268]: pgmap v50: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:32:55.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:55 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:55.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:55 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:55.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:55 smithi062 ceph-mon[26920]: pgmap v50: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:32:55.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:55 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:55.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:55 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:56.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:56 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:56 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:56 smithi079 ceph-mon[35268]: pgmap v51: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:32:56.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:56 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:56.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:56 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:32:56.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:56 smithi062 ceph-mon[26920]: pgmap v51: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:32:59.108 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:32:59 smithi062 ceph-mon[26920]: pgmap v52: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:32:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:32:59 smithi079 ceph-mon[35268]: pgmap v52: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:33:00.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:00 smithi062 ceph-mon[26920]: pgmap v53: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:33:00.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:00.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:00.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:00.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:00.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:00.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:33:00.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:00.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:00 smithi079 ceph-mon[35268]: pgmap v53: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:33:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/3618927621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fdfd0 msgr2=0x7f2a280fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 --2- 172.21.15.62:0/3618927621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fdfd0 0x7f2a280fe440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2a10004940 tx=0x7f2a10009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/3618927621 shutdown_connections 2024-05-09T06:33:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 --2- 172.21.15.62:0/3618927621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fdfd0 0x7f2a280fe440 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 --2- 172.21.15.62:0/3618927621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a280fce60 0x7f2a280fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/3618927621 >> 172.21.15.62:0/3618927621 conn(0x7f2a280f8540 msgr2=0x7f2a280fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/3618927621 shutdown_connections 2024-05-09T06:33:01.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/3618927621 wait complete. 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 Processor -- start 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.248+0000 7f2a2cc3e700 1 -- start start 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2cc3e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fce60 0x7f2a2810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2cc3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a280fdfd0 0x7f2a2810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2cc3e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2810e450 con 0x7f2a280fce60 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2cc3e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2810e5c0 con 0x7f2a280fdfd0 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fce60 0x7f2a2810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fce60 0x7f2a2810d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38330/0 (socket says 172.21.15.62:38330) 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2659c700 1 -- 172.21.15.62:0/1572237776 learned_addr learned my addr 172.21.15.62:0/1572237776 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a25d9b700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a280fdfd0 0x7f2a2810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2659c700 1 -- 172.21.15.62:0/1572237776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a280fdfd0 msgr2=0x7f2a2810de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2659c700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a280fdfd0 0x7f2a2810de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2659c700 1 -- 172.21.15.62:0/1572237776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10005040 con 0x7f2a280fce60 2024-05-09T06:33:01.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2659c700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fce60 0x7f2a2810d910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800cac0 tx=0x7f2a18007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:01.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a1effd700 1 -- 172.21.15.62:0/1572237776 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a1800a980 con 0x7f2a280fce60 2024-05-09T06:33:01.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a1effd700 1 -- 172.21.15.62:0/1572237776 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a18012440 con 0x7f2a280fce60 2024-05-09T06:33:01.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a28112fc0 con 0x7f2a280fce60 2024-05-09T06:33:01.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.249+0000 7f2a1effd700 1 -- 172.21.15.62:0/1572237776 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a180115e0 con 0x7f2a280fce60 2024-05-09T06:33:01.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.250+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a28113550 con 0x7f2a280fce60 2024-05-09T06:33:01.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.251+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2804c710 con 0x7f2a280fce60 2024-05-09T06:33:01.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.251+0000 7f2a1effd700 1 -- 172.21.15.62:0/1572237776 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f2a180125b0 con 0x7f2a280fce60 2024-05-09T06:33:01.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.252+0000 7f2a1effd700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f2a14078290 0x7f2a1407a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.252+0000 7f2a25d9b700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f2a14078290 0x7f2a1407a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.252+0000 7f2a1effd700 1 -- 172.21.15.62:0/1572237776 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2a1809a400 con 0x7f2a280fce60 2024-05-09T06:33:01.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.252+0000 7f2a25d9b700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f2a14078290 0x7f2a1407a740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b3b0 tx=0x7f2a10009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:01.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.257+0000 7f2a1effd700 1 -- 172.21.15.62:0/1572237776 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f2a18062940 con 0x7f2a280fce60 2024-05-09T06:33:01.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:01 smithi062 ceph-mon[26920]: Upgrade: Updating grafana.smithi062 2024-05-09T06:33:01.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:01 smithi062 ceph-mon[26920]: Deploying daemon grafana.smithi062 on smithi062 2024-05-09T06:33:01.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.510+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a28102390 con 0x7f2a14078290 2024-05-09T06:33:01.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.521+0000 7f2a1effd700 1 -- 172.21.15.62:0/1572237776 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f2a28102390 con 0x7f2a14078290 2024-05-09T06:33:01.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f2a14078290 msgr2=0x7f2a1407a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f2a14078290 0x7f2a1407a740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b3b0 tx=0x7f2a10009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fce60 msgr2=0x7f2a2810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fce60 0x7f2a2810d910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800cac0 tx=0x7f2a18007ee0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 shutdown_connections 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f2a14078290 0x7f2a1407a740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a280fce60 0x7f2a2810d910 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 --2- 172.21.15.62:0/1572237776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a280fdfd0 0x7f2a2810de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.523+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 >> 172.21.15.62:0/1572237776 conn(0x7f2a280f8540 msgr2=0x7f2a280f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.524+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 shutdown_connections 2024-05-09T06:33:01.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.524+0000 7f2a2cc3e700 1 -- 172.21.15.62:0/1572237776 wait complete. 2024-05-09T06:33:01.516 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:33:01.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.634+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/1332713806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 msgr2=0x7f0e540fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.634+0000 7f0e5b0a0700 1 --2- 172.21.15.62:0/1332713806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 0x7f0e540fd320 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e48004940 tx=0x7f0e48009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.634+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/1332713806 shutdown_connections 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.634+0000 7f0e5b0a0700 1 --2- 172.21.15.62:0/1332713806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e540fe080 0x7f0e540fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.634+0000 7f0e5b0a0700 1 --2- 172.21.15.62:0/1332713806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 0x7f0e540fd320 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.634+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/1332713806 >> 172.21.15.62:0/1332713806 conn(0x7f0e540f8560 msgr2=0x7f0e540fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.635+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/1332713806 shutdown_connections 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.635+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/1332713806 wait complete. 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.635+0000 7f0e5b0a0700 1 Processor -- start 2024-05-09T06:33:01.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.635+0000 7f0e5b0a0700 1 -- start start 2024-05-09T06:33:01.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e5b0a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 0x7f0e5410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e5b0a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e540fe080 0x7f0e5410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e5b0a0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5410e4a0 con 0x7f0e540fcf10 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e5b0a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5410ecf0 con 0x7f0e540fe080 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e58e3c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 0x7f0e5410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e58e3c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 0x7f0e5410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38348/0 (socket says 172.21.15.62:38348) 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e58e3c700 1 -- 172.21.15.62:0/998022553 learned_addr learned my addr 172.21.15.62:0/998022553 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e53fff700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e540fe080 0x7f0e5410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e58e3c700 1 -- 172.21.15.62:0/998022553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e540fe080 msgr2=0x7f0e5410dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e58e3c700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e540fe080 0x7f0e5410dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.636+0000 7f0e58e3c700 1 -- 172.21.15.62:0/998022553 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48005040 con 0x7f0e540fcf10 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.637+0000 7f0e58e3c700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 0x7f0e5410d960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0e48013870 tx=0x7f0e48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.637+0000 7f0e517fa700 1 -- 172.21.15.62:0/998022553 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4800e070 con 0x7f0e540fcf10 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.637+0000 7f0e517fa700 1 -- 172.21.15.62:0/998022553 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e48013de0 con 0x7f0e540fcf10 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.637+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5410ef70 con 0x7f0e540fcf10 2024-05-09T06:33:01.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.637+0000 7f0e517fa700 1 -- 172.21.15.62:0/998022553 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4801cea0 con 0x7f0e540fcf10 2024-05-09T06:33:01.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.637+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5410f450 con 0x7f0e540fcf10 2024-05-09T06:33:01.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.638+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5405f5c0 con 0x7f0e540fcf10 2024-05-09T06:33:01.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.640+0000 7f0e517fa700 1 -- 172.21.15.62:0/998022553 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f0e4801c690 con 0x7f0e540fcf10 2024-05-09T06:33:01.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.640+0000 7f0e517fa700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0e44078280 0x7f0e4407a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.641+0000 7f0e517fa700 1 -- 172.21.15.62:0/998022553 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0e4809bfc0 con 0x7f0e540fcf10 2024-05-09T06:33:01.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.641+0000 7f0e53fff700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0e44078280 0x7f0e4407a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.641+0000 7f0e53fff700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0e44078280 0x7f0e4407a730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009b80 tx=0x7f0e4000b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:01.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.648+0000 7f0e517fa700 1 -- 172.21.15.62:0/998022553 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f0e480645a0 con 0x7f0e540fcf10 2024-05-09T06:33:01.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:01 smithi079 ceph-mon[35268]: Upgrade: Updating grafana.smithi062 2024-05-09T06:33:01.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:01 smithi079 ceph-mon[35268]: Deploying daemon grafana.smithi062 on smithi062 2024-05-09T06:33:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.890+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e5410f730 con 0x7f0e44078280 2024-05-09T06:33:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.891+0000 7f0e517fa700 1 -- 172.21.15.62:0/998022553 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f0e5410f730 con 0x7f0e44078280 2024-05-09T06:33:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.893+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0e44078280 msgr2=0x7f0e4407a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.893+0000 7f0e5b0a0700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0e44078280 0x7f0e4407a730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009b80 tx=0x7f0e4000b040 comp rx=0 tx=0).stop 2024-05-09T06:33:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.893+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 msgr2=0x7f0e5410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.893+0000 7f0e5b0a0700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 0x7f0e5410d960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0e48013870 tx=0x7f0e48009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.894+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 shutdown_connections 2024-05-09T06:33:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.894+0000 7f0e5b0a0700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0e44078280 0x7f0e4407a730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.894+0000 7f0e5b0a0700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e540fcf10 0x7f0e5410d960 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.894+0000 7f0e5b0a0700 1 --2- 172.21.15.62:0/998022553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e540fe080 0x7f0e5410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.894+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 >> 172.21.15.62:0/998022553 conn(0x7f0e540f8560 msgr2=0x7f0e540f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.894+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 shutdown_connections 2024-05-09T06:33:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:01.894+0000 7f0e5b0a0700 1 -- 172.21.15.62:0/998022553 wait complete. 2024-05-09T06:33:01.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.002+0000 7f1e01239700 1 -- 172.21.15.62:0/3620840403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0662c0 msgr2=0x7f1dfc0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.002+0000 7f1e01239700 1 --2- 172.21.15.62:0/3620840403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0662c0 0x7f1dfc0ff9a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009ce0 tx=0x7f1dec004d10 comp rx=0 tx=0).stop 2024-05-09T06:33:01.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.002+0000 7f1e01239700 1 -- 172.21.15.62:0/3620840403 shutdown_connections 2024-05-09T06:33:01.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.002+0000 7f1e01239700 1 --2- 172.21.15.62:0/3620840403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0ffee0 0x7f1dfc102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.002+0000 7f1e01239700 1 --2- 172.21.15.62:0/3620840403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0662c0 0x7f1dfc0ff9a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.002+0000 7f1e01239700 1 -- 172.21.15.62:0/3620840403 >> 172.21.15.62:0/3620840403 conn(0x7f1dfc0f7430 msgr2=0x7f1dfc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:01.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.002+0000 7f1e01239700 1 -- 172.21.15.62:0/3620840403 shutdown_connections 2024-05-09T06:33:01.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.002+0000 7f1e01239700 1 -- 172.21.15.62:0/3620840403 wait complete. 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1e01239700 1 Processor -- start 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1e01239700 1 -- start start 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1e01239700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0662c0 0x7f1dfc0fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1e01239700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0ffee0 0x7f1dfc0fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1e01239700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0fbe50 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1e01239700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0fbfc0 con 0x7f1dfc0662c0 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1dfa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0ffee0 0x7f1dfc0fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1dfa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0ffee0 0x7f1dfc0fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38360/0 (socket says 172.21.15.62:38360) 2024-05-09T06:33:01.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1dfa59c700 1 -- 172.21.15.62:0/3848241352 learned_addr learned my addr 172.21.15.62:0/3848241352 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1dfad9d700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0662c0 0x7f1dfc0fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1dfa59c700 1 -- 172.21.15.62:0/3848241352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0662c0 msgr2=0x7f1dfc0fd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1dfa59c700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0662c0 0x7f1dfc0fd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1dfa59c700 1 -- 172.21.15.62:0/3848241352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec009940 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.003+0000 7f1dfa59c700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0ffee0 0x7f1dfc0fb8a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1de4002a50 tx=0x7f1de40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.004+0000 7f1df37fe700 1 -- 172.21.15.62:0/3848241352 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1de4007cc0 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.004+0000 7f1df37fe700 1 -- 172.21.15.62:0/3848241352 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1de400f040 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.004+0000 7f1df37fe700 1 -- 172.21.15.62:0/3848241352 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1de400da30 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.004+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc0fc2a0 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.004+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc115bc0 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.005+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc05f5c0 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.005+0000 7f1df37fe700 1 -- 172.21.15.62:0/3848241352 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f1de400db90 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.006+0000 7f1df37fe700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f1de8078290 0x7f1de807a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:01.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.006+0000 7f1dfad9d700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f1de8078290 0x7f1de807a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:01.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.006+0000 7f1df37fe700 1 -- 172.21.15.62:0/3848241352 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1de4099a60 con 0x7f1dfc0ffee0 2024-05-09T06:33:01.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.007+0000 7f1dfad9d700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f1de8078290 0x7f1de807a740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009cb0 tx=0x7f1dec004d10 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:01.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.011+0000 7f1df37fe700 1 -- 172.21.15.62:0/3848241352 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f1de4061fa0 con 0x7f1dfc0ffee0 2024-05-09T06:33:02.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.236+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dfc0f8f20 con 0x7f1de8078290 2024-05-09T06:33:02.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.246+0000 7f1df37fe700 1 -- 172.21.15.62:0/3848241352 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1dfc0f8f20 con 0x7f1de8078290 2024-05-09T06:33:02.227 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:33:02.227 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (13s) 7s ago 11m 14.7M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:33:02.227 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (11m) 7s ago 11m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (10m) 45s ago 10m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (2m) 7s ago 11m 81.5M - 9.4.7 954c08fa6188 93e460121fb3 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (5m) 7s ago 5m 14.7M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (5m) 7s ago 5m 153M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (5m) 45s ago 5m 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (5m) 45s ago 5m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (2m) 7s ago 12m 513M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (66s) 45s ago 10m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (13m) 7s ago 13m 54.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (10m) 45s ago 10m 43.6M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (53s) 7s ago 11m 7625k - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (49s) 45s ago 10m 5708k - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (9m) 7s ago 9m 246M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (8m) 7s ago 8m 260M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (8m) 7s ago 8m 219M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:33:02.228 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (8m) 45s ago 8m 280M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:33:02.229 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (7m) 45s ago 7m 251M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:33:02.229 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (7m) 45s ago 7m 245M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:33:02.229 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (31s) 7s ago 10m 49.1M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:33:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f1de8078290 msgr2=0x7f1de807a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f1de8078290 0x7f1de807a740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009cb0 tx=0x7f1dec004d10 comp rx=0 tx=0).stop 2024-05-09T06:33:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0ffee0 msgr2=0x7f1dfc0fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0ffee0 0x7f1dfc0fb8a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1de4002a50 tx=0x7f1de40046b0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 shutdown_connections 2024-05-09T06:33:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f1de8078290 0x7f1de807a740 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dfc0662c0 0x7f1dfc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 --2- 172.21.15.62:0/3848241352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dfc0ffee0 0x7f1dfc0fb8a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 >> 172.21.15.62:0/3848241352 conn(0x7f1dfc0f7430 msgr2=0x7f1dfc0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:02.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 shutdown_connections 2024-05-09T06:33:02.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.249+0000 7f1e01239700 1 -- 172.21.15.62:0/3848241352 wait complete. 2024-05-09T06:33:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.353+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/3631331358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fcf70 msgr2=0x7f8acc0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.353+0000 7f8ad1a6f700 1 --2- 172.21.15.62:0/3631331358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fcf70 0x7f8acc0fd3e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0004940 tx=0x7f8ac0009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.353+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/3631331358 shutdown_connections 2024-05-09T06:33:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.353+0000 7f8ad1a6f700 1 --2- 172.21.15.62:0/3631331358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fcf70 0x7f8acc0fd3e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.353+0000 7f8ad1a6f700 1 --2- 172.21.15.62:0/3631331358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8acc0fbcc0 0x7f8acc0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.353+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/3631331358 >> 172.21.15.62:0/3631331358 conn(0x7f8acc0f7440 msgr2=0x7f8acc0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.354+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/3631331358 shutdown_connections 2024-05-09T06:33:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.354+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/3631331358 wait complete. 2024-05-09T06:33:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.354+0000 7f8ad1a6f700 1 Processor -- start 2024-05-09T06:33:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.354+0000 7f8ad1a6f700 1 -- start start 2024-05-09T06:33:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.354+0000 7f8ad1a6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fbcc0 0x7f8acc10da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.354+0000 7f8ad1a6f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8acc0fcf70 0x7f8acc10df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8ad1a6f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc10e590 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8ad1a6f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc10e700 con 0x7f8acc0fcf70 2024-05-09T06:33:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fbcc0 0x7f8acc10da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8acb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fbcc0 0x7f8acc10da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38384/0 (socket says 172.21.15.62:38384) 2024-05-09T06:33:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8acb7fe700 1 -- 172.21.15.62:0/2870399688 learned_addr learned my addr 172.21.15.62:0/2870399688 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8acaffd700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8acc0fcf70 0x7f8acc10df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8acb7fe700 1 -- 172.21.15.62:0/2870399688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8acc0fcf70 msgr2=0x7f8acc10df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8acb7fe700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8acc0fcf70 0x7f8acc10df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8acb7fe700 1 -- 172.21.15.62:0/2870399688 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0005040 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8acb7fe700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fbcc0 0x7f8acc10da50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8abc002a50 tx=0x7f8abc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8ab3fff700 1 -- 172.21.15.62:0/2870399688 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8abc007cc0 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc1130c0 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8ab3fff700 1 -- 172.21.15.62:0/2870399688 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8abc00f040 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8ab3fff700 1 -- 172.21.15.62:0/2870399688 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8abc00da30 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.355+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc113680 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.356+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc101b00 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.357+0000 7f8ab3fff700 1 -- 172.21.15.62:0/2870399688 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f8abc00db90 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.358+0000 7f8ab3fff700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8ab4078290 0x7f8ab407a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.358+0000 7f8acaffd700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8ab4078290 0x7f8ab407a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.358+0000 7f8ab3fff700 1 -- 172.21.15.62:0/2870399688 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8abc099b10 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.358+0000 7f8acaffd700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8ab4078290 0x7f8ab407a740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000b3b0 tx=0x7f8ac0009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.363+0000 7f8ab3fff700 1 -- 172.21.15.62:0/2870399688 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f8abc061fd0 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.674+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8acc04c710 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.656 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:02 smithi062 ceph-mon[26920]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:02.656 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:02 smithi062 ceph-mon[26920]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:02.656 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:02 smithi062 ceph-mon[26920]: pgmap v54: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:33:02.657 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:02 smithi062 ceph-mon[26920]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.675+0000 7f8ab3fff700 1 -- 172.21.15.62:0/2870399688 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f8abc061970 con 0x7f8acc0fbcc0 2024-05-09T06:33:02.657 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:33:02.657 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:33:02.657 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:33:02.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:33:02.657 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:33:02.657 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:33:02.658 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8ab4078290 msgr2=0x7f8ab407a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8ab4078290 0x7f8ab407a740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000b3b0 tx=0x7f8ac0009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fbcc0 msgr2=0x7f8acc10da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fbcc0 0x7f8acc10da50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8abc002a50 tx=0x7f8abc0046b0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 shutdown_connections 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8ab4078290 0x7f8ab407a740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8acc0fbcc0 0x7f8acc10da50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 --2- 172.21.15.62:0/2870399688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8acc0fcf70 0x7f8acc10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 >> 172.21.15.62:0/2870399688 conn(0x7f8acc0f7440 msgr2=0x7f8acc0668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 shutdown_connections 2024-05-09T06:33:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.678+0000 7f8ad1a6f700 1 -- 172.21.15.62:0/2870399688 wait complete. 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.786+0000 7f22d13a9700 1 -- 172.21.15.62:0/22338524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0662c0 msgr2=0x7f22cc0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.786+0000 7f22d13a9700 1 --2- 172.21.15.62:0/22338524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0662c0 0x7f22cc0ff9a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009ce0 tx=0x7f22c4004d10 comp rx=0 tx=0).stop 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.786+0000 7f22d13a9700 1 -- 172.21.15.62:0/22338524 shutdown_connections 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.786+0000 7f22d13a9700 1 --2- 172.21.15.62:0/22338524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22cc0ffee0 0x7f22cc102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.786+0000 7f22d13a9700 1 --2- 172.21.15.62:0/22338524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0662c0 0x7f22cc0ff9a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.786+0000 7f22d13a9700 1 -- 172.21.15.62:0/22338524 >> 172.21.15.62:0/22338524 conn(0x7f22cc0f7430 msgr2=0x7f22cc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.786+0000 7f22d13a9700 1 -- 172.21.15.62:0/22338524 shutdown_connections 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.786+0000 7f22d13a9700 1 -- 172.21.15.62:0/22338524 wait complete. 2024-05-09T06:33:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22d13a9700 1 Processor -- start 2024-05-09T06:33:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22d13a9700 1 -- start start 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22d13a9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22cc0662c0 0x7f22cc10dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22d13a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0ffee0 0x7f22cc10e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22d13a9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc10e6e0 con 0x7f22cc0ffee0 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22d13a9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc10ef30 con 0x7f22cc0662c0 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22ca7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0ffee0 0x7f22cc10e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22ca7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0ffee0 0x7f22cc10e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38400/0 (socket says 172.21.15.62:38400) 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22ca7fc700 1 -- 172.21.15.62:0/243032530 learned_addr learned my addr 172.21.15.62:0/243032530 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22caffd700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22cc0662c0 0x7f22cc10dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22ca7fc700 1 -- 172.21.15.62:0/243032530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22cc0662c0 msgr2=0x7f22cc10dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22ca7fc700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22cc0662c0 0x7f22cc10dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.787+0000 7f22ca7fc700 1 -- 172.21.15.62:0/243032530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c4009940 con 0x7f22cc0ffee0 2024-05-09T06:33:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.788+0000 7f22ca7fc700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0ffee0 0x7f22cc10e0e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f22b4002a50 tx=0x7f22b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.788+0000 7f22c37fe700 1 -- 172.21.15.62:0/243032530 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22b4007cc0 con 0x7f22cc0ffee0 2024-05-09T06:33:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.788+0000 7f22c37fe700 1 -- 172.21.15.62:0/243032530 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22b400f040 con 0x7f22cc0ffee0 2024-05-09T06:33:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.788+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc10f210 con 0x7f22cc0ffee0 2024-05-09T06:33:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.788+0000 7f22c37fe700 1 -- 172.21.15.62:0/243032530 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22b400da30 con 0x7f22cc0ffee0 2024-05-09T06:33:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.788+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc10f750 con 0x7f22cc0ffee0 2024-05-09T06:33:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.789+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc05f5c0 con 0x7f22cc0ffee0 2024-05-09T06:33:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.790+0000 7f22c37fe700 1 -- 172.21.15.62:0/243032530 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f22b400db90 con 0x7f22cc0ffee0 2024-05-09T06:33:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.790+0000 7f22c37fe700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f22b8078290 0x7f22b807a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.790+0000 7f22caffd700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f22b8078290 0x7f22b807a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.790+0000 7f22c37fe700 1 -- 172.21.15.62:0/243032530 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f22b4099b10 con 0x7f22cc0ffee0 2024-05-09T06:33:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.791+0000 7f22caffd700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f22b8078290 0x7f22b807a740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009470 tx=0x7f22c4004d10 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:02.796+0000 7f22c37fe700 1 -- 172.21.15.62:0/243032530 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f22b4061fd0 con 0x7f22cc0ffee0 2024-05-09T06:33:02.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:02 smithi079 ceph-mon[35268]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:02 smithi079 ceph-mon[35268]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:02 smithi079 ceph-mon[35268]: pgmap v54: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:33:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:02 smithi079 ceph-mon[35268]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:03.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.032+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22cc10fa80 con 0x7f22b8078290 2024-05-09T06:33:03.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.033+0000 7f22c37fe700 1 -- 172.21.15.62:0/243032530 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f22cc10fa80 con 0x7f22b8078290 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "2/2 daemons upgraded", 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading grafana daemons", 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:33:03.014 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:33:03.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f22b8078290 msgr2=0x7f22b807a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:03.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f22b8078290 0x7f22b807a740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009470 tx=0x7f22c4004d10 comp rx=0 tx=0).stop 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0ffee0 msgr2=0x7f22cc10e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0ffee0 0x7f22cc10e0e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f22b4002a50 tx=0x7f22b40046b0 comp rx=0 tx=0).stop 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 shutdown_connections 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f22b8078290 0x7f22b807a740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22cc0662c0 0x7f22cc10dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 --2- 172.21.15.62:0/243032530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22cc0ffee0 0x7f22cc10e0e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 >> 172.21.15.62:0/243032530 conn(0x7f22cc0f7430 msgr2=0x7f22cc0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 shutdown_connections 2024-05-09T06:33:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:03.036+0000 7f22d13a9700 1 -- 172.21.15.62:0/243032530 wait complete. 2024-05-09T06:33:03.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:03 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2870399688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:03.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:03 smithi079 ceph-mon[35268]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:03.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:03 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2870399688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:03.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:03 smithi062 ceph-mon[26920]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:04.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:04 smithi079 ceph-mon[35268]: pgmap v55: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:04.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:04 smithi062 ceph-mon[26920]: pgmap v55: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:05.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:05 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:05 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:06.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:06 smithi079 ceph-mon[35268]: pgmap v56: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:06.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:06 smithi062 ceph-mon[26920]: pgmap v56: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:09.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:09 smithi062 ceph-mon[26920]: pgmap v57: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:09 smithi079 ceph-mon[35268]: pgmap v57: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:11.148 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:11 smithi062 ceph-mon[26920]: pgmap v58: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:11 smithi079 ceph-mon[35268]: pgmap v58: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:13.273 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:13 smithi062 ceph-mon[26920]: pgmap v59: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:13.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:13 smithi079 ceph-mon[35268]: pgmap v59: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:14.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:14 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:14 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:14.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:14 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:14.623 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:14 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:14.623 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:14 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:14.623 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:14 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:15.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:15 smithi079 ceph-mon[35268]: pgmap v60: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:15.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:15 smithi062 ceph-mon[26920]: pgmap v60: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:17.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:17 smithi079 ceph-mon[35268]: pgmap v61: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:17.652 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:17 smithi062 ceph-mon[26920]: pgmap v61: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:19 smithi079 ceph-mon[35268]: pgmap v62: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:19 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:19 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:19 smithi062 ceph-mon[26920]: pgmap v62: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:19 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:19 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:20.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:20.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:20.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:20 smithi062 ceph-mon[26920]: pgmap v63: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:20.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:20 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:21.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:21.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:21.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:20 smithi079 ceph-mon[35268]: pgmap v63: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:21.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:20 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:23.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:23 smithi079 ceph-mon[35268]: pgmap v64: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:23.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:23 smithi062 ceph-mon[26920]: pgmap v64: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:24.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:24.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: Upgrade: Finalizing container_image settings 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T06:33:24.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.346 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: Upgrade: Complete! 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:24.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:24 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:33:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:33:24.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:24.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: Upgrade: Finalizing container_image settings 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.414 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: Upgrade: Complete! 2024-05-09T06:33:24.415 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T06:33:24.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T06:33:24.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:24.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:24.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:24.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:24.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:24.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:24.416 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:24 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:25 smithi079 ceph-mon[35268]: pgmap v65: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:25.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:25 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:25 smithi062 ceph-mon[26920]: pgmap v65: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:25.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:25 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:26.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:26 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:26.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:26 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:27.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:27 smithi062 ceph-mon[26920]: pgmap v66: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:27.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:27 smithi079 ceph-mon[35268]: pgmap v66: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:29.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:29 smithi062 ceph-mon[26920]: pgmap v67: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:29.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:29 smithi079 ceph-mon[35268]: pgmap v67: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:31 smithi062 ceph-mon[26920]: pgmap v68: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:31.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:31 smithi079 ceph-mon[35268]: pgmap v68: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:33.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/4242889669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 msgr2=0x7f0cbc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:33.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 --2- 172.21.15.62:0/4242889669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 0x7f0cbc0fe440 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0004940 tx=0x7f0cb0009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:33.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/4242889669 shutdown_connections 2024-05-09T06:33:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 --2- 172.21.15.62:0/4242889669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 0x7f0cbc0fe440 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 --2- 172.21.15.62:0/4242889669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cbc0fce60 0x7f0cbc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/4242889669 >> 172.21.15.62:0/4242889669 conn(0x7f0cbc0f8540 msgr2=0x7f0cbc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/4242889669 shutdown_connections 2024-05-09T06:33:33.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/4242889669 wait complete. 2024-05-09T06:33:33.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.158+0000 7f0cc1c5d700 1 Processor -- start 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cc1c5d700 1 -- start start 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cc1c5d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cbc0fce60 0x7f0cbc10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cc1c5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 0x7f0cbc10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cc1c5d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc10e500 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cc1c5d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc112ea0 con 0x7f0cbc0fce60 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cbaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 0x7f0cbc10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cbaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 0x7f0cbc10de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44508/0 (socket says 172.21.15.62:44508) 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cbaffd700 1 -- 172.21.15.62:0/2300093166 learned_addr learned my addr 172.21.15.62:0/2300093166 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.159+0000 7f0cbb7fe700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cbc0fce60 0x7f0cbc10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0cbaffd700 1 -- 172.21.15.62:0/2300093166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cbc0fce60 msgr2=0x7f0cbc10d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0cbaffd700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cbc0fce60 0x7f0cbc10d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:33.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0cbaffd700 1 -- 172.21.15.62:0/2300093166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0005040 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0cbb7fe700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cbc0fce60 0x7f0cbc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:33:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0cbaffd700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 0x7f0cbc10de70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000b970 tx=0x7f0cb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0ca3fff700 1 -- 172.21.15.62:0/2300093166 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb000e040 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc1130a0 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0ca3fff700 1 -- 172.21.15.62:0/2300093166 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cb000bcc0 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0ca3fff700 1 -- 172.21.15.62:0/2300093166 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb0013660 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.160+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc113610 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.161+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc04c710 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.162+0000 7f0ca3fff700 1 -- 172.21.15.62:0/2300093166 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f0cb001ca00 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.163+0000 7f0ca3fff700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0ca4078290 0x7f0ca407a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.163+0000 7f0cbb7fe700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0ca4078290 0x7f0ca407a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.163+0000 7f0ca3fff700 1 -- 172.21.15.62:0/2300093166 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0cb009aa90 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.163+0000 7f0cbb7fe700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0ca4078290 0x7f0ca407a740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0cac006fd0 tx=0x7f0cac008040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:33.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.168+0000 7f0ca3fff700 1 -- 172.21.15.62:0/2300093166 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f0cb0063080 con 0x7f0cbc0fdfd0 2024-05-09T06:33:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.402+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cbc102270 con 0x7f0ca4078290 2024-05-09T06:33:33.384 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:33 smithi062 ceph-mon[26920]: pgmap v69: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:33.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.403+0000 7f0ca3fff700 1 -- 172.21.15.62:0/2300093166 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f0cbc102270 con 0x7f0ca4078290 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.405+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0ca4078290 msgr2=0x7f0ca407a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.405+0000 7f0cc1c5d700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0ca4078290 0x7f0ca407a740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0cac006fd0 tx=0x7f0cac008040 comp rx=0 tx=0).stop 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.405+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 msgr2=0x7f0cbc10de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.405+0000 7f0cc1c5d700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 0x7f0cbc10de70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000b970 tx=0x7f0cb0009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.405+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 shutdown_connections 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.405+0000 7f0cc1c5d700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0ca4078290 0x7f0ca407a740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.405+0000 7f0cc1c5d700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cbc0fce60 0x7f0cbc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.405+0000 7f0cc1c5d700 1 --2- 172.21.15.62:0/2300093166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cbc0fdfd0 0x7f0cbc10de70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.406+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 >> 172.21.15.62:0/2300093166 conn(0x7f0cbc0f8540 msgr2=0x7f0cbc0f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.406+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 shutdown_connections 2024-05-09T06:33:33.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:33.406+0000 7f0cc1c5d700 1 -- 172.21.15.62:0/2300093166 wait complete. 2024-05-09T06:33:33.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:33 smithi079 ceph-mon[35268]: pgmap v69: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:34.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-05-09T06:33:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:35.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:35 smithi062 ceph-mon[26920]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:35.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:35 smithi062 ceph-mon[26920]: pgmap v70: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:35.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:35 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:35 smithi079 ceph-mon[35268]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:35 smithi079 ceph-mon[35268]: pgmap v70: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:35 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.987+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1956962518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54102de0 msgr2=0x7f9c541031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.987+0000 7f9c5a8c6700 1 --2- 172.21.15.62:0/1956962518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54102de0 0x7f9c541031b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9c44004940 tx=0x7f9c44009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.987+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1956962518 shutdown_connections 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.987+0000 7f9c5a8c6700 1 --2- 172.21.15.62:0/1956962518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54103780 0x7f9c540fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.987+0000 7f9c5a8c6700 1 --2- 172.21.15.62:0/1956962518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54102de0 0x7f9c541031b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.988+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1956962518 >> 172.21.15.62:0/1956962518 conn(0x7f9c540f8950 msgr2=0x7f9c540fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.988+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1956962518 shutdown_connections 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.988+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1956962518 wait complete. 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.988+0000 7f9c5a8c6700 1 Processor -- start 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.988+0000 7f9c5a8c6700 1 -- start start 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.988+0000 7f9c5a8c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102de0 0x7f9c54113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.988+0000 7f9c5a8c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54103780 0x7f9c541140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c5a8c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54114740 con 0x7f9c54103780 2024-05-09T06:33:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c5a8c6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5410db30 con 0x7f9c54102de0 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54103780 0x7f9c541140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54103780 0x7f9c541140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45516/0 (socket says 172.21.15.62:45516) 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c537fe700 1 -- 172.21.15.62:0/1439195328 learned_addr learned my addr 172.21.15.62:0/1439195328 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c53fff700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102de0 0x7f9c54113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c537fe700 1 -- 172.21.15.62:0/1439195328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102de0 msgr2=0x7f9c54113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c537fe700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102de0 0x7f9c54113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c537fe700 1 -- 172.21.15.62:0/1439195328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44005040 con 0x7f9c54103780 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c537fe700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54103780 0x7f9c541140f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9c48002a50 tx=0x7f9c48004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c50ff9700 1 -- 172.21.15.62:0/1439195328 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c48007cc0 con 0x7f9c54103780 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5410de10 con 0x7f9c54103780 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c50ff9700 1 -- 172.21.15.62:0/1439195328 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c4800f040 con 0x7f9c54103780 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c50ff9700 1 -- 172.21.15.62:0/1439195328 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4800d9c0 con 0x7f9c54103780 2024-05-09T06:33:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.989+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5410e3d0 con 0x7f9c54103780 2024-05-09T06:33:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.990+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c541000f0 con 0x7f9c54103780 2024-05-09T06:33:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.991+0000 7f9c50ff9700 1 -- 172.21.15.62:0/1439195328 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f9c48009730 con 0x7f9c54103780 2024-05-09T06:33:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.992+0000 7f9c50ff9700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9c3c078280 0x7f9c3c07a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.992+0000 7f9c50ff9700 1 -- 172.21.15.62:0/1439195328 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9c48099a50 con 0x7f9c54103780 2024-05-09T06:33:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.992+0000 7f9c53fff700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9c3c078280 0x7f9c3c07a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.992+0000 7f9c53fff700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9c3c078280 0x7f9c3c07a730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009fd0 tx=0x7f9c44009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:35.997+0000 7f9c50ff9700 1 -- 172.21.15.62:0/1439195328 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f9c48061f10 con 0x7f9c54103780 2024-05-09T06:33:36.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.307+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9c5410f250 con 0x7f9c54103780 2024-05-09T06:33:36.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.307+0000 7f9c50ff9700 1 -- 172.21.15.62:0/1439195328 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f9c480618b0 con 0x7f9c54103780 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.309+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9c3c078280 msgr2=0x7f9c3c07a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.309+0000 7f9c5a8c6700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9c3c078280 0x7f9c3c07a730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009fd0 tx=0x7f9c44009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.309+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54103780 msgr2=0x7f9c541140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.309+0000 7f9c5a8c6700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54103780 0x7f9c541140f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9c48002a50 tx=0x7f9c48004600 comp rx=0 tx=0).stop 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.310+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 shutdown_connections 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.310+0000 7f9c5a8c6700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9c3c078280 0x7f9c3c07a730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.310+0000 7f9c5a8c6700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54102de0 0x7f9c54113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.310+0000 7f9c5a8c6700 1 --2- 172.21.15.62:0/1439195328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9c54103780 0x7f9c541140f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.310+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 >> 172.21.15.62:0/1439195328 conn(0x7f9c540f8950 msgr2=0x7f9c541073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.310+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 shutdown_connections 2024-05-09T06:33:36.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:36.310+0000 7f9c5a8c6700 1 -- 172.21.15.62:0/1439195328 wait complete. 2024-05-09T06:33:36.301 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:33:36.910 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-05-09T06:33:37.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:37 smithi062 ceph-mon[26920]: pgmap v71: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:37.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:37 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1439195328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:37.184 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:37.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:37 smithi079 ceph-mon[35268]: pgmap v71: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:37.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:37 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1439195328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:38.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.817+0000 7ffb7b882700 1 -- 172.21.15.62:0/3839579973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 msgr2=0x7ffb740fcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.817+0000 7ffb7b882700 1 --2- 172.21.15.62:0/3839579973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 0x7ffb740fcaa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ffb64004940 tx=0x7ffb64009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.817+0000 7ffb7b882700 1 -- 172.21.15.62:0/3839579973 shutdown_connections 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.817+0000 7ffb7b882700 1 --2- 172.21.15.62:0/3839579973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 0x7ffb740fcaa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.817+0000 7ffb7b882700 1 --2- 172.21.15.62:0/3839579973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb74101e10 0x7ffb741021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.817+0000 7ffb7b882700 1 -- 172.21.15.62:0/3839579973 >> 172.21.15.62:0/3839579973 conn(0x7ffb740714d0 msgr2=0x7ffb740718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.817+0000 7ffb7b882700 1 -- 172.21.15.62:0/3839579973 shutdown_connections 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.817+0000 7ffb7b882700 1 -- 172.21.15.62:0/3839579973 wait complete. 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7b882700 1 Processor -- start 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7b882700 1 -- start start 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7b882700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 0x7ffb74113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7b882700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb74101e10 0x7ffb74113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:38.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7b882700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb74114510 con 0x7ffb740fc630 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7b882700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7410db30 con 0x7ffb74101e10 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7961e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 0x7ffb74113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7961e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 0x7ffb74113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45530/0 (socket says 172.21.15.62:45530) 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.818+0000 7ffb7961e700 1 -- 172.21.15.62:0/650740648 learned_addr learned my addr 172.21.15.62:0/650740648 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb78e1d700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb74101e10 0x7ffb74113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb7961e700 1 -- 172.21.15.62:0/650740648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb74101e10 msgr2=0x7ffb74113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb7961e700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb74101e10 0x7ffb74113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb7961e700 1 -- 172.21.15.62:0/650740648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64005040 con 0x7ffb740fc630 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb7961e700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 0x7ffb74113980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffb70002a80 tx=0x7ffb700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb69ffb700 1 -- 172.21.15.62:0/650740648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb70007cc0 con 0x7ffb740fc630 2024-05-09T06:33:38.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb69ffb700 1 -- 172.21.15.62:0/650740648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb7000f040 con 0x7ffb740fc630 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb69ffb700 1 -- 172.21.15.62:0/650740648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7000dac0 con 0x7ffb740fc630 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7410de10 con 0x7ffb740fc630 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.819+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7410e350 con 0x7ffb740fc630 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.820+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb74100140 con 0x7ffb740fc630 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.821+0000 7ffb69ffb700 1 -- 172.21.15.62:0/650740648 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7ffb7000dc20 con 0x7ffb740fc630 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.821+0000 7ffb69ffb700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ffb60078280 0x7ffb6007a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.821+0000 7ffb69ffb700 1 -- 172.21.15.62:0/650740648 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ffb700999f0 con 0x7ffb740fc630 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.821+0000 7ffb78e1d700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ffb60078280 0x7ffb6007a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:38.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.822+0000 7ffb78e1d700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ffb60078280 0x7ffb6007a730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffb7410f220 tx=0x7ffb64009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:38.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:38.826+0000 7ffb69ffb700 1 -- 172.21.15.62:0/650740648 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7ffb7009be60 con 0x7ffb740fc630 2024-05-09T06:33:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.136+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffb74108f00 con 0x7ffb740fc630 2024-05-09T06:33:39.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.137+0000 7ffb69ffb700 1 -- 172.21.15.62:0/650740648 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7ffb70061eb0 con 0x7ffb740fc630 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ffb60078280 msgr2=0x7ffb6007a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ffb60078280 0x7ffb6007a730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffb7410f220 tx=0x7ffb64009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 msgr2=0x7ffb74113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 0x7ffb74113980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffb70002a80 tx=0x7ffb700046b0 comp rx=0 tx=0).stop 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 shutdown_connections 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ffb60078280 0x7ffb6007a730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb740fc630 0x7ffb74113980 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 --2- 172.21.15.62:0/650740648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb74101e10 0x7ffb74113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.139+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 >> 172.21.15.62:0/650740648 conn(0x7ffb740714d0 msgr2=0x7ffb741052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.140+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 shutdown_connections 2024-05-09T06:33:39.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:39.140+0000 7ffb7b882700 1 -- 172.21.15.62:0/650740648 wait complete. 2024-05-09T06:33:39.132 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)" 2024-05-09T06:33:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:39 smithi062 ceph-mon[26920]: pgmap v72: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:39 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/650740648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:39.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:39 smithi079 ceph-mon[35268]: pgmap v72: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:39.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:39 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/650740648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:39.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-05-09T06:33:40.155 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:41.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:41 smithi062 ceph-mon[26920]: pgmap v73: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:41.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:41 smithi079 ceph-mon[35268]: pgmap v73: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:41.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.868+0000 7fdc947ea700 1 -- 172.21.15.62:0/1700817046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 msgr2=0x7fdc8c0fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:41.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.868+0000 7fdc947ea700 1 --2- 172.21.15.62:0/1700817046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 0x7fdc8c0fbcf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c004940 tx=0x7fdc7c009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:41.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.868+0000 7fdc947ea700 1 -- 172.21.15.62:0/1700817046 shutdown_connections 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.868+0000 7fdc947ea700 1 --2- 172.21.15.62:0/1700817046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 0x7fdc8c0fbcf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.868+0000 7fdc947ea700 1 --2- 172.21.15.62:0/1700817046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c101ce0 0x7fdc8c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.868+0000 7fdc947ea700 1 -- 172.21.15.62:0/1700817046 >> 172.21.15.62:0/1700817046 conn(0x7fdc8c0f7830 msgr2=0x7fdc8c0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.868+0000 7fdc947ea700 1 -- 172.21.15.62:0/1700817046 shutdown_connections 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.868+0000 7fdc947ea700 1 -- 172.21.15.62:0/1700817046 wait complete. 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc947ea700 1 Processor -- start 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc947ea700 1 -- start start 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc947ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c101ce0 0x7fdc8c10eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc947ea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 0x7fdc8c10f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc947ea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c10f540 con 0x7fdc8c102680 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc947ea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c10f680 con 0x7fdc8c101ce0 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc91d85700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 0x7fdc8c10f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc91d85700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 0x7fdc8c10f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45546/0 (socket says 172.21.15.62:45546) 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc91d85700 1 -- 172.21.15.62:0/1655320527 learned_addr learned my addr 172.21.15.62:0/1655320527 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc92586700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c101ce0 0x7fdc8c10eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc91d85700 1 -- 172.21.15.62:0/1655320527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c101ce0 msgr2=0x7fdc8c10eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc91d85700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c101ce0 0x7fdc8c10eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc91d85700 1 -- 172.21.15.62:0/1655320527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c005040 con 0x7fdc8c102680 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.869+0000 7fdc92586700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c101ce0 0x7fdc8c10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.870+0000 7fdc91d85700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 0x7fdc8c10f000 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009180 tx=0x7fdc7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.870+0000 7fdc82ffd700 1 -- 172.21.15.62:0/1655320527 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc7c00e040 con 0x7fdc8c102680 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.870+0000 7fdc82ffd700 1 -- 172.21.15.62:0/1655320527 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc7c00bbc0 con 0x7fdc8c102680 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.870+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8c10f900 con 0x7fdc8c102680 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.870+0000 7fdc82ffd700 1 -- 172.21.15.62:0/1655320527 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc7c01c3f0 con 0x7fdc8c102680 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.870+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c117e30 con 0x7fdc8c102680 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.871+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c0fd430 con 0x7fdc8c102680 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.871+0000 7fdc82ffd700 1 -- 172.21.15.62:0/1655320527 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fdc7c00bd30 con 0x7fdc8c102680 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.872+0000 7fdc82ffd700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fdc78078290 0x7fdc7807a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.872+0000 7fdc92586700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fdc78078290 0x7fdc7807a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:41.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.872+0000 7fdc82ffd700 1 -- 172.21.15.62:0/1655320527 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdc7c09b050 con 0x7fdc8c102680 2024-05-09T06:33:41.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.873+0000 7fdc92586700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fdc78078290 0x7fdc7807a740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009b80 tx=0x7fdc8800b040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:41.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:41.877+0000 7fdc82ffd700 1 -- 172.21.15.62:0/1655320527 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fdc7c063630 con 0x7fdc8c102680 2024-05-09T06:33:42.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.182+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdc8c118080 con 0x7fdc8c102680 2024-05-09T06:33:42.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.182+0000 7fdc82ffd700 1 -- 172.21.15.62:0/1655320527 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fdc7c062fd0 con 0x7fdc8c102680 2024-05-09T06:33:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fdc78078290 msgr2=0x7fdc7807a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:42.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fdc78078290 0x7fdc7807a740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009b80 tx=0x7fdc8800b040 comp rx=0 tx=0).stop 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 msgr2=0x7fdc8c10f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 0x7fdc8c10f000 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009180 tx=0x7fdc7c009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 shutdown_connections 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fdc78078290 0x7fdc7807a740 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc8c101ce0 0x7fdc8c10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 --2- 172.21.15.62:0/1655320527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc8c102680 0x7fdc8c10f000 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 >> 172.21.15.62:0/1655320527 conn(0x7fdc8c0f7830 msgr2=0x7fdc8c0f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 shutdown_connections 2024-05-09T06:33:42.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:42.185+0000 7fdc947ea700 1 -- 172.21.15.62:0/1655320527 wait complete. 2024-05-09T06:33:42.177 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:33:42.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-05-09T06:33:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:43.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:43 smithi062 ceph-mon[26920]: pgmap v74: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:43.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:43 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1655320527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:43.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:43 smithi079 ceph-mon[35268]: pgmap v74: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:43 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1655320527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.765+0000 7f083b904700 1 -- 172.21.15.62:0/1614039959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 msgr2=0x7f0834065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.765+0000 7f083b904700 1 --2- 172.21.15.62:0/1614039959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 0x7f0834065ab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0824004940 tx=0x7f0824009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.765+0000 7f083b904700 1 -- 172.21.15.62:0/1614039959 shutdown_connections 2024-05-09T06:33:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.765+0000 7f083b904700 1 --2- 172.21.15.62:0/1614039959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 0x7f0834065ab0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:44.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.765+0000 7f083b904700 1 --2- 172.21.15.62:0/1614039959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0834102e50 0x7f0834103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.765+0000 7f083b904700 1 -- 172.21.15.62:0/1614039959 >> 172.21.15.62:0/1614039959 conn(0x7f0834071d00 msgr2=0x7f0834072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.765+0000 7f083b904700 1 -- 172.21.15.62:0/1614039959 shutdown_connections 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.765+0000 7f083b904700 1 -- 172.21.15.62:0/1614039959 wait complete. 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f083b904700 1 Processor -- start 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f083b904700 1 -- start start 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f083b904700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 0x7f0834113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f083b904700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0834102e50 0x7f08341140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f083b904700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08341147a0 con 0x7f0834065640 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f083b904700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083410db00 con 0x7f0834102e50 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f08396a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 0x7f0834113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f08396a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 0x7f0834113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41004/0 (socket says 172.21.15.62:41004) 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f08396a0700 1 -- 172.21.15.62:0/1599107768 learned_addr learned my addr 172.21.15.62:0/1599107768 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f08396a0700 1 -- 172.21.15.62:0/1599107768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0834102e50 msgr2=0x7f08341140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.766+0000 7f08396a0700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0834102e50 0x7f08341140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.767+0000 7f08396a0700 1 -- 172.21.15.62:0/1599107768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0824005040 con 0x7f0834065640 2024-05-09T06:33:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.767+0000 7f08396a0700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 0x7f0834113b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f083000b790 tx=0x7f0830009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.767+0000 7f0829ffb700 1 -- 172.21.15.62:0/1599107768 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f083000f770 con 0x7f0834065640 2024-05-09T06:33:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.767+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083410dde0 con 0x7f0834065640 2024-05-09T06:33:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.767+0000 7f0829ffb700 1 -- 172.21.15.62:0/1599107768 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f083000fda0 con 0x7f0834065640 2024-05-09T06:33:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.767+0000 7f0829ffb700 1 -- 172.21.15.62:0/1599107768 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f083000d310 con 0x7f0834065640 2024-05-09T06:33:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.767+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083410e3a0 con 0x7f0834065640 2024-05-09T06:33:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.768+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08340fe540 con 0x7f0834065640 2024-05-09T06:33:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.769+0000 7f0829ffb700 1 -- 172.21.15.62:0/1599107768 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f0830010420 con 0x7f0834065640 2024-05-09T06:33:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.769+0000 7f0829ffb700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0820078290 0x7f082007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.769+0000 7f0829ffb700 1 -- 172.21.15.62:0/1599107768 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0830099e10 con 0x7f0834065640 2024-05-09T06:33:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.769+0000 7f0838e9f700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0820078290 0x7f082007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.770+0000 7f0838e9f700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0820078290 0x7f082007a740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0824004f90 tx=0x7f0824009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:44.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:44.774+0000 7f0829ffb700 1 -- 172.21.15.62:0/1599107768 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f0830062350 con 0x7f0834065640 2024-05-09T06:33:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:45.009+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}) v1 -- 0x7f083404bed0 con 0x7f0820078290 2024-05-09T06:33:45.273 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:45 smithi062 ceph-mon[26920]: pgmap v75: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:45.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:45 smithi079 ceph-mon[35268]: pgmap v75: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:46.253 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:46 smithi062 ceph-mon[26920]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:46.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:46 smithi079 ceph-mon[35268]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:47.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.129+0000 7f0829ffb700 1 -- 172.21.15.62:0/1599107768 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5092 (secure 0 0 0) 0x7f083404bed0 con 0x7f0820078290 2024-05-09T06:33:47.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.131+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0820078290 msgr2=0x7f082007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:47.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.131+0000 7f083b904700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0820078290 0x7f082007a740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0824004f90 tx=0x7f0824009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:47.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.131+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 msgr2=0x7f0834113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:47.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.131+0000 7f083b904700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 0x7f0834113b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f083000b790 tx=0x7f0830009250 comp rx=0 tx=0).stop 2024-05-09T06:33:47.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.132+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 shutdown_connections 2024-05-09T06:33:47.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.132+0000 7f083b904700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0820078290 0x7f082007a740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:47.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.132+0000 7f083b904700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0834065640 0x7f0834113b80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:47.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.132+0000 7f083b904700 1 --2- 172.21.15.62:0/1599107768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0834102e50 0x7f08341140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:47.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.132+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 >> 172.21.15.62:0/1599107768 conn(0x7f0834071d00 msgr2=0x7f08340fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:47.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.132+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 shutdown_connections 2024-05-09T06:33:47.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:47.132+0000 7f083b904700 1 -- 172.21.15.62:0/1599107768 wait complete. 2024-05-09T06:33:47.125 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:33:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:47 smithi062 ceph-mon[26920]: pgmap v76: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:47.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:47 smithi079 ceph-mon[35268]: pgmap v76: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:47.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch ps' 2024-05-09T06:33:48.018 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:49.387 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:49 smithi062 ceph-mon[26920]: pgmap v77: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:49.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:49 smithi079 ceph-mon[35268]: pgmap v77: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:49.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.817+0000 7fec27072700 1 -- 172.21.15.62:0/2567360755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20065640 msgr2=0x7fec20065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.817+0000 7fec27072700 1 --2- 172.21.15.62:0/2567360755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20065640 0x7fec20065ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fec0c004940 tx=0x7fec0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.817+0000 7fec27072700 1 -- 172.21.15.62:0/2567360755 shutdown_connections 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.817+0000 7fec27072700 1 --2- 172.21.15.62:0/2567360755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20065640 0x7fec20065ab0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.817+0000 7fec27072700 1 --2- 172.21.15.62:0/2567360755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec20102e50 0x7fec20103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.817+0000 7fec27072700 1 -- 172.21.15.62:0/2567360755 >> 172.21.15.62:0/2567360755 conn(0x7fec20071d00 msgr2=0x7fec20072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.817+0000 7fec27072700 1 -- 172.21.15.62:0/2567360755 shutdown_connections 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.817+0000 7fec27072700 1 -- 172.21.15.62:0/2567360755 wait complete. 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec27072700 1 Processor -- start 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec27072700 1 -- start start 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec27072700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec20065640 0x7fec200fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:49.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec27072700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20102e50 0x7fec200fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec27072700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200fc910 con 0x7fec20102e50 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec27072700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200fca50 con 0x7fec20065640 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec1ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20102e50 0x7fec200fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec1ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20102e50 0x7fec200fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41032/0 (socket says 172.21.15.62:41032) 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.818+0000 7fec1ffff700 1 -- 172.21.15.62:0/2064694116 learned_addr learned my addr 172.21.15.62:0/2064694116 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec24e0e700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec20065640 0x7fec200fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec1ffff700 1 -- 172.21.15.62:0/2064694116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec20065640 msgr2=0x7fec200fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec1ffff700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec20065640 0x7fec200fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec1ffff700 1 -- 172.21.15.62:0/2064694116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c005040 con 0x7fec20102e50 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec24e0e700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec20065640 0x7fec200fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:33:49.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec1ffff700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20102e50 0x7fec200fc2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00b8b0 tx=0x7fec0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:49.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec1d7fa700 1 -- 172.21.15.62:0/2064694116 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec0c00e040 con 0x7fec20102e50 2024-05-09T06:33:49.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec1d7fa700 1 -- 172.21.15.62:0/2064694116 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec0c004290 con 0x7fec20102e50 2024-05-09T06:33:49.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec20119e80 con 0x7fec20102e50 2024-05-09T06:33:49.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec1d7fa700 1 -- 172.21.15.62:0/2064694116 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec0c01c3f0 con 0x7fec20102e50 2024-05-09T06:33:49.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.819+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2011a360 con 0x7fec20102e50 2024-05-09T06:33:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.820+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec200fe540 con 0x7fec20102e50 2024-05-09T06:33:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.821+0000 7fec1d7fa700 1 -- 172.21.15.62:0/2064694116 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fec0c0137b0 con 0x7fec20102e50 2024-05-09T06:33:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.821+0000 7fec1d7fa700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fec10078290 0x7fec1007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.821+0000 7fec1d7fa700 1 -- 172.21.15.62:0/2064694116 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fec0c09b000 con 0x7fec20102e50 2024-05-09T06:33:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.822+0000 7fec24e0e700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fec10078290 0x7fec1007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.822+0000 7fec24e0e700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fec10078290 0x7fec1007a740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec14007fd0 tx=0x7fec140074f0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:49.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:49.826+0000 7fec1d7fa700 1 -- 172.21.15.62:0/2064694116 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fec0c0635e0 con 0x7fec20102e50 2024-05-09T06:33:50.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.049+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec20109fe0 con 0x7fec10078290 2024-05-09T06:33:50.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.059+0000 7fec1d7fa700 1 -- 172.21.15.62:0/2064694116 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fec20109fe0 con 0x7fec10078290 2024-05-09T06:33:50.040 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:33:50.040 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (61s) 31s ago 12m 14.7M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (12m) 31s ago 12m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (11m) 93s ago 11m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (37s) 31s ago 11m 52.9M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (6m) 31s ago 6m 14.8M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (6m) 31s ago 6m 153M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (6m) 93s ago 6m 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (6m) 93s ago 6m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (2m) 31s ago 13m 522M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (114s) 93s ago 11m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (13m) 31s ago 13m 55.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (10m) 93s ago 10m 43.6M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (101s) 31s ago 12m 7956k - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (97s) 93s ago 11m 5708k - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (10m) 31s ago 10m 246M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (9m) 31s ago 9m 260M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:33:50.041 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (9m) 31s ago 9m 218M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:33:50.042 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (8m) 93s ago 8m 280M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:33:50.042 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (8m) 93s ago 8m 251M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:33:50.042 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (8m) 93s ago 8m 245M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:33:50.042 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (78s) 31s ago 11m 51.7M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fec10078290 msgr2=0x7fec1007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fec10078290 0x7fec1007a740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec14007fd0 tx=0x7fec140074f0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20102e50 msgr2=0x7fec200fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20102e50 0x7fec200fc2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00b8b0 tx=0x7fec0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 shutdown_connections 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fec10078290 0x7fec1007a740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec20065640 0x7fec200fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 --2- 172.21.15.62:0/2064694116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec20102e50 0x7fec200fc2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 >> 172.21.15.62:0/2064694116 conn(0x7fec20071d00 msgr2=0x7fec200fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.061+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 shutdown_connections 2024-05-09T06:33:50.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:50.062+0000 7fec27072700 1 -- 172.21.15.62:0/2064694116 wait complete. 2024-05-09T06:33:50.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:50 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:50.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:50 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:50.711 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T06:33:50.711 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:33:50.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-05-09T06:33:50.983 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:51.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:51 smithi062 ceph-mon[26920]: pgmap v78: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:51.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:51 smithi062 ceph-mon[26920]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:51.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:51 smithi079 ceph-mon[35268]: pgmap v78: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:51.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:51 smithi079 ceph-mon[35268]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:52.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.732+0000 7fc341049700 1 -- 172.21.15.62:0/2052987740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 msgr2=0x7fc33c1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:52.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.732+0000 7fc341049700 1 --2- 172.21.15.62:0/2052987740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 0x7fc33c1020e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc32c004940 tx=0x7fc32c009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:52.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.732+0000 7fc341049700 1 -- 172.21.15.62:0/2052987740 shutdown_connections 2024-05-09T06:33:52.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.732+0000 7fc341049700 1 --2- 172.21.15.62:0/2052987740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc33c1026b0 0x7fc33c0fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:52.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.732+0000 7fc341049700 1 --2- 172.21.15.62:0/2052987740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 0x7fc33c1020e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:52.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.732+0000 7fc341049700 1 -- 172.21.15.62:0/2052987740 >> 172.21.15.62:0/2052987740 conn(0x7fc33c0f7860 msgr2=0x7fc33c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:52.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.732+0000 7fc341049700 1 -- 172.21.15.62:0/2052987740 shutdown_connections 2024-05-09T06:33:52.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.732+0000 7fc341049700 1 -- 172.21.15.62:0/2052987740 wait complete. 2024-05-09T06:33:52.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc341049700 1 Processor -- start 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc341049700 1 -- start start 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc341049700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 0x7fc33c102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc341049700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc33c1026b0 0x7fc33c1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc341049700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c104aa0 con 0x7fc33c101d10 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc341049700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c1035f0 con 0x7fc33c1026b0 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc33ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 0x7fc33c102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc33ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 0x7fc33c102b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41048/0 (socket says 172.21.15.62:41048) 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc33ad9d700 1 -- 172.21.15.62:0/930922485 learned_addr learned my addr 172.21.15.62:0/930922485 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc33a59c700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc33c1026b0 0x7fc33c1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc33ad9d700 1 -- 172.21.15.62:0/930922485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc33c1026b0 msgr2=0x7fc33c1030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc33ad9d700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc33c1026b0 0x7fc33c1030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.733+0000 7fc33ad9d700 1 -- 172.21.15.62:0/930922485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c005040 con 0x7fc33c101d10 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.734+0000 7fc33ad9d700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 0x7fc33c102b70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00b8b0 tx=0x7fc32c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.734+0000 7fc3237fe700 1 -- 172.21.15.62:0/930922485 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32c00e040 con 0x7fc33c101d10 2024-05-09T06:33:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.734+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c103870 con 0x7fc33c101d10 2024-05-09T06:33:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.734+0000 7fc3237fe700 1 -- 172.21.15.62:0/930922485 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc32c004290 con 0x7fc33c101d10 2024-05-09T06:33:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.734+0000 7fc3237fe700 1 -- 172.21.15.62:0/930922485 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32c01c3f0 con 0x7fc33c101d10 2024-05-09T06:33:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.734+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c11a100 con 0x7fc33c101d10 2024-05-09T06:33:52.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.735+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c0fd460 con 0x7fc33c101d10 2024-05-09T06:33:52.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.736+0000 7fc3237fe700 1 -- 172.21.15.62:0/930922485 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fc32c0137b0 con 0x7fc33c101d10 2024-05-09T06:33:52.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.736+0000 7fc3237fe700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc324078290 0x7fc32407a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:52.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.736+0000 7fc3237fe700 1 -- 172.21.15.62:0/930922485 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc32c09b080 con 0x7fc33c101d10 2024-05-09T06:33:52.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.736+0000 7fc33a59c700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc324078290 0x7fc32407a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:52.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.737+0000 7fc33a59c700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc324078290 0x7fc32407a740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc330007fd0 tx=0x7fc330009040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:52.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.741+0000 7fc3237fe700 1 -- 172.21.15.62:0/930922485 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fc32c0635c0 con 0x7fc33c101d10 2024-05-09T06:33:52.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.954+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fc33c04c710 con 0x7fc33c101d10 2024-05-09T06:33:52.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.959+0000 7fc3237fe700 1 -- 172.21.15.62:0/930922485 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v46)=0 v46) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc32c062f60 con 0x7fc33c101d10 2024-05-09T06:33:52.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc324078290 msgr2=0x7fc32407a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:52.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc324078290 0x7fc32407a740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc330007fd0 tx=0x7fc330009040 comp rx=0 tx=0).stop 2024-05-09T06:33:52.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 msgr2=0x7fc33c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:52.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 0x7fc33c102b70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00b8b0 tx=0x7fc32c009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:52.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 shutdown_connections 2024-05-09T06:33:52.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc324078290 0x7fc32407a740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:52.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc33c101d10 0x7fc33c102b70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 --2- 172.21.15.62:0/930922485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc33c1026b0 0x7fc33c1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 >> 172.21.15.62:0/930922485 conn(0x7fc33c0f7860 msgr2=0x7fc33c0662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 shutdown_connections 2024-05-09T06:33:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:52.962+0000 7fc341049700 1 -- 172.21.15.62:0/930922485 wait complete. 2024-05-09T06:33:53.250 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:53 smithi062 ceph-mon[26920]: pgmap v79: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:53.250 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:53 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/930922485' entity='client.admin' 2024-05-09T06:33:53.250 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:53 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:53.250 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:53 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:53.250 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:53 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:53.250 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:53 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:53.396 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:53 smithi079 ceph-mon[35268]: pgmap v79: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:53.396 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:53 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/930922485' entity='client.admin' 2024-05-09T06:33:53.396 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:53 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:53.396 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:53 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:53.396 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:53 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:53.396 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:53 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:33:53.517 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T06:33:53.518 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:33:53.518 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-09T06:33:53.800 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:55.279 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:55 smithi062 ceph-mon[26920]: pgmap v80: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.538+0000 7fc5637b0700 1 -- 172.21.15.62:0/1880609451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 msgr2=0x7fc55c1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.538+0000 7fc5637b0700 1 --2- 172.21.15.62:0/1880609451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 0x7fc55c1020e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc558004940 tx=0x7fc558009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.539+0000 7fc5637b0700 1 -- 172.21.15.62:0/1880609451 shutdown_connections 2024-05-09T06:33:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.539+0000 7fc5637b0700 1 --2- 172.21.15.62:0/1880609451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc55c1026b0 0x7fc55c0fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.539+0000 7fc5637b0700 1 --2- 172.21.15.62:0/1880609451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 0x7fc55c1020e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.539+0000 7fc5637b0700 1 -- 172.21.15.62:0/1880609451 >> 172.21.15.62:0/1880609451 conn(0x7fc55c0f78a0 msgr2=0x7fc55c0f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.539+0000 7fc5637b0700 1 -- 172.21.15.62:0/1880609451 shutdown_connections 2024-05-09T06:33:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.539+0000 7fc5637b0700 1 -- 172.21.15.62:0/1880609451 wait complete. 2024-05-09T06:33:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.539+0000 7fc5637b0700 1 Processor -- start 2024-05-09T06:33:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.539+0000 7fc5637b0700 1 -- start start 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc5637b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 0x7fc55c115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc5637b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc55c1026b0 0x7fc55c116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc5637b0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c116840 con 0x7fc55c101d10 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc5637b0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c10fd90 con 0x7fc55c1026b0 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc56154c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 0x7fc55c115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc56154c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 0x7fc55c115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34302/0 (socket says 172.21.15.62:34302) 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc56154c700 1 -- 172.21.15.62:0/3987108985 learned_addr learned my addr 172.21.15.62:0/3987108985 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc560d4b700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc55c1026b0 0x7fc55c116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc56154c700 1 -- 172.21.15.62:0/3987108985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc55c1026b0 msgr2=0x7fc55c116160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc56154c700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc55c1026b0 0x7fc55c116160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc56154c700 1 -- 172.21.15.62:0/3987108985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558005040 con 0x7fc55c101d10 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc56154c700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 0x7fc55c115c20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b3b0 tx=0x7fc558009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc54dffb700 1 -- 172.21.15.62:0/3987108985 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55800e040 con 0x7fc55c101d10 2024-05-09T06:33:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c10ffb0 con 0x7fc55c101d10 2024-05-09T06:33:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.540+0000 7fc54dffb700 1 -- 172.21.15.62:0/3987108985 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc558013420 con 0x7fc55c101d10 2024-05-09T06:33:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.541+0000 7fc54dffb700 1 -- 172.21.15.62:0/3987108985 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55801c630 con 0x7fc55c101d10 2024-05-09T06:33:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.541+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c1104f0 con 0x7fc55c101d10 2024-05-09T06:33:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.542+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c0fd460 con 0x7fc55c101d10 2024-05-09T06:33:55.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.542+0000 7fc54dffb700 1 -- 172.21.15.62:0/3987108985 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fc558013590 con 0x7fc55c101d10 2024-05-09T06:33:55.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.543+0000 7fc54dffb700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc548078290 0x7fc54807a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:55.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.543+0000 7fc54dffb700 1 -- 172.21.15.62:0/3987108985 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc55809af70 con 0x7fc55c101d10 2024-05-09T06:33:55.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.543+0000 7fc560d4b700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc548078290 0x7fc54807a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:55.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.543+0000 7fc560d4b700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc548078290 0x7fc54807a740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc55c1114c0 tx=0x7fc5500091a0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:55.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.548+0000 7fc54dffb700 1 -- 172.21.15.62:0/3987108985 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fc5580634b0 con 0x7fc55c101d10 2024-05-09T06:33:55.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:55 smithi079 ceph-mon[35268]: pgmap v80: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:55.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.761+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fc55c111270 con 0x7fc55c101d10 2024-05-09T06:33:55.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.762+0000 7fc54dffb700 1 -- 172.21.15.62:0/3987108985 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v46)=0 v46) v1 ==== 155+0+0 (secure 0 0 0) 0x7fc558062e50 con 0x7fc55c101d10 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc548078290 msgr2=0x7fc54807a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc548078290 0x7fc54807a740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc55c1114c0 tx=0x7fc5500091a0 comp rx=0 tx=0).stop 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 msgr2=0x7fc55c115c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 0x7fc55c115c20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b3b0 tx=0x7fc558009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 shutdown_connections 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fc548078290 0x7fc54807a740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc55c101d10 0x7fc55c115c20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 --2- 172.21.15.62:0/3987108985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc55c1026b0 0x7fc55c116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 >> 172.21.15.62:0/3987108985 conn(0x7fc55c0f78a0 msgr2=0x7fc55c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:55.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 shutdown_connections 2024-05-09T06:33:55.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:55.764+0000 7fc5637b0700 1 -- 172.21.15.62:0/3987108985 wait complete. 2024-05-09T06:33:56.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-09T06:33:56.646 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:57.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:57 smithi062 ceph-mon[26920]: pgmap v81: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:57.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:57 smithi079 ceph-mon[35268]: pgmap v81: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:58.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.309+0000 7fb2a1c95700 1 -- 172.21.15.62:0/2642979843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 msgr2=0x7fb29c0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.309+0000 7fb2a1c95700 1 --2- 172.21.15.62:0/2642979843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 0x7fb29c0fcdf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb290004940 tx=0x7fb290009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 -- 172.21.15.62:0/2642979843 shutdown_connections 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 --2- 172.21.15.62:0/2642979843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 0x7fb29c0fcdf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 --2- 172.21.15.62:0/2642979843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c102de0 0x7fb29c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 -- 172.21.15.62:0/2642979843 >> 172.21.15.62:0/2642979843 conn(0x7fb29c0f8990 msgr2=0x7fb29c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 -- 172.21.15.62:0/2642979843 shutdown_connections 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 -- 172.21.15.62:0/2642979843 wait complete. 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 Processor -- start 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 -- start start 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.310+0000 7fb2a1c95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c102de0 0x7fb29c070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb2a1c95700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 0x7fb29c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:58.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb2a1c95700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c072240 con 0x7fb29c103780 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb2a1c95700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c070ce0 con 0x7fb29c102de0 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb29affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 0x7fb29c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb29affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 0x7fb29c0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34312/0 (socket says 172.21.15.62:34312) 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb29affd700 1 -- 172.21.15.62:0/3346160431 learned_addr learned my addr 172.21.15.62:0/3346160431 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb29b7fe700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c102de0 0x7fb29c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb29affd700 1 -- 172.21.15.62:0/3346160431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c102de0 msgr2=0x7fb29c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb29affd700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c102de0 0x7fb29c070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb29affd700 1 -- 172.21.15.62:0/3346160431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb290005040 con 0x7fb29c103780 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb29affd700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 0x7fb29c0707a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb290009100 tx=0x7fb290009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb283fff700 1 -- 172.21.15.62:0/3346160431 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb29000e040 con 0x7fb29c103780 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c070f60 con 0x7fb29c103780 2024-05-09T06:33:58.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb283fff700 1 -- 172.21.15.62:0/3346160431 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb290009af0 con 0x7fb29c103780 2024-05-09T06:33:58.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.311+0000 7fb283fff700 1 -- 172.21.15.62:0/3346160431 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb29001c3f0 con 0x7fb29c103780 2024-05-09T06:33:58.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.312+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c11a190 con 0x7fb29c103780 2024-05-09T06:33:58.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.313+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c1000f0 con 0x7fb29c103780 2024-05-09T06:33:58.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.313+0000 7fb283fff700 1 -- 172.21.15.62:0/3346160431 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fb29000baf0 con 0x7fb29c103780 2024-05-09T06:33:58.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.314+0000 7fb283fff700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fb284078290 0x7fb28407a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:58.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.314+0000 7fb283fff700 1 -- 172.21.15.62:0/3346160431 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb29009afd0 con 0x7fb29c103780 2024-05-09T06:33:58.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.314+0000 7fb29b7fe700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fb284078290 0x7fb28407a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:58.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.314+0000 7fb29b7fe700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fb284078290 0x7fb28407a740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009b60 tx=0x7fb28c0091a0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:58.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.318+0000 7fb283fff700 1 -- 172.21.15.62:0/3346160431 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fb290063510 con 0x7fb29c103780 2024-05-09T06:33:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.533+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fb29c0fe530 con 0x7fb29c103780 2024-05-09T06:33:58.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.533+0000 7fb283fff700 1 -- 172.21.15.62:0/3346160431 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v46)=0 v46) v1 ==== 163+0+0 (secure 0 0 0) 0x7fb29005de60 con 0x7fb29c103780 2024-05-09T06:33:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fb284078290 msgr2=0x7fb28407a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fb284078290 0x7fb28407a740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009b60 tx=0x7fb28c0091a0 comp rx=0 tx=0).stop 2024-05-09T06:33:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 msgr2=0x7fb29c0707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 0x7fb29c0707a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb290009100 tx=0x7fb290009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 shutdown_connections 2024-05-09T06:33:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fb284078290 0x7fb28407a740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c102de0 0x7fb29c070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 --2- 172.21.15.62:0/3346160431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c103780 0x7fb29c0707a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 >> 172.21.15.62:0/3346160431 conn(0x7fb29c0f8990 msgr2=0x7fb29c0fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 shutdown_connections 2024-05-09T06:33:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:33:58.536+0000 7fb2a1c95700 1 -- 172.21.15.62:0/3346160431 wait complete. 2024-05-09T06:33:59.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-09T06:33:59.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:33:59 smithi062 ceph-mon[26920]: pgmap v82: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:59.448 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:33:59.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:33:59 smithi079 ceph-mon[35268]: pgmap v82: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 -- 172.21.15.62:0/626232912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d80fb3c0 msgr2=0x7f59d80fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 --2- 172.21.15.62:0/626232912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d80fb3c0 0x7f59d80fb830 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f59c8004940 tx=0x7f59c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 -- 172.21.15.62:0/626232912 shutdown_connections 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 --2- 172.21.15.62:0/626232912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d80fb3c0 0x7f59d80fb830 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 --2- 172.21.15.62:0/626232912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59d8102eb0 0x7f59d8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 -- 172.21.15.62:0/626232912 >> 172.21.15.62:0/626232912 conn(0x7f59d8072320 msgr2=0x7f59d8072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 -- 172.21.15.62:0/626232912 shutdown_connections 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 -- 172.21.15.62:0/626232912 wait complete. 2024-05-09T06:34:01.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 Processor -- start 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.172+0000 7f59def6a700 1 -- start start 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59def6a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59d80fb3c0 0x7f59d80fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59def6a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d8102eb0 0x7f59d80fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59def6a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80fe4f0 con 0x7f59d8102eb0 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59def6a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80fd020 con 0x7f59d80fb3c0 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59cffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d8102eb0 0x7f59d80fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59cffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d8102eb0 0x7f59d80fcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34332/0 (socket says 172.21.15.62:34332) 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59cffff700 1 -- 172.21.15.62:0/897701220 learned_addr learned my addr 172.21.15.62:0/897701220 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59dcd06700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59d80fb3c0 0x7f59d80fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59cffff700 1 -- 172.21.15.62:0/897701220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59d80fb3c0 msgr2=0x7f59d80fc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59cffff700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59d80fb3c0 0x7f59d80fc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59cffff700 1 -- 172.21.15.62:0/897701220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8005040 con 0x7f59d8102eb0 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59cffff700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d8102eb0 0x7f59d80fcae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f59c800b3b0 tx=0x7f59c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:01.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.173+0000 7f59cd7fa700 1 -- 172.21.15.62:0/897701220 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59c800e040 con 0x7f59d8102eb0 2024-05-09T06:34:01.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.174+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d80fd2a0 con 0x7f59d8102eb0 2024-05-09T06:34:01.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.174+0000 7f59cd7fa700 1 -- 172.21.15.62:0/897701220 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59c8013420 con 0x7f59d8102eb0 2024-05-09T06:34:01.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.174+0000 7f59cd7fa700 1 -- 172.21.15.62:0/897701220 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59c801c630 con 0x7f59d8102eb0 2024-05-09T06:34:01.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.174+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d811a030 con 0x7f59d8102eb0 2024-05-09T06:34:01.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.175+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d8105290 con 0x7f59d8102eb0 2024-05-09T06:34:01.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.176+0000 7f59cd7fa700 1 -- 172.21.15.62:0/897701220 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f59c8013590 con 0x7f59d8102eb0 2024-05-09T06:34:01.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.177+0000 7f59cd7fa700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f59c0078290 0x7f59c007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:01.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.177+0000 7f59cd7fa700 1 -- 172.21.15.62:0/897701220 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f59c809b9e0 con 0x7f59d8102eb0 2024-05-09T06:34:01.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.177+0000 7f59dcd06700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f59c0078290 0x7f59c007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:01.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.177+0000 7f59dcd06700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f59c0078290 0x7f59c007a740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59d8065c20 tx=0x7f59d4009040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:01.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.183+0000 7f59cd7fa700 1 -- 172.21.15.62:0/897701220 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f59c8063fc0 con 0x7f59d8102eb0 2024-05-09T06:34:01.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.396+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f59d810a000 con 0x7f59d8102eb0 2024-05-09T06:34:01.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.396+0000 7f59cd7fa700 1 -- 172.21.15.62:0/897701220 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v46)=0 v46) v1 ==== 135+0+0 (secure 0 0 0) 0x7f59c8063960 con 0x7f59d8102eb0 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.398+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f59c0078290 msgr2=0x7f59c007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.398+0000 7f59def6a700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f59c0078290 0x7f59c007a740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59d8065c20 tx=0x7f59d4009040 comp rx=0 tx=0).stop 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.398+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d8102eb0 msgr2=0x7f59d80fcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.398+0000 7f59def6a700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d8102eb0 0x7f59d80fcae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f59c800b3b0 tx=0x7f59c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.399+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 shutdown_connections 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.399+0000 7f59def6a700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f59c0078290 0x7f59c007a740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.399+0000 7f59def6a700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59d80fb3c0 0x7f59d80fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.399+0000 7f59def6a700 1 --2- 172.21.15.62:0/897701220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d8102eb0 0x7f59d80fcae0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:01.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.399+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 >> 172.21.15.62:0/897701220 conn(0x7f59d8072320 msgr2=0x7f59d80fa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.399+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 shutdown_connections 2024-05-09T06:34:01.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:01.399+0000 7f59def6a700 1 -- 172.21.15.62:0/897701220 wait complete. 2024-05-09T06:34:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:01 smithi062 ceph-mon[26920]: pgmap v83: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:01.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:01 smithi079 ceph-mon[35268]: pgmap v83: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:02.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-05-09T06:34:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:34:03.425 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:03 smithi062 ceph-mon[26920]: pgmap v84: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:03.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:03 smithi079 ceph-mon[35268]: pgmap v84: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 -- 172.21.15.62:0/1105051158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fdc10 msgr2=0x7f97f00fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 --2- 172.21.15.62:0/1105051158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fdc10 0x7f97f00fdfe0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f97ec004940 tx=0x7f97ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 -- 172.21.15.62:0/1105051158 shutdown_connections 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 --2- 172.21.15.62:0/1105051158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f00fb350 0x7f97f00fb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 --2- 172.21.15.62:0/1105051158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fdc10 0x7f97f00fdfe0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 -- 172.21.15.62:0/1105051158 >> 172.21.15.62:0/1105051158 conn(0x7f97f0073350 msgr2=0x7f97f0073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 -- 172.21.15.62:0/1105051158 shutdown_connections 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 -- 172.21.15.62:0/1105051158 wait complete. 2024-05-09T06:34:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.938+0000 7f97f7cc6700 1 Processor -- start 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f7cc6700 1 -- start start 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f7cc6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fb350 0x7f97f0115b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f7cc6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f00fdc10 0x7f97f0116050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f7cc6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f01166a0 con 0x7f97f00fb350 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f7cc6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f010fd30 con 0x7f97f00fdc10 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f5a62700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fb350 0x7f97f0115b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f5a62700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fb350 0x7f97f0115b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59320/0 (socket says 172.21.15.62:59320) 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f5a62700 1 -- 172.21.15.62:0/987231268 learned_addr learned my addr 172.21.15.62:0/987231268 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f5261700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f00fdc10 0x7f97f0116050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f5a62700 1 -- 172.21.15.62:0/987231268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f00fdc10 msgr2=0x7f97f0116050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f5a62700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f00fdc10 0x7f97f0116050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f5a62700 1 -- 172.21.15.62:0/987231268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec005040 con 0x7f97f00fb350 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.939+0000 7f97f5a62700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fb350 0x7f97f0115b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00b3b0 tx=0x7f97ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.940+0000 7f97e67fc700 1 -- 172.21.15.62:0/987231268 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97ec00e040 con 0x7f97f00fb350 2024-05-09T06:34:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.940+0000 7f97e67fc700 1 -- 172.21.15.62:0/987231268 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97ec00bbc0 con 0x7f97f00fb350 2024-05-09T06:34:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.940+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f010ffb0 con 0x7f97f00fb350 2024-05-09T06:34:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.940+0000 7f97e67fc700 1 -- 172.21.15.62:0/987231268 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97ec01c3f0 con 0x7f97f00fb350 2024-05-09T06:34:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.940+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f01104f0 con 0x7f97f00fb350 2024-05-09T06:34:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.941+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f00fc360 con 0x7f97f00fb350 2024-05-09T06:34:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.941+0000 7f97e67fc700 1 -- 172.21.15.62:0/987231268 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f97ec00bd30 con 0x7f97f00fb350 2024-05-09T06:34:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.942+0000 7f97e67fc700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f97dc078290 0x7f97dc07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.942+0000 7f97e67fc700 1 -- 172.21.15.62:0/987231268 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f97ec09af70 con 0x7f97f00fb350 2024-05-09T06:34:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.942+0000 7f97f5261700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f97dc078290 0x7f97dc07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.942+0000 7f97f5261700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f97dc078290 0x7f97dc07a740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97f0073a20 tx=0x7f97e0009ee0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:03.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:03.947+0000 7f97e67fc700 1 -- 172.21.15.62:0/987231268 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f97ec0d06c0 con 0x7f97f00fb350 2024-05-09T06:34:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.184+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}) v1 -- 0x7f97f0110760 con 0x7f97dc078290 2024-05-09T06:34:04.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.190+0000 7f97e67fc700 1 -- 172.21.15.62:0/987231268 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f97f0110760 con 0x7f97dc078290 2024-05-09T06:34:04.171 INFO:teuthology.orchestra.run.smithi062.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:04.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f97dc078290 msgr2=0x7f97dc07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f97dc078290 0x7f97dc07a740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97f0073a20 tx=0x7f97e0009ee0 comp rx=0 tx=0).stop 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fb350 msgr2=0x7f97f0115b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fb350 0x7f97f0115b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00b3b0 tx=0x7f97ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 shutdown_connections 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f97dc078290 0x7f97dc07a740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97f00fb350 0x7f97f0115b10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 --2- 172.21.15.62:0/987231268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f00fdc10 0x7f97f0116050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 >> 172.21.15.62:0/987231268 conn(0x7f97f0073350 msgr2=0x7f97f00f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 shutdown_connections 2024-05-09T06:34:04.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:04.192+0000 7f97f7cc6700 1 -- 172.21.15.62:0/987231268 wait complete. 2024-05-09T06:34:05.051 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T06:34:05.051 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:34:05.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-05-09T06:34:05.346 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:34:05.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: pgmap v85: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:05.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:05.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:05.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:05.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:05 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:05.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: pgmap v85: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:05 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:06.554 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:06 smithi062 ceph-mon[26920]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:06.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:06 smithi079 ceph-mon[35268]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:07.247 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:07 smithi062 ceph-mon[26920]: pgmap v86: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:07.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:07 smithi079 ceph-mon[35268]: pgmap v86: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:08.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/3009860150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 msgr2=0x7f9f640fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 --2- 172.21.15.62:0/3009860150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 0x7f9f640fcdf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9f58004940 tx=0x7f9f58009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/3009860150 shutdown_connections 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 --2- 172.21.15.62:0/3009860150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 0x7f9f640fcdf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 --2- 172.21.15.62:0/3009860150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f64102de0 0x7f9f641031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/3009860150 >> 172.21.15.62:0/3009860150 conn(0x7f9f640f8990 msgr2=0x7f9f640fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/3009860150 shutdown_connections 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/3009860150 wait complete. 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.136+0000 7f9f6a0ae700 1 Processor -- start 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f6a0ae700 1 -- start start 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f6a0ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f64102de0 0x7f9f64070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f6a0ae700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 0x7f9f640707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f6a0ae700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f640721f0 con 0x7f9f64103780 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f6a0ae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f64070ce0 con 0x7f9f64102de0 2024-05-09T06:34:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f62ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 0x7f9f640707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f62ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 0x7f9f640707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59346/0 (socket says 172.21.15.62:59346) 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f62ffd700 1 -- 172.21.15.62:0/2867915398 learned_addr learned my addr 172.21.15.62:0/2867915398 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f637fe700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f64102de0 0x7f9f64070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f62ffd700 1 -- 172.21.15.62:0/2867915398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f64102de0 msgr2=0x7f9f64070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f62ffd700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f64102de0 0x7f9f64070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.137+0000 7f9f62ffd700 1 -- 172.21.15.62:0/2867915398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f58005040 con 0x7f9f64103780 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.138+0000 7f9f62ffd700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 0x7f9f640707a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009180 tx=0x7f9f58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.138+0000 7f9f4bfff700 1 -- 172.21.15.62:0/2867915398 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5800e040 con 0x7f9f64103780 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.138+0000 7f9f4bfff700 1 -- 172.21.15.62:0/2867915398 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f58013420 con 0x7f9f64103780 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.138+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f64070f60 con 0x7f9f64103780 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.138+0000 7f9f4bfff700 1 -- 172.21.15.62:0/2867915398 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5801c610 con 0x7f9f64103780 2024-05-09T06:34:08.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.138+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6411a170 con 0x7f9f64103780 2024-05-09T06:34:08.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.139+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f641000f0 con 0x7f9f64103780 2024-05-09T06:34:08.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.140+0000 7f9f4bfff700 1 -- 172.21.15.62:0/2867915398 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f9f5801c8d0 con 0x7f9f64103780 2024-05-09T06:34:08.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.140+0000 7f9f4bfff700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9f4c078290 0x7f9f4c07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.140+0000 7f9f4bfff700 1 -- 172.21.15.62:0/2867915398 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9f5809aea0 con 0x7f9f64103780 2024-05-09T06:34:08.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.140+0000 7f9f637fe700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9f4c078290 0x7f9f4c07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.141+0000 7f9f637fe700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9f4c078290 0x7f9f4c07a740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009bf0 tx=0x7f9f540091a0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:08.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.145+0000 7f9f4bfff700 1 -- 172.21.15.62:0/2867915398 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f9f580633e0 con 0x7f9f64103780 2024-05-09T06:34:08.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.389+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f640716f0 con 0x7f9f4c078290 2024-05-09T06:34:08.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.391+0000 7f9f4bfff700 1 -- 172.21.15.62:0/2867915398 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9f640716f0 con 0x7f9f4c078290 2024-05-09T06:34:08.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9f4c078290 msgr2=0x7f9f4c07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9f4c078290 0x7f9f4c07a740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009bf0 tx=0x7f9f540091a0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 msgr2=0x7f9f640707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 0x7f9f640707a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009180 tx=0x7f9f58009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 shutdown_connections 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f9f4c078290 0x7f9f4c07a740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f64102de0 0x7f9f64070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 --2- 172.21.15.62:0/2867915398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f64103780 0x7f9f640707a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 >> 172.21.15.62:0/2867915398 conn(0x7f9f640f8990 msgr2=0x7f9f64107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.393+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 shutdown_connections 2024-05-09T06:34:08.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.394+0000 7f9f6a0ae700 1 -- 172.21.15.62:0/2867915398 wait complete. 2024-05-09T06:34:08.387 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:34:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.505+0000 7ff08bd53700 1 -- 172.21.15.62:0/2803023173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0840fc630 msgr2=0x7ff0840fcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.505+0000 7ff08bd53700 1 --2- 172.21.15.62:0/2803023173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0840fc630 0x7ff0840fcaa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff078004940 tx=0x7ff078009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.505+0000 7ff08bd53700 1 -- 172.21.15.62:0/2803023173 shutdown_connections 2024-05-09T06:34:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.505+0000 7ff08bd53700 1 --2- 172.21.15.62:0/2803023173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0840fc630 0x7ff0840fcaa0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.505+0000 7ff08bd53700 1 --2- 172.21.15.62:0/2803023173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff084101e10 0x7ff0841021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.505+0000 7ff08bd53700 1 -- 172.21.15.62:0/2803023173 >> 172.21.15.62:0/2803023173 conn(0x7ff0840714d0 msgr2=0x7ff0840718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.505+0000 7ff08bd53700 1 -- 172.21.15.62:0/2803023173 shutdown_connections 2024-05-09T06:34:08.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.505+0000 7ff08bd53700 1 -- 172.21.15.62:0/2803023173 wait complete. 2024-05-09T06:34:08.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff08bd53700 1 Processor -- start 2024-05-09T06:34:08.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff08bd53700 1 -- start start 2024-05-09T06:34:08.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff08bd53700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0840fc630 0x7ff084112940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff08bd53700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff084101e10 0x7ff084112e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff08bd53700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084113560 con 0x7ff084101e10 2024-05-09T06:34:08.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff08bd53700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08410cad0 con 0x7ff0840fc630 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff0892ee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff084101e10 0x7ff084112e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff0892ee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff084101e10 0x7ff084112e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59364/0 (socket says 172.21.15.62:59364) 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.506+0000 7ff0892ee700 1 -- 172.21.15.62:0/1428343370 learned_addr learned my addr 172.21.15.62:0/1428343370 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff089aef700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0840fc630 0x7ff084112940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff0892ee700 1 -- 172.21.15.62:0/1428343370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0840fc630 msgr2=0x7ff084112940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff0892ee700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0840fc630 0x7ff084112940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff0892ee700 1 -- 172.21.15.62:0/1428343370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078005040 con 0x7ff084101e10 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff089aef700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0840fc630 0x7ff084112940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff0892ee700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff084101e10 0x7ff084112e80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff078009150 tx=0x7ff078009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff0827fc700 1 -- 172.21.15.62:0/1428343370 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07800e040 con 0x7ff084101e10 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff0827fc700 1 -- 172.21.15.62:0/1428343370 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff07800bd00 con 0x7ff084101e10 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff0827fc700 1 -- 172.21.15.62:0/1428343370 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff078013660 con 0x7ff084101e10 2024-05-09T06:34:08.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08410cd50 con 0x7ff084101e10 2024-05-09T06:34:08.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.507+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08410d230 con 0x7ff084101e10 2024-05-09T06:34:08.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.508+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0840fd640 con 0x7ff084101e10 2024-05-09T06:34:08.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.509+0000 7ff0827fc700 1 -- 172.21.15.62:0/1428343370 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7ff07801e420 con 0x7ff084101e10 2024-05-09T06:34:08.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.509+0000 7ff0827fc700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ff06c078280 0x7ff06c07a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.510+0000 7ff089aef700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ff06c078280 0x7ff06c07a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.510+0000 7ff0827fc700 1 -- 172.21.15.62:0/1428343370 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff07809dc30 con 0x7ff084101e10 2024-05-09T06:34:08.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.510+0000 7ff089aef700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ff06c078280 0x7ff06c07a730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff074007fd0 tx=0x7ff0740074f0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:08.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.514+0000 7ff0827fc700 1 -- 172.21.15.62:0/1428343370 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7ff0780a4080 con 0x7ff084101e10 2024-05-09T06:34:08.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.755+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff084108f80 con 0x7ff06c078280 2024-05-09T06:34:08.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.756+0000 7ff0827fc700 1 -- 172.21.15.62:0/1428343370 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ff084108f80 con 0x7ff06c078280 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ff06c078280 msgr2=0x7ff06c07a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ff06c078280 0x7ff06c07a730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff074007fd0 tx=0x7ff0740074f0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff084101e10 msgr2=0x7ff084112e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff084101e10 0x7ff084112e80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff078009150 tx=0x7ff078009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 shutdown_connections 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7ff06c078280 0x7ff06c07a730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0840fc630 0x7ff084112940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 --2- 172.21.15.62:0/1428343370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff084101e10 0x7ff084112e80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.758+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 >> 172.21.15.62:0/1428343370 conn(0x7ff0840714d0 msgr2=0x7ff0840fa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:08.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.759+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 shutdown_connections 2024-05-09T06:34:08.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.759+0000 7ff08bd53700 1 -- 172.21.15.62:0/1428343370 wait complete. 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.867+0000 7fa159283700 1 -- 172.21.15.62:0/4273909207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 msgr2=0x7fa1540fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.867+0000 7fa159283700 1 --2- 172.21.15.62:0/4273909207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 0x7fa1540fb600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa148004940 tx=0x7fa148009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.867+0000 7fa159283700 1 -- 172.21.15.62:0/4273909207 shutdown_connections 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.867+0000 7fa159283700 1 --2- 172.21.15.62:0/4273909207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 0x7fa1540fb600 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.867+0000 7fa159283700 1 --2- 172.21.15.62:0/4273909207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa154101cd0 0x7fa1541020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.867+0000 7fa159283700 1 -- 172.21.15.62:0/4273909207 >> 172.21.15.62:0/4273909207 conn(0x7fa154071460 msgr2=0x7fa154071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.868+0000 7fa159283700 1 -- 172.21.15.62:0/4273909207 shutdown_connections 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.868+0000 7fa159283700 1 -- 172.21.15.62:0/4273909207 wait complete. 2024-05-09T06:34:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.868+0000 7fa159283700 1 Processor -- start 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.868+0000 7fa159283700 1 -- start start 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.868+0000 7fa159283700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa154101cd0 0x7fa154113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.868+0000 7fa159283700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 0x7fa154114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.868+0000 7fa159283700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa154114750 con 0x7fa154102670 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.868+0000 7fa159283700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15410dab0 con 0x7fa154101cd0 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa1527fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 0x7fa154114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa1527fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 0x7fa154114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59388/0 (socket says 172.21.15.62:59388) 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa1527fc700 1 -- 172.21.15.62:0/2835301394 learned_addr learned my addr 172.21.15.62:0/2835301394 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa152ffd700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa154101cd0 0x7fa154113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa1527fc700 1 -- 172.21.15.62:0/2835301394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa154101cd0 msgr2=0x7fa154113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa1527fc700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa154101cd0 0x7fa154113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa1527fc700 1 -- 172.21.15.62:0/2835301394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148005040 con 0x7fa154102670 2024-05-09T06:34:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa1527fc700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 0x7fa154114070 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa148009030 tx=0x7fa148009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa13b7fe700 1 -- 172.21.15.62:0/2835301394 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14800e040 con 0x7fa154102670 2024-05-09T06:34:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa13b7fe700 1 -- 172.21.15.62:0/2835301394 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa148013420 con 0x7fa154102670 2024-05-09T06:34:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15410dd30 con 0x7fa154102670 2024-05-09T06:34:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa13b7fe700 1 -- 172.21.15.62:0/2835301394 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14801c630 con 0x7fa154102670 2024-05-09T06:34:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.869+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15410e2f0 con 0x7fa154102670 2024-05-09T06:34:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.870+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1541052e0 con 0x7fa154102670 2024-05-09T06:34:08.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.872+0000 7fa13b7fe700 1 -- 172.21.15.62:0/2835301394 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fa148013a90 con 0x7fa154102670 2024-05-09T06:34:08.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.872+0000 7fa13b7fe700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa13c078280 0x7fa13c07a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:08.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.872+0000 7fa13b7fe700 1 -- 172.21.15.62:0/2835301394 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa14809b090 con 0x7fa154102670 2024-05-09T06:34:08.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.872+0000 7fa152ffd700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa13c078280 0x7fa13c07a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:08.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.873+0000 7fa152ffd700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa13c078280 0x7fa13c07a730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa144006fd0 tx=0x7fa144008040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:08.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:08.876+0000 7fa13b7fe700 1 -- 172.21.15.62:0/2835301394 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fa148063670 con 0x7fa154102670 2024-05-09T06:34:08.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:08.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: Upgrade: Target is version 19.0.0-3575-g720f8e95 (squid) 2024-05-09T06:34:08.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc'] 2024-05-09T06:34:08.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:08.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:08.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: Upgrade: Setting container_image for all mgr 2024-05-09T06:34:08.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:08.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T06:34:08.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:08 smithi062 ceph-mon[26920]: pgmap v87: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.100+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa154113800 con 0x7fa13c078280 2024-05-09T06:34:09.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.110+0000 7fa13b7fe700 1 -- 172.21.15.62:0/2835301394 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa154113800 con 0x7fa13c078280 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (80s) 50s ago 12m 14.7M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (12m) 50s ago 12m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (11m) 112s ago 11m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (56s) 50s ago 12m 52.9M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (6m) 50s ago 6m 14.8M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (6m) 50s ago 6m 153M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (6m) 112s ago 6m 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (6m) 112s ago 6m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:34:09.092 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (3m) 50s ago 14m 522M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (2m) 112s ago 11m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (14m) 50s ago 14m 55.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 38521dd7b3dd 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (11m) 112s ago 11m 43.6M 2048M 17.2.7-933-g4ba5a836 b96134859c76 9b09bacca849 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (2m) 50s ago 12m 7956k - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (116s) 112s ago 11m 5708k - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (10m) 50s ago 10m 246M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (10m) 50s ago 10m 260M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (9m) 50s ago 9m 218M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (9m) 112s ago 9m 280M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:34:09.093 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (8m) 112s ago 8m 251M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:34:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (8m) 112s ago 8m 245M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:34:09.094 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (98s) 50s ago 11m 51.7M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:34:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa13c078280 msgr2=0x7fa13c07a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa13c078280 0x7fa13c07a730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa144006fd0 tx=0x7fa144008040 comp rx=0 tx=0).stop 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 msgr2=0x7fa154114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 0x7fa154114070 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa148009030 tx=0x7fa148009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 shutdown_connections 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fa13c078280 0x7fa13c07a730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa154101cd0 0x7fa154113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 --2- 172.21.15.62:0/2835301394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa154102670 0x7fa154114070 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 >> 172.21.15.62:0/2835301394 conn(0x7fa154071460 msgr2=0x7fa1540f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 shutdown_connections 2024-05-09T06:34:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.113+0000 7fa159283700 1 -- 172.21.15.62:0/2835301394 wait complete. 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 -- 172.21.15.62:0/2669886665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 msgr2=0x7f092c106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 --2- 172.21.15.62:0/2669886665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 0x7f092c106e50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0920004940 tx=0x7f0920009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 -- 172.21.15.62:0/2669886665 shutdown_connections 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 --2- 172.21.15.62:0/2669886665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 0x7f092c106e50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 --2- 172.21.15.62:0/2669886665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f092c0fde70 0x7f092c0fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 -- 172.21.15.62:0/2669886665 >> 172.21.15.62:0/2669886665 conn(0x7f092c0f78e0 msgr2=0x7f092c0f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 -- 172.21.15.62:0/2669886665 shutdown_connections 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 -- 172.21.15.62:0/2669886665 wait complete. 2024-05-09T06:34:09.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 Processor -- start 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.220+0000 7f0930ce5700 1 -- start start 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0930ce5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f092c0fde70 0x7f092c113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0930ce5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 0x7f092c113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0930ce5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1144c0 con 0x7f092c0fe810 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0930ce5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c10dac0 con 0x7f092c0fde70 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0929d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 0x7f092c113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0929d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 0x7f092c113e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59400/0 (socket says 172.21.15.62:59400) 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0929d9b700 1 -- 172.21.15.62:0/328722272 learned_addr learned my addr 172.21.15.62:0/328722272 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f092a59c700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f092c0fde70 0x7f092c113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0929d9b700 1 -- 172.21.15.62:0/328722272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f092c0fde70 msgr2=0x7f092c113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0929d9b700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f092c0fde70 0x7f092c113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0929d9b700 1 -- 172.21.15.62:0/328722272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920005040 con 0x7f092c0fe810 2024-05-09T06:34:09.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0929d9b700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 0x7f092c113e70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0920009380 tx=0x7f0920009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:09.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f091affd700 1 -- 172.21.15.62:0/328722272 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f092000e040 con 0x7f092c0fe810 2024-05-09T06:34:09.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f091affd700 1 -- 172.21.15.62:0/328722272 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0920009af0 con 0x7f092c0fe810 2024-05-09T06:34:09.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c10dda0 con 0x7f092c0fe810 2024-05-09T06:34:09.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f091affd700 1 -- 172.21.15.62:0/328722272 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f092001c630 con 0x7f092c0fe810 2024-05-09T06:34:09.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.221+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c10e2e0 con 0x7f092c0fe810 2024-05-09T06:34:09.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.222+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092c066ad0 con 0x7f092c0fe810 2024-05-09T06:34:09.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.223+0000 7f091affd700 1 -- 172.21.15.62:0/328722272 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f092000bbc0 con 0x7f092c0fe810 2024-05-09T06:34:09.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.224+0000 7f091affd700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0914078290 0x7f091407a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:09.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.224+0000 7f091affd700 1 -- 172.21.15.62:0/328722272 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f092009afa0 con 0x7f092c0fe810 2024-05-09T06:34:09.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.224+0000 7f092a59c700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0914078290 0x7f091407a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:09.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.224+0000 7f092a59c700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0914078290 0x7f091407a740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f091c007fd0 tx=0x7f091c009040 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:09.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.229+0000 7f091affd700 1 -- 172.21.15.62:0/328722272 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f0920063580 con 0x7f092c0fe810 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: Upgrade: Target is version 19.0.0-3575-g720f8e95 (squid) 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc'] 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: Upgrade: Setting container_image for all mgr 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T06:34:09.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:08 smithi079 ceph-mon[35268]: pgmap v87: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.536+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f092c109e30 con 0x7f092c0fe810 2024-05-09T06:34:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.537+0000 7f091affd700 1 -- 172.21.15.62:0/328722272 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f0920062f20 con 0x7f092c0fe810 2024-05-09T06:34:09.518 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:34:09.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:34:09.518 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:34:09.519 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0914078290 msgr2=0x7f091407a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0914078290 0x7f091407a740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f091c007fd0 tx=0x7f091c009040 comp rx=0 tx=0).stop 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 msgr2=0x7f092c113e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 0x7f092c113e70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0920009380 tx=0x7f0920009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 shutdown_connections 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f0914078290 0x7f091407a740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f092c0fde70 0x7f092c113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 --2- 172.21.15.62:0/328722272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c0fe810 0x7f092c113e70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 >> 172.21.15.62:0/328722272 conn(0x7f092c0f78e0 msgr2=0x7f092c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 shutdown_connections 2024-05-09T06:34:09.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.539+0000 7f0930ce5700 1 -- 172.21.15.62:0/328722272 wait complete. 2024-05-09T06:34:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 -- 172.21.15.62:0/2114381283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674103790 msgr2=0x7f16740fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 --2- 172.21.15.62:0/2114381283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674103790 0x7f16740fce00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1668004940 tx=0x7f1668009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 -- 172.21.15.62:0/2114381283 shutdown_connections 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 --2- 172.21.15.62:0/2114381283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674103790 0x7f16740fce00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 --2- 172.21.15.62:0/2114381283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1674102df0 0x7f16741031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 -- 172.21.15.62:0/2114381283 >> 172.21.15.62:0/2114381283 conn(0x7f16740f8980 msgr2=0x7f16740fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 -- 172.21.15.62:0/2114381283 shutdown_connections 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 -- 172.21.15.62:0/2114381283 wait complete. 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.649+0000 7f167a39e700 1 Processor -- start 2024-05-09T06:34:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f167a39e700 1 -- start start 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f167a39e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674102df0 0x7f1674070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f167a39e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1674103790 0x7f16740707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f167a39e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1674070d30 con 0x7f1674102df0 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f167a39e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1674070e70 con 0x7f1674103790 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f1673fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674102df0 0x7f1674070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f1673fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674102df0 0x7f1674070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59408/0 (socket says 172.21.15.62:59408) 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f1673fff700 1 -- 172.21.15.62:0/2829410138 learned_addr learned my addr 172.21.15.62:0/2829410138 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f16737fe700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1674103790 0x7f16740707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f1673fff700 1 -- 172.21.15.62:0/2829410138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1674103790 msgr2=0x7f16740707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f1673fff700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1674103790 0x7f16740707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.650+0000 7f1673fff700 1 -- 172.21.15.62:0/2829410138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668005040 con 0x7f1674102df0 2024-05-09T06:34:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.651+0000 7f1673fff700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674102df0 0x7f1674070260 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1664002a50 tx=0x7f16640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:09.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.651+0000 7f1670ff9700 1 -- 172.21.15.62:0/2829410138 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1664007cc0 con 0x7f1674102df0 2024-05-09T06:34:09.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.651+0000 7f1670ff9700 1 -- 172.21.15.62:0/2829410138 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f166400f040 con 0x7f1674102df0 2024-05-09T06:34:09.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.651+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1674119e70 con 0x7f1674102df0 2024-05-09T06:34:09.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.651+0000 7f1670ff9700 1 -- 172.21.15.62:0/2829410138 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1664009640 con 0x7f1674102df0 2024-05-09T06:34:09.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.651+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167411a2f0 con 0x7f1674102df0 2024-05-09T06:34:09.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.652+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16740fe540 con 0x7f1674102df0 2024-05-09T06:34:09.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.653+0000 7f1670ff9700 1 -- 172.21.15.62:0/2829410138 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f16640097a0 con 0x7f1674102df0 2024-05-09T06:34:09.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.653+0000 7f1670ff9700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f165c078290 0x7f165c07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:09.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.653+0000 7f1670ff9700 1 -- 172.21.15.62:0/2829410138 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1664099c10 con 0x7f1674102df0 2024-05-09T06:34:09.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.653+0000 7f16737fe700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f165c078290 0x7f165c07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:09.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.654+0000 7f16737fe700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f165c078290 0x7f165c07a740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f166800b3b0 tx=0x7f1668009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:09.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.658+0000 7f1670ff9700 1 -- 172.21.15.62:0/2829410138 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f1664062030 con 0x7f1674102df0 2024-05-09T06:34:09.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.924+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1674071950 con 0x7f1674102df0 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.924+0000 7f1670ff9700 1 -- 172.21.15.62:0/2829410138 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1802 (secure 0 0 0) 0x7f16640619d0 con 0x7f1674102df0 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:34:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:34:09.907 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:09.908 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:09.909 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f165c078290 msgr2=0x7f165c07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f165c078290 0x7f165c07a740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f166800b3b0 tx=0x7f1668009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674102df0 msgr2=0x7f1674070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674102df0 0x7f1674070260 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1664002a50 tx=0x7f16640046b0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 shutdown_connections 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f165c078290 0x7f165c07a740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1674102df0 0x7f1674070260 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 --2- 172.21.15.62:0/2829410138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1674103790 0x7f16740707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 >> 172.21.15.62:0/2829410138 conn(0x7f16740f8980 msgr2=0x7f16740f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 shutdown_connections 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:09.927+0000 7f167a39e700 1 -- 172.21.15.62:0/2829410138 wait complete. 2024-05-09T06:34:09.910 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:34:10.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.036+0000 7fcf0a938700 1 -- 172.21.15.62:0/3615992930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04103780 msgr2=0x7fcf040fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:10.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.036+0000 7fcf0a938700 1 --2- 172.21.15.62:0/3615992930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04103780 0x7fcf040fcdf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcef8004940 tx=0x7fcef8009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:10.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.036+0000 7fcf0a938700 1 -- 172.21.15.62:0/3615992930 shutdown_connections 2024-05-09T06:34:10.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.036+0000 7fcf0a938700 1 --2- 172.21.15.62:0/3615992930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04103780 0x7fcf040fcdf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.036+0000 7fcf0a938700 1 --2- 172.21.15.62:0/3615992930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf04102de0 0x7fcf041031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.036+0000 7fcf0a938700 1 -- 172.21.15.62:0/3615992930 >> 172.21.15.62:0/3615992930 conn(0x7fcf040f8950 msgr2=0x7fcf040fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:10.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.036+0000 7fcf0a938700 1 -- 172.21.15.62:0/3615992930 shutdown_connections 2024-05-09T06:34:10.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.036+0000 7fcf0a938700 1 -- 172.21.15.62:0/3615992930 wait complete. 2024-05-09T06:34:10.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.037+0000 7fcf0a938700 1 Processor -- start 2024-05-09T06:34:10.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.037+0000 7fcf0a938700 1 -- start start 2024-05-09T06:34:10.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.037+0000 7fcf0a938700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04102de0 0x7fcf04070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:10.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.037+0000 7fcf0a938700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf04103780 0x7fcf040707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:10.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.037+0000 7fcf0a938700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04070d30 con 0x7fcf04102de0 2024-05-09T06:34:10.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.037+0000 7fcf0a938700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04070e70 con 0x7fcf04103780 2024-05-09T06:34:10.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.037+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04102de0 0x7fcf04070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:10.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04102de0 0x7fcf04070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59418/0 (socket says 172.21.15.62:59418) 2024-05-09T06:34:10.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf03fff700 1 -- 172.21.15.62:0/2945400556 learned_addr learned my addr 172.21.15.62:0/2945400556 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:10.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf037fe700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf04103780 0x7fcf040707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:10.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf03fff700 1 -- 172.21.15.62:0/2945400556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf04103780 msgr2=0x7fcf040707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf03fff700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf04103780 0x7fcf040707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf03fff700 1 -- 172.21.15.62:0/2945400556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8005040 con 0x7fcf04102de0 2024-05-09T06:34:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf03fff700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04102de0 0x7fcf04070260 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c830 tx=0x7fcef4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf00ff9700 1 -- 172.21.15.62:0/2945400556 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcef40106f0 con 0x7fcf04102de0 2024-05-09T06:34:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf00ff9700 1 -- 172.21.15.62:0/2945400556 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcef4010d20 con 0x7fcf04102de0 2024-05-09T06:34:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf04119ea0 con 0x7fcf04102de0 2024-05-09T06:34:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf00ff9700 1 -- 172.21.15.62:0/2945400556 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcef40113a0 con 0x7fcf04102de0 2024-05-09T06:34:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.038+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0411a2c0 con 0x7fcf04102de0 2024-05-09T06:34:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.039+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf040fe530 con 0x7fcf04102de0 2024-05-09T06:34:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.040+0000 7fcf00ff9700 1 -- 172.21.15.62:0/2945400556 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fcef4012400 con 0x7fcf04102de0 2024-05-09T06:34:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.040+0000 7fcf00ff9700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fceec078290 0x7fceec07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.041+0000 7fcf00ff9700 1 -- 172.21.15.62:0/2945400556 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcef4099d40 con 0x7fcf04102de0 2024-05-09T06:34:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.041+0000 7fcf037fe700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fceec078290 0x7fceec07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.041+0000 7fcf037fe700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fceec078290 0x7fceec07a740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcef8004890 tx=0x7fcef8009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:10.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.050+0000 7fcf00ff9700 1 -- 172.21.15.62:0/2945400556 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fcef40621e0 con 0x7fcf04102de0 2024-05-09T06:34:10.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:09 smithi062 ceph-mon[26920]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:10.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:09 smithi062 ceph-mon[26920]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:10.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:09 smithi062 ceph-mon[26920]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:10.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:09 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/328722272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:10.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:09 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:10.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:09 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:34:10.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:09 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:34:10.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:09 smithi062 ceph-mon[26920]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:10.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.288+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 --> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf0404bed0 con 0x7fceec078290 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.290+0000 7fcf00ff9700 1 -- 172.21.15.62:0/2945400556 <== mgr.14678 v2:172.21.15.62:6800/4286057884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fcf0404bed0 con 0x7fceec078290 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "2/21 daemons upgraded", 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mon daemons", 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:34:10.271 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:34:10.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fceec078290 msgr2=0x7fceec07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fceec078290 0x7fceec07a740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcef8004890 tx=0x7fcef8009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04102de0 msgr2=0x7fcf04070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04102de0 0x7fcf04070260 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c830 tx=0x7fcef4004470 comp rx=0 tx=0).stop 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 shutdown_connections 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7fceec078290 0x7fceec07a740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf04102de0 0x7fcf04070260 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 --2- 172.21.15.62:0/2945400556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf04103780 0x7fcf040707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 >> 172.21.15.62:0/2945400556 conn(0x7fcf040f8950 msgr2=0x7fcf040f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 shutdown_connections 2024-05-09T06:34:10.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.292+0000 7fcf0a938700 1 -- 172.21.15.62:0/2945400556 wait complete. 2024-05-09T06:34:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:09 smithi079 ceph-mon[35268]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:09 smithi079 ceph-mon[35268]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:09 smithi079 ceph-mon[35268]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:09 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/328722272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:09 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:09 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:34:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:09 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:34:10.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:09 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.399+0000 7f8c9d54c700 1 -- 172.21.15.62:0/4266892415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98102de0 msgr2=0x7f8c981031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.399+0000 7f8c9d54c700 1 --2- 172.21.15.62:0/4266892415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98102de0 0x7f8c981031b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8c88004940 tx=0x7f8c88009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.399+0000 7f8c9d54c700 1 -- 172.21.15.62:0/4266892415 shutdown_connections 2024-05-09T06:34:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.399+0000 7f8c9d54c700 1 --2- 172.21.15.62:0/4266892415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c98103780 0x7f8c980fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.399+0000 7f8c9d54c700 1 --2- 172.21.15.62:0/4266892415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98102de0 0x7f8c981031b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.399+0000 7f8c9d54c700 1 -- 172.21.15.62:0/4266892415 >> 172.21.15.62:0/4266892415 conn(0x7f8c980f8950 msgr2=0x7f8c980fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.399+0000 7f8c9d54c700 1 -- 172.21.15.62:0/4266892415 shutdown_connections 2024-05-09T06:34:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.399+0000 7f8c9d54c700 1 -- 172.21.15.62:0/4266892415 wait complete. 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c9d54c700 1 Processor -- start 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c9d54c700 1 -- start start 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c9d54c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c98102de0 0x7f8c98113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c9d54c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98103780 0x7f8c981140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c9d54c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98114700 con 0x7f8c98103780 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c9d54c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9810daf0 con 0x7f8c98102de0 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c967fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98103780 0x7f8c981140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c967fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98103780 0x7f8c981140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59424/0 (socket says 172.21.15.62:59424) 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c967fc700 1 -- 172.21.15.62:0/1446413120 learned_addr learned my addr 172.21.15.62:0/1446413120 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c96ffd700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c98102de0 0x7f8c98113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c967fc700 1 -- 172.21.15.62:0/1446413120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c98102de0 msgr2=0x7f8c98113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c967fc700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c98102de0 0x7f8c98113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c967fc700 1 -- 172.21.15.62:0/1446413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c88005040 con 0x7f8c98103780 2024-05-09T06:34:10.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.400+0000 7f8c967fc700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98103780 0x7f8c981140b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c80002a50 tx=0x7f8c80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:10.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.401+0000 7f8c8f7fe700 1 -- 172.21.15.62:0/1446413120 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c80007cc0 con 0x7f8c98103780 2024-05-09T06:34:10.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.401+0000 7f8c8f7fe700 1 -- 172.21.15.62:0/1446413120 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c8000f040 con 0x7f8c98103780 2024-05-09T06:34:10.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.401+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9810ddd0 con 0x7f8c98103780 2024-05-09T06:34:10.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.401+0000 7f8c8f7fe700 1 -- 172.21.15.62:0/1446413120 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c8000d9c0 con 0x7f8c98103780 2024-05-09T06:34:10.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.401+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9810e390 con 0x7f8c98103780 2024-05-09T06:34:10.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.402+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c981000f0 con 0x7f8c98103780 2024-05-09T06:34:10.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.403+0000 7f8c8f7fe700 1 -- 172.21.15.62:0/1446413120 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 32) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f8c80009730 con 0x7f8c98103780 2024-05-09T06:34:10.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.403+0000 7f8c8f7fe700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c84078290 0x7f8c8407a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:10.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.403+0000 7f8c8f7fe700 1 -- 172.21.15.62:0/1446413120 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8c80099a30 con 0x7f8c98103780 2024-05-09T06:34:10.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.403+0000 7f8c96ffd700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c84078290 0x7f8c8407a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:10.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.404+0000 7f8c96ffd700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c84078290 0x7f8c8407a740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c88004f90 tx=0x7f8c88009e30 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:10.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.408+0000 7f8c8f7fe700 1 -- 172.21.15.62:0/1446413120 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f8c80061ef0 con 0x7f8c98103780 2024-05-09T06:34:10.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.715+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8c9810f1f0 con 0x7f8c98103780 2024-05-09T06:34:10.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.715+0000 7f8c8f7fe700 1 -- 172.21.15.62:0/1446413120 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f8c80061890 con 0x7f8c98103780 2024-05-09T06:34:10.697 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:10.697 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:10.697 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:34:10.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.717+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c84078290 msgr2=0x7f8c8407a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:10.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.717+0000 7f8c9d54c700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c84078290 0x7f8c8407a740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c88004f90 tx=0x7f8c88009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:10.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.717+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98103780 msgr2=0x7f8c981140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:10.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.717+0000 7f8c9d54c700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98103780 0x7f8c981140b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c80002a50 tx=0x7f8c80004600 comp rx=0 tx=0).stop 2024-05-09T06:34:10.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.717+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 shutdown_connections 2024-05-09T06:34:10.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.718+0000 7f8c9d54c700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:6800/4286057884,v1:172.21.15.62:6801/4286057884] conn(0x7f8c84078290 0x7f8c8407a740 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.718+0000 7f8c9d54c700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c98102de0 0x7f8c98113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.718+0000 7f8c9d54c700 1 --2- 172.21.15.62:0/1446413120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c98103780 0x7f8c981140b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:10.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.718+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 >> 172.21.15.62:0/1446413120 conn(0x7f8c980f8950 msgr2=0x7f8c981073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:10.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.718+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 shutdown_connections 2024-05-09T06:34:10.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:10.718+0000 7f8c9d54c700 1 -- 172.21.15.62:0/1446413120 wait complete. 2024-05-09T06:34:11.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:10 smithi062 ceph-mon[26920]: Upgrade: Updating mon.smithi062 2024-05-09T06:34:11.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:10 smithi062 ceph-mon[26920]: Deploying daemon mon.smithi062 on smithi062 2024-05-09T06:34:11.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:10 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/2829410138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:34:11.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:10 smithi062 ceph-mon[26920]: pgmap v88: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:11.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:10 smithi062 ceph-mon[26920]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:11.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:10 smithi062 ceph-mon[26920]: from='client.? 172.21.15.62:0/1446413120' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:34:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:10 smithi079 ceph-mon[35268]: Upgrade: Updating mon.smithi062 2024-05-09T06:34:11.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:10 smithi079 ceph-mon[35268]: Deploying daemon mon.smithi062 on smithi062 2024-05-09T06:34:11.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:10 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/2829410138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:34:11.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:10 smithi079 ceph-mon[35268]: pgmap v88: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:11.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:10 smithi079 ceph-mon[35268]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:11.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:10 smithi079 ceph-mon[35268]: from='client.? 172.21.15.62:0/1446413120' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:34:11.773 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:11 smithi062 systemd[1]: Stopping Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:34:12.098 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:11 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[26916]: 2024-05-09T06:34:11.791+0000 7f2b2023d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi062 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:34:12.098 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:11 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[26916]: 2024-05-09T06:34:11.791+0000 7f2b2023d700 -1 mon.smithi062@0(leader) e2 *** Got Signal Terminated *** 2024-05-09T06:34:12.098 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:11 smithi062 podman[109418]: 2024-05-09 06:34:11.832853752 +0000 UTC m=+0.150106974 container died 38521dd7b3dd2ad3cb6c6db7f5aff0de4d93eaa01d6a2ceda8989931746be310 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=quincy-4ba5a83, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-09T06:34:12.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:12 smithi062 podman[109418]: 2024-05-09 06:34:12.208407304 +0000 UTC m=+0.525660578 container cleanup 38521dd7b3dd2ad3cb6c6db7f5aff0de4d93eaa01d6a2ceda8989931746be310 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-4ba5a83, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-09T06:34:12.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:12 smithi062 bash[109418]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062 2024-05-09T06:34:12.838 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:12 smithi062 podman[109443]: 2024-05-09 06:34:12.46787658 +0000 UTC m=+0.628387263 container remove 38521dd7b3dd2ad3cb6c6db7f5aff0de4d93eaa01d6a2ceda8989931746be310 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=quincy-4ba5a83, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-09T06:34:12.838 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:12 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062.service: Deactivated successfully. 2024-05-09T06:34:12.838 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:12 smithi062 systemd[1]: Stopped Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:34:12.838 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:12 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062.service: Consumed 14.174s CPU time. 2024-05-09T06:34:13.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:12 smithi062 systemd[1]: Starting Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:34:13.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 podman[109572]: 2024-05-09 06:34:13.07713775 +0000 UTC m=+0.113204566 container create e633b5f5dc2db18ac1ffceb1a74333ad1f6e1fb430b20429b8df1a9c004a1381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-09T06:34:13.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 podman[109572]: 2024-05-09 06:34:12.983178003 +0000 UTC m=+0.019244833 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:34:13.485 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 podman[109572]: 2024-05-09 06:34:13.313230707 +0000 UTC m=+0.349297522 container init e633b5f5dc2db18ac1ffceb1a74333ad1f6e1fb430b20429b8df1a9c004a1381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 podman[109572]: 2024-05-09 06:34:13.316607446 +0000 UTC m=+0.352674267 container start e633b5f5dc2db18ac1ffceb1a74333ad1f6e1fb430b20429b8df1a9c004a1381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, ceph=True) 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev), process ceph-mon, pid 2 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: pidfile_write: ignore empty --pid-file 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: load: jerasure load: lrc 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: RocksDB version: 7.9.2 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Git sha 0 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Compile date 2024-05-08 16:28:29 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: DB SUMMARY 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: DB Session ID: 1X6AQZUCKCTQEKYMYYQ0 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: CURRENT file: CURRENT 2024-05-09T06:34:13.486 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1166 Bytes 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi062/store.db dir, Total Num: 1, files: 000033.sst 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi062/store.db: 000031.log size: 2136726 ; 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.error_if_exists: 0 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.create_if_missing: 0 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.paranoid_checks: 1 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.env: 0x5587f6518cc0 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.info_log: 0x5587f6e87ca0 2024-05-09T06:34:13.487 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T06:34:13.489 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.statistics: (nil) 2024-05-09T06:34:13.489 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.use_fsync: 0 2024-05-09T06:34:13.489 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_log_file_size: 0 2024-05-09T06:34:13.489 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T06:34:13.489 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.allow_fallocate: 1 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.use_direct_reads: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.db_log_dir: 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.wal_dir: 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T06:34:13.490 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.write_buffer_manager: 0x5587f6e590e0 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T06:34:13.491 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.unordered_write: 0 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.row_cache: None 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.wal_filter: None 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.two_write_queues: 0 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.wal_compression: 0 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.atomic_flush: 0 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T06:34:13.492 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.log_readahead_size: 0 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_background_jobs: 2 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_background_compactions: -1 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_subcompactions: 1 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T06:34:13.493 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_open_files: -1 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_background_flushes: -1 2024-05-09T06:34:13.494 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Compression algorithms supported: 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: kZSTD supported: 0 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: kXpressCompression supported: 0 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: kZlibCompression supported: 1 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: kSnappyCompression supported: 1 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: kLZ4Compression supported: 1 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: kBZip2Compression supported: 0 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi062/store.db/MANIFEST-000015 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T06:34:13.495 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.merge_operator: 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_filter: None 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5587f6e87e60) 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: cache_index_and_filter_blocks: 1 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: pin_top_level_index_and_filter: 1 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: index_type: 0 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: data_block_index_type: 0 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: index_shortening: 1 2024-05-09T06:34:13.496 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: checksum: 4 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: no_block_cache: 0 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_cache: 0x5587f6e8b1f0 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_cache_name: BinnedLRUCache 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_cache_options: 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: capacity : 536870912 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: num_shard_bits : 4 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: strict_capacity_limit : 0 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: high_pri_pool_ratio: 0.000 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_cache_compressed: (nil) 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: persistent_cache: (nil) 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_size: 4096 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_size_deviation: 10 2024-05-09T06:34:13.497 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_restart_interval: 16 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: index_block_restart_interval: 1 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: metadata_block_size: 4096 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: partition_filters: 0 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: use_delta_encoding: 1 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: filter_policy: bloomfilter 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: whole_key_filtering: 1 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: verify_compression: 0 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: read_amp_bytes_per_bit: 0 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: format_version: 5 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: enable_index_compression: 1 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: block_align: 0 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: max_auto_readahead_size: 262144 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: prepopulate_block_cache: 0 2024-05-09T06:34:13.498 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: initial_auto_readahead_size: 8192 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression: NoCompression 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.num_levels: 7 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T06:34:13.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T06:34:13.500 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T06:34:13.501 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T06:34:13.502 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.inplace_update_support: 0 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.bloom_locality: 0 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.max_successive_merges: 0 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T06:34:13.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.ttl: 2592000 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.enable_blob_files: false 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.min_blob_size: 0 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T06:34:13.504 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi062/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 11931, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0ee30597-1af3-45f3-b760-77dc22f49f53 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236453348455, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236453358945, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 1878411, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11925, "largest_seqno": 13513, "table_properties": {"data_size": 1870962, "index_size": 4615, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1797, "raw_key_size": 16722, "raw_average_key_size": 23, "raw_value_size": 1855839, "raw_average_value_size": 2613, "num_data_blocks": 211, "num_entries": 710, "num_filter_entries": 710, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715236453, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0ee30597-1af3-45f3-b760-77dc22f49f53", "db_session_id": "1X6AQZUCKCTQEKYMYYQ0", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236453359057, "job": 1, "event": "recovery_finished"} 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T06:34:13.505 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi062/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5587f6fa8000 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: DB pointer 0x5587f6f92000 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** DB Stats ** 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.506 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** Compaction Stats [default] ** 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: L0 1/0 1.79 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 375.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: L6 1/0 6.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Sum 2/0 8.53 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 375.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 375.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** Compaction Stats [default] ** 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 375.6 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.507 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Cumulative compaction: 0.00 GB write, 128.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Interval compaction: 0.00 GB write, 128.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Block cache BinnedLRUCache@0x5587f6e8b1f0#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: starting mon.smithi062 rank 0 at public addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] at bind addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi062 fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:34:13.508 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: mon.smithi062@-1(???) e2 preinit fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: mon.smithi062@-1(???).mds e14 new map 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: mon.smithi062@-1(???).mds e14 print_map 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: e14 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: legacy client fscid: 1 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Filesystem 'cephfs' (1) 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: fs_name cephfs 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: epoch 13 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:34:13.509 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: tableserver 0 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: root 0 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: session_timeout 60 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: session_autoclose 300 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: max_file_size 1099511627776 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: max_xattr_size 65536 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: required_client_features {} 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: last_failure 0 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: last_failure_osd_epoch 0 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: max_mds 1 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: in 0 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: up {0=14484} 2024-05-09T06:34:13.510 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: failed 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: damaged 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: stopped 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: data_pools [3] 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: metadata_pool 2 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: inline_data enabled 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: balancer 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: bal_rank_mask -1 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: standby_count_wanted 1 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: qdb_cluster leader: 0 members: 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: [mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: Standby daemons: 2024-05-09T06:34:13.511 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: [mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: [mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout: [mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: mon.smithi062@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: mon.smithi062@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: mon.smithi062@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: mon.smithi062@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 ceph-mon[109590]: mon.smithi062@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 bash[109572]: e633b5f5dc2db18ac1ffceb1a74333ad1f6e1fb430b20429b8df1a9c004a1381 2024-05-09T06:34:13.512 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:13 smithi062 systemd[1]: Started Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: pgmap v89: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: pgmap v90: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: pgmap v91: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: mon.smithi062 calling monitor election 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: mon.smithi062 is new leader, mons smithi062,smithi079 in quorum (ranks 0,1) 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: monmap epoch 2 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: last_changed 2024-05-09T06:22:53.813597+0000 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: created 2024-05-09T06:19:53.187818+0000 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: min_mon_release 17 (quincy) 2024-05-09T06:34:16.745 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: election_strategy: 1 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.smithi062 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: 1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.smithi079 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: mgrmap e32: smithi062.juuasl(active, since 2m), standbys: smithi079.genyri 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: from='mgr.14678 ' entity='' 2024-05-09T06:34:16.746 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:16 smithi079 ceph-mon[35268]: mgrmap e33: smithi062.juuasl(active, since 2m), standbys: smithi079.genyri 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: from='mgr.14678 172.21.15.62:0/3865292129' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: pgmap v89: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: pgmap v90: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: pgmap v91: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: mon.smithi062 calling monitor election 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: mon.smithi062 is new leader, mons smithi062,smithi079 in quorum (ranks 0,1) 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: monmap epoch 2 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: last_changed 2024-05-09T06:22:53.813597+0000 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: created 2024-05-09T06:19:53.187818+0000 2024-05-09T06:34:16.763 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: min_mon_release 17 (quincy) 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: election_strategy: 1 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.smithi062 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: 1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.smithi079 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: mgrmap e32: smithi062.juuasl(active, since 2m), standbys: smithi079.genyri 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: from='mgr.14678 ' entity='' 2024-05-09T06:34:16.764 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:16 smithi062 ceph-mon[109590]: mgrmap e33: smithi062.juuasl(active, since 2m), standbys: smithi079.genyri 2024-05-09T06:34:23.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:23 smithi079 ceph-mon[35268]: Standby manager daemon smithi079.genyri restarted 2024-05-09T06:34:23.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:23 smithi079 ceph-mon[35268]: Standby manager daemon smithi079.genyri started 2024-05-09T06:34:23.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:23 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/654154899' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:34:23.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:23 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/654154899' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:34:23.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:23 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/654154899' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:34:23.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:23 smithi079 ceph-mon[35268]: from='mgr.? 172.21.15.79:0/654154899' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:34:23.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:23 smithi062 ceph-mon[109590]: Standby manager daemon smithi079.genyri restarted 2024-05-09T06:34:23.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:23 smithi062 ceph-mon[109590]: Standby manager daemon smithi079.genyri started 2024-05-09T06:34:23.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:23 smithi062 ceph-mon[109590]: from='mgr.? 172.21.15.79:0/654154899' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/crt"}]: dispatch 2024-05-09T06:34:23.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:23 smithi062 ceph-mon[109590]: from='mgr.? 172.21.15.79:0/654154899' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:34:23.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:23 smithi062 ceph-mon[109590]: from='mgr.? 172.21.15.79:0/654154899' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.genyri/key"}]: dispatch 2024-05-09T06:34:23.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:23 smithi062 ceph-mon[109590]: from='mgr.? 172.21.15.79:0/654154899' entity='mgr.smithi079.genyri' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:34:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: mgrmap e34: smithi062.juuasl(active, since 3m), standbys: smithi079.genyri 2024-05-09T06:34:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: Active manager daemon smithi062.juuasl restarted 2024-05-09T06:34:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: Activating manager daemon smithi062.juuasl 2024-05-09T06:34:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:34:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: mgrmap e35: smithi062.juuasl(active, starting, since 0.00967654s), standbys: smithi079.genyri 2024-05-09T06:34:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi079.genyri", "id": "smithi079.genyri"}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:34:24.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:34:24.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:34:24.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:34:24.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: Manager daemon smithi062.juuasl is now available 2024-05-09T06:34:24.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:24.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:24.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:34:24.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:24 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/trash_purge_schedule"}]: dispatch 2024-05-09T06:34:24.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: mgrmap e34: smithi062.juuasl(active, since 3m), standbys: smithi079.genyri 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: Active manager daemon smithi062.juuasl restarted 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: Activating manager daemon smithi062.juuasl 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: mgrmap e35: smithi062.juuasl(active, starting, since 0.00967654s), standbys: smithi079.genyri 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:34:24.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi062.juuasl", "id": "smithi062.juuasl"}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr metadata", "who": "smithi079.genyri", "id": "smithi079.genyri"}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: Manager daemon smithi062.juuasl is now available 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:34:24.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi062.juuasl/trash_purge_schedule"}]: dispatch 2024-05-09T06:34:26.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:25 smithi079 ceph-mon[35268]: mgrmap e36: smithi062.juuasl(active, since 1.01296s), standbys: smithi079.genyri 2024-05-09T06:34:26.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:25 smithi079 ceph-mon[35268]: [09/May/2024:06:34:25] ENGINE Bus STARTING 2024-05-09T06:34:26.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:25 smithi079 ceph-mon[35268]: [09/May/2024:06:34:25] ENGINE Serving on http://172.21.15.62:8765 2024-05-09T06:34:26.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:25 smithi079 ceph-mon[35268]: [09/May/2024:06:34:25] ENGINE Serving on https://172.21.15.62:7150 2024-05-09T06:34:26.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:25 smithi079 ceph-mon[35268]: [09/May/2024:06:34:25] ENGINE Bus STARTED 2024-05-09T06:34:26.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:25 smithi062 ceph-mon[109590]: mgrmap e36: smithi062.juuasl(active, since 1.01296s), standbys: smithi079.genyri 2024-05-09T06:34:26.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:25 smithi062 ceph-mon[109590]: [09/May/2024:06:34:25] ENGINE Bus STARTING 2024-05-09T06:34:26.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:25 smithi062 ceph-mon[109590]: [09/May/2024:06:34:25] ENGINE Serving on http://172.21.15.62:8765 2024-05-09T06:34:26.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:25 smithi062 ceph-mon[109590]: [09/May/2024:06:34:25] ENGINE Serving on https://172.21.15.62:7150 2024-05-09T06:34:26.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:25 smithi062 ceph-mon[109590]: [09/May/2024:06:34:25] ENGINE Bus STARTED 2024-05-09T06:34:27.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:26 smithi079 ceph-mon[35268]: pgmap v4: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:27.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:26 smithi079 ceph-mon[35268]: mgrmap e37: smithi062.juuasl(active, since 2s), standbys: smithi079.genyri 2024-05-09T06:34:27.381 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:26 smithi062 ceph-mon[109590]: pgmap v4: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:27.381 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:26 smithi062 ceph-mon[109590]: mgrmap e37: smithi062.juuasl(active, since 2s), standbys: smithi079.genyri 2024-05-09T06:34:28.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:28 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:28.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:28 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:28.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:28 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:28.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:28 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:29.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:29 smithi079 ceph-mon[35268]: pgmap v5: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:29.668 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:29 smithi079 ceph-mon[35268]: mgrmap e38: smithi062.juuasl(active, since 4s), standbys: smithi079.genyri 2024-05-09T06:34:29.668 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:29 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:29.668 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:29 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:29.669 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:29 smithi062 ceph-mon[109590]: pgmap v5: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:29.669 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:29 smithi062 ceph-mon[109590]: mgrmap e38: smithi062.juuasl(active, since 4s), standbys: smithi079.genyri 2024-05-09T06:34:29.669 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:29.669 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:30.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:30 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:30.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:30 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:30.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:30 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:30.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:30 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:31.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:31 smithi062 ceph-mon[109590]: pgmap v6: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:31.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:31 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:31.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:31 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:31.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:31 smithi079 ceph-mon[35268]: pgmap v6: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:31.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:31 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:31.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:31 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:33.804 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:33 smithi062 ceph-mon[109590]: pgmap v7: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-09T06:34:33.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:33 smithi079 ceph-mon[35268]: pgmap v7: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-09T06:34:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:35 smithi079 ceph-mon[35268]: pgmap v8: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-09T06:34:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:35 smithi079 ceph-mon[35268]: Detected new or changed devices on smithi062 2024-05-09T06:34:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:35 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:35 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:35 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:35 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:35 smithi079 ceph-mon[35268]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:34:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:35 smithi079 ceph-mon[35268]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:34:35.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:35 smithi062 ceph-mon[109590]: pgmap v8: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-09T06:34:35.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:35 smithi062 ceph-mon[109590]: Detected new or changed devices on smithi062 2024-05-09T06:34:35.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:35.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:35.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:35.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:35.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:35 smithi062 ceph-mon[109590]: Updating smithi062:/etc/ceph/ceph.conf 2024-05-09T06:34:35.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:35 smithi062 ceph-mon[109590]: Updating smithi079:/etc/ceph/ceph.conf 2024-05-09T06:34:36.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:36.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:36.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:36 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: Updating smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: Updating smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:36.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:36.847 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:36.847 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:36 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T06:34:37.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:37 smithi062 ceph-mon[109590]: pgmap v9: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-09T06:34:37.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:37 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:37.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:37 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:34:37.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:37 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:34:37.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:37 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:37.681 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:37 smithi079 ceph-mon[35268]: pgmap v9: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-09T06:34:37.681 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:37 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:37.681 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:37 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:34:37.681 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:37 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:34:37.681 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:37 smithi079 ceph-mon[35268]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:38.630 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:38 smithi079 ceph-mon[35268]: Upgrade: Updating mon.smithi079 2024-05-09T06:34:38.630 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:38 smithi079 ceph-mon[35268]: Deploying daemon mon.smithi079 on smithi079 2024-05-09T06:34:38.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:38 smithi062 ceph-mon[109590]: Upgrade: Updating mon.smithi079 2024-05-09T06:34:38.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:38 smithi062 ceph-mon[109590]: Deploying daemon mon.smithi079 on smithi079 2024-05-09T06:34:39.161 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:38 smithi079 systemd[1]: Stopping Ceph mon.smithi079 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:34:39.161 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:39 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079[35254]: 2024-05-09T06:34:39.170+0000 7f40aaed5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi079 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:34:39.161 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:39 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079[35254]: 2024-05-09T06:34:39.170+0000 7f40aaed5700 -1 mon.smithi079@1(peon) e2 *** Got Signal Terminated *** 2024-05-09T06:34:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:39 smithi079 podman[82217]: 2024-05-09 06:34:39.354470777 +0000 UTC m=+0.282346657 container died 9b09bacca849e219def7c44ba218d9601f04c64c8a63e5e54fe7140c10d2be79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-4ba5a83, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-09T06:34:39.968 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:39 smithi079 podman[82217]: 2024-05-09 06:34:39.720169162 +0000 UTC m=+0.648045031 container cleanup 9b09bacca849e219def7c44ba218d9601f04c64c8a63e5e54fe7140c10d2be79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4ba5a83, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-09T06:34:39.968 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:39 smithi079 bash[82217]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079 2024-05-09T06:34:40.324 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:39 smithi079 podman[82231]: 2024-05-09 06:34:39.988330595 +0000 UTC m=+0.629415304 container remove 9b09bacca849e219def7c44ba218d9601f04c64c8a63e5e54fe7140c10d2be79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-4ba5a83, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-09T06:34:40.324 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi079.service: Deactivated successfully. 2024-05-09T06:34:40.324 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 systemd[1]: Stopped Ceph mon.smithi079 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:34:40.324 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi079.service: Consumed 6.779s CPU time. 2024-05-09T06:34:40.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 systemd[1]: Starting Ceph mon.smithi079 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:34:40.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 podman[82363]: 2024-05-09 06:34:40.462704944 +0000 UTC m=+0.018052125 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:34:40.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 podman[82363]: 2024-05-09 06:34:40.564179276 +0000 UTC m=+0.119526451 container create bf2cbd432c7c4f20a738bfec595fafa4a20670ace1f836abc24535daffa8c78d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-09T06:34:40.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.840+0000 7fe378201700 1 -- 172.21.15.62:0/2106518555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 msgr2=0x7fe3701031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:40.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.840+0000 7fe378201700 1 --2- 172.21.15.62:0/2106518555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 0x7fe3701031b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe360004940 tx=0x7fe360009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:40.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.840+0000 7fe378201700 1 -- 172.21.15.62:0/2106518555 shutdown_connections 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.840+0000 7fe378201700 1 --2- 172.21.15.62:0/2106518555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370103780 0x7fe3700fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.840+0000 7fe378201700 1 --2- 172.21.15.62:0/2106518555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 0x7fe3701031b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.840+0000 7fe378201700 1 -- 172.21.15.62:0/2106518555 >> 172.21.15.62:0/2106518555 conn(0x7fe3700f8990 msgr2=0x7fe3700fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.840+0000 7fe378201700 1 -- 172.21.15.62:0/2106518555 shutdown_connections 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.840+0000 7fe378201700 1 -- 172.21.15.62:0/2106518555 wait complete. 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe378201700 1 Processor -- start 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe378201700 1 -- start start 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe378201700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 0x7fe370113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe378201700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370103780 0x7fe370113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe378201700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3701144f0 con 0x7fe370102de0 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe378201700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37010daf0 con 0x7fe370103780 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe375f9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 0x7fe370113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe375f9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 0x7fe370113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58932/0 (socket says 172.21.15.62:58932) 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe375f9d700 1 -- 172.21.15.62:0/1894330368 learned_addr learned my addr 172.21.15.62:0/1894330368 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe37579c700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370103780 0x7fe370113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:40.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.841+0000 7fe375f9d700 1 -- 172.21.15.62:0/1894330368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370103780 msgr2=0x7fe370113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.842+0000 7fe375f9d700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370103780 0x7fe370113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.842+0000 7fe375f9d700 1 -- 172.21.15.62:0/1894330368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360005040 con 0x7fe370102de0 2024-05-09T06:34:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.842+0000 7fe375f9d700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 0x7fe370113960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe36000b3b0 tx=0x7fe360009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.842+0000 7fe3667fc700 1 -- 172.21.15.62:0/1894330368 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe36000e040 con 0x7fe370102de0 2024-05-09T06:34:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.842+0000 7fe3667fc700 1 -- 172.21.15.62:0/1894330368 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe36000bbc0 con 0x7fe370102de0 2024-05-09T06:34:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.842+0000 7fe3667fc700 1 -- 172.21.15.62:0/1894330368 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe36001c3f0 con 0x7fe370102de0 2024-05-09T06:34:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.842+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37010dd70 con 0x7fe370102de0 2024-05-09T06:34:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.842+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37010e2e0 con 0x7fe370102de0 2024-05-09T06:34:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.843+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3701000f0 con 0x7fe370102de0 2024-05-09T06:34:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.844+0000 7fe3667fc700 1 -- 172.21.15.62:0/1894330368 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fe36000bd30 con 0x7fe370102de0 2024-05-09T06:34:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.844+0000 7fe3667fc700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe35c078aa0 0x7fe35c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.844+0000 7fe3667fc700 1 -- 172.21.15.62:0/1894330368 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe36009bbe0 con 0x7fe370102de0 2024-05-09T06:34:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.844+0000 7fe37579c700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe35c078aa0 0x7fe35c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.845+0000 7fe37579c700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe35c078aa0 0x7fe35c07af50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe37010ecb0 tx=0x7fe36c009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:40.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:40.850+0000 7fe3667fc700 1 -- 172.21.15.62:0/1894330368 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fe360063680 con 0x7fe370102de0 2024-05-09T06:34:41.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.087+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe37010f020 con 0x7fe35c078aa0 2024-05-09T06:34:41.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.088+0000 7fe3667fc700 1 -- 172.21.15.62:0/1894330368 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe37010f020 con 0x7fe35c078aa0 2024-05-09T06:34:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe35c078aa0 msgr2=0x7fe35c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe35c078aa0 0x7fe35c07af50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe37010ecb0 tx=0x7fe36c009f70 comp rx=0 tx=0).stop 2024-05-09T06:34:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 msgr2=0x7fe370113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 0x7fe370113960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe36000b3b0 tx=0x7fe360009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 shutdown_connections 2024-05-09T06:34:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe35c078aa0 0x7fe35c07af50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe370102de0 0x7fe370113960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 --2- 172.21.15.62:0/1894330368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370103780 0x7fe370113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 >> 172.21.15.62:0/1894330368 conn(0x7fe3700f8990 msgr2=0x7fe3701073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:41.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 shutdown_connections 2024-05-09T06:34:41.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.091+0000 7fe378201700 1 -- 172.21.15.62:0/1894330368 wait complete. 2024-05-09T06:34:41.082 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 podman[82363]: 2024-05-09 06:34:40.775236747 +0000 UTC m=+0.330583915 container init bf2cbd432c7c4f20a738bfec595fafa4a20670ace1f836abc24535daffa8c78d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 podman[82363]: 2024-05-09 06:34:40.778443647 +0000 UTC m=+0.333790816 container start bf2cbd432c7c4f20a738bfec595fafa4a20670ace1f836abc24535daffa8c78d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev), process ceph-mon, pid 2 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: pidfile_write: ignore empty --pid-file 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: load: jerasure load: lrc 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: RocksDB version: 7.9.2 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Git sha 0 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Compile date 2024-05-08 16:28:29 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: DB SUMMARY 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: DB Session ID: 21ZWF4HMMMDDANRNPJ8W 2024-05-09T06:34:41.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: CURRENT file: CURRENT 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1091 Bytes 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi079/store.db dir, Total Num: 1, files: 000027.sst 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi079/store.db: 000025.log size: 6220786 ; 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.error_if_exists: 0 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.create_if_missing: 0 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.paranoid_checks: 1 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.env: 0x559daaf77cc0 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T06:34:41.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.info_log: 0x559dac197ca0 2024-05-09T06:34:41.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T06:34:41.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.statistics: (nil) 2024-05-09T06:34:41.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.use_fsync: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_log_file_size: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.allow_fallocate: 1 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.use_direct_reads: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T06:34:41.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.db_log_dir: 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.wal_dir: 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.write_buffer_manager: 0x559dac1690e0 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T06:34:41.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.unordered_write: 0 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.row_cache: None 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.wal_filter: None 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T06:34:41.099 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.two_write_queues: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.wal_compression: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.atomic_flush: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.log_readahead_size: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T06:34:41.100 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_background_jobs: 2 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_background_compactions: -1 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_subcompactions: 1 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T06:34:41.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_open_files: -1 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_background_flushes: -1 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Compression algorithms supported: 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: kZSTD supported: 0 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: kXpressCompression supported: 0 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: kZlibCompression supported: 1 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: kSnappyCompression supported: 1 2024-05-09T06:34:41.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: kLZ4Compression supported: 1 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: kBZip2Compression supported: 0 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi079/store.db/MANIFEST-000009 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.merge_operator: 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_filter: None 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559dac197e60) 2024-05-09T06:34:41.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: cache_index_and_filter_blocks: 1 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: pin_top_level_index_and_filter: 1 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_type: 0 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: data_block_index_type: 0 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_shortening: 1 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: checksum: 4 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: no_block_cache: 0 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache: 0x559dac19b1f0 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_name: BinnedLRUCache 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_options: 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: capacity : 536870912 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: num_shard_bits : 4 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: strict_capacity_limit : 0 2024-05-09T06:34:41.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: high_pri_pool_ratio: 0.000 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_compressed: (nil) 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: persistent_cache: (nil) 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_size: 4096 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_size_deviation: 10 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_restart_interval: 16 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_block_restart_interval: 1 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: metadata_block_size: 4096 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: partition_filters: 0 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: use_delta_encoding: 1 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: filter_policy: bloomfilter 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: whole_key_filtering: 1 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: verify_compression: 0 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: read_amp_bytes_per_bit: 0 2024-05-09T06:34:41.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: format_version: 5 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: enable_index_compression: 1 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_align: 0 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_auto_readahead_size: 262144 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: prepopulate_block_cache: 0 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: initial_auto_readahead_size: 8192 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression: NoCompression 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.num_levels: 7 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T06:34:41.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:34:41.107 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T06:34:41.108 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T06:34:41.109 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.inplace_update_support: 0 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.bloom_locality: 0 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.max_successive_merges: 0 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T06:34:41.110 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.ttl: 2592000 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.enable_blob_files: false 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.min_blob_size: 0 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T06:34:41.111 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi079/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12098, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 92f19765-1839-45f8-8de6-b253e44f8905 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236480808347, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236480823996, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3789918, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12095, "largest_seqno": 14355, "table_properties": {"data_size": 3780346, "index_size": 6158, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2373, "raw_key_size": 21801, "raw_average_key_size": 23, "raw_value_size": 3760597, "raw_average_value_size": 4061, "num_data_blocks": 279, "num_entries": 926, "num_filter_entries": 926, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715236480, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "92f19765-1839-45f8-8de6-b253e44f8905", "db_session_id": "21ZWF4HMMMDDANRNPJ8W", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236480824102, "job": 1, "event": "recovery_finished"} 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi079/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559dac2b8000 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: DB pointer 0x559dac2a2000 2024-05-09T06:34:41.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** DB Stats ** 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** Compaction Stats [default] ** 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: L0 1/0 3.61 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-05-09T06:34:41.113 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: L6 1/0 6.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Sum 2/0 10.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** Compaction Stats [default] ** 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 506.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T06:34:41.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative compaction: 0.00 GB write, 191.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval compaction: 0.00 GB write, 191.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Block cache BinnedLRUCache@0x559dac19b1f0#2 capacity: 512.00 MB usage: 9.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.53 KB,0.000482798%) IndexBlock(1,6.58 KB,0.00125468%) Misc(1,0.00 KB,0%) 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: starting mon.smithi079 rank 1 at public addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] at bind addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi079 fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: mon.smithi079@-1(???) e2 preinit fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: mon.smithi079@-1(???).mds e14 new map 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: mon.smithi079@-1(???).mds e14 print_map 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: e14 2024-05-09T06:34:41.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: legacy client fscid: 1 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Filesystem 'cephfs' (1) 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: fs_name cephfs 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: epoch 13 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: tableserver 0 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: root 0 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: session_timeout 60 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: session_autoclose 300 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_file_size 1099511627776 2024-05-09T06:34:41.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_xattr_size 65536 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: required_client_features {} 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: last_failure 0 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: last_failure_osd_epoch 0 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_mds 1 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: in 0 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: up {0=14484} 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: failed 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: damaged 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: stopped 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: data_pools [3] 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: metadata_pool 2 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: inline_data enabled 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: balancer 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: bal_rank_mask -1 2024-05-09T06:34:41.117 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: standby_count_wanted 1 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: qdb_cluster leader: 0 members: 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: [mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Standby daemons: 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: [mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: [mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: [mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: mon.smithi079@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: mon.smithi079@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: mon.smithi079@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: mon.smithi079@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 ceph-mon[82381]: mon.smithi079@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-05-09T06:34:41.118 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 bash[82363]: bf2cbd432c7c4f20a738bfec595fafa4a20670ace1f836abc24535daffa8c78d 2024-05-09T06:34:41.119 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:40 smithi079 systemd[1]: Started Ceph mon.smithi079 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:34:41.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.197+0000 7f0820363700 1 -- 172.21.15.62:0/347763326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 msgr2=0x7f08180fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.197+0000 7f0820363700 1 --2- 172.21.15.62:0/347763326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 0x7f08180fe230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0808009ce0 tx=0x7f0808004d10 comp rx=0 tx=0).stop 2024-05-09T06:34:41.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.197+0000 7f0820363700 1 -- 172.21.15.62:0/347763326 shutdown_connections 2024-05-09T06:34:41.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.197+0000 7f0820363700 1 --2- 172.21.15.62:0/347763326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08180fe800 0x7f0818106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.197+0000 7f0820363700 1 --2- 172.21.15.62:0/347763326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 0x7f08180fe230 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.197+0000 7f0820363700 1 -- 172.21.15.62:0/347763326 >> 172.21.15.62:0/347763326 conn(0x7f08180f7870 msgr2=0x7f08180f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:41.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.197+0000 7f0820363700 1 -- 172.21.15.62:0/347763326 shutdown_connections 2024-05-09T06:34:41.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.197+0000 7f0820363700 1 -- 172.21.15.62:0/347763326 wait complete. 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f0820363700 1 Processor -- start 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f0820363700 1 -- start start 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f0820363700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 0x7f0818115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f0820363700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08180fe800 0x7f0818116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f0820363700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0818116770 con 0x7f08180fde60 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f0820363700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081810fcc0 con 0x7f08180fe800 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f081e0ff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 0x7f0818115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f081e0ff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 0x7f0818115b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58940/0 (socket says 172.21.15.62:58940) 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.198+0000 7f081e0ff700 1 -- 172.21.15.62:0/979713064 learned_addr learned my addr 172.21.15.62:0/979713064 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:41.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f081d8fe700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08180fe800 0x7f0818116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f081e0ff700 1 -- 172.21.15.62:0/979713064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08180fe800 msgr2=0x7f0818116090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f081e0ff700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08180fe800 0x7f0818116090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f081e0ff700 1 -- 172.21.15.62:0/979713064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0808009940 con 0x7f08180fde60 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f081d8fe700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08180fe800 0x7f0818116090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f081e0ff700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 0x7f0818115b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0808007c00 tx=0x7f0808004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f0816ffd700 1 -- 172.21.15.62:0/979713064 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f080800e070 con 0x7f08180fde60 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f0816ffd700 1 -- 172.21.15.62:0/979713064 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f080800be70 con 0x7f08180fde60 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081810ff40 con 0x7f08180fde60 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f0816ffd700 1 -- 172.21.15.62:0/979713064 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f080801ba10 con 0x7f08180fde60 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.199+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0818110480 con 0x7f08180fde60 2024-05-09T06:34:41.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.200+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0818066ad0 con 0x7f08180fde60 2024-05-09T06:34:41.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.201+0000 7f0816ffd700 1 -- 172.21.15.62:0/979713064 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f0808019040 con 0x7f08180fde60 2024-05-09T06:34:41.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.201+0000 7f0816ffd700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0800078aa0 0x7f080007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.201+0000 7f081d8fe700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0800078aa0 0x7f080007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.201+0000 7f0816ffd700 1 -- 172.21.15.62:0/979713064 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f080809be30 con 0x7f08180fde60 2024-05-09T06:34:41.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.202+0000 7f081d8fe700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0800078aa0 0x7f080007af50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f080c006fd0 tx=0x7f080c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:41.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.206+0000 7f0816ffd700 1 -- 172.21.15.62:0/979713064 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0808063950 con 0x7f08180fde60 2024-05-09T06:34:41.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.440+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0818111210 con 0x7f0800078aa0 2024-05-09T06:34:41.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.441+0000 7f0816ffd700 1 -- 172.21.15.62:0/979713064 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f0818111210 con 0x7f0800078aa0 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0800078aa0 msgr2=0x7f080007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0800078aa0 0x7f080007af50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f080c006fd0 tx=0x7f080c008040 comp rx=0 tx=0).stop 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 msgr2=0x7f0818115b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 0x7f0818115b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0808007c00 tx=0x7f0808004d10 comp rx=0 tx=0).stop 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 shutdown_connections 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0800078aa0 0x7f080007af50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08180fde60 0x7f0818115b50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 --2- 172.21.15.62:0/979713064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08180fe800 0x7f0818116090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 >> 172.21.15.62:0/979713064 conn(0x7f08180f7870 msgr2=0x7f08180f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:41.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 shutdown_connections 2024-05-09T06:34:41.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.444+0000 7f0820363700 1 -- 172.21.15.62:0/979713064 wait complete. 2024-05-09T06:34:41.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.549+0000 7f552adc7700 1 -- 172.21.15.62:0/1274573245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5524101d90 msgr2=0x7f5524102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.549+0000 7f552adc7700 1 --2- 172.21.15.62:0/1274573245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5524101d90 0x7f5524102160 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f550c004940 tx=0x7f550c009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.549+0000 7f552adc7700 1 -- 172.21.15.62:0/1274573245 shutdown_connections 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.549+0000 7f552adc7700 1 --2- 172.21.15.62:0/1274573245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55240fbd40 0x7f55240fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.549+0000 7f552adc7700 1 --2- 172.21.15.62:0/1274573245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5524101d90 0x7f5524102160 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.549+0000 7f552adc7700 1 -- 172.21.15.62:0/1274573245 >> 172.21.15.62:0/1274573245 conn(0x7f5524071d00 msgr2=0x7f5524072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.549+0000 7f552adc7700 1 -- 172.21.15.62:0/1274573245 shutdown_connections 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.549+0000 7f552adc7700 1 -- 172.21.15.62:0/1274573245 wait complete. 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f552adc7700 1 Processor -- start 2024-05-09T06:34:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f552adc7700 1 -- start start 2024-05-09T06:34:41.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f552adc7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55240fbd40 0x7f5524102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f552adc7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5524101d90 0x7f5524103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f552adc7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55241035f0 con 0x7f55240fbd40 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f552adc7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5524103730 con 0x7f5524101d90 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f5528b63700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55240fbd40 0x7f5524102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f5528b63700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55240fbd40 0x7f5524102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58960/0 (socket says 172.21.15.62:58960) 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f5528b63700 1 -- 172.21.15.62:0/4065918412 learned_addr learned my addr 172.21.15.62:0/4065918412 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f5528b63700 1 -- 172.21.15.62:0/4065918412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5524101d90 msgr2=0x7f5524103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f5523fff700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5524101d90 0x7f5524103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.550+0000 7f5528b63700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5524101d90 0x7f5524103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.551+0000 7f5528b63700 1 -- 172.21.15.62:0/4065918412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c005040 con 0x7f55240fbd40 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.551+0000 7f5528b63700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55240fbd40 0x7f5524102b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f550c009180 tx=0x7f550c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.551+0000 7f55217fa700 1 -- 172.21.15.62:0/4065918412 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f550c00e040 con 0x7f55240fbd40 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.551+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5524103980 con 0x7f55240fbd40 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.551+0000 7f55217fa700 1 -- 172.21.15.62:0/4065918412 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f550c00bc90 con 0x7f55240fbd40 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.551+0000 7f55217fa700 1 -- 172.21.15.62:0/4065918412 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f550c01c630 con 0x7f55240fbd40 2024-05-09T06:34:41.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.551+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552411a2d0 con 0x7f55240fbd40 2024-05-09T06:34:41.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.552+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55240fd430 con 0x7f55240fbd40 2024-05-09T06:34:41.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.553+0000 7f55217fa700 1 -- 172.21.15.62:0/4065918412 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f550c013980 con 0x7f55240fbd40 2024-05-09T06:34:41.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.553+0000 7f55217fa700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5510078aa0 0x7f551007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.553+0000 7f55217fa700 1 -- 172.21.15.62:0/4065918412 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f550c09be50 con 0x7f55240fbd40 2024-05-09T06:34:41.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.553+0000 7f5523fff700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5510078aa0 0x7f551007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.554+0000 7f5523fff700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5510078aa0 0x7f551007af50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5524104460 tx=0x7f5514009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:41.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.558+0000 7f55217fa700 1 -- 172.21.15.62:0/4065918412 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f550c0638d0 con 0x7f55240fbd40 2024-05-09T06:34:41.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.781+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5524104210 con 0x7f5510078aa0 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.792+0000 7f55217fa700 1 -- 172.21.15.62:0/4065918412 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5524104210 con 0x7f5510078aa0 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (113s) 12s ago 13m 14.8M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (13m) 12s ago 13m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (12m) 14s ago 12m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (88s) 12s ago 12m 76.6M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (7m) 12s ago 7m 15.7M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (7m) 12s ago 7m 153M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (7m) 14s ago 7m 15.1M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (7m) 14s ago 7m 15.0M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (3m) 12s ago 14m 487M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:34:41.773 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (2m) 14s ago 11m 461M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (28s) 12s ago 14m 29.5M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 starting - - - 2048M 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (2m) 12s ago 13m 15.2M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (2m) 14s ago 11m 16.0M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (11m) 12s ago 11m 246M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (10m) 12s ago 10m 262M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (10m) 12s ago 10m 220M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (9m) 14s ago 9m 282M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (9m) 14s ago 9m 252M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (8m) 14s ago 8m 247M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:34:41.774 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (2m) 12s ago 12m 61.4M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:34:41.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5510078aa0 msgr2=0x7f551007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5510078aa0 0x7f551007af50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5524104460 tx=0x7f5514009040 comp rx=0 tx=0).stop 2024-05-09T06:34:41.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55240fbd40 msgr2=0x7f5524102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55240fbd40 0x7f5524102b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f550c009180 tx=0x7f550c009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 shutdown_connections 2024-05-09T06:34:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5510078aa0 0x7f551007af50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55240fbd40 0x7f5524102b20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 --2- 172.21.15.62:0/4065918412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5524101d90 0x7f5524103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 >> 172.21.15.62:0/4065918412 conn(0x7f5524071d00 msgr2=0x7f55240fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 shutdown_connections 2024-05-09T06:34:41.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.794+0000 7f552adc7700 1 -- 172.21.15.62:0/4065918412 wait complete. 2024-05-09T06:34:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.898+0000 7fc69d9cb700 1 -- 172.21.15.62:0/20473489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 msgr2=0x7fc698102100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.898+0000 7fc69d9cb700 1 --2- 172.21.15.62:0/20473489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 0x7fc698102100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc688004940 tx=0x7fc688009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.898+0000 7fc69d9cb700 1 -- 172.21.15.62:0/20473489 shutdown_connections 2024-05-09T06:34:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.898+0000 7fc69d9cb700 1 --2- 172.21.15.62:0/20473489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 0x7fc6980fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.898+0000 7fc69d9cb700 1 --2- 172.21.15.62:0/20473489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 0x7fc698102100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.898+0000 7fc69d9cb700 1 -- 172.21.15.62:0/20473489 >> 172.21.15.62:0/20473489 conn(0x7fc698073350 msgr2=0x7fc698073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.898+0000 7fc69d9cb700 1 -- 172.21.15.62:0/20473489 shutdown_connections 2024-05-09T06:34:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.899+0000 7fc69d9cb700 1 -- 172.21.15.62:0/20473489 wait complete. 2024-05-09T06:34:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.899+0000 7fc69d9cb700 1 Processor -- start 2024-05-09T06:34:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.899+0000 7fc69d9cb700 1 -- start start 2024-05-09T06:34:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc69d9cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 0x7fc698112900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc69d9cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 0x7fc698112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc69d9cb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc698113490 con 0x7fc698101d30 2024-05-09T06:34:41.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc69d9cb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69810ca90 con 0x7fc6981026d0 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc696ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 0x7fc698112900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc696ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 0x7fc698112900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58970/0 (socket says 172.21.15.62:58970) 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc696ffd700 1 -- 172.21.15.62:0/2100485996 learned_addr learned my addr 172.21.15.62:0/2100485996 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc6967fc700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 0x7fc698112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc6967fc700 1 -- 172.21.15.62:0/2100485996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 msgr2=0x7fc698112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc6967fc700 1 -- 172.21.15.62:0/2100485996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 msgr2=0x7fc698112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc6967fc700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 0x7fc698112e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc696ffd700 1 -- 172.21.15.62:0/2100485996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 msgr2=0x7fc698112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc6967fc700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 0x7fc698112e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc696ffd700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 0x7fc698112e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc696ffd700 1 -- 172.21.15.62:0/2100485996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc688005040 con 0x7fc698101d30 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc696ffd700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 0x7fc698112900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc688009180 tx=0x7fc688009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.900+0000 7fc67f7fe700 1 -- 172.21.15.62:0/2100485996 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68800e040 con 0x7fc698101d30 2024-05-09T06:34:41.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.901+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69810cc30 con 0x7fc698101d30 2024-05-09T06:34:41.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.901+0000 7fc67f7fe700 1 -- 172.21.15.62:0/2100485996 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc68800bbc0 con 0x7fc698101d30 2024-05-09T06:34:41.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.901+0000 7fc67f7fe700 1 -- 172.21.15.62:0/2100485996 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68801c630 con 0x7fc698101d30 2024-05-09T06:34:41.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.901+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69810d170 con 0x7fc698101d30 2024-05-09T06:34:41.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.902+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6980fd490 con 0x7fc698101d30 2024-05-09T06:34:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.902+0000 7fc67f7fe700 1 -- 172.21.15.62:0/2100485996 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fc68800bd30 con 0x7fc698101d30 2024-05-09T06:34:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.903+0000 7fc67f7fe700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc680078aa0 0x7fc68007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.903+0000 7fc67f7fe700 1 -- 172.21.15.62:0/2100485996 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc68809bcf0 con 0x7fc698101d30 2024-05-09T06:34:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.903+0000 7fc6967fc700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc680078aa0 0x7fc68007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.903+0000 7fc6967fc700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc680078aa0 0x7fc68007af50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc68c007fd0 tx=0x7fc68c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:41.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:41.907+0000 7fc67f7fe700 1 -- 172.21.15.62:0/2100485996 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc688063810 con 0x7fc698101d30 2024-05-09T06:34:42.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.217+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc6980fd490 con 0x7fc698101d30 2024-05-09T06:34:42.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.218+0000 7fc67f7fe700 1 -- 172.21.15.62:0/2100485996 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7fc6880631b0 con 0x7fc698101d30 2024-05-09T06:34:42.199 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:34:42.199 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:34:42.199 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:34:42.199 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:34:42.199 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:34:42.199 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:34:42.199 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 11, 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 3 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:34:42.200 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.220+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc680078aa0 msgr2=0x7fc68007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.220+0000 7fc69d9cb700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc680078aa0 0x7fc68007af50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc68c007fd0 tx=0x7fc68c009040 comp rx=0 tx=0).stop 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.220+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 msgr2=0x7fc698112900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.220+0000 7fc69d9cb700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 0x7fc698112900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc688009180 tx=0x7fc688009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.221+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 shutdown_connections 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.221+0000 7fc69d9cb700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc680078aa0 0x7fc68007af50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.221+0000 7fc69d9cb700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc698101d30 0x7fc698112900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.221+0000 7fc69d9cb700 1 --2- 172.21.15.62:0/2100485996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6981026d0 0x7fc698112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.221+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 >> 172.21.15.62:0/2100485996 conn(0x7fc698073350 msgr2=0x7fc698104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:42.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.221+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 shutdown_connections 2024-05-09T06:34:42.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.221+0000 7fc69d9cb700 1 -- 172.21.15.62:0/2100485996 wait complete. 2024-05-09T06:34:42.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.325+0000 7f0aab4d7700 1 -- 172.21.15.62:0/2884778715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 msgr2=0x7f0aa40fe1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:42.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.325+0000 7f0aab4d7700 1 --2- 172.21.15.62:0/2884778715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 0x7f0aa40fe1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0004940 tx=0x7f0aa0009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:42.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.326+0000 7f0aab4d7700 1 -- 172.21.15.62:0/2884778715 shutdown_connections 2024-05-09T06:34:42.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.326+0000 7f0aab4d7700 1 --2- 172.21.15.62:0/2884778715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 0x7f0aa4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.326+0000 7f0aab4d7700 1 --2- 172.21.15.62:0/2884778715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 0x7f0aa40fe1c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.326+0000 7f0aab4d7700 1 -- 172.21.15.62:0/2884778715 >> 172.21.15.62:0/2884778715 conn(0x7f0aa40f7850 msgr2=0x7f0aa40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:42.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.326+0000 7f0aab4d7700 1 -- 172.21.15.62:0/2884778715 shutdown_connections 2024-05-09T06:34:42.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.326+0000 7f0aab4d7700 1 -- 172.21.15.62:0/2884778715 wait complete. 2024-05-09T06:34:42.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.326+0000 7f0aab4d7700 1 Processor -- start 2024-05-09T06:34:42.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.326+0000 7f0aab4d7700 1 -- start start 2024-05-09T06:34:42.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aab4d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 0x7f0aa40fbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aab4d7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 0x7f0aa40fc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aab4d7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40fdc00 con 0x7f0aa40fddf0 2024-05-09T06:34:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aab4d7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40fc730 con 0x7f0aa40fe790 2024-05-09T06:34:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa9273700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 0x7f0aa40fbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa9273700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 0x7f0aa40fbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58984/0 (socket says 172.21.15.62:58984) 2024-05-09T06:34:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa9273700 1 -- 172.21.15.62:0/1879728945 learned_addr learned my addr 172.21.15.62:0/1879728945 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa8a72700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 0x7f0aa40fc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa8a72700 1 -- 172.21.15.62:0/1879728945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 msgr2=0x7f0aa40fc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa8a72700 1 -- 172.21.15.62:0/1879728945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 msgr2=0x7f0aa40fc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa8a72700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 0x7f0aa40fc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa8a72700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 0x7f0aa40fc1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa9273700 1 -- 172.21.15.62:0/1879728945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 msgr2=0x7f0aa40fc1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa9273700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 0x7f0aa40fc1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa9273700 1 -- 172.21.15.62:0/1879728945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0005040 con 0x7f0aa40fddf0 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aa9273700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 0x7f0aa40fbcb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009380 tx=0x7f0aa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0a99ffb700 1 -- 172.21.15.62:0/1879728945 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aa000e040 con 0x7f0aa40fddf0 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa40fc9b0 con 0x7f0aa40fddf0 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0a99ffb700 1 -- 172.21.15.62:0/1879728945 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0aa0009af0 con 0x7f0aa40fddf0 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.327+0000 7f0a99ffb700 1 -- 172.21.15.62:0/1879728945 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aa001c630 con 0x7f0aa40fddf0 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.328+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa411a060 con 0x7f0aa40fddf0 2024-05-09T06:34:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.329+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa4066a90 con 0x7f0aa40fddf0 2024-05-09T06:34:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.329+0000 7f0a99ffb700 1 -- 172.21.15.62:0/1879728945 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f0aa000bbc0 con 0x7f0aa40fddf0 2024-05-09T06:34:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.330+0000 7f0a99ffb700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0a90078aa0 0x7f0a9007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.330+0000 7f0a99ffb700 1 -- 172.21.15.62:0/1879728945 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0aa009bbe0 con 0x7f0aa40fddf0 2024-05-09T06:34:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.330+0000 7f0aa8a72700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0a90078aa0 0x7f0a9007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:42.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.330+0000 7f0aa8a72700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0a90078aa0 0x7f0a9007af50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40fd3e0 tx=0x7f0a94009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:42.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.335+0000 7f0a99ffb700 1 -- 172.21.15.62:0/1879728945 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0aa0063700 con 0x7f0aa40fddf0 2024-05-09T06:34:42.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.407+0000 7f0a99ffb700 1 -- 172.21.15.62:0/1879728945 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0aa0063700 con 0x7f0aa40fddf0 2024-05-09T06:34:42.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.603+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0aa411a310 con 0x7f0aa40fddf0 2024-05-09T06:34:42.585 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:42 smithi062 ceph-mon[109590]: pgmap v10: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-09T06:34:42.585 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:42 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:42.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.604+0000 7f0a99ffb700 1 -- 172.21.15.62:0/1879728945 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f0aa00630a0 con 0x7f0aa40fddf0 2024-05-09T06:34:42.585 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:34:42.585 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:34:42.585 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:42.585 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:34:42.586 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:34:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:42.588 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0a90078aa0 msgr2=0x7f0a9007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0a90078aa0 0x7f0a9007af50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40fd3e0 tx=0x7f0a94009040 comp rx=0 tx=0).stop 2024-05-09T06:34:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 msgr2=0x7f0aa40fbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 0x7f0aa40fbcb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009380 tx=0x7f0aa0009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 shutdown_connections 2024-05-09T06:34:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0a90078aa0 0x7f0a9007af50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0aa40fddf0 0x7f0aa40fbcb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 --2- 172.21.15.62:0/1879728945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa40fe790 0x7f0aa40fc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 >> 172.21.15.62:0/1879728945 conn(0x7f0aa40f7850 msgr2=0x7f0aa40f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 shutdown_connections 2024-05-09T06:34:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.606+0000 7f0aab4d7700 1 -- 172.21.15.62:0/1879728945 wait complete. 2024-05-09T06:34:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:34:42.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.713+0000 7fcc327de700 1 -- 172.21.15.62:0/535311765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c102de0 msgr2=0x7fcc2c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:42.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.713+0000 7fcc327de700 1 --2- 172.21.15.62:0/535311765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c102de0 0x7fcc2c1031b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c004940 tx=0x7fcc1c009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:42.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.713+0000 7fcc327de700 1 -- 172.21.15.62:0/535311765 shutdown_connections 2024-05-09T06:34:42.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.713+0000 7fcc327de700 1 --2- 172.21.15.62:0/535311765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c103780 0x7fcc2c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.713+0000 7fcc327de700 1 --2- 172.21.15.62:0/535311765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c102de0 0x7fcc2c1031b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.713+0000 7fcc327de700 1 -- 172.21.15.62:0/535311765 >> 172.21.15.62:0/535311765 conn(0x7fcc2c0f8990 msgr2=0x7fcc2c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:42.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.713+0000 7fcc327de700 1 -- 172.21.15.62:0/535311765 shutdown_connections 2024-05-09T06:34:42.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.713+0000 7fcc327de700 1 -- 172.21.15.62:0/535311765 wait complete. 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.714+0000 7fcc327de700 1 Processor -- start 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.714+0000 7fcc327de700 1 -- start start 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.714+0000 7fcc327de700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 0x7fcc2c115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.714+0000 7fcc327de700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c103780 0x7fcc2c116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.714+0000 7fcc327de700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c1166e0 con 0x7fcc2c103780 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.714+0000 7fcc327de700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c10fcc0 con 0x7fcc2c102de0 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c103780 0x7fcc2c116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 0x7fcc2c115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c103780 0x7fcc2c116090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59000/0 (socket says 172.21.15.62:59000) 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2b7fe700 1 -- 172.21.15.62:0/716265435 learned_addr learned my addr 172.21.15.62:0/716265435 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2bfff700 1 -- 172.21.15.62:0/716265435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 msgr2=0x7fcc2c115b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-09T06:34:42.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2bfff700 1 -- 172.21.15.62:0/716265435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 msgr2=0x7fcc2c115b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2bfff700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 0x7fcc2c115b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2bfff700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 0x7fcc2c115b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2b7fe700 1 -- 172.21.15.62:0/716265435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 msgr2=0x7fcc2c115b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2b7fe700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 0x7fcc2c115b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2b7fe700 1 -- 172.21.15.62:0/716265435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c005040 con 0x7fcc2c103780 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc2b7fe700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c103780 0x7fcc2c116090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc20002a50 tx=0x7fcc20004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc28ff9700 1 -- 172.21.15.62:0/716265435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc20007cc0 con 0x7fcc2c103780 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc28ff9700 1 -- 172.21.15.62:0/716265435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc2000f040 con 0x7fcc2c103780 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc28ff9700 1 -- 172.21.15.62:0/716265435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc2000da40 con 0x7fcc2c103780 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c10ffa0 con 0x7fcc2c103780 2024-05-09T06:34:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.715+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c110560 con 0x7fcc2c103780 2024-05-09T06:34:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.716+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c1072e0 con 0x7fcc2c103780 2024-05-09T06:34:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.717+0000 7fcc28ff9700 1 -- 172.21.15.62:0/716265435 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fcc200097c0 con 0x7fcc2c103780 2024-05-09T06:34:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.717+0000 7fcc28ff9700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcc14078aa0 0x7fcc1407af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.718+0000 7fcc2bfff700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcc14078aa0 0x7fcc1407af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.718+0000 7fcc28ff9700 1 -- 172.21.15.62:0/716265435 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcc2009a660 con 0x7fcc2c103780 2024-05-09T06:34:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.718+0000 7fcc2bfff700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcc14078aa0 0x7fcc1407af50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c004f90 tx=0x7fcc1c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:42.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.722+0000 7fcc28ff9700 1 -- 172.21.15.62:0/716265435 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fcc20061d00 con 0x7fcc2c103780 2024-05-09T06:34:42.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:42 smithi079 ceph-mon[82381]: pgmap v10: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-09T06:34:42.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:42 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:42.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.959+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc2c111210 con 0x7fcc14078aa0 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.960+0000 7fcc28ff9700 1 -- 172.21.15.62:0/716265435 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fcc2c111210 con 0x7fcc14078aa0 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:34:42.941 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "3/21 daemons upgraded", 2024-05-09T06:34:42.942 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mon daemons", 2024-05-09T06:34:42.942 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:34:42.942 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:34:42.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcc14078aa0 msgr2=0x7fcc1407af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcc14078aa0 0x7fcc1407af50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c004f90 tx=0x7fcc1c009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c103780 msgr2=0x7fcc2c116090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c103780 0x7fcc2c116090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc20002a50 tx=0x7fcc20004600 comp rx=0 tx=0).stop 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 shutdown_connections 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc2c102de0 0x7fcc2c115b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcc14078aa0 0x7fcc1407af50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 --2- 172.21.15.62:0/716265435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcc2c103780 0x7fcc2c116090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.962+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 >> 172.21.15.62:0/716265435 conn(0x7fcc2c0f8990 msgr2=0x7fcc2c070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.963+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 shutdown_connections 2024-05-09T06:34:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:42.963+0000 7fcc327de700 1 -- 172.21.15.62:0/716265435 wait complete. 2024-05-09T06:34:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 -- 172.21.15.62:0/113974802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740102dc0 msgr2=0x7ff740103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 --2- 172.21.15.62:0/113974802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740102dc0 0x7ff740103190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff730009ce0 tx=0x7ff730004d10 comp rx=0 tx=0).stop 2024-05-09T06:34:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 -- 172.21.15.62:0/113974802 shutdown_connections 2024-05-09T06:34:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 --2- 172.21.15.62:0/113974802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740103760 0x7ff7400fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 --2- 172.21.15.62:0/113974802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740102dc0 0x7ff740103190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 -- 172.21.15.62:0/113974802 >> 172.21.15.62:0/113974802 conn(0x7ff7400f8930 msgr2=0x7ff7400fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:43.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 -- 172.21.15.62:0/113974802 shutdown_connections 2024-05-09T06:34:43.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 -- 172.21.15.62:0/113974802 wait complete. 2024-05-09T06:34:43.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 Processor -- start 2024-05-09T06:34:43.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.068+0000 7ff7470c1700 1 -- start start 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff7470c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 0x7ff740113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff7470c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740103760 0x7ff740114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff7470c1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7401146a0 con 0x7ff740103760 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff7470c1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74010dc80 con 0x7ff740102dc0 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff73ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740103760 0x7ff740114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff73ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740103760 0x7ff740114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59008/0 (socket says 172.21.15.62:59008) 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff73ffff700 1 -- 172.21.15.62:0/878000002 learned_addr learned my addr 172.21.15.62:0/878000002 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff744e5d700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 0x7ff740113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff744e5d700 1 -- 172.21.15.62:0/878000002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 msgr2=0x7ff740113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff744e5d700 1 -- 172.21.15.62:0/878000002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 msgr2=0x7ff740113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff744e5d700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 0x7ff740113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:34:43.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff744e5d700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 0x7ff740113b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff73ffff700 1 -- 172.21.15.62:0/878000002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 msgr2=0x7ff740113b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff73ffff700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 0x7ff740113b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff73ffff700 1 -- 172.21.15.62:0/878000002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009940 con 0x7ff740103760 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.069+0000 7ff73ffff700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740103760 0x7ff740114050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff728002a80 tx=0x7ff728004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.070+0000 7ff73d7fa700 1 -- 172.21.15.62:0/878000002 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff728007cc0 con 0x7ff740103760 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.070+0000 7ff73d7fa700 1 -- 172.21.15.62:0/878000002 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff72800f040 con 0x7ff740103760 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.070+0000 7ff73d7fa700 1 -- 172.21.15.62:0/878000002 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72800daf0 con 0x7ff740103760 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.070+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74010df60 con 0x7ff740103760 2024-05-09T06:34:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.070+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74010e520 con 0x7ff740103760 2024-05-09T06:34:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.071+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7401000d0 con 0x7ff740103760 2024-05-09T06:34:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.072+0000 7ff73d7fa700 1 -- 172.21.15.62:0/878000002 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7ff72800dc90 con 0x7ff740103760 2024-05-09T06:34:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.072+0000 7ff73d7fa700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff72c078aa0 0x7ff72c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.072+0000 7ff744e5d700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff72c078aa0 0x7ff72c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.072+0000 7ff73d7fa700 1 -- 172.21.15.62:0/878000002 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff728099f80 con 0x7ff740103760 2024-05-09T06:34:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.073+0000 7ff744e5d700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff72c078aa0 0x7ff72c07af50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff73000b740 tx=0x7ff730004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:43.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.077+0000 7ff73d7fa700 1 -- 172.21.15.62:0/878000002 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ff728061aa0 con 0x7ff740103760 2024-05-09T06:34:43.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.383+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff74010f160 con 0x7ff740103760 2024-05-09T06:34:43.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.384+0000 7ff73d7fa700 1 -- 172.21.15.62:0/878000002 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff728061440 con 0x7ff740103760 2024-05-09T06:34:43.365 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:43.365 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:43.365 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:34:43.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff72c078aa0 msgr2=0x7ff72c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:43.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff72c078aa0 0x7ff72c07af50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff73000b740 tx=0x7ff730004d10 comp rx=0 tx=0).stop 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740103760 msgr2=0x7ff740114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740103760 0x7ff740114050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff728002a80 tx=0x7ff728004630 comp rx=0 tx=0).stop 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 shutdown_connections 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff740102dc0 0x7ff740113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff72c078aa0 0x7ff72c07af50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 --2- 172.21.15.62:0/878000002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740103760 0x7ff740114050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 >> 172.21.15.62:0/878000002 conn(0x7ff7400f8930 msgr2=0x7ff740107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 shutdown_connections 2024-05-09T06:34:43.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:34:43.386+0000 7ff7470c1700 1 -- 172.21.15.62:0/878000002 wait complete. 2024-05-09T06:34:43.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: pgmap v12: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: mon.smithi079 calling monitor election 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: mon.smithi062 calling monitor election 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: mon.smithi062 is new leader, mons smithi062,smithi079 in quorum (ranks 0,1) 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: monmap epoch 3 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: last_changed 2024-05-09T06:34:42.404685+0000 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: created 2024-05-09T06:19:53.187818+0000 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: min_mon_release 19 (squid) 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: election_strategy: 1 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.smithi062 2024-05-09T06:34:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: 1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.smithi079 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: mgrmap e38: smithi062.juuasl(active, since 18s), standbys: smithi079.genyri 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1879728945' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:34:43.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:43 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/878000002' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:34:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: pgmap v12: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi062"}]: dispatch 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: mon.smithi079 calling monitor election 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: mon.smithi062 calling monitor election 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: mon.smithi062 is new leader, mons smithi062,smithi079 in quorum (ranks 0,1) 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: monmap epoch 3 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: last_changed 2024-05-09T06:34:42.404685+0000 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: created 2024-05-09T06:19:53.187818+0000 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: min_mon_release 19 (squid) 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: election_strategy: 1 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.smithi062 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: 1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.smithi079 2024-05-09T06:34:43.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: mgrmap e38: smithi062.juuasl(active, since 18s), standbys: smithi079.genyri 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1879728945' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:34:43.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:43 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/878000002' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:34:44.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:44 smithi062 ceph-mon[109590]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:44.694 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:44 smithi079 ceph-mon[82381]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:45.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:45 smithi062 ceph-mon[109590]: pgmap v13: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:45.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:45 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:45.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:45 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:45.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:45 smithi079 ceph-mon[82381]: pgmap v13: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:45.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:45 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:45.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:45 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:47.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:47 smithi079 ceph-mon[82381]: pgmap v14: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:47.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:47 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:47.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:47 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:47.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:47 smithi062 ceph-mon[109590]: pgmap v14: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:47.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:47 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:47.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:47 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:49.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:49 smithi062 ceph-mon[109590]: pgmap v15: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:49.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:49 smithi079 ceph-mon[82381]: pgmap v15: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: Detected new or changed devices on smithi079 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: pgmap v16: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: Reconfiguring mon.smithi062 (monmap changed)... 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:34:51.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:51.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:50 smithi079 ceph-mon[82381]: Reconfiguring daemon mon.smithi062 on smithi062 2024-05-09T06:34:51.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: Detected new or changed devices on smithi079 2024-05-09T06:34:51.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:51.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: pgmap v16: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: Reconfiguring mon.smithi062 (monmap changed)... 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:51.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:50 smithi062 ceph-mon[109590]: Reconfiguring daemon mon.smithi062 on smithi062 2024-05-09T06:34:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:52 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:52 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:52 smithi062 ceph-mon[109590]: pgmap v17: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:52 smithi062 ceph-mon[109590]: Reconfiguring mgr.smithi062.juuasl (monmap changed)... 2024-05-09T06:34:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:52 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi062.juuasl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:34:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:52 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:34:53.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:52 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:53.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:52 smithi062 ceph-mon[109590]: Reconfiguring daemon mgr.smithi062.juuasl on smithi062 2024-05-09T06:34:53.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:52 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:53.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:52 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:52 smithi079 ceph-mon[82381]: pgmap v17: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:52 smithi079 ceph-mon[82381]: Reconfiguring mgr.smithi062.juuasl (monmap changed)... 2024-05-09T06:34:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:52 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi062.juuasl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:34:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:52 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:34:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:52 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:53.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:52 smithi079 ceph-mon[82381]: Reconfiguring daemon mgr.smithi062.juuasl on smithi062 2024-05-09T06:34:55.027 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:55.028 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:55.028 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:54 smithi062 ceph-mon[109590]: Reconfiguring crash.smithi062 (monmap changed)... 2024-05-09T06:34:55.028 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi062", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:34:55.028 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:55.028 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:54 smithi062 ceph-mon[109590]: Reconfiguring daemon crash.smithi062 on smithi062 2024-05-09T06:34:55.028 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:54 smithi062 ceph-mon[109590]: pgmap v18: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:55.028 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:55.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:55.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:55.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:54 smithi079 ceph-mon[82381]: Reconfiguring crash.smithi062 (monmap changed)... 2024-05-09T06:34:55.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi062", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:34:55.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:55.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:54 smithi079 ceph-mon[82381]: Reconfiguring daemon crash.smithi062 on smithi062 2024-05-09T06:34:55.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:54 smithi079 ceph-mon[82381]: pgmap v18: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:55.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:56.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:56.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:56.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:56 smithi062 ceph-mon[109590]: Reconfiguring osd.0 (monmap changed)... 2024-05-09T06:34:56.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:34:56.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:56.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:56 smithi062 ceph-mon[109590]: Reconfiguring daemon osd.0 on smithi062 2024-05-09T06:34:56.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:56 smithi079 ceph-mon[82381]: Reconfiguring osd.0 (monmap changed)... 2024-05-09T06:34:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:34:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:56 smithi079 ceph-mon[82381]: Reconfiguring daemon osd.0 on smithi062 2024-05-09T06:34:57.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:57 smithi062 ceph-mon[109590]: pgmap v19: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:57.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:57 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:57.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:57 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:57.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:57 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:34:57.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:57 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:57.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:57 smithi079 ceph-mon[82381]: pgmap v19: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:57.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:57 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:57.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:57 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:57.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:57 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:34:57.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:57 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:58.639 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:58 smithi062 ceph-mon[109590]: Reconfiguring osd.1 (monmap changed)... 2024-05-09T06:34:58.640 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:58 smithi062 ceph-mon[109590]: Reconfiguring daemon osd.1 on smithi062 2024-05-09T06:34:58.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:58 smithi079 ceph-mon[82381]: Reconfiguring osd.1 (monmap changed)... 2024-05-09T06:34:58.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:58 smithi079 ceph-mon[82381]: Reconfiguring daemon osd.1 on smithi062 2024-05-09T06:34:59.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:59 smithi062 ceph-mon[109590]: pgmap v20: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:59.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:59 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:59.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:59 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:59.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:59 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:34:59.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:34:59 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:59.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:59 smithi079 ceph-mon[82381]: pgmap v20: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:59.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:59 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:59.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:59 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:34:59.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:59 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:34:59.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:34:59 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:00.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:00 smithi062 ceph-mon[109590]: Reconfiguring osd.2 (monmap changed)... 2024-05-09T06:35:00.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:00 smithi062 ceph-mon[109590]: Reconfiguring daemon osd.2 on smithi062 2024-05-09T06:35:00.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:00 smithi079 ceph-mon[82381]: Reconfiguring osd.2 (monmap changed)... 2024-05-09T06:35:00.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:00 smithi079 ceph-mon[82381]: Reconfiguring daemon osd.2 on smithi062 2024-05-09T06:35:01.398 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:01 smithi062 ceph-mon[109590]: pgmap v21: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:01.398 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:01.398 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:01.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.etsgzx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:01.399 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:01 smithi079 ceph-mon[82381]: pgmap v21: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.etsgzx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:02.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:02 smithi062 ceph-mon[109590]: Reconfiguring mds.cephfs.smithi062.etsgzx (monmap changed)... 2024-05-09T06:35:02.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:02 smithi062 ceph-mon[109590]: Reconfiguring daemon mds.cephfs.smithi062.etsgzx on smithi062 2024-05-09T06:35:02.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:02 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:02.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:02 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:02.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:02 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.bwemju", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:02.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:02 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:02.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:02 smithi079 ceph-mon[82381]: Reconfiguring mds.cephfs.smithi062.etsgzx (monmap changed)... 2024-05-09T06:35:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:02 smithi079 ceph-mon[82381]: Reconfiguring daemon mds.cephfs.smithi062.etsgzx on smithi062 2024-05-09T06:35:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:02 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:02 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:02 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.bwemju", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:02.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:02 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:03.485 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:03 smithi062 ceph-mon[109590]: pgmap v22: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:03.485 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:03 smithi062 ceph-mon[109590]: Reconfiguring mds.cephfs.smithi062.bwemju (monmap changed)... 2024-05-09T06:35:03.485 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:03 smithi062 ceph-mon[109590]: Reconfiguring daemon mds.cephfs.smithi062.bwemju on smithi062 2024-05-09T06:35:03.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:03 smithi079 ceph-mon[82381]: pgmap v22: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:03.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:03 smithi079 ceph-mon[82381]: Reconfiguring mds.cephfs.smithi062.bwemju (monmap changed)... 2024-05-09T06:35:03.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:03 smithi079 ceph-mon[82381]: Reconfiguring daemon mds.cephfs.smithi062.bwemju on smithi062 2024-05-09T06:35:05.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:04 smithi079 ceph-mon[82381]: pgmap v23: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:04 smithi079 ceph-mon[82381]: Reconfiguring crash.smithi079 (monmap changed)... 2024-05-09T06:35:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:05.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:04 smithi079 ceph-mon[82381]: Reconfiguring daemon crash.smithi079 on smithi079 2024-05-09T06:35:05.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:04 smithi062 ceph-mon[109590]: pgmap v23: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:04 smithi062 ceph-mon[109590]: Reconfiguring crash.smithi079 (monmap changed)... 2024-05-09T06:35:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:05.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:04 smithi062 ceph-mon[109590]: Reconfiguring daemon crash.smithi079 on smithi079 2024-05-09T06:35:06.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:06 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:06.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:06 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:06.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:06 smithi079 ceph-mon[82381]: Reconfiguring mgr.smithi079.genyri (monmap changed)... 2024-05-09T06:35:06.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:06 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:35:06.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:06 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:35:06.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:06 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:06.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:06 smithi079 ceph-mon[82381]: Reconfiguring daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:35:06.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:06 smithi079 ceph-mon[82381]: pgmap v24: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:06.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:06 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:06.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:06 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:06.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:06 smithi062 ceph-mon[109590]: Reconfiguring mgr.smithi079.genyri (monmap changed)... 2024-05-09T06:35:06.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:06 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.genyri", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:35:06.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:06 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:35:06.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:06 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:06.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:06 smithi062 ceph-mon[109590]: Reconfiguring daemon mgr.smithi079.genyri on smithi079 2024-05-09T06:35:06.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:06 smithi062 ceph-mon[109590]: pgmap v24: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:08.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:08 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:08.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:08 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:08.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:08 smithi079 ceph-mon[82381]: Reconfiguring mon.smithi079 (monmap changed)... 2024-05-09T06:35:08.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:08 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:35:08.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:08 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:35:08.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:08 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:08.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:08 smithi079 ceph-mon[82381]: Reconfiguring daemon mon.smithi079 on smithi079 2024-05-09T06:35:08.639 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:08 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:08.639 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:08 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:08.639 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:08 smithi062 ceph-mon[109590]: Reconfiguring mon.smithi079 (monmap changed)... 2024-05-09T06:35:08.639 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:08 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:35:08.639 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:08 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:35:08.639 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:08 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:08.639 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:08 smithi062 ceph-mon[109590]: Reconfiguring daemon mon.smithi079 on smithi079 2024-05-09T06:35:09.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:09 smithi079 ceph-mon[82381]: pgmap v25: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:09.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:09.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:09.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:35:09.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:09.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:09 smithi062 ceph-mon[109590]: pgmap v25: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:35:09.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:09.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:10.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:10 smithi079 ceph-mon[82381]: Reconfiguring osd.3 (monmap changed)... 2024-05-09T06:35:10.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:10 smithi079 ceph-mon[82381]: Reconfiguring daemon osd.3 on smithi079 2024-05-09T06:35:10.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:10 smithi062 ceph-mon[109590]: Reconfiguring osd.3 (monmap changed)... 2024-05-09T06:35:10.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:10 smithi062 ceph-mon[109590]: Reconfiguring daemon osd.3 on smithi079 2024-05-09T06:35:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:11 smithi079 ceph-mon[82381]: pgmap v26: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:11 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:11 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:11 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:35:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:11 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:11.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:11 smithi062 ceph-mon[109590]: pgmap v26: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:11.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:11 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:11.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:11 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:11.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:11 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:35:11.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:11 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:12.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:12 smithi079 ceph-mon[82381]: Reconfiguring osd.4 (monmap changed)... 2024-05-09T06:35:12.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:12 smithi079 ceph-mon[82381]: Reconfiguring daemon osd.4 on smithi079 2024-05-09T06:35:12.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:12 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:12.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:12 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:12.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:12 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:35:12.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:12 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:12.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:12 smithi062 ceph-mon[109590]: Reconfiguring osd.4 (monmap changed)... 2024-05-09T06:35:12.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:12 smithi062 ceph-mon[109590]: Reconfiguring daemon osd.4 on smithi079 2024-05-09T06:35:12.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:12 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:12.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:12 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:12.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:12 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:35:12.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:12 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:13.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:13 smithi079 ceph-mon[82381]: pgmap v27: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:13.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:13 smithi079 ceph-mon[82381]: Reconfiguring osd.5 (monmap changed)... 2024-05-09T06:35:13.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:13 smithi079 ceph-mon[82381]: Reconfiguring daemon osd.5 on smithi079 2024-05-09T06:35:13.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 -- 172.21.15.62:0/3197661632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fe7b0 msgr2=0x7f9b34106e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 --2- 172.21.15.62:0/3197661632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fe7b0 0x7f9b34106e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b24004940 tx=0x7f9b24009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 -- 172.21.15.62:0/3197661632 shutdown_connections 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 --2- 172.21.15.62:0/3197661632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fe7b0 0x7f9b34106e80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 --2- 172.21.15.62:0/3197661632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b340fde10 0x7f9b340fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 -- 172.21.15.62:0/3197661632 >> 172.21.15.62:0/3197661632 conn(0x7f9b340f7850 msgr2=0x7f9b340f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 -- 172.21.15.62:0/3197661632 shutdown_connections 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 -- 172.21.15.62:0/3197661632 wait complete. 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 Processor -- start 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.508+0000 7f9b3c06f700 1 -- start start 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b3c06f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fde10 0x7f9b34113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b3c06f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b340fe7b0 0x7f9b341140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b3c06f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b34114720 con 0x7f9b340fde10 2024-05-09T06:35:13.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b3c06f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3410db30 con 0x7f9b340fe7b0 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b39e0b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fde10 0x7f9b34113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b39e0b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fde10 0x7f9b34113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48012/0 (socket says 172.21.15.62:48012) 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b39e0b700 1 -- 172.21.15.62:0/299748480 learned_addr learned my addr 172.21.15.62:0/299748480 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b3960a700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b340fe7b0 0x7f9b341140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b39e0b700 1 -- 172.21.15.62:0/299748480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b340fe7b0 msgr2=0x7f9b341140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b39e0b700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b340fe7b0 0x7f9b341140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b39e0b700 1 -- 172.21.15.62:0/299748480 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24005040 con 0x7f9b340fde10 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b3960a700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b340fe7b0 0x7f9b341140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.509+0000 7f9b39e0b700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fde10 0x7f9b34113b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9b30002a50 tx=0x7f9b300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.510+0000 7f9b2a7fc700 1 -- 172.21.15.62:0/299748480 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b30007cc0 con 0x7f9b340fde10 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.510+0000 7f9b2a7fc700 1 -- 172.21.15.62:0/299748480 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b3000f040 con 0x7f9b340fde10 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.510+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3410de10 con 0x7f9b340fde10 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.510+0000 7f9b2a7fc700 1 -- 172.21.15.62:0/299748480 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b3000da30 con 0x7f9b340fde10 2024-05-09T06:35:13.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.510+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3410e350 con 0x7f9b340fde10 2024-05-09T06:35:13.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.511+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b34066690 con 0x7f9b340fde10 2024-05-09T06:35:13.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.512+0000 7f9b2a7fc700 1 -- 172.21.15.62:0/299748480 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f9b3000dc70 con 0x7f9b340fde10 2024-05-09T06:35:13.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.512+0000 7f9b2a7fc700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9b20078aa0 0x7f9b2007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:13.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.512+0000 7f9b2a7fc700 1 -- 172.21.15.62:0/299748480 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9b3009a6e0 con 0x7f9b340fde10 2024-05-09T06:35:13.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.512+0000 7f9b3960a700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9b20078aa0 0x7f9b2007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:13.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.513+0000 7f9b3960a700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9b20078aa0 0x7f9b2007af50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b3410f430 tx=0x7f9b24009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:13.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.518+0000 7f9b2a7fc700 1 -- 172.21.15.62:0/299748480 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f9b30062180 con 0x7f9b340fde10 2024-05-09T06:35:13.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:13 smithi062 ceph-mon[109590]: pgmap v27: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:13.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:13 smithi062 ceph-mon[109590]: Reconfiguring osd.5 (monmap changed)... 2024-05-09T06:35:13.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:13 smithi062 ceph-mon[109590]: Reconfiguring daemon osd.5 on smithi079 2024-05-09T06:35:13.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.753+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b3404bf40 con 0x7f9b20078aa0 2024-05-09T06:35:13.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.755+0000 7f9b2a7fc700 1 -- 172.21.15.62:0/299748480 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9b3404bf40 con 0x7f9b20078aa0 2024-05-09T06:35:13.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9b20078aa0 msgr2=0x7f9b2007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:13.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9b20078aa0 0x7f9b2007af50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b3410f430 tx=0x7f9b24009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:13.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fde10 msgr2=0x7f9b34113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:13.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fde10 0x7f9b34113b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9b30002a50 tx=0x7f9b300046b0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 shutdown_connections 2024-05-09T06:35:13.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9b20078aa0 0x7f9b2007af50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b340fde10 0x7f9b34113b90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 --2- 172.21.15.62:0/299748480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b340fe7b0 0x7f9b341140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 >> 172.21.15.62:0/299748480 conn(0x7f9b340f7850 msgr2=0x7f9b340f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:13.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 shutdown_connections 2024-05-09T06:35:13.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.757+0000 7f9b3c06f700 1 -- 172.21.15.62:0/299748480 wait complete. 2024-05-09T06:35:13.749 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:35:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.866+0000 7f847e042700 1 -- 172.21.15.62:0/2421770604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8478102e00 msgr2=0x7f84781031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.866+0000 7f847e042700 1 --2- 172.21.15.62:0/2421770604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8478102e00 0x7f84781031d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8468004940 tx=0x7f8468009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.867+0000 7f847e042700 1 -- 172.21.15.62:0/2421770604 shutdown_connections 2024-05-09T06:35:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.867+0000 7f847e042700 1 --2- 172.21.15.62:0/2421770604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84781037a0 0x7f84780fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.867+0000 7f847e042700 1 --2- 172.21.15.62:0/2421770604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8478102e00 0x7f84781031d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.867+0000 7f847e042700 1 -- 172.21.15.62:0/2421770604 >> 172.21.15.62:0/2421770604 conn(0x7f84780f89d0 msgr2=0x7f84780fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.867+0000 7f847e042700 1 -- 172.21.15.62:0/2421770604 shutdown_connections 2024-05-09T06:35:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.867+0000 7f847e042700 1 -- 172.21.15.62:0/2421770604 wait complete. 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.867+0000 7f847e042700 1 Processor -- start 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.867+0000 7f847e042700 1 -- start start 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f847e042700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8478102e00 0x7f8478115b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f847e042700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84781037a0 0x7f84781160a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f847e042700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84781166f0 con 0x7f84781037a0 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f847e042700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847810fcd0 con 0x7f8478102e00 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f8476ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84781037a0 0x7f84781160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f8476ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84781037a0 0x7f84781160a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51394/0 (socket says 172.21.15.62:51394) 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f8476ffd700 1 -- 172.21.15.62:0/2017358415 learned_addr learned my addr 172.21.15.62:0/2017358415 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f84777fe700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8478102e00 0x7f8478115b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f8476ffd700 1 -- 172.21.15.62:0/2017358415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8478102e00 msgr2=0x7f8478115b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f8476ffd700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8478102e00 0x7f8478115b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f8476ffd700 1 -- 172.21.15.62:0/2017358415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468005040 con 0x7f84781037a0 2024-05-09T06:35:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f84777fe700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8478102e00 0x7f8478115b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:35:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f8476ffd700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84781037a0 0x7f84781160a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f846c00eb40 tx=0x7f846c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f845ffff700 1 -- 172.21.15.62:0/2017358415 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f846c007cc0 con 0x7f84781037a0 2024-05-09T06:35:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847810ff50 con 0x7f84781037a0 2024-05-09T06:35:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f845ffff700 1 -- 172.21.15.62:0/2017358415 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f846c00f040 con 0x7f84781037a0 2024-05-09T06:35:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f845ffff700 1 -- 172.21.15.62:0/2017358415 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f846c00cad0 con 0x7f84781037a0 2024-05-09T06:35:13.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.868+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8478110490 con 0x7f84781037a0 2024-05-09T06:35:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.870+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84780fe550 con 0x7f84781037a0 2024-05-09T06:35:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.870+0000 7f845ffff700 1 -- 172.21.15.62:0/2017358415 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f846c00cc30 con 0x7f84781037a0 2024-05-09T06:35:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.871+0000 7f845ffff700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8460078aa0 0x7f846007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.871+0000 7f84777fe700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8460078aa0 0x7f846007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.871+0000 7f845ffff700 1 -- 172.21.15.62:0/2017358415 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f846c09a4b0 con 0x7f84781037a0 2024-05-09T06:35:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.871+0000 7f84777fe700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8460078aa0 0x7f846007af50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8468009000 tx=0x7f8468009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:13.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:13.875+0000 7f845ffff700 1 -- 172.21.15.62:0/2017358415 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f846c061f50 con 0x7f84781037a0 2024-05-09T06:35:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.112+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8478111250 con 0x7f8460078aa0 2024-05-09T06:35:14.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.114+0000 7f845ffff700 1 -- 172.21.15.62:0/2017358415 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f8478111250 con 0x7f8460078aa0 2024-05-09T06:35:14.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8460078aa0 msgr2=0x7f846007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8460078aa0 0x7f846007af50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8468009000 tx=0x7f8468009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84781037a0 msgr2=0x7f84781160a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84781037a0 0x7f84781160a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f846c00eb40 tx=0x7f846c00b040 comp rx=0 tx=0).stop 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 shutdown_connections 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8478102e00 0x7f8478115b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8460078aa0 0x7f846007af50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 --2- 172.21.15.62:0/2017358415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84781037a0 0x7f84781160a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.116+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 >> 172.21.15.62:0/2017358415 conn(0x7f84780f89d0 msgr2=0x7f84780f8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.117+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 shutdown_connections 2024-05-09T06:35:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.117+0000 7f847e042700 1 -- 172.21.15.62:0/2017358415 wait complete. 2024-05-09T06:35:14.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 -- 172.21.15.62:0/543015653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 msgr2=0x7fcaf01031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 --2- 172.21.15.62:0/543015653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 0x7fcaf01031b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcaec004940 tx=0x7fcaec009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 -- 172.21.15.62:0/543015653 shutdown_connections 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 --2- 172.21.15.62:0/543015653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf0103780 0x7fcaf00fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 --2- 172.21.15.62:0/543015653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 0x7fcaf01031b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 -- 172.21.15.62:0/543015653 >> 172.21.15.62:0/543015653 conn(0x7fcaf00f8990 msgr2=0x7fcaf00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 -- 172.21.15.62:0/543015653 shutdown_connections 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 -- 172.21.15.62:0/543015653 wait complete. 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 Processor -- start 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.223+0000 7fcaf80c6700 1 -- start start 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf80c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 0x7fcaf0113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf80c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf0103780 0x7fcaf0113dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf80c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0114410 con 0x7fcaf0102de0 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf80c6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf010da50 con 0x7fcaf0103780 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf5e62700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 0x7fcaf0113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf5e62700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 0x7fcaf0113880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51422/0 (socket says 172.21.15.62:51422) 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf5e62700 1 -- 172.21.15.62:0/3525230703 learned_addr learned my addr 172.21.15.62:0/3525230703 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf5661700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf0103780 0x7fcaf0113dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf5e62700 1 -- 172.21.15.62:0/3525230703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf0103780 msgr2=0x7fcaf0113dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf5e62700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf0103780 0x7fcaf0113dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf5e62700 1 -- 172.21.15.62:0/3525230703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec005040 con 0x7fcaf0102de0 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf5e62700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 0x7fcaf0113880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009b30 tx=0x7fcaec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcae67fc700 1 -- 172.21.15.62:0/3525230703 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaec021070 con 0x7fcaf0102de0 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcae67fc700 1 -- 172.21.15.62:0/3525230703 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcaec013c00 con 0x7fcaf0102de0 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf010dcd0 con 0x7fcaf0102de0 2024-05-09T06:35:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcae67fc700 1 -- 172.21.15.62:0/3525230703 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaec00e070 con 0x7fcaf0102de0 2024-05-09T06:35:14.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.224+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf010e1b0 con 0x7fcaf0102de0 2024-05-09T06:35:14.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.225+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf01000f0 con 0x7fcaf0102de0 2024-05-09T06:35:14.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.226+0000 7fcae67fc700 1 -- 172.21.15.62:0/3525230703 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fcaec01cad0 con 0x7fcaf0102de0 2024-05-09T06:35:14.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.227+0000 7fcae67fc700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcadc078aa0 0x7fcadc07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.227+0000 7fcae67fc700 1 -- 172.21.15.62:0/3525230703 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcaec09bc60 con 0x7fcaf0102de0 2024-05-09T06:35:14.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.227+0000 7fcaf5661700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcadc078aa0 0x7fcadc07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.227+0000 7fcaf5661700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcadc078aa0 0x7fcadc07af50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00fc340 tx=0x7fcae000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:14.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.231+0000 7fcae67fc700 1 -- 172.21.15.62:0/3525230703 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fcaec063820 con 0x7fcaf0102de0 2024-05-09T06:35:14.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.456+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaf0109f50 con 0x7fcadc078aa0 2024-05-09T06:35:14.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.466+0000 7fcae67fc700 1 -- 172.21.15.62:0/3525230703 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fcaf0109f50 con 0x7fcadc078aa0 2024-05-09T06:35:14.447 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:35:14.447 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (2m) 45s ago 13m 14.8M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:35:14.447 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (13m) 45s ago 13m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 fe1b8ad24850 2024-05-09T06:35:14.447 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (12m) 29s ago 12m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 ee408a5b981d 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (2m) 45s ago 13m 76.6M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (7m) 45s ago 7m 15.7M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (7m) 45s ago 7m 153M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (7m) 29s ago 7m 15.7M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (7m) 29s ago 7m 15.6M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (4m) 45s ago 15m 487M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (3m) 29s ago 12m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (61s) 45s ago 15m 29.5M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (33s) 29s ago 12m 23.9M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (3m) 45s ago 13m 15.2M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (3m) 29s ago 12m 17.1M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (11m) 45s ago 11m 246M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (11m) 45s ago 11m 262M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:35:14.448 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (10m) 45s ago 10m 220M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:35:14.449 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (10m) 29s ago 10m 283M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:35:14.449 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (9m) 29s ago 9m 252M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:35:14.449 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (9m) 29s ago 9m 247M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:35:14.449 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (2m) 45s ago 12m 61.4M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:35:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcadc078aa0 msgr2=0x7fcadc07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcadc078aa0 0x7fcadc07af50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00fc340 tx=0x7fcae000b040 comp rx=0 tx=0).stop 2024-05-09T06:35:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 msgr2=0x7fcaf0113880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 0x7fcaf0113880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009b30 tx=0x7fcaec009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 shutdown_connections 2024-05-09T06:35:14.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fcadc078aa0 0x7fcadc07af50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0102de0 0x7fcaf0113880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 --2- 172.21.15.62:0/3525230703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf0103780 0x7fcaf0113dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 >> 172.21.15.62:0/3525230703 conn(0x7fcaf00f8990 msgr2=0x7fcaf00fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 shutdown_connections 2024-05-09T06:35:14.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.469+0000 7fcaf80c6700 1 -- 172.21.15.62:0/3525230703 wait complete. 2024-05-09T06:35:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.574+0000 7f4340d47700 1 -- 172.21.15.62:0/895078769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c101d00 msgr2=0x7f433c1020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.574+0000 7f4340d47700 1 --2- 172.21.15.62:0/895078769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c101d00 0x7f433c1020d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f432c004940 tx=0x7f432c009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.574+0000 7f4340d47700 1 -- 172.21.15.62:0/895078769 shutdown_connections 2024-05-09T06:35:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.574+0000 7f4340d47700 1 --2- 172.21.15.62:0/895078769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433c1026a0 0x7f433c0fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.574+0000 7f4340d47700 1 --2- 172.21.15.62:0/895078769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c101d00 0x7f433c1020d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.574+0000 7f4340d47700 1 -- 172.21.15.62:0/895078769 >> 172.21.15.62:0/895078769 conn(0x7f433c0f78d0 msgr2=0x7f433c0f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.574+0000 7f4340d47700 1 -- 172.21.15.62:0/895078769 shutdown_connections 2024-05-09T06:35:14.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.574+0000 7f4340d47700 1 -- 172.21.15.62:0/895078769 wait complete. 2024-05-09T06:35:14.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4340d47700 1 Processor -- start 2024-05-09T06:35:14.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4340d47700 1 -- start start 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4340d47700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433c101d00 0x7f433c102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4340d47700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c1026a0 0x7f433c1030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4340d47700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c103630 con 0x7f433c1026a0 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4340d47700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c103770 con 0x7f433c101d00 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4339d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c1026a0 0x7f433c1030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4339d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c1026a0 0x7f433c1030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51442/0 (socket says 172.21.15.62:51442) 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4339d9b700 1 -- 172.21.15.62:0/276956840 learned_addr learned my addr 172.21.15.62:0/276956840 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f433a59c700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433c101d00 0x7f433c102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4339d9b700 1 -- 172.21.15.62:0/276956840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433c101d00 msgr2=0x7f433c102b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4339d9b700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433c101d00 0x7f433c102b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4339d9b700 1 -- 172.21.15.62:0/276956840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c005040 con 0x7f433c1026a0 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f433a59c700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433c101d00 0x7f433c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:35:14.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.575+0000 7f4339d9b700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c1026a0 0x7f433c1030a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4330002a50 tx=0x7f4330004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.576+0000 7f432affd700 1 -- 172.21.15.62:0/276956840 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4330007cc0 con 0x7f433c1026a0 2024-05-09T06:35:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.576+0000 7f432affd700 1 -- 172.21.15.62:0/276956840 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f433000f040 con 0x7f433c1026a0 2024-05-09T06:35:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.576+0000 7f432affd700 1 -- 172.21.15.62:0/276956840 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433000da40 con 0x7f433c1026a0 2024-05-09T06:35:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.576+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c119e60 con 0x7f433c1026a0 2024-05-09T06:35:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.576+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c11a2e0 con 0x7f433c1026a0 2024-05-09T06:35:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.577+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c0fd450 con 0x7f433c1026a0 2024-05-09T06:35:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.577+0000 7f432affd700 1 -- 172.21.15.62:0/276956840 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f43300097c0 con 0x7f433c1026a0 2024-05-09T06:35:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.578+0000 7f432affd700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4324078aa0 0x7f432407af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.578+0000 7f432affd700 1 -- 172.21.15.62:0/276956840 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f433009a680 con 0x7f433c1026a0 2024-05-09T06:35:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.578+0000 7f433a59c700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4324078aa0 0x7f432407af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.578+0000 7f433a59c700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4324078aa0 0x7f432407af50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f432c004f90 tx=0x7f432c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:14.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.583+0000 7f432affd700 1 -- 172.21.15.62:0/276956840 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f4330061d20 con 0x7f433c1026a0 2024-05-09T06:35:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.891+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f433c04bed0 con 0x7f433c1026a0 2024-05-09T06:35:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.891+0000 7f432affd700 1 -- 172.21.15.62:0/276956840 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f4330061b40 con 0x7f433c1026a0 2024-05-09T06:35:14.872 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:35:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 10, 2024-05-09T06:35:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:35:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:35:14.874 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4324078aa0 msgr2=0x7f432407af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4324078aa0 0x7f432407af50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f432c004f90 tx=0x7f432c009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c1026a0 msgr2=0x7f433c1030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c1026a0 0x7f433c1030a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4330002a50 tx=0x7f4330004600 comp rx=0 tx=0).stop 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 shutdown_connections 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f433c101d00 0x7f433c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4324078aa0 0x7f432407af50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 --2- 172.21.15.62:0/276956840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f433c1026a0 0x7f433c1030a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 >> 172.21.15.62:0/276956840 conn(0x7f433c0f78d0 msgr2=0x7f433c065ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 shutdown_connections 2024-05-09T06:35:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:14.894+0000 7f4340d47700 1 -- 172.21.15.62:0/276956840 wait complete. 2024-05-09T06:35:14.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.000+0000 7f194c135700 1 -- 172.21.15.62:0/3811670617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 msgr2=0x7f19441031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.000+0000 7f194c135700 1 --2- 172.21.15.62:0/3811670617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 0x7f19441031c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1934009ce0 tx=0x7f1934004d10 comp rx=0 tx=0).stop 2024-05-09T06:35:14.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.000+0000 7f194c135700 1 -- 172.21.15.62:0/3811670617 shutdown_connections 2024-05-09T06:35:14.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.000+0000 7f194c135700 1 --2- 172.21.15.62:0/3811670617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1944103790 0x7f19440fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.000+0000 7f194c135700 1 --2- 172.21.15.62:0/3811670617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 0x7f19441031c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.000+0000 7f194c135700 1 -- 172.21.15.62:0/3811670617 >> 172.21.15.62:0/3811670617 conn(0x7f19440f8980 msgr2=0x7f19440fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.000+0000 7f194c135700 1 -- 172.21.15.62:0/3811670617 shutdown_connections 2024-05-09T06:35:14.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.000+0000 7f194c135700 1 -- 172.21.15.62:0/3811670617 wait complete. 2024-05-09T06:35:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f194c135700 1 Processor -- start 2024-05-09T06:35:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f194c135700 1 -- start start 2024-05-09T06:35:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f194c135700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 0x7f1944113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f194c135700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1944103790 0x7f19441140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f194c135700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944114710 con 0x7f1944102df0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f194c135700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194410db20 con 0x7f1944103790 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f1949ed1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 0x7f1944113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f1949ed1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 0x7f1944113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51474/0 (socket says 172.21.15.62:51474) 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f1949ed1700 1 -- 172.21.15.62:0/2942887631 learned_addr learned my addr 172.21.15.62:0/2942887631 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.001+0000 7f19496d0700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1944103790 0x7f19441140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f1949ed1700 1 -- 172.21.15.62:0/2942887631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1944103790 msgr2=0x7f19441140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f1949ed1700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1944103790 0x7f19441140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f1949ed1700 1 -- 172.21.15.62:0/2942887631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934009940 con 0x7f1944102df0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f1949ed1700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 0x7f1944113b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f193400ba50 tx=0x7f1934004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f19427fc700 1 -- 172.21.15.62:0/2942887631 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f193400e040 con 0x7f1944102df0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f19427fc700 1 -- 172.21.15.62:0/2942887631 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f193401cb20 con 0x7f1944102df0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f19427fc700 1 -- 172.21.15.62:0/2942887631 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1934012990 con 0x7f1944102df0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194410dda0 con 0x7f1944102df0 2024-05-09T06:35:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.002+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194410e360 con 0x7f1944102df0 2024-05-09T06:35:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.003+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1944100100 con 0x7f1944102df0 2024-05-09T06:35:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.004+0000 7f19427fc700 1 -- 172.21.15.62:0/2942887631 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f193401cc90 con 0x7f1944102df0 2024-05-09T06:35:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.004+0000 7f19427fc700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f192c078aa0 0x7f192c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.004+0000 7f19427fc700 1 -- 172.21.15.62:0/2942887631 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f193409cbc0 con 0x7f1944102df0 2024-05-09T06:35:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.004+0000 7f19496d0700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f192c078aa0 0x7f192c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:14.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.005+0000 7f19496d0700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f192c078aa0 0x7f192c07af50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f194410f420 tx=0x7f193800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.009+0000 7f19427fc700 1 -- 172.21.15.62:0/2942887631 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f19340646e0 con 0x7f1944102df0 2024-05-09T06:35:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: Reconfiguring mds.cephfs.smithi079.qwqgdo (monmap changed)... 2024-05-09T06:35:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.qwqgdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:15.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:15.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: Reconfiguring daemon mds.cephfs.smithi079.qwqgdo on smithi079 2024-05-09T06:35:15.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: pgmap v28: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:15.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:15.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:14 smithi079 ceph-mon[82381]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:15.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:15.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:15.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:15.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: Reconfiguring mds.cephfs.smithi079.qwqgdo (monmap changed)... 2024-05-09T06:35:15.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.qwqgdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:15.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:15.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: Reconfiguring daemon mds.cephfs.smithi079.qwqgdo on smithi079 2024-05-09T06:35:15.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: pgmap v28: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:15.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:15.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:14 smithi062 ceph-mon[109590]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:15.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.275+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f194404bed0 con 0x7f1944102df0 2024-05-09T06:35:15.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.275+0000 7f19427fc700 1 -- 172.21.15.62:0/2942887631 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f1934064080 con 0x7f1944102df0 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:35:15.257 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:35:15.258 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:35:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:35:15.260 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:35:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:35:15.260 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:15.260 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:15.260 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f192c078aa0 msgr2=0x7f192c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f192c078aa0 0x7f192c07af50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f194410f420 tx=0x7f193800b040 comp rx=0 tx=0).stop 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 msgr2=0x7f1944113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 0x7f1944113b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f193400ba50 tx=0x7f1934004d10 comp rx=0 tx=0).stop 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 shutdown_connections 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f192c078aa0 0x7f192c07af50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1944102df0 0x7f1944113b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 --2- 172.21.15.62:0/2942887631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1944103790 0x7f19441140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 >> 172.21.15.62:0/2942887631 conn(0x7f19440f8980 msgr2=0x7f19441073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 shutdown_connections 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.278+0000 7f194c135700 1 -- 172.21.15.62:0/2942887631 wait complete. 2024-05-09T06:35:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:35:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.384+0000 7f466d771700 1 -- 172.21.15.62:0/2299872638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 msgr2=0x7f4668106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.384+0000 7f466d771700 1 --2- 172.21.15.62:0/2299872638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 0x7f4668106de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f465c004940 tx=0x7f465c009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.384+0000 7f466d771700 1 -- 172.21.15.62:0/2299872638 shutdown_connections 2024-05-09T06:35:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.384+0000 7f466d771700 1 --2- 172.21.15.62:0/2299872638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 0x7f4668106de0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.384+0000 7f466d771700 1 --2- 172.21.15.62:0/2299872638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680fde00 0x7f46680fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.384+0000 7f466d771700 1 -- 172.21.15.62:0/2299872638 >> 172.21.15.62:0/2299872638 conn(0x7f46680f7870 msgr2=0x7f46680f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.384+0000 7f466d771700 1 -- 172.21.15.62:0/2299872638 shutdown_connections 2024-05-09T06:35:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.385+0000 7f466d771700 1 -- 172.21.15.62:0/2299872638 wait complete. 2024-05-09T06:35:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.385+0000 7f466d771700 1 Processor -- start 2024-05-09T06:35:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.385+0000 7f466d771700 1 -- start start 2024-05-09T06:35:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.385+0000 7f466d771700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680fde00 0x7f4668113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.385+0000 7f466d771700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 0x7f4668113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.385+0000 7f466d771700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4668114500 con 0x7f46680fe7a0 2024-05-09T06:35:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.385+0000 7f466d771700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466810db20 con 0x7f46680fde00 2024-05-09T06:35:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f46667fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 0x7f4668113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f46667fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 0x7f4668113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51478/0 (socket says 172.21.15.62:51478) 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f46667fc700 1 -- 172.21.15.62:0/187857147 learned_addr learned my addr 172.21.15.62:0/187857147 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f4666ffd700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680fde00 0x7f4668113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f46667fc700 1 -- 172.21.15.62:0/187857147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680fde00 msgr2=0x7f4668113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f46667fc700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680fde00 0x7f4668113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f46667fc700 1 -- 172.21.15.62:0/187857147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c005040 con 0x7f46680fe7a0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f4666ffd700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680fde00 0x7f4668113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f46667fc700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 0x7f4668113eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f465c004890 tx=0x7f465c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f464f7fe700 1 -- 172.21.15.62:0/187857147 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f465c00e040 con 0x7f46680fe7a0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466810dda0 con 0x7f46680fe7a0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f464f7fe700 1 -- 172.21.15.62:0/187857147 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f465c009af0 con 0x7f46680fe7a0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f464f7fe700 1 -- 172.21.15.62:0/187857147 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f465c01c630 con 0x7f46680fe7a0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.386+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466810e2e0 con 0x7f46680fe7a0 2024-05-09T06:35:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.387+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4668066b30 con 0x7f46680fe7a0 2024-05-09T06:35:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.388+0000 7f464f7fe700 1 -- 172.21.15.62:0/187857147 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f465c00bbc0 con 0x7f46680fe7a0 2024-05-09T06:35:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.388+0000 7f464f7fe700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4650078aa0 0x7f465007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.389+0000 7f464f7fe700 1 -- 172.21.15.62:0/187857147 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f465c09bc70 con 0x7f46680fe7a0 2024-05-09T06:35:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.389+0000 7f4666ffd700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4650078aa0 0x7f465007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.389+0000 7f4666ffd700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4650078aa0 0x7f465007af50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4658009fd0 tx=0x7f465800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:15.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.393+0000 7f464f7fe700 1 -- 172.21.15.62:0/187857147 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f465c063790 con 0x7f46680fe7a0 2024-05-09T06:35:15.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.632+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4668109eb0 con 0x7f4650078aa0 2024-05-09T06:35:15.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.634+0000 7f464f7fe700 1 -- 172.21.15.62:0/187857147 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4668109eb0 con 0x7f4650078aa0 2024-05-09T06:35:15.614 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "4/21 daemons upgraded", 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mon daemons", 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:35:15.615 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4650078aa0 msgr2=0x7f465007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4650078aa0 0x7f465007af50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4658009fd0 tx=0x7f465800b040 comp rx=0 tx=0).stop 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 msgr2=0x7f4668113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 0x7f4668113eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f465c004890 tx=0x7f465c009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 shutdown_connections 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46680fde00 0x7f4668113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4650078aa0 0x7f465007af50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 --2- 172.21.15.62:0/187857147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46680fe7a0 0x7f4668113eb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 >> 172.21.15.62:0/187857147 conn(0x7f46680f7870 msgr2=0x7f46680f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 shutdown_connections 2024-05-09T06:35:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.636+0000 7f466d771700 1 -- 172.21.15.62:0/187857147 wait complete. 2024-05-09T06:35:15.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.742+0000 7efe0b861700 1 -- 172.21.15.62:0/1466888577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 msgr2=0x7efe040fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:15.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.742+0000 7efe0b861700 1 --2- 172.21.15.62:0/1466888577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 0x7efe040fcb60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdfc004940 tx=0x7efdfc009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:15.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.742+0000 7efe0b861700 1 -- 172.21.15.62:0/1466888577 shutdown_connections 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.742+0000 7efe0b861700 1 --2- 172.21.15.62:0/1466888577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe040fd0a0 0x7efe04109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.742+0000 7efe0b861700 1 --2- 172.21.15.62:0/1466888577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 0x7efe040fcb60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.742+0000 7efe0b861700 1 -- 172.21.15.62:0/1466888577 >> 172.21.15.62:0/1466888577 conn(0x7efe04071d00 msgr2=0x7efe04072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.742+0000 7efe0b861700 1 -- 172.21.15.62:0/1466888577 shutdown_connections 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.742+0000 7efe0b861700 1 -- 172.21.15.62:0/1466888577 wait complete. 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe0b861700 1 Processor -- start 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe0b861700 1 -- start start 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe0b861700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 0x7efe04115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe0b861700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe040fd0a0 0x7efe041162d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe0b861700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04116920 con 0x7efe040fc790 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe0b861700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0410fcf0 con 0x7efe040fd0a0 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe095fd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 0x7efe04115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe095fd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 0x7efe04115d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51502/0 (socket says 172.21.15.62:51502) 2024-05-09T06:35:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe095fd700 1 -- 172.21.15.62:0/2775076266 learned_addr learned my addr 172.21.15.62:0/2775076266 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe08dfc700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe040fd0a0 0x7efe041162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe095fd700 1 -- 172.21.15.62:0/2775076266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe040fd0a0 msgr2=0x7efe041162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe095fd700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe040fd0a0 0x7efe041162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.743+0000 7efe095fd700 1 -- 172.21.15.62:0/2775076266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc005040 con 0x7efe040fc790 2024-05-09T06:35:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.744+0000 7efe095fd700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 0x7efe04115d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0091a0 tx=0x7efdfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.744+0000 7efe01ffb700 1 -- 172.21.15.62:0/2775076266 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdfc00e030 con 0x7efe040fc790 2024-05-09T06:35:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.744+0000 7efe01ffb700 1 -- 172.21.15.62:0/2775076266 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdfc004290 con 0x7efe040fc790 2024-05-09T06:35:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.744+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0410ff70 con 0x7efe040fc790 2024-05-09T06:35:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.744+0000 7efe01ffb700 1 -- 172.21.15.62:0/2775076266 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdfc00b650 con 0x7efe040fc790 2024-05-09T06:35:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.744+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe041104b0 con 0x7efe040fc790 2024-05-09T06:35:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.745+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe040fc330 con 0x7efe040fc790 2024-05-09T06:35:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.746+0000 7efe01ffb700 1 -- 172.21.15.62:0/2775076266 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7efdfc013c00 con 0x7efe040fc790 2024-05-09T06:35:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.746+0000 7efe01ffb700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdec078aa0 0x7efdec07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.746+0000 7efe01ffb700 1 -- 172.21.15.62:0/2775076266 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efdfc09c400 con 0x7efe040fc790 2024-05-09T06:35:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.746+0000 7efe08dfc700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdec078aa0 0x7efdec07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.747+0000 7efe08dfc700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdec078aa0 0x7efdec07af50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efe04111630 tx=0x7efdf800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:15.751+0000 7efe01ffb700 1 -- 172.21.15.62:0/2775076266 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7efdfc063fc0 con 0x7efe040fc790 2024-05-09T06:35:15.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:15 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/276956840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:15.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:15 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2942887631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:35:15.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:15.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:15.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pdxygz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:15.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:16.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.060+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efe0404bed0 con 0x7efe040fc790 2024-05-09T06:35:16.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.060+0000 7efe01ffb700 1 -- 172.21.15.62:0/2775076266 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7efdfc063960 con 0x7efe040fc790 2024-05-09T06:35:16.041 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:16.041 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:16.041 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:16.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdec078aa0 msgr2=0x7efdec07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdec078aa0 0x7efdec07af50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efe04111630 tx=0x7efdf800b040 comp rx=0 tx=0).stop 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 msgr2=0x7efe04115d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 0x7efe04115d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0091a0 tx=0x7efdfc009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 shutdown_connections 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdec078aa0 0x7efdec07af50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe040fc790 0x7efe04115d90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 --2- 172.21.15.62:0/2775076266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe040fd0a0 0x7efe041162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.062+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 >> 172.21.15.62:0/2775076266 conn(0x7efe04071d00 msgr2=0x7efe040f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.063+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 shutdown_connections 2024-05-09T06:35:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:16.063+0000 7efe0b861700 1 -- 172.21.15.62:0/2775076266 wait complete. 2024-05-09T06:35:16.078 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:15 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/276956840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:16.078 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:15 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2942887631' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:35:16.078 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:16.078 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:16.079 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pdxygz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:16.079 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:17.026 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:16 smithi079 ceph-mon[82381]: Reconfiguring mds.cephfs.smithi079.pdxygz (monmap changed)... 2024-05-09T06:35:17.026 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:16 smithi079 ceph-mon[82381]: Reconfiguring daemon mds.cephfs.smithi079.pdxygz on smithi079 2024-05-09T06:35:17.026 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:16 smithi079 ceph-mon[82381]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:17.026 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:16 smithi079 ceph-mon[82381]: pgmap v29: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:17.026 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:16 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2775076266' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:35:17.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:16 smithi062 ceph-mon[109590]: Reconfiguring mds.cephfs.smithi079.pdxygz (monmap changed)... 2024-05-09T06:35:17.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:16 smithi062 ceph-mon[109590]: Reconfiguring daemon mds.cephfs.smithi079.pdxygz on smithi079 2024-05-09T06:35:17.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:16 smithi062 ceph-mon[109590]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:17.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:16 smithi062 ceph-mon[109590]: pgmap v29: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:17.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:16 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2775076266' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all mon 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi062"}]: dispatch 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi062"}]': finished 2024-05-09T06:35:18.306 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi079"}]: dispatch 2024-05-09T06:35:18.307 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi079"}]': finished 2024-05-09T06:35:18.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all mon 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi062"}]: dispatch 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi062"}]': finished 2024-05-09T06:35:18.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi079"}]: dispatch 2024-05-09T06:35:18.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi079"}]': finished 2024-05-09T06:35:19.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:19 smithi062 ceph-mon[109590]: pgmap v30: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:19.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:19 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:19.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:19 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi062", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:19.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:19 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:19.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:19 smithi079 ceph-mon[82381]: pgmap v30: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:19.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:19 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:19.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:19 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi062", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:19.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:19 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:20.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:20 smithi062 ceph-mon[109590]: Upgrade: Updating crash.smithi062 (1/2) 2024-05-09T06:35:20.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:20 smithi062 ceph-mon[109590]: Deploying daemon crash.smithi062 on smithi062 2024-05-09T06:35:20.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:20 smithi079 ceph-mon[82381]: Upgrade: Updating crash.smithi062 (1/2) 2024-05-09T06:35:20.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:20 smithi079 ceph-mon[82381]: Deploying daemon crash.smithi062 on smithi062 2024-05-09T06:35:21.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:21 smithi062 ceph-mon[109590]: pgmap v31: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:21.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:21 smithi079 ceph-mon[82381]: pgmap v31: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:23.394 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:23 smithi079 ceph-mon[82381]: pgmap v32: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:23.395 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:23 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:23.395 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:23 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:23.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:23 smithi062 ceph-mon[109590]: pgmap v32: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:23.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:23 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:23.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:23 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:24.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:24.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:25.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:25 smithi079 ceph-mon[82381]: pgmap v33: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:25.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:25.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:25.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:25 smithi062 ceph-mon[109590]: pgmap v33: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:25.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:26.306 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:26 smithi079 ceph-mon[82381]: Upgrade: Updating crash.smithi079 (2/2) 2024-05-09T06:35:26.307 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:26 smithi079 ceph-mon[82381]: Deploying daemon crash.smithi079 on smithi079 2024-05-09T06:35:26.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:26 smithi062 ceph-mon[109590]: Upgrade: Updating crash.smithi079 (2/2) 2024-05-09T06:35:26.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:26 smithi062 ceph-mon[109590]: Deploying daemon crash.smithi079 on smithi079 2024-05-09T06:35:27.329 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:27 smithi079 ceph-mon[82381]: pgmap v34: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:27.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:27 smithi062 ceph-mon[109590]: pgmap v34: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:29.179 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:29 smithi079 ceph-mon[82381]: pgmap v35: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:29.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:29 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:29.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:29 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:29.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:29 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:29.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:29 smithi062 ceph-mon[109590]: pgmap v35: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:29.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:29.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:29.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:31 smithi062 ceph-mon[109590]: pgmap v36: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:31 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:31 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:31.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:31 smithi079 ceph-mon[82381]: pgmap v36: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:31.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:31 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:31.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:31 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:33.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:32 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:33.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:32 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:33.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:32 smithi079 ceph-mon[82381]: pgmap v37: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:32 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:32 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:32 smithi062 ceph-mon[109590]: pgmap v37: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:34.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:34 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:34.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:34 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:34.505 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:34 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:34.505 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:34 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:35 smithi079 ceph-mon[82381]: pgmap v38: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:35 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:35 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:35 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:35.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:35 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:35.635 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:35 smithi062 ceph-mon[109590]: pgmap v38: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:35.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:35.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:35.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:35.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:37.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:37 smithi079 ceph-mon[82381]: pgmap v39: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:37.594 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:37 smithi062 ceph-mon[109590]: pgmap v39: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:38.996 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: pgmap v40: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all crash 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi062"}]: dispatch 2024-05-09T06:35:38.997 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi062"}]': finished 2024-05-09T06:35:38.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi079"}]: dispatch 2024-05-09T06:35:38.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi079"}]': finished 2024-05-09T06:35:38.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T06:35:38.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T06:35:38.998 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:38 smithi062 ceph-mon[109590]: Upgrade: osd.0 is safe to restart 2024-05-09T06:35:39.221 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:39.221 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:39.221 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:39.221 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:35:39.221 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:39.221 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: pgmap v40: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:39.221 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:39.221 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all crash 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi062"}]: dispatch 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi062"}]': finished 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi079"}]: dispatch 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi079"}]': finished 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T06:35:39.222 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:38 smithi079 ceph-mon[82381]: Upgrade: osd.0 is safe to restart 2024-05-09T06:35:40.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:40.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:40.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:35:40.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:40.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:40.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:40.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:35:40.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:41.293 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:40 smithi062 ceph-mon[109590]: Upgrade: Updating osd.0 2024-05-09T06:35:41.293 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:40 smithi062 ceph-mon[109590]: Deploying daemon osd.0 on smithi062 2024-05-09T06:35:41.294 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:40 smithi062 ceph-mon[109590]: pgmap v41: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:41.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:40 smithi079 ceph-mon[82381]: Upgrade: Updating osd.0 2024-05-09T06:35:41.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:40 smithi079 ceph-mon[82381]: Deploying daemon osd.0 on smithi062 2024-05-09T06:35:41.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:40 smithi079 ceph-mon[82381]: pgmap v41: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:43.281 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:43 smithi062 ceph-mon[109590]: pgmap v42: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:43.282 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:43 smithi062 systemd[1]: Stopping Ceph osd.0 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:35:43.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:43 smithi079 ceph-mon[82381]: pgmap v42: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:43.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:43 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[45168]: 2024-05-09T06:35:43.299+0000 7f8ffd90a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:35:43.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:43 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[45168]: 2024-05-09T06:35:43.299+0000 7f8ffd90a700 -1 osd.0 49 *** Got signal Terminated *** 2024-05-09T06:35:43.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:43 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[45168]: 2024-05-09T06:35:43.299+0000 7f8ffd90a700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:35:44.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:44 smithi079 ceph-mon[82381]: osd.0 marked itself down and dead 2024-05-09T06:35:44.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:44 smithi062 ceph-mon[109590]: osd.0 marked itself down and dead 2024-05-09T06:35:44.874 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:44 smithi062 podman[120613]: 2024-05-09 06:35:44.60763661 +0000 UTC m=+1.419645830 container died ba4ad4af64f37f209682563a99aa003caa02df3953879af10888d944edd2e5fa (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, RELEASE=quincy-4ba5a83, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-05-09T06:35:45.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:45 smithi062 ceph-mon[109590]: pgmap v43: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:45.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:45 smithi062 ceph-mon[109590]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:35:45.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:45 smithi062 ceph-mon[109590]: osdmap e50: 6 total, 5 up, 6 in 2024-05-09T06:35:45.161 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:44 smithi062 podman[120613]: 2024-05-09 06:35:44.966475137 +0000 UTC m=+1.778484357 container cleanup ba4ad4af64f37f209682563a99aa003caa02df3953879af10888d944edd2e5fa (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, org.label-schema.build-date=20240507, RELEASE=quincy-4ba5a83, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:35:45.162 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:44 smithi062 bash[120613]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0 2024-05-09T06:35:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:45 smithi079 ceph-mon[82381]: pgmap v43: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:45 smithi079 ceph-mon[82381]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:35:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:45 smithi079 ceph-mon[82381]: osdmap e50: 6 total, 5 up, 6 in 2024-05-09T06:35:45.640 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:45 smithi062 podman[120630]: 2024-05-09 06:35:45.30517384 +0000 UTC m=+0.688391598 container remove ba4ad4af64f37f209682563a99aa003caa02df3953879af10888d944edd2e5fa (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=quincy-4ba5a83) 2024-05-09T06:35:45.911 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:45 smithi062 podman[120722]: 2024-05-09 06:35:45.563477061 +0000 UTC m=+0.019037885 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:35:45.911 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:45 smithi062 podman[120722]: 2024-05-09 06:35:45.677907203 +0000 UTC m=+0.133468028 container create d02a77c098eaa53608a846ce41176eaacd58a56f232666a513106721a20050c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-09T06:35:46.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.173+0000 7f755b69e700 1 -- 172.21.15.62:0/1984050478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7554101d90 msgr2=0x7f7554102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.173+0000 7f755b69e700 1 --2- 172.21.15.62:0/1984050478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7554101d90 0x7f7554102160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7550004940 tx=0x7f7550009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.173+0000 7f755b69e700 1 -- 172.21.15.62:0/1984050478 shutdown_connections 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.173+0000 7f755b69e700 1 --2- 172.21.15.62:0/1984050478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75540fbd40 0x7f75540fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.173+0000 7f755b69e700 1 --2- 172.21.15.62:0/1984050478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7554101d90 0x7f7554102160 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.173+0000 7f755b69e700 1 -- 172.21.15.62:0/1984050478 >> 172.21.15.62:0/1984050478 conn(0x7f7554071d00 msgr2=0x7f7554072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.174+0000 7f755b69e700 1 -- 172.21.15.62:0/1984050478 shutdown_connections 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.174+0000 7f755b69e700 1 -- 172.21.15.62:0/1984050478 wait complete. 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.174+0000 7f755b69e700 1 Processor -- start 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.174+0000 7f755b69e700 1 -- start start 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.174+0000 7f755b69e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75540fbd40 0x7f755410eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.174+0000 7f755b69e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7554101d90 0x7f755410f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.174+0000 7f755b69e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755410f7b0 con 0x7f75540fbd40 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.174+0000 7f755b69e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755410f8f0 con 0x7f7554101d90 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f755943a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75540fbd40 0x7f755410eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f755943a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75540fbd40 0x7f755410eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50840/0 (socket says 172.21.15.62:50840) 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f755943a700 1 -- 172.21.15.62:0/2366366295 learned_addr learned my addr 172.21.15.62:0/2366366295 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f7558c39700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7554101d90 0x7f755410f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f755943a700 1 -- 172.21.15.62:0/2366366295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7554101d90 msgr2=0x7f755410f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f755943a700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7554101d90 0x7f755410f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f755943a700 1 -- 172.21.15.62:0/2366366295 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550005040 con 0x7f75540fbd40 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f755943a700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75540fbd40 0x7f755410eca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7550009150 tx=0x7f7550009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:46.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f7549ffb700 1 -- 172.21.15.62:0/2366366295 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755000e040 con 0x7f75540fbd40 2024-05-09T06:35:46.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7554117bb0 con 0x7f75540fbd40 2024-05-09T06:35:46.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f7549ffb700 1 -- 172.21.15.62:0/2366366295 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7550013420 con 0x7f75540fbd40 2024-05-09T06:35:46.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.175+0000 7f7549ffb700 1 -- 172.21.15.62:0/2366366295 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755001c610 con 0x7f75540fbd40 2024-05-09T06:35:46.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.176+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7554118140 con 0x7f75540fbd40 2024-05-09T06:35:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.176+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75540fd430 con 0x7f75540fbd40 2024-05-09T06:35:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.178+0000 7f7549ffb700 1 -- 172.21.15.62:0/2366366295 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f755000baf0 con 0x7f75540fbd40 2024-05-09T06:35:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.178+0000 7f7549ffb700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7540078aa0 0x7f754007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.179+0000 7f7549ffb700 1 -- 172.21.15.62:0/2366366295 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f755009bbb0 con 0x7f75540fbd40 2024-05-09T06:35:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.179+0000 7f7558c39700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7540078aa0 0x7f754007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.179+0000 7f7558c39700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7540078aa0 0x7f754007af50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7554066040 tx=0x7f75440091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:46.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.184+0000 7f7549ffb700 1 -- 172.21.15.62:0/2366366295 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f75500a2080 con 0x7f75540fbd40 2024-05-09T06:35:46.330 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:46 smithi062 ceph-mon[109590]: osdmap e51: 6 total, 5 up, 6 in 2024-05-09T06:35:46.330 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:46 smithi062 podman[120722]: 2024-05-09 06:35:46.030913411 +0000 UTC m=+0.486474236 container init d02a77c098eaa53608a846ce41176eaacd58a56f232666a513106721a20050c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T06:35:46.330 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:46 smithi062 podman[120722]: 2024-05-09 06:35:46.034638828 +0000 UTC m=+0.490199652 container start d02a77c098eaa53608a846ce41176eaacd58a56f232666a513106721a20050c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-09T06:35:46.330 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:46 smithi062 podman[120722]: 2024-05-09 06:35:46.130771261 +0000 UTC m=+0.586332094 container attach d02a77c098eaa53608a846ce41176eaacd58a56f232666a513106721a20050c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-09T06:35:46.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:46 smithi079 ceph-mon[82381]: osdmap e51: 6 total, 5 up, 6 in 2024-05-09T06:35:46.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.421+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7554065df0 con 0x7f7540078aa0 2024-05-09T06:35:46.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.422+0000 7f7549ffb700 1 -- 172.21.15.62:0/2366366295 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7554065df0 con 0x7f7540078aa0 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7540078aa0 msgr2=0x7f754007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7540078aa0 0x7f754007af50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7554066040 tx=0x7f75440091a0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75540fbd40 msgr2=0x7f755410eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75540fbd40 0x7f755410eca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7550009150 tx=0x7f7550009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 shutdown_connections 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7540078aa0 0x7f754007af50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75540fbd40 0x7f755410eca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 --2- 172.21.15.62:0/2366366295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7554101d90 0x7f755410f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 >> 172.21.15.62:0/2366366295 conn(0x7f7554071d00 msgr2=0x7f75540fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 shutdown_connections 2024-05-09T06:35:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.425+0000 7f755b69e700 1 -- 172.21.15.62:0/2366366295 wait complete. 2024-05-09T06:35:46.417 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:35:46.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.532+0000 7fe20b01f700 1 -- 172.21.15.62:0/3786843219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204102df0 msgr2=0x7fe2041031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.532+0000 7fe20b01f700 1 --2- 172.21.15.62:0/3786843219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204102df0 0x7fe2041031c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec004940 tx=0x7fe1ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 -- 172.21.15.62:0/3786843219 shutdown_connections 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 --2- 172.21.15.62:0/3786843219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe204103790 0x7fe2040fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 --2- 172.21.15.62:0/3786843219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204102df0 0x7fe2041031c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 -- 172.21.15.62:0/3786843219 >> 172.21.15.62:0/3786843219 conn(0x7fe2040f8980 msgr2=0x7fe2040fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 -- 172.21.15.62:0/3786843219 shutdown_connections 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 -- 172.21.15.62:0/3786843219 wait complete. 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 Processor -- start 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 -- start start 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.533+0000 7fe20b01f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe204102df0 0x7fe204070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe20b01f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204103790 0x7fe2040707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe20b01f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204070d30 con 0x7fe204103790 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe20b01f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204070e70 con 0x7fe204102df0 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe203fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204103790 0x7fe2040707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe203fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204103790 0x7fe2040707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50860/0 (socket says 172.21.15.62:50860) 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe203fff700 1 -- 172.21.15.62:0/1228683819 learned_addr learned my addr 172.21.15.62:0/1228683819 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe208dbb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe204102df0 0x7fe204070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe203fff700 1 -- 172.21.15.62:0/1228683819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe204102df0 msgr2=0x7fe204070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe203fff700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe204102df0 0x7fe204070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe203fff700 1 -- 172.21.15.62:0/1228683819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec005040 con 0x7fe204103790 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe203fff700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204103790 0x7fe2040707a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400cae0 tx=0x7fe1f4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe2017fa700 1 -- 172.21.15.62:0/1228683819 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1f400a980 con 0x7fe204103790 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe2017fa700 1 -- 172.21.15.62:0/1228683819 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1f4012440 con 0x7fe204103790 2024-05-09T06:35:46.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe204119e80 con 0x7fe204103790 2024-05-09T06:35:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe2017fa700 1 -- 172.21.15.62:0/1228683819 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1f40115c0 con 0x7fe204103790 2024-05-09T06:35:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.534+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20411a300 con 0x7fe204103790 2024-05-09T06:35:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.536+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe204100100 con 0x7fe204103790 2024-05-09T06:35:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.536+0000 7fe2017fa700 1 -- 172.21.15.62:0/1228683819 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fe1f4012a50 con 0x7fe204103790 2024-05-09T06:35:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.537+0000 7fe2017fa700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe1f0078aa0 0x7fe1f007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.537+0000 7fe2017fa700 1 -- 172.21.15.62:0/1228683819 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe1f409add0 con 0x7fe204103790 2024-05-09T06:35:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.537+0000 7fe208dbb700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe1f0078aa0 0x7fe1f007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.537+0000 7fe208dbb700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe1f0078aa0 0x7fe1f007af50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec004f90 tx=0x7fe1ec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:46.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.542+0000 7fe2017fa700 1 -- 172.21.15.62:0/1228683819 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fe1f4062a00 con 0x7fe204103790 2024-05-09T06:35:46.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:46 smithi062 podman[120722]: 2024-05-09 06:35:46.350221576 +0000 UTC m=+0.805782412 container died d02a77c098eaa53608a846ce41176eaacd58a56f232666a513106721a20050c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9) 2024-05-09T06:35:46.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.777+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe204109ef0 con 0x7fe1f0078aa0 2024-05-09T06:35:46.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.779+0000 7fe2017fa700 1 -- 172.21.15.62:0/1228683819 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe204109ef0 con 0x7fe1f0078aa0 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe1f0078aa0 msgr2=0x7fe1f007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe1f0078aa0 0x7fe1f007af50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec004f90 tx=0x7fe1ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204103790 msgr2=0x7fe2040707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204103790 0x7fe2040707a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400cae0 tx=0x7fe1f4007f60 comp rx=0 tx=0).stop 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 shutdown_connections 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe204102df0 0x7fe204070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe1f0078aa0 0x7fe1f007af50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 --2- 172.21.15.62:0/1228683819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe204103790 0x7fe2040707a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 >> 172.21.15.62:0/1228683819 conn(0x7fe2040f8980 msgr2=0x7fe204107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:46.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 shutdown_connections 2024-05-09T06:35:46.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.781+0000 7fe20b01f700 1 -- 172.21.15.62:0/1228683819 wait complete. 2024-05-09T06:35:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.887+0000 7f905d7c6700 1 -- 172.21.15.62:0/333795368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 msgr2=0x7f9058109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.887+0000 7f905d7c6700 1 --2- 172.21.15.62:0/333795368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 0x7f9058109180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9040004940 tx=0x7f9040009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.887+0000 7f905d7c6700 1 -- 172.21.15.62:0/333795368 shutdown_connections 2024-05-09T06:35:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.887+0000 7f905d7c6700 1 --2- 172.21.15.62:0/333795368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 0x7f9058109180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.887+0000 7f905d7c6700 1 --2- 172.21.15.62:0/333795368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9058070280 0x7f9058070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.887+0000 7f905d7c6700 1 -- 172.21.15.62:0/333795368 >> 172.21.15.62:0/333795368 conn(0x7f90580f8980 msgr2=0x7f90580fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:46.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.887+0000 7f905d7c6700 1 -- 172.21.15.62:0/333795368 shutdown_connections 2024-05-09T06:35:46.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.887+0000 7f905d7c6700 1 -- 172.21.15.62:0/333795368 wait complete. 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f905d7c6700 1 Processor -- start 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f905d7c6700 1 -- start start 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f905d7c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9058070280 0x7f9058115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f905d7c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 0x7f9058116330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f905d7c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058116980 con 0x7f9058070b90 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f905d7c6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905810fd50 con 0x7f9058070280 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f904e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 0x7f9058116330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f904e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 0x7f9058116330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50890/0 (socket says 172.21.15.62:50890) 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f904e7fc700 1 -- 172.21.15.62:0/1684490006 learned_addr learned my addr 172.21.15.62:0/1684490006 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.888+0000 7f9056ffd700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9058070280 0x7f9058115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f904e7fc700 1 -- 172.21.15.62:0/1684490006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9058070280 msgr2=0x7f9058115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:46.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f904e7fc700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9058070280 0x7f9058115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:46.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f904e7fc700 1 -- 172.21.15.62:0/1684490006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040005040 con 0x7f9058070b90 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f904e7fc700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 0x7f9058116330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f904000b3b0 tx=0x7f9040009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f904ffff700 1 -- 172.21.15.62:0/1684490006 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f904000e040 con 0x7f9058070b90 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905810ffd0 con 0x7f9058070b90 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f904ffff700 1 -- 172.21.15.62:0/1684490006 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9040013420 con 0x7f9058070b90 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f904ffff700 1 -- 172.21.15.62:0/1684490006 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f904001c630 con 0x7f9058070b90 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.889+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9058110510 con 0x7f9058070b90 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.890+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90580719c0 con 0x7f9058070b90 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.891+0000 7f904ffff700 1 -- 172.21.15.62:0/1684490006 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f9040013590 con 0x7f9058070b90 2024-05-09T06:35:46.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.891+0000 7f904ffff700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9044078aa0 0x7f904407af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:46.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.891+0000 7f904ffff700 1 -- 172.21.15.62:0/1684490006 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f904009bb10 con 0x7f9058070b90 2024-05-09T06:35:46.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.891+0000 7f9056ffd700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9044078aa0 0x7f904407af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:46.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.892+0000 7f9056ffd700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9044078aa0 0x7f904407af50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9048004f40 tx=0x7f904800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:46.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:46.896+0000 7f904ffff700 1 -- 172.21.15.62:0/1684490006 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f9040063630 con 0x7f9058070b90 2024-05-09T06:35:47.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.145+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f905810c0d0 con 0x7f9044078aa0 2024-05-09T06:35:47.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.155+0000 7f904ffff700 1 -- 172.21.15.62:0/1684490006 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f905810c0d0 con 0x7f9044078aa0 2024-05-09T06:35:47.136 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (2m) 13s ago 14m 26.3M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (24s) 13s ago 14m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (19s) 16s ago 13m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (2m) 13s ago 13m 76.7M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (8m) 13s ago 8m 16.3M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (8m) 13s ago 8m 152M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (8m) 16s ago 8m 15.8M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (8m) 16s ago 8m 15.7M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (4m) 13s ago 15m 511M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (3m) 16s ago 12m 464M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (94s) 13s ago 15m 41.7M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (66s) 16s ago 12m 33.9M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (3m) 13s ago 14m 14.7M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:35:47.137 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (3m) 16s ago 13m 17.7M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (12m) 13s ago 12m 248M 1557M 17.2.7-933-g4ba5a836 b96134859c76 ba4ad4af64f3 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (11m) 13s ago 11m 262M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (11m) 13s ago 11m 220M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (10m) 16s ago 10m 284M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (10m) 16s ago 10m 253M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (9m) 16s ago 9m 248M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (3m) 13s ago 13m 65.7M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9044078aa0 msgr2=0x7f904407af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9044078aa0 0x7f904407af50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9048004f40 tx=0x7f904800b040 comp rx=0 tx=0).stop 2024-05-09T06:35:47.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 msgr2=0x7f9058116330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 0x7f9058116330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f904000b3b0 tx=0x7f9040009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:47.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 shutdown_connections 2024-05-09T06:35:47.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9058070280 0x7f9058115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9044078aa0 0x7f904407af50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 --2- 172.21.15.62:0/1684490006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9058070b90 0x7f9058116330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 >> 172.21.15.62:0/1684490006 conn(0x7f90580f8980 msgr2=0x7f90580f9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:47.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 shutdown_connections 2024-05-09T06:35:47.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.158+0000 7f905d7c6700 1 -- 172.21.15.62:0/1684490006 wait complete. 2024-05-09T06:35:47.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.271+0000 7fd106ac2700 1 -- 172.21.15.62:0/2667072922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100102de0 msgr2=0x7fd1001031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.271+0000 7fd106ac2700 1 --2- 172.21.15.62:0/2667072922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100102de0 0x7fd1001031b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8004940 tx=0x7fd0e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:47.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.271+0000 7fd106ac2700 1 -- 172.21.15.62:0/2667072922 shutdown_connections 2024-05-09T06:35:47.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.271+0000 7fd106ac2700 1 --2- 172.21.15.62:0/2667072922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd100103780 0x7fd1000fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.271+0000 7fd106ac2700 1 --2- 172.21.15.62:0/2667072922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100102de0 0x7fd1001031b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.271+0000 7fd106ac2700 1 -- 172.21.15.62:0/2667072922 >> 172.21.15.62:0/2667072922 conn(0x7fd1000f8950 msgr2=0x7fd1000fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:47.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.271+0000 7fd106ac2700 1 -- 172.21.15.62:0/2667072922 shutdown_connections 2024-05-09T06:35:47.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.272+0000 7fd106ac2700 1 -- 172.21.15.62:0/2667072922 wait complete. 2024-05-09T06:35:47.254 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:47 smithi062 ceph-mon[109590]: pgmap v46: 65 pgs: 34 peering, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:47.254 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:47 smithi062 ceph-mon[109590]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-05-09T06:35:47.254 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:47 smithi062 ceph-mon[109590]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:47.254 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:46 smithi062 podman[120771]: 2024-05-09 06:35:46.993538828 +0000 UTC m=+0.633249433 container remove d02a77c098eaa53608a846ce41176eaacd58a56f232666a513106721a20050c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T06:35:47.254 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.0.service: Deactivated successfully. 2024-05-09T06:35:47.254 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 systemd[1]: Stopped Ceph osd.0 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:35:47.254 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.0.service: Consumed 1min 2.495s CPU time. 2024-05-09T06:35:47.255 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 systemd[1]: Starting Ceph osd.0 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.272+0000 7fd106ac2700 1 Processor -- start 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.272+0000 7fd106ac2700 1 -- start start 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.273+0000 7fd106ac2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd100102de0 0x7fd100113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.273+0000 7fd106ac2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100103780 0x7fd100114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.273+0000 7fd106ac2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd100114680 con 0x7fd100103780 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.273+0000 7fd106ac2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10010da70 con 0x7fd100102de0 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.273+0000 7fd10485e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd100102de0 0x7fd100113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.273+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100103780 0x7fd100114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:47.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.273+0000 7fd10485e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd100102de0 0x7fd100113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:36858/0 (socket says 172.21.15.62:36858) 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.273+0000 7fd10485e700 1 -- 172.21.15.62:0/73547194 learned_addr learned my addr 172.21.15.62:0/73547194 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd10485e700 1 -- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100103780 msgr2=0x7fd100114030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd10485e700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100103780 0x7fd100114030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd10485e700 1 -- 172.21.15.62:0/73547194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8005040 con 0x7fd100102de0 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd0fffff700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100103780 0x7fd100114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd10485e700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd100102de0 0x7fd100113af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8009b30 tx=0x7fd0e8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd0fd7fa700 1 -- 172.21.15.62:0/73547194 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0e800e070 con 0x7fd100102de0 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd0fd7fa700 1 -- 172.21.15.62:0/73547194 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0e8013cd0 con 0x7fd100102de0 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd0fd7fa700 1 -- 172.21.15.62:0/73547194 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0e800b720 con 0x7fd100102de0 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10010dcf0 con 0x7fd100102de0 2024-05-09T06:35:47.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.274+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10010e110 con 0x7fd100102de0 2024-05-09T06:35:47.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.276+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1001000f0 con 0x7fd100102de0 2024-05-09T06:35:47.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.276+0000 7fd0fd7fa700 1 -- 172.21.15.62:0/73547194 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fd0e801cab0 con 0x7fd100102de0 2024-05-09T06:35:47.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.277+0000 7fd0fd7fa700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd0ec078aa0 0x7fd0ec07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:47.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.277+0000 7fd0fd7fa700 1 -- 172.21.15.62:0/73547194 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd0e809c1b0 con 0x7fd100102de0 2024-05-09T06:35:47.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.277+0000 7fd0fffff700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd0ec078aa0 0x7fd0ec07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:47.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.278+0000 7fd0fffff700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd0ec078aa0 0x7fd0ec07af50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd10010ec30 tx=0x7fd0f000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.282+0000 7fd0fd7fa700 1 -- 172.21.15.62:0/73547194 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fd0e8063d70 con 0x7fd100102de0 2024-05-09T06:35:47.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:47 smithi079 ceph-mon[82381]: pgmap v46: 65 pgs: 34 peering, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:47.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:47 smithi079 ceph-mon[82381]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-05-09T06:35:47.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:47 smithi079 ceph-mon[82381]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:47.579 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 podman[120943]: 2024-05-09 06:35:47.372193782 +0000 UTC m=+0.019245712 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:35:47.579 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 podman[120943]: 2024-05-09 06:35:47.49494045 +0000 UTC m=+0.141992361 container create a7ab38a7704d5f63e88c02c8a8c8d806310a09ff92f38f4d1e8427da85450de0 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-09T06:35:47.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.597+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd10010f140 con 0x7fd100102de0 2024-05-09T06:35:47.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.598+0000 7fd0fd7fa700 1 -- 172.21.15.62:0/73547194 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fd0e8004490 con 0x7fd100102de0 2024-05-09T06:35:47.579 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 5 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 9, 2024-05-09T06:35:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:35:47.581 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:35:47.581 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:35:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd0ec078aa0 msgr2=0x7fd0ec07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd0ec078aa0 0x7fd0ec07af50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd10010ec30 tx=0x7fd0f000b040 comp rx=0 tx=0).stop 2024-05-09T06:35:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd100102de0 msgr2=0x7fd100113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd100102de0 0x7fd100113af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8009b30 tx=0x7fd0e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 shutdown_connections 2024-05-09T06:35:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd100102de0 0x7fd100113af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd0ec078aa0 0x7fd0ec07af50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 --2- 172.21.15.62:0/73547194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd100103780 0x7fd100114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 >> 172.21.15.62:0/73547194 conn(0x7fd1000f8950 msgr2=0x7fd100107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 shutdown_connections 2024-05-09T06:35:47.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.601+0000 7fd106ac2700 1 -- 172.21.15.62:0/73547194 wait complete. 2024-05-09T06:35:47.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.709+0000 7fd65f629700 1 -- 172.21.15.62:0/1587808661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658065640 msgr2=0x7fd658065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.709+0000 7fd65f629700 1 --2- 172.21.15.62:0/1587808661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658065640 0x7fd658065ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd648004940 tx=0x7fd648009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:47.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.709+0000 7fd65f629700 1 -- 172.21.15.62:0/1587808661 shutdown_connections 2024-05-09T06:35:47.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.709+0000 7fd65f629700 1 --2- 172.21.15.62:0/1587808661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658065640 0x7fd658065ab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.709+0000 7fd65f629700 1 --2- 172.21.15.62:0/1587808661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd658102e50 0x7fd658103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.709+0000 7fd65f629700 1 -- 172.21.15.62:0/1587808661 >> 172.21.15.62:0/1587808661 conn(0x7fd658071d00 msgr2=0x7fd658072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:47.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.709+0000 7fd65f629700 1 -- 172.21.15.62:0/1587808661 shutdown_connections 2024-05-09T06:35:47.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.709+0000 7fd65f629700 1 -- 172.21.15.62:0/1587808661 wait complete. 2024-05-09T06:35:47.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.710+0000 7fd65f629700 1 Processor -- start 2024-05-09T06:35:47.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.710+0000 7fd65f629700 1 -- start start 2024-05-09T06:35:47.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.710+0000 7fd65f629700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd658065640 0x7fd658115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.710+0000 7fd65f629700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658102e50 0x7fd6581162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.710+0000 7fd65f629700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd658116910 con 0x7fd658102e50 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.710+0000 7fd65f629700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65810fce0 con 0x7fd658065640 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.710+0000 7fd65cbc4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658102e50 0x7fd6581162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd65cbc4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658102e50 0x7fd6581162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50926/0 (socket says 172.21.15.62:50926) 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd65cbc4700 1 -- 172.21.15.62:0/2428191668 learned_addr learned my addr 172.21.15.62:0/2428191668 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd65d3c5700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd658065640 0x7fd658115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd65cbc4700 1 -- 172.21.15.62:0/2428191668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd658065640 msgr2=0x7fd658115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd65cbc4700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd658065640 0x7fd658115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd65cbc4700 1 -- 172.21.15.62:0/2428191668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd648005040 con 0x7fd658102e50 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd65cbc4700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658102e50 0x7fd6581162c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd64800b3b0 tx=0x7fd648009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd64dffb700 1 -- 172.21.15.62:0/2428191668 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64800e040 con 0x7fd658102e50 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd64dffb700 1 -- 172.21.15.62:0/2428191668 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd648013420 con 0x7fd658102e50 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd64dffb700 1 -- 172.21.15.62:0/2428191668 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64801c630 con 0x7fd658102e50 2024-05-09T06:35:47.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.711+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65810ff60 con 0x7fd658102e50 2024-05-09T06:35:47.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.712+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd658110520 con 0x7fd658102e50 2024-05-09T06:35:47.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.713+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd658106960 con 0x7fd658102e50 2024-05-09T06:35:47.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.713+0000 7fd64dffb700 1 -- 172.21.15.62:0/2428191668 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fd648013590 con 0x7fd658102e50 2024-05-09T06:35:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.714+0000 7fd64dffb700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd644078aa0 0x7fd64407af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.714+0000 7fd64dffb700 1 -- 172.21.15.62:0/2428191668 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd64809ba00 con 0x7fd658102e50 2024-05-09T06:35:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.714+0000 7fd65d3c5700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd644078aa0 0x7fd64407af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.714+0000 7fd65d3c5700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd644078aa0 0x7fd64407af50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd654004f40 tx=0x7fd65400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:47.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.719+0000 7fd64dffb700 1 -- 172.21.15.62:0/2428191668 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fd6480635c0 con 0x7fd658102e50 2024-05-09T06:35:47.911 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 podman[120943]: 2024-05-09 06:35:47.706221305 +0000 UTC m=+0.353273217 container init a7ab38a7704d5f63e88c02c8a8c8d806310a09ff92f38f4d1e8427da85450de0 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-09T06:35:47.911 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 podman[120943]: 2024-05-09 06:35:47.710510145 +0000 UTC m=+0.357562072 container start a7ab38a7704d5f63e88c02c8a8c8d806310a09ff92f38f4d1e8427da85450de0 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:35:47.911 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:47 smithi062 podman[120943]: 2024-05-09 06:35:47.806280883 +0000 UTC m=+0.453332811 container attach a7ab38a7704d5f63e88c02c8a8c8d806310a09ff92f38f4d1e8427da85450de0 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-05-09T06:35:47.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.983+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd658106960 con 0x7fd658102e50 2024-05-09T06:35:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.983+0000 7fd64dffb700 1 -- 172.21.15.62:0/2428191668 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1872 (secure 0 0 0) 0x7fd648062f60 con 0x7fd658102e50 2024-05-09T06:35:47.965 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:35:47.965 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:35:47.965 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:47.965 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:35:47.965 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:35:47.965 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:35:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:35:47.967 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:47.968 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:35:47.968 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:35:47.968 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:35:47.968 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:35:47.968 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:47.968 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:47.968 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd644078aa0 msgr2=0x7fd64407af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd644078aa0 0x7fd64407af50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd654004f40 tx=0x7fd65400b040 comp rx=0 tx=0).stop 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658102e50 msgr2=0x7fd6581162c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658102e50 0x7fd6581162c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd64800b3b0 tx=0x7fd648009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 shutdown_connections 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd658065640 0x7fd658115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd644078aa0 0x7fd64407af50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 --2- 172.21.15.62:0/2428191668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd658102e50 0x7fd6581162c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:47.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 >> 172.21.15.62:0/2428191668 conn(0x7fd658071d00 msgr2=0x7fd6580fae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:47.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 shutdown_connections 2024-05-09T06:35:47.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:47.986+0000 7fd65f629700 1 -- 172.21.15.62:0/2428191668 wait complete. 2024-05-09T06:35:47.970 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:35:48.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.097+0000 7f9032fd9700 1 -- 172.21.15.62:0/358483733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c0fbd40 msgr2=0x7f902c0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.097+0000 7f9032fd9700 1 --2- 172.21.15.62:0/358483733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c0fbd40 0x7f902c0fc1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9018004940 tx=0x7f9018009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.097+0000 7f9032fd9700 1 -- 172.21.15.62:0/358483733 shutdown_connections 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.097+0000 7f9032fd9700 1 --2- 172.21.15.62:0/358483733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c0fbd40 0x7f902c0fc1b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.097+0000 7f9032fd9700 1 --2- 172.21.15.62:0/358483733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902c101d90 0x7f902c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.097+0000 7f9032fd9700 1 -- 172.21.15.62:0/358483733 >> 172.21.15.62:0/358483733 conn(0x7f902c071d00 msgr2=0x7f902c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.097+0000 7f9032fd9700 1 -- 172.21.15.62:0/358483733 shutdown_connections 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.097+0000 7f9032fd9700 1 -- 172.21.15.62:0/358483733 wait complete. 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f9032fd9700 1 Processor -- start 2024-05-09T06:35:48.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f9032fd9700 1 -- start start 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f9032fd9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902c0fbd40 0x7f902c113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f9032fd9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c101d90 0x7f902c1140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f9032fd9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c114740 con 0x7f902c101d90 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f9032fd9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c10db30 con 0x7f902c0fbd40 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f902bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c101d90 0x7f902c1140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f902bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c101d90 0x7f902c1140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50942/0 (socket says 172.21.15.62:50942) 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.098+0000 7f902bfff700 1 -- 172.21.15.62:0/3811129284 learned_addr learned my addr 172.21.15.62:0/3811129284 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f9030d75700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902c0fbd40 0x7f902c113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:48.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f902bfff700 1 -- 172.21.15.62:0/3811129284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902c0fbd40 msgr2=0x7f902c113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f902bfff700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902c0fbd40 0x7f902c113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f902bfff700 1 -- 172.21.15.62:0/3811129284 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018005040 con 0x7f902c101d90 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f902bfff700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c101d90 0x7f902c1140f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f901800b3b0 tx=0x7f9018009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f90297fa700 1 -- 172.21.15.62:0/3811129284 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901800e040 con 0x7f902c101d90 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f90297fa700 1 -- 172.21.15.62:0/3811129284 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9018013420 con 0x7f902c101d90 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f90297fa700 1 -- 172.21.15.62:0/3811129284 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901801c630 con 0x7f902c101d90 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c10ddb0 con 0x7f902c101d90 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.099+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c10e320 con 0x7f902c101d90 2024-05-09T06:35:48.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.100+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c0fd430 con 0x7f902c101d90 2024-05-09T06:35:48.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.101+0000 7f90297fa700 1 -- 172.21.15.62:0/3811129284 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f9018013590 con 0x7f902c101d90 2024-05-09T06:35:48.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.102+0000 7f90297fa700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f901c078aa0 0x7f901c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:48.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.102+0000 7f90297fa700 1 -- 172.21.15.62:0/3811129284 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f901809c660 con 0x7f902c101d90 2024-05-09T06:35:48.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.102+0000 7f9030d75700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f901c078aa0 0x7f901c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:48.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.102+0000 7f9030d75700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f901c078aa0 0x7f901c07af50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90200041d0 tx=0x7f90200043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.106+0000 7f90297fa700 1 -- 172.21.15.62:0/3811129284 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f9018064220 con 0x7f902c101d90 2024-05-09T06:35:48.231 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:48 smithi062 ceph-mon[109590]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:48.231 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:48 smithi062 ceph-mon[109590]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:48.231 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:48 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/73547194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:48.231 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:48 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2428191668' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:35:48.231 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 bash[120943]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T06:35:48.232 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T06:35:48.233 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-09T06:35:48.233 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T06:35:48.233 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate[120957]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-09T06:35:48.233 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 podman[120943]: 2024-05-09 06:35:48.251556053 +0000 UTC m=+0.898607970 container died a7ab38a7704d5f63e88c02c8a8c8d806310a09ff92f38f4d1e8427da85450de0 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-09T06:35:48.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.344+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f902c108df0 con 0x7f901c078aa0 2024-05-09T06:35:48.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.346+0000 7f90297fa700 1 -- 172.21.15.62:0/3811129284 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f902c108df0 con 0x7f901c078aa0 2024-05-09T06:35:48.327 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "6/21 daemons upgraded", 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:35:48.328 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.348+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f901c078aa0 msgr2=0x7f901c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.348+0000 7f9032fd9700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f901c078aa0 0x7f901c07af50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f90200041d0 tx=0x7f90200043c0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.348+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c101d90 msgr2=0x7f902c1140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.348+0000 7f9032fd9700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c101d90 0x7f902c1140f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f901800b3b0 tx=0x7f9018009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.349+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 shutdown_connections 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.349+0000 7f9032fd9700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f902c0fbd40 0x7f902c113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.349+0000 7f9032fd9700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f901c078aa0 0x7f901c07af50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.349+0000 7f9032fd9700 1 --2- 172.21.15.62:0/3811129284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f902c101d90 0x7f902c1140f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.349+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 >> 172.21.15.62:0/3811129284 conn(0x7f902c071d00 msgr2=0x7f902c065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:48.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.349+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 shutdown_connections 2024-05-09T06:35:48.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.349+0000 7f9032fd9700 1 -- 172.21.15.62:0/3811129284 wait complete. 2024-05-09T06:35:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:48 smithi079 ceph-mon[82381]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:48 smithi079 ceph-mon[82381]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:48 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/73547194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:48 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2428191668' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:35:48.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 -- 172.21.15.62:0/394424257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 msgr2=0x7f84e8103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:48.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 --2- 172.21.15.62:0/394424257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 0x7f84e8103220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84dc004940 tx=0x7f84dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:48.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 -- 172.21.15.62:0/394424257 shutdown_connections 2024-05-09T06:35:48.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 --2- 172.21.15.62:0/394424257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e8065640 0x7f84e8065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 --2- 172.21.15.62:0/394424257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 0x7f84e8103220 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 -- 172.21.15.62:0/394424257 >> 172.21.15.62:0/394424257 conn(0x7f84e8071d00 msgr2=0x7f84e8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:48.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 -- 172.21.15.62:0/394424257 shutdown_connections 2024-05-09T06:35:48.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 -- 172.21.15.62:0/394424257 wait complete. 2024-05-09T06:35:48.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 Processor -- start 2024-05-09T06:35:48.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.455+0000 7f84eed89700 1 -- start start 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84eed89700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e8065640 0x7f84e80fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84eed89700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 0x7f84e80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84eed89700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80fc880 con 0x7f84e8102e50 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84eed89700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80fc9c0 con 0x7f84e8065640 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84e7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 0x7f84e80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84e7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 0x7f84e80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50970/0 (socket says 172.21.15.62:50970) 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84e7fff700 1 -- 172.21.15.62:0/3960525425 learned_addr learned my addr 172.21.15.62:0/3960525425 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84ecb25700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e8065640 0x7f84e80fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84e7fff700 1 -- 172.21.15.62:0/3960525425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e8065640 msgr2=0x7f84e80fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84e7fff700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e8065640 0x7f84e80fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84e7fff700 1 -- 172.21.15.62:0/3960525425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc005040 con 0x7f84e8102e50 2024-05-09T06:35:48.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84ecb25700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e8065640 0x7f84e80fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:35:48.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84e7fff700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 0x7f84e80fc2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84d400eb40 tx=0x7f84d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:48.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.456+0000 7f84e57fa700 1 -- 172.21.15.62:0/3960525425 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d4007cc0 con 0x7f84e8102e50 2024-05-09T06:35:48.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.457+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e80fcc10 con 0x7f84e8102e50 2024-05-09T06:35:48.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.457+0000 7f84e57fa700 1 -- 172.21.15.62:0/3960525425 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84d400f040 con 0x7f84e8102e50 2024-05-09T06:35:48.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.457+0000 7f84e57fa700 1 -- 172.21.15.62:0/3960525425 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84d4009620 con 0x7f84e8102e50 2024-05-09T06:35:48.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.457+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e811a190 con 0x7f84e8102e50 2024-05-09T06:35:48.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.458+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e8100100 con 0x7f84e8102e50 2024-05-09T06:35:48.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.459+0000 7f84e57fa700 1 -- 172.21.15.62:0/3960525425 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 38) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f84d4009780 con 0x7f84e8102e50 2024-05-09T06:35:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.459+0000 7f84e57fa700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f84d8078aa0 0x7f84d807af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.459+0000 7f84e57fa700 1 -- 172.21.15.62:0/3960525425 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f84d409a5b0 con 0x7f84e8102e50 2024-05-09T06:35:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.459+0000 7f84ecb25700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f84d8078aa0 0x7f84d807af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.460+0000 7f84ecb25700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f84d8078aa0 0x7f84d807af50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00b0d0 tx=0x7f84dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:48.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.464+0000 7f84e57fa700 1 -- 172.21.15.62:0/3960525425 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f84d4062100 con 0x7f84e8102e50 2024-05-09T06:35:48.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.772+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f84e80fe540 con 0x7f84e8102e50 2024-05-09T06:35:48.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.773+0000 7f84e57fa700 1 -- 172.21.15.62:0/3960525425 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3058 (secure 0 0 0) 0x7f84d4019c10 con 0x7f84e8102e50 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 34 pgs peering 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] OSD_DOWN: 1 osds down 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout: osd.0 (root=default,host=smithi062) is down 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 34 pgs peering 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout: pg 1.0 is stuck peering for 81s, current state peering, last acting [3,1] 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.0 is stuck peering for 83s, current state peering, last acting [3,1] 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.1 is stuck peering for 84s, current state peering, last acting [2,1] 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.2 is stuck peering for 84s, current state peering, last acting [5,1] 2024-05-09T06:35:48.754 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.4 is stuck peering for 83s, current state peering, last acting [1,4] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.5 is stuck peering for 83s, current state peering, last acting [3,4] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.8 is stuck peering for 83s, current state peering, last acting [3,5] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.9 is stuck peering for 83s, current state peering, last acting [1,4] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.c is stuck peering for 84s, current state peering, last acting [2,3] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.e is stuck peering for 84s, current state peering, last acting [2,3] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.f is stuck peering for 83s, current state peering, last acting [4,5] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.10 is stuck peering for 84s, current state peering, last acting [2,1] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.12 is stuck peering for 83s, current state peering, last acting [3,1] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.13 is stuck peering for 4m, current state peering, last acting [4,2] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.15 is stuck peering for 83s, current state peering, last acting [1,3] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.19 is stuck peering for 4m, current state peering, last acting [4,2] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.1b is stuck peering for 83s, current state peering, last acting [1,5] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.1d is stuck peering for 83s, current state peering, last acting [3,5] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.1e is stuck peering for 84s, current state peering, last acting [2,5] 2024-05-09T06:35:48.755 INFO:teuthology.orchestra.run.smithi062.stdout: pg 2.1f is stuck peering for 4m, current state peering, last acting [3,4] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.1 is stuck peering for 3m, current state peering, last acting [4,2] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.3 is stuck peering for 83s, current state peering, last acting [4,3] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.6 is stuck peering for 3m, current state peering, last acting [1,4] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.b is stuck peering for 83s, current state peering, last acting [1,4] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.c is stuck peering for 84s, current state peering, last acting [5,3] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.f is stuck peering for 84s, current state peering, last acting [5,3] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.10 is stuck peering for 84s, current state peering, last acting [5,1] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.11 is stuck peering for 83s, current state peering, last acting [3,4] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.12 is stuck peering for 3m, current state peering, last acting [3,1] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.15 is stuck peering for 83s, current state peering, last acting [3,4] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.17 is stuck peering for 3m, current state peering, last acting [5,2] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.18 is stuck peering for 84s, current state peering, last acting [2,1] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.1b is stuck peering for 3m, current state peering, last acting [4,3] 2024-05-09T06:35:48.756 INFO:teuthology.orchestra.run.smithi062.stdout: pg 3.1f is stuck peering for 3m, current state peering, last acting [3,2] 2024-05-09T06:35:48.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f84d8078aa0 msgr2=0x7f84d807af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:48.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f84d8078aa0 0x7f84d807af50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00b0d0 tx=0x7f84dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:48.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 msgr2=0x7f84e80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:48.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 0x7f84e80fc2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84d400eb40 tx=0x7f84d400b040 comp rx=0 tx=0).stop 2024-05-09T06:35:48.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 shutdown_connections 2024-05-09T06:35:48.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e8065640 0x7f84e80fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f84d8078aa0 0x7f84d807af50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 --2- 172.21.15.62:0/3960525425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84e8102e50 0x7f84e80fc2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:48.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 >> 172.21.15.62:0/3960525425 conn(0x7f84e8071d00 msgr2=0x7f84e80faf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:48.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 shutdown_connections 2024-05-09T06:35:48.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:35:48.775+0000 7f84eed89700 1 -- 172.21.15.62:0/3960525425 wait complete. 2024-05-09T06:35:49.037 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:48 smithi062 podman[121131]: 2024-05-09 06:35:48.969774566 +0000 UTC m=+0.711355220 container remove a7ab38a7704d5f63e88c02c8a8c8d806310a09ff92f38f4d1e8427da85450de0 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:35:49.300 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:49 smithi062 ceph-mon[109590]: pgmap v47: 65 pgs: 34 peering, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:49.300 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:49 smithi062 ceph-mon[109590]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:49.301 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:49 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3960525425' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:35:49.301 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:49 smithi062 podman[121221]: 2024-05-09 06:35:49.092427577 +0000 UTC m=+0.019451259 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:35:49.301 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:49 smithi062 podman[121221]: 2024-05-09 06:35:49.195733339 +0000 UTC m=+0.122757001 container create c4cee88020d39c22bc1fb2a280a45f08a8ec89f14d41d3a8bd31a662e5d81985 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-09T06:35:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:49 smithi079 ceph-mon[82381]: pgmap v47: 65 pgs: 34 peering, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:49 smithi079 ceph-mon[82381]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:49 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3960525425' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:35:49.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:49 smithi062 podman[121221]: 2024-05-09 06:35:49.423249592 +0000 UTC m=+0.350273264 container init c4cee88020d39c22bc1fb2a280a45f08a8ec89f14d41d3a8bd31a662e5d81985 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:35:49.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:49 smithi062 podman[121221]: 2024-05-09 06:35:49.427289595 +0000 UTC m=+0.354313258 container start c4cee88020d39c22bc1fb2a280a45f08a8ec89f14d41d3a8bd31a662e5d81985 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=main-720f8e9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-09T06:35:49.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:49 smithi062 ceph-osd[121242]: -- 172.21.15.62:0/2659948598 <== mon.0 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564f84561680 con 0x564f8452ac00 2024-05-09T06:35:49.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:49 smithi062 bash[121221]: c4cee88020d39c22bc1fb2a280a45f08a8ec89f14d41d3a8bd31a662e5d81985 2024-05-09T06:35:49.661 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:49 smithi062 systemd[1]: Started Ceph osd.0 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:35:50.411 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:49 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[121238]: 2024-05-09T06:35:49.973+0000 7fd4d567d7c0 -1 Falling back to public interface 2024-05-09T06:35:50.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:50.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:50.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:50.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:50 smithi079 ceph-mon[82381]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2024-05-09T06:35:50.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:50.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:50.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:50.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:50 smithi062 ceph-mon[109590]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2024-05-09T06:35:51.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:51 smithi079 ceph-mon[82381]: Health check failed: Degraded data redundancy: 44/216 objects degraded (20.370%), 17 pgs degraded (PG_DEGRADED) 2024-05-09T06:35:51.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:51 smithi079 ceph-mon[82381]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-05-09T06:35:51.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:51 smithi062 ceph-mon[109590]: Health check failed: Degraded data redundancy: 44/216 objects degraded (20.370%), 17 pgs degraded (PG_DEGRADED) 2024-05-09T06:35:51.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:51 smithi062 ceph-mon[109590]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-05-09T06:35:52.818 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:52 smithi062 ceph-mon[109590]: pgmap v49: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2024-05-09T06:35:52.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:52 smithi079 ceph-mon[82381]: pgmap v49: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2024-05-09T06:35:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:55 smithi079 ceph-mon[82381]: pgmap v50: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2024-05-09T06:35:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:55 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:55 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:55 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:55 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:55 smithi079 ceph-mon[82381]: from='osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T06:35:55.411 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:55 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[121238]: 2024-05-09T06:35:55.002+0000 7fd4d567d7c0 -1 osd.0 49 log_to_monitors true 2024-05-09T06:35:55.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:55 smithi062 ceph-mon[109590]: pgmap v50: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/216 objects degraded (20.370%) 2024-05-09T06:35:55.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:55 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:55.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:55 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:55.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:55 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:55.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:55 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:55.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:55 smithi062 ceph-mon[109590]: from='osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T06:35:56.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:56 smithi079 ceph-mon[82381]: from='osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T06:35:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:56 smithi079 ceph-mon[82381]: osdmap e52: 6 total, 5 up, 6 in 2024-05-09T06:35:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:56 smithi079 ceph-mon[82381]: from='osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:35:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:56 smithi079 ceph-mon[82381]: pgmap v52: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s; 44/216 objects degraded (20.370%) 2024-05-09T06:35:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:56.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:57.044 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:56 smithi062 ceph-mon[109590]: from='osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T06:35:57.044 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:56 smithi062 ceph-mon[109590]: osdmap e52: 6 total, 5 up, 6 in 2024-05-09T06:35:57.044 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:56 smithi062 ceph-mon[109590]: from='osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:35:57.044 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:56 smithi062 ceph-mon[109590]: pgmap v52: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s; 44/216 objects degraded (20.370%) 2024-05-09T06:35:57.044 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:57.044 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:35:57.045 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:35:56 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[121238]: 2024-05-09T06:35:56.812+0000 7fd4c2acc700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:35:58.079 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:57 smithi062 ceph-mon[109590]: from='osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583]' entity='osd.0' 2024-05-09T06:35:58.079 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:57 smithi062 ceph-mon[109590]: mgrmap e39: smithi062.juuasl(active, since 92s), standbys: smithi079.genyri 2024-05-09T06:35:58.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:57 smithi079 ceph-mon[82381]: from='osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583]' entity='osd.0' 2024-05-09T06:35:58.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:57 smithi079 ceph-mon[82381]: mgrmap e39: smithi062.juuasl(active, since 92s), standbys: smithi079.genyri 2024-05-09T06:35:59.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:58 smithi079 ceph-mon[82381]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:35:59.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:58 smithi079 ceph-mon[82381]: osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583] boot 2024-05-09T06:35:59.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:58 smithi079 ceph-mon[82381]: osdmap e53: 6 total, 6 up, 6 in 2024-05-09T06:35:59.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:58 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:35:59.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:58 smithi079 ceph-mon[82381]: pgmap v54: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 44/216 objects degraded (20.370%) 2024-05-09T06:35:59.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:35:58 smithi079 ceph-mon[82381]: osdmap e54: 6 total, 6 up, 6 in 2024-05-09T06:35:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:58 smithi062 ceph-mon[109590]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:35:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:58 smithi062 ceph-mon[109590]: osd.0 [v2:172.21.15.62:6802/171663583,v1:172.21.15.62:6803/171663583] boot 2024-05-09T06:35:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:58 smithi062 ceph-mon[109590]: osdmap e53: 6 total, 6 up, 6 in 2024-05-09T06:35:59.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:58 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:35:59.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:58 smithi062 ceph-mon[109590]: pgmap v54: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 44/216 objects degraded (20.370%) 2024-05-09T06:35:59.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:35:58 smithi062 ceph-mon[109590]: osdmap e54: 6 total, 6 up, 6 in 2024-05-09T06:36:00.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:00 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 6/216 objects degraded (2.778%), 2 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:00.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:00 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 6/216 objects degraded (2.778%), 2 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: pgmap v56: 65 pgs: 2 active+undersized+degraded, 7 active+undersized, 56 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/216 objects degraded (2.778%) 2024-05-09T06:36:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:36:01.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:01.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:01.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:01.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:01.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:01.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:01.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:01.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:01 smithi062 ceph-mon[109590]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-05-09T06:36:01.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: pgmap v56: 65 pgs: 2 active+undersized+degraded, 7 active+undersized, 56 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/216 objects degraded (2.778%) 2024-05-09T06:36:01.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:01.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:01.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:01.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:36:01.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:01.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:01.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:01.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:01.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:01.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:01.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:01.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:01 smithi079 ceph-mon[82381]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-05-09T06:36:02.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:02 smithi062 ceph-mon[109590]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/216 objects degraded (2.778%), 2 pgs degraded) 2024-05-09T06:36:02.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:02 smithi079 ceph-mon[82381]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/216 objects degraded (2.778%), 2 pgs degraded) 2024-05-09T06:36:03.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:03 smithi062 ceph-mon[109590]: pgmap v57: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:03.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:03 smithi079 ceph-mon[82381]: pgmap v57: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:05.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:05 smithi062 ceph-mon[109590]: pgmap v58: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:05.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:05 smithi079 ceph-mon[82381]: pgmap v58: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:07.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:07 smithi062 ceph-mon[109590]: pgmap v59: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:07.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:07 smithi079 ceph-mon[82381]: pgmap v59: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:09 smithi062 ceph-mon[109590]: pgmap v60: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:09 smithi079 ceph-mon[82381]: pgmap v60: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:09.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:11.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:11 smithi062 ceph-mon[109590]: pgmap v61: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:11 smithi079 ceph-mon[82381]: pgmap v61: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:13.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:13 smithi062 ceph-mon[109590]: pgmap v62: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:13.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:13 smithi079 ceph-mon[82381]: pgmap v62: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:15.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:15 smithi062 ceph-mon[109590]: pgmap v63: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:15.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:15.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:15 smithi079 ceph-mon[82381]: pgmap v63: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:15.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:16.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:16 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:16.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:16 smithi062 ceph-mon[109590]: Upgrade: osd.1 is safe to restart 2024-05-09T06:36:16.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:16 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:16.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:16 smithi079 ceph-mon[82381]: Upgrade: osd.1 is safe to restart 2024-05-09T06:36:17.641 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:17 smithi062 ceph-mon[109590]: pgmap v64: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:17.641 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:17 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:17.642 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:17 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:36:17.642 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:17 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:17.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:17 smithi079 ceph-mon[82381]: pgmap v64: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:17.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:17 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:17.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:17 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:36:17.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:17 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:18.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:18 smithi062 ceph-mon[109590]: Upgrade: Updating osd.1 2024-05-09T06:36:18.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:18 smithi062 ceph-mon[109590]: Deploying daemon osd.1 on smithi062 2024-05-09T06:36:18.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:18 smithi079 ceph-mon[82381]: Upgrade: Updating osd.1 2024-05-09T06:36:18.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:18 smithi079 ceph-mon[82381]: Deploying daemon osd.1 on smithi062 2024-05-09T06:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.888+0000 7fc53ef86700 1 -- 172.21.15.62:0/660415515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fd1b0 msgr2=0x7fc5380fd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.888+0000 7fc53ef86700 1 --2- 172.21.15.62:0/660415515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fd1b0 0x7fc5380fd580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc52c004940 tx=0x7fc52c009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.888+0000 7fc53ef86700 1 -- 172.21.15.62:0/660415515 shutdown_connections 2024-05-09T06:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.888+0000 7fc53ef86700 1 --2- 172.21.15.62:0/660415515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380fe9b0 0x7fc5380fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.888+0000 7fc53ef86700 1 --2- 172.21.15.62:0/660415515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fd1b0 0x7fc5380fd580 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.888+0000 7fc53ef86700 1 -- 172.21.15.62:0/660415515 >> 172.21.15.62:0/660415515 conn(0x7fc5380f89b0 msgr2=0x7fc5380fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.889+0000 7fc53ef86700 1 -- 172.21.15.62:0/660415515 shutdown_connections 2024-05-09T06:36:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.889+0000 7fc53ef86700 1 -- 172.21.15.62:0/660415515 wait complete. 2024-05-09T06:36:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.889+0000 7fc53ef86700 1 Processor -- start 2024-05-09T06:36:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.889+0000 7fc53ef86700 1 -- start start 2024-05-09T06:36:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc53ef86700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380fd1b0 0x7fc538113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc53ef86700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fe9b0 0x7fc538113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc53ef86700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538114580 con 0x7fc5380fe9b0 2024-05-09T06:36:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc53ef86700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53810daf0 con 0x7fc5380fd1b0 2024-05-09T06:36:18.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc537fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fe9b0 0x7fc538113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc537fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fe9b0 0x7fc538113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57200/0 (socket says 172.21.15.62:57200) 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc537fff700 1 -- 172.21.15.62:0/416023215 learned_addr learned my addr 172.21.15.62:0/416023215 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc53cd22700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380fd1b0 0x7fc538113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc537fff700 1 -- 172.21.15.62:0/416023215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380fd1b0 msgr2=0x7fc538113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc537fff700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380fd1b0 0x7fc538113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc537fff700 1 -- 172.21.15.62:0/416023215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c005040 con 0x7fc5380fe9b0 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc53cd22700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380fd1b0 0x7fc538113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.890+0000 7fc537fff700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fe9b0 0x7fc538113ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc52400b790 tx=0x7fc524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.891+0000 7fc5357fa700 1 -- 172.21.15.62:0/416023215 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52400f770 con 0x7fc5380fe9b0 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.891+0000 7fc5357fa700 1 -- 172.21.15.62:0/416023215 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc52400fda0 con 0x7fc5380fe9b0 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.891+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53810ddd0 con 0x7fc5380fe9b0 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.891+0000 7fc5357fa700 1 -- 172.21.15.62:0/416023215 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52400d310 con 0x7fc5380fe9b0 2024-05-09T06:36:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.891+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53810e390 con 0x7fc5380fe9b0 2024-05-09T06:36:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.892+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5380fe550 con 0x7fc5380fe9b0 2024-05-09T06:36:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.893+0000 7fc5357fa700 1 -- 172.21.15.62:0/416023215 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc524010420 con 0x7fc5380fe9b0 2024-05-09T06:36:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.893+0000 7fc5357fa700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc528078980 0x7fc52807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.893+0000 7fc5357fa700 1 -- 172.21.15.62:0/416023215 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc52409a610 con 0x7fc5380fe9b0 2024-05-09T06:36:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.893+0000 7fc53cd22700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc528078980 0x7fc52807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.894+0000 7fc53cd22700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc528078980 0x7fc52807ae30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc52c000c00 tx=0x7fc52c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:18.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:18.898+0000 7fc5357fa700 1 -- 172.21.15.62:0/416023215 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc5240623f0 con 0x7fc5380fe9b0 2024-05-09T06:36:19.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.154+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc53810efb0 con 0x7fc528078980 2024-05-09T06:36:19.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.155+0000 7fc5357fa700 1 -- 172.21.15.62:0/416023215 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc53810efb0 con 0x7fc528078980 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc528078980 msgr2=0x7fc52807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc528078980 0x7fc52807ae30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc52c000c00 tx=0x7fc52c009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fe9b0 msgr2=0x7fc538113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fe9b0 0x7fc538113ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc52400b790 tx=0x7fc524009250 comp rx=0 tx=0).stop 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 shutdown_connections 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380fd1b0 0x7fc538113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc528078980 0x7fc52807ae30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 --2- 172.21.15.62:0/416023215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5380fe9b0 0x7fc538113ea0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 >> 172.21.15.62:0/416023215 conn(0x7fc5380f89b0 msgr2=0x7fc5380f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 shutdown_connections 2024-05-09T06:36:19.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.158+0000 7fc53ef86700 1 -- 172.21.15.62:0/416023215 wait complete. 2024-05-09T06:36:19.150 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 -- 172.21.15.62:0/3643256568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5244065640 msgr2=0x7f5244065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 --2- 172.21.15.62:0/3643256568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5244065640 0x7f5244065ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5238004940 tx=0x7f5238009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 -- 172.21.15.62:0/3643256568 shutdown_connections 2024-05-09T06:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 --2- 172.21.15.62:0/3643256568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5244065640 0x7f5244065ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 --2- 172.21.15.62:0/3643256568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5244102e50 0x7f5244103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 -- 172.21.15.62:0/3643256568 >> 172.21.15.62:0/3643256568 conn(0x7f5244071d00 msgr2=0x7f5244072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 -- 172.21.15.62:0/3643256568 shutdown_connections 2024-05-09T06:36:19.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 -- 172.21.15.62:0/3643256568 wait complete. 2024-05-09T06:36:19.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.270+0000 7f5249e32700 1 Processor -- start 2024-05-09T06:36:19.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f5249e32700 1 -- start start 2024-05-09T06:36:19.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f5249e32700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5244065640 0x7f52440fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f5249e32700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5244102e50 0x7f52440fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f5249e32700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440fc880 con 0x7f5244065640 2024-05-09T06:36:19.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f5249e32700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440fc9c0 con 0x7f5244102e50 2024-05-09T06:36:19.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f5242ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5244102e50 0x7f52440fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f5242ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5244102e50 0x7f52440fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:42452/0 (socket says 172.21.15.62:42452) 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f5242ffd700 1 -- 172.21.15.62:0/1890622471 learned_addr learned my addr 172.21.15.62:0/1890622471 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.271+0000 7f52437fe700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5244065640 0x7f52440fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f5242ffd700 1 -- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5244065640 msgr2=0x7f52440fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f5242ffd700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5244065640 0x7f52440fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f5242ffd700 1 -- 172.21.15.62:0/1890622471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238005040 con 0x7f5244102e50 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f5242ffd700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5244102e50 0x7f52440fc2f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f523800b3b0 tx=0x7f5238009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f522bfff700 1 -- 172.21.15.62:0/1890622471 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523800e040 con 0x7f5244102e50 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f522bfff700 1 -- 172.21.15.62:0/1890622471 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5238013420 con 0x7f5244102e50 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f522bfff700 1 -- 172.21.15.62:0/1890622471 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523801c630 con 0x7f5244102e50 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440fcc10 con 0x7f5244102e50 2024-05-09T06:36:19.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.272+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524411a2c0 con 0x7f5244102e50 2024-05-09T06:36:19.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.273+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5244100100 con 0x7f5244102e50 2024-05-09T06:36:19.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.274+0000 7f522bfff700 1 -- 172.21.15.62:0/1890622471 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f5238013590 con 0x7f5244102e50 2024-05-09T06:36:19.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.275+0000 7f522bfff700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f522c078990 0x7f522c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.275+0000 7f522bfff700 1 -- 172.21.15.62:0/1890622471 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f523809ba70 con 0x7f5244102e50 2024-05-09T06:36:19.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.275+0000 7f52437fe700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f522c078990 0x7f522c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.276+0000 7f52437fe700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f522c078990 0x7f522c07ae40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5234004fb0 tx=0x7f523400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:19.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.279+0000 7f522bfff700 1 -- 172.21.15.62:0/1890622471 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f5238063790 con 0x7f5244102e50 2024-05-09T06:36:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.516+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5244109f20 con 0x7f522c078990 2024-05-09T06:36:19.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.517+0000 7f522bfff700 1 -- 172.21.15.62:0/1890622471 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5244109f20 con 0x7f522c078990 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f522c078990 msgr2=0x7f522c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f522c078990 0x7f522c07ae40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5234004fb0 tx=0x7f523400b040 comp rx=0 tx=0).stop 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5244102e50 msgr2=0x7f52440fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5244102e50 0x7f52440fc2f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f523800b3b0 tx=0x7f5238009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 shutdown_connections 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f522c078990 0x7f522c07ae40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5244065640 0x7f52440fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 --2- 172.21.15.62:0/1890622471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5244102e50 0x7f52440fc2f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 >> 172.21.15.62:0/1890622471 conn(0x7f5244071d00 msgr2=0x7f52440faf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:19.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 shutdown_connections 2024-05-09T06:36:19.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.520+0000 7f5249e32700 1 -- 172.21.15.62:0/1890622471 wait complete. 2024-05-09T06:36:19.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.632+0000 7f5494b33700 1 -- 172.21.15.62:0/24809118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 msgr2=0x7f54900fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.632+0000 7f5494b33700 1 --2- 172.21.15.62:0/24809118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 0x7f54900fbcf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5484004940 tx=0x7f5484009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.632+0000 7f5494b33700 1 -- 172.21.15.62:0/24809118 shutdown_connections 2024-05-09T06:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.632+0000 7f5494b33700 1 --2- 172.21.15.62:0/24809118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 0x7f54900fbcf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.632+0000 7f5494b33700 1 --2- 172.21.15.62:0/24809118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5490101ce0 0x7f54901020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.632+0000 7f5494b33700 1 -- 172.21.15.62:0/24809118 >> 172.21.15.62:0/24809118 conn(0x7f54900f7850 msgr2=0x7f54900f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.632+0000 7f5494b33700 1 -- 172.21.15.62:0/24809118 shutdown_connections 2024-05-09T06:36:19.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.632+0000 7f5494b33700 1 -- 172.21.15.62:0/24809118 wait complete. 2024-05-09T06:36:19.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.633+0000 7f5494b33700 1 Processor -- start 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.633+0000 7f5494b33700 1 -- start start 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f5494b33700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5490101ce0 0x7f5490113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f5494b33700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 0x7f5490114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f5494b33700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54901146b0 con 0x7f5490102680 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f5494b33700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549010dae0 con 0x7f5490101ce0 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f548dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 0x7f5490114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f548dd9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 0x7f5490114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57234/0 (socket says 172.21.15.62:57234) 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f548dd9b700 1 -- 172.21.15.62:0/3912152540 learned_addr learned my addr 172.21.15.62:0/3912152540 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f548e59c700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5490101ce0 0x7f5490113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f548dd9b700 1 -- 172.21.15.62:0/3912152540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5490101ce0 msgr2=0x7f5490113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f548dd9b700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5490101ce0 0x7f5490113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f548dd9b700 1 -- 172.21.15.62:0/3912152540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484005040 con 0x7f5490102680 2024-05-09T06:36:19.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.634+0000 7f548dd9b700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 0x7f5490114060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5484009100 tx=0x7f5484009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.635+0000 7f547effd700 1 -- 172.21.15.62:0/3912152540 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f548400e040 con 0x7f5490102680 2024-05-09T06:36:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.635+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549010dd60 con 0x7f5490102680 2024-05-09T06:36:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.635+0000 7f547effd700 1 -- 172.21.15.62:0/3912152540 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5484009af0 con 0x7f5490102680 2024-05-09T06:36:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.635+0000 7f547effd700 1 -- 172.21.15.62:0/3912152540 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f548401c3f0 con 0x7f5490102680 2024-05-09T06:36:19.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.635+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549010e320 con 0x7f5490102680 2024-05-09T06:36:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.636+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54900fd430 con 0x7f5490102680 2024-05-09T06:36:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.636+0000 7f547effd700 1 -- 172.21.15.62:0/3912152540 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f548400baf0 con 0x7f5490102680 2024-05-09T06:36:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.637+0000 7f547effd700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5478078990 0x7f547807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.637+0000 7f548e59c700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5478078990 0x7f547807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.637+0000 7f547effd700 1 -- 172.21.15.62:0/3912152540 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f548409b8f0 con 0x7f5490102680 2024-05-09T06:36:19.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.638+0000 7f548e59c700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5478078990 0x7f547807ae40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5480004eb0 tx=0x7f548000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:19.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.642+0000 7f547effd700 1 -- 172.21.15.62:0/3912152540 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f5484063630 con 0x7f5490102680 2024-05-09T06:36:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:19 smithi062 ceph-mon[109590]: pgmap v65: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:19.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:19 smithi079 ceph-mon[82381]: pgmap v65: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:19.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.867+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5490108dc0 con 0x7f5478078990 2024-05-09T06:36:19.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.879+0000 7f547effd700 1 -- 172.21.15.62:0/3912152540 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5490108dc0 con 0x7f5478078990 2024-05-09T06:36:19.860 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:36:19.860 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (3m) 25s ago 14m 26.3M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:36:19.860 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (57s) 25s ago 15m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (52s) 49s ago 13m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (3m) 25s ago 14m 76.8M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (8m) 25s ago 8m 16.4M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (9m) 25s ago 9m 152M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (8m) 49s ago 8m 15.8M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (8m) 49s ago 8m 15.7M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (5m) 25s ago 16m 513M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (4m) 49s ago 13m 464M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (2m) 25s ago 16m 43.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (99s) 49s ago 13m 33.9M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (4m) 25s ago 14m 14.8M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (4m) 49s ago 13m 17.7M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (30s) 25s ago 12m 12.6M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:36:19.861 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (12m) 25s ago 12m 261M 1557M 17.2.7-933-g4ba5a836 b96134859c76 c0457f807e74 2024-05-09T06:36:19.862 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (11m) 25s ago 11m 220M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:36:19.862 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (11m) 49s ago 11m 284M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:36:19.862 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (10m) 49s ago 10m 253M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:36:19.862 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (10m) 49s ago 10m 248M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:36:19.862 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (3m) 25s ago 13m 65.7M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5478078990 msgr2=0x7f547807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5478078990 0x7f547807ae40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5480004eb0 tx=0x7f548000b040 comp rx=0 tx=0).stop 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 msgr2=0x7f5490114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 0x7f5490114060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5484009100 tx=0x7f5484009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 shutdown_connections 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5490101ce0 0x7f5490113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5478078990 0x7f547807ae40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 --2- 172.21.15.62:0/3912152540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5490102680 0x7f5490114060 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 >> 172.21.15.62:0/3912152540 conn(0x7f54900f7850 msgr2=0x7f5490065ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 shutdown_connections 2024-05-09T06:36:19.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.882+0000 7f5494b33700 1 -- 172.21.15.62:0/3912152540 wait complete. 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.991+0000 7fc8dfdae700 1 -- 172.21.15.62:0/2585268553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81026a0 msgr2=0x7fc8d80fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.991+0000 7fc8dfdae700 1 --2- 172.21.15.62:0/2585268553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81026a0 0x7fc8d80fbd10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8004940 tx=0x7fc8c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.991+0000 7fc8dfdae700 1 -- 172.21.15.62:0/2585268553 shutdown_connections 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.991+0000 7fc8dfdae700 1 --2- 172.21.15.62:0/2585268553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d81026a0 0x7fc8d80fbd10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.991+0000 7fc8dfdae700 1 --2- 172.21.15.62:0/2585268553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8101d00 0x7fc8d81020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.991+0000 7fc8dfdae700 1 -- 172.21.15.62:0/2585268553 >> 172.21.15.62:0/2585268553 conn(0x7fc8d80f7870 msgr2=0x7fc8d80f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.991+0000 7fc8dfdae700 1 -- 172.21.15.62:0/2585268553 shutdown_connections 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.991+0000 7fc8dfdae700 1 -- 172.21.15.62:0/2585268553 wait complete. 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.992+0000 7fc8dfdae700 1 Processor -- start 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.992+0000 7fc8dfdae700 1 -- start start 2024-05-09T06:36:19.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.992+0000 7fc8dfdae700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d8101d00 0x7fc8d810eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.992+0000 7fc8dfdae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d81026a0 0x7fc8d810f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.992+0000 7fc8dfdae700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d810f580 con 0x7fc8d8101d00 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.992+0000 7fc8dfdae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d810f6c0 con 0x7fc8d81026a0 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ddb4a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d8101d00 0x7fc8d810eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ddb4a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d8101d00 0x7fc8d810eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57246/0 (socket says 172.21.15.62:57246) 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ddb4a700 1 -- 172.21.15.62:0/1602304200 learned_addr learned my addr 172.21.15.62:0/1602304200 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8dd349700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d81026a0 0x7fc8d810f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ddb4a700 1 -- 172.21.15.62:0/1602304200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d81026a0 msgr2=0x7fc8d810f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ddb4a700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d81026a0 0x7fc8d810f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ddb4a700 1 -- 172.21.15.62:0/1602304200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c8005040 con 0x7fc8d8101d00 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8dd349700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d81026a0 0x7fc8d810f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ddb4a700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d8101d00 0x7fc8d810eb00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4002a50 tx=0x7fc8d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ce7fc700 1 -- 172.21.15.62:0/1602304200 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d4007cc0 con 0x7fc8d8101d00 2024-05-09T06:36:19.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d8117b70 con 0x7fc8d8101d00 2024-05-09T06:36:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8ce7fc700 1 -- 172.21.15.62:0/1602304200 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8d400f040 con 0x7fc8d8101d00 2024-05-09T06:36:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.993+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d8117f90 con 0x7fc8d8101d00 2024-05-09T06:36:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.994+0000 7fc8ce7fc700 1 -- 172.21.15.62:0/1602304200 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d4009640 con 0x7fc8d8101d00 2024-05-09T06:36:19.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.995+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d80fd450 con 0x7fc8d8101d00 2024-05-09T06:36:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.995+0000 7fc8ce7fc700 1 -- 172.21.15.62:0/1602304200 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc8d400d690 con 0x7fc8d8101d00 2024-05-09T06:36:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.996+0000 7fc8ce7fc700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc8c4078990 0x7fc8c407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.996+0000 7fc8ce7fc700 1 -- 172.21.15.62:0/1602304200 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc8d409a450 con 0x7fc8d8101d00 2024-05-09T06:36:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.996+0000 7fc8dd349700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc8c4078990 0x7fc8c407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:19.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:19.997+0000 7fc8dd349700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc8c4078990 0x7fc8c407ae40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800b3b0 tx=0x7fc8c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:19.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.001+0000 7fc8ce7fc700 1 -- 172.21.15.62:0/1602304200 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc8d4062110 con 0x7fc8d8101d00 2024-05-09T06:36:20.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.333+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc8d8066850 con 0x7fc8d8101d00 2024-05-09T06:36:20.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.333+0000 7fc8ce7fc700 1 -- 172.21.15.62:0/1602304200 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fc8d4061ab0 con 0x7fc8d8101d00 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 5, 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:36:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:36:20.317 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:36:20.317 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 9, 2024-05-09T06:36:20.317 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 5 2024-05-09T06:36:20.317 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:36:20.317 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:36:20.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc8c4078990 msgr2=0x7fc8c407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:20.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc8c4078990 0x7fc8c407ae40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800b3b0 tx=0x7fc8c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d8101d00 msgr2=0x7fc8d810eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d8101d00 0x7fc8d810eb00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4002a50 tx=0x7fc8d40046b0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 shutdown_connections 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc8c4078990 0x7fc8c407ae40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8d8101d00 0x7fc8d810eb00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 --2- 172.21.15.62:0/1602304200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d81026a0 0x7fc8d810f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 >> 172.21.15.62:0/1602304200 conn(0x7fc8d80f7870 msgr2=0x7fc8d80f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 shutdown_connections 2024-05-09T06:36:20.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.336+0000 7fc8dfdae700 1 -- 172.21.15.62:0/1602304200 wait complete. 2024-05-09T06:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 -- 172.21.15.62:0/4241813878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e580fdde0 msgr2=0x7f2e580fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 --2- 172.21.15.62:0/4241813878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e580fdde0 0x7f2e580fe1b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e48004940 tx=0x7f2e48009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 -- 172.21.15.62:0/4241813878 shutdown_connections 2024-05-09T06:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 --2- 172.21.15.62:0/4241813878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e580fe780 0x7f2e58106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 --2- 172.21.15.62:0/4241813878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e580fdde0 0x7f2e580fe1b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 -- 172.21.15.62:0/4241813878 >> 172.21.15.62:0/4241813878 conn(0x7f2e580f7850 msgr2=0x7f2e580f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 -- 172.21.15.62:0/4241813878 shutdown_connections 2024-05-09T06:36:20.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 -- 172.21.15.62:0/4241813878 wait complete. 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.456+0000 7f2e5e818700 1 Processor -- start 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.457+0000 7f2e5e818700 1 -- start start 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.457+0000 7f2e5e818700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e580fdde0 0x7f2e58113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.457+0000 7f2e5e818700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e580fe780 0x7f2e58114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.457+0000 7f2e5e818700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e58114650 con 0x7f2e580fdde0 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.457+0000 7f2e5e818700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5810da40 con 0x7f2e580fe780 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.457+0000 7f2e57fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e580fdde0 0x7f2e58113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.457+0000 7f2e57fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e580fdde0 0x7f2e58113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57256/0 (socket says 172.21.15.62:57256) 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.457+0000 7f2e57fff700 1 -- 172.21.15.62:0/2440663082 learned_addr learned my addr 172.21.15.62:0/2440663082 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.458+0000 7f2e577fe700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e580fe780 0x7f2e58114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.458+0000 7f2e57fff700 1 -- 172.21.15.62:0/2440663082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e580fe780 msgr2=0x7f2e58114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.458+0000 7f2e57fff700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e580fe780 0x7f2e58114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.458+0000 7f2e57fff700 1 -- 172.21.15.62:0/2440663082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48005040 con 0x7f2e580fdde0 2024-05-09T06:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.458+0000 7f2e57fff700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e580fdde0 0x7f2e58113ac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000c00 tx=0x7f2e48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.458+0000 7f2e54ff9700 1 -- 172.21.15.62:0/2440663082 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e48021070 con 0x7f2e580fdde0 2024-05-09T06:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.458+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5810dcc0 con 0x7f2e580fdde0 2024-05-09T06:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.458+0000 7f2e54ff9700 1 -- 172.21.15.62:0/2440663082 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e48013c00 con 0x7f2e580fdde0 2024-05-09T06:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.459+0000 7f2e54ff9700 1 -- 172.21.15.62:0/2440663082 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e4800e070 con 0x7f2e580fdde0 2024-05-09T06:36:20.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.459+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5810e200 con 0x7f2e580fdde0 2024-05-09T06:36:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.460+0000 7f2e54ff9700 1 -- 172.21.15.62:0/2440663082 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f2e4801c400 con 0x7f2e580fdde0 2024-05-09T06:36:20.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.460+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e58066750 con 0x7f2e580fdde0 2024-05-09T06:36:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.461+0000 7f2e54ff9700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f2e40078770 0x7f2e4007ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.461+0000 7f2e54ff9700 1 -- 172.21.15.62:0/2440663082 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2e4809b510 con 0x7f2e580fdde0 2024-05-09T06:36:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.461+0000 7f2e577fe700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f2e40078770 0x7f2e4007ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:20.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.461+0000 7f2e577fe700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f2e40078770 0x7f2e4007ac20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2e5810ec00 tx=0x7f2e4c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:20.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.467+0000 7f2e54ff9700 1 -- 172.21.15.62:0/2440663082 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f2e48063250 con 0x7f2e580fdde0 2024-05-09T06:36:20.563 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:20 smithi062 ceph-mon[109590]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:20.563 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:20 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1602304200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:20.563 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:20 smithi062 systemd[1]: Stopping Ceph osd.1 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:36:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.741+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2e5810f140 con 0x7f2e580fdde0 2024-05-09T06:36:20.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.742+0000 7f2e54ff9700 1 -- 172.21.15.62:0/2440663082 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f2e48062bf0 con 0x7f2e580fdde0 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:36:20.723 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:36:20.724 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:20.725 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f2e40078770 msgr2=0x7f2e4007ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f2e40078770 0x7f2e4007ac20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2e5810ec00 tx=0x7f2e4c00b040 comp rx=0 tx=0).stop 2024-05-09T06:36:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e580fdde0 msgr2=0x7f2e58113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e580fdde0 0x7f2e58113ac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000c00 tx=0x7f2e48009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 shutdown_connections 2024-05-09T06:36:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f2e40078770 0x7f2e4007ac20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e580fdde0 0x7f2e58113ac0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 --2- 172.21.15.62:0/2440663082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e580fe780 0x7f2e58114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 >> 172.21.15.62:0/2440663082 conn(0x7f2e580f7850 msgr2=0x7f2e580f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 shutdown_connections 2024-05-09T06:36:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.744+0000 7f2e5e818700 1 -- 172.21.15.62:0/2440663082 wait complete. 2024-05-09T06:36:20.727 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:36:20.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.851+0000 7f31f44c8700 1 -- 172.21.15.62:0/1312640857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070280 msgr2=0x7f31ec070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:20.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.851+0000 7f31f44c8700 1 --2- 172.21.15.62:0/1312640857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070280 0x7f31ec070650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009ce0 tx=0x7f31dc004d10 comp rx=0 tx=0).stop 2024-05-09T06:36:20.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.851+0000 7f31f44c8700 1 -- 172.21.15.62:0/1312640857 shutdown_connections 2024-05-09T06:36:20.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.851+0000 7f31f44c8700 1 --2- 172.21.15.62:0/1312640857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31ec070b90 0x7f31ec109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.851+0000 7f31f44c8700 1 --2- 172.21.15.62:0/1312640857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070280 0x7f31ec070650 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.851+0000 7f31f44c8700 1 -- 172.21.15.62:0/1312640857 >> 172.21.15.62:0/1312640857 conn(0x7f31ec0f8950 msgr2=0x7f31ec0fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:20.833 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:20 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[52726]: 2024-05-09T06:36:20.651+0000 7f6fb362f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:36:20.833 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:20 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[52726]: 2024-05-09T06:36:20.651+0000 7f6fb362f700 -1 osd.1 54 *** Got signal Terminated *** 2024-05-09T06:36:20.833 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:20 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[52726]: 2024-05-09T06:36:20.651+0000 7f6fb362f700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:36:20.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.851+0000 7f31f44c8700 1 -- 172.21.15.62:0/1312640857 shutdown_connections 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.851+0000 7f31f44c8700 1 -- 172.21.15.62:0/1312640857 wait complete. 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f44c8700 1 Processor -- start 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f44c8700 1 -- start start 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f44c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31ec070280 0x7f31ec115f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f44c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070b90 0x7f31ec116450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f44c8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec116b30 con 0x7f31ec070b90 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f44c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec10fe70 con 0x7f31ec070280 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f1a63700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070b90 0x7f31ec116450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f1a63700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070b90 0x7f31ec116450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57272/0 (socket says 172.21.15.62:57272) 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.852+0000 7f31f1a63700 1 -- 172.21.15.62:0/2798873716 learned_addr learned my addr 172.21.15.62:0/2798873716 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31f2264700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31ec070280 0x7f31ec115f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31f1a63700 1 -- 172.21.15.62:0/2798873716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31ec070280 msgr2=0x7f31ec115f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31f1a63700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31ec070280 0x7f31ec115f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31f1a63700 1 -- 172.21.15.62:0/2798873716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc009940 con 0x7f31ec070b90 2024-05-09T06:36:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31f2264700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31ec070280 0x7f31ec115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:36:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31f1a63700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070b90 0x7f31ec116450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31e000b790 tx=0x7f31e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31eaffd700 1 -- 172.21.15.62:0/2798873716 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31e000f770 con 0x7f31ec070b90 2024-05-09T06:36:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31eaffd700 1 -- 172.21.15.62:0/2798873716 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31e000fda0 con 0x7f31ec070b90 2024-05-09T06:36:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec1100f0 con 0x7f31ec070b90 2024-05-09T06:36:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.853+0000 7f31eaffd700 1 -- 172.21.15.62:0/2798873716 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31e000d310 con 0x7f31ec070b90 2024-05-09T06:36:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.854+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec110630 con 0x7f31ec070b90 2024-05-09T06:36:20.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.855+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec0719c0 con 0x7f31ec070b90 2024-05-09T06:36:20.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.855+0000 7f31eaffd700 1 -- 172.21.15.62:0/2798873716 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f31e000f8d0 con 0x7f31ec070b90 2024-05-09T06:36:20.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.856+0000 7f31eaffd700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f31d4078990 0x7f31d407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:20.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.856+0000 7f31eaffd700 1 -- 172.21.15.62:0/2798873716 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f31e009a5c0 con 0x7f31ec070b90 2024-05-09T06:36:20.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.856+0000 7f31f2264700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f31d4078990 0x7f31d407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:20.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.856+0000 7f31f2264700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f31d4078990 0x7f31d407ae40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00b740 tx=0x7f31dc004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:20.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:20.861+0000 7f31eaffd700 1 -- 172.21.15.62:0/2798873716 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f31e00623a0 con 0x7f31ec070b90 2024-05-09T06:36:20.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:20 smithi079 ceph-mon[82381]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:20.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:20 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1602304200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:21.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.096+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f31ec10c1b0 con 0x7f31d4078990 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.097+0000 7f31eaffd700 1 -- 172.21.15.62:0/2798873716 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f31ec10c1b0 con 0x7f31d4078990 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:36:21.078 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:36:21.079 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "7/21 daemons upgraded", 2024-05-09T06:36:21.079 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:36:21.079 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:36:21.079 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:36:21.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f31d4078990 msgr2=0x7f31d407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:21.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f31d4078990 0x7f31d407ae40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00b740 tx=0x7f31dc004d10 comp rx=0 tx=0).stop 2024-05-09T06:36:21.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070b90 msgr2=0x7f31ec116450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:21.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070b90 0x7f31ec116450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31e000b790 tx=0x7f31e0009250 comp rx=0 tx=0).stop 2024-05-09T06:36:21.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 shutdown_connections 2024-05-09T06:36:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31ec070280 0x7f31ec115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f31d4078990 0x7f31d407ae40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 --2- 172.21.15.62:0/2798873716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31ec070b90 0x7f31ec116450 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 >> 172.21.15.62:0/2798873716 conn(0x7f31ec0f8950 msgr2=0x7f31ec0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 shutdown_connections 2024-05-09T06:36:21.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.099+0000 7f31f44c8700 1 -- 172.21.15.62:0/2798873716 wait complete. 2024-05-09T06:36:21.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.205+0000 7f045e5af700 1 -- 172.21.15.62:0/2936924292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458102de0 msgr2=0x7f04581031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.205+0000 7f045e5af700 1 --2- 172.21.15.62:0/2936924292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458102de0 0x7f04581031b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0448004940 tx=0x7f0448009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.205+0000 7f045e5af700 1 -- 172.21.15.62:0/2936924292 shutdown_connections 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.205+0000 7f045e5af700 1 --2- 172.21.15.62:0/2936924292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0458103780 0x7f04580fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.205+0000 7f045e5af700 1 --2- 172.21.15.62:0/2936924292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458102de0 0x7f04581031b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.205+0000 7f045e5af700 1 -- 172.21.15.62:0/2936924292 >> 172.21.15.62:0/2936924292 conn(0x7f04580f8990 msgr2=0x7f04580fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.205+0000 7f045e5af700 1 -- 172.21.15.62:0/2936924292 shutdown_connections 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.205+0000 7f045e5af700 1 -- 172.21.15.62:0/2936924292 wait complete. 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f045e5af700 1 Processor -- start 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f045e5af700 1 -- start start 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f045e5af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0458102de0 0x7f0458113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f045e5af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458103780 0x7f0458113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:21.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f045e5af700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0458114500 con 0x7f0458103780 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f045e5af700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045810db50 con 0x7f0458102de0 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f044ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458103780 0x7f0458113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f044ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458103780 0x7f0458113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57294/0 (socket says 172.21.15.62:57294) 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f044ffff700 1 -- 172.21.15.62:0/1400726029 learned_addr learned my addr 172.21.15.62:0/1400726029 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f0457fff700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0458102de0 0x7f0458113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f044ffff700 1 -- 172.21.15.62:0/1400726029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0458102de0 msgr2=0x7f0458113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f044ffff700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0458102de0 0x7f0458113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f044ffff700 1 -- 172.21.15.62:0/1400726029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448005040 con 0x7f0458103780 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.206+0000 7f0457fff700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0458102de0 0x7f0458113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.207+0000 7f044ffff700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458103780 0x7f0458113eb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0440002a50 tx=0x7f0440004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.207+0000 7f04557fa700 1 -- 172.21.15.62:0/1400726029 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0440007cc0 con 0x7f0458103780 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.207+0000 7f04557fa700 1 -- 172.21.15.62:0/1400726029 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f044000f040 con 0x7f0458103780 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.207+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045810de30 con 0x7f0458103780 2024-05-09T06:36:21.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.207+0000 7f04557fa700 1 -- 172.21.15.62:0/1400726029 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f044000daf0 con 0x7f0458103780 2024-05-09T06:36:21.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.207+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045810e3f0 con 0x7f0458103780 2024-05-09T06:36:21.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.208+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04581000f0 con 0x7f0458103780 2024-05-09T06:36:21.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.208+0000 7f04557fa700 1 -- 172.21.15.62:0/1400726029 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f0440009810 con 0x7f0458103780 2024-05-09T06:36:21.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.209+0000 7f04557fa700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0444078980 0x7f044407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:21.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.209+0000 7f04557fa700 1 -- 172.21.15.62:0/1400726029 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f044009a440 con 0x7f0458103780 2024-05-09T06:36:21.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.209+0000 7f0457fff700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0444078980 0x7f044407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:21.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.210+0000 7f0457fff700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0444078980 0x7f044407ae30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f044800b3b0 tx=0x7f0448009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:21.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.214+0000 7f04557fa700 1 -- 172.21.15.62:0/1400726029 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0440062100 con 0x7f0458103780 2024-05-09T06:36:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.531+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f045810eff0 con 0x7f0458103780 2024-05-09T06:36:21.513 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:21 smithi062 ceph-mon[109590]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:21.513 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:21 smithi062 ceph-mon[109590]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:21.513 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:21 smithi062 ceph-mon[109590]: pgmap v66: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:21.513 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:21 smithi062 ceph-mon[109590]: osd.1 marked itself down and dead 2024-05-09T06:36:21.513 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:21 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2440663082' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:36:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.532+0000 7f04557fa700 1 -- 172.21.15.62:0/1400726029 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+290 (secure 0 0 0) 0x7f0440061aa0 con 0x7f0458103780 2024-05-09T06:36:21.514 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-05-09T06:36:21.514 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:36:21.514 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:36:21.514 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] OSD_DOWN: 1 osds down 2024-05-09T06:36:21.514 INFO:teuthology.orchestra.run.smithi062.stdout: osd.1 (root=default,host=smithi062) is down 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0444078980 msgr2=0x7f044407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0444078980 0x7f044407ae30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f044800b3b0 tx=0x7f0448009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458103780 msgr2=0x7f0458113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458103780 0x7f0458113eb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0440002a50 tx=0x7f0440004600 comp rx=0 tx=0).stop 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 shutdown_connections 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0458102de0 0x7f0458113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0444078980 0x7f044407ae30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 --2- 172.21.15.62:0/1400726029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0458103780 0x7f0458113eb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 >> 172.21.15.62:0/1400726029 conn(0x7f04580f8990 msgr2=0x7f0458107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 shutdown_connections 2024-05-09T06:36:21.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:21.535+0000 7f045e5af700 1 -- 172.21.15.62:0/1400726029 wait complete. 2024-05-09T06:36:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:21 smithi079 ceph-mon[82381]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:21 smithi079 ceph-mon[82381]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:21 smithi079 ceph-mon[82381]: pgmap v66: 65 pgs: 65 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:21 smithi079 ceph-mon[82381]: osd.1 marked itself down and dead 2024-05-09T06:36:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:21 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2440663082' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:36:22.096 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:21 smithi062 podman[126352]: 2024-05-09 06:36:21.842604302 +0000 UTC m=+1.351389618 container died c0457f807e74322a5e3aea098eeaa34855c3b5beee3c3ed97916bd02f6053dbb (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, RELEASE=quincy-4ba5a83) 2024-05-09T06:36:22.404 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:22 smithi062 podman[126352]: 2024-05-09 06:36:22.206995173 +0000 UTC m=+1.715780485 container cleanup c0457f807e74322a5e3aea098eeaa34855c3b5beee3c3ed97916bd02f6053dbb (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, org.label-schema.license=GPLv2, ceph=True, RELEASE=quincy-4ba5a83, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:36:22.404 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:22 smithi062 bash[126352]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1 2024-05-09T06:36:22.661 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:22 smithi062 podman[126418]: 2024-05-09 06:36:22.50009455 +0000 UTC m=+0.654693038 container remove c0457f807e74322a5e3aea098eeaa34855c3b5beee3c3ed97916bd02f6053dbb (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=quincy-4ba5a83, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:36:22.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:22 smithi062 ceph-mon[109590]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:22.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:22 smithi062 ceph-mon[109590]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:36:22.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:22 smithi062 ceph-mon[109590]: osdmap e55: 6 total, 5 up, 6 in 2024-05-09T06:36:22.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:22 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1400726029' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:36:22.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:22 smithi079 ceph-mon[82381]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:22.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:22 smithi079 ceph-mon[82381]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:36:22.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:22 smithi079 ceph-mon[82381]: osdmap e55: 6 total, 5 up, 6 in 2024-05-09T06:36:22.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:22 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1400726029' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:36:23.117 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:22 smithi062 podman[126513]: 2024-05-09 06:36:22.735905466 +0000 UTC m=+0.018733627 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:36:23.117 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:22 smithi062 podman[126513]: 2024-05-09 06:36:22.834728889 +0000 UTC m=+0.117557046 container create 2fd78204824ceb0c3e028b527770b424410317590e896aff0ff0acd1c9753e1b (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-09T06:36:23.117 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:23 smithi062 podman[126513]: 2024-05-09 06:36:23.063211783 +0000 UTC m=+0.346039940 container init 2fd78204824ceb0c3e028b527770b424410317590e896aff0ff0acd1c9753e1b (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-09T06:36:23.117 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:23 smithi062 podman[126513]: 2024-05-09 06:36:23.066878644 +0000 UTC m=+0.349706813 container start 2fd78204824ceb0c3e028b527770b424410317590e896aff0ff0acd1c9753e1b (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507) 2024-05-09T06:36:23.117 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:23 smithi062 podman[126513]: 2024-05-09 06:36:23.13725438 +0000 UTC m=+0.420082537 container attach 2fd78204824ceb0c3e028b527770b424410317590e896aff0ff0acd1c9753e1b (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:36:23.411 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:23 smithi062 podman[126513]: 2024-05-09 06:36:23.38056811 +0000 UTC m=+0.663396269 container died 2fd78204824ceb0c3e028b527770b424410317590e896aff0ff0acd1c9753e1b (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-720f8e9) 2024-05-09T06:36:23.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:23 smithi079 ceph-mon[82381]: pgmap v68: 65 pgs: 12 stale+active+clean, 53 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:23.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:23 smithi079 ceph-mon[82381]: osdmap e56: 6 total, 5 up, 6 in 2024-05-09T06:36:23.904 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:23 smithi062 ceph-mon[109590]: pgmap v68: 65 pgs: 12 stale+active+clean, 53 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:23.904 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:23 smithi062 ceph-mon[109590]: osdmap e56: 6 total, 5 up, 6 in 2024-05-09T06:36:24.161 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:23 smithi062 podman[126539]: 2024-05-09 06:36:23.924287292 +0000 UTC m=+0.537981326 container remove 2fd78204824ceb0c3e028b527770b424410317590e896aff0ff0acd1c9753e1b (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-09T06:36:24.161 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:23 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.1.service: Deactivated successfully. 2024-05-09T06:36:24.161 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:23 smithi062 systemd[1]: Stopped Ceph osd.1 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:36:24.161 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:23 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.1.service: Consumed 1min 9.744s CPU time. 2024-05-09T06:36:24.161 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:24 smithi062 systemd[1]: Starting Ceph osd.1 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:36:24.621 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:24 smithi062 podman[126641]: 2024-05-09 06:36:24.291874311 +0000 UTC m=+0.018978832 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:36:24.621 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:24 smithi062 podman[126641]: 2024-05-09 06:36:24.40902242 +0000 UTC m=+0.136126920 container create 84e77b6f75c2a80af842feeb40e4887863c9e65699afb6dab8a601d09a0cdcc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:36:24.621 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:24 smithi062 podman[126641]: 2024-05-09 06:36:24.637256884 +0000 UTC m=+0.364361395 container init 84e77b6f75c2a80af842feeb40e4887863c9e65699afb6dab8a601d09a0cdcc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-09T06:36:24.621 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:24 smithi062 podman[126641]: 2024-05-09 06:36:24.641154441 +0000 UTC m=+0.368258949 container start 84e77b6f75c2a80af842feeb40e4887863c9e65699afb6dab8a601d09a0cdcc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 2]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [3, 5]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 5]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 1]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 1]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 2]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 1]}]: dispatch 2024-05-09T06:36:24.622 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 0]}]: dispatch 2024-05-09T06:36:24.623 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:24.623 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:24.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 2]}]: dispatch 2024-05-09T06:36:24.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [3, 5]}]: dispatch 2024-05-09T06:36:24.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 5]}]: dispatch 2024-05-09T06:36:24.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 1]}]: dispatch 2024-05-09T06:36:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]: dispatch 2024-05-09T06:36:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 1]}]: dispatch 2024-05-09T06:36:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 2]}]: dispatch 2024-05-09T06:36:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]: dispatch 2024-05-09T06:36:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 1]}]: dispatch 2024-05-09T06:36:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 0]}]: dispatch 2024-05-09T06:36:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:24.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:24.911 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:24 smithi062 podman[126641]: 2024-05-09 06:36:24.804042626 +0000 UTC m=+0.531147139 container attach 84e77b6f75c2a80af842feeb40e4887863c9e65699afb6dab8a601d09a0cdcc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T06:36:25.412 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 bash[126641]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-09T06:36:25.413 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T06:36:25.413 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T06:36:25.413 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T06:36:25.413 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T06:36:25.413 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-09T06:36:25.413 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T06:36:25.413 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate[126655]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-09T06:36:25.413 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:25 smithi062 podman[126641]: 2024-05-09 06:36:25.174161239 +0000 UTC m=+0.901265763 container died 84e77b6f75c2a80af842feeb40e4887863c9e65699afb6dab8a601d09a0cdcc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-09T06:36:25.700 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: pgmap v70: 65 pgs: 12 stale+active+clean, 53 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 2]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [3, 5]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 5]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 1]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 1]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 2]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 1]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 0]}]': finished 2024-05-09T06:36:25.701 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:25 smithi062 ceph-mon[109590]: osdmap e57: 6 total, 5 up, 6 in 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: pgmap v70: 65 pgs: 12 stale+active+clean, 53 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 2]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [3, 5]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 5]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 1]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 1]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 2]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 1]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 0]}]': finished 2024-05-09T06:36:25.744 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:25 smithi079 ceph-mon[82381]: osdmap e57: 6 total, 5 up, 6 in 2024-05-09T06:36:26.347 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:26 smithi062 podman[126800]: 2024-05-09 06:36:26.016640389 +0000 UTC m=+0.836913679 container remove 84e77b6f75c2a80af842feeb40e4887863c9e65699afb6dab8a601d09a0cdcc5 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-09T06:36:26.348 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:26 smithi062 podman[126865]: 2024-05-09 06:36:26.148782388 +0000 UTC m=+0.019262390 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:36:26.348 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:26 smithi062 podman[126865]: 2024-05-09 06:36:26.25636581 +0000 UTC m=+0.126845867 container create 85c00585e2e69d4e66e2ac7817fa57cc95ff32603b4e4a2115761d7b6b2f8cf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507) 2024-05-09T06:36:26.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:26 smithi062 ceph-mon[109590]: osdmap e58: 6 total, 5 up, 6 in 2024-05-09T06:36:26.661 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:26 smithi062 podman[126865]: 2024-05-09 06:36:26.503955439 +0000 UTC m=+0.374435466 container init 85c00585e2e69d4e66e2ac7817fa57cc95ff32603b4e4a2115761d7b6b2f8cf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-09T06:36:26.661 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:26 smithi062 podman[126865]: 2024-05-09 06:36:26.509282133 +0000 UTC m=+0.379762315 container start 85c00585e2e69d4e66e2ac7817fa57cc95ff32603b4e4a2115761d7b6b2f8cf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-09T06:36:26.661 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:26 smithi062 ceph-osd[126884]: -- 172.21.15.62:0/2698264878 <== mon.0 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611de9b5680 con 0x5611de97f000 2024-05-09T06:36:26.661 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:26 smithi062 bash[126865]: 85c00585e2e69d4e66e2ac7817fa57cc95ff32603b4e4a2115761d7b6b2f8cf1 2024-05-09T06:36:26.662 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:26 smithi062 systemd[1]: Started Ceph osd.1 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:36:26.758 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:26 smithi079 ceph-mon[82381]: osdmap e58: 6 total, 5 up, 6 in 2024-05-09T06:36:27.411 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:27 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[126880]: 2024-05-09T06:36:27.049+0000 7fb07164c7c0 -1 Falling back to public interface 2024-05-09T06:36:27.736 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:27 smithi062 ceph-mon[109590]: pgmap v73: 65 pgs: 1 remapped+peering, 8 peering, 11 active+undersized+degraded, 1 stale+active+clean, 18 active+undersized, 26 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/216 objects degraded (12.500%) 2024-05-09T06:36:27.736 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:27 smithi062 ceph-mon[109590]: osdmap e59: 6 total, 5 up, 6 in 2024-05-09T06:36:27.736 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:27 smithi062 ceph-mon[109590]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-05-09T06:36:27.736 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:27 smithi062 ceph-mon[109590]: Health check failed: Degraded data redundancy: 27/216 objects degraded (12.500%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:27.736 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:27.736 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:27.736 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:27.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:27 smithi079 ceph-mon[82381]: pgmap v73: 65 pgs: 1 remapped+peering, 8 peering, 11 active+undersized+degraded, 1 stale+active+clean, 18 active+undersized, 26 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/216 objects degraded (12.500%) 2024-05-09T06:36:27.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:27 smithi079 ceph-mon[82381]: osdmap e59: 6 total, 5 up, 6 in 2024-05-09T06:36:27.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:27 smithi079 ceph-mon[82381]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-05-09T06:36:27.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:27 smithi079 ceph-mon[82381]: Health check failed: Degraded data redundancy: 27/216 objects degraded (12.500%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:27.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:27.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:27.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:28.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:28 smithi062 ceph-mon[109590]: osdmap e60: 6 total, 5 up, 6 in 2024-05-09T06:36:28.718 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:28 smithi062 ceph-mon[109590]: osdmap e61: 6 total, 5 up, 6 in 2024-05-09T06:36:28.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:28 smithi079 ceph-mon[82381]: osdmap e60: 6 total, 5 up, 6 in 2024-05-09T06:36:28.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:28 smithi079 ceph-mon[82381]: osdmap e61: 6 total, 5 up, 6 in 2024-05-09T06:36:29.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:29 smithi062 ceph-mon[109590]: pgmap v76: 65 pgs: 1 remapped+peering, 8 peering, 11 active+undersized+degraded, 1 stale+active+clean, 18 active+undersized, 26 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/216 objects degraded (12.500%) 2024-05-09T06:36:29.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:29 smithi062 ceph-mon[109590]: osdmap e62: 6 total, 5 up, 6 in 2024-05-09T06:36:29.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:29 smithi079 ceph-mon[82381]: pgmap v76: 65 pgs: 1 remapped+peering, 8 peering, 11 active+undersized+degraded, 1 stale+active+clean, 18 active+undersized, 26 active+clean; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/216 objects degraded (12.500%) 2024-05-09T06:36:29.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:29 smithi079 ceph-mon[82381]: osdmap e62: 6 total, 5 up, 6 in 2024-05-09T06:36:30.802 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:30 smithi062 ceph-mon[109590]: pgmap v79: 65 pgs: 9 active+clean+remapped, 26 active+clean, 18 active+undersized, 11 active+undersized+degraded, 1 remapped+peering; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/216 objects degraded (12.500%); 11/216 objects misplaced (5.093%); 4.0 MiB/s, 202 objects/s recovering 2024-05-09T06:36:30.802 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:30 smithi062 ceph-mon[109590]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-05-09T06:36:30.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:30 smithi079 ceph-mon[82381]: pgmap v79: 65 pgs: 9 active+clean+remapped, 26 active+clean, 18 active+undersized, 11 active+undersized+degraded, 1 remapped+peering; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/216 objects degraded (12.500%); 11/216 objects misplaced (5.093%); 4.0 MiB/s, 202 objects/s recovering 2024-05-09T06:36:30.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:30 smithi079 ceph-mon[82381]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-05-09T06:36:32.661 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:32 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[126880]: 2024-05-09T06:36:32.286+0000 7fb07164c7c0 -1 osd.1 54 log_to_monitors true 2024-05-09T06:36:33.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:33 smithi079 ceph-mon[82381]: pgmap v80: 65 pgs: 10 active+clean+remapped, 26 active+clean, 18 active+undersized, 11 active+undersized+degraded; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/216 objects degraded (12.500%); 11/216 objects misplaced (5.093%); 2.9 MiB/s, 280 objects/s recovering 2024-05-09T06:36:33.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:33 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:33.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:33 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:33.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:33 smithi079 ceph-mon[82381]: from='osd.1 [v2:172.21.15.62:6810/2522546383,v1:172.21.15.62:6811/2522546383]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T06:36:33.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:33 smithi062 ceph-mon[109590]: pgmap v80: 65 pgs: 10 active+clean+remapped, 26 active+clean, 18 active+undersized, 11 active+undersized+degraded; 195 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/216 objects degraded (12.500%); 11/216 objects misplaced (5.093%); 2.9 MiB/s, 280 objects/s recovering 2024-05-09T06:36:33.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:33 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:33.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:33 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:33.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:33 smithi062 ceph-mon[109590]: from='osd.1 [v2:172.21.15.62:6810/2522546383,v1:172.21.15.62:6811/2522546383]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T06:36:33.661 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:36:33 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[126880]: 2024-05-09T06:36:33.309+0000 7fb062aa3700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:36:34.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:34 smithi062 ceph-mon[109590]: from='osd.1 [v2:172.21.15.62:6810/2522546383,v1:172.21.15.62:6811/2522546383]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T06:36:34.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:34 smithi062 ceph-mon[109590]: osdmap e63: 6 total, 5 up, 6 in 2024-05-09T06:36:34.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:34 smithi062 ceph-mon[109590]: from='osd.1 [v2:172.21.15.62:6810/2522546383,v1:172.21.15.62:6811/2522546383]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:36:34.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:34 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:34.375 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:34 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:34.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:34 smithi079 ceph-mon[82381]: from='osd.1 [v2:172.21.15.62:6810/2522546383,v1:172.21.15.62:6811/2522546383]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T06:36:34.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:34 smithi079 ceph-mon[82381]: osdmap e63: 6 total, 5 up, 6 in 2024-05-09T06:36:34.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:34 smithi079 ceph-mon[82381]: from='osd.1 [v2:172.21.15.62:6810/2522546383,v1:172.21.15.62:6811/2522546383]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:36:34.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:34 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:34.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:34 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:35.526 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:35 smithi062 ceph-mon[109590]: pgmap v82: 65 pgs: 10 active+clean+remapped, 26 active+clean, 18 active+undersized, 11 active+undersized+degraded; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/216 objects degraded (12.500%); 11/216 objects misplaced (5.093%); 2.7 MiB/s, 258 objects/s recovering 2024-05-09T06:36:35.526 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:35 smithi062 ceph-mon[109590]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:36:35.527 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:35 smithi062 ceph-mon[109590]: osd.1 [v2:172.21.15.62:6810/2522546383,v1:172.21.15.62:6811/2522546383] boot 2024-05-09T06:36:35.527 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:35 smithi062 ceph-mon[109590]: osdmap e64: 6 total, 6 up, 6 in 2024-05-09T06:36:35.527 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:36:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:35 smithi079 ceph-mon[82381]: pgmap v82: 65 pgs: 10 active+clean+remapped, 26 active+clean, 18 active+undersized, 11 active+undersized+degraded; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/216 objects degraded (12.500%); 11/216 objects misplaced (5.093%); 2.7 MiB/s, 258 objects/s recovering 2024-05-09T06:36:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:35 smithi079 ceph-mon[82381]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:36:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:35 smithi079 ceph-mon[82381]: osd.1 [v2:172.21.15.62:6810/2522546383,v1:172.21.15.62:6811/2522546383] boot 2024-05-09T06:36:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:35 smithi079 ceph-mon[82381]: osdmap e64: 6 total, 6 up, 6 in 2024-05-09T06:36:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:35 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:36:36.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:36 smithi079 ceph-mon[82381]: osdmap e65: 6 total, 6 up, 6 in 2024-05-09T06:36:36.659 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:36 smithi062 ceph-mon[109590]: osdmap e65: 6 total, 6 up, 6 in 2024-05-09T06:36:37.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:37 smithi079 ceph-mon[82381]: pgmap v85: 65 pgs: 9 remapped+peering, 19 peering, 27 active+clean, 5 active+undersized, 5 active+undersized+degraded; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/216 objects degraded (5.093%); 0 B/s, 123 objects/s recovering 2024-05-09T06:36:37.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:37 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 11/216 objects degraded (5.093%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:37.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:37 smithi079 ceph-mon[82381]: osdmap e66: 6 total, 6 up, 6 in 2024-05-09T06:36:37.595 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:37 smithi062 ceph-mon[109590]: pgmap v85: 65 pgs: 9 remapped+peering, 19 peering, 27 active+clean, 5 active+undersized, 5 active+undersized+degraded; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/216 objects degraded (5.093%); 0 B/s, 123 objects/s recovering 2024-05-09T06:36:37.596 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:37 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 11/216 objects degraded (5.093%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:37.596 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:37 smithi062 ceph-mon[109590]: osdmap e66: 6 total, 6 up, 6 in 2024-05-09T06:36:38.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: osdmap e67: 6 total, 6 up, 6 in 2024-05-09T06:36:38.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:38.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:38.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:38.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:36:38.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:38.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:38.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:38.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:38.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:38.413 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:36:38.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: osdmap e67: 6 total, 6 up, 6 in 2024-05-09T06:36:38.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:38.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:38.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:38.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:36:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:38.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:36:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:39 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:36:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:39 smithi079 ceph-mon[82381]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-05-09T06:36:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:39 smithi079 ceph-mon[82381]: pgmap v88: 65 pgs: 9 remapped+peering, 19 peering, 27 active+clean, 5 active+undersized, 5 active+undersized+degraded; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/216 objects degraded (5.093%) 2024-05-09T06:36:39.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:39 smithi079 ceph-mon[82381]: osdmap e68: 6 total, 6 up, 6 in 2024-05-09T06:36:39.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:39.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:39.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:39 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:36:39.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:39 smithi062 ceph-mon[109590]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-05-09T06:36:39.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:39 smithi062 ceph-mon[109590]: pgmap v88: 65 pgs: 9 remapped+peering, 19 peering, 27 active+clean, 5 active+undersized, 5 active+undersized+degraded; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/216 objects degraded (5.093%) 2024-05-09T06:36:39.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:39 smithi062 ceph-mon[109590]: osdmap e68: 6 total, 6 up, 6 in 2024-05-09T06:36:39.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:39.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:40.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:40 smithi079 ceph-mon[82381]: osdmap e69: 6 total, 6 up, 6 in 2024-05-09T06:36:40.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:40 smithi062 ceph-mon[109590]: osdmap e69: 6 total, 6 up, 6 in 2024-05-09T06:36:41.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:41 smithi079 ceph-mon[82381]: pgmap v91: 65 pgs: 2 remapped+peering, 3 peering, 60 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s, 9 objects/s recovering 2024-05-09T06:36:41.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:41 smithi079 ceph-mon[82381]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T06:36:41.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:41 smithi079 ceph-mon[82381]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/216 objects degraded (5.093%), 5 pgs degraded) 2024-05-09T06:36:41.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:41 smithi079 ceph-mon[82381]: osdmap e70: 6 total, 6 up, 6 in 2024-05-09T06:36:41.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:41 smithi062 ceph-mon[109590]: pgmap v91: 65 pgs: 2 remapped+peering, 3 peering, 60 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s, 9 objects/s recovering 2024-05-09T06:36:41.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:41 smithi062 ceph-mon[109590]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T06:36:41.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:41 smithi062 ceph-mon[109590]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/216 objects degraded (5.093%), 5 pgs degraded) 2024-05-09T06:36:41.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:41 smithi062 ceph-mon[109590]: osdmap e70: 6 total, 6 up, 6 in 2024-05-09T06:36:43.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:43 smithi079 ceph-mon[82381]: pgmap v93: 65 pgs: 2 remapped+peering, 2 peering, 61 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s, 8 objects/s recovering 2024-05-09T06:36:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:43 smithi062 ceph-mon[109590]: pgmap v93: 65 pgs: 2 remapped+peering, 2 peering, 61 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s, 8 objects/s recovering 2024-05-09T06:36:44.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:44 smithi062 ceph-mon[109590]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T06:36:44.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:44 smithi079 ceph-mon[82381]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T06:36:45.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:45 smithi062 ceph-mon[109590]: pgmap v94: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s, 243 objects/s recovering 2024-05-09T06:36:45.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:45 smithi079 ceph-mon[82381]: pgmap v94: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s, 243 objects/s recovering 2024-05-09T06:36:47.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:47 smithi062 ceph-mon[109590]: pgmap v95: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s, 192 objects/s recovering 2024-05-09T06:36:47.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:47 smithi079 ceph-mon[82381]: pgmap v95: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s, 192 objects/s recovering 2024-05-09T06:36:49.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:49 smithi062 ceph-mon[109590]: pgmap v96: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s, 170 objects/s recovering 2024-05-09T06:36:49.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:49 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:49.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:49 smithi079 ceph-mon[82381]: pgmap v96: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s, 170 objects/s recovering 2024-05-09T06:36:49.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:49 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:51.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.657+0000 7f3eed326700 1 -- 172.21.15.62:0/1833645585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 msgr2=0x7f3ee8106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:51.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.657+0000 7f3eed326700 1 --2- 172.21.15.62:0/1833645585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 0x7f3ee8106e40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3edc004940 tx=0x7f3edc009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:51.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.657+0000 7f3eed326700 1 -- 172.21.15.62:0/1833645585 shutdown_connections 2024-05-09T06:36:51.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.657+0000 7f3eed326700 1 --2- 172.21.15.62:0/1833645585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 0x7f3ee8106e40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.657+0000 7f3eed326700 1 --2- 172.21.15.62:0/1833645585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee80fde60 0x7f3ee80fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.657+0000 7f3eed326700 1 -- 172.21.15.62:0/1833645585 >> 172.21.15.62:0/1833645585 conn(0x7f3ee80f7870 msgr2=0x7f3ee80f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:51.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.657+0000 7f3eed326700 1 -- 172.21.15.62:0/1833645585 shutdown_connections 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.657+0000 7f3eed326700 1 -- 172.21.15.62:0/1833645585 wait complete. 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3eed326700 1 Processor -- start 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3eed326700 1 -- start start 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3eed326700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee80fde60 0x7f3ee8113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3eed326700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 0x7f3ee8113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3eed326700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee8114490 con 0x7f3ee80fe800 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3eed326700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee810da90 con 0x7f3ee80fde60 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3ee67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 0x7f3ee8113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3ee67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 0x7f3ee8113e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41124/0 (socket says 172.21.15.62:41124) 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3ee67fc700 1 -- 172.21.15.62:0/3979354433 learned_addr learned my addr 172.21.15.62:0/3979354433 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.658+0000 7f3ee6ffd700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee80fde60 0x7f3ee8113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3ee67fc700 1 -- 172.21.15.62:0/3979354433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee80fde60 msgr2=0x7f3ee8113900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3ee67fc700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee80fde60 0x7f3ee8113900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3ee67fc700 1 -- 172.21.15.62:0/3979354433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc005040 con 0x7f3ee80fe800 2024-05-09T06:36:51.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3ee67fc700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 0x7f3ee8113e40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3edc000c00 tx=0x7f3edc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:51.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3ecf7fe700 1 -- 172.21.15.62:0/3979354433 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3edc021070 con 0x7f3ee80fe800 2024-05-09T06:36:51.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee810dd10 con 0x7f3ee80fe800 2024-05-09T06:36:51.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3ecf7fe700 1 -- 172.21.15.62:0/3979354433 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3edc013c00 con 0x7f3ee80fe800 2024-05-09T06:36:51.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3ecf7fe700 1 -- 172.21.15.62:0/3979354433 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3edc00e070 con 0x7f3ee80fe800 2024-05-09T06:36:51.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.659+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee810e250 con 0x7f3ee80fe800 2024-05-09T06:36:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.660+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee8066ad0 con 0x7f3ee80fe800 2024-05-09T06:36:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.661+0000 7f3ecf7fe700 1 -- 172.21.15.62:0/3979354433 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f3edc01c400 con 0x7f3ee80fe800 2024-05-09T06:36:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.662+0000 7f3ecf7fe700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3ed0078990 0x7f3ed007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.662+0000 7f3ecf7fe700 1 -- 172.21.15.62:0/3979354433 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f3edc09bc60 con 0x7f3ee80fe800 2024-05-09T06:36:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.662+0000 7f3ee6ffd700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3ed0078990 0x7f3ed007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:51.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.662+0000 7f3ee6ffd700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3ed0078990 0x7f3ed007ae40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009b80 tx=0x7f3ed800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:51.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.667+0000 7f3ecf7fe700 1 -- 172.21.15.62:0/3979354433 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f3edc063880 con 0x7f3ee80fe800 2024-05-09T06:36:51.648 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:51 smithi062 ceph-mon[109590]: pgmap v97: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 141 objects/s recovering 2024-05-09T06:36:51.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:51 smithi079 ceph-mon[82381]: pgmap v97: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 141 objects/s recovering 2024-05-09T06:36:51.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.899+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ee810efc0 con 0x7f3ed0078990 2024-05-09T06:36:51.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.901+0000 7f3ecf7fe700 1 -- 172.21.15.62:0/3979354433 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3ee810efc0 con 0x7f3ed0078990 2024-05-09T06:36:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3ed0078990 msgr2=0x7f3ed007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3ed0078990 0x7f3ed007ae40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009b80 tx=0x7f3ed800b040 comp rx=0 tx=0).stop 2024-05-09T06:36:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 msgr2=0x7f3ee8113e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 0x7f3ee8113e40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3edc000c00 tx=0x7f3edc009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 shutdown_connections 2024-05-09T06:36:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ee80fde60 0x7f3ee8113900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3ed0078990 0x7f3ed007ae40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 --2- 172.21.15.62:0/3979354433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee80fe800 0x7f3ee8113e40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 >> 172.21.15.62:0/3979354433 conn(0x7f3ee80f7870 msgr2=0x7f3ee8102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 shutdown_connections 2024-05-09T06:36:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:51.903+0000 7f3eed326700 1 -- 172.21.15.62:0/3979354433 wait complete. 2024-05-09T06:36:51.895 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:36:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.010+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/69276810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 msgr2=0x7f0bf01020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.010+0000 7f0bf4ba2700 1 --2- 172.21.15.62:0/69276810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 0x7f0bf01020d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0be0004940 tx=0x7f0be0009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/69276810 shutdown_connections 2024-05-09T06:36:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 --2- 172.21.15.62:0/69276810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bf01026a0 0x7f0bf00fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 --2- 172.21.15.62:0/69276810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 0x7f0bf01020d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/69276810 >> 172.21.15.62:0/69276810 conn(0x7f0bf00f7850 msgr2=0x7f0bf00f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/69276810 shutdown_connections 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/69276810 wait complete. 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 Processor -- start 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 -- start start 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 0x7f0bf0102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bf01026a0 0x7f0bf01030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0104b00 con 0x7f0bf0101d00 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.011+0000 7f0bf4ba2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf01035e0 con 0x7f0bf01026a0 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bee59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 0x7f0bf0102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bee59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 0x7f0bf0102b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41134/0 (socket says 172.21.15.62:41134) 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bee59c700 1 -- 172.21.15.62:0/1112020539 learned_addr learned my addr 172.21.15.62:0/1112020539 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bedd9b700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bf01026a0 0x7f0bf01030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bee59c700 1 -- 172.21.15.62:0/1112020539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bf01026a0 msgr2=0x7f0bf01030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bee59c700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bf01026a0 0x7f0bf01030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bee59c700 1 -- 172.21.15.62:0/1112020539 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0005040 con 0x7f0bf0101d00 2024-05-09T06:36:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bee59c700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 0x7f0bf0102b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0be000b3b0 tx=0x7f0be0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bdeffd700 1 -- 172.21.15.62:0/1112020539 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be000e040 con 0x7f0bf0101d00 2024-05-09T06:36:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bdeffd700 1 -- 172.21.15.62:0/1112020539 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0be0013420 con 0x7f0bf0101d00 2024-05-09T06:36:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf0103830 con 0x7f0bf0101d00 2024-05-09T06:36:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bdeffd700 1 -- 172.21.15.62:0/1112020539 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be001c630 con 0x7f0bf0101d00 2024-05-09T06:36:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.012+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf011a0d0 con 0x7f0bf0101d00 2024-05-09T06:36:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.013+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf00fd450 con 0x7f0bf0101d00 2024-05-09T06:36:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.014+0000 7f0bdeffd700 1 -- 172.21.15.62:0/1112020539 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f0be0013590 con 0x7f0bf0101d00 2024-05-09T06:36:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.015+0000 7f0bdeffd700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bd8078990 0x7f0bd807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.015+0000 7f0bedd9b700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bd8078990 0x7f0bd807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.015+0000 7f0bdeffd700 1 -- 172.21.15.62:0/1112020539 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f0be009b860 con 0x7f0bf0101d00 2024-05-09T06:36:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.015+0000 7f0bedd9b700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bd8078990 0x7f0bd807ae40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0104290 tx=0x7f0be40043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:52.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.020+0000 7f0bdeffd700 1 -- 172.21.15.62:0/1112020539 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0be0063520 con 0x7f0bf0101d00 2024-05-09T06:36:52.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.256+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bf00f96b0 con 0x7f0bd8078990 2024-05-09T06:36:52.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.258+0000 7f0bdeffd700 1 -- 172.21.15.62:0/1112020539 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0bf00f96b0 con 0x7f0bd8078990 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bd8078990 msgr2=0x7f0bd807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bd8078990 0x7f0bd807ae40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0104290 tx=0x7f0be40043c0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 msgr2=0x7f0bf0102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 0x7f0bf0102b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0be000b3b0 tx=0x7f0be0009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 shutdown_connections 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bd8078990 0x7f0bd807ae40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bf0101d00 0x7f0bf0102b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 --2- 172.21.15.62:0/1112020539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bf01026a0 0x7f0bf01030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 >> 172.21.15.62:0/1112020539 conn(0x7f0bf00f7850 msgr2=0x7f0bf00f8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 shutdown_connections 2024-05-09T06:36:52.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.260+0000 7f0bf4ba2700 1 -- 172.21.15.62:0/1112020539 wait complete. 2024-05-09T06:36:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 -- 172.21.15.62:0/3479466925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 msgr2=0x7f8d10106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 --2- 172.21.15.62:0/3479466925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 0x7f8d10106df0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d04004940 tx=0x7f8d04009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 -- 172.21.15.62:0/3479466925 shutdown_connections 2024-05-09T06:36:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 --2- 172.21.15.62:0/3479466925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 0x7f8d10106df0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 --2- 172.21.15.62:0/3479466925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d100fde10 0x7f8d100fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 -- 172.21.15.62:0/3479466925 >> 172.21.15.62:0/3479466925 conn(0x7f8d100f7860 msgr2=0x7f8d100f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 -- 172.21.15.62:0/3479466925 shutdown_connections 2024-05-09T06:36:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 -- 172.21.15.62:0/3479466925 wait complete. 2024-05-09T06:36:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.369+0000 7f8d15a83700 1 Processor -- start 2024-05-09T06:36:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d15a83700 1 -- start start 2024-05-09T06:36:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d15a83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d100fde10 0x7f8d10113a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d15a83700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 0x7f8d10113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d15a83700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101145b0 con 0x7f8d100fe7b0 2024-05-09T06:36:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d15a83700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1010db90 con 0x7f8d100fde10 2024-05-09T06:36:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 0x7f8d10113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:52.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 0x7f8d10113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41142/0 (socket says 172.21.15.62:41142) 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0effd700 1 -- 172.21.15.62:0/3430619475 learned_addr learned my addr 172.21.15.62:0/3430619475 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0f7fe700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d100fde10 0x7f8d10113a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0effd700 1 -- 172.21.15.62:0/3430619475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d100fde10 msgr2=0x7f8d10113a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0effd700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d100fde10 0x7f8d10113a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0effd700 1 -- 172.21.15.62:0/3430619475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04005040 con 0x7f8d100fe7b0 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0f7fe700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d100fde10 0x7f8d10113a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.370+0000 7f8d0effd700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 0x7f8d10113f60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009380 tx=0x7f8d04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.371+0000 7f8cf7fff700 1 -- 172.21.15.62:0/3430619475 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d0400e040 con 0x7f8d100fe7b0 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.371+0000 7f8cf7fff700 1 -- 172.21.15.62:0/3430619475 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d04009af0 con 0x7f8d100fe7b0 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.371+0000 7f8cf7fff700 1 -- 172.21.15.62:0/3430619475 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d0401c630 con 0x7f8d100fe7b0 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.371+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1010de10 con 0x7f8d100fe7b0 2024-05-09T06:36:52.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.371+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1010e300 con 0x7f8d100fe7b0 2024-05-09T06:36:52.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.372+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d10066b50 con 0x7f8d100fe7b0 2024-05-09T06:36:52.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.373+0000 7f8cf7fff700 1 -- 172.21.15.62:0/3430619475 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f8d0400bbc0 con 0x7f8d100fe7b0 2024-05-09T06:36:52.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.373+0000 7f8cf7fff700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8cf8078990 0x7f8cf807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:52.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.373+0000 7f8cf7fff700 1 -- 172.21.15.62:0/3430619475 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f8d0409ba70 con 0x7f8d100fe7b0 2024-05-09T06:36:52.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.373+0000 7f8d0f7fe700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8cf8078990 0x7f8cf807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:52.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.374+0000 7f8d0f7fe700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8cf8078990 0x7f8cf807ae40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d00001250 tx=0x7f8d0000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.378+0000 7f8cf7fff700 1 -- 172.21.15.62:0/3430619475 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8d04063690 con 0x7f8d100fe7b0 2024-05-09T06:36:52.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.605+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d10109ea0 con 0x7f8cf8078990 2024-05-09T06:36:52.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.615+0000 7f8cf7fff700 1 -- 172.21.15.62:0/3430619475 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8d10109ea0 con 0x7f8cf8078990 2024-05-09T06:36:52.596 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:36:52.596 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (4m) 20s ago 15m 26.3M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:36:52.596 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (90s) 20s ago 15m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:36:52.596 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (84s) 81s ago 14m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (3m) 20s ago 14m 79.6M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (9m) 20s ago 9m 16.6M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (9m) 20s ago 9m 152M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (9m) 81s ago 9m 15.8M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (9m) 81s ago 9m 15.7M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (5m) 20s ago 16m 518M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (4m) 81s ago 14m 464M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (2m) 20s ago 16m 46.1M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (2m) 81s ago 13m 33.9M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (4m) 20s ago 15m 15.1M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (4m) 81s ago 14m 17.7M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (63s) 20s ago 13m 130M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (26s) 20s ago 12m 12.8M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:36:52.597 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (12m) 20s ago 12m 250M 1557M 17.2.7-933-g4ba5a836 b96134859c76 b708acc93270 2024-05-09T06:36:52.598 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (11m) 81s ago 11m 284M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:36:52.598 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (11m) 81s ago 11m 253M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:36:52.598 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (11m) 81s ago 11m 248M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:36:52.598 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (4m) 20s ago 14m 65.7M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8cf8078990 msgr2=0x7f8cf807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8cf8078990 0x7f8cf807ae40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d00001250 tx=0x7f8d0000b040 comp rx=0 tx=0).stop 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 msgr2=0x7f8d10113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 0x7f8d10113f60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009380 tx=0x7f8d04009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 shutdown_connections 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d100fde10 0x7f8d10113a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8cf8078990 0x7f8cf807ae40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 --2- 172.21.15.62:0/3430619475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d100fe7b0 0x7f8d10113f60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 >> 172.21.15.62:0/3430619475 conn(0x7f8d100f7860 msgr2=0x7f8d100f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 shutdown_connections 2024-05-09T06:36:52.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.618+0000 7f8d15a83700 1 -- 172.21.15.62:0/3430619475 wait complete. 2024-05-09T06:36:52.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.726+0000 7f8913165700 1 -- 172.21.15.62:0/3414452969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c101ce0 msgr2=0x7f890c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:52.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.726+0000 7f8913165700 1 --2- 172.21.15.62:0/3414452969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c101ce0 0x7f890c1020b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8900004940 tx=0x7f8900009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:52.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.726+0000 7f8913165700 1 -- 172.21.15.62:0/3414452969 shutdown_connections 2024-05-09T06:36:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.726+0000 7f8913165700 1 --2- 172.21.15.62:0/3414452969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890c102680 0x7f890c0fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.726+0000 7f8913165700 1 --2- 172.21.15.62:0/3414452969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c101ce0 0x7f890c1020b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.726+0000 7f8913165700 1 -- 172.21.15.62:0/3414452969 >> 172.21.15.62:0/3414452969 conn(0x7f890c0f7850 msgr2=0x7f890c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.726+0000 7f8913165700 1 -- 172.21.15.62:0/3414452969 shutdown_connections 2024-05-09T06:36:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.726+0000 7f8913165700 1 -- 172.21.15.62:0/3414452969 wait complete. 2024-05-09T06:36:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f8913165700 1 Processor -- start 2024-05-09T06:36:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f8913165700 1 -- start start 2024-05-09T06:36:52.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f8913165700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890c101ce0 0x7f890c102b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:52.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f8913165700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c102680 0x7f890c103080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:52.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f8913165700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c1036a0 con 0x7f890c102680 2024-05-09T06:36:52.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f8913165700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c1037e0 con 0x7f890c101ce0 2024-05-09T06:36:52.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f890bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c102680 0x7f890c103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:52.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f890bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c102680 0x7f890c103080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41164/0 (socket says 172.21.15.62:41164) 2024-05-09T06:36:52.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.727+0000 7f890bfff700 1 -- 172.21.15.62:0/1061322568 learned_addr learned my addr 172.21.15.62:0/1061322568 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f8910f01700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890c101ce0 0x7f890c102b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f890bfff700 1 -- 172.21.15.62:0/1061322568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890c101ce0 msgr2=0x7f890c102b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f890bfff700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890c101ce0 0x7f890c102b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f890bfff700 1 -- 172.21.15.62:0/1061322568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8900005040 con 0x7f890c102680 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f8910f01700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890c101ce0 0x7f890c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f890bfff700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c102680 0x7f890c103080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b790 tx=0x7f88f8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f89097fa700 1 -- 172.21.15.62:0/1061322568 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f800f6f0 con 0x7f890c102680 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f89097fa700 1 -- 172.21.15.62:0/1061322568 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88f800fd20 con 0x7f890c102680 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890c119e80 con 0x7f890c102680 2024-05-09T06:36:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f89097fa700 1 -- 172.21.15.62:0/1061322568 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88f80103a0 con 0x7f890c102680 2024-05-09T06:36:52.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.728+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c11a360 con 0x7f890c102680 2024-05-09T06:36:52.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.729+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890c0fd430 con 0x7f890c102680 2024-05-09T06:36:52.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.730+0000 7f89097fa700 1 -- 172.21.15.62:0/1061322568 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f88f800f850 con 0x7f890c102680 2024-05-09T06:36:52.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.730+0000 7f89097fa700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f88fc078980 0x7f88fc07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:52.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.731+0000 7f8910f01700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f88fc078980 0x7f88fc07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:52.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.731+0000 7f89097fa700 1 -- 172.21.15.62:0/1061322568 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f88f809a4d0 con 0x7f890c102680 2024-05-09T06:36:52.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.731+0000 7f8910f01700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f88fc078980 0x7f88fc07ae30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8900004f90 tx=0x7f8900009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:52.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:52.735+0000 7f89097fa700 1 -- 172.21.15.62:0/1061322568 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f88f80620f0 con 0x7f890c102680 2024-05-09T06:36:53.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.047+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f890c05f5c0 con 0x7f890c102680 2024-05-09T06:36:53.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.048+0000 7f89097fa700 1 -- 172.21.15.62:0/1061322568 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f88f8061a90 con 0x7f890c102680 2024-05-09T06:36:53.029 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:36:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:36:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:36:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:36:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:36:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:36:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4, 2024-05-09T06:36:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:36:53.031 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:36:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:36:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:36:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:36:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 8, 2024-05-09T06:36:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:36:53.032 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:36:53.033 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:36:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.050+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f88fc078980 msgr2=0x7f88fc07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.050+0000 7f8913165700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f88fc078980 0x7f88fc07ae30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8900004f90 tx=0x7f8900009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.050+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c102680 msgr2=0x7f890c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.050+0000 7f8913165700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c102680 0x7f890c103080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f88f800b790 tx=0x7f88f8009220 comp rx=0 tx=0).stop 2024-05-09T06:36:53.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.051+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 shutdown_connections 2024-05-09T06:36:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.051+0000 7f8913165700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f890c101ce0 0x7f890c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.051+0000 7f8913165700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f88fc078980 0x7f88fc07ae30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.051+0000 7f8913165700 1 --2- 172.21.15.62:0/1061322568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f890c102680 0x7f890c103080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.051+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 >> 172.21.15.62:0/1061322568 conn(0x7f890c0f7850 msgr2=0x7f890c0f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.051+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 shutdown_connections 2024-05-09T06:36:53.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.051+0000 7f8913165700 1 -- 172.21.15.62:0/1061322568 wait complete. 2024-05-09T06:36:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.165+0000 7f97a9e3c700 1 -- 172.21.15.62:0/1215758914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a40fbd40 msgr2=0x7f97a40fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.165+0000 7f97a9e3c700 1 --2- 172.21.15.62:0/1215758914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a40fbd40 0x7f97a40fc1b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f978c004940 tx=0x7f978c009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.165+0000 7f97a9e3c700 1 -- 172.21.15.62:0/1215758914 shutdown_connections 2024-05-09T06:36:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.165+0000 7f97a9e3c700 1 --2- 172.21.15.62:0/1215758914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a40fbd40 0x7f97a40fc1b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.165+0000 7f97a9e3c700 1 --2- 172.21.15.62:0/1215758914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a4101d90 0x7f97a4102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.165+0000 7f97a9e3c700 1 -- 172.21.15.62:0/1215758914 >> 172.21.15.62:0/1215758914 conn(0x7f97a4071d00 msgr2=0x7f97a4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.165+0000 7f97a9e3c700 1 -- 172.21.15.62:0/1215758914 shutdown_connections 2024-05-09T06:36:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.165+0000 7f97a9e3c700 1 -- 172.21.15.62:0/1215758914 wait complete. 2024-05-09T06:36:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.166+0000 7f97a9e3c700 1 Processor -- start 2024-05-09T06:36:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.166+0000 7f97a9e3c700 1 -- start start 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.166+0000 7f97a9e3c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a40fbd40 0x7f97a4115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.166+0000 7f97a9e3c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a4101d90 0x7f97a4116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.166+0000 7f97a9e3c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4116860 con 0x7f97a4101d90 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.166+0000 7f97a9e3c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a410fc70 con 0x7f97a40fbd40 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a4101d90 0x7f97a4116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a4101d90 0x7f97a4116210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41184/0 (socket says 172.21.15.62:41184) 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a2ffd700 1 -- 172.21.15.62:0/2807110814 learned_addr learned my addr 172.21.15.62:0/2807110814 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a37fe700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a40fbd40 0x7f97a4115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a2ffd700 1 -- 172.21.15.62:0/2807110814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a40fbd40 msgr2=0x7f97a4115cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a2ffd700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a40fbd40 0x7f97a4115cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a2ffd700 1 -- 172.21.15.62:0/2807110814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c005040 con 0x7f97a4101d90 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a2ffd700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a4101d90 0x7f97a4116210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f978c009150 tx=0x7f978c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f979bfff700 1 -- 172.21.15.62:0/2807110814 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978c021070 con 0x7f97a4101d90 2024-05-09T06:36:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f979bfff700 1 -- 172.21.15.62:0/2807110814 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f978c013c00 con 0x7f97a4101d90 2024-05-09T06:36:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a410fef0 con 0x7f97a4101d90 2024-05-09T06:36:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.167+0000 7f979bfff700 1 -- 172.21.15.62:0/2807110814 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978c00e070 con 0x7f97a4101d90 2024-05-09T06:36:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.168+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a41103d0 con 0x7f97a4101d90 2024-05-09T06:36:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.168+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a40fd430 con 0x7f97a4101d90 2024-05-09T06:36:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.169+0000 7f979bfff700 1 -- 172.21.15.62:0/2807110814 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f978c01c400 con 0x7f97a4101d90 2024-05-09T06:36:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.170+0000 7f979bfff700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9790078980 0x7f979007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.170+0000 7f979bfff700 1 -- 172.21.15.62:0/2807110814 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f978c09bb80 con 0x7f97a4101d90 2024-05-09T06:36:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.170+0000 7f97a37fe700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9790078980 0x7f979007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.170+0000 7f97a37fe700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9790078980 0x7f979007ae30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9794009b80 tx=0x7f979400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:53.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.175+0000 7f979bfff700 1 -- 172.21.15.62:0/2807110814 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f978c063840 con 0x7f97a4101d90 2024-05-09T06:36:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.444+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f97a4111390 con 0x7f97a4101d90 2024-05-09T06:36:53.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.445+0000 7f979bfff700 1 -- 172.21.15.62:0/2807110814 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f978c004490 con 0x7f97a4101d90 2024-05-09T06:36:53.426 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:36:53.426 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:36:53.426 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:36:53.426 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:36:53.426 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:36:53.427 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:36:53.428 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:53.429 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:53.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9790078980 msgr2=0x7f979007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9790078980 0x7f979007ae30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9794009b80 tx=0x7f979400b040 comp rx=0 tx=0).stop 2024-05-09T06:36:53.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a4101d90 msgr2=0x7f97a4116210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a4101d90 0x7f97a4116210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f978c009150 tx=0x7f978c009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:53.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 shutdown_connections 2024-05-09T06:36:53.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97a40fbd40 0x7f97a4115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9790078980 0x7f979007ae30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 --2- 172.21.15.62:0/2807110814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97a4101d90 0x7f97a4116210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.447+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 >> 172.21.15.62:0/2807110814 conn(0x7f97a4071d00 msgr2=0x7f97a40fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:53.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.448+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 shutdown_connections 2024-05-09T06:36:53.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.448+0000 7f97a9e3c700 1 -- 172.21.15.62:0/2807110814 wait complete. 2024-05-09T06:36:53.431 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:36:53.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.557+0000 7ffba8be9700 1 -- 172.21.15.62:0/2282419539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 msgr2=0x7ffba41021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.557+0000 7ffba8be9700 1 --2- 172.21.15.62:0/2282419539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 0x7ffba41021e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb94004940 tx=0x7ffb94009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.557+0000 7ffba8be9700 1 -- 172.21.15.62:0/2282419539 shutdown_connections 2024-05-09T06:36:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.557+0000 7ffba8be9700 1 --2- 172.21.15.62:0/2282419539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffba40fc630 0x7ffba40fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.557+0000 7ffba8be9700 1 --2- 172.21.15.62:0/2282419539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 0x7ffba41021e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.557+0000 7ffba8be9700 1 -- 172.21.15.62:0/2282419539 >> 172.21.15.62:0/2282419539 conn(0x7ffba40714d0 msgr2=0x7ffba40718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba8be9700 1 -- 172.21.15.62:0/2282419539 shutdown_connections 2024-05-09T06:36:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba8be9700 1 -- 172.21.15.62:0/2282419539 wait complete. 2024-05-09T06:36:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba8be9700 1 Processor -- start 2024-05-09T06:36:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba8be9700 1 -- start start 2024-05-09T06:36:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba8be9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffba40fc630 0x7ffba410c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba8be9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 0x7ffba410ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba8be9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40fc3b0 con 0x7ffba4101e10 2024-05-09T06:36:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba8be9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba410d3c0 con 0x7ffba40fc630 2024-05-09T06:36:53.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 0x7ffba410ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 0x7ffba410ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41214/0 (socket says 172.21.15.62:41214) 2024-05-09T06:36:53.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.558+0000 7ffba1d9b700 1 -- 172.21.15.62:0/736699319 learned_addr learned my addr 172.21.15.62:0/736699319 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:53.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffba259c700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffba40fc630 0x7ffba410c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffba1d9b700 1 -- 172.21.15.62:0/736699319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffba40fc630 msgr2=0x7ffba410c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffba1d9b700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffba40fc630 0x7ffba410c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffba1d9b700 1 -- 172.21.15.62:0/736699319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb94005040 con 0x7ffba4101e10 2024-05-09T06:36:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffba1d9b700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 0x7ffba410ce80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800eb40 tx=0x7ffb9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffb92ffd700 1 -- 172.21.15.62:0/736699319 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb98007cc0 con 0x7ffba4101e10 2024-05-09T06:36:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffb92ffd700 1 -- 172.21.15.62:0/736699319 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb9800f040 con 0x7ffba4101e10 2024-05-09T06:36:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffb92ffd700 1 -- 172.21.15.62:0/736699319 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb98009620 con 0x7ffba4101e10 2024-05-09T06:36:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba410d640 con 0x7ffba4101e10 2024-05-09T06:36:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.559+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba411a170 con 0x7ffba4101e10 2024-05-09T06:36:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.560+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba40ff130 con 0x7ffba4101e10 2024-05-09T06:36:53.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.562+0000 7ffb92ffd700 1 -- 172.21.15.62:0/736699319 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7ffb98009780 con 0x7ffba4101e10 2024-05-09T06:36:53.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.562+0000 7ffb92ffd700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ffb8c078990 0x7ffb8c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.562+0000 7ffba259c700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ffb8c078990 0x7ffb8c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.562+0000 7ffb92ffd700 1 -- 172.21.15.62:0/736699319 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6614+0+0 (secure 0 0 0) 0x7ffb9809a3e0 con 0x7ffba4101e10 2024-05-09T06:36:53.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.563+0000 7ffba259c700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ffb8c078990 0x7ffb8c07ae40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffb940043d0 tx=0x7ffb94009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:53.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.567+0000 7ffb92ffd700 1 -- 172.21.15.62:0/736699319 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ffb98062030 con 0x7ffba4101e10 2024-05-09T06:36:53.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:53 smithi062 ceph-mon[109590]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:53.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:53 smithi062 ceph-mon[109590]: pgmap v98: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 121 objects/s recovering 2024-05-09T06:36:53.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:53 smithi062 ceph-mon[109590]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:53.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:53 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:36:53.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:53 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1061322568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.804+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffba4108f00 con 0x7ffb8c078990 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.805+0000 7ffb92ffd700 1 -- 172.21.15.62:0/736699319 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffba4108f00 con 0x7ffb8c078990 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:36:53.786 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:36:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:36:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "8/21 daemons upgraded", 2024-05-09T06:36:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:36:53.787 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:36:53.787 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:36:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.807+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ffb8c078990 msgr2=0x7ffb8c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.807+0000 7ffba8be9700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ffb8c078990 0x7ffb8c07ae40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffb940043d0 tx=0x7ffb94009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.807+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 msgr2=0x7ffba410ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.807+0000 7ffba8be9700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 0x7ffba410ce80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800eb40 tx=0x7ffb9800b040 comp rx=0 tx=0).stop 2024-05-09T06:36:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.808+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 shutdown_connections 2024-05-09T06:36:53.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.808+0000 7ffba8be9700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffba40fc630 0x7ffba410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.808+0000 7ffba8be9700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ffb8c078990 0x7ffb8c07ae40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.808+0000 7ffba8be9700 1 --2- 172.21.15.62:0/736699319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffba4101e10 0x7ffba410ce80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.808+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 >> 172.21.15.62:0/736699319 conn(0x7ffba40714d0 msgr2=0x7ffba40fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.808+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 shutdown_connections 2024-05-09T06:36:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.808+0000 7ffba8be9700 1 -- 172.21.15.62:0/736699319 wait complete. 2024-05-09T06:36:53.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:53 smithi079 ceph-mon[82381]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:53.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:53 smithi079 ceph-mon[82381]: pgmap v98: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 121 objects/s recovering 2024-05-09T06:36:53.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:53 smithi079 ceph-mon[82381]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:53.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:53 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:36:53.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:53 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1061322568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:53.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.918+0000 7f8c42a7b700 1 -- 172.21.15.62:0/3579540412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c102670 msgr2=0x7f8c3c0fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.918+0000 7f8c42a7b700 1 --2- 172.21.15.62:0/3579540412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c102670 0x7f8c3c0fbce0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c28004940 tx=0x7f8c28009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:53.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.918+0000 7f8c42a7b700 1 -- 172.21.15.62:0/3579540412 shutdown_connections 2024-05-09T06:36:53.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.918+0000 7f8c42a7b700 1 --2- 172.21.15.62:0/3579540412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c102670 0x7f8c3c0fbce0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.918+0000 7f8c42a7b700 1 --2- 172.21.15.62:0/3579540412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c3c101cd0 0x7f8c3c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.918+0000 7f8c42a7b700 1 -- 172.21.15.62:0/3579540412 >> 172.21.15.62:0/3579540412 conn(0x7f8c3c0f7860 msgr2=0x7f8c3c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:53.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.918+0000 7f8c42a7b700 1 -- 172.21.15.62:0/3579540412 shutdown_connections 2024-05-09T06:36:53.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.918+0000 7f8c42a7b700 1 -- 172.21.15.62:0/3579540412 wait complete. 2024-05-09T06:36:53.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c42a7b700 1 Processor -- start 2024-05-09T06:36:53.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c42a7b700 1 -- start start 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c42a7b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c101cd0 0x7f8c3c115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c42a7b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c3c102670 0x7f8c3c1160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c42a7b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c116720 con 0x7f8c3c101cd0 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c42a7b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c10fd00 con 0x7f8c3c102670 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c40817700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c101cd0 0x7f8c3c115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c40817700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c101cd0 0x7f8c3c115b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58472/0 (socket says 172.21.15.62:58472) 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c40817700 1 -- 172.21.15.62:0/1687428337 learned_addr learned my addr 172.21.15.62:0/1687428337 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.919+0000 7f8c3bfff700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c3c102670 0x7f8c3c1160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c40817700 1 -- 172.21.15.62:0/1687428337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c3c102670 msgr2=0x7f8c3c1160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c40817700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c3c102670 0x7f8c3c1160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c40817700 1 -- 172.21.15.62:0/1687428337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28005040 con 0x7f8c3c101cd0 2024-05-09T06:36:53.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c3bfff700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c3c102670 0x7f8c3c1160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:36:53.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c40817700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c101cd0 0x7f8c3c115b90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c30002a50 tx=0x7f8c300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:53.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c397fa700 1 -- 172.21.15.62:0/1687428337 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c30007cc0 con 0x7f8c3c101cd0 2024-05-09T06:36:53.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c397fa700 1 -- 172.21.15.62:0/1687428337 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c3000f040 con 0x7f8c3c101cd0 2024-05-09T06:36:53.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c397fa700 1 -- 172.21.15.62:0/1687428337 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c30009640 con 0x7f8c3c101cd0 2024-05-09T06:36:53.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c10ffe0 con 0x7f8c3c101cd0 2024-05-09T06:36:53.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.920+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c1105a0 con 0x7f8c3c101cd0 2024-05-09T06:36:53.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.921+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c0fd420 con 0x7f8c3c101cd0 2024-05-09T06:36:53.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.922+0000 7f8c397fa700 1 -- 172.21.15.62:0/1687428337 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f8c300097a0 con 0x7f8c3c101cd0 2024-05-09T06:36:53.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.922+0000 7f8c397fa700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8c2c078990 0x7f8c2c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:53.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.922+0000 7f8c397fa700 1 -- 172.21.15.62:0/1687428337 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f8c3009a4a0 con 0x7f8c3c101cd0 2024-05-09T06:36:53.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.922+0000 7f8c3bfff700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8c2c078990 0x7f8c2c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:53.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.923+0000 7f8c3bfff700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8c2c078990 0x7f8c2c07ae40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009fd0 tx=0x7f8c28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:53.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:53.927+0000 7f8c397fa700 1 -- 172.21.15.62:0/1687428337 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8c300620c0 con 0x7f8c3c101cd0 2024-05-09T06:36:54.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.235+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8c3c1111e0 con 0x7f8c3c101cd0 2024-05-09T06:36:54.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.235+0000 7f8c397fa700 1 -- 172.21.15.62:0/1687428337 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f8c30061a60 con 0x7f8c3c101cd0 2024-05-09T06:36:54.217 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:36:54.217 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:36:54.217 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8c2c078990 msgr2=0x7f8c2c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8c2c078990 0x7f8c2c07ae40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009fd0 tx=0x7f8c28009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c101cd0 msgr2=0x7f8c3c115b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c101cd0 0x7f8c3c115b90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c30002a50 tx=0x7f8c300046b0 comp rx=0 tx=0).stop 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 shutdown_connections 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8c2c078990 0x7f8c2c07ae40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c3c101cd0 0x7f8c3c115b90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 --2- 172.21.15.62:0/1687428337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c3c102670 0x7f8c3c1160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 >> 172.21.15.62:0/1687428337 conn(0x7f8c3c0f7860 msgr2=0x7f8c3c0f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 shutdown_connections 2024-05-09T06:36:54.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:36:54.238+0000 7f8c42a7b700 1 -- 172.21.15.62:0/1687428337 wait complete. 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: Upgrade: osd.2 is safe to restart 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2807110814' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1687428337' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:54.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:36:54.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:54.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:54.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:36:54.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: Upgrade: osd.2 is safe to restart 2024-05-09T06:36:54.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2807110814' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:36:54.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:54.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:54.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1687428337' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:36:54.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:36:54.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:36:54.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:55.633 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:55 smithi062 ceph-mon[109590]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:55.634 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:55 smithi062 ceph-mon[109590]: pgmap v99: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 118 objects/s recovering 2024-05-09T06:36:55.634 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:55 smithi062 ceph-mon[109590]: Upgrade: Updating osd.2 2024-05-09T06:36:55.634 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:55 smithi062 ceph-mon[109590]: Deploying daemon osd.2 on smithi062 2024-05-09T06:36:55.743 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:55 smithi079 ceph-mon[82381]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:55.743 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:55 smithi079 ceph-mon[82381]: pgmap v99: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 118 objects/s recovering 2024-05-09T06:36:55.743 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:55 smithi079 ceph-mon[82381]: Upgrade: Updating osd.2 2024-05-09T06:36:55.743 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:55 smithi079 ceph-mon[82381]: Deploying daemon osd.2 on smithi062 2024-05-09T06:36:57.631 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:57 smithi062 ceph-mon[109590]: pgmap v100: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:36:57.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:57 smithi079 ceph-mon[82381]: pgmap v100: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:36:57.881 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:57 smithi062 systemd[1]: Stopping Ceph osd.2 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:36:58.161 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:57 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[60484]: 2024-05-09T06:36:57.901+0000 7f6ad3e99700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:36:58.161 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:57 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[60484]: 2024-05-09T06:36:57.901+0000 7f6ad3e99700 -1 osd.2 70 *** Got signal Terminated *** 2024-05-09T06:36:58.161 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:57 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[60484]: 2024-05-09T06:36:57.901+0000 7f6ad3e99700 -1 osd.2 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:36:58.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:58 smithi079 ceph-mon[82381]: osd.2 marked itself down and dead 2024-05-09T06:36:58.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:58 smithi062 ceph-mon[109590]: osd.2 marked itself down and dead 2024-05-09T06:36:59.258 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:58 smithi062 podman[132048]: 2024-05-09 06:36:58.994259665 +0000 UTC m=+1.193032450 container died b708acc93270e5396caab3126cba7e0e9db435be1605a898beecfc3fc6a551fb (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4ba5a83, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:36:59.525 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:59 smithi062 ceph-mon[109590]: pgmap v101: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:36:59.525 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:59 smithi062 ceph-mon[109590]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:36:59.525 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:36:59 smithi062 ceph-mon[109590]: osdmap e71: 6 total, 5 up, 6 in 2024-05-09T06:36:59.525 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:59 smithi062 podman[132048]: 2024-05-09 06:36:59.368027742 +0000 UTC m=+1.566800527 container cleanup b708acc93270e5396caab3126cba7e0e9db435be1605a898beecfc3fc6a551fb (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4ba5a83, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True) 2024-05-09T06:36:59.525 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:59 smithi062 bash[132048]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2 2024-05-09T06:36:59.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:59 smithi079 ceph-mon[82381]: pgmap v101: 65 pgs: 65 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:36:59.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:59 smithi079 ceph-mon[82381]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:36:59.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:36:59 smithi079 ceph-mon[82381]: osdmap e71: 6 total, 5 up, 6 in 2024-05-09T06:36:59.911 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:59 smithi062 podman[132065]: 2024-05-09 06:36:59.544442854 +0000 UTC m=+0.547958411 container remove b708acc93270e5396caab3126cba7e0e9db435be1605a898beecfc3fc6a551fb (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=quincy-4ba5a83, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:37:00.252 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:59 smithi062 podman[132159]: 2024-05-09 06:36:59.895006495 +0000 UTC m=+0.018592607 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:00.252 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:36:59 smithi062 podman[132159]: 2024-05-09 06:36:59.995353678 +0000 UTC m=+0.118939771 container create 207fb7978dfa6108d5789dc40c1c206144a362f6e6e27460ce23318b02ec840e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=) 2024-05-09T06:37:00.503 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:00 smithi062 ceph-mon[109590]: osdmap e72: 6 total, 5 up, 6 in 2024-05-09T06:37:00.503 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:00 smithi062 podman[132159]: 2024-05-09 06:37:00.431998249 +0000 UTC m=+0.555584353 container init 207fb7978dfa6108d5789dc40c1c206144a362f6e6e27460ce23318b02ec840e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9) 2024-05-09T06:37:00.503 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:00 smithi062 podman[132159]: 2024-05-09 06:37:00.436474455 +0000 UTC m=+0.560060552 container start 207fb7978dfa6108d5789dc40c1c206144a362f6e6e27460ce23318b02ec840e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-09T06:37:00.503 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:00 smithi062 podman[132159]: 2024-05-09 06:37:00.523292383 +0000 UTC m=+0.646878485 container attach 207fb7978dfa6108d5789dc40c1c206144a362f6e6e27460ce23318b02ec840e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-09T06:37:00.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:00 smithi079 ceph-mon[82381]: osdmap e72: 6 total, 5 up, 6 in 2024-05-09T06:37:00.911 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:00 smithi062 podman[132159]: 2024-05-09 06:37:00.751519522 +0000 UTC m=+0.875105615 container died 207fb7978dfa6108d5789dc40c1c206144a362f6e6e27460ce23318b02ec840e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-720f8e9, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:37:01.536 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:01 smithi062 ceph-mon[109590]: pgmap v104: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 8 stale+active+clean, 48 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 9/216 objects degraded (4.167%) 2024-05-09T06:37:01.536 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:01 smithi062 ceph-mon[109590]: Health check failed: Degraded data redundancy: 9/216 objects degraded (4.167%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:01.536 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 podman[132185]: 2024-05-09 06:37:01.302121586 +0000 UTC m=+0.544497969 container remove 207fb7978dfa6108d5789dc40c1c206144a362f6e6e27460ce23318b02ec840e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T06:37:01.536 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.2.service: Deactivated successfully. 2024-05-09T06:37:01.536 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 systemd[1]: Stopped Ceph osd.2 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:37:01.536 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.2.service: Consumed 1min 278ms CPU time. 2024-05-09T06:37:01.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:01 smithi079 ceph-mon[82381]: pgmap v104: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 8 stale+active+clean, 48 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 9/216 objects degraded (4.167%) 2024-05-09T06:37:01.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:01 smithi079 ceph-mon[82381]: Health check failed: Degraded data redundancy: 9/216 objects degraded (4.167%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:01.872 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 systemd[1]: Starting Ceph osd.2 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:37:01.872 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 podman[132291]: 2024-05-09 06:37:01.682536675 +0000 UTC m=+0.019018794 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:01.872 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 podman[132291]: 2024-05-09 06:37:01.794924556 +0000 UTC m=+0.131406654 container create ad1f5117c2682baf78a26fa605db74801fe365e907d1237ac04691062fcdb603 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-09T06:37:02.161 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 podman[132291]: 2024-05-09 06:37:01.989482112 +0000 UTC m=+0.325964222 container init ad1f5117c2682baf78a26fa605db74801fe365e907d1237ac04691062fcdb603 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-09T06:37:02.161 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:01 smithi062 podman[132291]: 2024-05-09 06:37:01.993922659 +0000 UTC m=+0.330404767 container start ad1f5117c2682baf78a26fa605db74801fe365e907d1237ac04691062fcdb603 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:37:02.161 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 podman[132291]: 2024-05-09 06:37:02.072281601 +0000 UTC m=+0.408763712 container attach ad1f5117c2682baf78a26fa605db74801fe365e907d1237ac04691062fcdb603 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-720f8e9) 2024-05-09T06:37:02.789 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:02.789 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 bash[132291]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T06:37:02.790 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T06:37:02.791 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T06:37:02.791 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T06:37:02.791 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-09T06:37:02.791 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T06:37:02.791 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate[132306]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-09T06:37:02.791 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:02 smithi062 podman[132291]: 2024-05-09 06:37:02.522580002 +0000 UTC m=+0.859062105 container died ad1f5117c2682baf78a26fa605db74801fe365e907d1237ac04691062fcdb603 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-05-09T06:37:03.379 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:03 smithi062 podman[132450]: 2024-05-09 06:37:03.059652547 +0000 UTC m=+0.527276727 container remove ad1f5117c2682baf78a26fa605db74801fe365e907d1237ac04691062fcdb603 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-09T06:37:03.380 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:03 smithi062 podman[132513]: 2024-05-09 06:37:03.181290769 +0000 UTC m=+0.019458064 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:03.380 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:03 smithi062 podman[132513]: 2024-05-09 06:37:03.285499343 +0000 UTC m=+0.123666637 container create 89acd3b9ad6892ce5544e93bd80b9fd599f4bb8e8b640eeb4f0bfbd9f61cbcde (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-09T06:37:03.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:03 smithi062 ceph-mon[109590]: pgmap v105: 65 pgs: 10 active+undersized, 8 active+undersized+degraded, 4 stale+active+clean, 43 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 18/216 objects degraded (8.333%) 2024-05-09T06:37:03.661 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:03 smithi062 podman[132513]: 2024-05-09 06:37:03.530070338 +0000 UTC m=+0.368237642 container init 89acd3b9ad6892ce5544e93bd80b9fd599f4bb8e8b640eeb4f0bfbd9f61cbcde (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-09T06:37:03.662 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:03 smithi062 podman[132513]: 2024-05-09 06:37:03.53366666 +0000 UTC m=+0.371833964 container start 89acd3b9ad6892ce5544e93bd80b9fd599f4bb8e8b640eeb4f0bfbd9f61cbcde (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, GIT_BRANCH=HEAD) 2024-05-09T06:37:03.662 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:03 smithi062 ceph-osd[132531]: -- 172.21.15.62:0/152157141 <== mon.0 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f6dd4d680 con 0x556f6dd16c00 2024-05-09T06:37:03.662 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:03 smithi062 bash[132513]: 89acd3b9ad6892ce5544e93bd80b9fd599f4bb8e8b640eeb4f0bfbd9f61cbcde 2024-05-09T06:37:03.662 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:03 smithi062 systemd[1]: Started Ceph osd.2 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:37:03.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:03 smithi079 ceph-mon[82381]: pgmap v105: 65 pgs: 10 active+undersized, 8 active+undersized+degraded, 4 stale+active+clean, 43 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 18/216 objects degraded (8.333%) 2024-05-09T06:37:04.411 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:04 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[132527]: 2024-05-09T06:37:04.071+0000 7f66a6b927c0 -1 Falling back to public interface 2024-05-09T06:37:04.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:04.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:04.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:04.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:04 smithi062 ceph-mon[109590]: pgmap v106: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:05.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:05.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:05.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:05.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:04 smithi079 ceph-mon[82381]: pgmap v106: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:07.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:07 smithi079 ceph-mon[82381]: pgmap v107: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:07.355 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:07 smithi062 ceph-mon[109590]: pgmap v107: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:09.034 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:08 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[132527]: 2024-05-09T06:37:08.828+0000 7f66a6b927c0 -1 osd.2 70 log_to_monitors true 2024-05-09T06:37:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:09 smithi079 ceph-mon[82381]: pgmap v108: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:09 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 33/216 objects degraded (15.278%), 12 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:09 smithi079 ceph-mon[82381]: from='osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T06:37:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:09.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:09 smithi062 ceph-mon[109590]: pgmap v108: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:09.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:09 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 33/216 objects degraded (15.278%), 12 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:09.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:09 smithi062 ceph-mon[109590]: from='osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T06:37:09.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:09.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:10 smithi079 ceph-mon[82381]: from='osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T06:37:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:10 smithi079 ceph-mon[82381]: osdmap e73: 6 total, 5 up, 6 in 2024-05-09T06:37:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:10 smithi079 ceph-mon[82381]: from='osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:37:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:10 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:10 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:10 smithi079 ceph-mon[82381]: from='osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383]' entity='osd.2' 2024-05-09T06:37:10.411 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:37:10 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[132527]: 2024-05-09T06:37:10.007+0000 7f6693fe1700 -1 osd.2 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:37:10.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:10 smithi062 ceph-mon[109590]: from='osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T06:37:10.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:10 smithi062 ceph-mon[109590]: osdmap e73: 6 total, 5 up, 6 in 2024-05-09T06:37:10.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:10 smithi062 ceph-mon[109590]: from='osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-05-09T06:37:10.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:10 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:10.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:10 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:10.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:10 smithi062 ceph-mon[109590]: from='osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383]' entity='osd.2' 2024-05-09T06:37:11.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:11 smithi062 ceph-mon[109590]: pgmap v110: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:11.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:11 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:11.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:11 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:11.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:11 smithi062 ceph-mon[109590]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:37:11.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:11 smithi062 ceph-mon[109590]: osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383] boot 2024-05-09T06:37:11.636 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:11 smithi062 ceph-mon[109590]: osdmap e74: 6 total, 6 up, 6 in 2024-05-09T06:37:11.637 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:11 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:37:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:11 smithi079 ceph-mon[82381]: pgmap v110: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:11 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:11 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:11 smithi079 ceph-mon[82381]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:37:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:11 smithi079 ceph-mon[82381]: osd.2 [v2:172.21.15.62:6818/4281066383,v1:172.21.15.62:6819/4281066383] boot 2024-05-09T06:37:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:11 smithi079 ceph-mon[82381]: osdmap e74: 6 total, 6 up, 6 in 2024-05-09T06:37:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:11 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:37:13.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:13 smithi079 ceph-mon[82381]: pgmap v112: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:13.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:13 smithi079 ceph-mon[82381]: osdmap e75: 6 total, 6 up, 6 in 2024-05-09T06:37:13.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:13 smithi062 ceph-mon[109590]: pgmap v112: 65 pgs: 17 active+undersized, 12 active+undersized+degraded, 36 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 33/216 objects degraded (15.278%) 2024-05-09T06:37:13.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:13 smithi062 ceph-mon[109590]: osdmap e75: 6 total, 6 up, 6 in 2024-05-09T06:37:14.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:14 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 28/216 objects degraded (12.963%), 10 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:14.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:14 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 28/216 objects degraded (12.963%), 10 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: pgmap v114: 65 pgs: 12 active+undersized, 10 active+undersized+degraded, 43 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 28/216 objects degraded (12.963%) 2024-05-09T06:37:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:37:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:15.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:15.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:15.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:37:15.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: pgmap v114: 65 pgs: 12 active+undersized, 10 active+undersized+degraded, 43 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 28/216 objects degraded (12.963%) 2024-05-09T06:37:15.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:37:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:15.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:15.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:15.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:15.663 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:37:16.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:16 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:37:16.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:16 smithi079 ceph-mon[82381]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-05-09T06:37:16.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:16 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:37:16.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:16 smithi062 ceph-mon[109590]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-05-09T06:37:17.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:17 smithi079 ceph-mon[82381]: pgmap v115: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:17.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:17 smithi079 ceph-mon[82381]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/216 objects degraded (12.963%), 10 pgs degraded) 2024-05-09T06:37:17.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:17 smithi062 ceph-mon[109590]: pgmap v115: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:17.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:17 smithi062 ceph-mon[109590]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/216 objects degraded (12.963%), 10 pgs degraded) 2024-05-09T06:37:19.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:19 smithi079 ceph-mon[82381]: pgmap v116: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:19 smithi062 ceph-mon[109590]: pgmap v116: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:21 smithi062 ceph-mon[109590]: pgmap v117: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:21 smithi079 ceph-mon[82381]: pgmap v117: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:23.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:23 smithi062 ceph-mon[109590]: pgmap v118: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:23.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:23 smithi079 ceph-mon[82381]: pgmap v118: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.359+0000 7ff5b322b700 1 -- 172.21.15.62:0/1233869553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 msgr2=0x7ff5ac0ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.359+0000 7ff5b322b700 1 --2- 172.21.15.62:0/1233869553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 0x7ff5ac0ff090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009ce0 tx=0x7ff59c004d10 comp rx=0 tx=0).stop 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.359+0000 7ff5b322b700 1 -- 172.21.15.62:0/1233869553 shutdown_connections 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.359+0000 7ff5b322b700 1 --2- 172.21.15.62:0/1233869553 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 0x7ff5ac0ff090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.359+0000 7ff5b322b700 1 --2- 172.21.15.62:0/1233869553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5ac105080 0x7ff5ac105450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.359+0000 7ff5b322b700 1 -- 172.21.15.62:0/1233869553 >> 172.21.15.62:0/1233869553 conn(0x7ff5ac0fabf0 msgr2=0x7ff5ac0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.359+0000 7ff5b322b700 1 -- 172.21.15.62:0/1233869553 shutdown_connections 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.359+0000 7ff5b322b700 1 -- 172.21.15.62:0/1233869553 wait complete. 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5b322b700 1 Processor -- start 2024-05-09T06:37:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5b322b700 1 -- start start 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5b322b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5ac105080 0x7ff5ac115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5b322b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 0x7ff5ac1161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5b322b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac116840 con 0x7ff5ac105a20 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5b322b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac10fe20 con 0x7ff5ac105080 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 0x7ff5ac1161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5abfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 0x7ff5ac1161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53710/0 (socket says 172.21.15.62:53710) 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5abfff700 1 -- 172.21.15.62:0/3355941671 learned_addr learned my addr 172.21.15.62:0/3355941671 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.360+0000 7ff5b0fc7700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5ac105080 0x7ff5ac115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5abfff700 1 -- 172.21.15.62:0/3355941671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5ac105080 msgr2=0x7ff5ac115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5abfff700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5ac105080 0x7ff5ac115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5abfff700 1 -- 172.21.15.62:0/3355941671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c009940 con 0x7ff5ac105a20 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5abfff700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 0x7ff5ac1161f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00be40 tx=0x7ff59c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5a97fa700 1 -- 172.21.15.62:0/3355941671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59c00e040 con 0x7ff5ac105a20 2024-05-09T06:37:24.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5a97fa700 1 -- 172.21.15.62:0/3355941671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff59c004610 con 0x7ff5ac105a20 2024-05-09T06:37:24.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac1100a0 con 0x7ff5ac105a20 2024-05-09T06:37:24.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5a97fa700 1 -- 172.21.15.62:0/3355941671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59c01c640 con 0x7ff5ac105a20 2024-05-09T06:37:24.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.361+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac110660 con 0x7ff5ac105a20 2024-05-09T06:37:24.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.362+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac107550 con 0x7ff5ac105a20 2024-05-09T06:37:24.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.363+0000 7ff5a97fa700 1 -- 172.21.15.62:0/3355941671 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7ff59c012a70 con 0x7ff5ac105a20 2024-05-09T06:37:24.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.363+0000 7ff5a97fa700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff598078990 0x7ff59807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:24.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.364+0000 7ff5a97fa700 1 -- 172.21.15.62:0/3355941671 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6614+0+0 (secure 0 0 0) 0x7ff59c09c2a0 con 0x7ff5ac105a20 2024-05-09T06:37:24.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.364+0000 7ff5b0fc7700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff598078990 0x7ff59807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:24.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.364+0000 7ff5b0fc7700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff598078990 0x7ff59807ae40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40041d0 tx=0x7ff5a40043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:24.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.369+0000 7ff5a97fa700 1 -- 172.21.15.62:0/3355941671 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ff59c063e40 con 0x7ff5ac105a20 2024-05-09T06:37:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.614+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5ac111370 con 0x7ff598078990 2024-05-09T06:37:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.615+0000 7ff5a97fa700 1 -- 172.21.15.62:0/3355941671 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff5ac111370 con 0x7ff598078990 2024-05-09T06:37:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.617+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff598078990 msgr2=0x7ff59807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.617+0000 7ff5b322b700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff598078990 0x7ff59807ae40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40041d0 tx=0x7ff5a40043c0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.617+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 msgr2=0x7ff5ac1161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.617+0000 7ff5b322b700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 0x7ff5ac1161f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00be40 tx=0x7ff59c004d10 comp rx=0 tx=0).stop 2024-05-09T06:37:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.618+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 shutdown_connections 2024-05-09T06:37:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.618+0000 7ff5b322b700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5ac105080 0x7ff5ac115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.618+0000 7ff5b322b700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff598078990 0x7ff59807ae40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.618+0000 7ff5b322b700 1 --2- 172.21.15.62:0/3355941671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ac105a20 0x7ff5ac1161f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.618+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 >> 172.21.15.62:0/3355941671 conn(0x7ff5ac0fabf0 msgr2=0x7ff5ac0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.618+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 shutdown_connections 2024-05-09T06:37:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.618+0000 7ff5b322b700 1 -- 172.21.15.62:0/3355941671 wait complete. 2024-05-09T06:37:24.609 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:37:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.724+0000 7ff27d0c8700 1 -- 172.21.15.62:0/796815327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fe830 msgr2=0x7ff278106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.724+0000 7ff27d0c8700 1 --2- 172.21.15.62:0/796815327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fe830 0x7ff278106e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff26c004940 tx=0x7ff26c009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.724+0000 7ff27d0c8700 1 -- 172.21.15.62:0/796815327 shutdown_connections 2024-05-09T06:37:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.724+0000 7ff27d0c8700 1 --2- 172.21.15.62:0/796815327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fe830 0x7ff278106e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.724+0000 7ff27d0c8700 1 --2- 172.21.15.62:0/796815327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2780fde90 0x7ff2780fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.724+0000 7ff27d0c8700 1 -- 172.21.15.62:0/796815327 >> 172.21.15.62:0/796815327 conn(0x7ff2780f7940 msgr2=0x7ff2780f9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.724+0000 7ff27d0c8700 1 -- 172.21.15.62:0/796815327 shutdown_connections 2024-05-09T06:37:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.724+0000 7ff27d0c8700 1 -- 172.21.15.62:0/796815327 wait complete. 2024-05-09T06:37:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff27d0c8700 1 Processor -- start 2024-05-09T06:37:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff27d0c8700 1 -- start start 2024-05-09T06:37:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff27d0c8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fde90 0x7ff278113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff27d0c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2780fe830 0x7ff278113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff27d0c8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff278114510 con 0x7ff2780fde90 2024-05-09T06:37:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff27d0c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27810db10 con 0x7ff2780fe830 2024-05-09T06:37:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff276d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fde90 0x7ff278113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff276d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fde90 0x7ff278113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53734/0 (socket says 172.21.15.62:53734) 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff276d9d700 1 -- 172.21.15.62:0/187535154 learned_addr learned my addr 172.21.15.62:0/187535154 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff27659c700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2780fe830 0x7ff278113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff276d9d700 1 -- 172.21.15.62:0/187535154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2780fe830 msgr2=0x7ff278113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff276d9d700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2780fe830 0x7ff278113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.725+0000 7ff276d9d700 1 -- 172.21.15.62:0/187535154 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c005040 con 0x7ff2780fde90 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.726+0000 7ff276d9d700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fde90 0x7ff278113980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff268002a50 tx=0x7ff2680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.726+0000 7ff25f7fe700 1 -- 172.21.15.62:0/187535154 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff268007cc0 con 0x7ff2780fde90 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.726+0000 7ff25f7fe700 1 -- 172.21.15.62:0/187535154 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff26800f040 con 0x7ff2780fde90 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.726+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27810ddf0 con 0x7ff2780fde90 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.726+0000 7ff25f7fe700 1 -- 172.21.15.62:0/187535154 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff268009640 con 0x7ff2780fde90 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.726+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27810e330 con 0x7ff2780fde90 2024-05-09T06:37:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.727+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff278066b70 con 0x7ff2780fde90 2024-05-09T06:37:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.727+0000 7ff25f7fe700 1 -- 172.21.15.62:0/187535154 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7ff2680097a0 con 0x7ff2780fde90 2024-05-09T06:37:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.728+0000 7ff25f7fe700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff260078990 0x7ff26007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.728+0000 7ff25f7fe700 1 -- 172.21.15.62:0/187535154 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6614+0+0 (secure 0 0 0) 0x7ff26809a4a0 con 0x7ff2780fde90 2024-05-09T06:37:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.728+0000 7ff27659c700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff260078990 0x7ff26007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.728+0000 7ff27659c700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff260078990 0x7ff26007ae40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff27810ecd0 tx=0x7ff26c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.733+0000 7ff25f7fe700 1 -- 172.21.15.62:0/187535154 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ff2680620c0 con 0x7ff2780fde90 2024-05-09T06:37:24.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.970+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff278109f20 con 0x7ff260078990 2024-05-09T06:37:24.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.972+0000 7ff25f7fe700 1 -- 172.21.15.62:0/187535154 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff278109f20 con 0x7ff260078990 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff260078990 msgr2=0x7ff26007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff260078990 0x7ff26007ae40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff27810ecd0 tx=0x7ff26c009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fde90 msgr2=0x7ff278113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fde90 0x7ff278113980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff268002a50 tx=0x7ff2680046b0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 shutdown_connections 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff260078990 0x7ff26007ae40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2780fde90 0x7ff278113980 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 --2- 172.21.15.62:0/187535154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2780fe830 0x7ff278113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 >> 172.21.15.62:0/187535154 conn(0x7ff2780f7940 msgr2=0x7ff2781036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 shutdown_connections 2024-05-09T06:37:24.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:24.974+0000 7ff27d0c8700 1 -- 172.21.15.62:0/187535154 wait complete. 2024-05-09T06:37:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 -- 172.21.15.62:0/3221106440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 msgr2=0x7f202c070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 --2- 172.21.15.62:0/3221106440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 0x7f202c070cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2018004970 tx=0x7f2018009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 -- 172.21.15.62:0/3221106440 shutdown_connections 2024-05-09T06:37:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 --2- 172.21.15.62:0/3221106440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 0x7f202c070cb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 --2- 172.21.15.62:0/3221106440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f202c071f30 0x7f202c070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 -- 172.21.15.62:0/3221106440 >> 172.21.15.62:0/3221106440 conn(0x7f202c0f8990 msgr2=0x7f202c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 -- 172.21.15.62:0/3221106440 shutdown_connections 2024-05-09T06:37:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 -- 172.21.15.62:0/3221106440 wait complete. 2024-05-09T06:37:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 Processor -- start 2024-05-09T06:37:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.081+0000 7f2032b13700 1 -- start start 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f2032b13700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 0x7f202c119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f2032b13700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f202c071f30 0x7f202c11a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f2032b13700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c11aba0 con 0x7f202c070840 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f2032b13700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c1140f0 con 0x7f202c071f30 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f20308af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 0x7f202c119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f20308af700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 0x7f202c119f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53750/0 (socket says 172.21.15.62:53750) 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f20308af700 1 -- 172.21.15.62:0/855289432 learned_addr learned my addr 172.21.15.62:0/855289432 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f202bfff700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f202c071f30 0x7f202c11a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f20308af700 1 -- 172.21.15.62:0/855289432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f202c071f30 msgr2=0x7f202c11a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f20308af700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f202c071f30 0x7f202c11a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f20308af700 1 -- 172.21.15.62:0/855289432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018005040 con 0x7f202c070840 2024-05-09T06:37:25.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f202bfff700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f202c071f30 0x7f202c11a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:37:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.082+0000 7f20308af700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 0x7f202c119f80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f202000b790 tx=0x7f2020009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.083+0000 7f20297fa700 1 -- 172.21.15.62:0/855289432 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202000f770 con 0x7f202c070840 2024-05-09T06:37:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.083+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c114370 con 0x7f202c070840 2024-05-09T06:37:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.083+0000 7f20297fa700 1 -- 172.21.15.62:0/855289432 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f202000fda0 con 0x7f202c070840 2024-05-09T06:37:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.083+0000 7f20297fa700 1 -- 172.21.15.62:0/855289432 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202000d310 con 0x7f202c070840 2024-05-09T06:37:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.083+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c1148b0 con 0x7f202c070840 2024-05-09T06:37:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.084+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c071a40 con 0x7f202c070840 2024-05-09T06:37:25.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.084+0000 7f20297fa700 1 -- 172.21.15.62:0/855289432 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f2020010420 con 0x7f202c070840 2024-05-09T06:37:25.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.085+0000 7f20297fa700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f201c078990 0x7f201c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.085+0000 7f20297fa700 1 -- 172.21.15.62:0/855289432 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f202009a7d0 con 0x7f202c070840 2024-05-09T06:37:25.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.085+0000 7f202bfff700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f201c078990 0x7f201c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.085+0000 7f202bfff700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f201c078990 0x7f201c07ae40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2018004560 tx=0x7f2018009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:25.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.090+0000 7f20297fa700 1 -- 172.21.15.62:0/855289432 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f20200623f0 con 0x7f202c070840 2024-05-09T06:37:25.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.315+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f202c115670 con 0x7f201c078990 2024-05-09T06:37:25.296 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:25 smithi062 ceph-mon[109590]: pgmap v119: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:25.296 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:25.296 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:25.296 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:25.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.326+0000 7f20297fa700 1 -- 172.21.15.62:0/855289432 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f202c115670 con 0x7f201c078990 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (4m) 16s ago 15m 26.3M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (2m) 16s ago 16m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (117s) 114s ago 14m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (4m) 16s ago 15m 81.0M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (10m) 16s ago 10m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (10m) 16s ago 10m 152M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (9m) 114s ago 9m 15.8M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (10m) 114s ago 10m 15.7M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:37:25.307 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (6m) 16s ago 17m 519M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (5m) 114s ago 14m 464M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (3m) 16s ago 17m 47.3M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (2m) 114s ago 14m 33.9M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (5m) 16s ago 16m 14.7M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (5m) 114s ago 14m 17.7M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (96s) 16s ago 13m 141M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (59s) 16s ago 13m 140M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (22s) 16s ago 12m 12.7M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 89acd3b9ad68 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (12m) 114s ago 12m 284M 2581M 17.2.7-933-g4ba5a836 b96134859c76 c2e298ddeb35 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (12m) 114s ago 12m 253M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (11m) 114s ago 11m 248M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:37:25.308 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (4m) 16s ago 15m 65.8M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:37:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f201c078990 msgr2=0x7f201c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f201c078990 0x7f201c07ae40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2018004560 tx=0x7f2018009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 msgr2=0x7f202c119f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 0x7f202c119f80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f202000b790 tx=0x7f2020009250 comp rx=0 tx=0).stop 2024-05-09T06:37:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 shutdown_connections 2024-05-09T06:37:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f201c078990 0x7f201c07ae40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c070840 0x7f202c119f80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 --2- 172.21.15.62:0/855289432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f202c071f30 0x7f202c11a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 >> 172.21.15.62:0/855289432 conn(0x7f202c0f8990 msgr2=0x7f202c0f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:25.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 shutdown_connections 2024-05-09T06:37:25.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.328+0000 7f2032b13700 1 -- 172.21.15.62:0/855289432 wait complete. 2024-05-09T06:37:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:25 smithi079 ceph-mon[82381]: pgmap v119: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:25.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.432+0000 7f8a81d2b700 1 -- 172.21.15.62:0/2477410131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 msgr2=0x7f8a7c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.432+0000 7f8a81d2b700 1 --2- 172.21.15.62:0/2477410131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 0x7f8a7c1031c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009ce0 tx=0x7f8a6c004d10 comp rx=0 tx=0).stop 2024-05-09T06:37:25.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.432+0000 7f8a81d2b700 1 -- 172.21.15.62:0/2477410131 shutdown_connections 2024-05-09T06:37:25.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.432+0000 7f8a81d2b700 1 --2- 172.21.15.62:0/2477410131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c103790 0x7f8a7c0fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.432+0000 7f8a81d2b700 1 --2- 172.21.15.62:0/2477410131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 0x7f8a7c1031c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.432+0000 7f8a81d2b700 1 -- 172.21.15.62:0/2477410131 >> 172.21.15.62:0/2477410131 conn(0x7f8a7c0f8980 msgr2=0x7f8a7c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:25.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.432+0000 7f8a81d2b700 1 -- 172.21.15.62:0/2477410131 shutdown_connections 2024-05-09T06:37:25.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.432+0000 7f8a81d2b700 1 -- 172.21.15.62:0/2477410131 wait complete. 2024-05-09T06:37:25.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a81d2b700 1 Processor -- start 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a81d2b700 1 -- start start 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a81d2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 0x7f8a7c113d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a81d2b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c103790 0x7f8a7c114260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a81d2b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c1148b0 con 0x7f8a7c102df0 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a81d2b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c10dc80 con 0x7f8a7c103790 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 0x7f8a7c113d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 0x7f8a7c113d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53764/0 (socket says 172.21.15.62:53764) 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a7b7fe700 1 -- 172.21.15.62:0/3651623266 learned_addr learned my addr 172.21.15.62:0/3651623266 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a7b7fe700 1 -- 172.21.15.62:0/3651623266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c103790 msgr2=0x7f8a7c114260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a7affd700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c103790 0x7f8a7c114260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a7b7fe700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c103790 0x7f8a7c114260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.433+0000 7f8a7b7fe700 1 -- 172.21.15.62:0/3651623266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c009940 con 0x7f8a7c102df0 2024-05-09T06:37:25.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.434+0000 7f8a7b7fe700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 0x7f8a7c113d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00be90 tx=0x7f8a6c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.434+0000 7f8a73fff700 1 -- 172.21.15.62:0/3651623266 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6c00e040 con 0x7f8a7c102df0 2024-05-09T06:37:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.434+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7c10df00 con 0x7f8a7c102df0 2024-05-09T06:37:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.434+0000 7f8a73fff700 1 -- 172.21.15.62:0/3651623266 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a6c008ea0 con 0x7f8a7c102df0 2024-05-09T06:37:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.434+0000 7f8a73fff700 1 -- 172.21.15.62:0/3651623266 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6c01c810 con 0x7f8a7c102df0 2024-05-09T06:37:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.434+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c10e4c0 con 0x7f8a7c102df0 2024-05-09T06:37:25.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.435+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7c100100 con 0x7f8a7c102df0 2024-05-09T06:37:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.436+0000 7f8a73fff700 1 -- 172.21.15.62:0/3651623266 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f8a6c012c00 con 0x7f8a7c102df0 2024-05-09T06:37:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.436+0000 7f8a73fff700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8a68078990 0x7f8a6807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.436+0000 7f8a7affd700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8a68078990 0x7f8a6807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.436+0000 7f8a73fff700 1 -- 172.21.15.62:0/3651623266 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f8a6c09c360 con 0x7f8a7c102df0 2024-05-09T06:37:25.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.437+0000 7f8a7affd700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8a68078990 0x7f8a6807ae40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c10f5c0 tx=0x7f8a64009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:25.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.441+0000 7f8a73fff700 1 -- 172.21.15.62:0/3651623266 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8a6c063f80 con 0x7f8a7c102df0 2024-05-09T06:37:25.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.745+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a7c04bed0 con 0x7f8a7c102df0 2024-05-09T06:37:25.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.746+0000 7f8a73fff700 1 -- 172.21.15.62:0/3651623266 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f8a6c004e10 con 0x7f8a7c102df0 2024-05-09T06:37:25.727 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:37:25.727 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:37:25.728 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:25.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:37:25.728 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:37:25.728 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:25.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:37:25.728 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:37:25.729 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 3, 2024-05-09T06:37:25.729 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 3 2024-05-09T06:37:25.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:37:25.729 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:37:25.729 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:37:25.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:37:25.730 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:37:25.730 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 7, 2024-05-09T06:37:25.730 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 7 2024-05-09T06:37:25.730 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:37:25.730 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:37:25.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8a68078990 msgr2=0x7f8a6807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8a68078990 0x7f8a6807ae40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c10f5c0 tx=0x7f8a64009040 comp rx=0 tx=0).stop 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 msgr2=0x7f8a7c113d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 0x7f8a7c113d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00be90 tx=0x7f8a6c004d10 comp rx=0 tx=0).stop 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 shutdown_connections 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f8a68078990 0x7f8a6807ae40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a7c102df0 0x7f8a7c113d20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 --2- 172.21.15.62:0/3651623266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a7c103790 0x7f8a7c114260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.748+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 >> 172.21.15.62:0/3651623266 conn(0x7f8a7c0f8980 msgr2=0x7f8a7c1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.749+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 shutdown_connections 2024-05-09T06:37:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.749+0000 7f8a81d2b700 1 -- 172.21.15.62:0/3651623266 wait complete. 2024-05-09T06:37:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.854+0000 7fa24a658700 1 -- 172.21.15.62:0/221864010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa244101d00 msgr2=0x7fa2441020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.854+0000 7fa24a658700 1 --2- 172.21.15.62:0/221864010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa244101d00 0x7fa2441020d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa234004940 tx=0x7fa234009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.854+0000 7fa24a658700 1 -- 172.21.15.62:0/221864010 shutdown_connections 2024-05-09T06:37:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.854+0000 7fa24a658700 1 --2- 172.21.15.62:0/221864010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2441026a0 0x7fa2440fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.854+0000 7fa24a658700 1 --2- 172.21.15.62:0/221864010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa244101d00 0x7fa2441020d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.854+0000 7fa24a658700 1 -- 172.21.15.62:0/221864010 >> 172.21.15.62:0/221864010 conn(0x7fa2440f7870 msgr2=0x7fa2440f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.854+0000 7fa24a658700 1 -- 172.21.15.62:0/221864010 shutdown_connections 2024-05-09T06:37:25.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.854+0000 7fa24a658700 1 -- 172.21.15.62:0/221864010 wait complete. 2024-05-09T06:37:25.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa24a658700 1 Processor -- start 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa24a658700 1 -- start start 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa24a658700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244101d00 0x7fa2441139e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa24a658700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2441026a0 0x7fa244113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa24a658700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441144d0 con 0x7fa2441026a0 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa24a658700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24410db20 con 0x7fa244101d00 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa23bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2441026a0 0x7fa244113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa23bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2441026a0 0x7fa244113f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53784/0 (socket says 172.21.15.62:53784) 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa23bfff700 1 -- 172.21.15.62:0/485116860 learned_addr learned my addr 172.21.15.62:0/485116860 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa243fff700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244101d00 0x7fa2441139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa23bfff700 1 -- 172.21.15.62:0/485116860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244101d00 msgr2=0x7fa2441139e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa23bfff700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244101d00 0x7fa2441139e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.855+0000 7fa23bfff700 1 -- 172.21.15.62:0/485116860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234005040 con 0x7fa2441026a0 2024-05-09T06:37:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.856+0000 7fa23bfff700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2441026a0 0x7fa244113f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa22c002a50 tx=0x7fa22c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.856+0000 7fa2417fa700 1 -- 172.21.15.62:0/485116860 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa22c007cc0 con 0x7fa2441026a0 2024-05-09T06:37:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.856+0000 7fa2417fa700 1 -- 172.21.15.62:0/485116860 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa22c00f040 con 0x7fa2441026a0 2024-05-09T06:37:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.856+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24410de00 con 0x7fa2441026a0 2024-05-09T06:37:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.856+0000 7fa2417fa700 1 -- 172.21.15.62:0/485116860 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa22c00d9c0 con 0x7fa2441026a0 2024-05-09T06:37:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.856+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24410e3c0 con 0x7fa2441026a0 2024-05-09T06:37:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.857+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2440fd450 con 0x7fa2441026a0 2024-05-09T06:37:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.858+0000 7fa2417fa700 1 -- 172.21.15.62:0/485116860 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa22c009730 con 0x7fa2441026a0 2024-05-09T06:37:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.858+0000 7fa2417fa700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa230078990 0x7fa23007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.858+0000 7fa243fff700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa230078990 0x7fa23007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.858+0000 7fa2417fa700 1 -- 172.21.15.62:0/485116860 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fa22c09a440 con 0x7fa2441026a0 2024-05-09T06:37:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.859+0000 7fa243fff700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa230078990 0x7fa23007ae40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa234004f90 tx=0x7fa234009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:25.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:25.863+0000 7fa2417fa700 1 -- 172.21.15.62:0/485116860 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa22c062060 con 0x7fa2441026a0 2024-05-09T06:37:26.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.124+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa244108e00 con 0x7fa2441026a0 2024-05-09T06:37:26.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.125+0000 7fa2417fa700 1 -- 172.21.15.62:0/485116860 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1872 (secure 0 0 0) 0x7fa22c061a00 con 0x7fa2441026a0 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:37:26.106 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:37:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:37:26.108 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:26.109 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:26.109 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa230078990 msgr2=0x7fa23007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa230078990 0x7fa23007ae40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa234004f90 tx=0x7fa234009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2441026a0 msgr2=0x7fa244113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2441026a0 0x7fa244113f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa22c002a50 tx=0x7fa22c004600 comp rx=0 tx=0).stop 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 shutdown_connections 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244101d00 0x7fa2441139e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa230078990 0x7fa23007ae40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 --2- 172.21.15.62:0/485116860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2441026a0 0x7fa244113f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 >> 172.21.15.62:0/485116860 conn(0x7fa2440f7870 msgr2=0x7fa244066250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 shutdown_connections 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.127+0000 7fa24a658700 1 -- 172.21.15.62:0/485116860 wait complete. 2024-05-09T06:37:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:37:26.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 -- 172.21.15.62:0/139844186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 msgr2=0x7efdf01031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 --2- 172.21.15.62:0/139844186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 0x7efdf01031b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efde0004940 tx=0x7efde0009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:26.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 -- 172.21.15.62:0/139844186 shutdown_connections 2024-05-09T06:37:26.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 --2- 172.21.15.62:0/139844186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf0103780 0x7efdf00fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 --2- 172.21.15.62:0/139844186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 0x7efdf01031b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 -- 172.21.15.62:0/139844186 >> 172.21.15.62:0/139844186 conn(0x7efdf00f8990 msgr2=0x7efdf00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:26.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 -- 172.21.15.62:0/139844186 shutdown_connections 2024-05-09T06:37:26.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 -- 172.21.15.62:0/139844186 wait complete. 2024-05-09T06:37:26.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.234+0000 7efdf6cf0700 1 Processor -- start 2024-05-09T06:37:26.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf6cf0700 1 -- start start 2024-05-09T06:37:26.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf6cf0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 0x7efdf0113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:26.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf6cf0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf0103780 0x7efdf0113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:26.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf6cf0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0114500 con 0x7efdf0102de0 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf6cf0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf010db50 con 0x7efdf0103780 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf4a8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 0x7efdf0113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf4a8c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 0x7efdf0113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53800/0 (socket says 172.21.15.62:53800) 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf4a8c700 1 -- 172.21.15.62:0/3143973694 learned_addr learned my addr 172.21.15.62:0/3143973694 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdeffff700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf0103780 0x7efdf0113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf4a8c700 1 -- 172.21.15.62:0/3143973694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf0103780 msgr2=0x7efdf0113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf4a8c700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf0103780 0x7efdf0113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdf4a8c700 1 -- 172.21.15.62:0/3143973694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0005040 con 0x7efdf0102de0 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.235+0000 7efdeffff700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf0103780 0x7efdf0113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.236+0000 7efdf4a8c700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 0x7efdf0113970 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efde0009150 tx=0x7efde0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.236+0000 7efded7fa700 1 -- 172.21.15.62:0/3143973694 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efde000e040 con 0x7efdf0102de0 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.236+0000 7efded7fa700 1 -- 172.21.15.62:0/3143973694 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efde0013420 con 0x7efdf0102de0 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.236+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf010ddd0 con 0x7efdf0102de0 2024-05-09T06:37:26.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.236+0000 7efded7fa700 1 -- 172.21.15.62:0/3143973694 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efde001c630 con 0x7efdf0102de0 2024-05-09T06:37:26.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.236+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf010e390 con 0x7efdf0102de0 2024-05-09T06:37:26.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.237+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf01000f0 con 0x7efdf0102de0 2024-05-09T06:37:26.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.238+0000 7efded7fa700 1 -- 172.21.15.62:0/3143973694 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7efde0013590 con 0x7efdf0102de0 2024-05-09T06:37:26.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.238+0000 7efded7fa700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdd8078980 0x7efdd807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:26.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.238+0000 7efded7fa700 1 -- 172.21.15.62:0/3143973694 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6614+0+0 (secure 0 0 0) 0x7efde009b9e0 con 0x7efdf0102de0 2024-05-09T06:37:26.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.238+0000 7efdeffff700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdd8078980 0x7efdd807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:26.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.239+0000 7efdeffff700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdd8078980 0x7efdd807ae30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efde4007fd0 tx=0x7efde4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:26.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.243+0000 7efded7fa700 1 -- 172.21.15.62:0/3143973694 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7efde0063600 con 0x7efdf0102de0 2024-05-09T06:37:26.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:26 smithi079 ceph-mon[82381]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:26.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:26 smithi079 ceph-mon[82381]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:26.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:26 smithi079 ceph-mon[82381]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:26.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:26 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3651623266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:26.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:26 smithi062 ceph-mon[109590]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:26.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:26 smithi062 ceph-mon[109590]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:26.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:26 smithi062 ceph-mon[109590]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:26.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:26 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3651623266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:26.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.476+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdf010f030 con 0x7efdd8078980 2024-05-09T06:37:26.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.477+0000 7efded7fa700 1 -- 172.21.15.62:0/3143973694 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efdf010f030 con 0x7efdd8078980 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "9/21 daemons upgraded", 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:37:26.458 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:37:26.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdd8078980 msgr2=0x7efdd807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdd8078980 0x7efdd807ae30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efde4007fd0 tx=0x7efde4009040 comp rx=0 tx=0).stop 2024-05-09T06:37:26.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 msgr2=0x7efdf0113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 0x7efdf0113970 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efde0009150 tx=0x7efde0009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:26.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 shutdown_connections 2024-05-09T06:37:26.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efdd8078980 0x7efdd807ae30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdf0102de0 0x7efdf0113970 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 --2- 172.21.15.62:0/3143973694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efdf0103780 0x7efdf0113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.479+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 >> 172.21.15.62:0/3143973694 conn(0x7efdf00f8990 msgr2=0x7efdf0107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:26.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.480+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 shutdown_connections 2024-05-09T06:37:26.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.480+0000 7efdf6cf0700 1 -- 172.21.15.62:0/3143973694 wait complete. 2024-05-09T06:37:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.585+0000 7f110983e700 1 -- 172.21.15.62:0/3068980393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 msgr2=0x7f11040fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.585+0000 7f110983e700 1 --2- 172.21.15.62:0/3068980393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 0x7f11040fbd10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10f8004940 tx=0x7f10f8009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.585+0000 7f110983e700 1 -- 172.21.15.62:0/3068980393 shutdown_connections 2024-05-09T06:37:26.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.585+0000 7f110983e700 1 --2- 172.21.15.62:0/3068980393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 0x7f11040fbd10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.585+0000 7f110983e700 1 --2- 172.21.15.62:0/3068980393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104101d00 0x7f11041020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.585+0000 7f110983e700 1 -- 172.21.15.62:0/3068980393 >> 172.21.15.62:0/3068980393 conn(0x7f11040f7870 msgr2=0x7f11040f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.585+0000 7f110983e700 1 -- 172.21.15.62:0/3068980393 shutdown_connections 2024-05-09T06:37:26.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.585+0000 7f110983e700 1 -- 172.21.15.62:0/3068980393 wait complete. 2024-05-09T06:37:26.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.586+0000 7f110983e700 1 Processor -- start 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.586+0000 7f110983e700 1 -- start start 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.586+0000 7f110983e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104101d00 0x7f1104115bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f110983e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 0x7f1104116100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f110983e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1104116750 con 0x7f11041026a0 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f110983e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110410fd30 con 0x7f1104101d00 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f11027fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 0x7f1104116100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f11027fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 0x7f1104116100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53826/0 (socket says 172.21.15.62:53826) 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f11027fc700 1 -- 172.21.15.62:0/2950143120 learned_addr learned my addr 172.21.15.62:0/2950143120 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f1102ffd700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104101d00 0x7f1104115bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f11027fc700 1 -- 172.21.15.62:0/2950143120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104101d00 msgr2=0x7f1104115bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f11027fc700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104101d00 0x7f1104115bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f11027fc700 1 -- 172.21.15.62:0/2950143120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8005040 con 0x7f11041026a0 2024-05-09T06:37:26.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f11027fc700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 0x7f1104116100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009100 tx=0x7f10f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:26.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f10eb7fe700 1 -- 172.21.15.62:0/2950143120 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10f800e040 con 0x7f11041026a0 2024-05-09T06:37:26.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110410ffb0 con 0x7f11041026a0 2024-05-09T06:37:26.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f10eb7fe700 1 -- 172.21.15.62:0/2950143120 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10f8013420 con 0x7f11041026a0 2024-05-09T06:37:26.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.587+0000 7f10eb7fe700 1 -- 172.21.15.62:0/2950143120 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10f801c610 con 0x7f11041026a0 2024-05-09T06:37:26.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.588+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1104110570 con 0x7f11041026a0 2024-05-09T06:37:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.588+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11040fd450 con 0x7f11041026a0 2024-05-09T06:37:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.589+0000 7f10eb7fe700 1 -- 172.21.15.62:0/2950143120 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f10f8013590 con 0x7f11041026a0 2024-05-09T06:37:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.590+0000 7f10eb7fe700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10ec078990 0x7f10ec07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.590+0000 7f1102ffd700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10ec078990 0x7f10ec07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.590+0000 7f10eb7fe700 1 -- 172.21.15.62:0/2950143120 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f10f809ba10 con 0x7f11041026a0 2024-05-09T06:37:26.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.590+0000 7f1102ffd700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10ec078990 0x7f10ec07ae40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10f40041d0 tx=0x7f10f4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:26.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.594+0000 7f10eb7fe700 1 -- 172.21.15.62:0/2950143120 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f10f8063630 con 0x7f11041026a0 2024-05-09T06:37:26.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.899+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1104108de0 con 0x7f11041026a0 2024-05-09T06:37:26.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.900+0000 7f10eb7fe700 1 -- 172.21.15.62:0/2950143120 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f10f8062fd0 con 0x7f11041026a0 2024-05-09T06:37:26.881 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:37:26.881 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:37:26.881 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:37:26.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10ec078990 msgr2=0x7f10ec07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10ec078990 0x7f10ec07ae40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10f40041d0 tx=0x7f10f4009040 comp rx=0 tx=0).stop 2024-05-09T06:37:26.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 msgr2=0x7f1104116100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:26.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 0x7f1104116100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009100 tx=0x7f10f8009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:26.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 shutdown_connections 2024-05-09T06:37:26.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104101d00 0x7f1104115bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10ec078990 0x7f10ec07ae40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 --2- 172.21.15.62:0/2950143120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11041026a0 0x7f1104116100 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:26.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 >> 172.21.15.62:0/2950143120 conn(0x7f11040f7870 msgr2=0x7f1104066280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:26.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.902+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 shutdown_connections 2024-05-09T06:37:26.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:26.903+0000 7f110983e700 1 -- 172.21.15.62:0/2950143120 wait complete. 2024-05-09T06:37:27.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:27 smithi062 ceph-mon[109590]: pgmap v120: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:27.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:27 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/485116860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:37:27.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:27 smithi062 ceph-mon[109590]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:27.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:27 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2950143120' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:37:27.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:27 smithi079 ceph-mon[82381]: pgmap v120: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:27.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:27 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/485116860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:37:27.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:27 smithi079 ceph-mon[82381]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:27.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:27 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2950143120' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:37:29.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:29 smithi079 ceph-mon[82381]: pgmap v121: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:29.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:29 smithi062 ceph-mon[109590]: pgmap v121: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:30.300 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:30 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:37:30.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:30 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:37:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:31 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:37:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:31 smithi079 ceph-mon[82381]: Upgrade: osd.3 is safe to restart 2024-05-09T06:37:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:31 smithi079 ceph-mon[82381]: pgmap v122: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:31 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:37:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:31 smithi062 ceph-mon[109590]: Upgrade: osd.3 is safe to restart 2024-05-09T06:37:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:31 smithi062 ceph-mon[109590]: pgmap v122: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:32.319 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:32 smithi079 ceph-mon[82381]: Upgrade: Updating osd.3 2024-05-09T06:37:32.319 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:32 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:32.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:32 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:37:32.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:32 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:32.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:32 smithi079 ceph-mon[82381]: Deploying daemon osd.3 on smithi079 2024-05-09T06:37:32.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:32 smithi062 ceph-mon[109590]: Upgrade: Updating osd.3 2024-05-09T06:37:32.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:32 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:32.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:32 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:37:32.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:32 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:32.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:32 smithi062 ceph-mon[109590]: Deploying daemon osd.3 on smithi079 2024-05-09T06:37:33.195 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:33 smithi079 ceph-mon[82381]: pgmap v123: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:33 smithi062 ceph-mon[109590]: pgmap v123: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:34.430 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:34 smithi079 systemd[1]: Stopping Ceph osd.3 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:37:34.430 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:34 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[40732]: 2024-05-09T06:37:34.425+0000 7f9c449ba700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:37:34.431 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:34 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[40732]: 2024-05-09T06:37:34.425+0000 7f9c449ba700 -1 osd.3 75 *** Got signal Terminated *** 2024-05-09T06:37:34.431 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:34 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[40732]: 2024-05-09T06:37:34.425+0000 7f9c449ba700 -1 osd.3 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:37:35.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:35 smithi062 ceph-mon[109590]: pgmap v124: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:35.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:35 smithi062 ceph-mon[109590]: osd.3 marked itself down and dead 2024-05-09T06:37:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:35 smithi079 ceph-mon[82381]: pgmap v124: 65 pgs: 65 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:35.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:35 smithi079 ceph-mon[82381]: osd.3 marked itself down and dead 2024-05-09T06:37:35.865 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:35 smithi079 podman[90835]: 2024-05-09 06:37:35.622673951 +0000 UTC m=+1.293448096 container died c2e298ddeb3590b6142d523ece9b67c50212a10ef1513d2d9f67d07f20f68c1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4ba5a83, GIT_BRANCH=HEAD, ceph=True) 2024-05-09T06:37:36.120 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:35 smithi079 podman[90835]: 2024-05-09 06:37:35.983701746 +0000 UTC m=+1.654475902 container cleanup c2e298ddeb3590b6142d523ece9b67c50212a10ef1513d2d9f67d07f20f68c1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, RELEASE=quincy-4ba5a83, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-09T06:37:36.120 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:35 smithi079 bash[90835]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3 2024-05-09T06:37:36.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:36 smithi062 ceph-mon[109590]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:37:36.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:36 smithi062 ceph-mon[109590]: osdmap e76: 6 total, 5 up, 6 in 2024-05-09T06:37:36.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:36 smithi079 ceph-mon[82381]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:37:36.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:36 smithi079 ceph-mon[82381]: osdmap e76: 6 total, 5 up, 6 in 2024-05-09T06:37:36.594 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:36 smithi079 podman[90855]: 2024-05-09 06:37:36.293453792 +0000 UTC m=+0.668172214 container remove c2e298ddeb3590b6142d523ece9b67c50212a10ef1513d2d9f67d07f20f68c1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, org.label-schema.license=GPLv2, RELEASE=quincy-4ba5a83, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507) 2024-05-09T06:37:36.885 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:36 smithi079 podman[90948]: 2024-05-09 06:37:36.553338359 +0000 UTC m=+0.017544335 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:36.885 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:36 smithi079 podman[90948]: 2024-05-09 06:37:36.652474297 +0000 UTC m=+0.116680263 container create c0d8445ad55853ae07381b951107da1c381cadd89ef01de6b64895c6d1c8c5b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:37:36.885 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:36 smithi079 podman[90948]: 2024-05-09 06:37:36.829838257 +0000 UTC m=+0.294044225 container init c0d8445ad55853ae07381b951107da1c381cadd89ef01de6b64895c6d1c8c5b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-09T06:37:36.885 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:36 smithi079 podman[90948]: 2024-05-09 06:37:36.833506897 +0000 UTC m=+0.297712867 container start c0d8445ad55853ae07381b951107da1c381cadd89ef01de6b64895c6d1c8c5b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-09T06:37:36.885 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:36 smithi079 podman[90948]: 2024-05-09 06:37:36.90478109 +0000 UTC m=+0.368987080 container attach c0d8445ad55853ae07381b951107da1c381cadd89ef01de6b64895c6d1c8c5b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-05-09T06:37:37.342 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:37 smithi079 podman[90948]: 2024-05-09 06:37:37.131142343 +0000 UTC m=+0.595348318 container died c0d8445ad55853ae07381b951107da1c381cadd89ef01de6b64895c6d1c8c5b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:37:37.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:37 smithi079 ceph-mon[82381]: pgmap v126: 65 pgs: 7 peering, 11 stale+active+clean, 47 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:37.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:37 smithi079 ceph-mon[82381]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-05-09T06:37:37.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:37 smithi079 ceph-mon[82381]: osdmap e77: 6 total, 5 up, 6 in 2024-05-09T06:37:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:37 smithi062 ceph-mon[109590]: pgmap v126: 65 pgs: 7 peering, 11 stale+active+clean, 47 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:37 smithi062 ceph-mon[109590]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-05-09T06:37:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:37 smithi062 ceph-mon[109590]: osdmap e77: 6 total, 5 up, 6 in 2024-05-09T06:37:38.092 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:37 smithi079 podman[90974]: 2024-05-09 06:37:37.725008727 +0000 UTC m=+0.588474223 container remove c0d8445ad55853ae07381b951107da1c381cadd89ef01de6b64895c6d1c8c5b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-09T06:37:38.093 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:37 smithi079 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.3.service: Deactivated successfully. 2024-05-09T06:37:38.093 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:37 smithi079 systemd[1]: Stopped Ceph osd.3 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:37:38.093 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:37 smithi079 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.3.service: Consumed 1min 14.042s CPU time. 2024-05-09T06:37:38.093 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:37 smithi079 systemd[1]: Starting Ceph osd.3 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:37:38.441 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 podman[91080]: 2024-05-09 06:37:38.058255202 +0000 UTC m=+0.018131803 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:38.442 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 podman[91080]: 2024-05-09 06:37:38.167773825 +0000 UTC m=+0.127650411 container create 80d4e36b25e79c556bda89fdf7325d8d4f80564b25605c71726392a5f99a2063 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate, RELEASE=main-720f8e9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T06:37:38.442 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 podman[91080]: 2024-05-09 06:37:38.378651722 +0000 UTC m=+0.338528317 container init 80d4e36b25e79c556bda89fdf7325d8d4f80564b25605c71726392a5f99a2063 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-09T06:37:38.442 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 podman[91080]: 2024-05-09 06:37:38.382421553 +0000 UTC m=+0.342298137 container start 80d4e36b25e79c556bda89fdf7325d8d4f80564b25605c71726392a5f99a2063 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-09T06:37:38.442 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 podman[91080]: 2024-05-09 06:37:38.46167972 +0000 UTC m=+0.421556321 container attach 80d4e36b25e79c556bda89fdf7325d8d4f80564b25605c71726392a5f99a2063 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-09T06:37:39.127 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:39.127 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:39.127 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 bash[91080]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-05-09T06:37:39.128 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T06:37:39.129 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate[91095]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-09T06:37:39.129 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:38 smithi079 podman[91080]: 2024-05-09 06:37:38.892118571 +0000 UTC m=+0.851995146 container died 80d4e36b25e79c556bda89fdf7325d8d4f80564b25605c71726392a5f99a2063 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, io.buildah.version=1.33.5) 2024-05-09T06:37:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:39 smithi062 ceph-mon[109590]: pgmap v128: 65 pgs: 7 peering, 11 stale+active+clean, 47 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:39.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:39 smithi079 ceph-mon[82381]: pgmap v128: 65 pgs: 7 peering, 11 stale+active+clean, 47 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:39.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:39.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:39.813 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:39 smithi079 podman[91234]: 2024-05-09 06:37:39.457086281 +0000 UTC m=+0.559284965 container remove 80d4e36b25e79c556bda89fdf7325d8d4f80564b25605c71726392a5f99a2063 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:37:39.813 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:39 smithi079 podman[91302]: 2024-05-09 06:37:39.574427873 +0000 UTC m=+0.018359336 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:39.813 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:39 smithi079 podman[91302]: 2024-05-09 06:37:39.691337822 +0000 UTC m=+0.135269273 container create 8d7a05b6e02c86205430e77d845aa9a651863d8e7ebbbc9aebcb634421e3b58c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T06:37:40.342 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:39 smithi079 podman[91302]: 2024-05-09 06:37:39.935428287 +0000 UTC m=+0.379359735 container init 8d7a05b6e02c86205430e77d845aa9a651863d8e7ebbbc9aebcb634421e3b58c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-09T06:37:40.342 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:39 smithi079 podman[91302]: 2024-05-09 06:37:39.938564885 +0000 UTC m=+0.382496336 container start 8d7a05b6e02c86205430e77d845aa9a651863d8e7ebbbc9aebcb634421e3b58c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS) 2024-05-09T06:37:40.342 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:39 smithi079 ceph-osd[91320]: -- 172.21.15.79:0/1591667248 <== mon.1 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558a80a07680 con 0x558a809d0c00 2024-05-09T06:37:40.343 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:40 smithi079 bash[91302]: 8d7a05b6e02c86205430e77d845aa9a651863d8e7ebbbc9aebcb634421e3b58c 2024-05-09T06:37:40.343 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:40 smithi079 systemd[1]: Started Ceph osd.3 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:37:40.842 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:40 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[91316]: 2024-05-09T06:37:40.486+0000 7f1cde5457c0 -1 Falling back to public interface 2024-05-09T06:37:41.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:41 smithi079 ceph-mon[82381]: pgmap v129: 65 pgs: 15 active+undersized, 11 active+undersized+degraded, 7 peering, 32 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 29/216 objects degraded (13.426%) 2024-05-09T06:37:41.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:41 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:41.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:41 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:41.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:41 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:41.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:41 smithi079 ceph-mon[82381]: Health check failed: Degraded data redundancy: 29/216 objects degraded (13.426%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:41.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:41 smithi062 ceph-mon[109590]: pgmap v129: 65 pgs: 15 active+undersized, 11 active+undersized+degraded, 7 peering, 32 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 29/216 objects degraded (13.426%) 2024-05-09T06:37:41.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:41 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:41.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:41 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:41.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:41 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:41.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:41 smithi062 ceph-mon[109590]: Health check failed: Degraded data redundancy: 29/216 objects degraded (13.426%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:42.373 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:42 smithi079 ceph-mon[82381]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-05-09T06:37:42.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:42 smithi062 ceph-mon[109590]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-05-09T06:37:43.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:43 smithi062 ceph-mon[109590]: pgmap v130: 65 pgs: 19 active+undersized, 14 active+undersized+degraded, 32 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 37/216 objects degraded (17.130%) 2024-05-09T06:37:43.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:43.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:43.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:43 smithi079 ceph-mon[82381]: pgmap v130: 65 pgs: 19 active+undersized, 14 active+undersized+degraded, 32 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 37/216 objects degraded (17.130%) 2024-05-09T06:37:43.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:43.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:45 smithi079 ceph-mon[82381]: pgmap v131: 65 pgs: 19 active+undersized, 14 active+undersized+degraded, 32 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 37/216 objects degraded (17.130%) 2024-05-09T06:37:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:45 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:45 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:45.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:45 smithi062 ceph-mon[109590]: pgmap v131: 65 pgs: 19 active+undersized, 14 active+undersized+degraded, 32 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 37/216 objects degraded (17.130%) 2024-05-09T06:37:45.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:45 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:45.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:45 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:45.902 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[91316]: 2024-05-09T06:37:45.661+0000 7f1cde5457c0 -1 osd.3 75 log_to_monitors true 2024-05-09T06:37:46.210 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:46 smithi079 ceph-mon[82381]: from='osd.3 [v2:172.21.15.79:6800/2443081992,v1:172.21.15.79:6801/2443081992]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:37:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:46 smithi079 ceph-mon[82381]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:37:46.211 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:37:46 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[91316]: 2024-05-09T06:37:46.085+0000 7f1ccf99c700 -1 osd.3 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:37:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:46 smithi062 ceph-mon[109590]: from='osd.3 [v2:172.21.15.79:6800/2443081992,v1:172.21.15.79:6801/2443081992]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:37:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:46 smithi062 ceph-mon[109590]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:37:47.057 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:47 smithi079 ceph-mon[82381]: pgmap v132: 65 pgs: 19 active+undersized, 14 active+undersized+degraded, 32 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 37/216 objects degraded (17.130%) 2024-05-09T06:37:47.057 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:47 smithi079 ceph-mon[82381]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T06:37:47.057 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:47 smithi079 ceph-mon[82381]: from='osd.3 [v2:172.21.15.79:6800/2443081992,v1:172.21.15.79:6801/2443081992]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:37:47.058 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:47 smithi079 ceph-mon[82381]: osdmap e78: 6 total, 5 up, 6 in 2024-05-09T06:37:47.058 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:47 smithi079 ceph-mon[82381]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:37:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:47 smithi062 ceph-mon[109590]: pgmap v132: 65 pgs: 19 active+undersized, 14 active+undersized+degraded, 32 active+clean; 195 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 37/216 objects degraded (17.130%) 2024-05-09T06:37:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:47 smithi062 ceph-mon[109590]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T06:37:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:47 smithi062 ceph-mon[109590]: from='osd.3 [v2:172.21.15.79:6800/2443081992,v1:172.21.15.79:6801/2443081992]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:37:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:47 smithi062 ceph-mon[109590]: osdmap e78: 6 total, 5 up, 6 in 2024-05-09T06:37:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:47 smithi062 ceph-mon[109590]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:37:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:37:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: osd.3 [v2:172.21.15.79:6800/2443081992,v1:172.21.15.79:6801/2443081992] boot 2024-05-09T06:37:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: osdmap e79: 6 total, 6 up, 6 in 2024-05-09T06:37:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:37:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:48.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:37:48.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:48.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:48.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:48.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:48.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:48.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:37:48.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:48 smithi079 ceph-mon[82381]: osdmap e80: 6 total, 6 up, 6 in 2024-05-09T06:37:48.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:37:48.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: osd.3 [v2:172.21.15.79:6800/2443081992,v1:172.21.15.79:6801/2443081992] boot 2024-05-09T06:37:48.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: osdmap e79: 6 total, 6 up, 6 in 2024-05-09T06:37:48.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:37:48.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:37:48.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:48 smithi062 ceph-mon[109590]: osdmap e80: 6 total, 6 up, 6 in 2024-05-09T06:37:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:49 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:37:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:49 smithi079 ceph-mon[82381]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-05-09T06:37:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:49 smithi079 ceph-mon[82381]: pgmap v135: 65 pgs: 19 active+undersized, 14 active+undersized+degraded, 32 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/216 objects degraded (17.130%) 2024-05-09T06:37:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:49 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 37/216 objects degraded (17.130%), 14 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:49.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:49 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:37:49.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:49 smithi062 ceph-mon[109590]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-05-09T06:37:49.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:49 smithi062 ceph-mon[109590]: pgmap v135: 65 pgs: 19 active+undersized, 14 active+undersized+degraded, 32 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/216 objects degraded (17.130%) 2024-05-09T06:37:49.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:49 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 37/216 objects degraded (17.130%), 14 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:51.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:51 smithi079 ceph-mon[82381]: pgmap v137: 65 pgs: 10 active+undersized, 8 active+undersized+degraded, 47 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21/216 objects degraded (9.722%) 2024-05-09T06:37:51.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:51 smithi062 ceph-mon[109590]: pgmap v137: 65 pgs: 10 active+undersized, 8 active+undersized+degraded, 47 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21/216 objects degraded (9.722%) 2024-05-09T06:37:52.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:52 smithi062 ceph-mon[109590]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/216 objects degraded (9.722%), 8 pgs degraded) 2024-05-09T06:37:52.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:52 smithi079 ceph-mon[82381]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/216 objects degraded (9.722%), 8 pgs degraded) 2024-05-09T06:37:53.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:53 smithi062 ceph-mon[109590]: pgmap v138: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:53.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:53 smithi079 ceph-mon[82381]: pgmap v138: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:55 smithi079 ceph-mon[82381]: pgmap v139: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:55 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:55 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:55.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:55 smithi062 ceph-mon[109590]: pgmap v139: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:55.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:55 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:37:55.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:55 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.022+0000 7fa65a670700 1 -- 172.21.15.62:0/3807458475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6541037a0 msgr2=0x7fa6540fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.022+0000 7fa65a670700 1 --2- 172.21.15.62:0/3807458475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6541037a0 0x7fa6540fce10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa648004940 tx=0x7fa648009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.022+0000 7fa65a670700 1 -- 172.21.15.62:0/3807458475 shutdown_connections 2024-05-09T06:37:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.022+0000 7fa65a670700 1 --2- 172.21.15.62:0/3807458475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6541037a0 0x7fa6540fce10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.022+0000 7fa65a670700 1 --2- 172.21.15.62:0/3807458475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa654102e00 0x7fa6541031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.022+0000 7fa65a670700 1 -- 172.21.15.62:0/3807458475 >> 172.21.15.62:0/3807458475 conn(0x7fa6540f89d0 msgr2=0x7fa6540fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.022+0000 7fa65a670700 1 -- 172.21.15.62:0/3807458475 shutdown_connections 2024-05-09T06:37:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.022+0000 7fa65a670700 1 -- 172.21.15.62:0/3807458475 wait complete. 2024-05-09T06:37:57.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.023+0000 7fa65a670700 1 Processor -- start 2024-05-09T06:37:57.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.023+0000 7fa65a670700 1 -- start start 2024-05-09T06:37:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa65a670700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa654102e00 0x7fa654070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa65a670700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541037a0 0x7fa6540707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa65a670700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540721b0 con 0x7fa654102e00 2024-05-09T06:37:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa65a670700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654070ce0 con 0x7fa6541037a0 2024-05-09T06:37:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa653fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa654102e00 0x7fa654070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa653fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa654102e00 0x7fa654070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47992/0 (socket says 172.21.15.62:47992) 2024-05-09T06:37:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa653fff700 1 -- 172.21.15.62:0/457312945 learned_addr learned my addr 172.21.15.62:0/457312945 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa6537fe700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541037a0 0x7fa6540707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa653fff700 1 -- 172.21.15.62:0/457312945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541037a0 msgr2=0x7fa6540707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa653fff700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541037a0 0x7fa6540707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa653fff700 1 -- 172.21.15.62:0/457312945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648005040 con 0x7fa654102e00 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa653fff700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa654102e00 0x7fa654070260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa64400eb40 tx=0x7fa64400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa650ff9700 1 -- 172.21.15.62:0/457312945 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa644007cc0 con 0x7fa654102e00 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.024+0000 7fa650ff9700 1 -- 172.21.15.62:0/457312945 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa64400f040 con 0x7fa654102e00 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.025+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa654070f60 con 0x7fa654102e00 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.025+0000 7fa650ff9700 1 -- 172.21.15.62:0/457312945 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64400ca10 con 0x7fa654102e00 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.025+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa654119f70 con 0x7fa654102e00 2024-05-09T06:37:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.026+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6541052d0 con 0x7fa654102e00 2024-05-09T06:37:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.026+0000 7fa650ff9700 1 -- 172.21.15.62:0/457312945 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa64400cc80 con 0x7fa654102e00 2024-05-09T06:37:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.027+0000 7fa650ff9700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa63c078990 0x7fa63c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.027+0000 7fa650ff9700 1 -- 172.21.15.62:0/457312945 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fa64409a3b0 con 0x7fa654102e00 2024-05-09T06:37:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.027+0000 7fa6537fe700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa63c078990 0x7fa63c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.027+0000 7fa6537fe700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa63c078990 0x7fa63c07ae40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa648004890 tx=0x7fa648009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:57.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.032+0000 7fa650ff9700 1 -- 172.21.15.62:0/457312945 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa644062000 con 0x7fa654102e00 2024-05-09T06:37:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.267+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa654071740 con 0x7fa63c078990 2024-05-09T06:37:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.268+0000 7fa650ff9700 1 -- 172.21.15.62:0/457312945 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa654071740 con 0x7fa63c078990 2024-05-09T06:37:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa63c078990 msgr2=0x7fa63c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa63c078990 0x7fa63c07ae40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa648004890 tx=0x7fa648009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa654102e00 msgr2=0x7fa654070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa654102e00 0x7fa654070260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa64400eb40 tx=0x7fa64400b040 comp rx=0 tx=0).stop 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 shutdown_connections 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa63c078990 0x7fa63c07ae40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa654102e00 0x7fa654070260 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 --2- 172.21.15.62:0/457312945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541037a0 0x7fa6540707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 >> 172.21.15.62:0/457312945 conn(0x7fa6540f89d0 msgr2=0x7fa6540fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 shutdown_connections 2024-05-09T06:37:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.271+0000 7fa65a670700 1 -- 172.21.15.62:0/457312945 wait complete. 2024-05-09T06:37:57.262 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:37:57.262 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:57 smithi062 ceph-mon[109590]: pgmap v140: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:57.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:57 smithi079 ceph-mon[82381]: pgmap v140: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:57.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.378+0000 7f4685c88700 1 -- 172.21.15.62:0/2565063192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680102de0 msgr2=0x7f46801031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.378+0000 7f4685c88700 1 --2- 172.21.15.62:0/2565063192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680102de0 0x7f46801031b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4670004940 tx=0x7f4670009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:57.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.378+0000 7f4685c88700 1 -- 172.21.15.62:0/2565063192 shutdown_connections 2024-05-09T06:37:57.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.378+0000 7f4685c88700 1 --2- 172.21.15.62:0/2565063192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4680103780 0x7f46800fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.378+0000 7f4685c88700 1 --2- 172.21.15.62:0/2565063192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680102de0 0x7f46801031b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.378+0000 7f4685c88700 1 -- 172.21.15.62:0/2565063192 >> 172.21.15.62:0/2565063192 conn(0x7f46800f8990 msgr2=0x7f46800fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:57.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.378+0000 7f4685c88700 1 -- 172.21.15.62:0/2565063192 shutdown_connections 2024-05-09T06:37:57.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.378+0000 7f4685c88700 1 -- 172.21.15.62:0/2565063192 wait complete. 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f4685c88700 1 Processor -- start 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f4685c88700 1 -- start start 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f4685c88700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4680102de0 0x7f4680113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f4685c88700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680103780 0x7f4680113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f4685c88700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680114500 con 0x7f4680103780 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f4685c88700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468010db50 con 0x7f4680102de0 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f467effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680103780 0x7f4680113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f467effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680103780 0x7f4680113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48012/0 (socket says 172.21.15.62:48012) 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f467effd700 1 -- 172.21.15.62:0/2427880022 learned_addr learned my addr 172.21.15.62:0/2427880022 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.379+0000 7f467f7fe700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4680102de0 0x7f4680113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f467effd700 1 -- 172.21.15.62:0/2427880022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4680102de0 msgr2=0x7f4680113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f467effd700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4680102de0 0x7f4680113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f467effd700 1 -- 172.21.15.62:0/2427880022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670005040 con 0x7f4680103780 2024-05-09T06:37:57.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f467effd700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680103780 0x7f4680113eb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f467400c890 tx=0x7f46740044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:57.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f4667fff700 1 -- 172.21.15.62:0/2427880022 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f467400a7d0 con 0x7f4680103780 2024-05-09T06:37:57.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468010de30 con 0x7f4680103780 2024-05-09T06:37:57.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f4667fff700 1 -- 172.21.15.62:0/2427880022 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f467400ae00 con 0x7f4680103780 2024-05-09T06:37:57.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f4667fff700 1 -- 172.21.15.62:0/2427880022 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46740113a0 con 0x7f4680103780 2024-05-09T06:37:57.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.380+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468010e3f0 con 0x7f4680103780 2024-05-09T06:37:57.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.381+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46801000f0 con 0x7f4680103780 2024-05-09T06:37:57.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.382+0000 7f4667fff700 1 -- 172.21.15.62:0/2427880022 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f4674012400 con 0x7f4680103780 2024-05-09T06:37:57.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.382+0000 7f4667fff700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4668078980 0x7f466807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.382+0000 7f4667fff700 1 -- 172.21.15.62:0/2427880022 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f467409a8a0 con 0x7f4680103780 2024-05-09T06:37:57.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.382+0000 7f467f7fe700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4668078980 0x7f466807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.383+0000 7f467f7fe700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4668078980 0x7f466807ae30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f467000b3b0 tx=0x7f4670009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:57.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.387+0000 7f4667fff700 1 -- 172.21.15.62:0/2427880022 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f46740624c0 con 0x7f4680103780 2024-05-09T06:37:57.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.623+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f468010f030 con 0x7f4668078980 2024-05-09T06:37:57.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.624+0000 7f4667fff700 1 -- 172.21.15.62:0/2427880022 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f468010f030 con 0x7f4668078980 2024-05-09T06:37:57.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4668078980 msgr2=0x7f466807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4668078980 0x7f466807ae30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f467000b3b0 tx=0x7f4670009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680103780 msgr2=0x7f4680113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680103780 0x7f4680113eb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f467400c890 tx=0x7f46740044c0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 shutdown_connections 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4680102de0 0x7f4680113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4668078980 0x7f466807ae30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 --2- 172.21.15.62:0/2427880022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4680103780 0x7f4680113eb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 >> 172.21.15.62:0/2427880022 conn(0x7f46800f8990 msgr2=0x7f4680107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 shutdown_connections 2024-05-09T06:37:57.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.627+0000 7f4685c88700 1 -- 172.21.15.62:0/2427880022 wait complete. 2024-05-09T06:37:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.732+0000 7f4b840ae700 1 -- 172.21.15.62:0/2600904961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c102670 msgr2=0x7f4b7c0fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.732+0000 7f4b840ae700 1 --2- 172.21.15.62:0/2600904961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c102670 0x7f4b7c0fb600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4b70004940 tx=0x7f4b70009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.732+0000 7f4b840ae700 1 -- 172.21.15.62:0/2600904961 shutdown_connections 2024-05-09T06:37:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.732+0000 7f4b840ae700 1 --2- 172.21.15.62:0/2600904961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c102670 0x7f4b7c0fb600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.732+0000 7f4b840ae700 1 --2- 172.21.15.62:0/2600904961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c101cd0 0x7f4b7c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.732+0000 7f4b840ae700 1 -- 172.21.15.62:0/2600904961 >> 172.21.15.62:0/2600904961 conn(0x7f4b7c071460 msgr2=0x7f4b7c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:57.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.732+0000 7f4b840ae700 1 -- 172.21.15.62:0/2600904961 shutdown_connections 2024-05-09T06:37:57.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.732+0000 7f4b840ae700 1 -- 172.21.15.62:0/2600904961 wait complete. 2024-05-09T06:37:57.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b840ae700 1 Processor -- start 2024-05-09T06:37:57.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b840ae700 1 -- start start 2024-05-09T06:37:57.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b840ae700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c101cd0 0x7f4b7c113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b840ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c102670 0x7f4b7c114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b840ae700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c114750 con 0x7f4b7c101cd0 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b840ae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c10dab0 con 0x7f4b7c102670 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b81e4a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c101cd0 0x7f4b7c113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b81e4a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c101cd0 0x7f4b7c113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48028/0 (socket says 172.21.15.62:48028) 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b81e4a700 1 -- 172.21.15.62:0/1644603268 learned_addr learned my addr 172.21.15.62:0/1644603268 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b81e4a700 1 -- 172.21.15.62:0/1644603268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c102670 msgr2=0x7f4b7c114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b81649700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c102670 0x7f4b7c114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b81e4a700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c102670 0x7f4b7c114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b81e4a700 1 -- 172.21.15.62:0/1644603268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b70005040 con 0x7f4b7c101cd0 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.733+0000 7f4b81649700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c102670 0x7f4b7c114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.734+0000 7f4b81e4a700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c101cd0 0x7f4b7c113b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800b790 tx=0x7f4b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.734+0000 7f4b6e7fc700 1 -- 172.21.15.62:0/1644603268 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7800f770 con 0x7f4b7c101cd0 2024-05-09T06:37:57.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.734+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c10dd90 con 0x7f4b7c101cd0 2024-05-09T06:37:57.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.734+0000 7f4b6e7fc700 1 -- 172.21.15.62:0/1644603268 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b7800fda0 con 0x7f4b7c101cd0 2024-05-09T06:37:57.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.734+0000 7f4b6e7fc700 1 -- 172.21.15.62:0/1644603268 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7800d310 con 0x7f4b7c101cd0 2024-05-09T06:37:57.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.734+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c10e350 con 0x7f4b7c101cd0 2024-05-09T06:37:57.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.735+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c1052e0 con 0x7f4b7c101cd0 2024-05-09T06:37:57.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.735+0000 7f4b6e7fc700 1 -- 172.21.15.62:0/1644603268 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f4b78010420 con 0x7f4b7c101cd0 2024-05-09T06:37:57.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.736+0000 7f4b6e7fc700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4b68078990 0x7f4b6807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:57.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.736+0000 7f4b6e7fc700 1 -- 172.21.15.62:0/1644603268 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f4b7809a820 con 0x7f4b7c101cd0 2024-05-09T06:37:57.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.736+0000 7f4b81649700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4b68078990 0x7f4b6807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:57.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.736+0000 7f4b81649700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4b68078990 0x7f4b6807ae40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c10ec70 tx=0x7f4b70009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.741+0000 7f4b6e7fc700 1 -- 172.21.15.62:0/1644603268 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f4b78062440 con 0x7f4b7c101cd0 2024-05-09T06:37:57.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.963+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b7c10f1f0 con 0x7f4b68078990 2024-05-09T06:37:57.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.973+0000 7f4b6e7fc700 1 -- 172.21.15.62:0/1644603268 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4b7c10f1f0 con 0x7f4b68078990 2024-05-09T06:37:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:37:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (5m) 48s ago 16m 26.3M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:37:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (2m) 48s ago 16m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:37:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (2m) 15s ago 15m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:37:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (4m) 48s ago 16m 81.0M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:37:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (10m) 48s ago 10m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:37:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (10m) 48s ago 10m 152M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (10m) 15s ago 10m 16.4M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (10m) 15s ago 10m 16.3M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (6m) 48s ago 17m 519M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (6m) 15s ago 15m 465M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (3m) 48s ago 18m 47.3M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (3m) 15s ago 15m 36.8M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (5m) 48s ago 16m 14.7M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (5m) 15s ago 15m 17.1M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (2m) 48s ago 14m 141M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (91s) 48s ago 13m 140M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:37:57.955 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (54s) 48s ago 13m 12.7M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 89acd3b9ad68 2024-05-09T06:37:57.956 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (18s) 15s ago 12m 15.0M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 8d7a05b6e02c 2024-05-09T06:37:57.956 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (12m) 15s ago 12m 257M 2581M 17.2.7-933-g4ba5a836 b96134859c76 2669a808b459 2024-05-09T06:37:57.956 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (12m) 15s ago 12m 245M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:37:57.956 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (5m) 48s ago 15m 65.8M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4b68078990 msgr2=0x7f4b6807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4b68078990 0x7f4b6807ae40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c10ec70 tx=0x7f4b70009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c101cd0 msgr2=0x7f4b7c113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c101cd0 0x7f4b7c113b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800b790 tx=0x7f4b78009250 comp rx=0 tx=0).stop 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 shutdown_connections 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4b68078990 0x7f4b6807ae40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b7c101cd0 0x7f4b7c113b30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 --2- 172.21.15.62:0/1644603268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b7c102670 0x7f4b7c114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:57.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 >> 172.21.15.62:0/1644603268 conn(0x7f4b7c071460 msgr2=0x7f4b7c0f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 shutdown_connections 2024-05-09T06:37:57.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:57.976+0000 7f4b840ae700 1 -- 172.21.15.62:0/1644603268 wait complete. 2024-05-09T06:37:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 -- 172.21.15.62:0/1781140697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105080 msgr2=0x7f2720105450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 --2- 172.21.15.62:0/1781140697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105080 0x7f2720105450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2710009ce0 tx=0x7f2710004d10 comp rx=0 tx=0).stop 2024-05-09T06:37:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 -- 172.21.15.62:0/1781140697 shutdown_connections 2024-05-09T06:37:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 --2- 172.21.15.62:0/1781140697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720105a20 0x7f27200ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 --2- 172.21.15.62:0/1781140697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105080 0x7f2720105450 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 -- 172.21.15.62:0/1781140697 >> 172.21.15.62:0/1781140697 conn(0x7f27200fabf0 msgr2=0x7f27200fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 -- 172.21.15.62:0/1781140697 shutdown_connections 2024-05-09T06:37:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 -- 172.21.15.62:0/1781140697 wait complete. 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 Processor -- start 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.082+0000 7f2725549700 1 -- start start 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f2725549700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720105080 0x7f2720115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f2725549700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105a20 0x7f27201161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f2725549700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720116810 con 0x7f2720105a20 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f2725549700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272010fdf0 con 0x7f2720105080 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f271e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105a20 0x7f27201161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f271e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105a20 0x7f27201161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48058/0 (socket says 172.21.15.62:48058) 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f271e7fc700 1 -- 172.21.15.62:0/1498383354 learned_addr learned my addr 172.21.15.62:0/1498383354 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f271effd700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720105080 0x7f2720115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f271e7fc700 1 -- 172.21.15.62:0/1498383354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720105080 msgr2=0x7f2720115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f271e7fc700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720105080 0x7f2720115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f271e7fc700 1 -- 172.21.15.62:0/1498383354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710009940 con 0x7f2720105a20 2024-05-09T06:37:58.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f271e7fc700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105a20 0x7f27201161c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2708002a50 tx=0x7f2708004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:58.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f27177fe700 1 -- 172.21.15.62:0/1498383354 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2708007cc0 con 0x7f2720105a20 2024-05-09T06:37:58.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27201100d0 con 0x7f2720105a20 2024-05-09T06:37:58.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f27177fe700 1 -- 172.21.15.62:0/1498383354 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f270800f040 con 0x7f2720105a20 2024-05-09T06:37:58.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.083+0000 7f27177fe700 1 -- 172.21.15.62:0/1498383354 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f270800d9c0 con 0x7f2720105a20 2024-05-09T06:37:58.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.084+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2720110690 con 0x7f2720105a20 2024-05-09T06:37:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.085+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2720102390 con 0x7f2720105a20 2024-05-09T06:37:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.085+0000 7f27177fe700 1 -- 172.21.15.62:0/1498383354 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f270800dbc0 con 0x7f2720105a20 2024-05-09T06:37:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.086+0000 7f27177fe700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f270c078990 0x7f270c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.086+0000 7f27177fe700 1 -- 172.21.15.62:0/1498383354 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f270809a530 con 0x7f2720105a20 2024-05-09T06:37:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.086+0000 7f271effd700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f270c078990 0x7f270c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.086+0000 7f271effd700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f270c078990 0x7f270c07ae40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f271000b740 tx=0x7f2710004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:58.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.090+0000 7f27177fe700 1 -- 172.21.15.62:0/1498383354 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f2708062140 con 0x7f2720105a20 2024-05-09T06:37:58.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:58 smithi079 ceph-mon[82381]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:58.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.399+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27201112d0 con 0x7f2720105a20 2024-05-09T06:37:58.380 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:58 smithi062 ceph-mon[109590]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:58.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.399+0000 7f27177fe700 1 -- 172.21.15.62:0/1498383354 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f2708061ae0 con 0x7f2720105a20 2024-05-09T06:37:58.380 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:37:58.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:37:58.380 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:58.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:37:58.380 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2, 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6, 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 8 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:37:58.381 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f270c078990 msgr2=0x7f270c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f270c078990 0x7f270c07ae40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f271000b740 tx=0x7f2710004d10 comp rx=0 tx=0).stop 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105a20 msgr2=0x7f27201161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105a20 0x7f27201161c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2708002a50 tx=0x7f2708004600 comp rx=0 tx=0).stop 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 shutdown_connections 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720105080 0x7f2720115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f270c078990 0x7f270c07ae40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 --2- 172.21.15.62:0/1498383354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2720105a20 0x7f27201161c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 >> 172.21.15.62:0/1498383354 conn(0x7f27200fabf0 msgr2=0x7f27200fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 shutdown_connections 2024-05-09T06:37:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.403+0000 7f2725549700 1 -- 172.21.15.62:0/1498383354 wait complete. 2024-05-09T06:37:58.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.510+0000 7fc006a17700 1 -- 172.21.15.62:0/102241474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 msgr2=0x7fc0000fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.510+0000 7fc006a17700 1 --2- 172.21.15.62:0/102241474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 0x7fc0000fce00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8004940 tx=0x7fbfe8009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.510+0000 7fc006a17700 1 -- 172.21.15.62:0/102241474 shutdown_connections 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.510+0000 7fc006a17700 1 --2- 172.21.15.62:0/102241474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 0x7fc0000fce00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.510+0000 7fc006a17700 1 --2- 172.21.15.62:0/102241474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc000102df0 0x7fc0001031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.510+0000 7fc006a17700 1 -- 172.21.15.62:0/102241474 >> 172.21.15.62:0/102241474 conn(0x7fc0000f8980 msgr2=0x7fc0000fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.510+0000 7fc006a17700 1 -- 172.21.15.62:0/102241474 shutdown_connections 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.510+0000 7fc006a17700 1 -- 172.21.15.62:0/102241474 wait complete. 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.511+0000 7fc006a17700 1 Processor -- start 2024-05-09T06:37:58.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.511+0000 7fc006a17700 1 -- start start 2024-05-09T06:37:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.511+0000 7fc006a17700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc000102df0 0x7fc000113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.511+0000 7fc006a17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 0x7fc0001140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.511+0000 7fc006a17700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc000114720 con 0x7fc000103790 2024-05-09T06:37:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.511+0000 7fc006a17700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00010db10 con 0x7fc000102df0 2024-05-09T06:37:58.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbff7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 0x7fc0001140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbff7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 0x7fc0001140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48074/0 (socket says 172.21.15.62:48074) 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbff7fff700 1 -- 172.21.15.62:0/269377141 learned_addr learned my addr 172.21.15.62:0/269377141 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbffffff700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc000102df0 0x7fc000113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbff7fff700 1 -- 172.21.15.62:0/269377141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc000102df0 msgr2=0x7fc000113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbff7fff700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc000102df0 0x7fc000113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbff7fff700 1 -- 172.21.15.62:0/269377141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8005040 con 0x7fc000103790 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbff7fff700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 0x7fc0001140d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009100 tx=0x7fbfe8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbffd7fa700 1 -- 172.21.15.62:0/269377141 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe800e040 con 0x7fc000103790 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbffd7fa700 1 -- 172.21.15.62:0/269377141 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbfe8009af0 con 0x7fc000103790 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00010dd90 con 0x7fc000103790 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fbffd7fa700 1 -- 172.21.15.62:0/269377141 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe801c3f0 con 0x7fc000103790 2024-05-09T06:37:58.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.512+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00010e350 con 0x7fc000103790 2024-05-09T06:37:58.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.513+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0000fe540 con 0x7fc000103790 2024-05-09T06:37:58.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.514+0000 7fbffd7fa700 1 -- 172.21.15.62:0/269377141 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fbfe800baf0 con 0x7fc000103790 2024-05-09T06:37:58.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.515+0000 7fbffd7fa700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbfec078990 0x7fbfec07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.515+0000 7fbffffff700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbfec078990 0x7fbfec07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.515+0000 7fbffd7fa700 1 -- 172.21.15.62:0/269377141 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fbfe809b920 con 0x7fc000103790 2024-05-09T06:37:58.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.515+0000 7fbffffff700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbfec078990 0x7fbfec07ae40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbff0004eb0 tx=0x7fbff000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:58.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.520+0000 7fbffd7fa700 1 -- 172.21.15.62:0/269377141 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fbfe80635e0 con 0x7fc000103790 2024-05-09T06:37:58.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.782+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc000109ed0 con 0x7fc000103790 2024-05-09T06:37:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.782+0000 7fbffd7fa700 1 -- 172.21.15.62:0/269377141 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1872 (secure 0 0 0) 0x7fbfe8062f80 con 0x7fc000103790 2024-05-09T06:37:58.763 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:37:58.763 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:37:58.763 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:37:58.763 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:37:58.763 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:37:58.763 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:37:58.763 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:37:58.764 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:37:58.765 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:37:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:37:58.766 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:37:58.766 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:37:58.766 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:58.766 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:58.766 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbfec078990 msgr2=0x7fbfec07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbfec078990 0x7fbfec07ae40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbff0004eb0 tx=0x7fbff000b040 comp rx=0 tx=0).stop 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 msgr2=0x7fc0001140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 0x7fc0001140d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009100 tx=0x7fbfe8009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 shutdown_connections 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc000102df0 0x7fc000113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbfec078990 0x7fbfec07ae40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 --2- 172.21.15.62:0/269377141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc000103790 0x7fc0001140d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.785+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 >> 172.21.15.62:0/269377141 conn(0x7fc0000f8980 msgr2=0x7fc0000f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:58.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.786+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 shutdown_connections 2024-05-09T06:37:58.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.786+0000 7fc006a17700 1 -- 172.21.15.62:0/269377141 wait complete. 2024-05-09T06:37:58.768 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:37:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.892+0000 7fdb14d17700 1 -- 172.21.15.62:0/1754052250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 msgr2=0x7fdb101020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.892+0000 7fdb14d17700 1 --2- 172.21.15.62:0/1754052250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 0x7fdb101020e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdb00004940 tx=0x7fdb00009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.892+0000 7fdb14d17700 1 -- 172.21.15.62:0/1754052250 shutdown_connections 2024-05-09T06:37:58.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.892+0000 7fdb14d17700 1 --2- 172.21.15.62:0/1754052250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb101026b0 0x7fdb100fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.892+0000 7fdb14d17700 1 --2- 172.21.15.62:0/1754052250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 0x7fdb101020e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.892+0000 7fdb14d17700 1 -- 172.21.15.62:0/1754052250 >> 172.21.15.62:0/1754052250 conn(0x7fdb100f7860 msgr2=0x7fdb100f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.892+0000 7fdb14d17700 1 -- 172.21.15.62:0/1754052250 shutdown_connections 2024-05-09T06:37:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.892+0000 7fdb14d17700 1 -- 172.21.15.62:0/1754052250 wait complete. 2024-05-09T06:37:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb14d17700 1 Processor -- start 2024-05-09T06:37:58.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb14d17700 1 -- start start 2024-05-09T06:37:58.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb14d17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 0x7fdb101128c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb14d17700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb101026b0 0x7fdb10112e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb14d17700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10113450 con 0x7fdb10101d10 2024-05-09T06:37:58.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb14d17700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1010ca50 con 0x7fdb101026b0 2024-05-09T06:37:58.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb0e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 0x7fdb101128c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb0e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 0x7fdb101128c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48092/0 (socket says 172.21.15.62:48092) 2024-05-09T06:37:58.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb0e59c700 1 -- 172.21.15.62:0/1996512247 learned_addr learned my addr 172.21.15.62:0/1996512247 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb0dd9b700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb101026b0 0x7fdb10112e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb0e59c700 1 -- 172.21.15.62:0/1996512247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb101026b0 msgr2=0x7fdb10112e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb0e59c700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb101026b0 0x7fdb10112e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb0e59c700 1 -- 172.21.15.62:0/1996512247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00005040 con 0x7fdb10101d10 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.893+0000 7fdb0dd9b700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb101026b0 0x7fdb10112e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.894+0000 7fdb0e59c700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 0x7fdb101128c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009150 tx=0x7fdb00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.894+0000 7fdb06ffd700 1 -- 172.21.15.62:0/1996512247 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0000e040 con 0x7fdb10101d10 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.894+0000 7fdb06ffd700 1 -- 172.21.15.62:0/1996512247 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb00013420 con 0x7fdb10101d10 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.894+0000 7fdb06ffd700 1 -- 172.21.15.62:0/1996512247 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0001c630 con 0x7fdb10101d10 2024-05-09T06:37:58.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.894+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1010ccd0 con 0x7fdb10101d10 2024-05-09T06:37:58.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.894+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1010d160 con 0x7fdb10101d10 2024-05-09T06:37:58.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.895+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb100fd460 con 0x7fdb10101d10 2024-05-09T06:37:58.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.896+0000 7fdb06ffd700 1 -- 172.21.15.62:0/1996512247 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fdb00013590 con 0x7fdb10101d10 2024-05-09T06:37:58.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.896+0000 7fdb06ffd700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdafc078980 0x7fdafc07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:58.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.896+0000 7fdb06ffd700 1 -- 172.21.15.62:0/1996512247 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fdb0009b900 con 0x7fdb10101d10 2024-05-09T06:37:58.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.896+0000 7fdb0dd9b700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdafc078980 0x7fdafc07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:58.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.897+0000 7fdb0dd9b700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdafc078980 0x7fdafc07ae30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8007fd0 tx=0x7fdaf8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:58.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:58.901+0000 7fdb06ffd700 1 -- 172.21.15.62:0/1996512247 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fdb000635c0 con 0x7fdb10101d10 2024-05-09T06:37:59.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.144+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb1010d440 con 0x7fdafc078980 2024-05-09T06:37:59.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.145+0000 7fdb06ffd700 1 -- 172.21.15.62:0/1996512247 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdb1010d440 con 0x7fdafc078980 2024-05-09T06:37:59.125 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "10/21 daemons upgraded", 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:37:59.126 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:37:59.127 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdafc078980 msgr2=0x7fdafc07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdafc078980 0x7fdafc07ae30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8007fd0 tx=0x7fdaf8009040 comp rx=0 tx=0).stop 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 msgr2=0x7fdb101128c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 0x7fdb101128c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009150 tx=0x7fdb00009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 shutdown_connections 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdafc078980 0x7fdafc07ae30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb10101d10 0x7fdb101128c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 --2- 172.21.15.62:0/1996512247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb101026b0 0x7fdb10112e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 >> 172.21.15.62:0/1996512247 conn(0x7fdb100f7860 msgr2=0x7fdb100f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:59.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 shutdown_connections 2024-05-09T06:37:59.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.147+0000 7fdb14d17700 1 -- 172.21.15.62:0/1996512247 wait complete. 2024-05-09T06:37:59.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.255+0000 7f6349d6f700 1 -- 172.21.15.62:0/3327474479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6344101d90 msgr2=0x7f6344102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:59.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.255+0000 7f6349d6f700 1 --2- 172.21.15.62:0/3327474479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6344101d90 0x7f6344102160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6334004940 tx=0x7f6334009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:59.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.255+0000 7f6349d6f700 1 -- 172.21.15.62:0/3327474479 shutdown_connections 2024-05-09T06:37:59.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.255+0000 7f6349d6f700 1 --2- 172.21.15.62:0/3327474479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63440fbd40 0x7f63440fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.255+0000 7f6349d6f700 1 --2- 172.21.15.62:0/3327474479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6344101d90 0x7f6344102160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.255+0000 7f6349d6f700 1 -- 172.21.15.62:0/3327474479 >> 172.21.15.62:0/3327474479 conn(0x7f6344071d00 msgr2=0x7f6344072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:59.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.255+0000 7f6349d6f700 1 -- 172.21.15.62:0/3327474479 shutdown_connections 2024-05-09T06:37:59.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.255+0000 7f6349d6f700 1 -- 172.21.15.62:0/3327474479 wait complete. 2024-05-09T06:37:59.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f6349d6f700 1 Processor -- start 2024-05-09T06:37:59.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f6349d6f700 1 -- start start 2024-05-09T06:37:59.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f6349d6f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63440fbd40 0x7f6344113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:59.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f6349d6f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6344101d90 0x7f63441140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f6349d6f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344114790 con 0x7f63440fbd40 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f6349d6f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634410daf0 con 0x7f6344101d90 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f63437fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63440fbd40 0x7f6344113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f63437fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63440fbd40 0x7f6344113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48104/0 (socket says 172.21.15.62:48104) 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.256+0000 7f63437fe700 1 -- 172.21.15.62:0/3149210664 learned_addr learned my addr 172.21.15.62:0/3149210664 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f6342ffd700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6344101d90 0x7f63441140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f63437fe700 1 -- 172.21.15.62:0/3149210664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6344101d90 msgr2=0x7f63441140b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f63437fe700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6344101d90 0x7f63441140b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f63437fe700 1 -- 172.21.15.62:0/3149210664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6334005040 con 0x7f63440fbd40 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f6342ffd700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6344101d90 0x7f63441140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f63437fe700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63440fbd40 0x7f6344113b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6334009150 tx=0x7f6334009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f632bfff700 1 -- 172.21.15.62:0/3149210664 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633400e040 con 0x7f63440fbd40 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f632bfff700 1 -- 172.21.15.62:0/3149210664 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f633400bbc0 con 0x7f63440fbd40 2024-05-09T06:37:59.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634410dd70 con 0x7f63440fbd40 2024-05-09T06:37:59.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f632bfff700 1 -- 172.21.15.62:0/3149210664 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633401c630 con 0x7f63440fbd40 2024-05-09T06:37:59.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.257+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634410e330 con 0x7f63440fbd40 2024-05-09T06:37:59.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.258+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63440fd430 con 0x7f63440fbd40 2024-05-09T06:37:59.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.259+0000 7f632bfff700 1 -- 172.21.15.62:0/3149210664 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f633400bd30 con 0x7f63440fbd40 2024-05-09T06:37:59.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.260+0000 7f632bfff700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f632c078980 0x7f632c07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:59.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.260+0000 7f6342ffd700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f632c078980 0x7f632c07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:59.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.260+0000 7f632bfff700 1 -- 172.21.15.62:0/3149210664 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f633409ba20 con 0x7f63440fbd40 2024-05-09T06:37:59.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.260+0000 7f6342ffd700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f632c078980 0x7f632c07ae30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f634410ecb0 tx=0x7f63380096a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:59.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.264+0000 7f632bfff700 1 -- 172.21.15.62:0/3149210664 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6334063640 con 0x7f63440fbd40 2024-05-09T06:37:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:59 smithi079 ceph-mon[82381]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:59 smithi079 ceph-mon[82381]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:59 smithi079 ceph-mon[82381]: pgmap v141: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:59 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1498383354' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:37:59 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/269377141' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:37:59.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:59 smithi062 ceph-mon[109590]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:59.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:59 smithi062 ceph-mon[109590]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:59.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:59 smithi062 ceph-mon[109590]: pgmap v141: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:59.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:59 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1498383354' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:59.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:37:59 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/269377141' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:37:59.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.570+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6344108e70 con 0x7f63440fbd40 2024-05-09T06:37:59.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.570+0000 7f632bfff700 1 -- 172.21.15.62:0/3149210664 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6334062fe0 con 0x7f63440fbd40 2024-05-09T06:37:59.551 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:37:59.551 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:37:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:37:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f632c078980 msgr2=0x7f632c07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f632c078980 0x7f632c07ae30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f634410ecb0 tx=0x7f63380096a0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63440fbd40 msgr2=0x7f6344113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63440fbd40 0x7f6344113b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6334009150 tx=0x7f6334009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 shutdown_connections 2024-05-09T06:37:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f632c078980 0x7f632c07ae30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63440fbd40 0x7f6344113b70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 --2- 172.21.15.62:0/3149210664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6344101d90 0x7f63441140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 >> 172.21.15.62:0/3149210664 conn(0x7f6344071d00 msgr2=0x7f63440fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 shutdown_connections 2024-05-09T06:37:59.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:37:59.573+0000 7f6349d6f700 1 -- 172.21.15.62:0/3149210664 wait complete. 2024-05-09T06:38:00.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:00 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:00.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:00 smithi079 ceph-mon[82381]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:00.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:00 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3149210664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:38:00.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:00 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:00.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:00 smithi062 ceph-mon[109590]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:00.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:00 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3149210664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:38:01.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:01 smithi079 ceph-mon[82381]: pgmap v142: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:01 smithi062 ceph-mon[109590]: pgmap v142: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:03.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:03 smithi079 ceph-mon[82381]: pgmap v143: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:03.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:03 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:03.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:03 smithi062 ceph-mon[109590]: pgmap v143: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:03.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:03 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:04.127 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:04 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:04.128 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:04 smithi079 ceph-mon[82381]: Upgrade: osd.4 is safe to restart 2024-05-09T06:38:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:04 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:04 smithi062 ceph-mon[109590]: Upgrade: osd.4 is safe to restart 2024-05-09T06:38:05.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:05 smithi079 ceph-mon[82381]: pgmap v144: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:05.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:05 smithi079 ceph-mon[82381]: Upgrade: Updating osd.4 2024-05-09T06:38:05.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:05.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:38:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:05.593 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:05 smithi079 ceph-mon[82381]: Deploying daemon osd.4 on smithi079 2024-05-09T06:38:05.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:05 smithi062 ceph-mon[109590]: pgmap v144: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:05.668 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:05 smithi062 ceph-mon[109590]: Upgrade: Updating osd.4 2024-05-09T06:38:05.668 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:05.668 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:38:05.668 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:05.668 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:05 smithi062 ceph-mon[109590]: Deploying daemon osd.4 on smithi079 2024-05-09T06:38:07.477 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:07 smithi079 ceph-mon[82381]: pgmap v145: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:07.477 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:07 smithi079 systemd[1]: Stopping Ceph osd.4 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:38:07.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:07 smithi062 ceph-mon[109590]: pgmap v145: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:07.842 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:07 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[47557]: 2024-05-09T06:38:07.515+0000 7f0f7ea4f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:38:07.842 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:07 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[47557]: 2024-05-09T06:38:07.515+0000 7f0f7ea4f700 -1 osd.4 80 *** Got signal Terminated *** 2024-05-09T06:38:07.842 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:07 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[47557]: 2024-05-09T06:38:07.515+0000 7f0f7ea4f700 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:38:08.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:08 smithi079 ceph-mon[82381]: osd.4 marked itself down and dead 2024-05-09T06:38:08.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:08 smithi062 ceph-mon[109590]: osd.4 marked itself down and dead 2024-05-09T06:38:08.870 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:08 smithi079 podman[95668]: 2024-05-09 06:38:08.614733722 +0000 UTC m=+1.219604794 container died 2669a808b45978e67ef8bd91ccb0d5eaa31dde779422f3962d12c3c909595afc (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=quincy-4ba5a83) 2024-05-09T06:38:09.204 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:08 smithi079 podman[95668]: 2024-05-09 06:38:08.981778305 +0000 UTC m=+1.586649370 container cleanup 2669a808b45978e67ef8bd91ccb0d5eaa31dde779422f3962d12c3c909595afc (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, maintainer=Guillaume Abrioux , RELEASE=quincy-4ba5a83, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-09T06:38:09.204 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:08 smithi079 bash[95668]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4 2024-05-09T06:38:09.522 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:09 smithi079 podman[95698]: 2024-05-09 06:38:09.224587088 +0000 UTC m=+0.605022720 container remove 2669a808b45978e67ef8bd91ccb0d5eaa31dde779422f3962d12c3c909595afc (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=quincy-4ba5a83, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-09T06:38:09.522 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:09 smithi079 ceph-mon[82381]: pgmap v146: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:09.523 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:09 smithi079 ceph-mon[82381]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:38:09.523 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:09 smithi079 ceph-mon[82381]: osdmap e81: 6 total, 5 up, 6 in 2024-05-09T06:38:09.523 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:09.523 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:09 smithi062 ceph-mon[109590]: pgmap v146: 65 pgs: 65 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:09 smithi062 ceph-mon[109590]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:38:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:09 smithi062 ceph-mon[109590]: osdmap e81: 6 total, 5 up, 6 in 2024-05-09T06:38:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:09.832 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:09 smithi079 podman[95786]: 2024-05-09 06:38:09.542480516 +0000 UTC m=+0.105398590 container create 14b67ffb1de464b1b41992e87da5870919c08828d7483b4f6df115d5f36d4146 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:38:09.833 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:09 smithi079 podman[95786]: 2024-05-09 06:38:09.454712239 +0000 UTC m=+0.017630281 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:09.833 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:09 smithi079 podman[95786]: 2024-05-09 06:38:09.778274505 +0000 UTC m=+0.341192534 container init 14b67ffb1de464b1b41992e87da5870919c08828d7483b4f6df115d5f36d4146 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:38:09.833 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:09 smithi079 podman[95786]: 2024-05-09 06:38:09.782058024 +0000 UTC m=+0.344976060 container start 14b67ffb1de464b1b41992e87da5870919c08828d7483b4f6df115d5f36d4146 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-09T06:38:09.833 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:09 smithi079 podman[95786]: 2024-05-09 06:38:09.853025654 +0000 UTC m=+0.415943697 container attach 14b67ffb1de464b1b41992e87da5870919c08828d7483b4f6df115d5f36d4146 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-09T06:38:10.092 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:10 smithi079 podman[95786]: 2024-05-09 06:38:10.073053562 +0000 UTC m=+0.635971582 container died 14b67ffb1de464b1b41992e87da5870919c08828d7483b4f6df115d5f36d4146 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-09T06:38:10.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:10 smithi079 ceph-mon[82381]: osdmap e82: 6 total, 5 up, 6 in 2024-05-09T06:38:10.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:10 smithi062 ceph-mon[109590]: osdmap e82: 6 total, 5 up, 6 in 2024-05-09T06:38:11.039 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:10 smithi079 podman[95813]: 2024-05-09 06:38:10.614679485 +0000 UTC m=+0.535807951 container remove 14b67ffb1de464b1b41992e87da5870919c08828d7483b4f6df115d5f36d4146 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-09T06:38:11.039 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:10 smithi079 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.4.service: Deactivated successfully. 2024-05-09T06:38:11.039 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:10 smithi079 systemd[1]: Stopped Ceph osd.4 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:38:11.039 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:10 smithi079 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.4.service: Consumed 1min 2.375s CPU time. 2024-05-09T06:38:11.039 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:10 smithi079 systemd[1]: Starting Ceph osd.4 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:38:11.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:11 smithi079 ceph-mon[82381]: pgmap v149: 65 pgs: 3 active+undersized, 2 active+undersized+degraded, 12 peering, 3 stale+active+clean, 45 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/216 objects degraded (1.852%) 2024-05-09T06:38:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:11 smithi079 ceph-mon[82381]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T06:38:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:11 smithi079 ceph-mon[82381]: Health check failed: Degraded data redundancy: 4/216 objects degraded (1.852%), 2 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:11.342 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 podman[95916]: 2024-05-09 06:38:10.961224251 +0000 UTC m=+0.017828974 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:11.342 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 podman[95916]: 2024-05-09 06:38:11.074329642 +0000 UTC m=+0.130934351 container create 52f0aca69ad0ff22d74555d10c7c90813e15965560989e138bf51568deb1d299 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-09T06:38:11.342 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 podman[95916]: 2024-05-09 06:38:11.293973661 +0000 UTC m=+0.350578378 container init 52f0aca69ad0ff22d74555d10c7c90813e15965560989e138bf51568deb1d299 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-09T06:38:11.342 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 podman[95916]: 2024-05-09 06:38:11.297767544 +0000 UTC m=+0.354372253 container start 52f0aca69ad0ff22d74555d10c7c90813e15965560989e138bf51568deb1d299 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:38:11.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:11 smithi062 ceph-mon[109590]: pgmap v149: 65 pgs: 3 active+undersized, 2 active+undersized+degraded, 12 peering, 3 stale+active+clean, 45 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/216 objects degraded (1.852%) 2024-05-09T06:38:11.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:11 smithi062 ceph-mon[109590]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T06:38:11.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:11 smithi062 ceph-mon[109590]: Health check failed: Degraded data redundancy: 4/216 objects degraded (1.852%), 2 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:11.758 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 podman[95916]: 2024-05-09 06:38:11.402044704 +0000 UTC m=+0.458649423 container attach 52f0aca69ad0ff22d74555d10c7c90813e15965560989e138bf51568deb1d299 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate, GIT_CLEAN=True, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:38:12.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:12.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:12.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:12.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:12.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T06:38:12.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T06:38:12.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 bash[95916]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate[95931]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-09T06:38:12.069 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:11 smithi079 podman[95916]: 2024-05-09 06:38:11.803094229 +0000 UTC m=+0.859698942 container died 52f0aca69ad0ff22d74555d10c7c90813e15965560989e138bf51568deb1d299 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-09T06:38:12.710 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:12 smithi079 podman[96066]: 2024-05-09 06:38:12.388697741 +0000 UTC m=+0.580090089 container remove 52f0aca69ad0ff22d74555d10c7c90813e15965560989e138bf51568deb1d299 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-activate, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-09T06:38:12.710 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:12 smithi079 podman[96130]: 2024-05-09 06:38:12.504577268 +0000 UTC m=+0.018002477 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:12.710 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:12 smithi079 podman[96130]: 2024-05-09 06:38:12.631244766 +0000 UTC m=+0.144669949 container create 874246927b692c1440631be3f89b0b66756bd48a83bda58214ed0026ab114505 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-09T06:38:13.092 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:12 smithi079 podman[96130]: 2024-05-09 06:38:12.850857559 +0000 UTC m=+0.364282751 container init 874246927b692c1440631be3f89b0b66756bd48a83bda58214ed0026ab114505 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-09T06:38:13.092 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:12 smithi079 podman[96130]: 2024-05-09 06:38:12.854170447 +0000 UTC m=+0.367595630 container start 874246927b692c1440631be3f89b0b66756bd48a83bda58214ed0026ab114505 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507) 2024-05-09T06:38:13.092 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:12 smithi079 ceph-osd[96148]: -- 172.21.15.79:0/4038001021 <== mon.1 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7cbba1680 con 0x55e7cbb6ac00 2024-05-09T06:38:13.092 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:12 smithi079 bash[96130]: 874246927b692c1440631be3f89b0b66756bd48a83bda58214ed0026ab114505 2024-05-09T06:38:13.092 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:12 smithi079 systemd[1]: Started Ceph osd.4 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:38:13.592 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:13 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:38:13.407+0000 7f4293ea17c0 -1 Falling back to public interface 2024-05-09T06:38:13.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:13 smithi079 ceph-mon[82381]: pgmap v150: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 12 peering, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25/216 objects degraded (11.574%) 2024-05-09T06:38:13.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:13 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:13.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:13 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:13.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:13 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:13.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:13 smithi062 ceph-mon[109590]: pgmap v150: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 12 peering, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25/216 objects degraded (11.574%) 2024-05-09T06:38:13.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:13 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:13.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:13 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:13.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:13 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:14.587 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:14 smithi079 ceph-mon[82381]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T06:38:14.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:14 smithi062 ceph-mon[109590]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T06:38:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:15 smithi079 ceph-mon[82381]: pgmap v151: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 1 peering, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:15.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:15 smithi062 ceph-mon[109590]: pgmap v151: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 1 peering, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:17.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:17 smithi079 ceph-mon[82381]: pgmap v152: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:17.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:17 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:17.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:17 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:17.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:17 smithi062 ceph-mon[109590]: pgmap v152: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:17.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:17 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:17.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:17 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:18.544 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:18.544 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:18.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:18.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:18.842 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:18 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:38:18.562+0000 7f4293ea17c0 -1 osd.4 80 log_to_monitors true 2024-05-09T06:38:19.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:19 smithi079 ceph-mon[82381]: pgmap v153: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:19.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:19 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 34/216 objects degraded (15.741%), 14 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:19.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:19 smithi079 ceph-mon[82381]: from='osd.4 [v2:172.21.15.79:6808/873796025,v1:172.21.15.79:6809/873796025]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:38:19.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:19 smithi079 ceph-mon[82381]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:38:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:19 smithi062 ceph-mon[109590]: pgmap v153: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 195 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:19 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 34/216 objects degraded (15.741%), 14 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:19 smithi062 ceph-mon[109590]: from='osd.4 [v2:172.21.15.79:6808/873796025,v1:172.21.15.79:6809/873796025]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:38:19.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:19 smithi062 ceph-mon[109590]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:38:20.592 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:38:20 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:38:20.338+0000 7f42812f0700 -1 osd.4 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:38:20.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:20 smithi079 ceph-mon[82381]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T06:38:20.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:20 smithi079 ceph-mon[82381]: osdmap e83: 6 total, 5 up, 6 in 2024-05-09T06:38:20.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:20 smithi079 ceph-mon[82381]: from='osd.4 [v2:172.21.15.79:6808/873796025,v1:172.21.15.79:6809/873796025]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:38:20.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:20 smithi079 ceph-mon[82381]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:38:20.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:20 smithi079 ceph-mon[82381]: from='osd.4 ' entity='osd.4' 2024-05-09T06:38:20.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:20 smithi062 ceph-mon[109590]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T06:38:20.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:20 smithi062 ceph-mon[109590]: osdmap e83: 6 total, 5 up, 6 in 2024-05-09T06:38:20.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:20 smithi062 ceph-mon[109590]: from='osd.4 [v2:172.21.15.79:6808/873796025,v1:172.21.15.79:6809/873796025]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:38:20.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:20 smithi062 ceph-mon[109590]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:38:20.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:20 smithi062 ceph-mon[109590]: from='osd.4 ' entity='osd.4' 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: pgmap v155: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:21.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:21.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:21.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:38:21.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:38:21.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: osd.4 [v2:172.21.15.79:6808/873796025,v1:172.21.15.79:6809/873796025] boot 2024-05-09T06:38:21.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: osdmap e84: 6 total, 6 up, 6 in 2024-05-09T06:38:21.662 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:38:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: pgmap v155: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:38:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:38:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:38:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: osd.4 [v2:172.21.15.79:6808/873796025,v1:172.21.15.79:6809/873796025] boot 2024-05-09T06:38:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: osdmap e84: 6 total, 6 up, 6 in 2024-05-09T06:38:21.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:38:22.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:22 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:38:22.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:22 smithi062 ceph-mon[109590]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-05-09T06:38:22.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:22 smithi062 ceph-mon[109590]: osdmap e85: 6 total, 6 up, 6 in 2024-05-09T06:38:22.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:22 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:38:22.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:22 smithi079 ceph-mon[82381]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-05-09T06:38:22.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:22 smithi079 ceph-mon[82381]: osdmap e85: 6 total, 6 up, 6 in 2024-05-09T06:38:23.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:23 smithi079 ceph-mon[82381]: pgmap v157: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:23.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:23 smithi062 ceph-mon[109590]: pgmap v157: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/216 objects degraded (15.741%) 2024-05-09T06:38:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:25 smithi079 ceph-mon[82381]: pgmap v159: 65 pgs: 13 active+undersized, 9 active+undersized+degraded, 43 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25/216 objects degraded (11.574%) 2024-05-09T06:38:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:25 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 25/216 objects degraded (11.574%), 9 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:25 smithi062 ceph-mon[109590]: pgmap v159: 65 pgs: 13 active+undersized, 9 active+undersized+degraded, 43 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25/216 objects degraded (11.574%) 2024-05-09T06:38:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:25 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 25/216 objects degraded (11.574%), 9 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:27.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:27 smithi079 ceph-mon[82381]: pgmap v160: 65 pgs: 4 active+undersized, 4 active+undersized+degraded, 57 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13/216 objects degraded (6.019%) 2024-05-09T06:38:27.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:27 smithi062 ceph-mon[109590]: pgmap v160: 65 pgs: 4 active+undersized, 4 active+undersized+degraded, 57 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13/216 objects degraded (6.019%) 2024-05-09T06:38:28.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:28 smithi079 ceph-mon[82381]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/216 objects degraded (6.019%), 4 pgs degraded) 2024-05-09T06:38:28.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:28 smithi062 ceph-mon[109590]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/216 objects degraded (6.019%), 4 pgs degraded) 2024-05-09T06:38:29.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:29 smithi062 ceph-mon[109590]: pgmap v161: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:29.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.693+0000 7f0c0f432700 1 -- 172.21.15.62:0/4191353086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 msgr2=0x7f0c080fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:29.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.693+0000 7f0c0f432700 1 --2- 172.21.15.62:0/4191353086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 0x7f0c080fc1b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8004940 tx=0x7f0bf8009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:29.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.693+0000 7f0c0f432700 1 -- 172.21.15.62:0/4191353086 shutdown_connections 2024-05-09T06:38:29.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.693+0000 7f0c0f432700 1 --2- 172.21.15.62:0/4191353086 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 0x7f0c080fc1b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:29.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.693+0000 7f0c0f432700 1 --2- 172.21.15.62:0/4191353086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c08101d90 0x7f0c08102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:29.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.693+0000 7f0c0f432700 1 -- 172.21.15.62:0/4191353086 >> 172.21.15.62:0/4191353086 conn(0x7f0c08071d00 msgr2=0x7f0c08072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:29.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.693+0000 7f0c0f432700 1 -- 172.21.15.62:0/4191353086 shutdown_connections 2024-05-09T06:38:29.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.694+0000 7f0c0f432700 1 -- 172.21.15.62:0/4191353086 wait complete. 2024-05-09T06:38:29.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.694+0000 7f0c0f432700 1 Processor -- start 2024-05-09T06:38:29.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.694+0000 7f0c0f432700 1 -- start start 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0f432700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 0x7f0c08102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0f432700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c08101d90 0x7f0c08103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0f432700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c081035f0 con 0x7f0c080fbd40 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0f432700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08103730 con 0x7f0c08101d90 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0d1ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 0x7f0c08102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0d1ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 0x7f0c08102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35310/0 (socket says 172.21.15.62:35310) 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0d1ce700 1 -- 172.21.15.62:0/4107949273 learned_addr learned my addr 172.21.15.62:0/4107949273 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0c9cd700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c08101d90 0x7f0c08103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0d1ce700 1 -- 172.21.15.62:0/4107949273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c08101d90 msgr2=0x7f0c08103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0d1ce700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c08101d90 0x7f0c08103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:29.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0d1ce700 1 -- 172.21.15.62:0/4107949273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8005040 con 0x7f0c080fbd40 2024-05-09T06:38:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0c9cd700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c08101d90 0x7f0c08103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:38:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0c0d1ce700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 0x7f0c08102b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400c8c0 tx=0x7f0c040044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.695+0000 7f0bfdffb700 1 -- 172.21.15.62:0/4107949273 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c0400a980 con 0x7f0c080fbd40 2024-05-09T06:38:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.696+0000 7f0bfdffb700 1 -- 172.21.15.62:0/4107949273 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c0400ce60 con 0x7f0c080fbd40 2024-05-09T06:38:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.696+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c08119eb0 con 0x7f0c080fbd40 2024-05-09T06:38:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.696+0000 7f0bfdffb700 1 -- 172.21.15.62:0/4107949273 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c040115e0 con 0x7f0c080fbd40 2024-05-09T06:38:29.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.696+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0811a330 con 0x7f0c080fbd40 2024-05-09T06:38:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.697+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c080fd430 con 0x7f0c080fbd40 2024-05-09T06:38:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.697+0000 7f0bfdffb700 1 -- 172.21.15.62:0/4107949273 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f0c04012400 con 0x7f0c080fbd40 2024-05-09T06:38:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.698+0000 7f0bfdffb700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bf4078990 0x7f0bf407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.698+0000 7f0bfdffb700 1 -- 172.21.15.62:0/4107949273 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f0c0409a8b0 con 0x7f0c080fbd40 2024-05-09T06:38:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.698+0000 7f0c0c9cd700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bf4078990 0x7f0bf407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:29.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.698+0000 7f0c0c9cd700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bf4078990 0x7f0bf407ae40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b3b0 tx=0x7f0bf8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:29.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.703+0000 7f0bfdffb700 1 -- 172.21.15.62:0/4107949273 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0c040624d0 con 0x7f0c080fbd40 2024-05-09T06:38:29.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:29 smithi079 ceph-mon[82381]: pgmap v161: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:29.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.936+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c08104210 con 0x7f0bf4078990 2024-05-09T06:38:29.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.937+0000 7f0bfdffb700 1 -- 172.21.15.62:0/4107949273 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0c08104210 con 0x7f0bf4078990 2024-05-09T06:38:29.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bf4078990 msgr2=0x7f0bf407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:29.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bf4078990 0x7f0bf407ae40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b3b0 tx=0x7f0bf8009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:29.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 msgr2=0x7f0c08102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:29.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 0x7f0c08102b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400c8c0 tx=0x7f0c040044c0 comp rx=0 tx=0).stop 2024-05-09T06:38:29.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 shutdown_connections 2024-05-09T06:38:29.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0bf4078990 0x7f0bf407ae40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:29.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c080fbd40 0x7f0c08102b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:29.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 --2- 172.21.15.62:0/4107949273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c08101d90 0x7f0c08103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:29.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 >> 172.21.15.62:0/4107949273 conn(0x7f0c08071d00 msgr2=0x7f0c080fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:29.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 shutdown_connections 2024-05-09T06:38:29.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:29.940+0000 7f0c0f432700 1 -- 172.21.15.62:0/4107949273 wait complete. 2024-05-09T06:38:29.931 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:38:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.047+0000 7fed9096b700 1 -- 172.21.15.62:0/1261366753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 msgr2=0x7fed8c0fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.047+0000 7fed9096b700 1 --2- 172.21.15.62:0/1261366753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 0x7fed8c0fbd20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed74004940 tx=0x7fed74009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.047+0000 7fed9096b700 1 -- 172.21.15.62:0/1261366753 shutdown_connections 2024-05-09T06:38:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 --2- 172.21.15.62:0/1261366753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 0x7fed8c0fbd20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 --2- 172.21.15.62:0/1261366753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c101d10 0x7fed8c1020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 -- 172.21.15.62:0/1261366753 >> 172.21.15.62:0/1261366753 conn(0x7fed8c0f7860 msgr2=0x7fed8c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 -- 172.21.15.62:0/1261366753 shutdown_connections 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 -- 172.21.15.62:0/1261366753 wait complete. 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 Processor -- start 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 -- start start 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c101d10 0x7fed8c10eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 0x7fed8c10f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c10f5d0 con 0x7fed8c1026b0 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.048+0000 7fed9096b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c10f710 con 0x7fed8c101d10 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed83fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 0x7fed8c10f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed83fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 0x7fed8c10f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35336/0 (socket says 172.21.15.62:35336) 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed83fff700 1 -- 172.21.15.62:0/634489623 learned_addr learned my addr 172.21.15.62:0/634489623 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed8a59c700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c101d10 0x7fed8c10eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed83fff700 1 -- 172.21.15.62:0/634489623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c101d10 msgr2=0x7fed8c10eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed83fff700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c101d10 0x7fed8c10eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed83fff700 1 -- 172.21.15.62:0/634489623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74005040 con 0x7fed8c1026b0 2024-05-09T06:38:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed83fff700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 0x7fed8c10f090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fed74009180 tx=0x7fed74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed82ffd700 1 -- 172.21.15.62:0/634489623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7400e040 con 0x7fed8c1026b0 2024-05-09T06:38:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c10f990 con 0x7fed8c1026b0 2024-05-09T06:38:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed82ffd700 1 -- 172.21.15.62:0/634489623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed7400bbc0 con 0x7fed8c1026b0 2024-05-09T06:38:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed82ffd700 1 -- 172.21.15.62:0/634489623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7401c3f0 con 0x7fed8c1026b0 2024-05-09T06:38:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.049+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c117ec0 con 0x7fed8c1026b0 2024-05-09T06:38:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.050+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c0fd460 con 0x7fed8c1026b0 2024-05-09T06:38:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.051+0000 7fed82ffd700 1 -- 172.21.15.62:0/634489623 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fed7400bd30 con 0x7fed8c1026b0 2024-05-09T06:38:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.051+0000 7fed82ffd700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fed78078990 0x7fed7807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.051+0000 7fed82ffd700 1 -- 172.21.15.62:0/634489623 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fed7409bae0 con 0x7fed8c1026b0 2024-05-09T06:38:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.051+0000 7fed8a59c700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fed78078990 0x7fed7807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.052+0000 7fed8a59c700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fed78078990 0x7fed7807ae40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed7c007fd0 tx=0x7fed7c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:30.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.056+0000 7fed82ffd700 1 -- 172.21.15.62:0/634489623 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fed74063700 con 0x7fed8c1026b0 2024-05-09T06:38:30.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.291+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed8c108e40 con 0x7fed78078990 2024-05-09T06:38:30.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.292+0000 7fed82ffd700 1 -- 172.21.15.62:0/634489623 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fed8c108e40 con 0x7fed78078990 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fed78078990 msgr2=0x7fed7807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fed78078990 0x7fed7807ae40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed7c007fd0 tx=0x7fed7c009040 comp rx=0 tx=0).stop 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 msgr2=0x7fed8c10f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 0x7fed8c10f090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fed74009180 tx=0x7fed74009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 shutdown_connections 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed8c101d10 0x7fed8c10eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fed78078990 0x7fed7807ae40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 --2- 172.21.15.62:0/634489623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed8c1026b0 0x7fed8c10f090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 >> 172.21.15.62:0/634489623 conn(0x7fed8c0f7860 msgr2=0x7fed8c0f8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 shutdown_connections 2024-05-09T06:38:30.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.294+0000 7fed9096b700 1 -- 172.21.15.62:0/634489623 wait complete. 2024-05-09T06:38:30.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 -- 172.21.15.62:0/1382525602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210102de0 msgr2=0x7f82101031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 --2- 172.21.15.62:0/1382525602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210102de0 0x7f82101031b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f820c004940 tx=0x7f820c009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 -- 172.21.15.62:0/1382525602 shutdown_connections 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 --2- 172.21.15.62:0/1382525602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8210103780 0x7f82100fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 --2- 172.21.15.62:0/1382525602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210102de0 0x7f82101031b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 -- 172.21.15.62:0/1382525602 >> 172.21.15.62:0/1382525602 conn(0x7f82100f8990 msgr2=0x7f82100fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 -- 172.21.15.62:0/1382525602 shutdown_connections 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 -- 172.21.15.62:0/1382525602 wait complete. 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 Processor -- start 2024-05-09T06:38:30.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 -- start start 2024-05-09T06:38:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8210102de0 0x7f8210070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210103780 0x7f82100707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.402+0000 7f821787c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8210072160 con 0x7f8210103780 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f821787c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8210070ce0 con 0x7f8210102de0 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8214e17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210103780 0x7f82100707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8214e17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210103780 0x7f82100707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35346/0 (socket says 172.21.15.62:35346) 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8214e17700 1 -- 172.21.15.62:0/780863213 learned_addr learned my addr 172.21.15.62:0/780863213 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8215618700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8210102de0 0x7f8210070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8214e17700 1 -- 172.21.15.62:0/780863213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8210102de0 msgr2=0x7f8210070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8214e17700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8210102de0 0x7f8210070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8214e17700 1 -- 172.21.15.62:0/780863213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c005040 con 0x7f8210103780 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8214e17700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210103780 0x7f82100707a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8200002a50 tx=0x7f8200004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8205ffb700 1 -- 172.21.15.62:0/780863213 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8200007cc0 con 0x7f8210103780 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f8205ffb700 1 -- 172.21.15.62:0/780863213 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f820000f040 con 0x7f8210103780 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.403+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8210070fc0 con 0x7f8210103780 2024-05-09T06:38:30.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.404+0000 7f8205ffb700 1 -- 172.21.15.62:0/780863213 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f820000d9c0 con 0x7f8210103780 2024-05-09T06:38:30.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.404+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821011a160 con 0x7f8210103780 2024-05-09T06:38:30.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.405+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82101000f0 con 0x7f8210103780 2024-05-09T06:38:30.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.405+0000 7f8205ffb700 1 -- 172.21.15.62:0/780863213 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f8200009730 con 0x7f8210103780 2024-05-09T06:38:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.406+0000 7f8205ffb700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81fc078990 0x7f81fc07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.406+0000 7f8205ffb700 1 -- 172.21.15.62:0/780863213 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f820009a430 con 0x7f8210103780 2024-05-09T06:38:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.406+0000 7f8215618700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81fc078990 0x7f81fc07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.406+0000 7f8215618700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81fc078990 0x7f81fc07ae40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f820c004f90 tx=0x7f820c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:30.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.410+0000 7f8205ffb700 1 -- 172.21.15.62:0/780863213 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8200062050 con 0x7f8210103780 2024-05-09T06:38:30.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.633+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8210071760 con 0x7f81fc078990 2024-05-09T06:38:30.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.643+0000 7f8205ffb700 1 -- 172.21.15.62:0/780863213 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8210071760 con 0x7f81fc078990 2024-05-09T06:38:30.624 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:38:30.624 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (5m) 81s ago 16m 26.3M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:38:30.624 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (3m) 81s ago 17m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:38:30.624 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (3m) 14s ago 15m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:38:30.624 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (5m) 81s ago 16m 81.0M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:38:30.624 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (11m) 81s ago 11m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (11m) 81s ago 11m 152M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (11m) 14s ago 11m 16.5M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (11m) 14s ago 11m 16.4M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (7m) 81s ago 18m 519M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (6m) 14s ago 15m 465M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (4m) 81s ago 18m 47.3M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (3m) 14s ago 15m 38.1M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (6m) 81s ago 17m 14.7M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (6m) 14s ago 15m 17.2M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (2m) 81s ago 14m 141M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (2m) 81s ago 14m 140M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (87s) 81s ago 13m 12.7M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 89acd3b9ad68 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (51s) 14s ago 13m 99.6M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 8d7a05b6e02c 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (18s) 14s ago 13m 12.7M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 874246927b69 2024-05-09T06:38:30.625 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (12m) 14s ago 12m 245M 2581M 17.2.7-933-g4ba5a836 b96134859c76 42b4e96baa8f 2024-05-09T06:38:30.626 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (5m) 81s ago 16m 65.8M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:38:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81fc078990 msgr2=0x7f81fc07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81fc078990 0x7f81fc07ae40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f820c004f90 tx=0x7f820c009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210103780 msgr2=0x7f82100707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210103780 0x7f82100707a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8200002a50 tx=0x7f8200004600 comp rx=0 tx=0).stop 2024-05-09T06:38:30.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 shutdown_connections 2024-05-09T06:38:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8210102de0 0x7f8210070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81fc078990 0x7f81fc07ae40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 --2- 172.21.15.62:0/780863213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8210103780 0x7f82100707a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.645+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 >> 172.21.15.62:0/780863213 conn(0x7f82100f8990 msgr2=0x7f8210107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.646+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 shutdown_connections 2024-05-09T06:38:30.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.646+0000 7f821787c700 1 -- 172.21.15.62:0/780863213 wait complete. 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.750+0000 7fca2389d700 1 -- 172.21.15.62:0/1319952327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 msgr2=0x7fca1c106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.750+0000 7fca2389d700 1 --2- 172.21.15.62:0/1319952327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 0x7fca1c106de0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fca0c004940 tx=0x7fca0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.750+0000 7fca2389d700 1 -- 172.21.15.62:0/1319952327 shutdown_connections 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.750+0000 7fca2389d700 1 --2- 172.21.15.62:0/1319952327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 0x7fca1c106de0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.750+0000 7fca2389d700 1 --2- 172.21.15.62:0/1319952327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca1c0fde00 0x7fca1c0fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.750+0000 7fca2389d700 1 -- 172.21.15.62:0/1319952327 >> 172.21.15.62:0/1319952327 conn(0x7fca1c0f7870 msgr2=0x7fca1c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.750+0000 7fca2389d700 1 -- 172.21.15.62:0/1319952327 shutdown_connections 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.750+0000 7fca2389d700 1 -- 172.21.15.62:0/1319952327 wait complete. 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca2389d700 1 Processor -- start 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca2389d700 1 -- start start 2024-05-09T06:38:30.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca2389d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca1c0fde00 0x7fca1c113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca2389d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 0x7fca1c113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca2389d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c114500 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca2389d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c10db00 con 0x7fca1c0fde00 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca20e38700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 0x7fca1c113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca20e38700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 0x7fca1c113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35368/0 (socket says 172.21.15.62:35368) 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca20e38700 1 -- 172.21.15.62:0/3894908736 learned_addr learned my addr 172.21.15.62:0/3894908736 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca21639700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca1c0fde00 0x7fca1c113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca20e38700 1 -- 172.21.15.62:0/3894908736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca1c0fde00 msgr2=0x7fca1c113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca20e38700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca1c0fde00 0x7fca1c113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca20e38700 1 -- 172.21.15.62:0/3894908736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c005040 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.751+0000 7fca21639700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca1c0fde00 0x7fca1c113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:38:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.752+0000 7fca20e38700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 0x7fca1c113eb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009380 tx=0x7fca0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.752+0000 7fca11ffb700 1 -- 172.21.15.62:0/3894908736 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0c00e040 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.752+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1c10dd80 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.752+0000 7fca11ffb700 1 -- 172.21.15.62:0/3894908736 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca0c009af0 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.752+0000 7fca11ffb700 1 -- 172.21.15.62:0/3894908736 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0c01c630 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.752+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c10e2c0 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.753+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1c066b30 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.754+0000 7fca11ffb700 1 -- 172.21.15.62:0/3894908736 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fca0c00bbc0 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.754+0000 7fca11ffb700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fca08078990 0x7fca0807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.754+0000 7fca11ffb700 1 -- 172.21.15.62:0/3894908736 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fca0c09ba70 con 0x7fca1c0fe7a0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.754+0000 7fca21639700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fca08078990 0x7fca0807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.755+0000 7fca21639700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fca08078990 0x7fca0807ae40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca18009fd0 tx=0x7fca18009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:30.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:30.759+0000 7fca11ffb700 1 -- 172.21.15.62:0/3894908736 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fca0c063690 con 0x7fca1c0fe7a0 2024-05-09T06:38:31.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.065+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca1c109e90 con 0x7fca1c0fe7a0 2024-05-09T06:38:31.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.066+0000 7fca11ffb700 1 -- 172.21.15.62:0/3894908736 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fca0c063030 con 0x7fca1c0fe7a0 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 5 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:38:31.047 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:38:31.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:38:31.048 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:38:31.048 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 5, 2024-05-09T06:38:31.048 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 9 2024-05-09T06:38:31.048 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:38:31.048 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:38:31.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fca08078990 msgr2=0x7fca0807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fca08078990 0x7fca0807ae40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca18009fd0 tx=0x7fca18009ee0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 msgr2=0x7fca1c113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 0x7fca1c113eb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009380 tx=0x7fca0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:31.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 shutdown_connections 2024-05-09T06:38:31.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca1c0fde00 0x7fca1c113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fca08078990 0x7fca0807ae40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 --2- 172.21.15.62:0/3894908736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca1c0fe7a0 0x7fca1c113eb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.068+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 >> 172.21.15.62:0/3894908736 conn(0x7fca1c0f7870 msgr2=0x7fca1c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:31.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.069+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 shutdown_connections 2024-05-09T06:38:31.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.069+0000 7fca2389d700 1 -- 172.21.15.62:0/3894908736 wait complete. 2024-05-09T06:38:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.174+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2837818724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb38101d00 msgr2=0x7fbb381020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.174+0000 7fbb3d1f4700 1 --2- 172.21.15.62:0/2837818724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb38101d00 0x7fbb381020d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbb28004940 tx=0x7fbb28009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.174+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2837818724 shutdown_connections 2024-05-09T06:38:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.174+0000 7fbb3d1f4700 1 --2- 172.21.15.62:0/2837818724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb381026a0 0x7fbb380fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.174+0000 7fbb3d1f4700 1 --2- 172.21.15.62:0/2837818724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb38101d00 0x7fbb381020d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.174+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2837818724 >> 172.21.15.62:0/2837818724 conn(0x7fbb380f7870 msgr2=0x7fbb380f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:31.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.174+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2837818724 shutdown_connections 2024-05-09T06:38:31.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.174+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2837818724 wait complete. 2024-05-09T06:38:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.175+0000 7fbb3d1f4700 1 Processor -- start 2024-05-09T06:38:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.175+0000 7fbb3d1f4700 1 -- start start 2024-05-09T06:38:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.175+0000 7fbb3d1f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38101d00 0x7fbb3810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.175+0000 7fbb3d1f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb381026a0 0x7fbb3810f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.175+0000 7fbb3d1f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3810f5b0 con 0x7fbb381026a0 2024-05-09T06:38:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.175+0000 7fbb3d1f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3810f6f0 con 0x7fbb38101d00 2024-05-09T06:38:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb381026a0 0x7fbb3810f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb381026a0 0x7fbb3810f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35384/0 (socket says 172.21.15.62:35384) 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3659c700 1 -- 172.21.15.62:0/2125752868 learned_addr learned my addr 172.21.15.62:0/2125752868 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb36d9d700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38101d00 0x7fbb3810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3659c700 1 -- 172.21.15.62:0/2125752868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38101d00 msgr2=0x7fbb3810eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3659c700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38101d00 0x7fbb3810eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3659c700 1 -- 172.21.15.62:0/2125752868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28005040 con 0x7fbb381026a0 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb36d9d700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38101d00 0x7fbb3810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3659c700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb381026a0 0x7fbb3810f070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000c800 tx=0x7fbb20004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb2f7fe700 1 -- 172.21.15.62:0/2125752868 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb2000a760 con 0x7fbb381026a0 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb38117ba0 con 0x7fbb381026a0 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb2f7fe700 1 -- 172.21.15.62:0/2125752868 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb2000ad90 con 0x7fbb381026a0 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb2f7fe700 1 -- 172.21.15.62:0/2125752868 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb200113a0 con 0x7fbb381026a0 2024-05-09T06:38:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.176+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3810c9a0 con 0x7fbb381026a0 2024-05-09T06:38:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.177+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb380fd450 con 0x7fbb381026a0 2024-05-09T06:38:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.178+0000 7fbb2f7fe700 1 -- 172.21.15.62:0/2125752868 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fbb20012400 con 0x7fbb381026a0 2024-05-09T06:38:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.179+0000 7fbb2f7fe700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbb2407cda0 0x7fbb2407f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.179+0000 7fbb2f7fe700 1 -- 172.21.15.62:0/2125752868 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fbb2009a7b0 con 0x7fbb381026a0 2024-05-09T06:38:31.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.179+0000 7fbb36d9d700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbb2407cda0 0x7fbb2407f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.179+0000 7fbb36d9d700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbb2407cda0 0x7fbb2407f250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb28004560 tx=0x7fbb28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:31.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.184+0000 7fbb2f7fe700 1 -- 172.21.15.62:0/2125752868 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fbb200623d0 con 0x7fbb381026a0 2024-05-09T06:38:31.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.444+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbb3810cbc0 con 0x7fbb381026a0 2024-05-09T06:38:31.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.444+0000 7fbb2f7fe700 1 -- 172.21.15.62:0/2125752868 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1872 (secure 0 0 0) 0x7fbb20061d70 con 0x7fbb381026a0 2024-05-09T06:38:31.425 INFO:teuthology.orchestra.run.smithi062.stdout:e14 2024-05-09T06:38:31.425 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:38:31.425 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:38:31.425 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:38:31.425 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:38:31.425 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 13 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:27:30.542268+0000 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:38:31.426 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14484} 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:38:31.427 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:14484} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.62:6826/2962760421,v1:172.21.15.62:6827/2962760421] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:31.428 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:38:31.428 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:38:31.428 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:38:31.428 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:38:31.428 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:31.428 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:31.428 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbb2407cda0 msgr2=0x7fbb2407f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbb2407cda0 0x7fbb2407f250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb28004560 tx=0x7fbb28009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb381026a0 msgr2=0x7fbb3810f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb381026a0 0x7fbb3810f070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000c800 tx=0x7fbb20004470 comp rx=0 tx=0).stop 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 shutdown_connections 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38101d00 0x7fbb3810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbb2407cda0 0x7fbb2407f250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 --2- 172.21.15.62:0/2125752868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb381026a0 0x7fbb3810f070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 >> 172.21.15.62:0/2125752868 conn(0x7fbb380f7870 msgr2=0x7fbb380f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 shutdown_connections 2024-05-09T06:38:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.448+0000 7fbb3d1f4700 1 -- 172.21.15.62:0/2125752868 wait complete. 2024-05-09T06:38:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:38:31.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 -- 172.21.15.62:0/741409640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 msgr2=0x7f55fc065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 --2- 172.21.15.62:0/741409640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 0x7f55fc065ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f55f0004940 tx=0x7f55f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 -- 172.21.15.62:0/741409640 shutdown_connections 2024-05-09T06:38:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 --2- 172.21.15.62:0/741409640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 0x7f55fc065ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 --2- 172.21.15.62:0/741409640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc102e50 0x7f55fc103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 -- 172.21.15.62:0/741409640 >> 172.21.15.62:0/741409640 conn(0x7f55fc071d00 msgr2=0x7f55fc072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 -- 172.21.15.62:0/741409640 shutdown_connections 2024-05-09T06:38:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 -- 172.21.15.62:0/741409640 wait complete. 2024-05-09T06:38:31.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.555+0000 7f5601b6e700 1 Processor -- start 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f5601b6e700 1 -- start start 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f5601b6e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 0x7f55fc0fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f5601b6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc102e50 0x7f55fc0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f5601b6e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0fc830 con 0x7f55fc065640 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f5601b6e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0fc970 con 0x7f55fc102e50 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f55fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 0x7f55fc0fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f55fb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 0x7f55fc0fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35404/0 (socket says 172.21.15.62:35404) 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f55fb7fe700 1 -- 172.21.15.62:0/188622965 learned_addr learned my addr 172.21.15.62:0/188622965 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f55faffd700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc102e50 0x7f55fc0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f55fb7fe700 1 -- 172.21.15.62:0/188622965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc102e50 msgr2=0x7f55fc0fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f55fb7fe700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc102e50 0x7f55fc0fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f55fb7fe700 1 -- 172.21.15.62:0/188622965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0005040 con 0x7f55fc065640 2024-05-09T06:38:31.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.556+0000 7f55fb7fe700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 0x7f55fc0fbdb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00eb40 tx=0x7f55ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:31.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.557+0000 7f55e3fff700 1 -- 172.21.15.62:0/188622965 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55ec007cc0 con 0x7f55fc065640 2024-05-09T06:38:31.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.557+0000 7f55e3fff700 1 -- 172.21.15.62:0/188622965 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55ec00f040 con 0x7f55fc065640 2024-05-09T06:38:31.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.557+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc0fcbc0 con 0x7f55fc065640 2024-05-09T06:38:31.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.557+0000 7f55e3fff700 1 -- 172.21.15.62:0/188622965 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55ec00ca10 con 0x7f55fc065640 2024-05-09T06:38:31.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.557+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc11a180 con 0x7f55fc065640 2024-05-09T06:38:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.558+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc100100 con 0x7f55fc065640 2024-05-09T06:38:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.558+0000 7f55e3fff700 1 -- 172.21.15.62:0/188622965 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f55ec00cc80 con 0x7f55fc065640 2024-05-09T06:38:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.559+0000 7f55e3fff700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f55e4078990 0x7f55e407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.559+0000 7f55e3fff700 1 -- 172.21.15.62:0/188622965 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f55ec09a2d0 con 0x7f55fc065640 2024-05-09T06:38:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.559+0000 7f55faffd700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f55e4078990 0x7f55e407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.559+0000 7f55faffd700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f55e4078990 0x7f55e407ae40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0fd6a0 tx=0x7f55f0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:31.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.564+0000 7f55e3fff700 1 -- 172.21.15.62:0/188622965 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f55ec061f20 con 0x7f55fc065640 2024-05-09T06:38:31.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:31 smithi062 ceph-mon[109590]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:31.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:31 smithi062 ceph-mon[109590]: pgmap v162: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:31.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:31 smithi062 ceph-mon[109590]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:31.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:31 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3894908736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:31.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.800+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55fc04bed0 con 0x7f55e4078990 2024-05-09T06:38:31.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.802+0000 7f55e3fff700 1 -- 172.21.15.62:0/188622965 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f55fc04bed0 con 0x7f55e4078990 2024-05-09T06:38:31.782 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:38:31.782 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "11/21 daemons upgraded", 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:38:31.783 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f55e4078990 msgr2=0x7f55e407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f55e4078990 0x7f55e407ae40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0fd6a0 tx=0x7f55f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 msgr2=0x7f55fc0fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 0x7f55fc0fbdb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00eb40 tx=0x7f55ec00b040 comp rx=0 tx=0).stop 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 shutdown_connections 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f55e4078990 0x7f55e407ae40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55fc065640 0x7f55fc0fbdb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 --2- 172.21.15.62:0/188622965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55fc102e50 0x7f55fc0fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 >> 172.21.15.62:0/188622965 conn(0x7f55fc071d00 msgr2=0x7f55fc0faf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 shutdown_connections 2024-05-09T06:38:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.804+0000 7f5601b6e700 1 -- 172.21.15.62:0/188622965 wait complete. 2024-05-09T06:38:31.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:31 smithi079 ceph-mon[82381]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:31.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:31 smithi079 ceph-mon[82381]: pgmap v162: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:31.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:31 smithi079 ceph-mon[82381]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:31.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:31 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3894908736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.910+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/1734834824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f81026b0 msgr2=0x7fa1f80fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.910+0000 7fa1fd8ca700 1 --2- 172.21.15.62:0/1734834824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f81026b0 0x7fa1f80fbd20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec004940 tx=0x7fa1ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.910+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/1734834824 shutdown_connections 2024-05-09T06:38:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.910+0000 7fa1fd8ca700 1 --2- 172.21.15.62:0/1734834824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f81026b0 0x7fa1f80fbd20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.910+0000 7fa1fd8ca700 1 --2- 172.21.15.62:0/1734834824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f8101d10 0x7fa1f81020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.910+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/1734834824 >> 172.21.15.62:0/1734834824 conn(0x7fa1f80f7820 msgr2=0x7fa1f80f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.910+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/1734834824 shutdown_connections 2024-05-09T06:38:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.910+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/1734834824 wait complete. 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1fd8ca700 1 Processor -- start 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1fd8ca700 1 -- start start 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1fd8ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f8101d10 0x7fa1f8113cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1fd8ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f81026b0 0x7fa1f8114210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1fd8ca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8114860 con 0x7fa1f8101d10 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1fd8ca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f810de40 con 0x7fa1f81026b0 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1f6ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f8101d10 0x7fa1f8113cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1f6ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f8101d10 0x7fa1f8113cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35434/0 (socket says 172.21.15.62:35434) 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1f6ffd700 1 -- 172.21.15.62:0/3361261278 learned_addr learned my addr 172.21.15.62:0/3361261278 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1f67fc700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f81026b0 0x7fa1f8114210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1f6ffd700 1 -- 172.21.15.62:0/3361261278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f81026b0 msgr2=0x7fa1f8114210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1f6ffd700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f81026b0 0x7fa1f8114210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.911+0000 7fa1f6ffd700 1 -- 172.21.15.62:0/3361261278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec005040 con 0x7fa1f8101d10 2024-05-09T06:38:31.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.912+0000 7fa1f6ffd700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f8101d10 0x7fa1f8113cd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8002a50 tx=0x7fa1e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:31.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.912+0000 7fa1df7fe700 1 -- 172.21.15.62:0/3361261278 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e8007cc0 con 0x7fa1f8101d10 2024-05-09T06:38:31.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.912+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f810e120 con 0x7fa1f8101d10 2024-05-09T06:38:31.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.912+0000 7fa1df7fe700 1 -- 172.21.15.62:0/3361261278 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1e800f040 con 0x7fa1f8101d10 2024-05-09T06:38:31.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.912+0000 7fa1df7fe700 1 -- 172.21.15.62:0/3361261278 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e8009640 con 0x7fa1f8101d10 2024-05-09T06:38:31.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.912+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f810e6e0 con 0x7fa1f8101d10 2024-05-09T06:38:31.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.913+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f80fd460 con 0x7fa1f8101d10 2024-05-09T06:38:31.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.913+0000 7fa1df7fe700 1 -- 172.21.15.62:0/3361261278 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa1e80097a0 con 0x7fa1f8101d10 2024-05-09T06:38:31.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.914+0000 7fa1df7fe700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa1e0078990 0x7fa1e007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:31.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.914+0000 7fa1f67fc700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa1e0078990 0x7fa1e007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:31.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.914+0000 7fa1df7fe700 1 -- 172.21.15.62:0/3361261278 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fa1e809a4a0 con 0x7fa1f8101d10 2024-05-09T06:38:31.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.915+0000 7fa1f67fc700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa1e0078990 0x7fa1e007ae40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b3b0 tx=0x7fa1ec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:31.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:31.919+0000 7fa1df7fe700 1 -- 172.21.15.62:0/3361261278 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa1e80620c0 con 0x7fa1f8101d10 2024-05-09T06:38:32.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.227+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa1f810f320 con 0x7fa1f8101d10 2024-05-09T06:38:32.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.227+0000 7fa1df7fe700 1 -- 172.21.15.62:0/3361261278 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa1e8061a60 con 0x7fa1f8101d10 2024-05-09T06:38:32.208 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:38:32.208 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:38:32.208 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:38:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa1e0078990 msgr2=0x7fa1e007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa1e0078990 0x7fa1e007ae40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b3b0 tx=0x7fa1ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f8101d10 msgr2=0x7fa1f8113cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f8101d10 0x7fa1f8113cd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8002a50 tx=0x7fa1e80046b0 comp rx=0 tx=0).stop 2024-05-09T06:38:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 shutdown_connections 2024-05-09T06:38:32.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa1e0078990 0x7fa1e007ae40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:32.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f8101d10 0x7fa1f8113cd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:32.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 --2- 172.21.15.62:0/3361261278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f81026b0 0x7fa1f8114210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:32.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 >> 172.21.15.62:0/3361261278 conn(0x7fa1f80f7820 msgr2=0x7fa1f8066280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:32.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 shutdown_connections 2024-05-09T06:38:32.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:38:32.230+0000 7fa1fd8ca700 1 -- 172.21.15.62:0/3361261278 wait complete. 2024-05-09T06:38:32.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:32 smithi062 ceph-mon[109590]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:32.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:32 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2125752868' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:38:32.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:32 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3361261278' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:38:32.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:32 smithi079 ceph-mon[82381]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:32.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:32 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2125752868' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:38:32.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:32 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3361261278' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:38:33.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:33 smithi062 ceph-mon[109590]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:33.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:33 smithi062 ceph-mon[109590]: pgmap v163: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:33.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:33 smithi079 ceph-mon[82381]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:33.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:33 smithi079 ceph-mon[82381]: pgmap v163: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:35.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:35 smithi079 ceph-mon[82381]: pgmap v164: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:35.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:35 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:35.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:35 smithi062 ceph-mon[109590]: pgmap v164: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:35.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:35 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:37.333 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:37 smithi079 ceph-mon[82381]: pgmap v165: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:37.333 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:37 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:38:37.333 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:37 smithi079 ceph-mon[82381]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:38:37.334 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:37 smithi079 ceph-mon[82381]: Upgrade: osd.5 is safe to restart 2024-05-09T06:38:37.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:37 smithi062 ceph-mon[109590]: pgmap v165: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:37 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:38:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:37 smithi062 ceph-mon[109590]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:38:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:37 smithi062 ceph-mon[109590]: Upgrade: osd.5 is safe to restart 2024-05-09T06:38:39.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:38 smithi079 ceph-mon[82381]: Upgrade: Updating osd.5 2024-05-09T06:38:39.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:39.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:38:39.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:39.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:38 smithi079 ceph-mon[82381]: Deploying daemon osd.5 on smithi079 2024-05-09T06:38:39.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:38 smithi079 ceph-mon[82381]: pgmap v166: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:39.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:38 smithi062 ceph-mon[109590]: Upgrade: Updating osd.5 2024-05-09T06:38:39.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:39.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:38:39.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:39.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:38 smithi062 ceph-mon[109590]: Deploying daemon osd.5 on smithi079 2024-05-09T06:38:39.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:38 smithi062 ceph-mon[109590]: pgmap v166: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:40.279 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:40 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:40.280 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:40 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:40.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:40 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:40.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:40 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:41.136 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:41 smithi079 ceph-mon[82381]: pgmap v167: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:41.137 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:40 smithi079 systemd[1]: Stopping Ceph osd.5 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:38:41.137 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:41 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[54463]: 2024-05-09T06:38:41.154+0000 7f2415b5d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:38:41.137 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:41 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[54463]: 2024-05-09T06:38:41.154+0000 7f2415b5d700 -1 osd.5 85 *** Got signal Terminated *** 2024-05-09T06:38:41.137 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:41 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[54463]: 2024-05-09T06:38:41.154+0000 7f2415b5d700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:38:41.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:41 smithi062 ceph-mon[109590]: pgmap v167: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:42.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:42 smithi079 ceph-mon[82381]: osd.5 marked itself down and dead 2024-05-09T06:38:42.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:42 smithi062 ceph-mon[109590]: osd.5 marked itself down and dead 2024-05-09T06:38:42.792 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:42 smithi079 podman[100675]: 2024-05-09 06:38:42.509287948 +0000 UTC m=+1.452115369 container died 42b4e96baa8ffc2f51fda9f2f95a94a75e3533913554682d817eb7913f928348 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=quincy-4ba5a83, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-09T06:38:43.092 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:42 smithi079 podman[100675]: 2024-05-09 06:38:42.813121951 +0000 UTC m=+1.755949367 container cleanup 42b4e96baa8ffc2f51fda9f2f95a94a75e3533913554682d817eb7913f928348 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, RELEASE=quincy-4ba5a83, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-09T06:38:43.092 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:42 smithi079 bash[100675]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5 2024-05-09T06:38:43.092 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:43 smithi079 podman[100703]: 2024-05-09 06:38:43.039329948 +0000 UTC m=+0.531221777 container remove 42b4e96baa8ffc2f51fda9f2f95a94a75e3533913554682d817eb7913f928348 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4ba5a83, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=) 2024-05-09T06:38:43.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:43 smithi079 ceph-mon[82381]: pgmap v168: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:43.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:43 smithi079 ceph-mon[82381]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:38:43.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:43 smithi079 ceph-mon[82381]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-09T06:38:43.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:43 smithi079 ceph-mon[82381]: osdmap e86: 6 total, 5 up, 6 in 2024-05-09T06:38:43.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:43 smithi062 ceph-mon[109590]: pgmap v168: 65 pgs: 65 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:43.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:43 smithi062 ceph-mon[109590]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:38:43.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:43 smithi062 ceph-mon[109590]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-09T06:38:43.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:43 smithi062 ceph-mon[109590]: osdmap e86: 6 total, 5 up, 6 in 2024-05-09T06:38:43.672 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:43 smithi079 podman[100795]: 2024-05-09 06:38:43.272866985 +0000 UTC m=+0.017841898 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:43.672 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:43 smithi079 podman[100795]: 2024-05-09 06:38:43.373558601 +0000 UTC m=+0.118533557 container create b337c7dba28187e4ddec0fbfeecfdae33da46fde927b07670b8d035e16173433 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:38:43.672 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:43 smithi079 podman[100795]: 2024-05-09 06:38:43.600838431 +0000 UTC m=+0.345813326 container init b337c7dba28187e4ddec0fbfeecfdae33da46fde927b07670b8d035e16173433 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-05-09T06:38:43.672 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:43 smithi079 podman[100795]: 2024-05-09 06:38:43.604389858 +0000 UTC m=+0.349364763 container start b337c7dba28187e4ddec0fbfeecfdae33da46fde927b07670b8d035e16173433 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:38:43.672 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:43 smithi079 podman[100795]: 2024-05-09 06:38:43.692470422 +0000 UTC m=+0.437445350 container attach b337c7dba28187e4ddec0fbfeecfdae33da46fde927b07670b8d035e16173433 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:38:44.030 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:43 smithi079 podman[100795]: 2024-05-09 06:38:43.896971121 +0000 UTC m=+0.641946017 container died b337c7dba28187e4ddec0fbfeecfdae33da46fde927b07670b8d035e16173433 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=main-720f8e9, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:44.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:44 smithi079 ceph-mon[82381]: osdmap e87: 6 total, 5 up, 6 in 2024-05-09T06:38:44.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:44 smithi062 ceph-mon[109590]: osdmap e87: 6 total, 5 up, 6 in 2024-05-09T06:38:44.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:44 smithi079 podman[100821]: 2024-05-09 06:38:44.446277549 +0000 UTC m=+0.543690937 container remove b337c7dba28187e4ddec0fbfeecfdae33da46fde927b07670b8d035e16173433 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-09T06:38:44.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:44 smithi079 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.5.service: Deactivated successfully. 2024-05-09T06:38:44.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:44 smithi079 systemd[1]: Stopped Ceph osd.5 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:38:44.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:44 smithi079 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.5.service: Consumed 1min 4.043s CPU time. 2024-05-09T06:38:44.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:44 smithi079 systemd[1]: Starting Ceph osd.5 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:38:45.179 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:45 smithi079 ceph-mon[82381]: pgmap v171: 65 pgs: 2 active+undersized, 4 active+undersized+degraded, 12 stale+active+clean, 47 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8/216 objects degraded (3.704%) 2024-05-09T06:38:45.179 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:45 smithi079 ceph-mon[82381]: Health check failed: Degraded data redundancy: 8/216 objects degraded (3.704%), 4 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:45.179 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:44 smithi079 podman[100918]: 2024-05-09 06:38:44.784686023 +0000 UTC m=+0.018400095 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:45.179 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:44 smithi079 podman[100918]: 2024-05-09 06:38:44.889771936 +0000 UTC m=+0.123486004 container create 285252db6c5a448cf0d4f5fb427b7b4a1ca880ce6f8004730c0d28c9d0943afb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-09T06:38:45.180 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 podman[100918]: 2024-05-09 06:38:45.125481691 +0000 UTC m=+0.359195764 container init 285252db6c5a448cf0d4f5fb427b7b4a1ca880ce6f8004730c0d28c9d0943afb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:45.180 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 podman[100918]: 2024-05-09 06:38:45.12945807 +0000 UTC m=+0.363172145 container start 285252db6c5a448cf0d4f5fb427b7b4a1ca880ce6f8004730c0d28c9d0943afb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T06:38:45.180 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 podman[100918]: 2024-05-09 06:38:45.199876734 +0000 UTC m=+0.433590828 container attach 285252db6c5a448cf0d4f5fb427b7b4a1ca880ce6f8004730c0d28c9d0943afb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-09T06:38:45.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:45 smithi062 ceph-mon[109590]: pgmap v171: 65 pgs: 2 active+undersized, 4 active+undersized+degraded, 12 stale+active+clean, 47 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8/216 objects degraded (3.704%) 2024-05-09T06:38:45.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:45 smithi062 ceph-mon[109590]: Health check failed: Degraded data redundancy: 8/216 objects degraded (3.704%), 4 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:45.916 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:45.916 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:45.916 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:45.917 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:45.917 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T06:38:45.917 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T06:38:45.917 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T06:38:45.917 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T06:38:45.917 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-05-09T06:38:45.917 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T06:38:45.918 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 bash[100918]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-09T06:38:45.918 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T06:38:45.918 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T06:38:45.918 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T06:38:45.918 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T06:38:45.918 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-05-09T06:38:45.919 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T06:38:45.919 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate[100933]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-09T06:38:45.919 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:45 smithi079 podman[100918]: 2024-05-09 06:38:45.638678521 +0000 UTC m=+0.872392581 container died 285252db6c5a448cf0d4f5fb427b7b4a1ca880ce6f8004730c0d28c9d0943afb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:46.493 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:46 smithi079 podman[101073]: 2024-05-09 06:38:46.195619458 +0000 UTC m=+0.551237458 container remove 285252db6c5a448cf0d4f5fb427b7b4a1ca880ce6f8004730c0d28c9d0943afb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-05-09T06:38:46.493 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:46 smithi079 podman[101138]: 2024-05-09 06:38:46.314467727 +0000 UTC m=+0.017838082 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:46.493 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:46 smithi079 podman[101138]: 2024-05-09 06:38:46.41319446 +0000 UTC m=+0.116564792 container create 486b85997c378ee7a845f2e2b8a29a2bb4feb4fe9afcad20a664eab896543a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-05-09T06:38:46.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:46 smithi079 podman[101138]: 2024-05-09 06:38:46.607171423 +0000 UTC m=+0.310541755 container init 486b85997c378ee7a845f2e2b8a29a2bb4feb4fe9afcad20a664eab896543a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:38:46.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:46 smithi079 podman[101138]: 2024-05-09 06:38:46.610553664 +0000 UTC m=+0.313924005 container start 486b85997c378ee7a845f2e2b8a29a2bb4feb4fe9afcad20a664eab896543a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:46.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:46 smithi079 ceph-osd[101157]: -- 172.21.15.79:0/2280968081 <== mon.1 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fbebfcb680 con 0x55fbebf95000 2024-05-09T06:38:46.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:46 smithi079 bash[101138]: 486b85997c378ee7a845f2e2b8a29a2bb4feb4fe9afcad20a664eab896543a5c 2024-05-09T06:38:46.842 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:46 smithi079 systemd[1]: Started Ceph osd.5 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:38:47.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:47 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:38:47.153+0000 7fb0e8ff77c0 -1 Falling back to public interface 2024-05-09T06:38:47.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:47 smithi079 ceph-mon[82381]: pgmap v172: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 3 stale+active+clean, 42 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19/216 objects degraded (8.796%) 2024-05-09T06:38:47.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:47 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:47.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:47 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:47.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:47 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:47.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:47 smithi062 ceph-mon[109590]: pgmap v172: 65 pgs: 11 active+undersized, 9 active+undersized+degraded, 3 stale+active+clean, 42 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19/216 objects degraded (8.796%) 2024-05-09T06:38:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:47 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:47 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:47.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:47 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:49.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:49 smithi079 ceph-mon[82381]: pgmap v173: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2024-05-09T06:38:49.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:49 smithi062 ceph-mon[109590]: pgmap v173: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2024-05-09T06:38:51.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:51.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:50 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:51.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:50 smithi079 ceph-mon[82381]: pgmap v174: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2024-05-09T06:38:51.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:51.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:50 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:51.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:50 smithi062 ceph-mon[109590]: pgmap v174: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2024-05-09T06:38:52.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:51 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:52.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:51 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:52.092 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:51 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:38:51.883+0000 7fb0e8ff77c0 -1 osd.5 85 log_to_monitors true 2024-05-09T06:38:52.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:51 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:52.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:51 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:53.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:52 smithi079 ceph-mon[82381]: from='osd.5 [v2:172.21.15.79:6816/1012225864,v1:172.21.15.79:6817/1012225864]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:38:53.074 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:52 smithi079 ceph-mon[82381]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:38:53.074 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:52 smithi079 ceph-mon[82381]: pgmap v175: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2024-05-09T06:38:53.074 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:38:52 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:38:52.877+0000 7fb0da44e700 -1 osd.5 85 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:38:53.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:52 smithi062 ceph-mon[109590]: from='osd.5 [v2:172.21.15.79:6816/1012225864,v1:172.21.15.79:6817/1012225864]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:38:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:52 smithi062 ceph-mon[109590]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:38:53.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:52 smithi062 ceph-mon[109590]: pgmap v175: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 195 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2024-05-09T06:38:54.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:53 smithi079 ceph-mon[82381]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T06:38:54.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:53 smithi079 ceph-mon[82381]: osdmap e88: 6 total, 5 up, 6 in 2024-05-09T06:38:54.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:53 smithi079 ceph-mon[82381]: from='osd.5 [v2:172.21.15.79:6816/1012225864,v1:172.21.15.79:6817/1012225864]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:38:54.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:53 smithi079 ceph-mon[82381]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:38:54.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:53 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 32/216 objects degraded (14.815%), 13 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:54.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:53 smithi062 ceph-mon[109590]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T06:38:54.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:53 smithi062 ceph-mon[109590]: osdmap e88: 6 total, 5 up, 6 in 2024-05-09T06:38:54.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:53 smithi062 ceph-mon[109590]: from='osd.5 [v2:172.21.15.79:6816/1012225864,v1:172.21.15.79:6817/1012225864]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:38:54.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:53 smithi062 ceph-mon[109590]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-05-09T06:38:54.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:53 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 32/216 objects degraded (14.815%), 13 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:38:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: osd.5 [v2:172.21.15.79:6816/1012225864,v1:172.21.15.79:6817/1012225864] boot 2024-05-09T06:38:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: osdmap e89: 6 total, 6 up, 6 in 2024-05-09T06:38:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:38:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: pgmap v178: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2024-05-09T06:38:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:55.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-09T06:38:55.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-09T06:38:55.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:54 smithi062 ceph-mon[109590]: osdmap e90: 6 total, 6 up, 6 in 2024-05-09T06:38:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:38:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: osd.5 [v2:172.21.15.79:6816/1012225864,v1:172.21.15.79:6817/1012225864] boot 2024-05-09T06:38:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: osdmap e89: 6 total, 6 up, 6 in 2024-05-09T06:38:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:38:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: pgmap v178: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 32/216 objects degraded (14.815%) 2024-05-09T06:38:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-09T06:38:55.344 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-09T06:38:55.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:54 smithi079 ceph-mon[82381]: osdmap e90: 6 total, 6 up, 6 in 2024-05-09T06:38:56.091 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:55 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all osd 2024-05-09T06:38:56.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:55 smithi079 ceph-mon[82381]: Upgrade: Setting require_osd_release to 19 squid 2024-05-09T06:38:56.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:55 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all osd 2024-05-09T06:38:56.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:55 smithi062 ceph-mon[109590]: Upgrade: Setting require_osd_release to 19 squid 2024-05-09T06:38:57.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:56 smithi062 ceph-mon[109590]: pgmap v180: 65 pgs: 4 peering, 15 active+undersized, 10 active+undersized+degraded, 36 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 26/216 objects degraded (12.037%) 2024-05-09T06:38:57.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:57.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.etsgzx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:38:57.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:57.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:56 smithi079 ceph-mon[82381]: pgmap v180: 65 pgs: 4 peering, 15 active+undersized, 10 active+undersized+degraded, 36 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 26/216 objects degraded (12.037%) 2024-05-09T06:38:57.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:38:57.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.etsgzx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:38:57.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:58.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:57 smithi062 ceph-mon[109590]: Upgrade: Updating mds.cephfs.smithi062.etsgzx 2024-05-09T06:38:58.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:57 smithi062 ceph-mon[109590]: Deploying daemon mds.cephfs.smithi062.etsgzx on smithi062 2024-05-09T06:38:58.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:57 smithi079 ceph-mon[82381]: Upgrade: Updating mds.cephfs.smithi062.etsgzx 2024-05-09T06:38:58.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:57 smithi079 ceph-mon[82381]: Deploying daemon mds.cephfs.smithi062.etsgzx on smithi062 2024-05-09T06:38:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[109586]: 2024-05-09T06:38:58.859+0000 7fc8d1a60700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:38:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: pgmap v181: 65 pgs: 4 peering, 2 active+undersized, 3 active+undersized+degraded, 56 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 7/216 objects degraded (3.241%) 2024-05-09T06:38:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: Health check update: Degraded data redundancy: 26/216 objects degraded (12.037%), 10 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:38:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:38:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: osdmap e91: 6 total, 6 up, 6 in 2024-05-09T06:38:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: Standby daemon mds.cephfs.smithi062.bwemju assigned to filesystem cephfs as rank 0 2024-05-09T06:38:59.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:38:59.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:38:59.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:38:58 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi062.bwemju=up:replay} 2 up:standby 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: pgmap v181: 65 pgs: 4 peering, 2 active+undersized, 3 active+undersized+degraded, 56 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 7/216 objects degraded (3.241%) 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: Health check update: Degraded data redundancy: 26/216 objects degraded (12.037%), 10 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: osdmap e91: 6 total, 6 up, 6 in 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: Standby daemon mds.cephfs.smithi062.bwemju assigned to filesystem cephfs as rank 0 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:38:59.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:38:58 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi062.bwemju=up:replay} 2 up:standby 2024-05-09T06:39:00.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:00 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:39:00.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:00 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:39:01.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:01 smithi079 ceph-mon[82381]: pgmap v183: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-05-09T06:39:01.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:01 smithi079 ceph-mon[82381]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/216 objects degraded (3.241%), 3 pgs degraded) 2024-05-09T06:39:01.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:01 smithi062 ceph-mon[109590]: pgmap v183: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-05-09T06:39:01.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:01 smithi062 ceph-mon[109590]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/216 objects degraded (3.241%), 3 pgs degraded) 2024-05-09T06:39:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.377+0000 7f18e379e700 1 -- 172.21.15.62:0/3370355124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 msgr2=0x7f18dc0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.377+0000 7f18e379e700 1 --2- 172.21.15.62:0/3370355124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 0x7f18dc0fcdf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f18cc004940 tx=0x7f18cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.377+0000 7f18e379e700 1 -- 172.21.15.62:0/3370355124 shutdown_connections 2024-05-09T06:39:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.377+0000 7f18e379e700 1 --2- 172.21.15.62:0/3370355124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 0x7f18dc0fcdf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.377+0000 7f18e379e700 1 --2- 172.21.15.62:0/3370355124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18dc102de0 0x7f18dc1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.377+0000 7f18e379e700 1 -- 172.21.15.62:0/3370355124 >> 172.21.15.62:0/3370355124 conn(0x7f18dc0f89b0 msgr2=0x7f18dc0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.378+0000 7f18e379e700 1 -- 172.21.15.62:0/3370355124 shutdown_connections 2024-05-09T06:39:02.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.378+0000 7f18e379e700 1 -- 172.21.15.62:0/3370355124 wait complete. 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.378+0000 7f18e379e700 1 Processor -- start 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.378+0000 7f18e379e700 1 -- start start 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e379e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18dc102de0 0x7f18dc070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e379e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 0x7f18dc0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e379e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc070d30 con 0x7f18dc103780 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e379e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc070e70 con 0x7f18dc102de0 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e0d39700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 0x7f18dc0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e0d39700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 0x7f18dc0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47048/0 (socket says 172.21.15.62:47048) 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e0d39700 1 -- 172.21.15.62:0/1773065466 learned_addr learned my addr 172.21.15.62:0/1773065466 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e153a700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18dc102de0 0x7f18dc070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e0d39700 1 -- 172.21.15.62:0/1773065466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18dc102de0 msgr2=0x7f18dc070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e0d39700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18dc102de0 0x7f18dc070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e0d39700 1 -- 172.21.15.62:0/1773065466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc005040 con 0x7f18dc103780 2024-05-09T06:39:02.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.379+0000 7f18e0d39700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 0x7f18dc0707a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009100 tx=0x7f18cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.380+0000 7f18d1ffb700 1 -- 172.21.15.62:0/1773065466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18cc00e040 con 0x7f18dc103780 2024-05-09T06:39:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.380+0000 7f18d1ffb700 1 -- 172.21.15.62:0/1773065466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18cc004290 con 0x7f18dc103780 2024-05-09T06:39:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.380+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc0710c0 con 0x7f18dc103780 2024-05-09T06:39:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.380+0000 7f18d1ffb700 1 -- 172.21.15.62:0/1773065466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18cc01c3f0 con 0x7f18dc103780 2024-05-09T06:39:02.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.380+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc11a2d0 con 0x7f18dc103780 2024-05-09T06:39:02.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.381+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc0fe530 con 0x7f18dc103780 2024-05-09T06:39:02.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.382+0000 7f18d1ffb700 1 -- 172.21.15.62:0/1773065466 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f18cc013690 con 0x7f18dc103780 2024-05-09T06:39:02.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.383+0000 7f18d1ffb700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f18c8078980 0x7f18c807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:02.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.383+0000 7f18d1ffb700 1 -- 172.21.15.62:0/1773065466 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f18cc09c420 con 0x7f18dc103780 2024-05-09T06:39:02.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.383+0000 7f18e153a700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f18c8078980 0x7f18c807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:02.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.383+0000 7f18e153a700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f18c8078980 0x7f18c807ae30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18d8007fd0 tx=0x7f18d8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:02.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.387+0000 7f18d1ffb700 1 -- 172.21.15.62:0/1773065466 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f18cc063fd0 con 0x7f18dc103780 2024-05-09T06:39:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.670+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18dc109f30 con 0x7f18c8078980 2024-05-09T06:39:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.671+0000 7f18d1ffb700 1 -- 172.21.15.62:0/1773065466 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f18dc109f30 con 0x7f18c8078980 2024-05-09T06:39:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.673+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f18c8078980 msgr2=0x7f18c807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.673+0000 7f18e379e700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f18c8078980 0x7f18c807ae30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18d8007fd0 tx=0x7f18d8009040 comp rx=0 tx=0).stop 2024-05-09T06:39:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.673+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 msgr2=0x7f18dc0707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.673+0000 7f18e379e700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 0x7f18dc0707a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009100 tx=0x7f18cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.674+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 shutdown_connections 2024-05-09T06:39:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.674+0000 7f18e379e700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18dc102de0 0x7f18dc070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.674+0000 7f18e379e700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f18c8078980 0x7f18c807ae30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.674+0000 7f18e379e700 1 --2- 172.21.15.62:0/1773065466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18dc103780 0x7f18dc0707a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.674+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 >> 172.21.15.62:0/1773065466 conn(0x7f18dc0f89b0 msgr2=0x7f18dc0f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.674+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 shutdown_connections 2024-05-09T06:39:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.674+0000 7f18e379e700 1 -- 172.21.15.62:0/1773065466 wait complete. 2024-05-09T06:39:02.666 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:39:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.800+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1277103436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e88101d90 msgr2=0x7f4e88102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.800+0000 7f4e8fcea700 1 --2- 172.21.15.62:0/1277103436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e88101d90 0x7f4e88102160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e84004880 tx=0x7f4e84009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.800+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1277103436 shutdown_connections 2024-05-09T06:39:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.800+0000 7f4e8fcea700 1 --2- 172.21.15.62:0/1277103436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e880fbd40 0x7f4e880fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.800+0000 7f4e8fcea700 1 --2- 172.21.15.62:0/1277103436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e88101d90 0x7f4e88102160 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.800+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1277103436 >> 172.21.15.62:0/1277103436 conn(0x7f4e88071d00 msgr2=0x7f4e88072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.800+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1277103436 shutdown_connections 2024-05-09T06:39:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.800+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1277103436 wait complete. 2024-05-09T06:39:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.801+0000 7f4e8fcea700 1 Processor -- start 2024-05-09T06:39:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.801+0000 7f4e8fcea700 1 -- start start 2024-05-09T06:39:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.801+0000 7f4e8fcea700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e880fbd40 0x7f4e88113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.801+0000 7f4e8fcea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e88101d90 0x7f4e88114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.801+0000 7f4e8fcea700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e881147a0 con 0x7f4e880fbd40 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.801+0000 7f4e8fcea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8810db90 con 0x7f4e88101d90 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.801+0000 7f4e8da86700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e880fbd40 0x7f4e88113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8da86700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e880fbd40 0x7f4e88113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47054/0 (socket says 172.21.15.62:47054) 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8da86700 1 -- 172.21.15.62:0/1410229939 learned_addr learned my addr 172.21.15.62:0/1410229939 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8d285700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e88101d90 0x7f4e88114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8da86700 1 -- 172.21.15.62:0/1410229939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e88101d90 msgr2=0x7f4e88114150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8da86700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e88101d90 0x7f4e88114150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8da86700 1 -- 172.21.15.62:0/1410229939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84005040 con 0x7f4e880fbd40 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8da86700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e880fbd40 0x7f4e88113c10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e840134a0 tx=0x7f4e84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e7e7fc700 1 -- 172.21.15.62:0/1410229939 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8400e070 con 0x7f4e880fbd40 2024-05-09T06:39:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e7e7fc700 1 -- 172.21.15.62:0/1410229939 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e84013d60 con 0x7f4e880fbd40 2024-05-09T06:39:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e7e7fc700 1 -- 172.21.15.62:0/1410229939 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e840123c0 con 0x7f4e880fbd40 2024-05-09T06:39:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8810de10 con 0x7f4e880fbd40 2024-05-09T06:39:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.802+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8810e2a0 con 0x7f4e880fbd40 2024-05-09T06:39:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.804+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e880fd430 con 0x7f4e880fbd40 2024-05-09T06:39:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.805+0000 7f4e7e7fc700 1 -- 172.21.15.62:0/1410229939 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f4e8401c400 con 0x7f4e880fbd40 2024-05-09T06:39:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.806+0000 7f4e7e7fc700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4e74078980 0x7f4e7407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.806+0000 7f4e7e7fc700 1 -- 172.21.15.62:0/1410229939 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f4e8409bd90 con 0x7f4e880fbd40 2024-05-09T06:39:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.806+0000 7f4e8d285700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4e74078980 0x7f4e7407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.806+0000 7f4e8d285700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4e74078980 0x7f4e7407ae30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4e780046c0 tx=0x7f4e7800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:02.811+0000 7f4e7e7fc700 1 -- 172.21.15.62:0/1410229939 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f4e84063960 con 0x7f4e880fbd40 2024-05-09T06:39:03.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.091+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e8804bf20 con 0x7f4e74078980 2024-05-09T06:39:03.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.093+0000 7f4e7e7fc700 1 -- 172.21.15.62:0/1410229939 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4e8804bf20 con 0x7f4e74078980 2024-05-09T06:39:03.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4e74078980 msgr2=0x7f4e7407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4e74078980 0x7f4e7407ae30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4e780046c0 tx=0x7f4e7800b040 comp rx=0 tx=0).stop 2024-05-09T06:39:03.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e880fbd40 msgr2=0x7f4e88113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e880fbd40 0x7f4e88113c10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e840134a0 tx=0x7f4e84009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:03.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 shutdown_connections 2024-05-09T06:39:03.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4e74078980 0x7f4e7407ae30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e880fbd40 0x7f4e88113c10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 --2- 172.21.15.62:0/1410229939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e88101d90 0x7f4e88114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 >> 172.21.15.62:0/1410229939 conn(0x7f4e88071d00 msgr2=0x7f4e880655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:03.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 shutdown_connections 2024-05-09T06:39:03.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.096+0000 7f4e8fcea700 1 -- 172.21.15.62:0/1410229939 wait complete. 2024-05-09T06:39:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.209+0000 7f342eaa2700 1 -- 172.21.15.62:0/4561909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428102e50 msgr2=0x7f3428103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.209+0000 7f342eaa2700 1 --2- 172.21.15.62:0/4561909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428102e50 0x7f3428103220 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f341c004940 tx=0x7f341c009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.209+0000 7f342eaa2700 1 -- 172.21.15.62:0/4561909 shutdown_connections 2024-05-09T06:39:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.209+0000 7f342eaa2700 1 --2- 172.21.15.62:0/4561909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3428065640 0x7f3428065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.209+0000 7f342eaa2700 1 --2- 172.21.15.62:0/4561909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428102e50 0x7f3428103220 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.209+0000 7f342eaa2700 1 -- 172.21.15.62:0/4561909 >> 172.21.15.62:0/4561909 conn(0x7f3428071d00 msgr2=0x7f3428072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.209+0000 7f342eaa2700 1 -- 172.21.15.62:0/4561909 shutdown_connections 2024-05-09T06:39:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.209+0000 7f342eaa2700 1 -- 172.21.15.62:0/4561909 wait complete. 2024-05-09T06:39:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.210+0000 7f342eaa2700 1 Processor -- start 2024-05-09T06:39:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.210+0000 7f342eaa2700 1 -- start start 2024-05-09T06:39:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.210+0000 7f342eaa2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428065640 0x7f34280fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.210+0000 7f342eaa2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3428102e50 0x7f34280fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.210+0000 7f342eaa2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280fc880 con 0x7f3428065640 2024-05-09T06:39:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.210+0000 7f342eaa2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280fc9c0 con 0x7f3428102e50 2024-05-09T06:39:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.210+0000 7f342c83e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428065640 0x7f34280fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f342c83e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428065640 0x7f34280fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47068/0 (socket says 172.21.15.62:47068) 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f342c83e700 1 -- 172.21.15.62:0/303428513 learned_addr learned my addr 172.21.15.62:0/303428513 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f3427fff700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3428102e50 0x7f34280fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f342c83e700 1 -- 172.21.15.62:0/303428513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3428102e50 msgr2=0x7f34280fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f342c83e700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3428102e50 0x7f34280fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f342c83e700 1 -- 172.21.15.62:0/303428513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c005040 con 0x7f3428065640 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f342c83e700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428065640 0x7f34280fbdb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f341c009150 tx=0x7f341c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f34257fa700 1 -- 172.21.15.62:0/303428513 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f341c00e040 con 0x7f3428065640 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f34257fa700 1 -- 172.21.15.62:0/303428513 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f341c013420 con 0x7f3428065640 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280fcc10 con 0x7f3428065640 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f34257fa700 1 -- 172.21.15.62:0/303428513 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f341c01c630 con 0x7f3428065640 2024-05-09T06:39:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.211+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342811a2b0 con 0x7f3428065640 2024-05-09T06:39:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.212+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3428100100 con 0x7f3428065640 2024-05-09T06:39:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.213+0000 7f34257fa700 1 -- 172.21.15.62:0/303428513 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f341c013590 con 0x7f3428065640 2024-05-09T06:39:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.214+0000 7f34257fa700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3418078980 0x7f341807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.214+0000 7f34257fa700 1 -- 172.21.15.62:0/303428513 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f341c09ba40 con 0x7f3428065640 2024-05-09T06:39:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.214+0000 7f3427fff700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3418078980 0x7f341807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.215+0000 7f3427fff700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3418078980 0x7f341807ae30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34280fd6f0 tx=0x7f3414009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:03.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.218+0000 7f34257fa700 1 -- 172.21.15.62:0/303428513 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f341c063610 con 0x7f3428065640 2024-05-09T06:39:03.228 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:03 smithi062 ceph-mon[109590]: pgmap v184: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 2 op/s 2024-05-09T06:39:03.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:03 smithi079 ceph-mon[82381]: pgmap v184: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 2 op/s 2024-05-09T06:39:03.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.468+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f342804bed0 con 0x7f3418078980 2024-05-09T06:39:03.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.478+0000 7f34257fa700 1 -- 172.21.15.62:0/303428513 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f342804bed0 con 0x7f3418078980 2024-05-09T06:39:03.459 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:39:03.459 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (6m) 114s ago 17m 26.3M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:39:03.459 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (3m) 114s ago 17m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:39:03.459 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (3m) 13s ago 16m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:39:03.459 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (5m) 114s ago 17m 81.0M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (11m) 114s ago 11m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 d4404b49fbd8 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (11m) 114s ago 11m 152M - 17.2.7-933-g4ba5a836 b96134859c76 520454450dd1 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (11m) 13s ago 11m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (11m) 13s ago 11m 16.6M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (8m) 114s ago 19m 519M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (7m) 13s ago 16m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (4m) 114s ago 19m 47.3M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (4m) 13s ago 16m 38.4M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (6m) 114s ago 17m 14.7M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (6m) 13s ago 16m 16.8M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (3m) 114s ago 15m 141M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (2m) 114s ago 14m 140M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (2m) 114s ago 14m 12.7M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 89acd3b9ad68 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (83s) 13s ago 14m 100M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 8d7a05b6e02c 2024-05-09T06:39:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (50s) 13s ago 13m 102M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 874246927b69 2024-05-09T06:39:03.461 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (17s) 13s ago 13m 14.8M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 486b85997c37 2024-05-09T06:39:03.461 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (6m) 114s ago 16m 65.8M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:39:03.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3418078980 msgr2=0x7f341807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3418078980 0x7f341807ae30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34280fd6f0 tx=0x7f3414009ee0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428065640 msgr2=0x7f34280fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428065640 0x7f34280fbdb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f341c009150 tx=0x7f341c009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 shutdown_connections 2024-05-09T06:39:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3418078980 0x7f341807ae30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3428065640 0x7f34280fbdb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 --2- 172.21.15.62:0/303428513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3428102e50 0x7f34280fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 >> 172.21.15.62:0/303428513 conn(0x7f3428071d00 msgr2=0x7f34280fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 shutdown_connections 2024-05-09T06:39:03.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.481+0000 7f342eaa2700 1 -- 172.21.15.62:0/303428513 wait complete. 2024-05-09T06:39:03.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.591+0000 7fe1836a7700 1 -- 172.21.15.62:0/1122290480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c101e20 msgr2=0x7fe17c1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.591+0000 7fe1836a7700 1 --2- 172.21.15.62:0/1122290480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c101e20 0x7fe17c1021f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe178004940 tx=0x7fe178009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 -- 172.21.15.62:0/1122290480 shutdown_connections 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 --2- 172.21.15.62:0/1122290480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe17c0fc710 0x7fe17c0fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 --2- 172.21.15.62:0/1122290480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c101e20 0x7fe17c1021f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 -- 172.21.15.62:0/1122290480 >> 172.21.15.62:0/1122290480 conn(0x7fe17c071460 msgr2=0x7fe17c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 -- 172.21.15.62:0/1122290480 shutdown_connections 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 -- 172.21.15.62:0/1122290480 wait complete. 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 Processor -- start 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 -- start start 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c0fc710 0x7fe17c0fd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.592+0000 7fe1836a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe17c101e20 0x7fe17c0fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe1836a7700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0fe440 con 0x7fe17c0fc710 2024-05-09T06:39:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe1836a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0fe580 con 0x7fe17c101e20 2024-05-09T06:39:03.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe181443700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c0fc710 0x7fe17c0fd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:03.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe181443700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c0fc710 0x7fe17c0fd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47104/0 (socket says 172.21.15.62:47104) 2024-05-09T06:39:03.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe181443700 1 -- 172.21.15.62:0/3156806404 learned_addr learned my addr 172.21.15.62:0/3156806404 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:03.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe180c42700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe17c101e20 0x7fe17c0fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:03.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe181443700 1 -- 172.21.15.62:0/3156806404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe17c101e20 msgr2=0x7fe17c0fdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe181443700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe17c101e20 0x7fe17c0fdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe181443700 1 -- 172.21.15.62:0/3156806404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178005040 con 0x7fe17c0fc710 2024-05-09T06:39:03.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.593+0000 7fe181443700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c0fc710 0x7fe17c0fd970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe17800b3b0 tx=0x7fe178009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:03.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.594+0000 7fe171ffb700 1 -- 172.21.15.62:0/3156806404 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17800e040 con 0x7fe17c0fc710 2024-05-09T06:39:03.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.594+0000 7fe171ffb700 1 -- 172.21.15.62:0/3156806404 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe17800bbc0 con 0x7fe17c0fc710 2024-05-09T06:39:03.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.594+0000 7fe171ffb700 1 -- 172.21.15.62:0/3156806404 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17801c3f0 con 0x7fe17c0fc710 2024-05-09T06:39:03.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.594+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c0fe7d0 con 0x7fe17c0fc710 2024-05-09T06:39:03.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.594+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c11a230 con 0x7fe17c0fc710 2024-05-09T06:39:03.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.595+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c0652f0 con 0x7fe17c0fc710 2024-05-09T06:39:03.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.596+0000 7fe171ffb700 1 -- 172.21.15.62:0/3156806404 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fe17800bd30 con 0x7fe17c0fc710 2024-05-09T06:39:03.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.596+0000 7fe171ffb700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe168078990 0x7fe16807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:03.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.596+0000 7fe171ffb700 1 -- 172.21.15.62:0/3156806404 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fe17809b9d0 con 0x7fe17c0fc710 2024-05-09T06:39:03.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.596+0000 7fe180c42700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe168078990 0x7fe16807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:03.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.597+0000 7fe180c42700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe168078990 0x7fe16807ae40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0ff2b0 tx=0x7fe16c009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:03.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.601+0000 7fe171ffb700 1 -- 172.21.15.62:0/3156806404 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fe1780635a0 con 0x7fe17c0fc710 2024-05-09T06:39:03.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.957+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe17c04bf60 con 0x7fe17c0fc710 2024-05-09T06:39:03.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.958+0000 7fe171ffb700 1 -- 172.21.15.62:0/3156806404 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fe178062f40 con 0x7fe17c0fc710 2024-05-09T06:39:03.938 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 3, 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:39:03.939 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 3, 2024-05-09T06:39:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 11 2024-05-09T06:39:03.940 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:39:03.940 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe168078990 msgr2=0x7fe16807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe168078990 0x7fe16807ae40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0ff2b0 tx=0x7fe16c009ee0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c0fc710 msgr2=0x7fe17c0fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c0fc710 0x7fe17c0fd970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe17800b3b0 tx=0x7fe178009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 shutdown_connections 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe168078990 0x7fe16807ae40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe17c0fc710 0x7fe17c0fd970 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 --2- 172.21.15.62:0/3156806404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe17c101e20 0x7fe17c0fdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 >> 172.21.15.62:0/3156806404 conn(0x7fe17c071460 msgr2=0x7fe17c0ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.960+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 shutdown_connections 2024-05-09T06:39:03.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:03.961+0000 7fe1836a7700 1 -- 172.21.15.62:0/3156806404 wait complete. 2024-05-09T06:39:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.093+0000 7f81c4593700 1 -- 172.21.15.62:0/954146039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 msgr2=0x7f81bc106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.093+0000 7f81c4593700 1 --2- 172.21.15.62:0/954146039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 0x7f81bc106dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f81ac004940 tx=0x7f81ac009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.093+0000 7f81c4593700 1 -- 172.21.15.62:0/954146039 shutdown_connections 2024-05-09T06:39:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.093+0000 7f81c4593700 1 --2- 172.21.15.62:0/954146039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 0x7f81bc106dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.093+0000 7f81c4593700 1 --2- 172.21.15.62:0/954146039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81bc0fdde0 0x7f81bc0fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.093+0000 7f81c4593700 1 -- 172.21.15.62:0/954146039 >> 172.21.15.62:0/954146039 conn(0x7f81bc0f7890 msgr2=0x7f81bc0f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.093+0000 7f81c4593700 1 -- 172.21.15.62:0/954146039 shutdown_connections 2024-05-09T06:39:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.093+0000 7f81c4593700 1 -- 172.21.15.62:0/954146039 wait complete. 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.094+0000 7f81c4593700 1 Processor -- start 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.094+0000 7f81c4593700 1 -- start start 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.094+0000 7f81c4593700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81bc0fdde0 0x7f81bc0fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.094+0000 7f81c4593700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 0x7f81bc0fc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.094+0000 7f81c4593700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc0fc6e0 con 0x7f81bc0fe780 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.094+0000 7f81c4593700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc0fc820 con 0x7f81bc0fdde0 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c1b2e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 0x7f81bc0fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c1b2e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 0x7f81bc0fc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59134/0 (socket says 172.21.15.62:59134) 2024-05-09T06:39:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c1b2e700 1 -- 172.21.15.62:0/473003467 learned_addr learned my addr 172.21.15.62:0/473003467 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c232f700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81bc0fdde0 0x7f81bc0fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c1b2e700 1 -- 172.21.15.62:0/473003467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81bc0fdde0 msgr2=0x7f81bc0fbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c1b2e700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81bc0fdde0 0x7f81bc0fbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c1b2e700 1 -- 172.21.15.62:0/473003467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac005040 con 0x7f81bc0fe780 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c232f700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81bc0fdde0 0x7f81bc0fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.095+0000 7f81c1b2e700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 0x7f81bc0fc150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009380 tx=0x7f81ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.096+0000 7f81b2ffd700 1 -- 172.21.15.62:0/473003467 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81ac00e040 con 0x7f81bc0fe780 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.096+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc0fca70 con 0x7f81bc0fe780 2024-05-09T06:39:04.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.096+0000 7f81b2ffd700 1 -- 172.21.15.62:0/473003467 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81ac009af0 con 0x7f81bc0fe780 2024-05-09T06:39:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.096+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc11a120 con 0x7f81bc0fe780 2024-05-09T06:39:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.097+0000 7f81b2ffd700 1 -- 172.21.15.62:0/473003467 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81ac01c630 con 0x7f81bc0fe780 2024-05-09T06:39:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.097+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a00052b0 con 0x7f81bc0fe780 2024-05-09T06:39:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.098+0000 7f81b2ffd700 1 -- 172.21.15.62:0/473003467 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f81ac013420 con 0x7f81bc0fe780 2024-05-09T06:39:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.099+0000 7f81b2ffd700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81a8078990 0x7f81a807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.099+0000 7f81c232f700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81a8078990 0x7f81a807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.099+0000 7f81b2ffd700 1 -- 172.21.15.62:0/473003467 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f81ac09ba20 con 0x7f81bc0fe780 2024-05-09T06:39:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.100+0000 7f81c232f700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81a8078990 0x7f81a807ae40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009fd0 tx=0x7f81b800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:04.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.109+0000 7f81b2ffd700 1 -- 172.21.15.62:0/473003467 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f81ac0635d0 con 0x7f81bc0fe780 2024-05-09T06:39:04.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:04 smithi079 ceph-mon[82381]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:04.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:04 smithi079 ceph-mon[82381]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:04.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:04 smithi079 ceph-mon[82381]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:04.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:04.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:04.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:04 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:04.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:04 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3156806404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:04.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:04 smithi062 ceph-mon[109590]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:04 smithi062 ceph-mon[109590]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:04 smithi062 ceph-mon[109590]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:04 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:04.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:04 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3156806404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:04.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.537+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f81a0005d70 con 0x7f81bc0fe780 2024-05-09T06:39:04.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.537+0000 7f81b2ffd700 1 -- 172.21.15.62:0/473003467 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f81ac00bbc0 con 0x7f81bc0fe780 2024-05-09T06:39:04.518 INFO:teuthology.orchestra.run.smithi062.stdout:e17 2024-05-09T06:39:04.518 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 16 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:38:58.865234+0000 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:39:04.519 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 91 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=14494} 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:39:04.520 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{0:14494} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:04.521 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{-1:34384} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:39:04.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81a8078990 msgr2=0x7f81a807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:04.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81a8078990 0x7f81a807ae40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009fd0 tx=0x7f81b800b040 comp rx=0 tx=0).stop 2024-05-09T06:39:04.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 msgr2=0x7f81bc0fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:04.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 0x7f81bc0fc150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009380 tx=0x7f81ac009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 shutdown_connections 2024-05-09T06:39:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81bc0fdde0 0x7f81bc0fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f81a8078990 0x7f81a807ae40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 --2- 172.21.15.62:0/473003467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81bc0fe780 0x7f81bc0fc150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 >> 172.21.15.62:0/473003467 conn(0x7f81bc0f7890 msgr2=0x7f81bc0f8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 shutdown_connections 2024-05-09T06:39:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.541+0000 7f81c4593700 1 -- 172.21.15.62:0/473003467 wait complete. 2024-05-09T06:39:04.523 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 17 2024-05-09T06:39:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.651+0000 7f7a5c331700 1 -- 172.21.15.62:0/1596684538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54102670 msgr2=0x7f7a540fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.651+0000 7f7a5c331700 1 --2- 172.21.15.62:0/1596684538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54102670 0x7f7a540fb600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a44004940 tx=0x7f7a44009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.651+0000 7f7a5c331700 1 -- 172.21.15.62:0/1596684538 shutdown_connections 2024-05-09T06:39:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.651+0000 7f7a5c331700 1 --2- 172.21.15.62:0/1596684538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54102670 0x7f7a540fb600 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a44004940 tx=0x7f7a44009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.651+0000 7f7a5c331700 1 --2- 172.21.15.62:0/1596684538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a54101cd0 0x7f7a541020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.652+0000 7f7a5c331700 1 -- 172.21.15.62:0/1596684538 >> 172.21.15.62:0/1596684538 conn(0x7f7a54071460 msgr2=0x7f7a54071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:04.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.652+0000 7f7a5c331700 1 -- 172.21.15.62:0/1596684538 shutdown_connections 2024-05-09T06:39:04.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.653+0000 7f7a5c331700 1 -- 172.21.15.62:0/1596684538 wait complete. 2024-05-09T06:39:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5c331700 1 Processor -- start 2024-05-09T06:39:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5c331700 1 -- start start 2024-05-09T06:39:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5c331700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54101cd0 0x7f7a54113ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5c331700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a541141e0 0x7f7a5410dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5c331700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54114760 con 0x7f7a54101cd0 2024-05-09T06:39:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5c331700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541148d0 con 0x7f7a541141e0 2024-05-09T06:39:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5a0cd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54101cd0 0x7f7a54113ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:04.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5a0cd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54101cd0 0x7f7a54113ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59150/0 (socket says 172.21.15.62:59150) 2024-05-09T06:39:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5a0cd700 1 -- 172.21.15.62:0/2723239332 learned_addr learned my addr 172.21.15.62:0/2723239332 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a598cc700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a541141e0 0x7f7a5410dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5a0cd700 1 -- 172.21.15.62:0/2723239332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a541141e0 msgr2=0x7f7a5410dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5a0cd700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a541141e0 0x7f7a5410dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a5a0cd700 1 -- 172.21.15.62:0/2723239332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44005040 con 0x7f7a54101cd0 2024-05-09T06:39:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.654+0000 7f7a598cc700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a541141e0 0x7f7a5410dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:39:04.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.655+0000 7f7a5a0cd700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54101cd0 0x7f7a54113ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a50002a80 tx=0x7f7a500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.655+0000 7f7a4affd700 1 -- 172.21.15.62:0/2723239332 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a50007cc0 con 0x7f7a54101cd0 2024-05-09T06:39:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.655+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5410e200 con 0x7f7a54101cd0 2024-05-09T06:39:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.655+0000 7f7a4affd700 1 -- 172.21.15.62:0/2723239332 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a5000f040 con 0x7f7a54101cd0 2024-05-09T06:39:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.656+0000 7f7a4affd700 1 -- 172.21.15.62:0/2723239332 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a500096f0 con 0x7f7a54101cd0 2024-05-09T06:39:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.656+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5410e7c0 con 0x7f7a54101cd0 2024-05-09T06:39:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.657+0000 7f7a4affd700 1 -- 172.21.15.62:0/2723239332 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f7a5000d690 con 0x7f7a54101cd0 2024-05-09T06:39:04.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.657+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a54065200 con 0x7f7a54101cd0 2024-05-09T06:39:04.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.658+0000 7f7a4affd700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7a40078990 0x7f7a4007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:04.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.658+0000 7f7a4affd700 1 -- 172.21.15.62:0/2723239332 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f7a50099fd0 con 0x7f7a54101cd0 2024-05-09T06:39:04.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.659+0000 7f7a598cc700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7a40078990 0x7f7a4007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:04.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.660+0000 7f7a598cc700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7a40078990 0x7f7a4007ae40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a44008000 tx=0x7f7a44009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:04.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.668+0000 7f7a4affd700 1 -- 172.21.15.62:0/2723239332 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f7a50061b20 con 0x7f7a54101cd0 2024-05-09T06:39:04.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.971+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a5410f320 con 0x7f7a40078990 2024-05-09T06:39:04.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.972+0000 7f7a4affd700 1 -- 172.21.15.62:0/2723239332 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7a5410f320 con 0x7f7a40078990 2024-05-09T06:39:04.953 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:39:04.953 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:39:04.953 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:39:04.953 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:39:04.953 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:39:04.953 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:39:04.954 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:39:04.954 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr", 2024-05-09T06:39:04.954 INFO:teuthology.orchestra.run.smithi062.stdout: "osd" 2024-05-09T06:39:04.954 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:39:04.954 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "12/21 daemons upgraded", 2024-05-09T06:39:04.954 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T06:39:04.954 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:39:04.954 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:39:04.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7a40078990 msgr2=0x7f7a4007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:04.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7a40078990 0x7f7a4007ae40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a44008000 tx=0x7f7a44009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:04.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54101cd0 msgr2=0x7f7a54113ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54101cd0 0x7f7a54113ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a50002a80 tx=0x7f7a500046b0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 shutdown_connections 2024-05-09T06:39:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7a40078990 0x7f7a4007ae40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54101cd0 0x7f7a54113ca0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 --2- 172.21.15.62:0/2723239332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a541141e0 0x7f7a5410dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 >> 172.21.15.62:0/2723239332 conn(0x7f7a54071460 msgr2=0x7f7a541009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 shutdown_connections 2024-05-09T06:39:04.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:04.975+0000 7f7a5c331700 1 -- 172.21.15.62:0/2723239332 wait complete. 2024-05-09T06:39:05.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.085+0000 7fbd75411700 1 -- 172.21.15.62:0/440690719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 msgr2=0x7fbd70065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:05.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.085+0000 7fbd75411700 1 --2- 172.21.15.62:0/440690719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 0x7fbd70065ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd64004940 tx=0x7fbd64009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:05.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.085+0000 7fbd75411700 1 -- 172.21.15.62:0/440690719 shutdown_connections 2024-05-09T06:39:05.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.085+0000 7fbd75411700 1 --2- 172.21.15.62:0/440690719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 0x7fbd70065ab0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:05.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.086+0000 7fbd75411700 1 --2- 172.21.15.62:0/440690719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd70102e50 0x7fbd70103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:05.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.086+0000 7fbd75411700 1 -- 172.21.15.62:0/440690719 >> 172.21.15.62:0/440690719 conn(0x7fbd70071d00 msgr2=0x7fbd70072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:05.067 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:05 smithi062 ceph-mon[109590]: pgmap v185: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-05-09T06:39:05.067 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:05 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] up:boot 2024-05-09T06:39:05.067 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:05 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi062.bwemju=up:replay} 3 up:standby 2024-05-09T06:39:05.067 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:39:05.067 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:05 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/473003467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:39:05.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.086+0000 7fbd75411700 1 -- 172.21.15.62:0/440690719 shutdown_connections 2024-05-09T06:39:05.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.086+0000 7fbd75411700 1 -- 172.21.15.62:0/440690719 wait complete. 2024-05-09T06:39:05.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd75411700 1 Processor -- start 2024-05-09T06:39:05.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd75411700 1 -- start start 2024-05-09T06:39:05.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd75411700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 0x7fbd70115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:05.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd75411700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd70102e50 0x7fbd701162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:05.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd75411700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd70116910 con 0x7fbd70065640 2024-05-09T06:39:05.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd75411700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7010fce0 con 0x7fbd70102e50 2024-05-09T06:39:05.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd6effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 0x7fbd70115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:05.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd6effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 0x7fbd70115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59178/0 (socket says 172.21.15.62:59178) 2024-05-09T06:39:05.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.087+0000 7fbd6effd700 1 -- 172.21.15.62:0/1823810798 learned_addr learned my addr 172.21.15.62:0/1823810798 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:05.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.088+0000 7fbd6effd700 1 -- 172.21.15.62:0/1823810798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd70102e50 msgr2=0x7fbd701162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:05.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.088+0000 7fbd6effd700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd70102e50 0x7fbd701162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:05.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.088+0000 7fbd6effd700 1 -- 172.21.15.62:0/1823810798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd64005040 con 0x7fbd70065640 2024-05-09T06:39:05.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.088+0000 7fbd6effd700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 0x7fbd70115d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd60002a50 tx=0x7fbd600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:05.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.088+0000 7fbd577fe700 1 -- 172.21.15.62:0/1823810798 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd60007cc0 con 0x7fbd70065640 2024-05-09T06:39:05.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.088+0000 7fbd577fe700 1 -- 172.21.15.62:0/1823810798 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd6000f040 con 0x7fbd70065640 2024-05-09T06:39:05.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.088+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7010ffc0 con 0x7fbd70065640 2024-05-09T06:39:05.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.089+0000 7fbd577fe700 1 -- 172.21.15.62:0/1823810798 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd60009640 con 0x7fbd70065640 2024-05-09T06:39:05.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.089+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd70110580 con 0x7fbd70065640 2024-05-09T06:39:05.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.090+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd70106960 con 0x7fbd70065640 2024-05-09T06:39:05.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.091+0000 7fbd577fe700 1 -- 172.21.15.62:0/1823810798 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fbd600097a0 con 0x7fbd70065640 2024-05-09T06:39:05.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.091+0000 7fbd577fe700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbd58078990 0x7fbd5807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:05.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.091+0000 7fbd577fe700 1 -- 172.21.15.62:0/1823810798 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fbd6009a4f0 con 0x7fbd70065640 2024-05-09T06:39:05.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.091+0000 7fbd6e7fc700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbd58078990 0x7fbd5807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:05.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.092+0000 7fbd6e7fc700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbd58078990 0x7fbd5807ae40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd64004f90 tx=0x7fbd64009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:05.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.101+0000 7fbd577fe700 1 -- 172.21.15.62:0/1823810798 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fbd600620c0 con 0x7fbd70065640 2024-05-09T06:39:05.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:05 smithi079 ceph-mon[82381]: pgmap v185: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-05-09T06:39:05.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:05 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] up:boot 2024-05-09T06:39:05.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:05 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi062.bwemju=up:replay} 3 up:standby 2024-05-09T06:39:05.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:39:05.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:05 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/473003467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:39:05.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.462+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbd70109f00 con 0x7fbd70065640 2024-05-09T06:39:05.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.462+0000 7fbd577fe700 1 -- 172.21.15.62:0/1823810798 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7fbd60061a60 con 0x7fbd70065640 2024-05-09T06:39:05.443 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-05-09T06:39:05.443 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-05-09T06:39:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs is degraded 2024-05-09T06:39:05.443 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:39:05.444 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:39:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbd58078990 msgr2=0x7fbd5807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbd58078990 0x7fbd5807ae40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd64004f90 tx=0x7fbd64009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 msgr2=0x7fbd70115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 0x7fbd70115d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd60002a50 tx=0x7fbd600046b0 comp rx=0 tx=0).stop 2024-05-09T06:39:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 shutdown_connections 2024-05-09T06:39:05.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbd58078990 0x7fbd5807ae40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70065640 0x7fbd70115d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 --2- 172.21.15.62:0/1823810798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd70102e50 0x7fbd701162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 >> 172.21.15.62:0/1823810798 conn(0x7fbd70071d00 msgr2=0x7fbd700fae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 shutdown_connections 2024-05-09T06:39:05.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:05.466+0000 7fbd75411700 1 -- 172.21.15.62:0/1823810798 wait complete. 2024-05-09T06:39:06.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:06 smithi079 ceph-mon[82381]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:06.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:06 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1823810798' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:39:06.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:06 smithi062 ceph-mon[109590]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:06.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:06 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1823810798' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:39:07.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:07 smithi079 ceph-mon[82381]: pgmap v186: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T06:39:07.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:07 smithi062 ceph-mon[109590]: pgmap v186: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T06:39:09.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:09 smithi079 ceph-mon[82381]: pgmap v187: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-09T06:39:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:09.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:09.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:09 smithi062 ceph-mon[109590]: pgmap v187: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-09T06:39:09.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:09.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:10.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:10 smithi079 ceph-mon[82381]: reconnect by client.14526 v1:192.168.0.1:0/2072281023 after 0 2024-05-09T06:39:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:10 smithi079 ceph-mon[82381]: reconnect by client.14532 v1:172.21.15.79:0/875005746 after 0.000999983 2024-05-09T06:39:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:10 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:reconnect 2024-05-09T06:39:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:10 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi062.bwemju=up:reconnect} 3 up:standby 2024-05-09T06:39:10.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:10 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:10.370 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:10 smithi062 ceph-mon[109590]: reconnect by client.14526 v1:192.168.0.1:0/2072281023 after 0 2024-05-09T06:39:10.370 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:10 smithi062 ceph-mon[109590]: reconnect by client.14532 v1:172.21.15.79:0/875005746 after 0.000999983 2024-05-09T06:39:10.370 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:10 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:reconnect 2024-05-09T06:39:10.370 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:10 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi062.bwemju=up:reconnect} 3 up:standby 2024-05-09T06:39:10.370 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:10 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:11.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:11 smithi079 ceph-mon[82381]: pgmap v188: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:39:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:11 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:rejoin 2024-05-09T06:39:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:11 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi062.bwemju=up:rejoin} 3 up:standby 2024-05-09T06:39:11.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:11 smithi079 ceph-mon[82381]: daemon mds.cephfs.smithi062.bwemju is now active in filesystem cephfs as rank 0 2024-05-09T06:39:11.372 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:11 smithi062 ceph-mon[109590]: pgmap v188: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:39:11.373 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:11 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:rejoin 2024-05-09T06:39:11.373 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:11 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi062.bwemju=up:rejoin} 3 up:standby 2024-05-09T06:39:11.373 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:11 smithi062 ceph-mon[109590]: daemon mds.cephfs.smithi062.bwemju is now active in filesystem cephfs as rank 0 2024-05-09T06:39:12.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:12 smithi062 ceph-mon[109590]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:39:12.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:12 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:active 2024-05-09T06:39:12.187 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:12 smithi062 ceph-mon[109590]: fsmap cephfs:1 {0=cephfs.smithi062.bwemju=up:active} 3 up:standby 2024-05-09T06:39:12.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:12 smithi079 ceph-mon[82381]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:39:12.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:12 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.62:6828/490880971,v1:172.21.15.62:6829/490880971] up:active 2024-05-09T06:39:12.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:12 smithi079 ceph-mon[82381]: fsmap cephfs:1 {0=cephfs.smithi062.bwemju=up:active} 3 up:standby 2024-05-09T06:39:13.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:13 smithi079 ceph-mon[82381]: pgmap v189: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 85 B/s wr, 4 op/s 2024-05-09T06:39:13.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:13 smithi062 ceph-mon[109590]: pgmap v189: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 85 B/s wr, 4 op/s 2024-05-09T06:39:14.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:14 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:14.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:14 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:14.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:14 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:14.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:14 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:15 smithi079 ceph-mon[82381]: pgmap v190: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T06:39:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:15.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:15 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:15.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:15 smithi062 ceph-mon[109590]: pgmap v190: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T06:39:15.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:15.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:15 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:17.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:17 smithi062 ceph-mon[109590]: pgmap v191: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T06:39:17.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:17 smithi079 ceph-mon[82381]: pgmap v191: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T06:39:18.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:18.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:18.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:18.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:18.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:18.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:18.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:18.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:18.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:18.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:18.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:18 smithi062 ceph-mon[109590]: pgmap v192: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:19.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:18 smithi079 ceph-mon[82381]: pgmap v192: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T06:39:20.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:20 smithi062 ceph-mon[109590]: Upgrade: Updating mds.cephfs.smithi062.bwemju 2024-05-09T06:39:20.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:20 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:20.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:20 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.bwemju", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:39:20.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:20 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:20.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:20 smithi062 ceph-mon[109590]: Deploying daemon mds.cephfs.smithi062.bwemju on smithi062 2024-05-09T06:39:20.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:20 smithi062 ceph-mon[109590]: pgmap v193: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:39:21.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:20 smithi079 ceph-mon[82381]: Upgrade: Updating mds.cephfs.smithi062.bwemju 2024-05-09T06:39:21.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:20 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:21.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:20 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi062.bwemju", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:39:21.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:20 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:21.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:20 smithi079 ceph-mon[82381]: Deploying daemon mds.cephfs.smithi062.bwemju on smithi062 2024-05-09T06:39:21.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:20 smithi079 ceph-mon[82381]: pgmap v193: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:39:22.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:21 smithi079 ceph-mon[82381]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:39:22.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:21 smithi079 ceph-mon[82381]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:39:22.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:21 smithi079 ceph-mon[82381]: osdmap e92: 6 total, 6 up, 6 in 2024-05-09T06:39:22.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:21 smithi079 ceph-mon[82381]: Standby daemon mds.cephfs.smithi079.qwqgdo assigned to filesystem cephfs as rank 0 2024-05-09T06:39:22.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:21 smithi079 ceph-mon[82381]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:39:22.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:21 smithi079 ceph-mon[82381]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:39:22.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:21 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi079.qwqgdo=up:replay} 2 up:standby 2024-05-09T06:39:22.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:21 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[109586]: 2024-05-09T06:39:21.944+0000 7fc8d1a60700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:39:22.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:21 smithi062 ceph-mon[109590]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:39:22.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:21 smithi062 ceph-mon[109590]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:39:22.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:21 smithi062 ceph-mon[109590]: osdmap e92: 6 total, 6 up, 6 in 2024-05-09T06:39:22.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:21 smithi062 ceph-mon[109590]: Standby daemon mds.cephfs.smithi079.qwqgdo assigned to filesystem cephfs as rank 0 2024-05-09T06:39:22.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:21 smithi062 ceph-mon[109590]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:39:22.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:21 smithi062 ceph-mon[109590]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:39:22.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:21 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi079.qwqgdo=up:replay} 2 up:standby 2024-05-09T06:39:23.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:23 smithi079 ceph-mon[82381]: pgmap v195: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-05-09T06:39:23.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:23 smithi062 ceph-mon[109590]: pgmap v195: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-05-09T06:39:24.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:24.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:25.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:25 smithi079 ceph-mon[82381]: pgmap v196: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-05-09T06:39:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:39:25.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:25 smithi062 ceph-mon[109590]: pgmap v196: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-05-09T06:39:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:39:27.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:27 smithi079 ceph-mon[82381]: pgmap v197: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-05-09T06:39:27.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:27 smithi062 ceph-mon[109590]: pgmap v197: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-05-09T06:39:29.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:29 smithi079 ceph-mon[82381]: pgmap v198: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 0 B/s wr, 4 op/s 2024-05-09T06:39:29.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:29 smithi062 ceph-mon[109590]: pgmap v198: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 0 B/s wr, 4 op/s 2024-05-09T06:39:31.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:31 smithi079 ceph-mon[82381]: pgmap v199: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:39:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:31 smithi079 ceph-mon[82381]: reconnect by client.14532 v1:172.21.15.79:0/875005746 after 0 2024-05-09T06:39:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:31 smithi079 ceph-mon[82381]: reconnect by client.14526 v1:192.168.0.1:0/2072281023 after 0 2024-05-09T06:39:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:31 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:reconnect 2024-05-09T06:39:31.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:31 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi079.qwqgdo=up:reconnect} 2 up:standby 2024-05-09T06:39:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:31 smithi062 ceph-mon[109590]: pgmap v199: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:39:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:31 smithi062 ceph-mon[109590]: reconnect by client.14532 v1:172.21.15.79:0/875005746 after 0 2024-05-09T06:39:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:31 smithi062 ceph-mon[109590]: reconnect by client.14526 v1:192.168.0.1:0/2072281023 after 0 2024-05-09T06:39:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:31 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:reconnect 2024-05-09T06:39:31.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:31 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi079.qwqgdo=up:reconnect} 2 up:standby 2024-05-09T06:39:32.307 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:32 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:rejoin 2024-05-09T06:39:32.308 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:32 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi079.qwqgdo=up:rejoin} 2 up:standby 2024-05-09T06:39:32.308 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:32 smithi062 ceph-mon[109590]: daemon mds.cephfs.smithi079.qwqgdo is now active in filesystem cephfs as rank 0 2024-05-09T06:39:32.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:32 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:rejoin 2024-05-09T06:39:32.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:32 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi079.qwqgdo=up:rejoin} 2 up:standby 2024-05-09T06:39:32.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:32 smithi079 ceph-mon[82381]: daemon mds.cephfs.smithi079.qwqgdo is now active in filesystem cephfs as rank 0 2024-05-09T06:39:33.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:33 smithi079 ceph-mon[82381]: pgmap v200: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-05-09T06:39:33.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:33 smithi079 ceph-mon[82381]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:39:33.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:33 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:active 2024-05-09T06:39:33.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:33 smithi079 ceph-mon[82381]: fsmap cephfs:1 {0=cephfs.smithi079.qwqgdo=up:active} 2 up:standby 2024-05-09T06:39:33.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:33 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:33.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:33 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:33.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:33 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:33 smithi062 ceph-mon[109590]: pgmap v200: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-05-09T06:39:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:33 smithi062 ceph-mon[109590]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:39:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:33 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] up:active 2024-05-09T06:39:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:33 smithi062 ceph-mon[109590]: fsmap cephfs:1 {0=cephfs.smithi079.qwqgdo=up:active} 2 up:standby 2024-05-09T06:39:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:33 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:33 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:33.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:33 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:34.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:34 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.62:6828/2587505211,v1:172.21.15.62:6829/2587505211] up:boot 2024-05-09T06:39:34.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:34 smithi062 ceph-mon[109590]: fsmap cephfs:1 {0=cephfs.smithi079.qwqgdo=up:active} 3 up:standby 2024-05-09T06:39:34.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:34 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:39:34.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:34 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.62:6828/2587505211,v1:172.21.15.62:6829/2587505211] up:boot 2024-05-09T06:39:34.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:34 smithi079 ceph-mon[82381]: fsmap cephfs:1 {0=cephfs.smithi079.qwqgdo=up:active} 3 up:standby 2024-05-09T06:39:34.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:34 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:39:35.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:35 smithi079 ceph-mon[82381]: pgmap v201: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T06:39:35.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:35 smithi062 ceph-mon[109590]: pgmap v201: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T06:39:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.581+0000 7f915a81c700 1 -- 172.21.15.62:0/3067861993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154103790 msgr2=0x7f91540fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.581+0000 7f915a81c700 1 --2- 172.21.15.62:0/3067861993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154103790 0x7f91540fce00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9148004940 tx=0x7f9148009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.581+0000 7f915a81c700 1 -- 172.21.15.62:0/3067861993 shutdown_connections 2024-05-09T06:39:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.581+0000 7f915a81c700 1 --2- 172.21.15.62:0/3067861993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154103790 0x7f91540fce00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.581+0000 7f915a81c700 1 --2- 172.21.15.62:0/3067861993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9154102df0 0x7f91541031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.581+0000 7f915a81c700 1 -- 172.21.15.62:0/3067861993 >> 172.21.15.62:0/3067861993 conn(0x7f91540f8980 msgr2=0x7f91540fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.581+0000 7f915a81c700 1 -- 172.21.15.62:0/3067861993 shutdown_connections 2024-05-09T06:39:35.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.581+0000 7f915a81c700 1 -- 172.21.15.62:0/3067861993 wait complete. 2024-05-09T06:39:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.582+0000 7f915a81c700 1 Processor -- start 2024-05-09T06:39:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.582+0000 7f915a81c700 1 -- start start 2024-05-09T06:39:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.582+0000 7f915a81c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154102df0 0x7f9154113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.582+0000 7f915a81c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9154103790 0x7f91541140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.582+0000 7f915a81c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9154114710 con 0x7f9154102df0 2024-05-09T06:39:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.582+0000 7f915a81c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915410db00 con 0x7f9154103790 2024-05-09T06:39:35.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9153fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154102df0 0x7f9154113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9153fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154102df0 0x7f9154113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47314/0 (socket says 172.21.15.62:47314) 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9153fff700 1 -- 172.21.15.62:0/373876723 learned_addr learned my addr 172.21.15.62:0/373876723 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f91537fe700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9154103790 0x7f91541140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9153fff700 1 -- 172.21.15.62:0/373876723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9154103790 msgr2=0x7f91541140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9153fff700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9154103790 0x7f91541140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9153fff700 1 -- 172.21.15.62:0/373876723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9148005040 con 0x7f9154102df0 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9153fff700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154102df0 0x7f9154113b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9144002a50 tx=0x7f91440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9150ff9700 1 -- 172.21.15.62:0/373876723 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9144007cc0 con 0x7f9154102df0 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9150ff9700 1 -- 172.21.15.62:0/373876723 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f914400f040 con 0x7f9154102df0 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915410dde0 con 0x7f9154102df0 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f9150ff9700 1 -- 172.21.15.62:0/373876723 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9144009640 con 0x7f9154102df0 2024-05-09T06:39:35.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.583+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915410e3a0 con 0x7f9154102df0 2024-05-09T06:39:35.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.584+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91540fe540 con 0x7f9154102df0 2024-05-09T06:39:35.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.585+0000 7f9150ff9700 1 -- 172.21.15.62:0/373876723 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f91440097a0 con 0x7f9154102df0 2024-05-09T06:39:35.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.586+0000 7f9150ff9700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f913c078990 0x7f913c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:35.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.586+0000 7f9150ff9700 1 -- 172.21.15.62:0/373876723 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f914409a650 con 0x7f9154102df0 2024-05-09T06:39:35.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.586+0000 7f91537fe700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f913c078990 0x7f913c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:35.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.586+0000 7f91537fe700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f913c078990 0x7f913c07ae40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9148009fd0 tx=0x7f9148009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:35.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.590+0000 7f9150ff9700 1 -- 172.21.15.62:0/373876723 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f9144062140 con 0x7f9154102df0 2024-05-09T06:39:35.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.834+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9154109f40 con 0x7f913c078990 2024-05-09T06:39:35.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.835+0000 7f9150ff9700 1 -- 172.21.15.62:0/373876723 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9154109f40 con 0x7f913c078990 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f913c078990 msgr2=0x7f913c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f913c078990 0x7f913c07ae40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9148009fd0 tx=0x7f9148009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154102df0 msgr2=0x7f9154113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154102df0 0x7f9154113b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9144002a50 tx=0x7f91440046b0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 shutdown_connections 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f913c078990 0x7f913c07ae40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9154102df0 0x7f9154113b80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 --2- 172.21.15.62:0/373876723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9154103790 0x7f91541140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.837+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 >> 172.21.15.62:0/373876723 conn(0x7f91540f8980 msgr2=0x7f91540f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:35.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.838+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 shutdown_connections 2024-05-09T06:39:35.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.838+0000 7f915a81c700 1 -- 172.21.15.62:0/373876723 wait complete. 2024-05-09T06:39:35.828 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:39:35.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.946+0000 7fb2a3877700 1 -- 172.21.15.62:0/2767842694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 msgr2=0x7fb29c0fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.946+0000 7fb2a3877700 1 --2- 172.21.15.62:0/2767842694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 0x7fb29c0fbcf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb28c004940 tx=0x7fb28c009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.946+0000 7fb2a3877700 1 -- 172.21.15.62:0/2767842694 shutdown_connections 2024-05-09T06:39:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.946+0000 7fb2a3877700 1 --2- 172.21.15.62:0/2767842694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 0x7fb29c0fbcf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.946+0000 7fb2a3877700 1 --2- 172.21.15.62:0/2767842694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c101ce0 0x7fb29c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.946+0000 7fb2a3877700 1 -- 172.21.15.62:0/2767842694 >> 172.21.15.62:0/2767842694 conn(0x7fb29c0f7850 msgr2=0x7fb29c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.946+0000 7fb2a3877700 1 -- 172.21.15.62:0/2767842694 shutdown_connections 2024-05-09T06:39:35.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.946+0000 7fb2a3877700 1 -- 172.21.15.62:0/2767842694 wait complete. 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a3877700 1 Processor -- start 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a3877700 1 -- start start 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a3877700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c101ce0 0x7fb29c10ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a3877700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 0x7fb29c10f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a3877700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c10f6b0 con 0x7fb29c102680 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a3877700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c10f7f0 con 0x7fb29c101ce0 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a0e12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 0x7fb29c10f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a0e12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 0x7fb29c10f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47318/0 (socket says 172.21.15.62:47318) 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a0e12700 1 -- 172.21.15.62:0/4175707626 learned_addr learned my addr 172.21.15.62:0/4175707626 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.947+0000 7fb2a1613700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c101ce0 0x7fb29c10ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb2a0e12700 1 -- 172.21.15.62:0/4175707626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c101ce0 msgr2=0x7fb29c10ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:35.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb2a0e12700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c101ce0 0x7fb29c10ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb2a0e12700 1 -- 172.21.15.62:0/4175707626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c005040 con 0x7fb29c102680 2024-05-09T06:39:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb2a0e12700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 0x7fb29c10f170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb28c000c00 tx=0x7fb28c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb291ffb700 1 -- 172.21.15.62:0/4175707626 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb28c021070 con 0x7fb29c102680 2024-05-09T06:39:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c117ae0 con 0x7fb29c102680 2024-05-09T06:39:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb291ffb700 1 -- 172.21.15.62:0/4175707626 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb28c013cd0 con 0x7fb29c102680 2024-05-09T06:39:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb291ffb700 1 -- 172.21.15.62:0/4175707626 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb28c00e070 con 0x7fb29c102680 2024-05-09T06:39:35.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.948+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c117f90 con 0x7fb29c102680 2024-05-09T06:39:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.950+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c0fd430 con 0x7fb29c102680 2024-05-09T06:39:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.950+0000 7fb291ffb700 1 -- 172.21.15.62:0/4175707626 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fb28c00b720 con 0x7fb29c102680 2024-05-09T06:39:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.951+0000 7fb291ffb700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb288078990 0x7fb28807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.951+0000 7fb291ffb700 1 -- 172.21.15.62:0/4175707626 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7fb28c09bc50 con 0x7fb29c102680 2024-05-09T06:39:35.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.951+0000 7fb2a1613700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb288078990 0x7fb28807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:35.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.951+0000 7fb2a1613700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb288078990 0x7fb28807ae40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb298004600 tx=0x7fb29800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:35.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:35.956+0000 7fb291ffb700 1 -- 172.21.15.62:0/4175707626 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fb28c063860 con 0x7fb29c102680 2024-05-09T06:39:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.208+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb29c108e30 con 0x7fb288078990 2024-05-09T06:39:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.209+0000 7fb291ffb700 1 -- 172.21.15.62:0/4175707626 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb29c108e30 con 0x7fb288078990 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb288078990 msgr2=0x7fb28807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb288078990 0x7fb28807ae40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb298004600 tx=0x7fb29800b040 comp rx=0 tx=0).stop 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 msgr2=0x7fb29c10f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 0x7fb29c10f170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb28c000c00 tx=0x7fb28c009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 shutdown_connections 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb29c101ce0 0x7fb29c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb288078990 0x7fb28807ae40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 --2- 172.21.15.62:0/4175707626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb29c102680 0x7fb29c10f170 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 >> 172.21.15.62:0/4175707626 conn(0x7fb29c0f7850 msgr2=0x7fb29c0f87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 shutdown_connections 2024-05-09T06:39:36.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.212+0000 7fb2a3877700 1 -- 172.21.15.62:0/4175707626 wait complete. 2024-05-09T06:39:36.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.317+0000 7f027d771700 1 -- 172.21.15.62:0/2053169551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 msgr2=0x7f0278103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:36.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.317+0000 7f027d771700 1 --2- 172.21.15.62:0/2053169551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 0x7f0278103330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0268004940 tx=0x7f0268009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:36.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.318+0000 7f027d771700 1 -- 172.21.15.62:0/2053169551 shutdown_connections 2024-05-09T06:39:36.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.318+0000 7f027d771700 1 --2- 172.21.15.62:0/2053169551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02780fb520 0x7f02780fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.318+0000 7f027d771700 1 --2- 172.21.15.62:0/2053169551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 0x7f0278103330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.318+0000 7f027d771700 1 -- 172.21.15.62:0/2053169551 >> 172.21.15.62:0/2053169551 conn(0x7f02780714d0 msgr2=0x7f02780718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:36.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.318+0000 7f027d771700 1 -- 172.21.15.62:0/2053169551 shutdown_connections 2024-05-09T06:39:36.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.318+0000 7f027d771700 1 -- 172.21.15.62:0/2053169551 wait complete. 2024-05-09T06:39:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.318+0000 7f027d771700 1 Processor -- start 2024-05-09T06:39:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f027d771700 1 -- start start 2024-05-09T06:39:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f027d771700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02780fb520 0x7f0278113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f027d771700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 0x7f0278113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f027d771700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0278114520 con 0x7f0278102f60 2024-05-09T06:39:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f027d771700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027810db40 con 0x7f02780fb520 2024-05-09T06:39:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f02767fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 0x7f0278113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f02767fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 0x7f0278113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47340/0 (socket says 172.21.15.62:47340) 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f02767fc700 1 -- 172.21.15.62:0/3373170199 learned_addr learned my addr 172.21.15.62:0/3373170199 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f0276ffd700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02780fb520 0x7f0278113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f02767fc700 1 -- 172.21.15.62:0/3373170199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02780fb520 msgr2=0x7f0278113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f02767fc700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02780fb520 0x7f0278113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f02767fc700 1 -- 172.21.15.62:0/3373170199 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268005040 con 0x7f0278102f60 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.319+0000 7f02767fc700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 0x7f0278113ed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f026c002a50 tx=0x7f026c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.320+0000 7f025f7fe700 1 -- 172.21.15.62:0/3373170199 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f026c007cc0 con 0x7f0278102f60 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.320+0000 7f025f7fe700 1 -- 172.21.15.62:0/3373170199 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f026c00f040 con 0x7f0278102f60 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.320+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027810de20 con 0x7f0278102f60 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.320+0000 7f025f7fe700 1 -- 172.21.15.62:0/3373170199 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f026c00da70 con 0x7f0278102f60 2024-05-09T06:39:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.320+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027810e360 con 0x7f0278102f60 2024-05-09T06:39:36.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.321+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0278100250 con 0x7f0278102f60 2024-05-09T06:39:36.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.322+0000 7f025f7fe700 1 -- 172.21.15.62:0/3373170199 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f026c00dc10 con 0x7f0278102f60 2024-05-09T06:39:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.322+0000 7f025f7fe700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0260078990 0x7f026007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.322+0000 7f025f7fe700 1 -- 172.21.15.62:0/3373170199 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f026c099e20 con 0x7f0278102f60 2024-05-09T06:39:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.322+0000 7f0276ffd700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0260078990 0x7f026007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.323+0000 7f0276ffd700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0260078990 0x7f026007ae40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0268004f90 tx=0x7f0268009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:36.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.327+0000 7f025f7fe700 1 -- 172.21.15.62:0/3373170199 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f026c061990 con 0x7f0278102f60 2024-05-09T06:39:36.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.573+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f027810efe0 con 0x7f0260078990 2024-05-09T06:39:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.583+0000 7f025f7fe700 1 -- 172.21.15.62:0/3373170199 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f027810efe0 con 0x7f0260078990 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (6m) 23s ago 17m 25.9M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (4m) 23s ago 18m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (4m) 46s ago 16m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (6m) 23s ago 17m 80.0M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 starting - - - - 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (33s) 23s ago 12m 14.1M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 46146b741422 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (12m) 46s ago 12m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (12m) 46s ago 12m 16.6M - 17.2.7-933-g4ba5a836 b96134859c76 5294aa0f47e4 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (8m) 23s ago 19m 524M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (7m) 46s ago 16m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:39:36.564 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (5m) 23s ago 19m 54.8M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (4m) 46s ago 16m 38.4M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (7m) 23s ago 18m 15.3M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (7m) 46s ago 16m 16.8M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (3m) 23s ago 15m 146M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (3m) 23s ago 15m 137M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (2m) 23s ago 14m 104M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 89acd3b9ad68 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (117s) 46s ago 14m 100M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 8d7a05b6e02c 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (84s) 46s ago 14m 102M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 874246927b69 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (50s) 46s ago 13m 14.8M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 486b85997c37 2024-05-09T06:39:36.565 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (7m) 23s ago 17m 66.8M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0260078990 msgr2=0x7f026007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0260078990 0x7f026007ae40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0268004f90 tx=0x7f0268009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 msgr2=0x7f0278113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 0x7f0278113ed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f026c002a50 tx=0x7f026c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 shutdown_connections 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02780fb520 0x7f0278113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f0260078990 0x7f026007ae40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 --2- 172.21.15.62:0/3373170199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0278102f60 0x7f0278113ed0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 >> 172.21.15.62:0/3373170199 conn(0x7f02780714d0 msgr2=0x7f02780fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:36.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 shutdown_connections 2024-05-09T06:39:36.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.586+0000 7f027d771700 1 -- 172.21.15.62:0/3373170199 wait complete. 2024-05-09T06:39:36.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.691+0000 7fe33a4dc700 1 -- 172.21.15.62:0/305327352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 msgr2=0x7fe334065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:36.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.691+0000 7fe33a4dc700 1 --2- 172.21.15.62:0/305327352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 0x7fe334065ab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe31c004940 tx=0x7fe31c009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:36.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.691+0000 7fe33a4dc700 1 -- 172.21.15.62:0/305327352 shutdown_connections 2024-05-09T06:39:36.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.691+0000 7fe33a4dc700 1 --2- 172.21.15.62:0/305327352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 0x7fe334065ab0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.691+0000 7fe33a4dc700 1 --2- 172.21.15.62:0/305327352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334102e50 0x7fe334103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.691+0000 7fe33a4dc700 1 -- 172.21.15.62:0/305327352 >> 172.21.15.62:0/305327352 conn(0x7fe334071d00 msgr2=0x7fe334072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:36.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.691+0000 7fe33a4dc700 1 -- 172.21.15.62:0/305327352 shutdown_connections 2024-05-09T06:39:36.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.691+0000 7fe33a4dc700 1 -- 172.21.15.62:0/305327352 wait complete. 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe33a4dc700 1 Processor -- start 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe33a4dc700 1 -- start start 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe33a4dc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 0x7fe3340fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe33a4dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334102e50 0x7fe3340fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe33a4dc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340fc880 con 0x7fe334065640 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe33a4dc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340fc9c0 con 0x7fe334102e50 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe333fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 0x7fe3340fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe333fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 0x7fe3340fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47350/0 (socket says 172.21.15.62:47350) 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe333fff700 1 -- 172.21.15.62:0/773195336 learned_addr learned my addr 172.21.15.62:0/773195336 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.692+0000 7fe3337fe700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334102e50 0x7fe3340fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe333fff700 1 -- 172.21.15.62:0/773195336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334102e50 msgr2=0x7fe3340fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:36.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe333fff700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334102e50 0x7fe3340fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:36.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe333fff700 1 -- 172.21.15.62:0/773195336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c005040 con 0x7fe334065640 2024-05-09T06:39:36.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe333fff700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 0x7fe3340fbdb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe32400eb40 tx=0x7fe32400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:36.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe330ff9700 1 -- 172.21.15.62:0/773195336 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe324007cc0 con 0x7fe334065640 2024-05-09T06:39:36.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe330ff9700 1 -- 172.21.15.62:0/773195336 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe32400f040 con 0x7fe334065640 2024-05-09T06:39:36.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3340fcc10 con 0x7fe334065640 2024-05-09T06:39:36.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe330ff9700 1 -- 172.21.15.62:0/773195336 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe324009620 con 0x7fe334065640 2024-05-09T06:39:36.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.693+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33411a180 con 0x7fe334065640 2024-05-09T06:39:36.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.694+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334100100 con 0x7fe334065640 2024-05-09T06:39:36.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.695+0000 7fe330ff9700 1 -- 172.21.15.62:0/773195336 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fe324009780 con 0x7fe334065640 2024-05-09T06:39:36.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.695+0000 7fe330ff9700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe320078980 0x7fe32007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:36.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.695+0000 7fe3337fe700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe320078980 0x7fe32007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:36.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.695+0000 7fe330ff9700 1 -- 172.21.15.62:0/773195336 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7fe32409a4c0 con 0x7fe334065640 2024-05-09T06:39:36.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.696+0000 7fe3337fe700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe320078980 0x7fe32007ae30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe31c007f50 tx=0x7fe31c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:36.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:36.700+0000 7fe330ff9700 1 -- 172.21.15.62:0/773195336 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fe324062060 con 0x7fe334065640 2024-05-09T06:39:37.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.032+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe33404bed0 con 0x7fe334065640 2024-05-09T06:39:37.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.032+0000 7fe330ff9700 1 -- 172.21.15.62:0/773195336 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fe324061a00 con 0x7fe334065640 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:39:37.013 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2, 2024-05-09T06:39:37.014 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:37.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:39:37.014 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:39:37.014 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2, 2024-05-09T06:39:37.014 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 12 2024-05-09T06:39:37.014 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:39:37.014 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:39:37.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe320078980 msgr2=0x7fe32007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe320078980 0x7fe32007ae30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe31c007f50 tx=0x7fe31c009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:37.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 msgr2=0x7fe3340fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 0x7fe3340fbdb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe32400eb40 tx=0x7fe32400b040 comp rx=0 tx=0).stop 2024-05-09T06:39:37.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 shutdown_connections 2024-05-09T06:39:37.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe320078980 0x7fe32007ae30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe334065640 0x7fe3340fbdb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 --2- 172.21.15.62:0/773195336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334102e50 0x7fe3340fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 >> 172.21.15.62:0/773195336 conn(0x7fe334071d00 msgr2=0x7fe3340fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:37.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 shutdown_connections 2024-05-09T06:39:37.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.035+0000 7fe33a4dc700 1 -- 172.21.15.62:0/773195336 wait complete. 2024-05-09T06:39:37.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 -- 172.21.15.62:0/4126959945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 msgr2=0x7f23000fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 --2- 172.21.15.62:0/4126959945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 0x7f23000fcdf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f22ec004940 tx=0x7f22ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:37.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 -- 172.21.15.62:0/4126959945 shutdown_connections 2024-05-09T06:39:37.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 --2- 172.21.15.62:0/4126959945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 0x7f23000fcdf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 --2- 172.21.15.62:0/4126959945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2300102de0 0x7f23001031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 -- 172.21.15.62:0/4126959945 >> 172.21.15.62:0/4126959945 conn(0x7f23000f8990 msgr2=0x7f23000fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 -- 172.21.15.62:0/4126959945 shutdown_connections 2024-05-09T06:39:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 -- 172.21.15.62:0/4126959945 wait complete. 2024-05-09T06:39:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 Processor -- start 2024-05-09T06:39:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.143+0000 7f2306f78700 1 -- start start 2024-05-09T06:39:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f2306f78700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2300102de0 0x7f2300113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f2306f78700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 0x7f2300113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f2306f78700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2300114520 con 0x7f2300103780 2024-05-09T06:39:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f2306f78700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230010db20 con 0x7f2300102de0 2024-05-09T06:39:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 0x7f2300113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 0x7f2300113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47362/0 (socket says 172.21.15.62:47362) 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fffff700 1 -- 172.21.15.62:0/1847818941 learned_addr learned my addr 172.21.15.62:0/1847818941 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f2304d14700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2300102de0 0x7f2300113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fffff700 1 -- 172.21.15.62:0/1847818941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2300102de0 msgr2=0x7f2300113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fffff700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2300102de0 0x7f2300113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fffff700 1 -- 172.21.15.62:0/1847818941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec005040 con 0x7f2300103780 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fffff700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 0x7f2300113ed0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009100 tx=0x7f22ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fd7fa700 1 -- 172.21.15.62:0/1847818941 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22ec00e040 con 0x7f2300103780 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fd7fa700 1 -- 172.21.15.62:0/1847818941 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22ec009af0 con 0x7f2300103780 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230010dda0 con 0x7f2300103780 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.144+0000 7f22fd7fa700 1 -- 172.21.15.62:0/1847818941 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22ec01c3f0 con 0x7f2300103780 2024-05-09T06:39:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.145+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230010e360 con 0x7f2300103780 2024-05-09T06:39:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.145+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23000fe530 con 0x7f2300103780 2024-05-09T06:39:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.146+0000 7f22fd7fa700 1 -- 172.21.15.62:0/1847818941 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f22ec00baf0 con 0x7f2300103780 2024-05-09T06:39:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.147+0000 7f22fd7fa700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f22f0078990 0x7f22f007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.147+0000 7f22fd7fa700 1 -- 172.21.15.62:0/1847818941 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f22ec09b9d0 con 0x7f2300103780 2024-05-09T06:39:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.147+0000 7f2304d14700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f22f0078990 0x7f22f007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.147+0000 7f2304d14700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f22f0078990 0x7f22f007ae40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22f4004eb0 tx=0x7f22f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:37.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.151+0000 7f22fd7fa700 1 -- 172.21.15.62:0/1847818941 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f22ec0635e0 con 0x7f2300103780 2024-05-09T06:39:37.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:37 smithi062 ceph-mon[109590]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:37 smithi062 ceph-mon[109590]: pgmap v202: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 85 B/s wr, 6 op/s 2024-05-09T06:39:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:37 smithi062 ceph-mon[109590]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:37.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:37 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/773195336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:37.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.442+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2300109ec0 con 0x7f2300103780 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.442+0000 7f22fd7fa700 1 -- 172.21.15.62:0/1847818941 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1888 (secure 0 0 0) 0x7f22ec062f80 con 0x7f2300103780 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout:e26 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 25 2024-05-09T06:39:37.423 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:39:32.099907+0000 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 92 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:39:37.424 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=24285} 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:39:37.425 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 24285 members: 24285 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{0:24285} state up:active seq 186 join_fscid=1 addr [v2:172.21.15.79:6824/331990842,v1:172.21.15.79:6825/331990842] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:24297} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{-1:34384} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:39:37.426 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.62:6828/2587505211,v1:172.21.15.62:6829/2587505211] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:39:37.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f22f0078990 msgr2=0x7f22f007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f22f0078990 0x7f22f007ae40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22f4004eb0 tx=0x7f22f400b040 comp rx=0 tx=0).stop 2024-05-09T06:39:37.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 msgr2=0x7f2300113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 0x7f2300113ed0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009100 tx=0x7f22ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:37.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 shutdown_connections 2024-05-09T06:39:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2300102de0 0x7f2300113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f22f0078990 0x7f22f007ae40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 --2- 172.21.15.62:0/1847818941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2300103780 0x7f2300113ed0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 >> 172.21.15.62:0/1847818941 conn(0x7f23000f8990 msgr2=0x7f23000f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 shutdown_connections 2024-05-09T06:39:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.445+0000 7f2306f78700 1 -- 172.21.15.62:0/1847818941 wait complete. 2024-05-09T06:39:37.428 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 26 2024-05-09T06:39:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.558+0000 7fa347eca700 1 -- 172.21.15.62:0/2248999876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340065640 msgr2=0x7fa340065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.558+0000 7fa347eca700 1 --2- 172.21.15.62:0/2248999876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340065640 0x7fa340065ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa33c004940 tx=0x7fa33c009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.558+0000 7fa347eca700 1 -- 172.21.15.62:0/2248999876 shutdown_connections 2024-05-09T06:39:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.558+0000 7fa347eca700 1 --2- 172.21.15.62:0/2248999876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340065640 0x7fa340065ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.558+0000 7fa347eca700 1 --2- 172.21.15.62:0/2248999876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340102e50 0x7fa340103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.558+0000 7fa347eca700 1 -- 172.21.15.62:0/2248999876 >> 172.21.15.62:0/2248999876 conn(0x7fa340071d00 msgr2=0x7fa340072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.558+0000 7fa347eca700 1 -- 172.21.15.62:0/2248999876 shutdown_connections 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.558+0000 7fa347eca700 1 -- 172.21.15.62:0/2248999876 wait complete. 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa347eca700 1 Processor -- start 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa347eca700 1 -- start start 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa347eca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340065640 0x7fa3400fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa347eca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340102e50 0x7fa3400fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa347eca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400fc910 con 0x7fa340102e50 2024-05-09T06:39:37.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa347eca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400fca50 con 0x7fa340065640 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa345465700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340102e50 0x7fa3400fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa345465700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340102e50 0x7fa3400fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47380/0 (socket says 172.21.15.62:47380) 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa345465700 1 -- 172.21.15.62:0/784940828 learned_addr learned my addr 172.21.15.62:0/784940828 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa345c66700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340065640 0x7fa3400fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa345465700 1 -- 172.21.15.62:0/784940828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340065640 msgr2=0x7fa3400fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa345465700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340065640 0x7fa3400fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.559+0000 7fa345465700 1 -- 172.21.15.62:0/784940828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c005040 con 0x7fa340102e50 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.560+0000 7fa345465700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340102e50 0x7fa3400fc2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00b8b0 tx=0x7fa33c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:37.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.560+0000 7fa3327fc700 1 -- 172.21.15.62:0/784940828 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33c00e040 con 0x7fa340102e50 2024-05-09T06:39:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.560+0000 7fa3327fc700 1 -- 172.21.15.62:0/784940828 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa33c004290 con 0x7fa340102e50 2024-05-09T06:39:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.560+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa340119e60 con 0x7fa340102e50 2024-05-09T06:39:37.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.560+0000 7fa3327fc700 1 -- 172.21.15.62:0/784940828 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33c01c3f0 con 0x7fa340102e50 2024-05-09T06:39:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.560+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34011a340 con 0x7fa340102e50 2024-05-09T06:39:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.561+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3400fe540 con 0x7fa340102e50 2024-05-09T06:39:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.562+0000 7fa3327fc700 1 -- 172.21.15.62:0/784940828 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa33c0137b0 con 0x7fa340102e50 2024-05-09T06:39:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.562+0000 7fa3327fc700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa32c078990 0x7fa32c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.562+0000 7fa3327fc700 1 -- 172.21.15.62:0/784940828 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7fa33c09bac0 con 0x7fa340102e50 2024-05-09T06:39:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.562+0000 7fa345c66700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa32c078990 0x7fa32c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.563+0000 7fa345c66700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa32c078990 0x7fa32c07ae40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa334006fd0 tx=0x7fa334008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:37.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.567+0000 7fa3327fc700 1 -- 172.21.15.62:0/784940828 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa33c0636d0 con 0x7fa340102e50 2024-05-09T06:39:37.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:37 smithi079 ceph-mon[82381]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:37.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:37 smithi079 ceph-mon[82381]: pgmap v202: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 85 B/s wr, 6 op/s 2024-05-09T06:39:37.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:37 smithi079 ceph-mon[82381]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:37.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:37 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/773195336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.801+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa34004bed0 con 0x7fa32c078990 2024-05-09T06:39:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.803+0000 7fa3327fc700 1 -- 172.21.15.62:0/784940828 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa34004bed0 con 0x7fa32c078990 2024-05-09T06:39:37.783 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:39:37.783 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:39:37.783 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:39:37.783 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:39:37.783 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr", 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout: "osd" 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "14/21 daemons upgraded", 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:39:37.784 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:39:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa32c078990 msgr2=0x7fa32c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa32c078990 0x7fa32c07ae40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa334006fd0 tx=0x7fa334008040 comp rx=0 tx=0).stop 2024-05-09T06:39:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340102e50 msgr2=0x7fa3400fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340102e50 0x7fa3400fc2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00b8b0 tx=0x7fa33c009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 shutdown_connections 2024-05-09T06:39:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa340065640 0x7fa3400fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa32c078990 0x7fa32c07ae40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 --2- 172.21.15.62:0/784940828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa340102e50 0x7fa3400fc2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 >> 172.21.15.62:0/784940828 conn(0x7fa340071d00 msgr2=0x7fa3400f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 shutdown_connections 2024-05-09T06:39:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.805+0000 7fa347eca700 1 -- 172.21.15.62:0/784940828 wait complete. 2024-05-09T06:39:37.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.912+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/3372800967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 msgr2=0x7fc5e00fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.912+0000 7fc5e5ba1700 1 --2- 172.21.15.62:0/3372800967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 0x7fc5e00fc1b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4004940 tx=0x7fc5d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.913+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/3372800967 shutdown_connections 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.913+0000 7fc5e5ba1700 1 --2- 172.21.15.62:0/3372800967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 0x7fc5e00fc1b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.913+0000 7fc5e5ba1700 1 --2- 172.21.15.62:0/3372800967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e0101d90 0x7fc5e0102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.913+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/3372800967 >> 172.21.15.62:0/3372800967 conn(0x7fc5e0071d00 msgr2=0x7fc5e0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.913+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/3372800967 shutdown_connections 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.913+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/3372800967 wait complete. 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.913+0000 7fc5e5ba1700 1 Processor -- start 2024-05-09T06:39:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.913+0000 7fc5e5ba1700 1 -- start start 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5e5ba1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 0x7fc5e0113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5e5ba1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e0101d90 0x7fc5e01140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5e5ba1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e0114710 con 0x7fc5e00fbd40 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5e5ba1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e010db00 con 0x7fc5e0101d90 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5df7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 0x7fc5e0113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5df7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 0x7fc5e0113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47402/0 (socket says 172.21.15.62:47402) 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5df7fe700 1 -- 172.21.15.62:0/2797077629 learned_addr learned my addr 172.21.15.62:0/2797077629 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5deffd700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e0101d90 0x7fc5e01140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5df7fe700 1 -- 172.21.15.62:0/2797077629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e0101d90 msgr2=0x7fc5e01140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5df7fe700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e0101d90 0x7fc5e01140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5df7fe700 1 -- 172.21.15.62:0/2797077629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d4005040 con 0x7fc5e00fbd40 2024-05-09T06:39:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.914+0000 7fc5df7fe700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 0x7fc5e0113b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000c830 tx=0x7fc5d0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.915+0000 7fc5c7fff700 1 -- 172.21.15.62:0/2797077629 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d00106f0 con 0x7fc5e00fbd40 2024-05-09T06:39:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.915+0000 7fc5c7fff700 1 -- 172.21.15.62:0/2797077629 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5d0010d20 con 0x7fc5e00fbd40 2024-05-09T06:39:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.915+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e010dde0 con 0x7fc5e00fbd40 2024-05-09T06:39:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.915+0000 7fc5c7fff700 1 -- 172.21.15.62:0/2797077629 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5d00113a0 con 0x7fc5e00fbd40 2024-05-09T06:39:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.915+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e010e3a0 con 0x7fc5e00fbd40 2024-05-09T06:39:37.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.916+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e00fd430 con 0x7fc5e00fbd40 2024-05-09T06:39:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.917+0000 7fc5c7fff700 1 -- 172.21.15.62:0/2797077629 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc5d0012400 con 0x7fc5e00fbd40 2024-05-09T06:39:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.917+0000 7fc5c7fff700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5c8078980 0x7fc5c807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.918+0000 7fc5c7fff700 1 -- 172.21.15.62:0/2797077629 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6786+0+0 (secure 0 0 0) 0x7fc5d009a800 con 0x7fc5e00fbd40 2024-05-09T06:39:37.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.918+0000 7fc5deffd700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5c8078980 0x7fc5c807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.918+0000 7fc5deffd700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5c8078980 0x7fc5c807ae30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5e010ecc0 tx=0x7fc5d4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:37.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:37.922+0000 7fc5c7fff700 1 -- 172.21.15.62:0/2797077629 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc5d0062370 con 0x7fc5e00fbd40 2024-05-09T06:39:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.232+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc5e0108df0 con 0x7fc5e00fbd40 2024-05-09T06:39:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.232+0000 7fc5c7fff700 1 -- 172.21.15.62:0/2797077629 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc5d0061d10 con 0x7fc5e00fbd40 2024-05-09T06:39:38.214 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:39:38.214 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:39:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:39:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5c8078980 msgr2=0x7fc5c807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5c8078980 0x7fc5c807ae30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5e010ecc0 tx=0x7fc5d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 msgr2=0x7fc5e0113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 0x7fc5e0113b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000c830 tx=0x7fc5d0004470 comp rx=0 tx=0).stop 2024-05-09T06:39:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 shutdown_connections 2024-05-09T06:39:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5c8078980 0x7fc5c807ae30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e00fbd40 0x7fc5e0113b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 --2- 172.21.15.62:0/2797077629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e0101d90 0x7fc5e01140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 >> 172.21.15.62:0/2797077629 conn(0x7fc5e0071d00 msgr2=0x7fc5e00fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 shutdown_connections 2024-05-09T06:39:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:39:38.236+0000 7fc5e5ba1700 1 -- 172.21.15.62:0/2797077629 wait complete. 2024-05-09T06:39:38.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:38 smithi062 ceph-mon[109590]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:38.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:38 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1847818941' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:39:38.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:38.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:38 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:38.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:38 smithi079 ceph-mon[82381]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:38.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:38 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1847818941' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:39:38.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:38.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:38 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:39.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:39 smithi062 ceph-mon[109590]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:39 smithi062 ceph-mon[109590]: pgmap v203: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-05-09T06:39:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:39 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2797077629' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:39:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:39.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:39.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:39 smithi079 ceph-mon[82381]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:39 smithi079 ceph-mon[82381]: pgmap v203: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-05-09T06:39:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:39 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2797077629' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:39:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:39.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:41.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:41 smithi062 ceph-mon[109590]: pgmap v204: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T06:39:41.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:41 smithi079 ceph-mon[82381]: pgmap v204: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T06:39:43.570 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: pgmap v205: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:43.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:43 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:43.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: pgmap v205: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:43.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:43 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:45.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:44 smithi079 ceph-mon[82381]: Upgrade: Updating mds.cephfs.smithi079.qwqgdo 2024-05-09T06:39:45.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:44 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:44 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.qwqgdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:39:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:44 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:44 smithi079 ceph-mon[82381]: Deploying daemon mds.cephfs.smithi079.qwqgdo on smithi079 2024-05-09T06:39:45.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:44 smithi079 ceph-mon[82381]: pgmap v206: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 365 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:39:45.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:44 smithi062 ceph-mon[109590]: Upgrade: Updating mds.cephfs.smithi079.qwqgdo 2024-05-09T06:39:45.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:44 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:45.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:44 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.qwqgdo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:39:45.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:44 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:45.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:44 smithi062 ceph-mon[109590]: Deploying daemon mds.cephfs.smithi079.qwqgdo on smithi079 2024-05-09T06:39:45.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:44 smithi062 ceph-mon[109590]: pgmap v206: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 365 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:39:46.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:46 smithi079 ceph-mon[82381]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:39:46.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:46 smithi079 ceph-mon[82381]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:39:46.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:46 smithi079 ceph-mon[82381]: osdmap e93: 6 total, 6 up, 6 in 2024-05-09T06:39:46.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:46 smithi079 ceph-mon[82381]: Standby daemon mds.cephfs.smithi079.pdxygz assigned to filesystem cephfs as rank 0 2024-05-09T06:39:46.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:46 smithi079 ceph-mon[82381]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:39:46.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:46 smithi079 ceph-mon[82381]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:39:46.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:46 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi079.pdxygz=up:replay} 2 up:standby 2024-05-09T06:39:46.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:46 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[109586]: 2024-05-09T06:39:46.036+0000 7fc8d1a60700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:39:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:46 smithi062 ceph-mon[109590]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:39:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:46 smithi062 ceph-mon[109590]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:39:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:46 smithi062 ceph-mon[109590]: osdmap e93: 6 total, 6 up, 6 in 2024-05-09T06:39:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:46 smithi062 ceph-mon[109590]: Standby daemon mds.cephfs.smithi079.pdxygz assigned to filesystem cephfs as rank 0 2024-05-09T06:39:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:46 smithi062 ceph-mon[109590]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:39:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:46 smithi062 ceph-mon[109590]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:39:46.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:46 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi079.pdxygz=up:replay} 2 up:standby 2024-05-09T06:39:47.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:47 smithi079 ceph-mon[82381]: pgmap v207: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 32 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-05-09T06:39:47.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:47 smithi062 ceph-mon[109590]: pgmap v207: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 32 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-05-09T06:39:49.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:49 smithi079 ceph-mon[82381]: pgmap v209: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 0 B/s wr, 1 op/s 2024-05-09T06:39:49.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:49 smithi062 ceph-mon[109590]: pgmap v209: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 0 B/s wr, 1 op/s 2024-05-09T06:39:51.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:51 smithi079 ceph-mon[82381]: pgmap v210: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-05-09T06:39:51.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:51 smithi062 ceph-mon[109590]: pgmap v210: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-05-09T06:39:53.311 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:53 smithi079 ceph-mon[82381]: pgmap v211: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T06:39:53.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:53 smithi062 ceph-mon[109590]: pgmap v211: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T06:39:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:55 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:55.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:55 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:55.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:55 smithi079 ceph-mon[82381]: pgmap v212: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-09T06:39:55.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:55 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:55.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:55 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:55.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:55 smithi062 ceph-mon[109590]: pgmap v212: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-09T06:39:56.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: reconnect by client.14532 v1:172.21.15.79:0/875005746 after 0 2024-05-09T06:39:56.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: reconnect by client.14526 v1:192.168.0.1:0/2072281023 after 0 2024-05-09T06:39:56.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:reconnect 2024-05-09T06:39:56.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.79:6824/3936046313,v1:172.21.15.79:6825/3936046313] up:boot 2024-05-09T06:39:56.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi079.pdxygz=up:reconnect} 3 up:standby 2024-05-09T06:39:56.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:39:56.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:56.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:56.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:56 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:56.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: reconnect by client.14532 v1:172.21.15.79:0/875005746 after 0 2024-05-09T06:39:56.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: reconnect by client.14526 v1:192.168.0.1:0/2072281023 after 0 2024-05-09T06:39:56.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:reconnect 2024-05-09T06:39:56.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.79:6824/3936046313,v1:172.21.15.79:6825/3936046313] up:boot 2024-05-09T06:39:56.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi079.pdxygz=up:reconnect} 3 up:standby 2024-05-09T06:39:56.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:39:56.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:56.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:39:56.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:56 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:57.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:57 smithi079 ceph-mon[82381]: pgmap v213: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-05-09T06:39:57.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:57 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:rejoin 2024-05-09T06:39:57.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:57 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi079.pdxygz=up:rejoin} 3 up:standby 2024-05-09T06:39:57.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:57 smithi079 ceph-mon[82381]: daemon mds.cephfs.smithi079.pdxygz is now active in filesystem cephfs as rank 0 2024-05-09T06:39:57.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:57 smithi062 ceph-mon[109590]: pgmap v213: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-05-09T06:39:57.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:57 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:rejoin 2024-05-09T06:39:57.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:57 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi079.pdxygz=up:rejoin} 3 up:standby 2024-05-09T06:39:57.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:57 smithi062 ceph-mon[109590]: daemon mds.cephfs.smithi079.pdxygz is now active in filesystem cephfs as rank 0 2024-05-09T06:39:58.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:58 smithi079 ceph-mon[82381]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:39:58.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:58 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:active 2024-05-09T06:39:58.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:58 smithi079 ceph-mon[82381]: fsmap cephfs:1 {0=cephfs.smithi079.pdxygz=up:active} 3 up:standby 2024-05-09T06:39:58.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:58 smithi062 ceph-mon[109590]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:39:58.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:58 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.79:6826/1887614093,v1:172.21.15.79:6827/1887614093] up:active 2024-05-09T06:39:58.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:58 smithi062 ceph-mon[109590]: fsmap cephfs:1 {0=cephfs.smithi079.pdxygz=up:active} 3 up:standby 2024-05-09T06:39:59.204 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:39:59 smithi079 ceph-mon[82381]: pgmap v214: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T06:39:59.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:39:59 smithi062 ceph-mon[109590]: pgmap v214: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T06:40:00.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:00 smithi079 ceph-mon[82381]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:00.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:00 smithi062 ceph-mon[109590]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:01.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:01 smithi079 ceph-mon[82381]: pgmap v215: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T06:40:01.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:01.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:01 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:01.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:01 smithi062 ceph-mon[109590]: pgmap v215: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T06:40:01.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:01.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:01 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:02.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:02 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:02.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:02 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:02.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:02 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:02.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:02 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:03.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:03 smithi079 ceph-mon[82381]: pgmap v216: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T06:40:03.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:03 smithi062 ceph-mon[109590]: pgmap v216: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T06:40:05.684 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: pgmap v217: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T06:40:05.684 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:05.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:05 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:05.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: pgmap v217: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T06:40:05.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:05.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:05 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:07.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:07 smithi079 ceph-mon[82381]: pgmap v218: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:40:07.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:07 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:07.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:07 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pdxygz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:40:07.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:07 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:07.771 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:07 smithi062 ceph-mon[109590]: pgmap v218: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:40:07.771 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:07 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:07.771 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:07 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pdxygz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:40:07.771 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:07 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.362+0000 7f10fd1a0700 1 -- 172.21.15.62:0/3855310715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f81035e0 msgr2=0x7f10f80fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.362+0000 7f10fd1a0700 1 --2- 172.21.15.62:0/3855310715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f81035e0 0x7f10f80fcc50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10e0004940 tx=0x7f10e0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:08.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.363+0000 7f10fd1a0700 1 -- 172.21.15.62:0/3855310715 shutdown_connections 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.363+0000 7f10fd1a0700 1 --2- 172.21.15.62:0/3855310715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f81035e0 0x7f10f80fcc50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.363+0000 7f10fd1a0700 1 --2- 172.21.15.62:0/3855310715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f8102c40 0x7f10f8103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.363+0000 7f10fd1a0700 1 -- 172.21.15.62:0/3855310715 >> 172.21.15.62:0/3855310715 conn(0x7f10f80f8810 msgr2=0x7f10f80fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.363+0000 7f10fd1a0700 1 -- 172.21.15.62:0/3855310715 shutdown_connections 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.363+0000 7f10fd1a0700 1 -- 172.21.15.62:0/3855310715 wait complete. 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.363+0000 7f10fd1a0700 1 Processor -- start 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.363+0000 7f10fd1a0700 1 -- start start 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10fd1a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f8102c40 0x7f10f8115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10fd1a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f81035e0 0x7f10f81160f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10fd1a0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8116740 con 0x7f10f8102c40 2024-05-09T06:40:08.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10fd1a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f810fb50 con 0x7f10f81035e0 2024-05-09T06:40:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10f7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f8102c40 0x7f10f8115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10f7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f8102c40 0x7f10f8115bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41966/0 (socket says 172.21.15.62:41966) 2024-05-09T06:40:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10f7fff700 1 -- 172.21.15.62:0/1937620927 learned_addr learned my addr 172.21.15.62:0/1937620927 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10f77fe700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f81035e0 0x7f10f81160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10f7fff700 1 -- 172.21.15.62:0/1937620927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f81035e0 msgr2=0x7f10f81160f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10f7fff700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f81035e0 0x7f10f81160f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10f7fff700 1 -- 172.21.15.62:0/1937620927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0005040 con 0x7f10f8102c40 2024-05-09T06:40:08.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.364+0000 7f10f7fff700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f8102c40 0x7f10f8115bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f10e8002a50 tx=0x7f10e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:08.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.365+0000 7f10f4ff9700 1 -- 172.21.15.62:0/1937620927 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10e8007cc0 con 0x7f10f8102c40 2024-05-09T06:40:08.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.365+0000 7f10f4ff9700 1 -- 172.21.15.62:0/1937620927 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10e800f040 con 0x7f10f8102c40 2024-05-09T06:40:08.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.365+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f810fe30 con 0x7f10f8102c40 2024-05-09T06:40:08.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.365+0000 7f10f4ff9700 1 -- 172.21.15.62:0/1937620927 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10e800da70 con 0x7f10f8102c40 2024-05-09T06:40:08.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.365+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f81103f0 con 0x7f10f8102c40 2024-05-09T06:40:08.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.366+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f80fe390 con 0x7f10f8102c40 2024-05-09T06:40:08.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.366+0000 7f10f4ff9700 1 -- 172.21.15.62:0/1937620927 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f10e800dc10 con 0x7f10f8102c40 2024-05-09T06:40:08.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.367+0000 7f10f4ff9700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10e4078990 0x7f10e407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:08.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.367+0000 7f10f4ff9700 1 -- 172.21.15.62:0/1937620927 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f10e8099f10 con 0x7f10f8102c40 2024-05-09T06:40:08.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.367+0000 7f10f77fe700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10e4078990 0x7f10e407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:08.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.368+0000 7f10f77fe700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10e4078990 0x7f10e407ae40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f10f8111450 tx=0x7f10e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:08.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.372+0000 7f10f4ff9700 1 -- 172.21.15.62:0/1937620927 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f10e80619b0 con 0x7f10f8102c40 2024-05-09T06:40:08.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.607+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10f8111200 con 0x7f10e4078990 2024-05-09T06:40:08.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.608+0000 7f10f4ff9700 1 -- 172.21.15.62:0/1937620927 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f10f8111200 con 0x7f10e4078990 2024-05-09T06:40:08.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10e4078990 msgr2=0x7f10e407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10e4078990 0x7f10e407ae40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f10f8111450 tx=0x7f10e0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f8102c40 msgr2=0x7f10f8115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f8102c40 0x7f10f8115bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f10e8002a50 tx=0x7f10e80046b0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 shutdown_connections 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f10e4078990 0x7f10e407ae40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10f8102c40 0x7f10f8115bb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 --2- 172.21.15.62:0/1937620927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f81035e0 0x7f10f81160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 >> 172.21.15.62:0/1937620927 conn(0x7f10f80f8810 msgr2=0x7f10f80f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 shutdown_connections 2024-05-09T06:40:08.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.610+0000 7f10fd1a0700 1 -- 172.21.15.62:0/1937620927 wait complete. 2024-05-09T06:40:08.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:08 smithi079 ceph-mon[82381]: Upgrade: Updating mds.cephfs.smithi079.pdxygz 2024-05-09T06:40:08.592 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:08 smithi079 ceph-mon[82381]: Deploying daemon mds.cephfs.smithi079.pdxygz on smithi079 2024-05-09T06:40:08.601 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:40:08.602 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:08 smithi062 ceph-mon[109590]: Upgrade: Updating mds.cephfs.smithi079.pdxygz 2024-05-09T06:40:08.602 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:08 smithi062 ceph-mon[109590]: Deploying daemon mds.cephfs.smithi079.pdxygz on smithi079 2024-05-09T06:40:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.735+0000 7fc3cbb48700 1 -- 172.21.15.62:0/1250228897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fe770 msgr2=0x7fc3c4106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.735+0000 7fc3cbb48700 1 --2- 172.21.15.62:0/1250228897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fe770 0x7fc3c4106e40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4004940 tx=0x7fc3b4009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.735+0000 7fc3cbb48700 1 -- 172.21.15.62:0/1250228897 shutdown_connections 2024-05-09T06:40:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.735+0000 7fc3cbb48700 1 --2- 172.21.15.62:0/1250228897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fe770 0x7fc3c4106e40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.735+0000 7fc3cbb48700 1 --2- 172.21.15.62:0/1250228897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c40fddd0 0x7fc3c40fe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.735+0000 7fc3cbb48700 1 -- 172.21.15.62:0/1250228897 >> 172.21.15.62:0/1250228897 conn(0x7fc3c40f7850 msgr2=0x7fc3c40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.735+0000 7fc3cbb48700 1 -- 172.21.15.62:0/1250228897 shutdown_connections 2024-05-09T06:40:08.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.735+0000 7fc3cbb48700 1 -- 172.21.15.62:0/1250228897 wait complete. 2024-05-09T06:40:08.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3cbb48700 1 Processor -- start 2024-05-09T06:40:08.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3cbb48700 1 -- start start 2024-05-09T06:40:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3cbb48700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fddd0 0x7fc3c4113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3cbb48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c40fe770 0x7fc3c4114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3cbb48700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c4114670 con 0x7fc3c40fddd0 2024-05-09T06:40:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3cbb48700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c410da60 con 0x7fc3c40fe770 2024-05-09T06:40:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3c98e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fddd0 0x7fc3c4113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3c90e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c40fe770 0x7fc3c4114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3c98e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fddd0 0x7fc3c4113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41984/0 (socket says 172.21.15.62:41984) 2024-05-09T06:40:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3c90e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c40fe770 0x7fc3c4114020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.62:33102/0 (socket says 172.21.15.62:33102) 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.736+0000 7fc3c98e4700 1 -- 172.21.15.62:0/51572611 learned_addr learned my addr 172.21.15.62:0/51572611 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3c98e4700 1 -- 172.21.15.62:0/51572611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c40fe770 msgr2=0x7fc3c4114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3c98e4700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c40fe770 0x7fc3c4114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3c98e4700 1 -- 172.21.15.62:0/51572611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b4005040 con 0x7fc3c40fddd0 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3c98e4700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fddd0 0x7fc3c4113ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000eb40 tx=0x7fc3c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3ba7fc700 1 -- 172.21.15.62:0/51572611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c0007cc0 con 0x7fc3c40fddd0 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3ba7fc700 1 -- 172.21.15.62:0/51572611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3c000f040 con 0x7fc3c40fddd0 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c410dce0 con 0x7fc3c40fddd0 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c410e220 con 0x7fc3c40fddd0 2024-05-09T06:40:08.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.737+0000 7fc3ba7fc700 1 -- 172.21.15.62:0/51572611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c000ca10 con 0x7fc3c40fddd0 2024-05-09T06:40:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.739+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a80052b0 con 0x7fc3c40fddd0 2024-05-09T06:40:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.739+0000 7fc3ba7fc700 1 -- 172.21.15.62:0/51572611 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc3c000cc80 con 0x7fc3c40fddd0 2024-05-09T06:40:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.740+0000 7fc3ba7fc700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc3b0078990 0x7fc3b007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.740+0000 7fc3ba7fc700 1 -- 172.21.15.62:0/51572611 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fc3c009a410 con 0x7fc3c40fddd0 2024-05-09T06:40:08.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.740+0000 7fc3c90e3700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc3b0078990 0x7fc3b007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:08.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.740+0000 7fc3c90e3700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc3b0078990 0x7fc3b007ae40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3c410ec20 tx=0x7fc3b4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:08.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.749+0000 7fc3ba7fc700 1 -- 172.21.15.62:0/51572611 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc3c0061f10 con 0x7fc3c40fddd0 2024-05-09T06:40:08.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:08 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[109586]: 2024-05-09T06:40:08.677+0000 7fc8d1a60700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:08.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.988+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3a8000bc0 con 0x7fc3b0078990 2024-05-09T06:40:08.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.990+0000 7fc3ba7fc700 1 -- 172.21.15.62:0/51572611 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc3a8000bc0 con 0x7fc3b0078990 2024-05-09T06:40:08.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc3b0078990 msgr2=0x7fc3b007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:08.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc3b0078990 0x7fc3b007ae40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3c410ec20 tx=0x7fc3b4009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:08.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fddd0 msgr2=0x7fc3c4113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:08.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fddd0 0x7fc3c4113ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000eb40 tx=0x7fc3c000b040 comp rx=0 tx=0).stop 2024-05-09T06:40:08.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 shutdown_connections 2024-05-09T06:40:08.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc3b0078990 0x7fc3b007ae40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c40fddd0 0x7fc3c4113ae0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 --2- 172.21.15.62:0/51572611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c40fe770 0x7fc3c4114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:08.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 >> 172.21.15.62:0/51572611 conn(0x7fc3c40f7850 msgr2=0x7fc3c40f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:08.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 shutdown_connections 2024-05-09T06:40:08.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:08.992+0000 7fc3cbb48700 1 -- 172.21.15.62:0/51572611 wait complete. 2024-05-09T06:40:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.116+0000 7fccf4c14700 1 -- 172.21.15.62:0/164917650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf0101d90 msgr2=0x7fccf0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.116+0000 7fccf4c14700 1 --2- 172.21.15.62:0/164917650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf0101d90 0x7fccf0102160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcce0004940 tx=0x7fcce0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.116+0000 7fccf4c14700 1 -- 172.21.15.62:0/164917650 shutdown_connections 2024-05-09T06:40:09.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.116+0000 7fccf4c14700 1 --2- 172.21.15.62:0/164917650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf00fbd40 0x7fccf00fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.116+0000 7fccf4c14700 1 --2- 172.21.15.62:0/164917650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf0101d90 0x7fccf0102160 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.116+0000 7fccf4c14700 1 -- 172.21.15.62:0/164917650 >> 172.21.15.62:0/164917650 conn(0x7fccf0071d00 msgr2=0x7fccf0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.116+0000 7fccf4c14700 1 -- 172.21.15.62:0/164917650 shutdown_connections 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.116+0000 7fccf4c14700 1 -- 172.21.15.62:0/164917650 wait complete. 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccf4c14700 1 Processor -- start 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccf4c14700 1 -- start start 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccf4c14700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf00fbd40 0x7fccf010eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccf4c14700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf0101d90 0x7fccf010f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccf4c14700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf010f6d0 con 0x7fccf00fbd40 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccf4c14700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf010f810 con 0x7fccf0101d90 2024-05-09T06:40:09.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccee59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf00fbd40 0x7fccf010eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccee59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf00fbd40 0x7fccf010eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41994/0 (socket says 172.21.15.62:41994) 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccee59c700 1 -- 172.21.15.62:0/2713237838 learned_addr learned my addr 172.21.15.62:0/2713237838 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.117+0000 7fccedd9b700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf0101d90 0x7fccf010f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccee59c700 1 -- 172.21.15.62:0/2713237838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf0101d90 msgr2=0x7fccf010f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccee59c700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf0101d90 0x7fccf010f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccee59c700 1 -- 172.21.15.62:0/2713237838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0005040 con 0x7fccf00fbd40 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccee59c700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf00fbd40 0x7fccf010eb40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009150 tx=0x7fcce0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccdeffd700 1 -- 172.21.15.62:0/2713237838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce000e040 con 0x7fccf00fbd40 2024-05-09T06:40:09.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccdeffd700 1 -- 172.21.15.62:0/2713237838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcce0013420 con 0x7fccf00fbd40 2024-05-09T06:40:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf0117bb0 con 0x7fccf00fbd40 2024-05-09T06:40:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccdeffd700 1 -- 172.21.15.62:0/2713237838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce001c610 con 0x7fccf00fbd40 2024-05-09T06:40:09.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.118+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf010c9b0 con 0x7fccf00fbd40 2024-05-09T06:40:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.119+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf00fd430 con 0x7fccf00fbd40 2024-05-09T06:40:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.120+0000 7fccdeffd700 1 -- 172.21.15.62:0/2713237838 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fcce000baf0 con 0x7fccf00fbd40 2024-05-09T06:40:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.121+0000 7fccdeffd700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fccd807cd90 0x7fccd807f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.121+0000 7fccdeffd700 1 -- 172.21.15.62:0/2713237838 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fcce009ba80 con 0x7fccf00fbd40 2024-05-09T06:40:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.121+0000 7fccedd9b700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fccd807cd90 0x7fccd807f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.121+0000 7fccedd9b700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fccd807cd90 0x7fccd807f240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fccf0065fe0 tx=0x7fcce400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:09.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.126+0000 7fccdeffd700 1 -- 172.21.15.62:0/2713237838 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fcce00635f0 con 0x7fccf00fbd40 2024-05-09T06:40:09.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.354+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fccf0065d90 con 0x7fccd807cd90 2024-05-09T06:40:09.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.365+0000 7fccdeffd700 1 -- 172.21.15.62:0/2713237838 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fccf0065d90 con 0x7fccd807cd90 2024-05-09T06:40:09.345 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:40:09.345 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (7m) 31s ago 18m 25.9M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (4m) 31s ago 18m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (4m) 9s ago 17m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (6m) 31s ago 18m 80.5M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (36s) 31s ago 12m 15.2M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 43065134ffb6 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (66s) 31s ago 12m 14.3M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 46146b741422 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (12m) 9s ago 12m 83.7M - 17.2.7-933-g4ba5a836 b96134859c76 660359419d37 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (15s) 9s ago 12m 15.1M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 be2130e50081 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (9m) 31s ago 20m 525M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (8m) 9s ago 17m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (5m) 31s ago 20m 55.2M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:40:09.346 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (5m) 9s ago 17m 43.5M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (8m) 31s ago 18m 15.0M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (7m) 9s ago 17m 16.7M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (4m) 31s ago 16m 149M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (3m) 31s ago 16m 135M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (3m) 31s ago 15m 107M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 89acd3b9ad68 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (2m) 9s ago 15m 113M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 8d7a05b6e02c 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (116s) 9s ago 14m 105M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 874246927b69 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (83s) 9s ago 14m 103M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 486b85997c37 2024-05-09T06:40:09.347 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (7m) 31s ago 17m 66.8M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:40:09.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fccd807cd90 msgr2=0x7fccd807f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fccd807cd90 0x7fccd807f240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fccf0065fe0 tx=0x7fcce400b040 comp rx=0 tx=0).stop 2024-05-09T06:40:09.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf00fbd40 msgr2=0x7fccf010eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf00fbd40 0x7fccf010eb40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009150 tx=0x7fcce0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:09.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 shutdown_connections 2024-05-09T06:40:09.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fccd807cd90 0x7fccd807f240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fccf00fbd40 0x7fccf010eb40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 --2- 172.21.15.62:0/2713237838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccf0101d90 0x7fccf010f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.367+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 >> 172.21.15.62:0/2713237838 conn(0x7fccf0071d00 msgr2=0x7fccf00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:09.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.368+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 shutdown_connections 2024-05-09T06:40:09.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.368+0000 7fccf4c14700 1 -- 172.21.15.62:0/2713237838 wait complete. 2024-05-09T06:40:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.475+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1969307570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c981014d0 msgr2=0x7f5c981018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.475+0000 7f5c9fcd4700 1 --2- 172.21.15.62:0/1969307570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c981014d0 0x7f5c981018a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c004940 tx=0x7f5c8c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.475+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1969307570 shutdown_connections 2024-05-09T06:40:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.475+0000 7f5c9fcd4700 1 --2- 172.21.15.62:0/1969307570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c980fb600 0x7f5c980fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.475+0000 7f5c9fcd4700 1 --2- 172.21.15.62:0/1969307570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c981014d0 0x7f5c981018a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.475+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1969307570 >> 172.21.15.62:0/1969307570 conn(0x7f5c98071460 msgr2=0x7f5c98071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.475+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1969307570 shutdown_connections 2024-05-09T06:40:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.475+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1969307570 wait complete. 2024-05-09T06:40:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9fcd4700 1 Processor -- start 2024-05-09T06:40:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9fcd4700 1 -- start start 2024-05-09T06:40:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9fcd4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c980fb600 0x7f5c9810ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9fcd4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c981014d0 0x7f5c9810efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9fcd4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9810f620 con 0x7f5c980fb600 2024-05-09T06:40:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9fcd4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9810f760 con 0x7f5c981014d0 2024-05-09T06:40:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9da70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c980fb600 0x7f5c9810ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9da70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c980fb600 0x7f5c9810ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42024/0 (socket says 172.21.15.62:42024) 2024-05-09T06:40:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.476+0000 7f5c9da70700 1 -- 172.21.15.62:0/1426255527 learned_addr learned my addr 172.21.15.62:0/1426255527 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c9d26f700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c981014d0 0x7f5c9810efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c9da70700 1 -- 172.21.15.62:0/1426255527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c981014d0 msgr2=0x7f5c9810efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c9da70700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c981014d0 0x7f5c9810efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c9da70700 1 -- 172.21.15.62:0/1426255527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c005040 con 0x7f5c980fb600 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c9da70700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c980fb600 0x7f5c9810ea90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009150 tx=0x7f5c8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c8a7fc700 1 -- 172.21.15.62:0/1426255527 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c8c021070 con 0x7f5c980fb600 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c98117b00 con 0x7f5c980fb600 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c98117f60 con 0x7f5c980fb600 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c8a7fc700 1 -- 172.21.15.62:0/1426255527 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c8c013c00 con 0x7f5c980fb600 2024-05-09T06:40:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.477+0000 7f5c8a7fc700 1 -- 172.21.15.62:0/1426255527 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c8c00e070 con 0x7f5c980fb600 2024-05-09T06:40:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.478+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c981038b0 con 0x7f5c980fb600 2024-05-09T06:40:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.479+0000 7f5c8a7fc700 1 -- 172.21.15.62:0/1426255527 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f5c8c01c400 con 0x7f5c980fb600 2024-05-09T06:40:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.480+0000 7f5c8a7fc700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5c84078980 0x7f5c8407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.480+0000 7f5c8a7fc700 1 -- 172.21.15.62:0/1426255527 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f5c8c09c400 con 0x7f5c980fb600 2024-05-09T06:40:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.480+0000 7f5c9d26f700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5c84078980 0x7f5c8407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.480+0000 7f5c9d26f700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5c84078980 0x7f5c8407ae30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c94004600 tx=0x7f5c9400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.489+0000 7f5c8a7fc700 1 -- 172.21.15.62:0/1426255527 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f5c8c063f70 con 0x7f5c980fb600 2024-05-09T06:40:09.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: pgmap v219: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 42 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:40:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:40:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: osdmap e94: 6 total, 6 up, 6 in 2024-05-09T06:40:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: Standby daemon mds.cephfs.smithi062.etsgzx assigned to filesystem cephfs as rank 0 2024-05-09T06:40:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:40:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:40:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi062.etsgzx=up:replay} 2 up:standby 2024-05-09T06:40:09.661 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.805+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c980fcbb0 con 0x7f5c980fb600 2024-05-09T06:40:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.806+0000 7f5c8a7fc700 1 -- 172.21.15.62:0/1426255527 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f5c8c063910 con 0x7f5c980fb600 2024-05-09T06:40:09.786 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:40:09.786 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:40:09.786 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:09.786 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 3 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 13 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:40:09.787 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:40:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5c84078980 msgr2=0x7f5c8407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5c84078980 0x7f5c8407ae30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c94004600 tx=0x7f5c9400b040 comp rx=0 tx=0).stop 2024-05-09T06:40:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c980fb600 msgr2=0x7f5c9810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c980fb600 0x7f5c9810ea90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009150 tx=0x7f5c8c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 shutdown_connections 2024-05-09T06:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f5c84078980 0x7f5c8407ae30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c980fb600 0x7f5c9810ea90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 --2- 172.21.15.62:0/1426255527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c981014d0 0x7f5c9810efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 >> 172.21.15.62:0/1426255527 conn(0x7f5c98071460 msgr2=0x7f5c980fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 shutdown_connections 2024-05-09T06:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.808+0000 7f5c9fcd4700 1 -- 172.21.15.62:0/1426255527 wait complete. 2024-05-09T06:40:09.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: pgmap v219: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 42 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:40:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:40:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: osdmap e94: 6 total, 6 up, 6 in 2024-05-09T06:40:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: Standby daemon mds.cephfs.smithi062.etsgzx assigned to filesystem cephfs as rank 0 2024-05-09T06:40:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:40:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:40:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi062.etsgzx=up:replay} 2 up:standby 2024-05-09T06:40:09.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.916+0000 7f9075a97700 1 -- 172.21.15.62:0/2992652714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fc790 msgr2=0x7f90700fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.916+0000 7f9075a97700 1 --2- 172.21.15.62:0/2992652714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fc790 0x7f90700fcb60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9060004940 tx=0x7f9060009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.916+0000 7f9075a97700 1 -- 172.21.15.62:0/2992652714 shutdown_connections 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.916+0000 7f9075a97700 1 --2- 172.21.15.62:0/2992652714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90700fd0a0 0x7f9070109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.916+0000 7f9075a97700 1 --2- 172.21.15.62:0/2992652714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fc790 0x7f90700fcb60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.916+0000 7f9075a97700 1 -- 172.21.15.62:0/2992652714 >> 172.21.15.62:0/2992652714 conn(0x7f9070071d00 msgr2=0x7f9070072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.916+0000 7f9075a97700 1 -- 172.21.15.62:0/2992652714 shutdown_connections 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.916+0000 7f9075a97700 1 -- 172.21.15.62:0/2992652714 wait complete. 2024-05-09T06:40:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f9075a97700 1 Processor -- start 2024-05-09T06:40:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f9075a97700 1 -- start start 2024-05-09T06:40:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f9075a97700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90700fc790 0x7f9070115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f9075a97700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fd0a0 0x7f9070116330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f9075a97700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9070116a10 con 0x7f90700fd0a0 2024-05-09T06:40:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f9075a97700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907010fd50 con 0x7f90700fc790 2024-05-09T06:40:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f906effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fd0a0 0x7f9070116330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f906effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fd0a0 0x7f9070116330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42030/0 (socket says 172.21.15.62:42030) 2024-05-09T06:40:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f906effd700 1 -- 172.21.15.62:0/1912491761 learned_addr learned my addr 172.21.15.62:0/1912491761 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.917+0000 7f906f7fe700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90700fc790 0x7f9070115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f906effd700 1 -- 172.21.15.62:0/1912491761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90700fc790 msgr2=0x7f9070115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f906effd700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90700fc790 0x7f9070115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f906effd700 1 -- 172.21.15.62:0/1912491761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060005040 con 0x7f90700fd0a0 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f906f7fe700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90700fc790 0x7f9070115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f906effd700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fd0a0 0x7f9070116330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f906400b790 tx=0x7f9064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f9057fff700 1 -- 172.21.15.62:0/1912491761 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f906400f770 con 0x7f90700fd0a0 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f9057fff700 1 -- 172.21.15.62:0/1912491761 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f906400fda0 con 0x7f90700fd0a0 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907010ffd0 con 0x7f90700fd0a0 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f9057fff700 1 -- 172.21.15.62:0/1912491761 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f906400d310 con 0x7f90700fd0a0 2024-05-09T06:40:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.918+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9070110510 con 0x7f90700fd0a0 2024-05-09T06:40:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.919+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90700fc330 con 0x7f90700fd0a0 2024-05-09T06:40:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.920+0000 7f9057fff700 1 -- 172.21.15.62:0/1912491761 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f9064010420 con 0x7f90700fd0a0 2024-05-09T06:40:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.920+0000 7f9057fff700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9058078990 0x7f905807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.920+0000 7f9057fff700 1 -- 172.21.15.62:0/1912491761 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f906409a920 con 0x7f90700fd0a0 2024-05-09T06:40:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.920+0000 7f906f7fe700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9058078990 0x7f905807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.921+0000 7f906f7fe700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9058078990 0x7f905807ae40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9060004f90 tx=0x7f9060009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:09.929+0000 7f9057fff700 1 -- 172.21.15.62:0/1912491761 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f90640623f0 con 0x7f90700fd0a0 2024-05-09T06:40:10.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.198+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f907004bed0 con 0x7f90700fd0a0 2024-05-09T06:40:10.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.199+0000 7f9057fff700 1 -- 172.21.15.62:0/1912491761 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1748 (secure 0 0 0) 0x7f9064061d90 con 0x7f90700fd0a0 2024-05-09T06:40:10.179 INFO:teuthology.orchestra.run.smithi062.stdout:e33 2024-05-09T06:40:10.179 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:40:10.179 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:40:10.179 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:40:10.179 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 33 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:40:08.683237+0000 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:40:10.180 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 94 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=34384} 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:40:10.181 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:40:10.182 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:40:10.182 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:34384} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:40:10.182 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:40:10.182 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:40:10.182 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:40:10.182 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:40:10.182 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.62:6828/2587505211,v1:172.21.15.62:6829/2587505211] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:40:10.182 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6824/3936046313,v1:172.21.15.79:6825/3936046313] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9058078990 msgr2=0x7f905807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9058078990 0x7f905807ae40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9060004f90 tx=0x7f9060009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fd0a0 msgr2=0x7f9070116330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fd0a0 0x7f9070116330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f906400b790 tx=0x7f9064009250 comp rx=0 tx=0).stop 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 shutdown_connections 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90700fc790 0x7f9070115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9058078990 0x7f905807ae40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 --2- 172.21.15.62:0/1912491761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90700fd0a0 0x7f9070116330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 >> 172.21.15.62:0/1912491761 conn(0x7f9070071d00 msgr2=0x7f90700f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 shutdown_connections 2024-05-09T06:40:10.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.202+0000 7f9075a97700 1 -- 172.21.15.62:0/1912491761 wait complete. 2024-05-09T06:40:10.184 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 33 2024-05-09T06:40:10.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.318+0000 7f6b07172700 1 -- 172.21.15.62:0/2180268762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00065640 msgr2=0x7f6b00065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.318+0000 7f6b07172700 1 --2- 172.21.15.62:0/2180268762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00065640 0x7f6b00065ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6aec004940 tx=0x7f6aec009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.318+0000 7f6b07172700 1 -- 172.21.15.62:0/2180268762 shutdown_connections 2024-05-09T06:40:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.318+0000 7f6b07172700 1 --2- 172.21.15.62:0/2180268762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00065640 0x7f6b00065ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.318+0000 7f6b07172700 1 --2- 172.21.15.62:0/2180268762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b00102e50 0x7f6b00103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.318+0000 7f6b07172700 1 -- 172.21.15.62:0/2180268762 >> 172.21.15.62:0/2180268762 conn(0x7f6b00071d00 msgr2=0x7f6b00072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.319+0000 7f6b07172700 1 -- 172.21.15.62:0/2180268762 shutdown_connections 2024-05-09T06:40:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.319+0000 7f6b07172700 1 -- 172.21.15.62:0/2180268762 wait complete. 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.319+0000 7f6b07172700 1 Processor -- start 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.319+0000 7f6b07172700 1 -- start start 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6b07172700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b00065640 0x7f6b00113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6b07172700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00102e50 0x7f6b001140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6b07172700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b00114780 con 0x7f6b00102e50 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6b07172700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0010dae0 con 0x7f6b00065640 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6afffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00102e50 0x7f6b001140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6afffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00102e50 0x7f6b001140a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42040/0 (socket says 172.21.15.62:42040) 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6afffff700 1 -- 172.21.15.62:0/2321979147 learned_addr learned my addr 172.21.15.62:0/2321979147 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6b04f0e700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b00065640 0x7f6b00113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6afffff700 1 -- 172.21.15.62:0/2321979147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b00065640 msgr2=0x7f6b00113b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6afffff700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b00065640 0x7f6b00113b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6afffff700 1 -- 172.21.15.62:0/2321979147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec005040 con 0x7f6b00102e50 2024-05-09T06:40:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.320+0000 7f6afffff700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00102e50 0x7f6b001140a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00b8b0 tx=0x7f6aec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.321+0000 7f6afd7fa700 1 -- 172.21.15.62:0/2321979147 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aec00e040 con 0x7f6b00102e50 2024-05-09T06:40:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.321+0000 7f6afd7fa700 1 -- 172.21.15.62:0/2321979147 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6aec004290 con 0x7f6b00102e50 2024-05-09T06:40:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.321+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0010dd60 con 0x7f6b00102e50 2024-05-09T06:40:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.321+0000 7f6afd7fa700 1 -- 172.21.15.62:0/2321979147 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aec01c3f0 con 0x7f6b00102e50 2024-05-09T06:40:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.321+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0010e320 con 0x7f6b00102e50 2024-05-09T06:40:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.322+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b000fe540 con 0x7f6b00102e50 2024-05-09T06:40:10.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.323+0000 7f6afd7fa700 1 -- 172.21.15.62:0/2321979147 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f6aec0137b0 con 0x7f6b00102e50 2024-05-09T06:40:10.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.324+0000 7f6afd7fa700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6af0078990 0x7f6af007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:10.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.324+0000 7f6b04f0e700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6af0078990 0x7f6af007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:10.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.324+0000 7f6afd7fa700 1 -- 172.21.15.62:0/2321979147 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f6aec09c760 con 0x7f6b00102e50 2024-05-09T06:40:10.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.324+0000 7f6b04f0e700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6af0078990 0x7f6af007ae40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6af4006fd0 tx=0x7f6af4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.328+0000 7f6afd7fa700 1 -- 172.21.15.62:0/2321979147 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6aec064250 con 0x7f6b00102e50 2024-05-09T06:40:10.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.568+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b00109f70 con 0x7f6af0078990 2024-05-09T06:40:10.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.569+0000 7f6afd7fa700 1 -- 172.21.15.62:0/2321979147 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6b00109f70 con 0x7f6af0078990 2024-05-09T06:40:10.549 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:40:10.549 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:40:10.549 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "mon", 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr", 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "osd" 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "15/21 daemons upgraded", 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:40:10.550 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6af0078990 msgr2=0x7f6af007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6af0078990 0x7f6af007ae40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6af4006fd0 tx=0x7f6af4008040 comp rx=0 tx=0).stop 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00102e50 msgr2=0x7f6b001140a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00102e50 0x7f6b001140a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00b8b0 tx=0x7f6aec009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 shutdown_connections 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b00065640 0x7f6b00113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6af0078990 0x7f6af007ae40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 --2- 172.21.15.62:0/2321979147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b00102e50 0x7f6b001140a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.571+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 >> 172.21.15.62:0/2321979147 conn(0x7f6b00071d00 msgr2=0x7f6b000f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.572+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 shutdown_connections 2024-05-09T06:40:10.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.572+0000 7f6b07172700 1 -- 172.21.15.62:0/2321979147 wait complete. 2024-05-09T06:40:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.679+0000 7ff8c7b32700 1 -- 172.21.15.62:0/1212659500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 msgr2=0x7ff8c0070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.679+0000 7ff8c7b32700 1 --2- 172.21.15.62:0/1212659500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 0x7ff8c0070cb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0004970 tx=0x7ff8b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.679+0000 7ff8c7b32700 1 -- 172.21.15.62:0/1212659500 shutdown_connections 2024-05-09T06:40:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.679+0000 7ff8c7b32700 1 --2- 172.21.15.62:0/1212659500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 0x7ff8c0070cb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.679+0000 7ff8c7b32700 1 --2- 172.21.15.62:0/1212659500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c0071f30 0x7ff8c0070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.680+0000 7ff8c7b32700 1 -- 172.21.15.62:0/1212659500 >> 172.21.15.62:0/1212659500 conn(0x7ff8c00f8980 msgr2=0x7ff8c00fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:10.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.680+0000 7ff8c7b32700 1 -- 172.21.15.62:0/1212659500 shutdown_connections 2024-05-09T06:40:10.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.680+0000 7ff8c7b32700 1 -- 172.21.15.62:0/1212659500 wait complete. 2024-05-09T06:40:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.680+0000 7ff8c7b32700 1 Processor -- start 2024-05-09T06:40:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.680+0000 7ff8c7b32700 1 -- start start 2024-05-09T06:40:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.680+0000 7ff8c7b32700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 0x7ff8c011a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.680+0000 7ff8c7b32700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c0071f30 0x7ff8c011a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c7b32700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c011acf0 con 0x7ff8c0070840 2024-05-09T06:40:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c7b32700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c01140c0 con 0x7ff8c0071f30 2024-05-09T06:40:10.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c58ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 0x7ff8c011a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c58ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 0x7ff8c011a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42054/0 (socket says 172.21.15.62:42054) 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c58ce700 1 -- 172.21.15.62:0/3888337701 learned_addr learned my addr 172.21.15.62:0/3888337701 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c50cd700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c0071f30 0x7ff8c011a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c58ce700 1 -- 172.21.15.62:0/3888337701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c0071f30 msgr2=0x7ff8c011a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c58ce700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c0071f30 0x7ff8c011a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c58ce700 1 -- 172.21.15.62:0/3888337701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0005040 con 0x7ff8c0070840 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c58ce700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 0x7ff8c011a160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c8c0 tx=0x7ff8bc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8b67fc700 1 -- 172.21.15.62:0/3888337701 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc00a760 con 0x7ff8c0070840 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c01143a0 con 0x7ff8c0070840 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.681+0000 7ff8b67fc700 1 -- 172.21.15.62:0/3888337701 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8bc00ad90 con 0x7ff8c0070840 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.682+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c01148b0 con 0x7ff8c0070840 2024-05-09T06:40:10.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.682+0000 7ff8b67fc700 1 -- 172.21.15.62:0/3888337701 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc0113a0 con 0x7ff8c0070840 2024-05-09T06:40:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.682+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c0071a40 con 0x7ff8c0070840 2024-05-09T06:40:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.683+0000 7ff8b67fc700 1 -- 172.21.15.62:0/3888337701 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7ff8bc012400 con 0x7ff8c0070840 2024-05-09T06:40:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.684+0000 7ff8b67fc700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8ac078990 0x7ff8ac07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.684+0000 7ff8b67fc700 1 -- 172.21.15.62:0/3888337701 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7ff8bc09b510 con 0x7ff8c0070840 2024-05-09T06:40:10.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.684+0000 7ff8c50cd700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8ac078990 0x7ff8ac07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:10.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.685+0000 7ff8c50cd700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8ac078990 0x7ff8ac07ae40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0004f50 tx=0x7ff8b0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:10.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:10.692+0000 7ff8b67fc700 1 -- 172.21.15.62:0/3888337701 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ff8bc063000 con 0x7ff8c0070840 2024-05-09T06:40:10.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:10 smithi079 ceph-mon[82381]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:10.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:10 smithi079 ceph-mon[82381]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:10.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:10 smithi079 ceph-mon[82381]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:10.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:10 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1426255527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:10.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:10 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:40:10.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:10 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1912491761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:40:10.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:10 smithi062 ceph-mon[109590]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:10.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:10 smithi062 ceph-mon[109590]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:10.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:10 smithi062 ceph-mon[109590]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:10.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:10 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1426255527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:10.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:10 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:40:10.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:10 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1912491761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:40:10.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.011+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff8c005f5c0 con 0x7ff8c0070840 2024-05-09T06:40:10.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.011+0000 7ff8b67fc700 1 -- 172.21.15.62:0/3888337701 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7ff8bc0629a0 con 0x7ff8c0070840 2024-05-09T06:40:10.992 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:10.992 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-05-09T06:40:10.992 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs is degraded 2024-05-09T06:40:10.992 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:10.992 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8ac078990 msgr2=0x7ff8ac07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8ac078990 0x7ff8ac07ae40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0004f50 tx=0x7ff8b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 msgr2=0x7ff8c011a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 0x7ff8c011a160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c8c0 tx=0x7ff8bc0044c0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 shutdown_connections 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8ac078990 0x7ff8ac07ae40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8c0070840 0x7ff8c011a160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 --2- 172.21.15.62:0/3888337701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c0071f30 0x7ff8c011a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:10.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 >> 172.21.15.62:0/3888337701 conn(0x7ff8c00f8980 msgr2=0x7ff8c00f9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:10.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 shutdown_connections 2024-05-09T06:40:10.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:11.014+0000 7ff8c7b32700 1 -- 172.21.15.62:0/3888337701 wait complete. 2024-05-09T06:40:11.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:11 smithi079 ceph-mon[82381]: pgmap v221: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 1023 KiB/s rd, 1 op/s 2024-05-09T06:40:11.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:11 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3888337701' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:40:11.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:11 smithi062 ceph-mon[109590]: pgmap v221: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 1023 KiB/s rd, 1 op/s 2024-05-09T06:40:11.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:11 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3888337701' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:40:12.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:12 smithi079 ceph-mon[82381]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:12.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:12 smithi062 ceph-mon[109590]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:13.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:13 smithi079 ceph-mon[82381]: pgmap v222: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 1 op/s 2024-05-09T06:40:13.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:13 smithi062 ceph-mon[109590]: pgmap v222: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 1 op/s 2024-05-09T06:40:15.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:15 smithi079 ceph-mon[82381]: pgmap v223: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-05-09T06:40:15.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:15 smithi062 ceph-mon[109590]: pgmap v223: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-05-09T06:40:17.712 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:17 smithi062 ceph-mon[109590]: pgmap v224: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-05-09T06:40:17.756 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:17 smithi079 ceph-mon[82381]: pgmap v224: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-05-09T06:40:18.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:18 smithi079 ceph-mon[82381]: reconnect by client.14526 v1:192.168.0.1:0/2072281023 after 0 2024-05-09T06:40:18.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:18 smithi079 ceph-mon[82381]: reconnect by client.14532 v1:172.21.15.79:0/875005746 after 0 2024-05-09T06:40:18.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:18 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] up:reconnect 2024-05-09T06:40:18.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:18 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi062.etsgzx=up:reconnect} 2 up:standby 2024-05-09T06:40:18.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:18 smithi062 ceph-mon[109590]: reconnect by client.14526 v1:192.168.0.1:0/2072281023 after 0 2024-05-09T06:40:18.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:18 smithi062 ceph-mon[109590]: reconnect by client.14532 v1:172.21.15.79:0/875005746 after 0 2024-05-09T06:40:18.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:18 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] up:reconnect 2024-05-09T06:40:18.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:18 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi062.etsgzx=up:reconnect} 2 up:standby 2024-05-09T06:40:19.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:19 smithi079 ceph-mon[82381]: pgmap v225: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:19.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:19 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] up:rejoin 2024-05-09T06:40:19.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:19 smithi079 ceph-mon[82381]: fsmap cephfs:1/1 {0=cephfs.smithi062.etsgzx=up:rejoin} 2 up:standby 2024-05-09T06:40:19.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:19 smithi079 ceph-mon[82381]: daemon mds.cephfs.smithi062.etsgzx is now active in filesystem cephfs as rank 0 2024-05-09T06:40:19.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:19 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:19.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:19 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:19.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:19 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:19.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:19 smithi062 ceph-mon[109590]: pgmap v225: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:19.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:19 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] up:rejoin 2024-05-09T06:40:19.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:19 smithi062 ceph-mon[109590]: fsmap cephfs:1/1 {0=cephfs.smithi062.etsgzx=up:rejoin} 2 up:standby 2024-05-09T06:40:19.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:19 smithi062 ceph-mon[109590]: daemon mds.cephfs.smithi062.etsgzx is now active in filesystem cephfs as rank 0 2024-05-09T06:40:19.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:19 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:19.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:19 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:19.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:19 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:20.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:20 smithi079 ceph-mon[82381]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:40:20.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:20 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] up:active 2024-05-09T06:40:20.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:20 smithi079 ceph-mon[82381]: mds.? [v2:172.21.15.79:6826/2608114839,v1:172.21.15.79:6827/2608114839] up:boot 2024-05-09T06:40:20.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:20 smithi079 ceph-mon[82381]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:40:20.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:20 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:40:20.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:20 smithi062 ceph-mon[109590]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:40:20.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:20 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] up:active 2024-05-09T06:40:20.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:20 smithi062 ceph-mon[109590]: mds.? [v2:172.21.15.79:6826/2608114839,v1:172.21.15.79:6827/2608114839] up:boot 2024-05-09T06:40:20.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:20 smithi062 ceph-mon[109590]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:40:20.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:20 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:40:21.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:21 smithi079 ceph-mon[82381]: pgmap v226: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:21.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:21 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:21.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:21 smithi062 ceph-mon[109590]: pgmap v226: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:21.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:21.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:21 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:23.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:23 smithi079 ceph-mon[82381]: pgmap v227: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T06:40:23.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:23 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:23.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:23 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:23.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:23 smithi062 ceph-mon[109590]: pgmap v227: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T06:40:23.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:23 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:23.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:23 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:25.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:25 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:25.342 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:25 smithi079 ceph-mon[82381]: pgmap v228: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T06:40:25.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:25.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:25 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:25.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:25 smithi062 ceph-mon[109590]: pgmap v228: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T06:40:26.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:26.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:26.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:26.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:26.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all mds 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi062.bwemju"}]': finished 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:40:26.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi062.etsgzx"}]': finished 2024-05-09T06:40:26.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:40:26.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.pdxygz"}]': finished 2024-05-09T06:40:26.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:40:26.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.qwqgdo"}]': finished 2024-05-09T06:40:26.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: Upgrade: Setting filesystem cephfs Joinable 2024-05-09T06:40:26.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-05-09T06:40:26.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:26 smithi079 ceph-mon[82381]: pgmap v229: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T06:40:26.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:26.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:26.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:26.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:26.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:26.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:26.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.911 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all mds 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi062.bwemju"}]: dispatch 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi062.bwemju"}]': finished 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi062.etsgzx"}]: dispatch 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi062.etsgzx"}]': finished 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.pdxygz"}]: dispatch 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.pdxygz"}]': finished 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.qwqgdo"}]: dispatch 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.qwqgdo"}]': finished 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: Upgrade: Setting filesystem cephfs Joinable 2024-05-09T06:40:26.912 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-05-09T06:40:26.913 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:26 smithi062 ceph-mon[109590]: pgmap v229: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T06:40:28.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all rgw 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all iscsi 2024-05-09T06:40:28.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all nfs 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: Upgrade: Setting container_image for all nvmeof 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.094 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: Upgrade: Finalizing container_image settings 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T06:40:28.095 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T06:40:28.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: Upgrade: Complete! 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:28.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:28.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:28.098 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-05-09T06:40:28.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: fsmap cephfs:1 {0=cephfs.smithi062.etsgzx=up:active} 3 up:standby 2024-05-09T06:40:28.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all rgw 2024-05-09T06:40:28.161 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all iscsi 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all nfs 2024-05-09T06:40:28.162 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: Upgrade: Setting container_image for all nvmeof 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: Upgrade: Finalizing container_image settings 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.163 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T06:40:28.164 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: Upgrade: Complete! 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T06:40:28.165 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T06:40:28.166 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:28.166 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:28.166 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:28.166 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:28.166 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:28.166 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:28.166 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:28.166 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:29.091 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:28 smithi079 ceph-mon[82381]: pgmap v230: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-05-09T06:40:29.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:28 smithi062 ceph-mon[109590]: pgmap v230: 65 pgs: 65 active+clean; 195 MiB data, 815 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-05-09T06:40:30.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:30 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:30.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:30 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:40:31.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:31 smithi079 ceph-mon[82381]: pgmap v231: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T06:40:31.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:31 smithi062 ceph-mon[109590]: pgmap v231: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T06:40:33.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:33 smithi079 ceph-mon[82381]: pgmap v232: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 42 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T06:40:33.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:33 smithi062 ceph-mon[109590]: pgmap v232: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 42 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T06:40:35.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:35 smithi079 ceph-mon[82381]: pgmap v233: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 4.3 KiB/s wr, 3 op/s 2024-05-09T06:40:35.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:35 smithi062 ceph-mon[109590]: pgmap v233: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 4.3 KiB/s wr, 3 op/s 2024-05-09T06:40:37.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:37 smithi079 ceph-mon[82381]: pgmap v234: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-05-09T06:40:37.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:37 smithi062 ceph-mon[109590]: pgmap v234: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-05-09T06:40:39.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:39 smithi079 ceph-mon[82381]: pgmap v235: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-09T06:40:39.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:39.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:39 smithi062 ceph-mon[109590]: pgmap v235: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-09T06:40:39.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.135+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/3291615807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 msgr2=0x7fc5e8070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:41.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.135+0000 7fc5ef5b6700 1 --2- 172.21.15.62:0/3291615807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 0x7fc5e8070650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4004940 tx=0x7fc5e4009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.135+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/3291615807 shutdown_connections 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.135+0000 7fc5ef5b6700 1 --2- 172.21.15.62:0/3291615807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e8070b90 0x7fc5e8109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.135+0000 7fc5ef5b6700 1 --2- 172.21.15.62:0/3291615807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 0x7fc5e8070650 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.135+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/3291615807 >> 172.21.15.62:0/3291615807 conn(0x7fc5e80f8990 msgr2=0x7fc5e80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.135+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/3291615807 shutdown_connections 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.135+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/3291615807 wait complete. 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ef5b6700 1 Processor -- start 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ef5b6700 1 -- start start 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ef5b6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 0x7fc5e8115a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ef5b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e8070b90 0x7fc5e8115f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ef5b6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81165c0 con 0x7fc5e8070280 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ef5b6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e810fc50 con 0x7fc5e8070b90 2024-05-09T06:40:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ed352700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 0x7fc5e8115a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ed352700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 0x7fc5e8115a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53862/0 (socket says 172.21.15.62:53862) 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.136+0000 7fc5ed352700 1 -- 172.21.15.62:0/2841626473 learned_addr learned my addr 172.21.15.62:0/2841626473 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ecb51700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e8070b90 0x7fc5e8115f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ed352700 1 -- 172.21.15.62:0/2841626473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e8070b90 msgr2=0x7fc5e8115f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ed352700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e8070b90 0x7fc5e8115f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ed352700 1 -- 172.21.15.62:0/2841626473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e4005040 con 0x7fc5e8070280 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ed352700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 0x7fc5e8115a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40091a0 tx=0x7fc5e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ddffb700 1 -- 172.21.15.62:0/2841626473 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5e400e030 con 0x7fc5e8070280 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ddffb700 1 -- 172.21.15.62:0/2841626473 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5e4004290 con 0x7fc5e8070280 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e810fed0 con 0x7fc5e8070280 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ddffb700 1 -- 172.21.15.62:0/2841626473 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5e400b650 con 0x7fc5e8070280 2024-05-09T06:40:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.137+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e8110410 con 0x7fc5e8070280 2024-05-09T06:40:41.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.139+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e80719c0 con 0x7fc5e8070280 2024-05-09T06:40:41.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.139+0000 7fc5ddffb700 1 -- 172.21.15.62:0/2841626473 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc5e4013cd0 con 0x7fc5e8070280 2024-05-09T06:40:41.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.140+0000 7fc5ddffb700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5d4078980 0x7fc5d407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:41.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.140+0000 7fc5ddffb700 1 -- 172.21.15.62:0/2841626473 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fc5e409c590 con 0x7fc5e8070280 2024-05-09T06:40:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.140+0000 7fc5ecb51700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5d4078980 0x7fc5d407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:41.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.140+0000 7fc5ecb51700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5d4078980 0x7fc5d407ae30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8004600 tx=0x7fc5d800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:41.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.145+0000 7fc5ddffb700 1 -- 172.21.15.62:0/2841626473 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc5e4064060 con 0x7fc5e8070280 2024-05-09T06:40:41.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:41 smithi079 ceph-mon[82381]: pgmap v236: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:41.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.379+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e810c0c0 con 0x7fc5d4078980 2024-05-09T06:40:41.359 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:41 smithi062 ceph-mon[109590]: pgmap v236: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:41.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.380+0000 7fc5ddffb700 1 -- 172.21.15.62:0/2841626473 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc5e810c0c0 con 0x7fc5d4078980 2024-05-09T06:40:41.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5d4078980 msgr2=0x7fc5d407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:41.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5d4078980 0x7fc5d407ae30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8004600 tx=0x7fc5d800b040 comp rx=0 tx=0).stop 2024-05-09T06:40:41.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 msgr2=0x7fc5e8115a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 0x7fc5e8115a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40091a0 tx=0x7fc5e4009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 shutdown_connections 2024-05-09T06:40:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc5d4078980 0x7fc5d407ae30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5e8070280 0x7fc5e8115a30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 --2- 172.21.15.62:0/2841626473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5e8070b90 0x7fc5e8115f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 >> 172.21.15.62:0/2841626473 conn(0x7fc5e80f8990 msgr2=0x7fc5e80f9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 shutdown_connections 2024-05-09T06:40:41.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:41.382+0000 7fc5ef5b6700 1 -- 172.21.15.62:0/2841626473 wait complete. 2024-05-09T06:40:42.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch ps' 2024-05-09T06:40:42.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:42 smithi062 ceph-mon[109590]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:42.526 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:40:42.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:42 smithi079 ceph-mon[82381]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:43.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:43 smithi062 ceph-mon[109590]: pgmap v237: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:43.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:43 smithi079 ceph-mon[82381]: pgmap v237: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.406+0000 7f80f62b9700 1 -- 172.21.15.62:0/1526746610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 msgr2=0x7f80f00fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.406+0000 7f80f62b9700 1 --2- 172.21.15.62:0/1526746610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 0x7f80f00fc1b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f80d8004940 tx=0x7f80d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.406+0000 7f80f62b9700 1 -- 172.21.15.62:0/1526746610 shutdown_connections 2024-05-09T06:40:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.406+0000 7f80f62b9700 1 --2- 172.21.15.62:0/1526746610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 0x7f80f00fc1b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.406+0000 7f80f62b9700 1 --2- 172.21.15.62:0/1526746610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80f0101d90 0x7f80f0102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.406+0000 7f80f62b9700 1 -- 172.21.15.62:0/1526746610 >> 172.21.15.62:0/1526746610 conn(0x7f80f0071d00 msgr2=0x7f80f0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:44.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.406+0000 7f80f62b9700 1 -- 172.21.15.62:0/1526746610 shutdown_connections 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.406+0000 7f80f62b9700 1 -- 172.21.15.62:0/1526746610 wait complete. 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80f62b9700 1 Processor -- start 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80f62b9700 1 -- start start 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80f62b9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 0x7f80f0113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80f62b9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80f0101d90 0x7f80f01140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80f62b9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0114740 con 0x7f80f00fbd40 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80f62b9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f010db30 con 0x7f80f0101d90 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 0x7f80f0113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 0x7f80f0113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35222/0 (socket says 172.21.15.62:35222) 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80effff700 1 -- 172.21.15.62:0/4063916905 learned_addr learned my addr 172.21.15.62:0/4063916905 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.407+0000 7f80e7fff700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80f0101d90 0x7f80f01140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80effff700 1 -- 172.21.15.62:0/4063916905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80f0101d90 msgr2=0x7f80f01140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80effff700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80f0101d90 0x7f80f01140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:44.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80effff700 1 -- 172.21.15.62:0/4063916905 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8005040 con 0x7f80f00fbd40 2024-05-09T06:40:44.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80effff700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 0x7f80f0113bb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f80e0002a50 tx=0x7f80e00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:44.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80ed7fa700 1 -- 172.21.15.62:0/4063916905 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e0007cc0 con 0x7f80f00fbd40 2024-05-09T06:40:44.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80ed7fa700 1 -- 172.21.15.62:0/4063916905 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80e000f040 con 0x7f80f00fbd40 2024-05-09T06:40:44.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f010de10 con 0x7f80f00fbd40 2024-05-09T06:40:44.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80ed7fa700 1 -- 172.21.15.62:0/4063916905 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e000da30 con 0x7f80f00fbd40 2024-05-09T06:40:44.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.408+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f010e3a0 con 0x7f80f00fbd40 2024-05-09T06:40:44.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.409+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f00fd430 con 0x7f80f00fbd40 2024-05-09T06:40:44.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.410+0000 7f80ed7fa700 1 -- 172.21.15.62:0/4063916905 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f80e000db90 con 0x7f80f00fbd40 2024-05-09T06:40:44.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.410+0000 7f80ed7fa700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f80dc078990 0x7f80dc07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:44.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.411+0000 7f80ed7fa700 1 -- 172.21.15.62:0/4063916905 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f80e009a690 con 0x7f80f00fbd40 2024-05-09T06:40:44.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.411+0000 7f80e7fff700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f80dc078990 0x7f80dc07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:44.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.411+0000 7f80e7fff700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f80dc078990 0x7f80dc07ae40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80f010ee10 tx=0x7f80d8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:44.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.415+0000 7f80ed7fa700 1 -- 172.21.15.62:0/4063916905 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f80e00620e0 con 0x7f80f00fbd40 2024-05-09T06:40:44.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.638+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f80f0108df0 con 0x7f80dc078990 2024-05-09T06:40:44.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.649+0000 7f80ed7fa700 1 -- 172.21.15.62:0/4063916905 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f80f0108df0 con 0x7f80dc078990 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (7m) 67s ago 19m 25.9M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (5m) 67s ago 19m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (5m) 23s ago 18m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (7m) 67s ago 18m 80.5M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (72s) 67s ago 13m 15.2M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 43065134ffb6 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (101s) 67s ago 13m 14.3M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 46146b741422 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (26s) 23s ago 13m 11.4M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fef84f9e6df9 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (51s) 23s ago 13m 15.2M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 be2130e50081 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (9m) 67s ago 20m 525M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (8m) 23s ago 17m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:40:44.630 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (6m) 67s ago 20m 55.2M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (6m) 23s ago 17m 44.1M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (8m) 67s ago 19m 15.0M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (8m) 23s ago 17m 16.8M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (4m) 67s ago 17m 149M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (4m) 67s ago 16m 135M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (3m) 67s ago 16m 107M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 89acd3b9ad68 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (3m) 23s ago 15m 115M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 8d7a05b6e02c 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (2m) 23s ago 15m 106M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 874246927b69 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (118s) 23s ago 14m 104M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 486b85997c37 2024-05-09T06:40:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (8m) 67s ago 18m 66.8M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:40:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f80dc078990 msgr2=0x7f80dc07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f80dc078990 0x7f80dc07ae40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80f010ee10 tx=0x7f80d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 msgr2=0x7f80f0113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 0x7f80f0113bb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f80e0002a50 tx=0x7f80e00046b0 comp rx=0 tx=0).stop 2024-05-09T06:40:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 shutdown_connections 2024-05-09T06:40:44.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f80dc078990 0x7f80dc07ae40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80f00fbd40 0x7f80f0113bb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 --2- 172.21.15.62:0/4063916905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80f0101d90 0x7f80f01140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 >> 172.21.15.62:0/4063916905 conn(0x7f80f0071d00 msgr2=0x7f80f00655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 shutdown_connections 2024-05-09T06:40:44.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:44.652+0000 7f80f62b9700 1 -- 172.21.15.62:0/4063916905 wait complete. 2024-05-09T06:40:45.367 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:45 smithi062 ceph-mon[109590]: pgmap v238: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:45.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch upgrade status' 2024-05-09T06:40:45.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:45 smithi079 ceph-mon[82381]: pgmap v238: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:40:46.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:46 smithi062 ceph-mon[109590]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:46.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:46 smithi079 ceph-mon[82381]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.381+0000 7f486c88d700 1 -- 172.21.15.62:0/4252458169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 msgr2=0x7f4868103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.381+0000 7f486c88d700 1 --2- 172.21.15.62:0/4252458169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 0x7f4868103330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4858009ce0 tx=0x7f4858004d10 comp rx=0 tx=0).stop 2024-05-09T06:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.381+0000 7f486c88d700 1 -- 172.21.15.62:0/4252458169 shutdown_connections 2024-05-09T06:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.381+0000 7f486c88d700 1 --2- 172.21.15.62:0/4252458169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48680fb520 0x7f48680fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.381+0000 7f486c88d700 1 --2- 172.21.15.62:0/4252458169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 0x7f4868103330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.381+0000 7f486c88d700 1 -- 172.21.15.62:0/4252458169 >> 172.21.15.62:0/4252458169 conn(0x7f48680714d0 msgr2=0x7f48680718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.381+0000 7f486c88d700 1 -- 172.21.15.62:0/4252458169 shutdown_connections 2024-05-09T06:40:47.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.381+0000 7f486c88d700 1 -- 172.21.15.62:0/4252458169 wait complete. 2024-05-09T06:40:47.363 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:47 smithi062 ceph-mon[109590]: pgmap v239: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f486c88d700 1 Processor -- start 2024-05-09T06:40:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f486c88d700 1 -- start start 2024-05-09T06:40:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f486c88d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48680fb520 0x7f4868113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:47.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f486c88d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 0x7f4868114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f486c88d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48681146b0 con 0x7f4868102f60 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f486c88d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486810dc90 con 0x7f48680fb520 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f4865d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 0x7f4868114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f4865d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 0x7f4868114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35246/0 (socket says 172.21.15.62:35246) 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f4865d9b700 1 -- 172.21.15.62:0/1329096544 learned_addr learned my addr 172.21.15.62:0/1329096544 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f486659c700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48680fb520 0x7f4868113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f4865d9b700 1 -- 172.21.15.62:0/1329096544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48680fb520 msgr2=0x7f4868113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f4865d9b700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48680fb520 0x7f4868113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f4865d9b700 1 -- 172.21.15.62:0/1329096544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858009940 con 0x7f4868102f60 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.382+0000 7f486659c700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48680fb520 0x7f4868113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.383+0000 7f4865d9b700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 0x7f4868114060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f485c002a50 tx=0x7f485c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.383+0000 7f4856ffd700 1 -- 172.21.15.62:0/1329096544 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485c007cc0 con 0x7f4868102f60 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.383+0000 7f4856ffd700 1 -- 172.21.15.62:0/1329096544 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f485c00f040 con 0x7f4868102f60 2024-05-09T06:40:47.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.383+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486810df70 con 0x7f4868102f60 2024-05-09T06:40:47.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.383+0000 7f4856ffd700 1 -- 172.21.15.62:0/1329096544 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485c009640 con 0x7f4868102f60 2024-05-09T06:40:47.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.383+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486810e4b0 con 0x7f4868102f60 2024-05-09T06:40:47.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.384+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4868100250 con 0x7f4868102f60 2024-05-09T06:40:47.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.385+0000 7f4856ffd700 1 -- 172.21.15.62:0/1329096544 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f485c0097c0 con 0x7f4868102f60 2024-05-09T06:40:47.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.385+0000 7f4856ffd700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4850078990 0x7f485007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:47.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.385+0000 7f4856ffd700 1 -- 172.21.15.62:0/1329096544 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f485c09a5e0 con 0x7f4868102f60 2024-05-09T06:40:47.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.386+0000 7f486659c700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4850078990 0x7f485007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:47.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.386+0000 7f486659c700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4850078990 0x7f485007ae40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f485800b740 tx=0x7f4858004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:47.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.390+0000 7f4856ffd700 1 -- 172.21.15.62:0/1329096544 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f485c0620b0 con 0x7f4868102f60 2024-05-09T06:40:47.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:47 smithi079 ceph-mon[82381]: pgmap v239: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:47.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.623+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f486810f1e0 con 0x7f4850078990 2024-05-09T06:40:47.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.624+0000 7f4856ffd700 1 -- 172.21.15.62:0/1329096544 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f486810f1e0 con 0x7f4850078990 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": null, 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": false, 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "", 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": null, 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "", 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-05-09T06:40:47.605 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4850078990 msgr2=0x7f485007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4850078990 0x7f485007ae40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f485800b740 tx=0x7f4858004d10 comp rx=0 tx=0).stop 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 msgr2=0x7f4868114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 0x7f4868114060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f485c002a50 tx=0x7f485c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 shutdown_connections 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48680fb520 0x7f4868113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4850078990 0x7f485007ae40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 --2- 172.21.15.62:0/1329096544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4868102f60 0x7f4868114060 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:47.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 >> 172.21.15.62:0/1329096544 conn(0x7f48680714d0 msgr2=0x7f48680fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:47.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 shutdown_connections 2024-05-09T06:40:47.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:47.627+0000 7f486c88d700 1 -- 172.21.15.62:0/1329096544 wait complete. 2024-05-09T06:40:48.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph health detail' 2024-05-09T06:40:48.638 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:40:49.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:49 smithi062 ceph-mon[109590]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:49.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:49 smithi062 ceph-mon[109590]: pgmap v240: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:49.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:49 smithi079 ceph-mon[82381]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:49.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:49 smithi079 ceph-mon[82381]: pgmap v240: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:50.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 -- 172.21.15.62:0/1575567593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8101ce0 msgr2=0x7fd6d81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:50.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 --2- 172.21.15.62:0/1575567593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8101ce0 0x7fd6d81020b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8004940 tx=0x7fd6c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:50.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 -- 172.21.15.62:0/1575567593 shutdown_connections 2024-05-09T06:40:50.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 --2- 172.21.15.62:0/1575567593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d8102680 0x7fd6d80fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:50.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 --2- 172.21.15.62:0/1575567593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8101ce0 0x7fd6d81020b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:50.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 -- 172.21.15.62:0/1575567593 >> 172.21.15.62:0/1575567593 conn(0x7fd6d80f7890 msgr2=0x7fd6d80f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:50.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 -- 172.21.15.62:0/1575567593 shutdown_connections 2024-05-09T06:40:50.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 -- 172.21.15.62:0/1575567593 wait complete. 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.328+0000 7fd6de644700 1 Processor -- start 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6de644700 1 -- start start 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6de644700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d8101ce0 0x7fd6d8113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6de644700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8102680 0x7fd6d81140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6de644700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d81146f0 con 0x7fd6d8102680 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6de644700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d810dae0 con 0x7fd6d8101ce0 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6cffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8102680 0x7fd6d81140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6cffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8102680 0x7fd6d81140a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35270/0 (socket says 172.21.15.62:35270) 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6cffff700 1 -- 172.21.15.62:0/3182575087 learned_addr learned my addr 172.21.15.62:0/3182575087 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6d7fff700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d8101ce0 0x7fd6d8113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6cffff700 1 -- 172.21.15.62:0/3182575087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d8101ce0 msgr2=0x7fd6d8113b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:50.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6cffff700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d8101ce0 0x7fd6d8113b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6cffff700 1 -- 172.21.15.62:0/3182575087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8005040 con 0x7fd6d8102680 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6d7fff700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d8101ce0 0x7fd6d8113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.329+0000 7fd6cffff700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8102680 0x7fd6d81140a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000c800 tx=0x7fd6c0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.330+0000 7fd6d57fa700 1 -- 172.21.15.62:0/3182575087 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c000a760 con 0x7fd6d8102680 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.330+0000 7fd6d57fa700 1 -- 172.21.15.62:0/3182575087 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6c000ad90 con 0x7fd6d8102680 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.330+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d810ddc0 con 0x7fd6d8102680 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.330+0000 7fd6d57fa700 1 -- 172.21.15.62:0/3182575087 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c00113a0 con 0x7fd6d8102680 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.330+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d810e380 con 0x7fd6d8102680 2024-05-09T06:40:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.331+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80fd430 con 0x7fd6d8102680 2024-05-09T06:40:50.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.331+0000 7fd6d57fa700 1 -- 172.21.15.62:0/3182575087 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fd6c0012400 con 0x7fd6d8102680 2024-05-09T06:40:50.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.332+0000 7fd6d57fa700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd6c4078990 0x7fd6c407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:50.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.332+0000 7fd6d57fa700 1 -- 172.21.15.62:0/3182575087 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fd6c009a910 con 0x7fd6d8102680 2024-05-09T06:40:50.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.332+0000 7fd6d7fff700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd6c4078990 0x7fd6c407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:50.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.332+0000 7fd6d7fff700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd6c4078990 0x7fd6c407ae40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8004560 tx=0x7fd6c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:50.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.337+0000 7fd6d57fa700 1 -- 172.21.15.62:0/3182575087 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fd6c00623e0 con 0x7fd6d8102680 2024-05-09T06:40:50.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.644+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd6d804bed0 con 0x7fd6d8102680 2024-05-09T06:40:50.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.644+0000 7fd6d57fa700 1 -- 172.21.15.62:0/3182575087 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd6c0061d80 con 0x7fd6d8102680 2024-05-09T06:40:50.624 INFO:teuthology.orchestra.run.smithi062.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:50.624 INFO:teuthology.orchestra.run.smithi062.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:50.625 INFO:teuthology.orchestra.run.smithi062.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.647+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd6c4078990 msgr2=0x7fd6c407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.647+0000 7fd6de644700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd6c4078990 0x7fd6c407ae40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8004560 tx=0x7fd6c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.647+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8102680 msgr2=0x7fd6d81140a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.647+0000 7fd6de644700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8102680 0x7fd6d81140a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000c800 tx=0x7fd6c0004470 comp rx=0 tx=0).stop 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.647+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 shutdown_connections 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.647+0000 7fd6de644700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6d8101ce0 0x7fd6d8113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.648+0000 7fd6de644700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fd6c4078990 0x7fd6c407ae40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.648+0000 7fd6de644700 1 --2- 172.21.15.62:0/3182575087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6d8102680 0x7fd6d81140a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.648+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 >> 172.21.15.62:0/3182575087 conn(0x7fd6d80f7890 msgr2=0x7fd6d80f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.648+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 shutdown_connections 2024-05-09T06:40:50.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:50.648+0000 7fd6de644700 1 -- 172.21.15.62:0/3182575087 wait complete. 2024-05-09T06:40:51.207 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:51 smithi062 ceph-mon[109590]: pgmap v241: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:51.207 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:51 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3182575087' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:40:51.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions' 2024-05-09T06:40:51.509 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:40:51.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:51 smithi079 ceph-mon[82381]: pgmap v241: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:51.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:51 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3182575087' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:40:53.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.057+0000 7f72aa1c9700 1 -- 172.21.15.62:0/2830928827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a40fbd40 msgr2=0x7f72a40fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:53.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.057+0000 7f72aa1c9700 1 --2- 172.21.15.62:0/2830928827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a40fbd40 0x7f72a40fc1b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f728c004940 tx=0x7f728c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:53.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.057+0000 7f72aa1c9700 1 -- 172.21.15.62:0/2830928827 shutdown_connections 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.057+0000 7f72aa1c9700 1 --2- 172.21.15.62:0/2830928827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a40fbd40 0x7f72a40fc1b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.057+0000 7f72aa1c9700 1 --2- 172.21.15.62:0/2830928827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a4101d90 0x7f72a4102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.057+0000 7f72aa1c9700 1 -- 172.21.15.62:0/2830928827 >> 172.21.15.62:0/2830928827 conn(0x7f72a4071d00 msgr2=0x7f72a4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.057+0000 7f72aa1c9700 1 -- 172.21.15.62:0/2830928827 shutdown_connections 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.057+0000 7f72aa1c9700 1 -- 172.21.15.62:0/2830928827 wait complete. 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72aa1c9700 1 Processor -- start 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72aa1c9700 1 -- start start 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72aa1c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a40fbd40 0x7f72a410c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72aa1c9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a4101d90 0x7f72a410ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72aa1c9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a410d3a0 con 0x7f72a4101d90 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72aa1c9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a410d510 con 0x7f72a40fbd40 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72a2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a4101d90 0x7f72a410ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:53.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72a2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a4101d90 0x7f72a410ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35300/0 (socket says 172.21.15.62:35300) 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.058+0000 7f72a2ffd700 1 -- 172.21.15.62:0/1987134997 learned_addr learned my addr 172.21.15.62:0/1987134997 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f72a37fe700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a40fbd40 0x7f72a410c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f72a2ffd700 1 -- 172.21.15.62:0/1987134997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a40fbd40 msgr2=0x7f72a410c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f72a2ffd700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a40fbd40 0x7f72a410c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f72a2ffd700 1 -- 172.21.15.62:0/1987134997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c005040 con 0x7f72a4101d90 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f72a2ffd700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a4101d90 0x7f72a410ce60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f728c009100 tx=0x7f728c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f729bfff700 1 -- 172.21.15.62:0/1987134997 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f728c00e040 con 0x7f72a4101d90 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a410d790 con 0x7f72a4101d90 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f729bfff700 1 -- 172.21.15.62:0/1987134997 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f728c00bbc0 con 0x7f72a4101d90 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f729bfff700 1 -- 172.21.15.62:0/1987134997 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f728c01c630 con 0x7f72a4101d90 2024-05-09T06:40:53.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.059+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a411a310 con 0x7f72a4101d90 2024-05-09T06:40:53.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.060+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a40fd430 con 0x7f72a4101d90 2024-05-09T06:40:53.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.061+0000 7f729bfff700 1 -- 172.21.15.62:0/1987134997 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f728c00bd30 con 0x7f72a4101d90 2024-05-09T06:40:53.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.061+0000 7f729bfff700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7290078990 0x7f729007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:53.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.062+0000 7f729bfff700 1 -- 172.21.15.62:0/1987134997 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f728c09b3a0 con 0x7f72a4101d90 2024-05-09T06:40:53.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.062+0000 7f72a37fe700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7290078990 0x7f729007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:53.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.062+0000 7f72a37fe700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7290078990 0x7f729007ae40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7294004bc0 tx=0x7f7294009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:53.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.066+0000 7f729bfff700 1 -- 172.21.15.62:0/1987134997 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f728c062e70 con 0x7f72a4101d90 2024-05-09T06:40:53.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.374+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f72a40fac30 con 0x7f72a4101d90 2024-05-09T06:40:53.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.374+0000 7f729bfff700 1 -- 172.21.15.62:0/1987134997 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f728c062810 con 0x7f72a4101d90 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:40:53.355 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 14 2024-05-09T06:40:53.356 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:40:53.356 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:40:53.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7290078990 msgr2=0x7f729007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7290078990 0x7f729007ae40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7294004bc0 tx=0x7f7294009040 comp rx=0 tx=0).stop 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a4101d90 msgr2=0x7f72a410ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a4101d90 0x7f72a410ce60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f728c009100 tx=0x7f728c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 shutdown_connections 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72a40fbd40 0x7f72a410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7290078990 0x7f729007ae40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 --2- 172.21.15.62:0/1987134997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72a4101d90 0x7f72a410ce60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.376+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 >> 172.21.15.62:0/1987134997 conn(0x7f72a4071d00 msgr2=0x7f72a4104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.377+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 shutdown_connections 2024-05-09T06:40:53.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:40:53.377+0000 7f72aa1c9700 1 -- 172.21.15.62:0/1987134997 wait complete. 2024-05-09T06:40:53.367 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:53 smithi062 ceph-mon[109590]: pgmap v242: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:53.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:53 smithi079 ceph-mon[82381]: pgmap v242: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:54.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-05-09T06:40:54.316 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:40:54.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:54 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1987134997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:54.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:54.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:54 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1987134997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:54.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:55.371 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:55 smithi062 ceph-mon[109590]: pgmap v243: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:55.492 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:55 smithi079 ceph-mon[82381]: pgmap v243: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:55.908 INFO:teuthology.orchestra.run.smithi062.stdout:wait for servicemap items w/ changing names to refresh 2024-05-09T06:40:56.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'sleep 60' 2024-05-09T06:40:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:40:57.281 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:57 smithi062 ceph-mon[109590]: pgmap v244: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:57.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:57 smithi079 ceph-mon[82381]: pgmap v244: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:59.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:40:59 smithi062 ceph-mon[109590]: pgmap v245: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:59.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:40:59 smithi079 ceph-mon[82381]: pgmap v245: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:01.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:01 smithi062 ceph-mon[109590]: pgmap v246: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:01.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:01 smithi079 ceph-mon[82381]: pgmap v246: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:03.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:03 smithi062 ceph-mon[109590]: pgmap v247: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:03.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:03 smithi079 ceph-mon[82381]: pgmap v247: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:05.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:05 smithi062 ceph-mon[109590]: pgmap v248: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:05.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:05 smithi079 ceph-mon[82381]: pgmap v248: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:07.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:07 smithi062 ceph-mon[109590]: pgmap v249: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:07.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:07 smithi079 ceph-mon[82381]: pgmap v249: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:09.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:09 smithi062 ceph-mon[109590]: pgmap v250: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:09.411 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:09.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:09 smithi079 ceph-mon[82381]: pgmap v250: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:09.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:11.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:11 smithi062 ceph-mon[109590]: pgmap v251: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:11.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:11 smithi079 ceph-mon[82381]: pgmap v251: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:13.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:13 smithi062 ceph-mon[109590]: pgmap v252: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:13.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:13 smithi079 ceph-mon[82381]: pgmap v252: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:15.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:15 smithi062 ceph-mon[109590]: pgmap v253: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:15.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:15 smithi079 ceph-mon[82381]: pgmap v253: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:17.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:17 smithi062 ceph-mon[109590]: pgmap v254: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:17.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:17 smithi079 ceph-mon[82381]: pgmap v254: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:19.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:19 smithi062 ceph-mon[109590]: pgmap v255: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:19.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:19 smithi079 ceph-mon[82381]: pgmap v255: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:21.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:21 smithi062 ceph-mon[109590]: pgmap v256: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:21.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:21 smithi079 ceph-mon[82381]: pgmap v256: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:23.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:23 smithi079 ceph-mon[82381]: pgmap v257: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:23.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:23 smithi062 ceph-mon[109590]: pgmap v257: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:24.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:24.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:25.492 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:25 smithi079 ceph-mon[82381]: pgmap v258: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:25.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:25 smithi062 ceph-mon[109590]: pgmap v258: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:27.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:27 smithi079 ceph-mon[82381]: pgmap v259: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:27.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:27 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:27.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:27 smithi062 ceph-mon[109590]: pgmap v259: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:27.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:27 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:29.091 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:28 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:41:29.091 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:28 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:41:29.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:28 smithi079 ceph-mon[82381]: pgmap v260: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:29.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:28 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:41:29.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:28 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:41:29.092 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:28 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:41:29.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:28 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:41:29.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:28 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:41:29.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:28 smithi062 ceph-mon[109590]: pgmap v260: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:29.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:28 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:41:29.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:28 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:41:29.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:28 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:41:31.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:31 smithi062 ceph-mon[109590]: pgmap v261: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:31.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:31 smithi079 ceph-mon[82381]: pgmap v261: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:33.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:33 smithi062 ceph-mon[109590]: pgmap v262: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:33.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:33 smithi079 ceph-mon[82381]: pgmap v262: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:35.412 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:35 smithi062 ceph-mon[109590]: pgmap v263: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:35.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:35 smithi079 ceph-mon[82381]: pgmap v263: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:37.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:37 smithi062 ceph-mon[109590]: pgmap v264: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:37.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:37 smithi079 ceph-mon[82381]: pgmap v264: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:39.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:39 smithi062 ceph-mon[109590]: pgmap v265: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:39.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:39.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:39 smithi079 ceph-mon[82381]: pgmap v265: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:39.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:41.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:41 smithi062 ceph-mon[109590]: pgmap v266: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:41.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:41 smithi079 ceph-mon[82381]: pgmap v266: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:43.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:43 smithi062 ceph-mon[109590]: pgmap v267: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:43.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:43 smithi079 ceph-mon[82381]: pgmap v267: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:45.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:45 smithi062 ceph-mon[109590]: pgmap v268: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:45.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:45 smithi079 ceph-mon[82381]: pgmap v268: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:47.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:47 smithi062 ceph-mon[109590]: pgmap v269: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:47.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:47 smithi079 ceph-mon[82381]: pgmap v269: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:49.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:49 smithi062 ceph-mon[109590]: pgmap v270: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:49.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:49 smithi079 ceph-mon[82381]: pgmap v270: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:51.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:51 smithi062 ceph-mon[109590]: pgmap v271: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:51.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:51 smithi079 ceph-mon[82381]: pgmap v271: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:53.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:53 smithi062 ceph-mon[109590]: pgmap v272: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:53.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:53 smithi079 ceph-mon[82381]: pgmap v272: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:54.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:54.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:55.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:55 smithi062 ceph-mon[109590]: pgmap v273: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:55.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:55 smithi079 ceph-mon[82381]: pgmap v273: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:57.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:57 smithi062 ceph-mon[109590]: pgmap v274: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:57.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:57 smithi079 ceph-mon[82381]: pgmap v274: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:59.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch ps' 2024-05-09T06:41:59.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:41:59 smithi062 ceph-mon[109590]: pgmap v275: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:59.667 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:41:59.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:41:59 smithi079 ceph-mon[82381]: pgmap v275: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.540+0000 7fa44298e700 1 -- 172.21.15.62:0/1663544530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 msgr2=0x7fa43c0fcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.540+0000 7fa44298e700 1 --2- 172.21.15.62:0/1663544530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 0x7fa43c0fcaa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa430004940 tx=0x7fa430009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.540+0000 7fa44298e700 1 -- 172.21.15.62:0/1663544530 shutdown_connections 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.540+0000 7fa44298e700 1 --2- 172.21.15.62:0/1663544530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 0x7fa43c0fcaa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.540+0000 7fa44298e700 1 --2- 172.21.15.62:0/1663544530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa43c101e10 0x7fa43c1021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.540+0000 7fa44298e700 1 -- 172.21.15.62:0/1663544530 >> 172.21.15.62:0/1663544530 conn(0x7fa43c0714d0 msgr2=0x7fa43c0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.540+0000 7fa44298e700 1 -- 172.21.15.62:0/1663544530 shutdown_connections 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.540+0000 7fa44298e700 1 -- 172.21.15.62:0/1663544530 wait complete. 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa44298e700 1 Processor -- start 2024-05-09T06:42:01.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa44298e700 1 -- start start 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa44298e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 0x7fa43c10eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa44298e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa43c101e10 0x7fa43c10f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa44298e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c10f570 con 0x7fa43c0fc630 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa44298e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c10f6b0 con 0x7fa43c101e10 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa43bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 0x7fa43c10eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa43bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 0x7fa43c10eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33072/0 (socket says 172.21.15.62:33072) 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa43bfff700 1 -- 172.21.15.62:0/2191253451 learned_addr learned my addr 172.21.15.62:0/2191253451 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa43b7fe700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa43c101e10 0x7fa43c10f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.541+0000 7fa43bfff700 1 -- 172.21.15.62:0/2191253451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa43c101e10 msgr2=0x7fa43c10f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.542+0000 7fa43bfff700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa43c101e10 0x7fa43c10f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.542+0000 7fa43bfff700 1 -- 172.21.15.62:0/2191253451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430005040 con 0x7fa43c0fc630 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.542+0000 7fa43bfff700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 0x7fa43c10eaf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa42c002a50 tx=0x7fa42c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:01.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.542+0000 7fa438ff9700 1 -- 172.21.15.62:0/2191253451 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42c007cc0 con 0x7fa43c0fc630 2024-05-09T06:42:01.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.542+0000 7fa438ff9700 1 -- 172.21.15.62:0/2191253451 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa42c00f040 con 0x7fa43c0fc630 2024-05-09T06:42:01.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.542+0000 7fa438ff9700 1 -- 172.21.15.62:0/2191253451 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42c009640 con 0x7fa43c0fc630 2024-05-09T06:42:01.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.542+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c117b60 con 0x7fa43c0fc630 2024-05-09T06:42:01.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.542+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c117eb0 con 0x7fa43c0fc630 2024-05-09T06:42:01.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.543+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c0ff130 con 0x7fa43c0fc630 2024-05-09T06:42:01.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.544+0000 7fa438ff9700 1 -- 172.21.15.62:0/2191253451 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa42c0097a0 con 0x7fa43c0fc630 2024-05-09T06:42:01.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.544+0000 7fa438ff9700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa424078990 0x7fa42407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:01.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.544+0000 7fa438ff9700 1 -- 172.21.15.62:0/2191253451 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fa42c09a6f0 con 0x7fa43c0fc630 2024-05-09T06:42:01.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.544+0000 7fa43b7fe700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa424078990 0x7fa42407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:01.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.545+0000 7fa43b7fe700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa424078990 0x7fa42407ae40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa43000b3b0 tx=0x7fa430009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:01.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.549+0000 7fa438ff9700 1 -- 172.21.15.62:0/2191253451 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa42c062140 con 0x7fa43c0fc630 2024-05-09T06:42:01.529 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:01 smithi062 ceph-mon[109590]: pgmap v276: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:01.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.773+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 --> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa43c0fbae0 con 0x7fa424078990 2024-05-09T06:42:01.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.784+0000 7fa438ff9700 1 -- 172.21.15.62:0/2191253451 <== mgr.34104 v2:172.21.15.62:6800/669341028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa43c0fbae0 con 0x7fa424078990 2024-05-09T06:42:01.763 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.smithi062 smithi062 *:9093,9094 running (9m) 2m ago 20m 25.9M - 0.25.0 c8568f914cd2 8375c9d07e0e 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi062 smithi062 running (6m) 2m ago 20m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5695197aa7f7 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:crash.smithi079 smithi079 running (6m) 100s ago 19m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 0026f93e5fed 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.smithi062 smithi062 *:3000 running (8m) 2m ago 20m 80.5M - 9.4.12 2bacad6d85d8 537835683cd6 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.bwemju smithi062 running (2m) 2m ago 14m 15.2M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 43065134ffb6 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi062.etsgzx smithi062 running (2m) 2m ago 14m 14.3M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 46146b741422 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.pdxygz smithi079 running (103s) 100s ago 14m 11.4M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fef84f9e6df9 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:mds.cephfs.smithi079.qwqgdo smithi079 running (2m) 100s ago 14m 15.2M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 be2130e50081 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi062.juuasl smithi062 *:8443,9283,8765 running (11m) 2m ago 21m 525M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 5af66e2c2db5 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.smithi079.genyri smithi079 *:8443,9283,8765 running (10m) 100s ago 19m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e39cfe2af950 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi062 smithi062 running (7m) 2m ago 22m 55.2M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 e633b5f5dc2d 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:mon.smithi079 smithi079 running (7m) 100s ago 19m 44.1M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 bf2cbd432c7c 2024-05-09T06:42:01.764 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi062 smithi062 *:9100 running (9m) 2m ago 20m 15.0M - 1.5.0 0da6a335fe13 459823b8e6c7 2024-05-09T06:42:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.smithi079 smithi079 *:9100 running (9m) 100s ago 19m 16.8M - 1.5.0 0da6a335fe13 d586491125d6 2024-05-09T06:42:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (6m) 2m ago 18m 149M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 c4cee88020d3 2024-05-09T06:42:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (5m) 2m ago 17m 135M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 85c00585e2e6 2024-05-09T06:42:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (4m) 2m ago 17m 107M 1557M 19.0.0-3575-g720f8e95 8ec306cbfbd6 89acd3b9ad68 2024-05-09T06:42:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi079 running (4m) 100s ago 17m 115M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 8d7a05b6e02c 2024-05-09T06:42:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi079 running (3m) 100s ago 16m 106M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 874246927b69 2024-05-09T06:42:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi079 running (3m) 100s ago 16m 104M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 486b85997c37 2024-05-09T06:42:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.smithi062 smithi062 *:9095 running (9m) 2m ago 19m 66.8M - 2.43.0 a07b618ecd1d e9b37e6ae8e3 2024-05-09T06:42:01.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa424078990 msgr2=0x7fa42407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:01.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa424078990 0x7fa42407ae40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa43000b3b0 tx=0x7fa430009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:01.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 msgr2=0x7fa43c10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:01.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 0x7fa43c10eaf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa42c002a50 tx=0x7fa42c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:42:01.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 shutdown_connections 2024-05-09T06:42:01.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa424078990 0x7fa42407ae40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:01.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa43c0fc630 0x7fa43c10eaf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:01.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 --2- 172.21.15.62:0/2191253451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa43c101e10 0x7fa43c10f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:01.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 >> 172.21.15.62:0/2191253451 conn(0x7fa43c0714d0 msgr2=0x7fa43c0fa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:01.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 shutdown_connections 2024-05-09T06:42:01.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:01.786+0000 7fa44298e700 1 -- 172.21.15.62:0/2191253451 wait complete. 2024-05-09T06:42:01.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:01 smithi079 ceph-mon[82381]: pgmap v276: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:02.446 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions' 2024-05-09T06:42:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:03.724 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:03 smithi062 ceph-mon[109590]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:42:03.724 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:03 smithi062 ceph-mon[109590]: pgmap v277: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:03.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:03 smithi079 ceph-mon[82381]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:42:03.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:03 smithi079 ceph-mon[82381]: pgmap v277: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 -- 172.21.15.62:0/4123891951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 msgr2=0x7ff8dc101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 --2- 172.21.15.62:0/4123891951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 0x7ff8dc101a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc004940 tx=0x7ff8cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 -- 172.21.15.62:0/4123891951 shutdown_connections 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 --2- 172.21.15.62:0/4123891951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 0x7ff8dc101a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 --2- 172.21.15.62:0/4123891951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8dc0fb5a0 0x7ff8dc0fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 -- 172.21.15.62:0/4123891951 >> 172.21.15.62:0/4123891951 conn(0x7ff8dc073350 msgr2=0x7ff8dc073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 -- 172.21.15.62:0/4123891951 shutdown_connections 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 -- 172.21.15.62:0/4123891951 wait complete. 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.365+0000 7ff8e4181700 1 Processor -- start 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e4181700 1 -- start start 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e4181700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8dc0fb5a0 0x7ff8dc0fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:04.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e4181700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 0x7ff8dc0fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e4181700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0fe480 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e4181700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0fcfb0 con 0x7ff8dc0fb5a0 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e171c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 0x7ff8dc0fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e171c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 0x7ff8dc0fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52280/0 (socket says 172.21.15.62:52280) 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e171c700 1 -- 172.21.15.62:0/2144862316 learned_addr learned my addr 172.21.15.62:0/2144862316 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e1f1d700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8dc0fb5a0 0x7ff8dc0fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e171c700 1 -- 172.21.15.62:0/2144862316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8dc0fb5a0 msgr2=0x7ff8dc0fc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e171c700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8dc0fb5a0 0x7ff8dc0fc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e171c700 1 -- 172.21.15.62:0/2144862316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc005040 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.366+0000 7ff8e171c700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 0x7ff8dc0fca70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00b3b0 tx=0x7ff8cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.367+0000 7ff8d27fc700 1 -- 172.21.15.62:0/2144862316 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8cc00e040 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.367+0000 7ff8d27fc700 1 -- 172.21.15.62:0/2144862316 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8cc013420 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.367+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc0fd230 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.367+0000 7ff8d27fc700 1 -- 172.21.15.62:0/2144862316 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8cc01c630 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.367+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc11a130 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.368+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0fe670 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.368+0000 7ff8d27fc700 1 -- 172.21.15.62:0/2144862316 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7ff8cc013590 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.369+0000 7ff8d27fc700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8c8078990 0x7ff8c807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:04.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.369+0000 7ff8d27fc700 1 -- 172.21.15.62:0/2144862316 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7ff8cc09ba60 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.369+0000 7ff8e1f1d700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8c8078990 0x7ff8c807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:04.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.369+0000 7ff8e1f1d700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8c8078990 0x7ff8c807ae40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8004f60 tx=0x7ff8d800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:04.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.374+0000 7ff8d27fc700 1 -- 172.21.15.62:0/2144862316 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ff8cc0635e0 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.679+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff8dc109f20 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.680+0000 7ff8d27fc700 1 -- 172.21.15.62:0/2144862316 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ff8cc013840 con 0x7ff8dc0fbf40 2024-05-09T06:42:04.660 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-05-09T06:42:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-05-09T06:42:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:42:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:42:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-05-09T06:42:04.660 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": { 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 14 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-05-09T06:42:04.661 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.682+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8c8078990 msgr2=0x7ff8c807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.682+0000 7ff8e4181700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8c8078990 0x7ff8c807ae40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8004f60 tx=0x7ff8d800b040 comp rx=0 tx=0).stop 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.682+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 msgr2=0x7ff8dc0fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.682+0000 7ff8e4181700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 0x7ff8dc0fca70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00b3b0 tx=0x7ff8cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.683+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 shutdown_connections 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.683+0000 7ff8e4181700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8dc0fb5a0 0x7ff8dc0fc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.683+0000 7ff8e4181700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7ff8c8078990 0x7ff8c807ae40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.683+0000 7ff8e4181700 1 --2- 172.21.15.62:0/2144862316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8dc0fbf40 0x7ff8dc0fca70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:04.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.683+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 >> 172.21.15.62:0/2144862316 conn(0x7ff8dc073350 msgr2=0x7ff8dc100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:04.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.683+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 shutdown_connections 2024-05-09T06:42:04.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:04.683+0000 7ff8e4181700 1 -- 172.21.15.62:0/2144862316 wait complete. 2024-05-09T06:42:05.394 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-05-09T06:42:05.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:05 smithi062 ceph-mon[109590]: pgmap v278: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:05.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:05 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2144862316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:05.669 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:05.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:05 smithi079 ceph-mon[82381]: pgmap v278: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:05.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:05 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2144862316' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:07.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.272+0000 7fbaba159700 1 -- 172.21.15.62:0/2909424471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 msgr2=0x7fbab40fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:07.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.272+0000 7fbaba159700 1 --2- 172.21.15.62:0/2909424471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 0x7fbab40fce00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba9c004940 tx=0x7fba9c009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:07.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.272+0000 7fbaba159700 1 -- 172.21.15.62:0/2909424471 shutdown_connections 2024-05-09T06:42:07.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.272+0000 7fbaba159700 1 --2- 172.21.15.62:0/2909424471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 0x7fbab40fce00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:07.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.272+0000 7fbaba159700 1 --2- 172.21.15.62:0/2909424471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4102df0 0x7fbab41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:07.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.272+0000 7fbaba159700 1 -- 172.21.15.62:0/2909424471 >> 172.21.15.62:0/2909424471 conn(0x7fbab40f8980 msgr2=0x7fbab40fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:07.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.272+0000 7fbaba159700 1 -- 172.21.15.62:0/2909424471 shutdown_connections 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.272+0000 7fbaba159700 1 -- 172.21.15.62:0/2909424471 wait complete. 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbaba159700 1 Processor -- start 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbaba159700 1 -- start start 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbaba159700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4102df0 0x7fbab4070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbaba159700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 0x7fbab40707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbaba159700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4070d30 con 0x7fbab4103790 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbaba159700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4070e70 con 0x7fbab4102df0 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbab2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 0x7fbab40707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbab2ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 0x7fbab40707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52300/0 (socket says 172.21.15.62:52300) 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.273+0000 7fbab2ffd700 1 -- 172.21.15.62:0/597939285 learned_addr learned my addr 172.21.15.62:0/597939285 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbab37fe700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4102df0 0x7fbab4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbab2ffd700 1 -- 172.21.15.62:0/597939285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4102df0 msgr2=0x7fbab4070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbab2ffd700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4102df0 0x7fbab4070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:07.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbab2ffd700 1 -- 172.21.15.62:0/597939285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c005040 con 0x7fbab4103790 2024-05-09T06:42:07.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbab2ffd700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 0x7fbab40707a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009100 tx=0x7fba9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:07.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbaabfff700 1 -- 172.21.15.62:0/597939285 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9c00e040 con 0x7fbab4103790 2024-05-09T06:42:07.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbaabfff700 1 -- 172.21.15.62:0/597939285 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba9c004290 con 0x7fbab4103790 2024-05-09T06:42:07.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab40710c0 con 0x7fbab4103790 2024-05-09T06:42:07.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbaabfff700 1 -- 172.21.15.62:0/597939285 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9c01c3f0 con 0x7fbab4103790 2024-05-09T06:42:07.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.274+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab411a2a0 con 0x7fbab4103790 2024-05-09T06:42:07.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.275+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab40fe540 con 0x7fbab4103790 2024-05-09T06:42:07.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.276+0000 7fbaabfff700 1 -- 172.21.15.62:0/597939285 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fba9c013690 con 0x7fbab4103790 2024-05-09T06:42:07.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.276+0000 7fbaabfff700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbaa0078980 0x7fbaa007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:07.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.277+0000 7fbab37fe700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbaa0078980 0x7fbaa007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:07.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.277+0000 7fbaabfff700 1 -- 172.21.15.62:0/597939285 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fba9c09b9d0 con 0x7fbab4103790 2024-05-09T06:42:07.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.277+0000 7fbab37fe700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbaa0078980 0x7fbaa007ae30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4004f40 tx=0x7fbaa400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:07.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.281+0000 7fbaabfff700 1 -- 172.21.15.62:0/597939285 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fba9c063540 con 0x7fbab4103790 2024-05-09T06:42:07.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.588+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbab4109f00 con 0x7fbab4103790 2024-05-09T06:42:07.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.588+0000 7fbaabfff700 1 -- 172.21.15.62:0/597939285 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fba9c062ee0 con 0x7fbab4103790 2024-05-09T06:42:07.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbaa0078980 msgr2=0x7fbaa007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:07.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbaa0078980 0x7fbaa007ae30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4004f40 tx=0x7fbaa400b040 comp rx=0 tx=0).stop 2024-05-09T06:42:07.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 msgr2=0x7fbab40707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:07.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 0x7fbab40707a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009100 tx=0x7fba9c009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:07.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 shutdown_connections 2024-05-09T06:42:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4102df0 0x7fbab4070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbaa0078980 0x7fbaa007ae30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 --2- 172.21.15.62:0/597939285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbab4103790 0x7fbab40707a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 >> 172.21.15.62:0/597939285 conn(0x7fbab40f8980 msgr2=0x7fbab40f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 shutdown_connections 2024-05-09T06:42:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:07.590+0000 7fbaba159700 1 -- 172.21.15.62:0/597939285 wait complete. 2024-05-09T06:42:07.580 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-05-09T06:42:07.772 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:07 smithi062 ceph-mon[109590]: pgmap v279: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:07.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:07 smithi079 ceph-mon[82381]: pgmap v279: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:08.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-05-09T06:42:08.483 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:08.713 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:08 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/597939285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:08.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:08 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/597939285' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:09.559 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:09 smithi062 ceph-mon[109590]: pgmap v280: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:09.559 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:09.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:09 smithi079 ceph-mon[82381]: pgmap v280: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:09.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:10.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 -- 172.21.15.62:0/1266465894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 msgr2=0x7f40801031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:10.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 --2- 172.21.15.62:0/1266465894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 0x7f40801031f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4070004940 tx=0x7f4070009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:10.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 -- 172.21.15.62:0/1266465894 shutdown_connections 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 --2- 172.21.15.62:0/1266465894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40801037c0 0x7f40800fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 --2- 172.21.15.62:0/1266465894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 0x7f40801031f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 -- 172.21.15.62:0/1266465894 >> 172.21.15.62:0/1266465894 conn(0x7f4080072380 msgr2=0x7f4080072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 -- 172.21.15.62:0/1266465894 shutdown_connections 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 -- 172.21.15.62:0/1266465894 wait complete. 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 Processor -- start 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.329+0000 7f4085f9c700 1 -- start start 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f4085f9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 0x7f40800fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f4085f9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40801037c0 0x7f40800fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f4085f9c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800fe580 con 0x7f4080102e20 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f4085f9c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800fd020 con 0x7f40801037c0 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 0x7f40800fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 0x7f40800fc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52318/0 (socket says 172.21.15.62:52318) 2024-05-09T06:42:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407f7fe700 1 -- 172.21.15.62:0/3330341194 learned_addr learned my addr 172.21.15.62:0/3330341194 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407effd700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40801037c0 0x7f40800fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407f7fe700 1 -- 172.21.15.62:0/3330341194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40801037c0 msgr2=0x7f40800fcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407f7fe700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40801037c0 0x7f40800fcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407f7fe700 1 -- 172.21.15.62:0/3330341194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4070005040 con 0x7f4080102e20 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407effd700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40801037c0 0x7f40800fcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f407f7fe700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 0x7f40800fc5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4070009100 tx=0x7f4070009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f4067fff700 1 -- 172.21.15.62:0/3330341194 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f407000e040 con 0x7f4080102e20 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40800fd2a0 con 0x7f4080102e20 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.330+0000 7f4067fff700 1 -- 172.21.15.62:0/3330341194 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4070013420 con 0x7f4080102e20 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.331+0000 7f4067fff700 1 -- 172.21.15.62:0/3330341194 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f407001c610 con 0x7f4080102e20 2024-05-09T06:42:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.331+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408011a140 con 0x7f4080102e20 2024-05-09T06:42:10.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.332+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40800fe6e0 con 0x7f4080102e20 2024-05-09T06:42:10.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.332+0000 7f4067fff700 1 -- 172.21.15.62:0/3330341194 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f4070013590 con 0x7f4080102e20 2024-05-09T06:42:10.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.333+0000 7f4067fff700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4068078990 0x7f406807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:10.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.333+0000 7f407effd700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4068078990 0x7f406807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:10.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.333+0000 7f4067fff700 1 -- 172.21.15.62:0/3330341194 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f407009bb90 con 0x7f4080102e20 2024-05-09T06:42:10.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.333+0000 7f407effd700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4068078990 0x7f406807ae40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4074006fd0 tx=0x7f4074008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:10.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.338+0000 7f4067fff700 1 -- 172.21.15.62:0/3330341194 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f4070063660 con 0x7f4080102e20 2024-05-09T06:42:10.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.642+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f408011a330 con 0x7f4080102e20 2024-05-09T06:42:10.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.643+0000 7f4067fff700 1 -- 172.21.15.62:0/3330341194 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f4070063000 con 0x7f4080102e20 2024-05-09T06:42:10.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4068078990 msgr2=0x7f406807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:10.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4068078990 0x7f406807ae40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4074006fd0 tx=0x7f4074008040 comp rx=0 tx=0).stop 2024-05-09T06:42:10.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 msgr2=0x7f40800fc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:10.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 0x7f40800fc5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4070009100 tx=0x7f4070009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:10.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 shutdown_connections 2024-05-09T06:42:10.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4068078990 0x7f406807ae40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:10.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4080102e20 0x7f40800fc5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:10.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 --2- 172.21.15.62:0/3330341194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40801037c0 0x7f40800fcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:10.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 >> 172.21.15.62:0/3330341194 conn(0x7f4080072380 msgr2=0x7f40800f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:10.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 shutdown_connections 2024-05-09T06:42:10.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:10.645+0000 7f4085f9c700 1 -- 172.21.15.62:0/3330341194 wait complete. 2024-05-09T06:42:10.635 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)" 2024-05-09T06:42:11.367 DEBUG:teuthology.parallel:result is None 2024-05-09T06:42:11.425 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:42:11.509 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:42:11.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T06:42:11.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:11 smithi062 ceph-mon[109590]: pgmap v281: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:11.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:11 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3330341194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:11.793 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:11.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:11 smithi079 ceph-mon[82381]: pgmap v281: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:11.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:11 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3330341194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:13.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.393+0000 7fe1710cf700 1 -- 172.21.15.62:0/3719407299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0fc630 msgr2=0x7fe16c0fcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:13.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.393+0000 7fe1710cf700 1 --2- 172.21.15.62:0/3719407299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0fc630 0x7fe16c0fcaa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe160004940 tx=0x7fe160009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:13.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.393+0000 7fe1710cf700 1 -- 172.21.15.62:0/3719407299 shutdown_connections 2024-05-09T06:42:13.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.393+0000 7fe1710cf700 1 --2- 172.21.15.62:0/3719407299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c0fc630 0x7fe16c0fcaa0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:13.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.393+0000 7fe1710cf700 1 --2- 172.21.15.62:0/3719407299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c101e10 0x7fe16c1021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:13.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.393+0000 7fe1710cf700 1 -- 172.21.15.62:0/3719407299 >> 172.21.15.62:0/3719407299 conn(0x7fe16c0714d0 msgr2=0x7fe16c0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:13.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.394+0000 7fe1710cf700 1 -- 172.21.15.62:0/3719407299 shutdown_connections 2024-05-09T06:42:13.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.394+0000 7fe1710cf700 1 -- 172.21.15.62:0/3719407299 wait complete. 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.394+0000 7fe1710cf700 1 Processor -- start 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.394+0000 7fe1710cf700 1 -- start start 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1710cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0fc630 0x7fe16c102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1710cf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c101e10 0x7fe16c103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1710cf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c104ba0 con 0x7fe16c101e10 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1710cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c1036d0 con 0x7fe16c0fc630 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe16a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c101e10 0x7fe16c103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe16a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c101e10 0x7fe16c103190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52338/0 (socket says 172.21.15.62:52338) 2024-05-09T06:42:13.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe16a59c700 1 -- 172.21.15.62:0/4250729273 learned_addr learned my addr 172.21.15.62:0/4250729273 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe16ad9d700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0fc630 0x7fe16c102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe16a59c700 1 -- 172.21.15.62:0/4250729273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0fc630 msgr2=0x7fe16c102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe16a59c700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0fc630 0x7fe16c102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe16a59c700 1 -- 172.21.15.62:0/4250729273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160005040 con 0x7fe16c101e10 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe16a59c700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c101e10 0x7fe16c103190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b3b0 tx=0x7fe160009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1537fe700 1 -- 172.21.15.62:0/4250729273 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe16000e040 con 0x7fe16c101e10 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c103950 con 0x7fe16c101e10 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1537fe700 1 -- 172.21.15.62:0/4250729273 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe160013420 con 0x7fe16c101e10 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1537fe700 1 -- 172.21.15.62:0/4250729273 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe16001c630 con 0x7fe16c101e10 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.395+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c11a060 con 0x7fe16c101e10 2024-05-09T06:42:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.396+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c100140 con 0x7fe16c101e10 2024-05-09T06:42:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.397+0000 7fe1537fe700 1 -- 172.21.15.62:0/4250729273 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fe160013590 con 0x7fe16c101e10 2024-05-09T06:42:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.398+0000 7fe1537fe700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe154078990 0x7fe15407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.398+0000 7fe16ad9d700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe154078990 0x7fe15407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.398+0000 7fe1537fe700 1 -- 172.21.15.62:0/4250729273 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fe16009bac0 con 0x7fe16c101e10 2024-05-09T06:42:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.398+0000 7fe16ad9d700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe154078990 0x7fe15407ae40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe15c004f40 tx=0x7fe15c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.403+0000 7fe1537fe700 1 -- 172.21.15.62:0/4250729273 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fe160063590 con 0x7fe16c101e10 2024-05-09T06:42:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.662+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe16c108f00 con 0x7fe16c101e10 2024-05-09T06:42:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.663+0000 7fe1537fe700 1 -- 172.21.15.62:0/4250729273 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1935 (secure 0 0 0) 0x7fe16006ae60 con 0x7fe16c101e10 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:e37 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 37 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-05-09T06:27:15.419064+0000 2024-05-09T06:42:13.643 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-05-09T06:40:25.759545+0000 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 60 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 94 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=34384} 2024-05-09T06:42:13.644 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3] 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data enabled 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 1 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 34384 members: 34384 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.etsgzx{0:34384} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.62:6826/1556586455,v1:172.21.15.62:6827/1556586455] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-05-09T06:42:13.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:13.646 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi062.bwemju{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.62:6828/2587505211,v1:172.21.15.62:6829/2587505211] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:42:13.646 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.qwqgdo{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6824/3936046313,v1:172.21.15.79:6825/3936046313] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:42:13.646 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.cephfs.smithi079.pdxygz{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/2608114839,v1:172.21.15.79:6827/2608114839] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:42:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe154078990 msgr2=0x7fe15407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe154078990 0x7fe15407ae40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe15c004f40 tx=0x7fe15c00b040 comp rx=0 tx=0).stop 2024-05-09T06:42:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c101e10 msgr2=0x7fe16c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c101e10 0x7fe16c103190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b3b0 tx=0x7fe160009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 shutdown_connections 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe16c0fc630 0x7fe16c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe154078990 0x7fe15407ae40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 --2- 172.21.15.62:0/4250729273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe16c101e10 0x7fe16c103190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 >> 172.21.15.62:0/4250729273 conn(0x7fe16c0714d0 msgr2=0x7fe16c1052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 shutdown_connections 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:13.665+0000 7fe1710cf700 1 -- 172.21.15.62:0/4250729273 wait complete. 2024-05-09T06:42:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 37 2024-05-09T06:42:13.787 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:13 smithi062 ceph-mon[109590]: pgmap v282: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:13.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:13 smithi079 ceph-mon[82381]: pgmap v282: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:14.325 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-05-09T06:42:14.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T06:42:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:14.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:14 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/4250729273' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:42:14.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:14 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/4250729273' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:42:15.756 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:15 smithi062 ceph-mon[109590]: pgmap v283: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:15.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:15 smithi079 ceph-mon[82381]: pgmap v283: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.307+0000 7f4730638700 1 -- 172.21.15.62:0/2627608183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728103780 msgr2=0x7f47280fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.307+0000 7f4730638700 1 --2- 172.21.15.62:0/2627608183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728103780 0x7f47280fcdf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4718004940 tx=0x7f4718009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.307+0000 7f4730638700 1 -- 172.21.15.62:0/2627608183 shutdown_connections 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.307+0000 7f4730638700 1 --2- 172.21.15.62:0/2627608183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728103780 0x7f47280fcdf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.307+0000 7f4730638700 1 --2- 172.21.15.62:0/2627608183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4728102de0 0x7f47281031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.307+0000 7f4730638700 1 -- 172.21.15.62:0/2627608183 >> 172.21.15.62:0/2627608183 conn(0x7f47280f8990 msgr2=0x7f47280fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.307+0000 7f4730638700 1 -- 172.21.15.62:0/2627608183 shutdown_connections 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.307+0000 7f4730638700 1 -- 172.21.15.62:0/2627608183 wait complete. 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f4730638700 1 Processor -- start 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f4730638700 1 -- start start 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f4730638700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728102de0 0x7f4728115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f4730638700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4728103780 0x7f47281160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f4730638700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4728116720 con 0x7f4728102de0 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f4730638700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472810fd00 con 0x7f4728103780 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f472e3d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728102de0 0x7f4728115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f472e3d4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728102de0 0x7f4728115b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37390/0 (socket says 172.21.15.62:37390) 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f472e3d4700 1 -- 172.21.15.62:0/3861347352 learned_addr learned my addr 172.21.15.62:0/3861347352 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f472dbd3700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4728103780 0x7f47281160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f472e3d4700 1 -- 172.21.15.62:0/3861347352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4728103780 msgr2=0x7f47281160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f472e3d4700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4728103780 0x7f47281160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f472e3d4700 1 -- 172.21.15.62:0/3861347352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718005040 con 0x7f4728102de0 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.308+0000 7f472dbd3700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4728103780 0x7f47281160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.309+0000 7f472e3d4700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728102de0 0x7f4728115b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4724002a50 tx=0x7f47240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.309+0000 7f471effd700 1 -- 172.21.15.62:0/3861347352 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4724007cc0 con 0x7f4728102de0 2024-05-09T06:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.309+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472810ffe0 con 0x7f4728102de0 2024-05-09T06:42:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.309+0000 7f471effd700 1 -- 172.21.15.62:0/3861347352 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f472400f040 con 0x7f4728102de0 2024-05-09T06:42:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.309+0000 7f471effd700 1 -- 172.21.15.62:0/3861347352 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4724009640 con 0x7f4728102de0 2024-05-09T06:42:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.309+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47281105a0 con 0x7f4728102de0 2024-05-09T06:42:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.310+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47280fe530 con 0x7f4728102de0 2024-05-09T06:42:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.311+0000 7f471effd700 1 -- 172.21.15.62:0/3861347352 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f47240097c0 con 0x7f4728102de0 2024-05-09T06:42:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.311+0000 7f471effd700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4714078980 0x7f471407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.311+0000 7f472dbd3700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4714078980 0x7f471407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.311+0000 7f471effd700 1 -- 172.21.15.62:0/3861347352 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f472409a6c0 con 0x7f4728102de0 2024-05-09T06:42:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.312+0000 7f472dbd3700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4714078980 0x7f471407ae30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4718009fd0 tx=0x7f4718009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.316+0000 7f471effd700 1 -- 172.21.15.62:0/3861347352 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f4724062110 con 0x7f4728102de0 2024-05-09T06:42:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.579+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47281111e0 con 0x7f4728102de0 2024-05-09T06:42:16.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.579+0000 7f471effd700 1 -- 172.21.15.62:0/3861347352 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+5207 (secure 0 0 0) 0x7f4724061ab0 con 0x7f4728102de0 2024-05-09T06:42:16.559 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:16.559 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44329,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/2608114839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2608114839},{"type":"v1","addr":"172.21.15.79:6827","nonce":2608114839}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:40:25.759545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":0,"incarnation":33,"state":"up:active","state_seq":22,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-05-09T06:42:16.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4714078980 msgr2=0x7f471407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:16.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4714078980 0x7f471407ae30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4718009fd0 tx=0x7f4718009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:16.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728102de0 msgr2=0x7f4728115b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:16.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728102de0 0x7f4728115b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4724002a50 tx=0x7f47240046b0 comp rx=0 tx=0).stop 2024-05-09T06:42:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 shutdown_connections 2024-05-09T06:42:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4714078980 0x7f471407ae30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4728102de0 0x7f4728115b90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 --2- 172.21.15.62:0/3861347352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4728103780 0x7f47281160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.581+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 >> 172.21.15.62:0/3861347352 conn(0x7f47280f8990 msgr2=0x7f4728071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.582+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 shutdown_connections 2024-05-09T06:42:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:16.582+0000 7f4730638700 1 -- 172.21.15.62:0/3861347352 wait complete. 2024-05-09T06:42:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 37 2024-05-09T06:42:17.190 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2024-05-09T06:42:17.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 14 2024-05-09T06:42:17.461 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:17.771 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:17 smithi062 ceph-mon[109590]: pgmap v284: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:17.772 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:17 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3861347352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:42:17.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:17 smithi079 ceph-mon[82381]: pgmap v284: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:17.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:17 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3861347352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:42:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 -- 172.21.15.62:0/4156005495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fe7b0 msgr2=0x7fbbdc106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 --2- 172.21.15.62:0/4156005495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fe7b0 0x7fbbdc106df0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc004940 tx=0x7fbbcc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 -- 172.21.15.62:0/4156005495 shutdown_connections 2024-05-09T06:42:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 --2- 172.21.15.62:0/4156005495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fe7b0 0x7fbbdc106df0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:19.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 --2- 172.21.15.62:0/4156005495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc0fde10 0x7fbbdc0fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 -- 172.21.15.62:0/4156005495 >> 172.21.15.62:0/4156005495 conn(0x7fbbdc0f7860 msgr2=0x7fbbdc0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 -- 172.21.15.62:0/4156005495 shutdown_connections 2024-05-09T06:42:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 -- 172.21.15.62:0/4156005495 wait complete. 2024-05-09T06:42:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.064+0000 7fbbe46da700 1 Processor -- start 2024-05-09T06:42:19.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe46da700 1 -- start start 2024-05-09T06:42:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe46da700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fde10 0x7fbbdc0fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe46da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc0fe7b0 0x7fbbdc0fc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:19.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe46da700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0fdb90 con 0x7fbbdc0fde10 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe46da700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0fc6c0 con 0x7fbbdc0fe7b0 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe2476700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fde10 0x7fbbdc0fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe2476700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fde10 0x7fbbdc0fbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37410/0 (socket says 172.21.15.62:37410) 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe2476700 1 -- 172.21.15.62:0/2156327855 learned_addr learned my addr 172.21.15.62:0/2156327855 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe1c75700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc0fe7b0 0x7fbbdc0fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe2476700 1 -- 172.21.15.62:0/2156327855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc0fe7b0 msgr2=0x7fbbdc0fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe2476700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc0fe7b0 0x7fbbdc0fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.065+0000 7fbbe2476700 1 -- 172.21.15.62:0/2156327855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc005040 con 0x7fbbdc0fde10 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.066+0000 7fbbe2476700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fde10 0x7fbbdc0fbc40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8002a50 tx=0x7fbbd80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.066+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/2156327855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd8007cc0 con 0x7fbbdc0fde10 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.066+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc0fc9a0 con 0x7fbbdc0fde10 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.066+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/2156327855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbd800f040 con 0x7fbbdc0fde10 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.066+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/2156327855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd800da30 con 0x7fbbdc0fde10 2024-05-09T06:42:19.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.066+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc11a0e0 con 0x7fbbdc0fde10 2024-05-09T06:42:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.067+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc066b50 con 0x7fbbdc0fde10 2024-05-09T06:42:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.067+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/2156327855 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fbbd800db90 con 0x7fbbdc0fde10 2024-05-09T06:42:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.068+0000 7fbbd2ffd700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbbc8078990 0x7fbbc807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.068+0000 7fbbe1c75700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbbc8078990 0x7fbbc807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.068+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/2156327855 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fbbd809a690 con 0x7fbbdc0fde10 2024-05-09T06:42:19.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.069+0000 7fbbe1c75700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbbc8078990 0x7fbbc807ae40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0fd370 tx=0x7fbbcc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:19.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.073+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/2156327855 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fbbd80620e0 con 0x7fbbdc0fde10 2024-05-09T06:42:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.332+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7fbbdc11a2d0 con 0x7fbbdc0fde10 2024-05-09T06:42:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.332+0000 7fbbd2ffd700 1 -- 172.21.15.62:0/2156327855 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v37) v1 ==== 107+0+4849 (secure 0 0 0) 0x7fbbd8061a80 con 0x7fbbdc0fde10 2024-05-09T06:42:19.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:19.313 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6829/490880971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":490880971},{"type":"v1","addr":"172.21.15.62:6829","nonce":490880971}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:27:30.542268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi062.etsgzx","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6827/2962760421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2962760421},{"type":"v1","addr":"172.21.15.62:6827","nonce":2962760421}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:19.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbbc8078990 msgr2=0x7fbbc807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbbc8078990 0x7fbbc807ae40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0fd370 tx=0x7fbbcc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fde10 msgr2=0x7fbbdc0fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fde10 0x7fbbdc0fbc40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8002a50 tx=0x7fbbd80046b0 comp rx=0 tx=0).stop 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 shutdown_connections 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fbbc8078990 0x7fbbc807ae40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbdc0fde10 0x7fbbdc0fbc40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 --2- 172.21.15.62:0/2156327855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbdc0fe7b0 0x7fbbdc0fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 >> 172.21.15.62:0/2156327855 conn(0x7fbbdc0f7860 msgr2=0x7fbbdc0f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 shutdown_connections 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:19.335+0000 7fbbe46da700 1 -- 172.21.15.62:0/2156327855 wait complete. 2024-05-09T06:42:19.315 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 14 2024-05-09T06:42:19.606 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:19 smithi062 ceph-mon[109590]: pgmap v285: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:19.607 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:19 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2156327855' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-05-09T06:42:19.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:19 smithi079 ceph-mon[82381]: pgmap v285: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:19.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:19 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2156327855' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-05-09T06:42:19.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 15 2024-05-09T06:42:20.192 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:21.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:21 smithi062 ceph-mon[109590]: pgmap v286: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:21.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:21 smithi079 ceph-mon[82381]: pgmap v286: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 -- 172.21.15.62:0/576467194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0103780 msgr2=0x7f63a00fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 --2- 172.21.15.62:0/576467194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0103780 0x7f63a00fcdf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6394004940 tx=0x7f6394009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 -- 172.21.15.62:0/576467194 shutdown_connections 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 --2- 172.21.15.62:0/576467194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0103780 0x7f63a00fcdf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 --2- 172.21.15.62:0/576467194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a0102de0 0x7f63a01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 -- 172.21.15.62:0/576467194 >> 172.21.15.62:0/576467194 conn(0x7f63a00f8950 msgr2=0x7f63a00fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 -- 172.21.15.62:0/576467194 shutdown_connections 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 -- 172.21.15.62:0/576467194 wait complete. 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.947+0000 7f63a604f700 1 Processor -- start 2024-05-09T06:42:21.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f63a604f700 1 -- start start 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f63a604f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0102de0 0x7f63a0070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f63a604f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a0103780 0x7f63a00707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f63a604f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0070d30 con 0x7f63a0102de0 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f63a604f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0070e70 con 0x7f63a0103780 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f639f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0102de0 0x7f63a0070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f639f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0102de0 0x7f63a0070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37436/0 (socket says 172.21.15.62:37436) 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f639f7fe700 1 -- 172.21.15.62:0/598637300 learned_addr learned my addr 172.21.15.62:0/598637300 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f639effd700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a0103780 0x7f63a00707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f639f7fe700 1 -- 172.21.15.62:0/598637300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a0103780 msgr2=0x7f63a00707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f639f7fe700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a0103780 0x7f63a00707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:21.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.948+0000 7f639f7fe700 1 -- 172.21.15.62:0/598637300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6394005040 con 0x7f63a0102de0 2024-05-09T06:42:21.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.949+0000 7f639f7fe700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0102de0 0x7f63a0070260 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6390001d80 tx=0x7f6390009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:21.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.949+0000 7f6387fff700 1 -- 172.21.15.62:0/598637300 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6390007d10 con 0x7f63a0102de0 2024-05-09T06:42:21.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.949+0000 7f6387fff700 1 -- 172.21.15.62:0/598637300 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6390001e80 con 0x7f63a0102de0 2024-05-09T06:42:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.949+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a0119e90 con 0x7f63a0102de0 2024-05-09T06:42:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.949+0000 7f6387fff700 1 -- 172.21.15.62:0/598637300 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6390014640 con 0x7f63a0102de0 2024-05-09T06:42:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.949+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a011a2b0 con 0x7f63a0102de0 2024-05-09T06:42:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.950+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a00fe530 con 0x7f63a0102de0 2024-05-09T06:42:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.950+0000 7f6387fff700 1 -- 172.21.15.62:0/598637300 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f639000e960 con 0x7f63a0102de0 2024-05-09T06:42:21.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.951+0000 7f6387fff700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f63880789e0 0x7f638807ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:21.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.951+0000 7f639effd700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f63880789e0 0x7f638807ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:21.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.951+0000 7f6387fff700 1 -- 172.21.15.62:0/598637300 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f639009a640 con 0x7f63a0102de0 2024-05-09T06:42:21.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.952+0000 7f639effd700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f63880789e0 0x7f638807ae90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6394004890 tx=0x7f6394009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:21.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:21.956+0000 7f6387fff700 1 -- 172.21.15.62:0/598637300 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f63900620a0 con 0x7f63a0102de0 2024-05-09T06:42:22.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.217+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f63a005f5c0 con 0x7f63a0102de0 2024-05-09T06:42:22.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.217+0000 7f6387fff700 1 -- 172.21.15.62:0/598637300 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v37) v1 ==== 107+0+4061 (secure 0 0 0) 0x7f63900097e0 con 0x7f63a0102de0 2024-05-09T06:42:22.196 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:22.196 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.62:6829/490880971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":490880971},{"type":"v1","addr":"172.21.15.62:6829","nonce":490880971}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:38:58.860064+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f63880789e0 msgr2=0x7f638807ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f63880789e0 0x7f638807ae90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6394004890 tx=0x7f6394009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0102de0 msgr2=0x7f63a0070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0102de0 0x7f63a0070260 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6390001d80 tx=0x7f6390009ec0 comp rx=0 tx=0).stop 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 shutdown_connections 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f63880789e0 0x7f638807ae90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63a0102de0 0x7f63a0070260 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 --2- 172.21.15.62:0/598637300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63a0103780 0x7f63a00707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 >> 172.21.15.62:0/598637300 conn(0x7f63a00f8950 msgr2=0x7f63a00f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 shutdown_connections 2024-05-09T06:42:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:22.220+0000 7f63a604f700 1 -- 172.21.15.62:0/598637300 wait complete. 2024-05-09T06:42:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 15 2024-05-09T06:42:22.783 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:22 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/598637300' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-05-09T06:42:22.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 16 2024-05-09T06:42:22.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:22 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/598637300' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-05-09T06:42:23.083 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:23.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:23 smithi079 ceph-mon[82381]: pgmap v287: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:23.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:23 smithi062 ceph-mon[109590]: pgmap v287: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.674+0000 7f75110a9700 1 -- 172.21.15.62:0/4107019282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 msgr2=0x7f750c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.674+0000 7f75110a9700 1 --2- 172.21.15.62:0/4107019282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 0x7f750c1031c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f74fc004940 tx=0x7f74fc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.674+0000 7f75110a9700 1 -- 172.21.15.62:0/4107019282 shutdown_connections 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.674+0000 7f75110a9700 1 --2- 172.21.15.62:0/4107019282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f750c103790 0x7f750c0fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.674+0000 7f75110a9700 1 --2- 172.21.15.62:0/4107019282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 0x7f750c1031c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.674+0000 7f75110a9700 1 -- 172.21.15.62:0/4107019282 >> 172.21.15.62:0/4107019282 conn(0x7f750c0f8980 msgr2=0x7f750c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.674+0000 7f75110a9700 1 -- 172.21.15.62:0/4107019282 shutdown_connections 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.674+0000 7f75110a9700 1 -- 172.21.15.62:0/4107019282 wait complete. 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f75110a9700 1 Processor -- start 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f75110a9700 1 -- start start 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f75110a9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 0x7f750c070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f75110a9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f750c103790 0x7f750c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f75110a9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c070d30 con 0x7f750c102df0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f75110a9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c070e70 con 0x7f750c103790 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f750ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 0x7f750c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f750ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 0x7f750c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55418/0 (socket says 172.21.15.62:55418) 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f750ad9d700 1 -- 172.21.15.62:0/1127784303 learned_addr learned my addr 172.21.15.62:0/1127784303 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f750a59c700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f750c103790 0x7f750c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f750ad9d700 1 -- 172.21.15.62:0/1127784303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f750c103790 msgr2=0x7f750c0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f750ad9d700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f750c103790 0x7f750c0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.675+0000 7f750ad9d700 1 -- 172.21.15.62:0/1127784303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc005040 con 0x7f750c102df0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.676+0000 7f750ad9d700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 0x7f750c070260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009180 tx=0x7f74fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.676+0000 7f75037fe700 1 -- 172.21.15.62:0/1127784303 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74fc00e040 con 0x7f750c102df0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.676+0000 7f75037fe700 1 -- 172.21.15.62:0/1127784303 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74fc00bbc0 con 0x7f750c102df0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.676+0000 7f75037fe700 1 -- 172.21.15.62:0/1127784303 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74fc01c630 con 0x7f750c102df0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.676+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c0710c0 con 0x7f750c102df0 2024-05-09T06:42:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.676+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c11a310 con 0x7f750c102df0 2024-05-09T06:42:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.677+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c100100 con 0x7f750c102df0 2024-05-09T06:42:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.678+0000 7f75037fe700 1 -- 172.21.15.62:0/1127784303 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f74fc00bd30 con 0x7f750c102df0 2024-05-09T06:42:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.678+0000 7f75037fe700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f74f8078980 0x7f74f807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.678+0000 7f75037fe700 1 -- 172.21.15.62:0/1127784303 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f74fc09bcd0 con 0x7f750c102df0 2024-05-09T06:42:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.678+0000 7f750a59c700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f74f8078980 0x7f74f807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.679+0000 7f750a59c700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f74f8078980 0x7f74f807ae30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f750c071ba0 tx=0x7f74f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.683+0000 7f75037fe700 1 -- 172.21.15.62:0/1127784303 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f74fc0637a0 con 0x7f750c102df0 2024-05-09T06:42:24.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:24.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.941+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f750c04bed0 con 0x7f750c102df0 2024-05-09T06:42:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.942+0000 7f75037fe700 1 -- 172.21.15.62:0/1127784303 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v37) v1 ==== 107+0+4072 (secure 0 0 0) 0x7f74fc063140 con 0x7f750c102df0 2024-05-09T06:42:24.922 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:24.922 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:38:58.865234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14494":{"gid":14494,"name":"cephfs.smithi062.bwemju","rank":0,"incarnation":16,"state":"up:replay","state_seq":2,"addr":"172.21.15.62:6829/490880971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":490880971},{"type":"v1","addr":"172.21.15.62:6829","nonce":490880971}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f74f8078980 msgr2=0x7f74f807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f74f8078980 0x7f74f807ae30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f750c071ba0 tx=0x7f74f400b040 comp rx=0 tx=0).stop 2024-05-09T06:42:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 msgr2=0x7f750c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 0x7f750c070260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009180 tx=0x7f74fc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 shutdown_connections 2024-05-09T06:42:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f74f8078980 0x7f74f807ae30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f750c102df0 0x7f750c070260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 --2- 172.21.15.62:0/1127784303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f750c103790 0x7f750c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 >> 172.21.15.62:0/1127784303 conn(0x7f750c0f8980 msgr2=0x7f750c0facd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.944+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 shutdown_connections 2024-05-09T06:42:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:24.945+0000 7f75110a9700 1 -- 172.21.15.62:0/1127784303 wait complete. 2024-05-09T06:42:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 16 2024-05-09T06:42:25.539 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:25 smithi062 ceph-mon[109590]: pgmap v288: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:25.539 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:25 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1127784303' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-05-09T06:42:25.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 17 2024-05-09T06:42:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:25.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:25 smithi079 ceph-mon[82381]: pgmap v288: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:25.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:25 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1127784303' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-05-09T06:42:27.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.451+0000 7fa17cb29700 1 -- 172.21.15.62:0/3722796610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178102de0 msgr2=0x7fa1781031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:27.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.451+0000 7fa17cb29700 1 --2- 172.21.15.62:0/3722796610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178102de0 0x7fa1781031b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa168004940 tx=0x7fa168009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:27.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.451+0000 7fa17cb29700 1 -- 172.21.15.62:0/3722796610 shutdown_connections 2024-05-09T06:42:27.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.451+0000 7fa17cb29700 1 --2- 172.21.15.62:0/3722796610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa178103780 0x7fa1780fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:27.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.451+0000 7fa17cb29700 1 --2- 172.21.15.62:0/3722796610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178102de0 0x7fa1781031b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:27.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.451+0000 7fa17cb29700 1 -- 172.21.15.62:0/3722796610 >> 172.21.15.62:0/3722796610 conn(0x7fa1780f8990 msgr2=0x7fa1780fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:27.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.451+0000 7fa17cb29700 1 -- 172.21.15.62:0/3722796610 shutdown_connections 2024-05-09T06:42:27.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.451+0000 7fa17cb29700 1 -- 172.21.15.62:0/3722796610 wait complete. 2024-05-09T06:42:27.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa17cb29700 1 Processor -- start 2024-05-09T06:42:27.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa17cb29700 1 -- start start 2024-05-09T06:42:27.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa17cb29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa178102de0 0x7fa178113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:27.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa17cb29700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178103780 0x7fa178113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:27.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa17cb29700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178114500 con 0x7fa178103780 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa17cb29700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17810db50 con 0x7fa178102de0 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa175d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178103780 0x7fa178113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa175d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178103780 0x7fa178113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55442/0 (socket says 172.21.15.62:55442) 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.452+0000 7fa175d9b700 1 -- 172.21.15.62:0/3600020546 learned_addr learned my addr 172.21.15.62:0/3600020546 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa17659c700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa178102de0 0x7fa178113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa175d9b700 1 -- 172.21.15.62:0/3600020546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa178102de0 msgr2=0x7fa178113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa175d9b700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa178102de0 0x7fa178113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa175d9b700 1 -- 172.21.15.62:0/3600020546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168005040 con 0x7fa178103780 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa175d9b700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178103780 0x7fa178113eb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa16c002a50 tx=0x7fa16c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:27.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa166ffd700 1 -- 172.21.15.62:0/3600020546 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa16c007cc0 con 0x7fa178103780 2024-05-09T06:42:27.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17810de30 con 0x7fa178103780 2024-05-09T06:42:27.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa166ffd700 1 -- 172.21.15.62:0/3600020546 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa16c00f040 con 0x7fa178103780 2024-05-09T06:42:27.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa166ffd700 1 -- 172.21.15.62:0/3600020546 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa16c00d9c0 con 0x7fa178103780 2024-05-09T06:42:27.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.453+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17810e3f0 con 0x7fa178103780 2024-05-09T06:42:27.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.454+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1781000f0 con 0x7fa178103780 2024-05-09T06:42:27.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.455+0000 7fa166ffd700 1 -- 172.21.15.62:0/3600020546 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa16c00db40 con 0x7fa178103780 2024-05-09T06:42:27.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.455+0000 7fa166ffd700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa160078990 0x7fa16007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:27.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.456+0000 7fa166ffd700 1 -- 172.21.15.62:0/3600020546 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fa16c09a680 con 0x7fa178103780 2024-05-09T06:42:27.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.456+0000 7fa17659c700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa160078990 0x7fa16007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:27.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.456+0000 7fa17659c700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa160078990 0x7fa16007ae40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa168004f90 tx=0x7fa168009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:27.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.460+0000 7fa166ffd700 1 -- 172.21.15.62:0/3600020546 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa16c062140 con 0x7fa178103780 2024-05-09T06:42:27.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.722+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fa17810efc0 con 0x7fa178103780 2024-05-09T06:42:27.703 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:27 smithi062 ceph-mon[109590]: pgmap v289: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:27.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.723+0000 7fa166ffd700 1 -- 172.21.15.62:0/3600020546 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v37) v1 ==== 107+0+4919 (secure 0 0 0) 0x7fa16c061ae0 con 0x7fa178103780 2024-05-09T06:42:27.703 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:27.703 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:38:58.865234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14494":{"gid":14494,"name":"cephfs.smithi062.bwemju","rank":0,"incarnation":16,"state":"up:replay","state_seq":2,"addr":"172.21.15.62:6829/490880971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":490880971},{"type":"v1","addr":"172.21.15.62:6829","nonce":490880971}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:27.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.725+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa160078990 msgr2=0x7fa16007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.725+0000 7fa17cb29700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa160078990 0x7fa16007ae40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa168004f90 tx=0x7fa168009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.725+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178103780 msgr2=0x7fa178113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.725+0000 7fa17cb29700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178103780 0x7fa178113eb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa16c002a50 tx=0x7fa16c004600 comp rx=0 tx=0).stop 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.726+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 shutdown_connections 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.726+0000 7fa17cb29700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa178102de0 0x7fa178113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.726+0000 7fa17cb29700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fa160078990 0x7fa16007ae40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.726+0000 7fa17cb29700 1 --2- 172.21.15.62:0/3600020546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa178103780 0x7fa178113eb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.726+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 >> 172.21.15.62:0/3600020546 conn(0x7fa1780f8990 msgr2=0x7fa178107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.726+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 shutdown_connections 2024-05-09T06:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:27.726+0000 7fa17cb29700 1 -- 172.21.15.62:0/3600020546 wait complete. 2024-05-09T06:42:27.707 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 17 2024-05-09T06:42:27.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:27 smithi079 ceph-mon[82381]: pgmap v289: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:28.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 18 2024-05-09T06:42:28.643 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:28.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:28 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3600020546' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-05-09T06:42:28.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:28 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3600020546' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-05-09T06:42:29.778 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:29 smithi062 ceph-mon[109590]: pgmap v290: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:29.778 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:42:29.778 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:42:29.778 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:42:29.778 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:29 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:42:29.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:29 smithi079 ceph-mon[82381]: pgmap v290: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:29.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:29 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:42:29.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:29 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:42:29.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:29 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:42:29.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:29 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' 2024-05-09T06:42:30.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.304+0000 7f15cff00700 1 -- 172.21.15.62:0/4180448364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 msgr2=0x7f15c80fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:30.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.304+0000 7f15cff00700 1 --2- 172.21.15.62:0/4180448364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 0x7f15c80fc1b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15bc004940 tx=0x7f15bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:30.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.304+0000 7f15cff00700 1 -- 172.21.15.62:0/4180448364 shutdown_connections 2024-05-09T06:42:30.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.304+0000 7f15cff00700 1 --2- 172.21.15.62:0/4180448364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 0x7f15c80fc1b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:30.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.304+0000 7f15cff00700 1 --2- 172.21.15.62:0/4180448364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15c8101d90 0x7f15c8102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:30.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.304+0000 7f15cff00700 1 -- 172.21.15.62:0/4180448364 >> 172.21.15.62:0/4180448364 conn(0x7f15c8071d00 msgr2=0x7f15c8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.304+0000 7f15cff00700 1 -- 172.21.15.62:0/4180448364 shutdown_connections 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.304+0000 7f15cff00700 1 -- 172.21.15.62:0/4180448364 wait complete. 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cff00700 1 Processor -- start 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cff00700 1 -- start start 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cff00700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 0x7f15c810ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cff00700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15c8101d90 0x7f15c810f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cff00700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c810f730 con 0x7f15c80fbd40 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cff00700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c810f870 con 0x7f15c8101d90 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cdc9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 0x7f15c810ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cdc9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 0x7f15c810ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55468/0 (socket says 172.21.15.62:55468) 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.305+0000 7f15cdc9c700 1 -- 172.21.15.62:0/1574327949 learned_addr learned my addr 172.21.15.62:0/1574327949 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:30.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15cd49b700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15c8101d90 0x7f15c810f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15cdc9c700 1 -- 172.21.15.62:0/1574327949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15c8101d90 msgr2=0x7f15c810f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15cdc9c700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15c8101d90 0x7f15c810f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15cdc9c700 1 -- 172.21.15.62:0/1574327949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc005040 con 0x7f15c80fbd40 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15cdc9c700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 0x7f15c810ecb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15c4002a50 tx=0x7f15c40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15ba7fc700 1 -- 172.21.15.62:0/1574327949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15c4007cc0 con 0x7f15c80fbd40 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15ba7fc700 1 -- 172.21.15.62:0/1574327949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15c400f040 con 0x7f15c80fbd40 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c8117b60 con 0x7f15c80fbd40 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15ba7fc700 1 -- 172.21.15.62:0/1574327949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15c4009640 con 0x7f15c80fbd40 2024-05-09T06:42:30.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.306+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c8118120 con 0x7f15c80fbd40 2024-05-09T06:42:30.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.307+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c80fd430 con 0x7f15c80fbd40 2024-05-09T06:42:30.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.308+0000 7f15ba7fc700 1 -- 172.21.15.62:0/1574327949 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f15c40097a0 con 0x7f15c80fbd40 2024-05-09T06:42:30.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.308+0000 7f15ba7fc700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f15b4078990 0x7f15b407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:30.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.308+0000 7f15ba7fc700 1 -- 172.21.15.62:0/1574327949 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f15c409a5e0 con 0x7f15c80fbd40 2024-05-09T06:42:30.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.308+0000 7f15cd49b700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f15b4078990 0x7f15b407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:30.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.309+0000 7f15cd49b700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f15b4078990 0x7f15b407ae40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f15bc000c00 tx=0x7f15bc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:30.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.313+0000 7f15ba7fc700 1 -- 172.21.15.62:0/1574327949 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f15c40620b0 con 0x7f15c80fbd40 2024-05-09T06:42:30.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.574+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f15c8065df0 con 0x7f15c80fbd40 2024-05-09T06:42:30.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.575+0000 7f15ba7fc700 1 -- 172.21.15.62:0/1574327949 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v37) v1 ==== 107+0+4924 (secure 0 0 0) 0x7f15c4061a50 con 0x7f15c80fbd40 2024-05-09T06:42:30.555 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:30.555 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:08.136819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14494":{"gid":14494,"name":"cephfs.smithi062.bwemju","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":177,"addr":"172.21.15.62:6829/490880971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":490880971},{"type":"v1","addr":"172.21.15.62:6829","nonce":490880971}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:30.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f15b4078990 msgr2=0x7f15b407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:30.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f15b4078990 0x7f15b407ae40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f15bc000c00 tx=0x7f15bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 msgr2=0x7f15c810ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 0x7f15c810ecb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15c4002a50 tx=0x7f15c40046b0 comp rx=0 tx=0).stop 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 shutdown_connections 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f15b4078990 0x7f15b407ae40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15c80fbd40 0x7f15c810ecb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 --2- 172.21.15.62:0/1574327949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15c8101d90 0x7f15c810f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 >> 172.21.15.62:0/1574327949 conn(0x7f15c8071d00 msgr2=0x7f15c80fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 shutdown_connections 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:30.578+0000 7f15cff00700 1 -- 172.21.15.62:0/1574327949 wait complete. 2024-05-09T06:42:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 18 2024-05-09T06:42:31.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 19 2024-05-09T06:42:31.482 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:31.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:31 smithi079 ceph-mon[82381]: pgmap v291: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:31.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:31 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1574327949' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-05-09T06:42:31.847 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:31 smithi062 ceph-mon[109590]: pgmap v291: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:31.847 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:31 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1574327949' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-05-09T06:42:33.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 -- 172.21.15.62:0/3301445810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a00102e00 msgr2=0x7f8a001031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:33.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 --2- 172.21.15.62:0/3301445810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a00102e00 0x7f8a001031d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89f4004940 tx=0x7f89f4009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 -- 172.21.15.62:0/3301445810 shutdown_connections 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 --2- 172.21.15.62:0/3301445810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a001037a0 0x7f8a000fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 --2- 172.21.15.62:0/3301445810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a00102e00 0x7f8a001031d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 -- 172.21.15.62:0/3301445810 >> 172.21.15.62:0/3301445810 conn(0x7f8a000f89d0 msgr2=0x7f8a000fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 -- 172.21.15.62:0/3301445810 shutdown_connections 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 -- 172.21.15.62:0/3301445810 wait complete. 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 Processor -- start 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.147+0000 7f8a07ed4700 1 -- start start 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a07ed4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a00102e00 0x7f8a00070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a07ed4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a001037a0 0x7f8a000707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a07ed4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a000721b0 con 0x7f8a001037a0 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a07ed4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00070ce0 con 0x7f8a00102e00 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a0546f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a001037a0 0x7f8a000707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a0546f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a001037a0 0x7f8a000707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55490/0 (socket says 172.21.15.62:55490) 2024-05-09T06:42:33.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a0546f700 1 -- 172.21.15.62:0/4143891551 learned_addr learned my addr 172.21.15.62:0/4143891551 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a05c70700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a00102e00 0x7f8a00070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a0546f700 1 -- 172.21.15.62:0/4143891551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a00102e00 msgr2=0x7f8a00070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a0546f700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a00102e00 0x7f8a00070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a0546f700 1 -- 172.21.15.62:0/4143891551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4005040 con 0x7f8a001037a0 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.148+0000 7f8a0546f700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a001037a0 0x7f8a000707a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c800 tx=0x7f89fc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.149+0000 7f89f27fc700 1 -- 172.21.15.62:0/4143891551 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89fc00a760 con 0x7f8a001037a0 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.149+0000 7f89f27fc700 1 -- 172.21.15.62:0/4143891551 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89fc00ad90 con 0x7f8a001037a0 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.149+0000 7f89f27fc700 1 -- 172.21.15.62:0/4143891551 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89fc0113a0 con 0x7f8a001037a0 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.149+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a00070fc0 con 0x7f8a001037a0 2024-05-09T06:42:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.149+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0011a0f0 con 0x7f8a001037a0 2024-05-09T06:42:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.150+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a00100110 con 0x7f8a001037a0 2024-05-09T06:42:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.150+0000 7f89f27fc700 1 -- 172.21.15.62:0/4143891551 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f89fc012400 con 0x7f8a001037a0 2024-05-09T06:42:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.151+0000 7f89f27fc700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f89ec078990 0x7f89ec07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.151+0000 7f8a05c70700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f89ec078990 0x7f89ec07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.151+0000 7f89f27fc700 1 -- 172.21.15.62:0/4143891551 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f89fc09a820 con 0x7f8a001037a0 2024-05-09T06:42:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.151+0000 7f8a05c70700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f89ec078990 0x7f89ec07ae40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89f4004f90 tx=0x7f89f4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:33.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.156+0000 7f89f27fc700 1 -- 172.21.15.62:0/4143891551 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f89fc062390 con 0x7f8a001037a0 2024-05-09T06:42:33.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.416+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f8a000fe550 con 0x7f8a001037a0 2024-05-09T06:42:33.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.417+0000 7f89f27fc700 1 -- 172.21.15.62:0/4143891551 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) v1 ==== 107+0+4921 (secure 0 0 0) 0x7f89fc061d30 con 0x7f8a001037a0 2024-05-09T06:42:33.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:33.397 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:09.052478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14494":{"gid":14494,"name":"cephfs.smithi062.bwemju","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":178,"addr":"172.21.15.62:6829/490880971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":490880971},{"type":"v1","addr":"172.21.15.62:6829","nonce":490880971}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f89ec078990 msgr2=0x7f89ec07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f89ec078990 0x7f89ec07ae40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89f4004f90 tx=0x7f89f4009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a001037a0 msgr2=0x7f8a000707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a001037a0 0x7f8a000707a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c800 tx=0x7f89fc004470 comp rx=0 tx=0).stop 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 shutdown_connections 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a00102e00 0x7f8a00070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f89ec078990 0x7f89ec07ae40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 --2- 172.21.15.62:0/4143891551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a001037a0 0x7f8a000707a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 >> 172.21.15.62:0/4143891551 conn(0x7f8a000f89d0 msgr2=0x7f8a000fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 shutdown_connections 2024-05-09T06:42:33.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:33.420+0000 7f8a07ed4700 1 -- 172.21.15.62:0/4143891551 wait complete. 2024-05-09T06:42:33.401 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 19 2024-05-09T06:42:33.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:33 smithi062 ceph-mon[109590]: pgmap v292: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:33.660 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:33 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/4143891551' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-05-09T06:42:33.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:33 smithi079 ceph-mon[82381]: pgmap v292: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:33.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:33 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/4143891551' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-05-09T06:42:34.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 20 2024-05-09T06:42:34.308 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:34.690 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:34 smithi062 ceph-mon[109590]: pgmap v293: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:34.841 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:34 smithi079 ceph-mon[82381]: pgmap v293: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:35.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.905+0000 7fc0b57eb700 1 -- 172.21.15.62:0/1788389675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fe790 msgr2=0x7fc0b0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:35.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.905+0000 7fc0b57eb700 1 --2- 172.21.15.62:0/1788389675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fe790 0x7fc0b0106e60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4004940 tx=0x7fc0a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.905+0000 7fc0b57eb700 1 -- 172.21.15.62:0/1788389675 shutdown_connections 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.905+0000 7fc0b57eb700 1 --2- 172.21.15.62:0/1788389675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fe790 0x7fc0b0106e60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.905+0000 7fc0b57eb700 1 --2- 172.21.15.62:0/1788389675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b00fddf0 0x7fc0b00fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.905+0000 7fc0b57eb700 1 -- 172.21.15.62:0/1788389675 >> 172.21.15.62:0/1788389675 conn(0x7fc0b00f7870 msgr2=0x7fc0b00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.905+0000 7fc0b57eb700 1 -- 172.21.15.62:0/1788389675 shutdown_connections 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.905+0000 7fc0b57eb700 1 -- 172.21.15.62:0/1788389675 wait complete. 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0b57eb700 1 Processor -- start 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0b57eb700 1 -- start start 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0b57eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fddf0 0x7fc0b0113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0b57eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b00fe790 0x7fc0b0113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0b57eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b01145f0 con 0x7fc0b00fddf0 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0b57eb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b010dbd0 con 0x7fc0b00fe790 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0aeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fddf0 0x7fc0b0113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0aeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fddf0 0x7fc0b0113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43212/0 (socket says 172.21.15.62:43212) 2024-05-09T06:42:35.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0aeffd700 1 -- 172.21.15.62:0/691124231 learned_addr learned my addr 172.21.15.62:0/691124231 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0ae7fc700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b00fe790 0x7fc0b0113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0aeffd700 1 -- 172.21.15.62:0/691124231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b00fe790 msgr2=0x7fc0b0113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0aeffd700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b00fe790 0x7fc0b0113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0aeffd700 1 -- 172.21.15.62:0/691124231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4005040 con 0x7fc0b00fddf0 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.906+0000 7fc0aeffd700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fddf0 0x7fc0b0113a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0002a50 tx=0x7fc0a00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.907+0000 7fc0977fe700 1 -- 172.21.15.62:0/691124231 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a0007cc0 con 0x7fc0b00fddf0 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.907+0000 7fc0977fe700 1 -- 172.21.15.62:0/691124231 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0a000f040 con 0x7fc0b00fddf0 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.907+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b010deb0 con 0x7fc0b00fddf0 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.907+0000 7fc0977fe700 1 -- 172.21.15.62:0/691124231 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a000db70 con 0x7fc0b00fddf0 2024-05-09T06:42:35.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.907+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b010e3f0 con 0x7fc0b00fddf0 2024-05-09T06:42:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.908+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b0066ab0 con 0x7fc0b00fddf0 2024-05-09T06:42:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.908+0000 7fc0977fe700 1 -- 172.21.15.62:0/691124231 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc0a000dd10 con 0x7fc0b00fddf0 2024-05-09T06:42:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.909+0000 7fc0977fe700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc098078980 0x7fc09807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.909+0000 7fc0ae7fc700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc098078980 0x7fc09807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.909+0000 7fc0977fe700 1 -- 172.21.15.62:0/691124231 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fc0a009a000 con 0x7fc0b00fddf0 2024-05-09T06:42:35.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.910+0000 7fc0ae7fc700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc098078980 0x7fc09807ae30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0b010f300 tx=0x7fc0a4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:35.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:35.914+0000 7fc0977fe700 1 -- 172.21.15.62:0/691124231 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc0a0061a50 con 0x7fc0b00fddf0 2024-05-09T06:42:36.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.178+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fc0b004c710 con 0x7fc0b00fddf0 2024-05-09T06:42:36.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.178+0000 7fc0977fe700 1 -- 172.21.15.62:0/691124231 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) v1 ==== 107+0+4930 (secure 0 0 0) 0x7fc0a00613f0 con 0x7fc0b00fddf0 2024-05-09T06:42:36.158 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:36.159 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:11.078923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14494":{"gid":14494,"name":"cephfs.smithi062.bwemju","rank":0,"incarnation":16,"state":"up:active","state_seq":179,"addr":"172.21.15.62:6829/490880971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":490880971},{"type":"v1","addr":"172.21.15.62:6829","nonce":490880971}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14494,"qdb_cluster":[14494]},"id":1}]} 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc098078980 msgr2=0x7fc09807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc098078980 0x7fc09807ae30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0b010f300 tx=0x7fc0a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fddf0 msgr2=0x7fc0b0113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fddf0 0x7fc0b0113a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0002a50 tx=0x7fc0a00046b0 comp rx=0 tx=0).stop 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 shutdown_connections 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fc098078980 0x7fc09807ae30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0b00fddf0 0x7fc0b0113a60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 --2- 172.21.15.62:0/691124231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b00fe790 0x7fc0b0113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 >> 172.21.15.62:0/691124231 conn(0x7fc0b00f7870 msgr2=0x7fc0b00f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:36.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 shutdown_connections 2024-05-09T06:42:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:36.181+0000 7fc0b57eb700 1 -- 172.21.15.62:0/691124231 wait complete. 2024-05-09T06:42:36.162 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 20 2024-05-09T06:42:36.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 21 2024-05-09T06:42:37.068 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:37.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:37 smithi062 ceph-mon[109590]: pgmap v294: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:37.386 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:37 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/691124231' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-05-09T06:42:37.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:37 smithi079 ceph-mon[82381]: pgmap v294: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:37.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:37 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/691124231' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-05-09T06:42:38.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 -- 172.21.15.62:0/3280541292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c102f60 msgr2=0x7efc5c103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:38.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 --2- 172.21.15.62:0/3280541292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c102f60 0x7efc5c103330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efc4c004940 tx=0x7efc4c009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:38.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 -- 172.21.15.62:0/3280541292 shutdown_connections 2024-05-09T06:42:38.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 --2- 172.21.15.62:0/3280541292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c0fb520 0x7efc5c0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:38.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 --2- 172.21.15.62:0/3280541292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c102f60 0x7efc5c103330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:38.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 -- 172.21.15.62:0/3280541292 >> 172.21.15.62:0/3280541292 conn(0x7efc5c0714d0 msgr2=0x7efc5c0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:38.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 -- 172.21.15.62:0/3280541292 shutdown_connections 2024-05-09T06:42:38.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 -- 172.21.15.62:0/3280541292 wait complete. 2024-05-09T06:42:38.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.713+0000 7efc623f6700 1 Processor -- start 2024-05-09T06:42:38.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc623f6700 1 -- start start 2024-05-09T06:42:38.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc623f6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c0fb520 0x7efc5c113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc623f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c102f60 0x7efc5c113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc623f6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c114510 con 0x7efc5c0fb520 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc623f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c10db30 con 0x7efc5c102f60 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc5bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c0fb520 0x7efc5c113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc5bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c0fb520 0x7efc5c113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43228/0 (socket says 172.21.15.62:43228) 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc5bfff700 1 -- 172.21.15.62:0/1345470080 learned_addr learned my addr 172.21.15.62:0/1345470080 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc5b7fe700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c102f60 0x7efc5c113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc5bfff700 1 -- 172.21.15.62:0/1345470080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c102f60 msgr2=0x7efc5c113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc5bfff700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c102f60 0x7efc5c113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.714+0000 7efc5bfff700 1 -- 172.21.15.62:0/1345470080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c005040 con 0x7efc5c0fb520 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.715+0000 7efc5bfff700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c0fb520 0x7efc5c113980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00b3b0 tx=0x7efc4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.715+0000 7efc58ff9700 1 -- 172.21.15.62:0/1345470080 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc4c00e040 con 0x7efc5c0fb520 2024-05-09T06:42:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.715+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c10ddb0 con 0x7efc5c0fb520 2024-05-09T06:42:38.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.715+0000 7efc58ff9700 1 -- 172.21.15.62:0/1345470080 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc4c013420 con 0x7efc5c0fb520 2024-05-09T06:42:38.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.715+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c10e2f0 con 0x7efc5c0fb520 2024-05-09T06:42:38.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.715+0000 7efc58ff9700 1 -- 172.21.15.62:0/1345470080 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc4c01c630 con 0x7efc5c0fb520 2024-05-09T06:42:38.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.716+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c100250 con 0x7efc5c0fb520 2024-05-09T06:42:38.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.716+0000 7efc58ff9700 1 -- 172.21.15.62:0/1345470080 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7efc4c013590 con 0x7efc5c0fb520 2024-05-09T06:42:38.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.717+0000 7efc58ff9700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efc44078990 0x7efc4407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:38.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.717+0000 7efc58ff9700 1 -- 172.21.15.62:0/1345470080 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7efc4c09b9b0 con 0x7efc5c0fb520 2024-05-09T06:42:38.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.717+0000 7efc5b7fe700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efc44078990 0x7efc4407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:38.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.717+0000 7efc5b7fe700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efc44078990 0x7efc4407ae40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efc5c10f220 tx=0x7efc500043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:38.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.722+0000 7efc58ff9700 1 -- 172.21.15.62:0/1345470080 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7efc4c063520 con 0x7efc5c0fb520 2024-05-09T06:42:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.984+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7efc5c109fe0 con 0x7efc5c0fb520 2024-05-09T06:42:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.985+0000 7efc58ff9700 1 -- 172.21.15.62:0/1345470080 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) v1 ==== 107+0+4132 (secure 0 0 0) 0x7efc4c062ec0 con 0x7efc5c0fb520 2024-05-09T06:42:38.964 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:38.965 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:21.945813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efc44078990 msgr2=0x7efc4407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efc44078990 0x7efc4407ae40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efc5c10f220 tx=0x7efc500043c0 comp rx=0 tx=0).stop 2024-05-09T06:42:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c0fb520 msgr2=0x7efc5c113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c0fb520 0x7efc5c113980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00b3b0 tx=0x7efc4c009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 shutdown_connections 2024-05-09T06:42:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7efc44078990 0x7efc4407ae40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:38.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc5c0fb520 0x7efc5c113980 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 --2- 172.21.15.62:0/1345470080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc5c102f60 0x7efc5c113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 >> 172.21.15.62:0/1345470080 conn(0x7efc5c0714d0 msgr2=0x7efc5c0fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.987+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 shutdown_connections 2024-05-09T06:42:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:38.988+0000 7efc623f6700 1 -- 172.21.15.62:0/1345470080 wait complete. 2024-05-09T06:42:38.968 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-05-09T06:42:39.282 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:39 smithi062 ceph-mon[109590]: pgmap v295: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:39.282 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:39 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1345470080' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-05-09T06:42:39.282 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:39 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:39.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:39 smithi079 ceph-mon[82381]: pgmap v295: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:39.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:39 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1345470080' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-05-09T06:42:39.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:39 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:39.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 22 2024-05-09T06:42:39.882 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:41.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:41 smithi062 ceph-mon[109590]: pgmap v296: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.448+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3222758368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4103780 msgr2=0x7f78b40fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.448+0000 7f78b9ec3700 1 --2- 172.21.15.62:0/3222758368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4103780 0x7f78b40fcdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f789c004940 tx=0x7f789c009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.448+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3222758368 shutdown_connections 2024-05-09T06:42:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.448+0000 7f78b9ec3700 1 --2- 172.21.15.62:0/3222758368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4103780 0x7f78b40fcdf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.448+0000 7f78b9ec3700 1 --2- 172.21.15.62:0/3222758368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b4102de0 0x7f78b41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.448+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3222758368 >> 172.21.15.62:0/3222758368 conn(0x7f78b40f8950 msgr2=0x7f78b40fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:41.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.448+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3222758368 shutdown_connections 2024-05-09T06:42:41.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.448+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3222758368 wait complete. 2024-05-09T06:42:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.449+0000 7f78b9ec3700 1 Processor -- start 2024-05-09T06:42:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.449+0000 7f78b9ec3700 1 -- start start 2024-05-09T06:42:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.449+0000 7f78b9ec3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4102de0 0x7f78b4113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.449+0000 7f78b9ec3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b4103780 0x7f78b4114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.449+0000 7f78b9ec3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b41146a0 con 0x7f78b4102de0 2024-05-09T06:42:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.449+0000 7f78b9ec3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b410dad0 con 0x7f78b4103780 2024-05-09T06:42:41.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.449+0000 7f78b37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4102de0 0x7f78b4113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b37fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4102de0 0x7f78b4113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43244/0 (socket says 172.21.15.62:43244) 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b37fe700 1 -- 172.21.15.62:0/3693977260 learned_addr learned my addr 172.21.15.62:0/3693977260 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b2ffd700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b4103780 0x7f78b4114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b37fe700 1 -- 172.21.15.62:0/3693977260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b4103780 msgr2=0x7f78b4114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b37fe700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b4103780 0x7f78b4114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b37fe700 1 -- 172.21.15.62:0/3693977260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c005040 con 0x7f78b4102de0 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b37fe700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4102de0 0x7f78b4113b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f78a400cb10 tx=0x7f78a4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78abfff700 1 -- 172.21.15.62:0/3693977260 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a4004200 con 0x7f78b4102de0 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78abfff700 1 -- 172.21.15.62:0/3693977260 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78a400acc0 con 0x7f78b4102de0 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b410ddb0 con 0x7f78b4102de0 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78abfff700 1 -- 172.21.15.62:0/3693977260 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a4003d90 con 0x7f78b4102de0 2024-05-09T06:42:41.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.450+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b410e370 con 0x7f78b4102de0 2024-05-09T06:42:41.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.451+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b40fe530 con 0x7f78b4102de0 2024-05-09T06:42:41.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.452+0000 7f78abfff700 1 -- 172.21.15.62:0/3693977260 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f78a4003430 con 0x7f78b4102de0 2024-05-09T06:42:41.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.452+0000 7f78abfff700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f78a0078990 0x7f78a007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:41.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.453+0000 7f78abfff700 1 -- 172.21.15.62:0/3693977260 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f78a409aef0 con 0x7f78b4102de0 2024-05-09T06:42:41.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.453+0000 7f78b2ffd700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f78a0078990 0x7f78a007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:41.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.453+0000 7f78b2ffd700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f78a0078990 0x7f78a007ae40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f789c009fd0 tx=0x7f789c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:41.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.457+0000 7f78abfff700 1 -- 172.21.15.62:0/3693977260 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f78a4062940 con 0x7f78b4102de0 2024-05-09T06:42:41.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:41 smithi079 ceph-mon[82381]: pgmap v296: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.719+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f78b404bed0 con 0x7f78b4102de0 2024-05-09T06:42:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.719+0000 7f78abfff700 1 -- 172.21.15.62:0/3693977260 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) v1 ==== 107+0+4143 (secure 0 0 0) 0x7f78a40622e0 con 0x7f78b4102de0 2024-05-09T06:42:41.700 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:41.700 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:21.950094+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":0,"incarnation":22,"state":"up:replay","state_seq":3,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:41.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f78a0078990 msgr2=0x7f78a007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:41.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f78a0078990 0x7f78a007ae40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f789c009fd0 tx=0x7f789c009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4102de0 msgr2=0x7f78b4113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4102de0 0x7f78b4113b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f78a400cb10 tx=0x7f78a4007f90 comp rx=0 tx=0).stop 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 shutdown_connections 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f78a0078990 0x7f78a007ae40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78b4102de0 0x7f78b4113b10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 --2- 172.21.15.62:0/3693977260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78b4103780 0x7f78b4114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 >> 172.21.15.62:0/3693977260 conn(0x7f78b40f8950 msgr2=0x7f78b4100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 shutdown_connections 2024-05-09T06:42:41.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:41.722+0000 7f78b9ec3700 1 -- 172.21.15.62:0/3693977260 wait complete. 2024-05-09T06:42:41.703 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 22 2024-05-09T06:42:42.355 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:42 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3693977260' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-05-09T06:42:42.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 23 2024-05-09T06:42:42.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:42 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3693977260' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-05-09T06:42:42.652 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:43.409 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:43 smithi062 ceph-mon[109590]: pgmap v297: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:43.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:43 smithi079 ceph-mon[82381]: pgmap v297: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:44.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 -- 172.21.15.62:0/3584233280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 msgr2=0x7f95841031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 --2- 172.21.15.62:0/3584233280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 0x7f95841031b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9578004940 tx=0x7f9578009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 -- 172.21.15.62:0/3584233280 shutdown_connections 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 --2- 172.21.15.62:0/3584233280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9584103780 0x7f95840fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 --2- 172.21.15.62:0/3584233280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 0x7f95841031b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 -- 172.21.15.62:0/3584233280 >> 172.21.15.62:0/3584233280 conn(0x7f95840f8950 msgr2=0x7f95840fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 -- 172.21.15.62:0/3584233280 shutdown_connections 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 -- 172.21.15.62:0/3584233280 wait complete. 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 Processor -- start 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.246+0000 7f958ab7e700 1 -- start start 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958ab7e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 0x7f9584115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:44.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958ab7e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9584103780 0x7f9584116260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958ab7e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584116940 con 0x7f9584102de0 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958ab7e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958410fcd0 con 0x7f9584103780 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958891a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 0x7f9584115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958891a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 0x7f9584115d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48290/0 (socket says 172.21.15.62:48290) 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958891a700 1 -- 172.21.15.62:0/2074293944 learned_addr learned my addr 172.21.15.62:0/2074293944 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f9583fff700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9584103780 0x7f9584116260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958891a700 1 -- 172.21.15.62:0/2074293944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9584103780 msgr2=0x7f9584116260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958891a700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9584103780 0x7f9584116260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958891a700 1 -- 172.21.15.62:0/2074293944 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578005040 con 0x7f9584102de0 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f9583fff700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9584103780 0x7f9584116260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.247+0000 7f958891a700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 0x7f9584115d20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9578009180 tx=0x7f9578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.248+0000 7f95817fa700 1 -- 172.21.15.62:0/2074293944 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f957800e040 con 0x7f9584102de0 2024-05-09T06:42:44.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.248+0000 7f95817fa700 1 -- 172.21.15.62:0/2074293944 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f957800bbc0 con 0x7f9584102de0 2024-05-09T06:42:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.248+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958410fef0 con 0x7f9584102de0 2024-05-09T06:42:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.248+0000 7f95817fa700 1 -- 172.21.15.62:0/2074293944 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f957801c630 con 0x7f9584102de0 2024-05-09T06:42:44.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.248+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95841104b0 con 0x7f9584102de0 2024-05-09T06:42:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.249+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95841072e0 con 0x7f9584102de0 2024-05-09T06:42:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.249+0000 7f95817fa700 1 -- 172.21.15.62:0/2074293944 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f957800bd30 con 0x7f9584102de0 2024-05-09T06:42:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.250+0000 7f95817fa700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9574078980 0x7f957407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.250+0000 7f95817fa700 1 -- 172.21.15.62:0/2074293944 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f957809bd70 con 0x7f9584102de0 2024-05-09T06:42:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.250+0000 7f9583fff700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9574078980 0x7f957407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:44.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.251+0000 7f9583fff700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9574078980 0x7f957407ae30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9570006fd0 tx=0x7f9570008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:44.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.255+0000 7f95817fa700 1 -- 172.21.15.62:0/2074293944 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f95780637e0 con 0x7f9584102de0 2024-05-09T06:42:44.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.514+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f95841072e0 con 0x7f9584102de0 2024-05-09T06:42:44.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.514+0000 7f95817fa700 1 -- 172.21.15.62:0/2074293944 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) v1 ==== 107+0+4148 (secure 0 0 0) 0x7f9578063180 con 0x7f9584102de0 2024-05-09T06:42:44.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:44.494 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:29.861788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":0,"incarnation":22,"state":"up:reconnect","state_seq":184,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:44.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9574078980 msgr2=0x7f957407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9574078980 0x7f957407ae30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9570006fd0 tx=0x7f9570008040 comp rx=0 tx=0).stop 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 msgr2=0x7f9584115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 0x7f9584115d20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9578009180 tx=0x7f9578009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 shutdown_connections 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f9574078980 0x7f957407ae30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584102de0 0x7f9584115d20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 --2- 172.21.15.62:0/2074293944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9584103780 0x7f9584116260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 >> 172.21.15.62:0/2074293944 conn(0x7f95840f8950 msgr2=0x7f95840fa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 shutdown_connections 2024-05-09T06:42:44.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:44.517+0000 7f958ab7e700 1 -- 172.21.15.62:0/2074293944 wait complete. 2024-05-09T06:42:44.498 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 23 2024-05-09T06:42:45.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 24 2024-05-09T06:42:45.389 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:45.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:45 smithi062 ceph-mon[109590]: pgmap v298: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:45.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:45 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2074293944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-05-09T06:42:45.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:45 smithi079 ceph-mon[82381]: pgmap v298: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:45.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:45 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2074293944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.022+0000 7f7d62b60700 1 -- 172.21.15.62:0/899656250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 msgr2=0x7f7d5c106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.022+0000 7f7d62b60700 1 --2- 172.21.15.62:0/899656250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 0x7f7d5c106e30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d48004940 tx=0x7f7d48009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.022+0000 7f7d62b60700 1 -- 172.21.15.62:0/899656250 shutdown_connections 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.022+0000 7f7d62b60700 1 --2- 172.21.15.62:0/899656250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 0x7f7d5c106e30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.022+0000 7f7d62b60700 1 --2- 172.21.15.62:0/899656250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d5c0fde50 0x7f7d5c0fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.022+0000 7f7d62b60700 1 -- 172.21.15.62:0/899656250 >> 172.21.15.62:0/899656250 conn(0x7f7d5c0f7860 msgr2=0x7f7d5c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.023+0000 7f7d62b60700 1 -- 172.21.15.62:0/899656250 shutdown_connections 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.023+0000 7f7d62b60700 1 -- 172.21.15.62:0/899656250 wait complete. 2024-05-09T06:42:47.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.023+0000 7f7d62b60700 1 Processor -- start 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.023+0000 7f7d62b60700 1 -- start start 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.023+0000 7f7d62b60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d5c0fde50 0x7f7d5c115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.023+0000 7f7d62b60700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 0x7f7d5c1160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.023+0000 7f7d62b60700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c116710 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.023+0000 7f7d62b60700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c10fcf0 con 0x7f7d5c0fde50 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d5bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 0x7f7d5c1160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d5bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 0x7f7d5c1160c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48314/0 (socket says 172.21.15.62:48314) 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d5bfff700 1 -- 172.21.15.62:0/814345981 learned_addr learned my addr 172.21.15.62:0/814345981 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d608fc700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d5c0fde50 0x7f7d5c115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d5bfff700 1 -- 172.21.15.62:0/814345981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d5c0fde50 msgr2=0x7f7d5c115b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d5bfff700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d5c0fde50 0x7f7d5c115b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d5bfff700 1 -- 172.21.15.62:0/814345981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d48005040 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d5bfff700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 0x7f7d5c1160c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009380 tx=0x7f7d48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:47.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d597fa700 1 -- 172.21.15.62:0/814345981 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4800e040 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d597fa700 1 -- 172.21.15.62:0/814345981 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d48009af0 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c10ffd0 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d597fa700 1 -- 172.21.15.62:0/814345981 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4801c3f0 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.024+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c110510 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.025+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c066b50 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.026+0000 7f7d597fa700 1 -- 172.21.15.62:0/814345981 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f7d48013420 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.027+0000 7f7d597fa700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7d4c078990 0x7f7d4c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.027+0000 7f7d597fa700 1 -- 172.21.15.62:0/814345981 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f7d4809bc60 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.027+0000 7f7d608fc700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7d4c078990 0x7f7d4c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:47.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.027+0000 7f7d608fc700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7d4c078990 0x7f7d4c07ae40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7d50004f40 tx=0x7f7d5000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:47.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.031+0000 7f7d597fa700 1 -- 172.21.15.62:0/814345981 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f7d480636b0 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.292+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f7d5c04c710 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.293+0000 7f7d597fa700 1 -- 172.21.15.62:0/814345981 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) v1 ==== 107+0+4145 (secure 0 0 0) 0x7f7d48063050 con 0x7f7d5c0fe7f0 2024-05-09T06:42:47.278 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:47.278 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:30.096202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":0,"incarnation":22,"state":"up:rejoin","state_seq":185,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7d4c078990 msgr2=0x7f7d4c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7d4c078990 0x7f7d4c07ae40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7d50004f40 tx=0x7f7d5000b040 comp rx=0 tx=0).stop 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 msgr2=0x7f7d5c1160c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 0x7f7d5c1160c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009380 tx=0x7f7d48009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 shutdown_connections 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d5c0fde50 0x7f7d5c115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7d4c078990 0x7f7d4c07ae40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 --2- 172.21.15.62:0/814345981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d5c0fe7f0 0x7f7d5c1160c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.295+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 >> 172.21.15.62:0/814345981 conn(0x7f7d5c0f7860 msgr2=0x7f7d5c0fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.296+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 shutdown_connections 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:47.296+0000 7f7d62b60700 1 -- 172.21.15.62:0/814345981 wait complete. 2024-05-09T06:42:47.279 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 24 2024-05-09T06:42:47.409 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:47 smithi062 ceph-mon[109590]: pgmap v299: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:47.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:47 smithi079 ceph-mon[82381]: pgmap v299: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:47.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 25 2024-05-09T06:42:48.262 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:48.385 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:48 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/814345981' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-05-09T06:42:48.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:48 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/814345981' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-05-09T06:42:49.361 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:49 smithi062 ceph-mon[109590]: pgmap v300: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:49.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:49 smithi079 ceph-mon[82381]: pgmap v300: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.899+0000 7fae636f5700 1 -- 172.21.15.62:0/296712645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 msgr2=0x7fae5c1090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.899+0000 7fae636f5700 1 --2- 172.21.15.62:0/296712645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 0x7fae5c1090f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae50004970 tx=0x7fae50009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.900+0000 7fae636f5700 1 -- 172.21.15.62:0/296712645 shutdown_connections 2024-05-09T06:42:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.900+0000 7fae636f5700 1 --2- 172.21.15.62:0/296712645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 0x7fae5c1090f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.900+0000 7fae636f5700 1 --2- 172.21.15.62:0/296712645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae5c070300 0x7fae5c0706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.900+0000 7fae636f5700 1 -- 172.21.15.62:0/296712645 >> 172.21.15.62:0/296712645 conn(0x7fae5c0f8990 msgr2=0x7fae5c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.900+0000 7fae636f5700 1 -- 172.21.15.62:0/296712645 shutdown_connections 2024-05-09T06:42:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.900+0000 7fae636f5700 1 -- 172.21.15.62:0/296712645 wait complete. 2024-05-09T06:42:49.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae636f5700 1 Processor -- start 2024-05-09T06:42:49.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae636f5700 1 -- start start 2024-05-09T06:42:49.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae636f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae5c070300 0x7fae5c115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:49.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae636f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 0x7fae5c1160e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae636f5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c1167c0 con 0x7fae5c070c10 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae636f5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c10fd10 con 0x7fae5c070300 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae60c90700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 0x7fae5c1160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae60c90700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 0x7fae5c1160e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48332/0 (socket says 172.21.15.62:48332) 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae60c90700 1 -- 172.21.15.62:0/410026751 learned_addr learned my addr 172.21.15.62:0/410026751 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae61491700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae5c070300 0x7fae5c115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae60c90700 1 -- 172.21.15.62:0/410026751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae5c070300 msgr2=0x7fae5c115ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.901+0000 7fae60c90700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae5c070300 0x7fae5c115ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.902+0000 7fae60c90700 1 -- 172.21.15.62:0/410026751 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50005040 con 0x7fae5c070c10 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.902+0000 7fae61491700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae5c070300 0x7fae5c115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.902+0000 7fae60c90700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 0x7fae5c1160e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae50000c00 tx=0x7fae50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.902+0000 7fae59ffb700 1 -- 172.21.15.62:0/410026751 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5000e040 con 0x7fae5c070c10 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.902+0000 7fae59ffb700 1 -- 172.21.15.62:0/410026751 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae5000bc10 con 0x7fae5c070c10 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.902+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c10ff30 con 0x7fae5c070c10 2024-05-09T06:42:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.902+0000 7fae59ffb700 1 -- 172.21.15.62:0/410026751 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5001c3f0 con 0x7fae5c070c10 2024-05-09T06:42:49.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.902+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c110470 con 0x7fae5c070c10 2024-05-09T06:42:49.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.903+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c071a40 con 0x7fae5c070c10 2024-05-09T06:42:49.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.904+0000 7fae59ffb700 1 -- 172.21.15.62:0/410026751 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fae5001c670 con 0x7fae5c070c10 2024-05-09T06:42:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.905+0000 7fae59ffb700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae44078990 0x7fae4407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.905+0000 7fae59ffb700 1 -- 172.21.15.62:0/410026751 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fae5009bb80 con 0x7fae5c070c10 2024-05-09T06:42:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.905+0000 7fae61491700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae44078990 0x7fae4407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.906+0000 7fae61491700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae44078990 0x7fae4407ae40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae4c001370 tx=0x7fae4c0096a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:49.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:49.910+0000 7fae59ffb700 1 -- 172.21.15.62:0/410026751 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fae50063650 con 0x7fae5c070c10 2024-05-09T06:42:50.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.185+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fae5c04c710 con 0x7fae5c070c10 2024-05-09T06:42:50.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.186+0000 7fae59ffb700 1 -- 172.21.15.62:0/410026751 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) v1 ==== 107+0+4154 (secure 0 0 0) 0x7fae50062ff0 con 0x7fae5c070c10 2024-05-09T06:42:50.166 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:50.166 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:32.099907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":0,"incarnation":22,"state":"up:active","state_seq":186,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-05-09T06:42:50.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.188+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae44078990 msgr2=0x7fae4407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:50.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.188+0000 7fae636f5700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae44078990 0x7fae4407ae40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae4c001370 tx=0x7fae4c0096a0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.188+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 msgr2=0x7fae5c1160e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.188+0000 7fae636f5700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 0x7fae5c1160e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae50000c00 tx=0x7fae50009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.189+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 shutdown_connections 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.189+0000 7fae636f5700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae5c070300 0x7fae5c115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.189+0000 7fae636f5700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae44078990 0x7fae4407ae40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.189+0000 7fae636f5700 1 --2- 172.21.15.62:0/410026751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae5c070c10 0x7fae5c1160e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.189+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 >> 172.21.15.62:0/410026751 conn(0x7fae5c0f8990 msgr2=0x7fae5c0f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.189+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 shutdown_connections 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:50.189+0000 7fae636f5700 1 -- 172.21.15.62:0/410026751 wait complete. 2024-05-09T06:42:50.169 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 25 2024-05-09T06:42:50.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 26 2024-05-09T06:42:51.087 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:51.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:51 smithi062 ceph-mon[109590]: pgmap v301: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:51.160 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:51 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/410026751' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-05-09T06:42:51.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:51 smithi079 ceph-mon[82381]: pgmap v301: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:51.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:51 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/410026751' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-05-09T06:42:52.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.722+0000 7f322f82e700 1 -- 172.21.15.62:0/1676515006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228065640 msgr2=0x7f3228065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.722+0000 7f322f82e700 1 --2- 172.21.15.62:0/1676515006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228065640 0x7f3228065ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3224004940 tx=0x7f3224009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.722+0000 7f322f82e700 1 -- 172.21.15.62:0/1676515006 shutdown_connections 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.722+0000 7f322f82e700 1 --2- 172.21.15.62:0/1676515006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228065640 0x7f3228065ab0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.722+0000 7f322f82e700 1 --2- 172.21.15.62:0/1676515006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228102e50 0x7f3228103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.722+0000 7f322f82e700 1 -- 172.21.15.62:0/1676515006 >> 172.21.15.62:0/1676515006 conn(0x7f3228071d00 msgr2=0x7f3228072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.723+0000 7f322f82e700 1 -- 172.21.15.62:0/1676515006 shutdown_connections 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.723+0000 7f322f82e700 1 -- 172.21.15.62:0/1676515006 wait complete. 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.723+0000 7f322f82e700 1 Processor -- start 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.723+0000 7f322f82e700 1 -- start start 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.723+0000 7f322f82e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228065640 0x7f3228113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.723+0000 7f322f82e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228102e50 0x7f32281140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.723+0000 7f322f82e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3228114780 con 0x7f3228102e50 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.723+0000 7f322f82e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322810dae0 con 0x7f3228065640 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322cdc9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228102e50 0x7f32281140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322cdc9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228102e50 0x7f32281140a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48354/0 (socket says 172.21.15.62:48354) 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322cdc9700 1 -- 172.21.15.62:0/3211371656 learned_addr learned my addr 172.21.15.62:0/3211371656 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322d5ca700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228065640 0x7f3228113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322cdc9700 1 -- 172.21.15.62:0/3211371656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228065640 msgr2=0x7f3228113b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322cdc9700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228065640 0x7f3228113b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322cdc9700 1 -- 172.21.15.62:0/3211371656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224005040 con 0x7f3228102e50 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322cdc9700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228102e50 0x7f32281140a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f322400b8b0 tx=0x7f3224009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f3219ffb700 1 -- 172.21.15.62:0/3211371656 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322400e040 con 0x7f3228102e50 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f3219ffb700 1 -- 172.21.15.62:0/3211371656 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3224004290 con 0x7f3228102e50 2024-05-09T06:42:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322810dd60 con 0x7f3228102e50 2024-05-09T06:42:52.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.724+0000 7f3219ffb700 1 -- 172.21.15.62:0/3211371656 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f322401c3f0 con 0x7f3228102e50 2024-05-09T06:42:52.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.725+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322810e320 con 0x7f3228102e50 2024-05-09T06:42:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.726+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32280fe540 con 0x7f3228102e50 2024-05-09T06:42:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.726+0000 7f3219ffb700 1 -- 172.21.15.62:0/3211371656 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f32240137b0 con 0x7f3228102e50 2024-05-09T06:42:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.727+0000 7f3219ffb700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3214078990 0x7f321407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.727+0000 7f3219ffb700 1 -- 172.21.15.62:0/3211371656 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f322409bc20 con 0x7f3228102e50 2024-05-09T06:42:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.727+0000 7f322d5ca700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3214078990 0x7f321407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:52.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.727+0000 7f322d5ca700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3214078990 0x7f321407ae40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f321c006fd0 tx=0x7f321c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:52.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.732+0000 7f3219ffb700 1 -- 172.21.15.62:0/3211371656 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f32240636f0 con 0x7f3228102e50 2024-05-09T06:42:52.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.997+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f322805f5c0 con 0x7f3228102e50 2024-05-09T06:42:52.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:52.997+0000 7f3219ffb700 1 -- 172.21.15.62:0/3211371656 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) v1 ==== 107+0+5001 (secure 0 0 0) 0x7f3224068e60 con 0x7f3228102e50 2024-05-09T06:42:52.977 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:52.978 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:32.099907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi079.qwqgdo","rank":0,"incarnation":22,"state":"up:active","state_seq":186,"addr":"172.21.15.79:6825/331990842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":331990842},{"type":"v1","addr":"172.21.15.79:6825","nonce":331990842}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-05-09T06:42:52.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3214078990 msgr2=0x7f321407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3214078990 0x7f321407ae40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f321c006fd0 tx=0x7f321c008040 comp rx=0 tx=0).stop 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228102e50 msgr2=0x7f32281140a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228102e50 0x7f32281140a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f322400b8b0 tx=0x7f3224009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 shutdown_connections 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228065640 0x7f3228113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3214078990 0x7f321407ae40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 --2- 172.21.15.62:0/3211371656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3228102e50 0x7f32281140a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 >> 172.21.15.62:0/3211371656 conn(0x7f3228071d00 msgr2=0x7f32280f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:52.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 shutdown_connections 2024-05-09T06:42:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:53.000+0000 7f322f82e700 1 -- 172.21.15.62:0/3211371656 wait complete. 2024-05-09T06:42:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 26 2024-05-09T06:42:53.274 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:53 smithi062 ceph-mon[109590]: pgmap v302: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:53.275 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:53 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3211371656' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-05-09T06:42:53.587 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 27 2024-05-09T06:42:53.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:53 smithi079 ceph-mon[82381]: pgmap v302: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:53.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:53 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3211371656' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-05-09T06:42:53.864 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:54.320 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:54 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:54.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:54 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:55.257 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:55 smithi062 ceph-mon[109590]: pgmap v303: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:55.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.467+0000 7fefe82c0700 1 -- 172.21.15.62:0/2447240401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe0101d90 msgr2=0x7fefe0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:55.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.467+0000 7fefe82c0700 1 --2- 172.21.15.62:0/2447240401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe0101d90 0x7fefe0102160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fefdc004940 tx=0x7fefdc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:55.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.467+0000 7fefe82c0700 1 -- 172.21.15.62:0/2447240401 shutdown_connections 2024-05-09T06:42:55.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.467+0000 7fefe82c0700 1 --2- 172.21.15.62:0/2447240401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe00fbd40 0x7fefe00fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:55.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.467+0000 7fefe82c0700 1 --2- 172.21.15.62:0/2447240401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe0101d90 0x7fefe0102160 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:55.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.467+0000 7fefe82c0700 1 -- 172.21.15.62:0/2447240401 >> 172.21.15.62:0/2447240401 conn(0x7fefe0071d00 msgr2=0x7fefe0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:55.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.467+0000 7fefe82c0700 1 -- 172.21.15.62:0/2447240401 shutdown_connections 2024-05-09T06:42:55.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.467+0000 7fefe82c0700 1 -- 172.21.15.62:0/2447240401 wait complete. 2024-05-09T06:42:55.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe82c0700 1 Processor -- start 2024-05-09T06:42:55.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe82c0700 1 -- start start 2024-05-09T06:42:55.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe82c0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe00fbd40 0x7fefe010c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:55.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe82c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe0101d90 0x7fefe010ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe82c0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe010d440 con 0x7fefe00fbd40 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe82c0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe010d5b0 con 0x7fefe0101d90 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe605c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe00fbd40 0x7fefe010c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe605c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe00fbd40 0x7fefe010c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52256/0 (socket says 172.21.15.62:52256) 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe605c700 1 -- 172.21.15.62:0/376017243 learned_addr learned my addr 172.21.15.62:0/376017243 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe585b700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe0101d90 0x7fefe010ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe605c700 1 -- 172.21.15.62:0/376017243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe0101d90 msgr2=0x7fefe010ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe605c700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe0101d90 0x7fefe010ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.468+0000 7fefe605c700 1 -- 172.21.15.62:0/376017243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc005040 con 0x7fefe00fbd40 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.469+0000 7fefe605c700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe00fbd40 0x7fefe010c930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009150 tx=0x7fefdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.469+0000 7fefd6ffd700 1 -- 172.21.15.62:0/376017243 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefdc00e040 con 0x7fefe00fbd40 2024-05-09T06:42:55.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.469+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe0119fa0 con 0x7fefe00fbd40 2024-05-09T06:42:55.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.469+0000 7fefd6ffd700 1 -- 172.21.15.62:0/376017243 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefdc00bbc0 con 0x7fefe00fbd40 2024-05-09T06:42:55.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.469+0000 7fefd6ffd700 1 -- 172.21.15.62:0/376017243 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefdc01c630 con 0x7fefe00fbd40 2024-05-09T06:42:55.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.469+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe011a370 con 0x7fefe00fbd40 2024-05-09T06:42:55.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.470+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe00fd430 con 0x7fefe00fbd40 2024-05-09T06:42:55.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.471+0000 7fefd6ffd700 1 -- 172.21.15.62:0/376017243 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fefdc00bd30 con 0x7fefe00fbd40 2024-05-09T06:42:55.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.471+0000 7fefd6ffd700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fefcc078980 0x7fefcc07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:55.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.471+0000 7fefd6ffd700 1 -- 172.21.15.62:0/376017243 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fefdc09bb80 con 0x7fefe00fbd40 2024-05-09T06:42:55.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.471+0000 7fefe585b700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fefcc078980 0x7fefcc07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:55.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.472+0000 7fefe585b700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fefcc078980 0x7fefcc07ae30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fefd0006fd0 tx=0x7fefd0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:55.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.476+0000 7fefd6ffd700 1 -- 172.21.15.62:0/376017243 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fefdc063650 con 0x7fefe00fbd40 2024-05-09T06:42:55.492 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:55 smithi079 ceph-mon[82381]: pgmap v303: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:55.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.736+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fefe0108ed0 con 0x7fefe00fbd40 2024-05-09T06:42:55.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.737+0000 7fefd6ffd700 1 -- 172.21.15.62:0/376017243 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) v1 ==== 107+0+4203 (secure 0 0 0) 0x7fefdc062ff0 con 0x7fefe00fbd40 2024-05-09T06:42:55.716 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:55.717 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:46.037231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fefcc078980 msgr2=0x7fefcc07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fefcc078980 0x7fefcc07ae30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fefd0006fd0 tx=0x7fefd0008040 comp rx=0 tx=0).stop 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe00fbd40 msgr2=0x7fefe010c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe00fbd40 0x7fefe010c930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009150 tx=0x7fefdc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 shutdown_connections 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fefcc078980 0x7fefcc07ae30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fefe00fbd40 0x7fefe010c930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 --2- 172.21.15.62:0/376017243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe0101d90 0x7fefe010ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:55.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 >> 172.21.15.62:0/376017243 conn(0x7fefe0071d00 msgr2=0x7fefe00fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:55.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 shutdown_connections 2024-05-09T06:42:55.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:55.739+0000 7fefe82c0700 1 -- 172.21.15.62:0/376017243 wait complete. 2024-05-09T06:42:55.720 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 27 2024-05-09T06:42:56.357 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:56 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/376017243' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-05-09T06:42:56.385 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 28 2024-05-09T06:42:56.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:56 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/376017243' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-05-09T06:42:56.656 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:57.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:57 smithi062 ceph-mon[109590]: pgmap v304: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:57.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:57 smithi079 ceph-mon[82381]: pgmap v304: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:58.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 -- 172.21.15.62:0/2859708786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 msgr2=0x7fb1640fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:58.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 --2- 172.21.15.62:0/2859708786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 0x7fb1640fbd20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb14c004940 tx=0x7fb14c009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:58.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 -- 172.21.15.62:0/2859708786 shutdown_connections 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 --2- 172.21.15.62:0/2859708786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 0x7fb1640fbd20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 --2- 172.21.15.62:0/2859708786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb164101d10 0x7fb1641020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 -- 172.21.15.62:0/2859708786 >> 172.21.15.62:0/2859708786 conn(0x7fb1640f7860 msgr2=0x7fb1640f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 -- 172.21.15.62:0/2859708786 shutdown_connections 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 -- 172.21.15.62:0/2859708786 wait complete. 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 Processor -- start 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.217+0000 7fb16a264700 1 -- start start 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb16a264700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb164101d10 0x7fb164115ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb16a264700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 0x7fb164116020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb16a264700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164116670 con 0x7fb1641026b0 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb16a264700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16410fd00 con 0x7fb164101d10 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb15bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 0x7fb164116020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb15bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 0x7fb164116020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52276/0 (socket says 172.21.15.62:52276) 2024-05-09T06:42:58.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb15bfff700 1 -- 172.21.15.62:0/2257054318 learned_addr learned my addr 172.21.15.62:0/2257054318 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb163fff700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb164101d10 0x7fb164115ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb15bfff700 1 -- 172.21.15.62:0/2257054318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb164101d10 msgr2=0x7fb164115ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb15bfff700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb164101d10 0x7fb164115ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb15bfff700 1 -- 172.21.15.62:0/2257054318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c005040 con 0x7fb1641026b0 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb15bfff700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 0x7fb164116020 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009180 tx=0x7fb14c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb1617fa700 1 -- 172.21.15.62:0/2257054318 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb14c00e040 con 0x7fb1641026b0 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb1617fa700 1 -- 172.21.15.62:0/2257054318 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb14c013420 con 0x7fb1641026b0 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16410ff80 con 0x7fb1641026b0 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.218+0000 7fb1617fa700 1 -- 172.21.15.62:0/2257054318 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb14c01c610 con 0x7fb1641026b0 2024-05-09T06:42:58.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.219+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb164110540 con 0x7fb1641026b0 2024-05-09T06:42:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.219+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1640fd460 con 0x7fb1641026b0 2024-05-09T06:42:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.220+0000 7fb1617fa700 1 -- 172.21.15.62:0/2257054318 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fb14c013a00 con 0x7fb1641026b0 2024-05-09T06:42:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.221+0000 7fb1617fa700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb150078990 0x7fb15007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.221+0000 7fb1617fa700 1 -- 172.21.15.62:0/2257054318 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fb14c09b900 con 0x7fb1641026b0 2024-05-09T06:42:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.221+0000 7fb163fff700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb150078990 0x7fb15007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:58.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.221+0000 7fb163fff700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb150078990 0x7fb15007ae40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb154007fd0 tx=0x7fb154009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:58.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.225+0000 7fb1617fa700 1 -- 172.21.15.62:0/2257054318 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fb14c063470 con 0x7fb1641026b0 2024-05-09T06:42:58.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.486+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fb164111240 con 0x7fb1641026b0 2024-05-09T06:42:58.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.487+0000 7fb1617fa700 1 -- 172.21.15.62:0/2257054318 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) v1 ==== 107+0+4214 (secure 0 0 0) 0x7fb14c062e10 con 0x7fb1641026b0 2024-05-09T06:42:58.467 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:42:58.467 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:46.045224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":0,"incarnation":28,"state":"up:replay","state_seq":2,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb150078990 msgr2=0x7fb15007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb150078990 0x7fb15007ae40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb154007fd0 tx=0x7fb154009040 comp rx=0 tx=0).stop 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 msgr2=0x7fb164116020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 0x7fb164116020 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009180 tx=0x7fb14c009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 shutdown_connections 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb164101d10 0x7fb164115ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fb150078990 0x7fb15007ae40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 --2- 172.21.15.62:0/2257054318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1641026b0 0x7fb164116020 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 >> 172.21.15.62:0/2257054318 conn(0x7fb1640f7860 msgr2=0x7fb164066270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 shutdown_connections 2024-05-09T06:42:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:42:58.489+0000 7fb16a264700 1 -- 172.21.15.62:0/2257054318 wait complete. 2024-05-09T06:42:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 28 2024-05-09T06:42:59.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 29 2024-05-09T06:42:59.380 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:42:59.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:59 smithi062 ceph-mon[109590]: pgmap v305: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:59.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:42:59 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2257054318' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-05-09T06:42:59.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:59 smithi079 ceph-mon[82381]: pgmap v305: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:59.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:42:59 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2257054318' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-05-09T06:43:01.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.141+0000 7f392e531700 1 -- 172.21.15.62:0/124383522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fbb60 msgr2=0x7f39280fbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:01.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.141+0000 7f392e531700 1 --2- 172.21.15.62:0/124383522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fbb60 0x7f39280fbf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3918004940 tx=0x7f3918009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:01.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.141+0000 7f392e531700 1 -- 172.21.15.62:0/124383522 shutdown_connections 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.141+0000 7f392e531700 1 --2- 172.21.15.62:0/124383522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39280fc470 0x7f39281091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.141+0000 7f392e531700 1 --2- 172.21.15.62:0/124383522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fbb60 0x7f39280fbf30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.141+0000 7f392e531700 1 -- 172.21.15.62:0/124383522 >> 172.21.15.62:0/124383522 conn(0x7f39280f7870 msgr2=0x7f39280f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.141+0000 7f392e531700 1 -- 172.21.15.62:0/124383522 shutdown_connections 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.141+0000 7f392e531700 1 -- 172.21.15.62:0/124383522 wait complete. 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f392e531700 1 Processor -- start 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f392e531700 1 -- start start 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f392e531700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39280fbb60 0x7f3928115ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f392e531700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fc470 0x7f3928116020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f392e531700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3928116670 con 0x7f39280fc470 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f392e531700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392810fc50 con 0x7f39280fbb60 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f391ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fc470 0x7f3928116020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:01.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f391ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fc470 0x7f3928116020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52302/0 (socket says 172.21.15.62:52302) 2024-05-09T06:43:01.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f391ffff700 1 -- 172.21.15.62:0/1514732671 learned_addr learned my addr 172.21.15.62:0/1514732671 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:01.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.142+0000 7f3927fff700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39280fbb60 0x7f3928115ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:01.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f391ffff700 1 -- 172.21.15.62:0/1514732671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39280fbb60 msgr2=0x7f3928115ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:01.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f391ffff700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39280fbb60 0x7f3928115ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f391ffff700 1 -- 172.21.15.62:0/1514732671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918005040 con 0x7f39280fc470 2024-05-09T06:43:01.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f391ffff700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fc470 0x7f3928116020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3910002a50 tx=0x7f39100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:01.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f39257fa700 1 -- 172.21.15.62:0/1514732671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3910007cc0 con 0x7f39280fc470 2024-05-09T06:43:01.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392810ff30 con 0x7f39280fc470 2024-05-09T06:43:01.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f39257fa700 1 -- 172.21.15.62:0/1514732671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f391000f040 con 0x7f39280fc470 2024-05-09T06:43:01.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f39257fa700 1 -- 172.21.15.62:0/1514732671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391000da30 con 0x7f39280fc470 2024-05-09T06:43:01.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.143+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39281104f0 con 0x7f39280fc470 2024-05-09T06:43:01.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.144+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3928066b30 con 0x7f39280fc470 2024-05-09T06:43:01.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.145+0000 7f39257fa700 1 -- 172.21.15.62:0/1514732671 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f391000db90 con 0x7f39280fc470 2024-05-09T06:43:01.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.146+0000 7f39257fa700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3914078980 0x7f391407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:01.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.146+0000 7f39257fa700 1 -- 172.21.15.62:0/1514732671 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f391009a5e0 con 0x7f39280fc470 2024-05-09T06:43:01.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.146+0000 7f3927fff700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3914078980 0x7f391407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:01.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.146+0000 7f3927fff700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3914078980 0x7f391407ae30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3918004f30 tx=0x7f3918009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:01.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.151+0000 7f39257fa700 1 -- 172.21.15.62:0/1514732671 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f39100620b0 con 0x7f39280fc470 2024-05-09T06:43:01.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.409+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f392804c710 con 0x7f39280fc470 2024-05-09T06:43:01.389 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:01 smithi062 ceph-mon[109590]: pgmap v306: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:01.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.410+0000 7f39257fa700 1 -- 172.21.15.62:0/1514732671 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) v1 ==== 107+0+5066 (secure 0 0 0) 0x7f3910061a50 con 0x7f39280fc470 2024-05-09T06:43:01.390 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:43:01.390 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:54.160474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":188,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3914078980 msgr2=0x7f391407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3914078980 0x7f391407ae30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3918004f30 tx=0x7f3918009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fc470 msgr2=0x7f3928116020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fc470 0x7f3928116020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3910002a50 tx=0x7f39100046b0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 shutdown_connections 2024-05-09T06:43:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39280fbb60 0x7f3928115ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f3914078980 0x7f391407ae30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 --2- 172.21.15.62:0/1514732671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39280fc470 0x7f3928116020 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 >> 172.21.15.62:0/1514732671 conn(0x7f39280f7870 msgr2=0x7f39280f7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:01.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 shutdown_connections 2024-05-09T06:43:01.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:01.412+0000 7f392e531700 1 -- 172.21.15.62:0/1514732671 wait complete. 2024-05-09T06:43:01.393 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 29 2024-05-09T06:43:01.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:01 smithi079 ceph-mon[82381]: pgmap v306: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:02.001 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 30 2024-05-09T06:43:02.284 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:02.406 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:02 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1514732671' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-05-09T06:43:02.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:02 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1514732671' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-05-09T06:43:03.339 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:03 smithi062 ceph-mon[109590]: pgmap v307: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:03.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:03 smithi079 ceph-mon[82381]: pgmap v307: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.899+0000 7f6a2189a700 1 -- 172.21.15.62:0/3378484601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c102e50 msgr2=0x7f6a1c103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.899+0000 7f6a2189a700 1 --2- 172.21.15.62:0/3378484601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c102e50 0x7f6a1c103220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009ce0 tx=0x7f6a14004d10 comp rx=0 tx=0).stop 2024-05-09T06:43:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.899+0000 7f6a2189a700 1 -- 172.21.15.62:0/3378484601 shutdown_connections 2024-05-09T06:43:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.899+0000 7f6a2189a700 1 --2- 172.21.15.62:0/3378484601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1c065640 0x7f6a1c065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.899+0000 7f6a2189a700 1 --2- 172.21.15.62:0/3378484601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c102e50 0x7f6a1c103220 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.899+0000 7f6a2189a700 1 -- 172.21.15.62:0/3378484601 >> 172.21.15.62:0/3378484601 conn(0x7f6a1c071d00 msgr2=0x7f6a1c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.899+0000 7f6a2189a700 1 -- 172.21.15.62:0/3378484601 shutdown_connections 2024-05-09T06:43:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.899+0000 7f6a2189a700 1 -- 172.21.15.62:0/3378484601 wait complete. 2024-05-09T06:43:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a2189a700 1 Processor -- start 2024-05-09T06:43:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a2189a700 1 -- start start 2024-05-09T06:43:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a2189a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c065640 0x7f6a1c113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a2189a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1c102e50 0x7f6a1c1140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a2189a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c114710 con 0x7f6a1c065640 2024-05-09T06:43:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a2189a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c10db00 con 0x7f6a1c102e50 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a1affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c065640 0x7f6a1c113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a1affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c065640 0x7f6a1c113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43078/0 (socket says 172.21.15.62:43078) 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.900+0000 7f6a1affd700 1 -- 172.21.15.62:0/815782059 learned_addr learned my addr 172.21.15.62:0/815782059 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a1affd700 1 -- 172.21.15.62:0/815782059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1c102e50 msgr2=0x7f6a1c1140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a1a7fc700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1c102e50 0x7f6a1c1140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a1affd700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1c102e50 0x7f6a1c1140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a1affd700 1 -- 172.21.15.62:0/815782059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a14009940 con 0x7f6a1c065640 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a1affd700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c065640 0x7f6a1c113b80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400ba50 tx=0x7f6a14004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a137fe700 1 -- 172.21.15.62:0/815782059 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1400e040 con 0x7f6a1c065640 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c10dd80 con 0x7f6a1c065640 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a137fe700 1 -- 172.21.15.62:0/815782059 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a1401cb20 con 0x7f6a1c065640 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a137fe700 1 -- 172.21.15.62:0/815782059 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a14012a70 con 0x7f6a1c065640 2024-05-09T06:43:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.901+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c10e340 con 0x7f6a1c065640 2024-05-09T06:43:03.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.902+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c100100 con 0x7f6a1c065640 2024-05-09T06:43:03.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.903+0000 7f6a137fe700 1 -- 172.21.15.62:0/815782059 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f6a1401cc90 con 0x7f6a1c065640 2024-05-09T06:43:03.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.903+0000 7f6a137fe700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6a08078990 0x7f6a0807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:03.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.903+0000 7f6a137fe700 1 -- 172.21.15.62:0/815782059 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f6a1409cc60 con 0x7f6a1c065640 2024-05-09T06:43:03.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.903+0000 7f6a1a7fc700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6a08078990 0x7f6a0807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:03.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.904+0000 7f6a1a7fc700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6a08078990 0x7f6a0807ae40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6a04004600 tx=0x7f6a0400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:03.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:03.908+0000 7f6a137fe700 1 -- 172.21.15.62:0/815782059 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6a140646b0 con 0x7f6a1c065640 2024-05-09T06:43:04.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.168+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f6a1c10f1d0 con 0x7f6a1c065640 2024-05-09T06:43:04.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.169+0000 7f6a137fe700 1 -- 172.21.15.62:0/815782059 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) v1 ==== 107+0+5063 (secure 0 0 0) 0x7f6a14064050 con 0x7f6a1c065640 2024-05-09T06:43:04.149 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:43:04.149 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:55.037395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":189,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6a08078990 msgr2=0x7f6a0807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6a08078990 0x7f6a0807ae40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6a04004600 tx=0x7f6a0400b040 comp rx=0 tx=0).stop 2024-05-09T06:43:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c065640 msgr2=0x7f6a1c113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c065640 0x7f6a1c113b80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400ba50 tx=0x7f6a14004d10 comp rx=0 tx=0).stop 2024-05-09T06:43:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 shutdown_connections 2024-05-09T06:43:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6a08078990 0x7f6a0807ae40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a1c065640 0x7f6a1c113b80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:04.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 --2- 172.21.15.62:0/815782059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a1c102e50 0x7f6a1c1140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:04.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 >> 172.21.15.62:0/815782059 conn(0x7f6a1c071d00 msgr2=0x7f6a1c0fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:04.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 shutdown_connections 2024-05-09T06:43:04.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:04.171+0000 7f6a2189a700 1 -- 172.21.15.62:0/815782059 wait complete. 2024-05-09T06:43:04.152 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 30 2024-05-09T06:43:04.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:04 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/815782059' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-05-09T06:43:04.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:04 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/815782059' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-05-09T06:43:04.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 31 2024-05-09T06:43:05.023 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:05.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:05 smithi062 ceph-mon[109590]: pgmap v308: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:05.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:05 smithi079 ceph-mon[82381]: pgmap v308: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:06.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.832+0000 7f52fe28d700 1 -- 172.21.15.62:0/4214588277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 msgr2=0x7f52f8102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:06.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.832+0000 7f52fe28d700 1 --2- 172.21.15.62:0/4214588277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 0x7f52f8102160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f52e8004940 tx=0x7f52e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:06.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.832+0000 7f52fe28d700 1 -- 172.21.15.62:0/4214588277 shutdown_connections 2024-05-09T06:43:06.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.832+0000 7f52fe28d700 1 --2- 172.21.15.62:0/4214588277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f80fbd40 0x7f52f80fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.832+0000 7f52fe28d700 1 --2- 172.21.15.62:0/4214588277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 0x7f52f8102160 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.832+0000 7f52fe28d700 1 -- 172.21.15.62:0/4214588277 >> 172.21.15.62:0/4214588277 conn(0x7f52f8071d00 msgr2=0x7f52f8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.832+0000 7f52fe28d700 1 -- 172.21.15.62:0/4214588277 shutdown_connections 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.832+0000 7f52fe28d700 1 -- 172.21.15.62:0/4214588277 wait complete. 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52fe28d700 1 Processor -- start 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52fe28d700 1 -- start start 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52fe28d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f80fbd40 0x7f52f8115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52fe28d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 0x7f52f8116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52fe28d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8116970 con 0x7f52f8101d90 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52fe28d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f810fd80 con 0x7f52f80fbd40 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 0x7f52f8116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 0x7f52f8116320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43098/0 (socket says 172.21.15.62:43098) 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.833+0000 7f52effff700 1 -- 172.21.15.62:0/2017719081 learned_addr learned my addr 172.21.15.62:0/2017719081 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:06.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52f7fff700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f80fbd40 0x7f52f8115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:06.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52effff700 1 -- 172.21.15.62:0/2017719081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f80fbd40 msgr2=0x7f52f8115de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:06.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52effff700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f80fbd40 0x7f52f8115de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:06.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52effff700 1 -- 172.21.15.62:0/2017719081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8005040 con 0x7f52f8101d90 2024-05-09T06:43:06.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52f7fff700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f80fbd40 0x7f52f8115de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:43:06.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52effff700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 0x7f52f8116320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f52e000c830 tx=0x7f52e0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52f57fa700 1 -- 172.21.15.62:0/2017719081 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e000a760 con 0x7f52f8101d90 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52f57fa700 1 -- 172.21.15.62:0/2017719081 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52e000ad90 con 0x7f52f8101d90 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f8110060 con 0x7f52f8101d90 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52f57fa700 1 -- 172.21.15.62:0/2017719081 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e00113a0 con 0x7f52f8101d90 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.834+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f81105a0 con 0x7f52f8101d90 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.835+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f80fd430 con 0x7f52f8101d90 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.836+0000 7f52f57fa700 1 -- 172.21.15.62:0/2017719081 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f52e0012400 con 0x7f52f8101d90 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.836+0000 7f52f57fa700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f52e4078990 0x7f52e407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:06.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.836+0000 7f52f57fa700 1 -- 172.21.15.62:0/2017719081 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f52e009a850 con 0x7f52f8101d90 2024-05-09T06:43:06.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.837+0000 7f52f7fff700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f52e4078990 0x7f52e407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:06.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.837+0000 7f52f7fff700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f52e4078990 0x7f52e407ae40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52e8004560 tx=0x7f52e8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:06.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:06.841+0000 7f52f57fa700 1 -- 172.21.15.62:0/2017719081 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f52e00623c0 con 0x7f52f8101d90 2024-05-09T06:43:07.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.106+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f52f8108df0 con 0x7f52f8101d90 2024-05-09T06:43:07.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.106+0000 7f52f57fa700 1 -- 172.21.15.62:0/2017719081 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) v1 ==== 107+0+5072 (secure 0 0 0) 0x7f52e0061d60 con 0x7f52f8101d90 2024-05-09T06:43:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:43:07.087 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:39:57.042222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24297":{"gid":24297,"name":"cephfs.smithi079.pdxygz","rank":0,"incarnation":28,"state":"up:active","state_seq":190,"addr":"172.21.15.79:6827/1887614093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1887614093},{"type":"v1","addr":"172.21.15.79:6827","nonce":1887614093}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24297,"qdb_cluster":[24297]},"id":1}]} 2024-05-09T06:43:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.108+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f52e4078990 msgr2=0x7f52e407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.108+0000 7f52fe28d700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f52e4078990 0x7f52e407ae40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52e8004560 tx=0x7f52e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:07.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.108+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 msgr2=0x7f52f8116320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.108+0000 7f52fe28d700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 0x7f52f8116320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f52e000c830 tx=0x7f52e0004470 comp rx=0 tx=0).stop 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.109+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 shutdown_connections 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.109+0000 7f52fe28d700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f80fbd40 0x7f52f8115de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.109+0000 7f52fe28d700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f52e4078990 0x7f52e407ae40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.109+0000 7f52fe28d700 1 --2- 172.21.15.62:0/2017719081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52f8101d90 0x7f52f8116320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.109+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 >> 172.21.15.62:0/2017719081 conn(0x7f52f8071d00 msgr2=0x7f52f80655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.109+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 shutdown_connections 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:07.109+0000 7f52fe28d700 1 -- 172.21.15.62:0/2017719081 wait complete. 2024-05-09T06:43:07.089 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 31 2024-05-09T06:43:07.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:07 smithi062 ceph-mon[109590]: pgmap v309: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:07.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:07 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2017719081' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-05-09T06:43:07.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:07 smithi079 ceph-mon[82381]: pgmap v309: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:07.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:07 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2017719081' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-05-09T06:43:07.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 32 2024-05-09T06:43:08.041 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:09.396 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:09 smithi062 ceph-mon[109590]: pgmap v310: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:09.396 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:09 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:09.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:09 smithi079 ceph-mon[82381]: pgmap v310: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:09.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:09 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:09.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/2789472306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fdbf0 msgr2=0x7f6e980fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:09.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 --2- 172.21.15.62:0/2789472306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fdbf0 0x7f6e980fdfc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6e88004940 tx=0x7f6e88009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:09.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/2789472306 shutdown_connections 2024-05-09T06:43:09.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 --2- 172.21.15.62:0/2789472306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e980fb3c0 0x7f6e980fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 --2- 172.21.15.62:0/2789472306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fdbf0 0x7f6e980fdfc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/2789472306 >> 172.21.15.62:0/2789472306 conn(0x7f6e98072380 msgr2=0x7f6e98072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/2789472306 shutdown_connections 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/2789472306 wait complete. 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 Processor -- start 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.647+0000 7f6e9d4aa700 1 -- start start 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e9d4aa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fb3c0 0x7f6e98115b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e9d4aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e980fdbf0 0x7f6e98116050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e9d4aa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e981166a0 con 0x7f6e980fb3c0 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e9d4aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9810fc80 con 0x7f6e980fdbf0 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e96ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fb3c0 0x7f6e98115b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e96ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fb3c0 0x7f6e98115b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43118/0 (socket says 172.21.15.62:43118) 2024-05-09T06:43:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e96ffd700 1 -- 172.21.15.62:0/563577786 learned_addr learned my addr 172.21.15.62:0/563577786 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e967fc700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e980fdbf0 0x7f6e98116050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e96ffd700 1 -- 172.21.15.62:0/563577786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e980fdbf0 msgr2=0x7f6e98116050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e96ffd700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e980fdbf0 0x7f6e98116050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e96ffd700 1 -- 172.21.15.62:0/563577786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88005040 con 0x7f6e980fb3c0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e96ffd700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fb3c0 0x7f6e98115b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800b8b0 tx=0x7f6e88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.648+0000 7f6e7f7fe700 1 -- 172.21.15.62:0/563577786 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e8800e040 con 0x7f6e980fb3c0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.649+0000 7f6e7f7fe700 1 -- 172.21.15.62:0/563577786 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e88004290 con 0x7f6e980fb3c0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.649+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9810ff00 con 0x7f6e980fb3c0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.649+0000 7f6e7f7fe700 1 -- 172.21.15.62:0/563577786 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e8801c3f0 con 0x7f6e980fb3c0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.649+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e981104c0 con 0x7f6e980fb3c0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.649+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e980fc3d0 con 0x7f6e980fb3c0 2024-05-09T06:43:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.650+0000 7f6e7f7fe700 1 -- 172.21.15.62:0/563577786 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f6e880137b0 con 0x7f6e980fb3c0 2024-05-09T06:43:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.651+0000 7f6e7f7fe700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6e80078990 0x7f6e8007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.651+0000 7f6e7f7fe700 1 -- 172.21.15.62:0/563577786 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f6e8809bc20 con 0x7f6e980fb3c0 2024-05-09T06:43:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.651+0000 7f6e967fc700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6e80078990 0x7f6e8007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.651+0000 7f6e967fc700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6e80078990 0x7f6e8007ae40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c007fd0 tx=0x7f6e8c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:09.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.656+0000 7f6e7f7fe700 1 -- 172.21.15.62:0/563577786 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6e880636f0 con 0x7f6e980fb3c0 2024-05-09T06:43:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.918+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f6e98111160 con 0x7f6e980fb3c0 2024-05-09T06:43:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.919+0000 7f6e7f7fe700 1 -- 172.21.15.62:0/563577786 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) v1 ==== 107+0+4271 (secure 0 0 0) 0x7f6e88068e60 con 0x7f6e980fb3c0 2024-05-09T06:43:09.899 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:43:09.899 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:40:08.678820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6e80078990 msgr2=0x7f6e8007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6e80078990 0x7f6e8007ae40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c007fd0 tx=0x7f6e8c009040 comp rx=0 tx=0).stop 2024-05-09T06:43:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fb3c0 msgr2=0x7f6e98115b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fb3c0 0x7f6e98115b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800b8b0 tx=0x7f6e88009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 shutdown_connections 2024-05-09T06:43:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f6e80078990 0x7f6e8007ae40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6e980fb3c0 0x7f6e98115b10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 --2- 172.21.15.62:0/563577786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e980fdbf0 0x7f6e98116050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.921+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 >> 172.21.15.62:0/563577786 conn(0x7f6e98072380 msgr2=0x7f6e980f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.922+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 shutdown_connections 2024-05-09T06:43:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:09.922+0000 7f6e9d4aa700 1 -- 172.21.15.62:0/563577786 wait complete. 2024-05-09T06:43:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 32 2024-05-09T06:43:10.559 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:10 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/563577786' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-05-09T06:43:10.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:10 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/563577786' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-05-09T06:43:10.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 33 2024-05-09T06:43:10.870 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:11.288 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:11 smithi062 ceph-mon[109590]: pgmap v311: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:11.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:11 smithi079 ceph-mon[82381]: pgmap v311: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:12.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.478+0000 7fae93a56700 1 -- 172.21.15.62:0/4266712253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c102710 msgr2=0x7fae8c0fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.478+0000 7fae93a56700 1 --2- 172.21.15.62:0/4266712253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c102710 0x7fae8c0fbd80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae7c004940 tx=0x7fae7c009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.478+0000 7fae93a56700 1 -- 172.21.15.62:0/4266712253 shutdown_connections 2024-05-09T06:43:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.478+0000 7fae93a56700 1 --2- 172.21.15.62:0/4266712253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c102710 0x7fae8c0fbd80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.478+0000 7fae93a56700 1 --2- 172.21.15.62:0/4266712253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae8c101d70 0x7fae8c102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.478+0000 7fae93a56700 1 -- 172.21.15.62:0/4266712253 >> 172.21.15.62:0/4266712253 conn(0x7fae8c0f78e0 msgr2=0x7fae8c0f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae93a56700 1 -- 172.21.15.62:0/4266712253 shutdown_connections 2024-05-09T06:43:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae93a56700 1 -- 172.21.15.62:0/4266712253 wait complete. 2024-05-09T06:43:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae93a56700 1 Processor -- start 2024-05-09T06:43:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae93a56700 1 -- start start 2024-05-09T06:43:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae93a56700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c101d70 0x7fae8c1127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae93a56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae8c102710 0x7fae8c112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae93a56700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c113360 con 0x7fae8c101d70 2024-05-09T06:43:12.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae93a56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c10c960 con 0x7fae8c102710 2024-05-09T06:43:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae917f2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c101d70 0x7fae8c1127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae917f2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c101d70 0x7fae8c1127d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43146/0 (socket says 172.21.15.62:43146) 2024-05-09T06:43:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.479+0000 7fae917f2700 1 -- 172.21.15.62:0/1329592690 learned_addr learned my addr 172.21.15.62:0/1329592690 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae90ff1700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae8c102710 0x7fae8c112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae917f2700 1 -- 172.21.15.62:0/1329592690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae8c102710 msgr2=0x7fae8c112d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae917f2700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae8c102710 0x7fae8c112d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:12.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae917f2700 1 -- 172.21.15.62:0/1329592690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c005040 con 0x7fae8c101d70 2024-05-09T06:43:12.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae90ff1700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae8c102710 0x7fae8c112d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:43:12.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae917f2700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c101d70 0x7fae8c1127d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fae8800eb40 tx=0x7fae8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:12.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae81ffb700 1 -- 172.21.15.62:0/1329592690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae88007cc0 con 0x7fae8c101d70 2024-05-09T06:43:12.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae81ffb700 1 -- 172.21.15.62:0/1329592690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae8800f040 con 0x7fae8c101d70 2024-05-09T06:43:12.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c10cbe0 con 0x7fae8c101d70 2024-05-09T06:43:12.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae81ffb700 1 -- 172.21.15.62:0/1329592690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae88009620 con 0x7fae8c101d70 2024-05-09T06:43:12.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.480+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c10d120 con 0x7fae8c101d70 2024-05-09T06:43:12.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.481+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c104240 con 0x7fae8c101d70 2024-05-09T06:43:12.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.482+0000 7fae81ffb700 1 -- 172.21.15.62:0/1329592690 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fae88009780 con 0x7fae8c101d70 2024-05-09T06:43:12.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.482+0000 7fae81ffb700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae78078990 0x7fae7807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:12.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.482+0000 7fae90ff1700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae78078990 0x7fae7807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:12.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.483+0000 7fae81ffb700 1 -- 172.21.15.62:0/1329592690 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fae8809a570 con 0x7fae8c101d70 2024-05-09T06:43:12.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.483+0000 7fae90ff1700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae78078990 0x7fae7807ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae8c10db20 tx=0x7fae7c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:12.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.487+0000 7fae81ffb700 1 -- 172.21.15.62:0/1329592690 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fae88062070 con 0x7fae8c101d70 2024-05-09T06:43:12.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.747+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fae8c10de20 con 0x7fae8c101d70 2024-05-09T06:43:12.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.748+0000 7fae81ffb700 1 -- 172.21.15.62:0/1329592690 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) v1 ==== 107+0+4350 (secure 0 0 0) 0x7fae88061a10 con 0x7fae8c101d70 2024-05-09T06:43:12.727 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:43:12.727 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:40:08.683237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:12.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae78078990 msgr2=0x7fae7807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:12.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae78078990 0x7fae7807ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae8c10db20 tx=0x7fae7c009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:12.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c101d70 msgr2=0x7fae8c1127d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c101d70 0x7fae8c1127d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fae8800eb40 tx=0x7fae8800b040 comp rx=0 tx=0).stop 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 shutdown_connections 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fae78078990 0x7fae7807ae40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8c101d70 0x7fae8c1127d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 --2- 172.21.15.62:0/1329592690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae8c102710 0x7fae8c112d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 >> 172.21.15.62:0/1329592690 conn(0x7fae8c0f78e0 msgr2=0x7fae8c0f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 shutdown_connections 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:12.750+0000 7fae93a56700 1 -- 172.21.15.62:0/1329592690 wait complete. 2024-05-09T06:43:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 33 2024-05-09T06:43:13.341 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:13 smithi062 ceph-mon[109590]: pgmap v312: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:13.341 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:13 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/1329592690' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-05-09T06:43:13.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 34 2024-05-09T06:43:13.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:13 smithi079 ceph-mon[82381]: pgmap v312: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:13.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:13 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/1329592690' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-05-09T06:43:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:15.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 -- 172.21.15.62:0/1523509835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 msgr2=0x7f8610103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:15.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 --2- 172.21.15.62:0/1523509835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 0x7f8610103220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f860c004940 tx=0x7f860c009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:15.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 -- 172.21.15.62:0/1523509835 shutdown_connections 2024-05-09T06:43:15.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 --2- 172.21.15.62:0/1523509835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8610065640 0x7f8610065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:15.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 --2- 172.21.15.62:0/1523509835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 0x7f8610103220 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:15.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 -- 172.21.15.62:0/1523509835 >> 172.21.15.62:0/1523509835 conn(0x7f8610071d00 msgr2=0x7f8610072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:15.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 -- 172.21.15.62:0/1523509835 shutdown_connections 2024-05-09T06:43:15.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 -- 172.21.15.62:0/1523509835 wait complete. 2024-05-09T06:43:15.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.245+0000 7f8617eba700 1 Processor -- start 2024-05-09T06:43:15.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8617eba700 1 -- start start 2024-05-09T06:43:15.226 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:15 smithi062 ceph-mon[109590]: pgmap v313: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:15.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8617eba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8610065640 0x7f8610113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8617eba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 0x7f86101140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8617eba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610114710 con 0x7f8610102e50 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8617eba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861010db00 con 0x7f8610065640 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8615455700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 0x7f86101140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8615455700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 0x7f86101140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50782/0 (socket says 172.21.15.62:50782) 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8615455700 1 -- 172.21.15.62:0/2644124181 learned_addr learned my addr 172.21.15.62:0/2644124181 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8615c56700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8610065640 0x7f8610113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8615455700 1 -- 172.21.15.62:0/2644124181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8610065640 msgr2=0x7f8610113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8615455700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8610065640 0x7f8610113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.246+0000 7f8615455700 1 -- 172.21.15.62:0/2644124181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c005040 con 0x7f8610102e50 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.247+0000 7f8615455700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 0x7f86101140c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f860000c8c0 tx=0x7f86000044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.247+0000 7f86067fc700 1 -- 172.21.15.62:0/2644124181 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f860000a980 con 0x7f8610102e50 2024-05-09T06:43:15.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.247+0000 7f86067fc700 1 -- 172.21.15.62:0/2644124181 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f860000ce60 con 0x7f8610102e50 2024-05-09T06:43:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.247+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861010dde0 con 0x7f8610102e50 2024-05-09T06:43:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.247+0000 7f86067fc700 1 -- 172.21.15.62:0/2644124181 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86000115e0 con 0x7f8610102e50 2024-05-09T06:43:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.247+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861010e3a0 con 0x7f8610102e50 2024-05-09T06:43:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.248+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8610100100 con 0x7f8610102e50 2024-05-09T06:43:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.249+0000 7f86067fc700 1 -- 172.21.15.62:0/2644124181 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f8600012400 con 0x7f8610102e50 2024-05-09T06:43:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.249+0000 7f86067fc700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f85fc078990 0x7f85fc07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.249+0000 7f86067fc700 1 -- 172.21.15.62:0/2644124181 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f860009a950 con 0x7f8610102e50 2024-05-09T06:43:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.249+0000 7f8615c56700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f85fc078990 0x7f85fc07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.250+0000 7f8615c56700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f85fc078990 0x7f85fc07ae40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f860c004f90 tx=0x7f860c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:15.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.254+0000 7f86067fc700 1 -- 172.21.15.62:0/2644124181 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f86000624c0 con 0x7f8610102e50 2024-05-09T06:43:15.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.523+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f861010f1d0 con 0x7f8610102e50 2024-05-09T06:43:15.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.524+0000 7f86067fc700 1 -- 172.21.15.62:0/2644124181 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) v1 ==== 107+0+4354 (secure 0 0 0) 0x7f86000126b0 con 0x7f8610102e50 2024-05-09T06:43:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:43:15.504 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:40:17.077880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f85fc078990 msgr2=0x7f85fc07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f85fc078990 0x7f85fc07ae40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f860c004f90 tx=0x7f860c009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 msgr2=0x7f86101140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 0x7f86101140c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f860000c8c0 tx=0x7f86000044c0 comp rx=0 tx=0).stop 2024-05-09T06:43:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 shutdown_connections 2024-05-09T06:43:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8610065640 0x7f8610113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f85fc078990 0x7f85fc07ae40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 --2- 172.21.15.62:0/2644124181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8610102e50 0x7f86101140c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.526+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 >> 172.21.15.62:0/2644124181 conn(0x7f8610071d00 msgr2=0x7f86100fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.527+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 shutdown_connections 2024-05-09T06:43:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:15.527+0000 7f8617eba700 1 -- 172.21.15.62:0/2644124181 wait complete. 2024-05-09T06:43:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 34 2024-05-09T06:43:15.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:15 smithi079 ceph-mon[82381]: pgmap v313: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:16.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 35 2024-05-09T06:43:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:16.409 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:16 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2644124181' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-05-09T06:43:16.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:16 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2644124181' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-05-09T06:43:17.464 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:17 smithi062 ceph-mon[109590]: pgmap v314: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:17.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:17 smithi079 ceph-mon[82381]: pgmap v314: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.034+0000 7fdbcbda6700 1 -- 172.21.15.62:0/1613423945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 msgr2=0x7fdbc40fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.034+0000 7fdbcbda6700 1 --2- 172.21.15.62:0/1613423945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 0x7fdbc40fb970 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4004940 tx=0x7fdbb4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.034+0000 7fdbcbda6700 1 -- 172.21.15.62:0/1613423945 shutdown_connections 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.034+0000 7fdbcbda6700 1 --2- 172.21.15.62:0/1613423945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbc40fbf40 0x7fdbc4101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.034+0000 7fdbcbda6700 1 --2- 172.21.15.62:0/1613423945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 0x7fdbc40fb970 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.034+0000 7fdbcbda6700 1 -- 172.21.15.62:0/1613423945 >> 172.21.15.62:0/1613423945 conn(0x7fdbc4073350 msgr2=0x7fdbc4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.034+0000 7fdbcbda6700 1 -- 172.21.15.62:0/1613423945 shutdown_connections 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.034+0000 7fdbcbda6700 1 -- 172.21.15.62:0/1613423945 wait complete. 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbcbda6700 1 Processor -- start 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbcbda6700 1 -- start start 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbcbda6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 0x7fdbc40fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:18.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbcbda6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbc40fbf40 0x7fdbc40fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbcbda6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40fe480 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbcbda6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40fcfb0 con 0x7fdbc40fbf40 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbc9b42700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 0x7fdbc40fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbc9b42700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 0x7fdbc40fc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50800/0 (socket says 172.21.15.62:50800) 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbc9b42700 1 -- 172.21.15.62:0/521523592 learned_addr learned my addr 172.21.15.62:0/521523592 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbc9341700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbc40fbf40 0x7fdbc40fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbc9b42700 1 -- 172.21.15.62:0/521523592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbc40fbf40 msgr2=0x7fdbc40fca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbc9b42700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbc40fbf40 0x7fdbc40fca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbc9b42700 1 -- 172.21.15.62:0/521523592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4005040 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.035+0000 7fdbc9341700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbc40fbf40 0x7fdbc40fca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.036+0000 7fdbc9b42700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 0x7fdbc40fc530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009150 tx=0x7fdbb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.036+0000 7fdbba7fc700 1 -- 172.21.15.62:0/521523592 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb400e040 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.036+0000 7fdbba7fc700 1 -- 172.21.15.62:0/521523592 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbb4013420 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.036+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc40fd230 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.036+0000 7fdbba7fc700 1 -- 172.21.15.62:0/521523592 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb401c630 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.036+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc411a090 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.037+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc40fe670 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.038+0000 7fdbba7fc700 1 -- 172.21.15.62:0/521523592 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fdbb4013590 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.038+0000 7fdbba7fc700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdbb0078980 0x7fdbb007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.038+0000 7fdbc9341700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdbb0078980 0x7fdbb007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.039+0000 7fdbba7fc700 1 -- 172.21.15.62:0/521523592 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fdbb409bb40 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.039+0000 7fdbc9341700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdbb0078980 0x7fdbb007ae30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0007fd0 tx=0x7fdbc0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:18.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.043+0000 7fdbba7fc700 1 -- 172.21.15.62:0/521523592 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fdbb4063610 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.307+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fdbc404c710 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.308+0000 7fdbba7fc700 1 -- 172.21.15.62:0/521523592 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) v1 ==== 107+0+4351 (secure 0 0 0) 0x7fdbb4062fb0 con 0x7fdbc40fb5a0 2024-05-09T06:43:18.288 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:43:18.288 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:40:17.481210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.310+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdbb0078980 msgr2=0x7fdbb007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.310+0000 7fdbcbda6700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdbb0078980 0x7fdbb007ae30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0007fd0 tx=0x7fdbc0009040 comp rx=0 tx=0).stop 2024-05-09T06:43:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.310+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 msgr2=0x7fdbc40fc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:18.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.310+0000 7fdbcbda6700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 0x7fdbc40fc530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009150 tx=0x7fdbb4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.311+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 shutdown_connections 2024-05-09T06:43:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.311+0000 7fdbcbda6700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fdbb0078980 0x7fdbb007ae30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.311+0000 7fdbcbda6700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbc40fb5a0 0x7fdbc40fc530 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.311+0000 7fdbcbda6700 1 --2- 172.21.15.62:0/521523592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbc40fbf40 0x7fdbc40fca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.311+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 >> 172.21.15.62:0/521523592 conn(0x7fdbc4073350 msgr2=0x7fdbc4100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.311+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 shutdown_connections 2024-05-09T06:43:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:18.311+0000 7fdbcbda6700 1 -- 172.21.15.62:0/521523592 wait complete. 2024-05-09T06:43:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 35 2024-05-09T06:43:18.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 36 2024-05-09T06:43:19.177 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:19.525 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:19 smithi062 ceph-mon[109590]: pgmap v315: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:19.526 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:19 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/521523592' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-05-09T06:43:19.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:19 smithi079 ceph-mon[82381]: pgmap v315: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:19.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:19 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/521523592' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-05-09T06:43:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.926+0000 7f7f2185a700 1 -- 172.21.15.62:0/3361609479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c103780 msgr2=0x7f7f1c0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.926+0000 7f7f2185a700 1 --2- 172.21.15.62:0/3361609479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c103780 0x7f7f1c0fcdf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f04004940 tx=0x7f7f04009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.926+0000 7f7f2185a700 1 -- 172.21.15.62:0/3361609479 shutdown_connections 2024-05-09T06:43:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.926+0000 7f7f2185a700 1 --2- 172.21.15.62:0/3361609479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c103780 0x7f7f1c0fcdf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.926+0000 7f7f2185a700 1 --2- 172.21.15.62:0/3361609479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1c102de0 0x7f7f1c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.926+0000 7f7f2185a700 1 -- 172.21.15.62:0/3361609479 >> 172.21.15.62:0/3361609479 conn(0x7f7f1c0f8950 msgr2=0x7f7f1c0fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:20.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.926+0000 7f7f2185a700 1 -- 172.21.15.62:0/3361609479 shutdown_connections 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.926+0000 7f7f2185a700 1 -- 172.21.15.62:0/3361609479 wait complete. 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f2185a700 1 Processor -- start 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f2185a700 1 -- start start 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f2185a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c102de0 0x7f7f1c070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f2185a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1c103780 0x7f7f1c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f2185a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c070d30 con 0x7f7f1c102de0 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f2185a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c070e70 con 0x7f7f1c103780 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f1affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c102de0 0x7f7f1c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f1affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c102de0 0x7f7f1c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50806/0 (socket says 172.21.15.62:50806) 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f1affd700 1 -- 172.21.15.62:0/2495406591 learned_addr learned my addr 172.21.15.62:0/2495406591 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.927+0000 7f7f1a7fc700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1c103780 0x7f7f1c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f1affd700 1 -- 172.21.15.62:0/2495406591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1c103780 msgr2=0x7f7f1c0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f1affd700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1c103780 0x7f7f1c0707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f1affd700 1 -- 172.21.15.62:0/2495406591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04005040 con 0x7f7f1c102de0 2024-05-09T06:43:20.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f1a7fc700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1c103780 0x7f7f1c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:43:20.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f1affd700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c102de0 0x7f7f1c070260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f14002a50 tx=0x7f7f140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f137fe700 1 -- 172.21.15.62:0/2495406591 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f14007cc0 con 0x7f7f1c102de0 2024-05-09T06:43:20.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f137fe700 1 -- 172.21.15.62:0/2495406591 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f1400f040 con 0x7f7f1c102de0 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c119e90 con 0x7f7f1c102de0 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f137fe700 1 -- 172.21.15.62:0/2495406591 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f14009640 con 0x7f7f1c102de0 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.928+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c11a310 con 0x7f7f1c102de0 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.929+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c0fe530 con 0x7f7f1c102de0 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.930+0000 7f7f137fe700 1 -- 172.21.15.62:0/2495406591 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f7f140097a0 con 0x7f7f1c102de0 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.930+0000 7f7f137fe700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7f08078980 0x7f7f0807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.930+0000 7f7f137fe700 1 -- 172.21.15.62:0/2495406591 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f7f1409a6a0 con 0x7f7f1c102de0 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.930+0000 7f7f1a7fc700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7f08078980 0x7f7f0807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.931+0000 7f7f1a7fc700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7f08078980 0x7f7f0807ae30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c071ba0 tx=0x7f7f04009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:20.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:20.936+0000 7f7f137fe700 1 -- 172.21.15.62:0/2495406591 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f7f140620f0 con 0x7f7f1c102de0 2024-05-09T06:43:21.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.196+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f7f1c05f5c0 con 0x7f7f1c102de0 2024-05-09T06:43:21.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.197+0000 7f7f137fe700 1 -- 172.21.15.62:0/2495406591 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) v1 ==== 107+0+5207 (secure 0 0 0) 0x7f7f14061a90 con 0x7f7f1c102de0 2024-05-09T06:43:21.176 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-09T06:43:21.176 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi062.bwemju","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6829/2587505211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2587505211},{"type":"v1","addr":"172.21.15.62:6829","nonce":2587505211}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44303,"name":"cephfs.smithi079.qwqgdo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6825/3936046313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":3936046313},{"type":"v1","addr":"172.21.15.79:6825","nonce":3936046313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44329,"name":"cephfs.smithi079.pdxygz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/2608114839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":2608114839},{"type":"v1","addr":"172.21.15.79:6827","nonce":2608114839}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:15.419064+0000","modified":"2024-05-09T06:40:19.484479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi062.etsgzx","rank":0,"incarnation":33,"state":"up:active","state_seq":22,"addr":"172.21.15.62:6827/1556586455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1556586455},{"type":"v1","addr":"172.21.15.62:6827","nonce":1556586455}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-05-09T06:43:21.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7f08078980 msgr2=0x7f7f0807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7f08078980 0x7f7f0807ae30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c071ba0 tx=0x7f7f04009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c102de0 msgr2=0x7f7f1c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c102de0 0x7f7f1c070260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f14002a50 tx=0x7f7f140046b0 comp rx=0 tx=0).stop 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 shutdown_connections 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f7f08078980 0x7f7f0807ae30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f1c102de0 0x7f7f1c070260 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 --2- 172.21.15.62:0/2495406591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f1c103780 0x7f7f1c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 >> 172.21.15.62:0/2495406591 conn(0x7f7f1c0f8950 msgr2=0x7f7f1c0f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 shutdown_connections 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:21.200+0000 7f7f2185a700 1 -- 172.21.15.62:0/2495406591 wait complete. 2024-05-09T06:43:21.179 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 36 2024-05-09T06:43:21.559 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:21 smithi062 ceph-mon[109590]: pgmap v316: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:21.559 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:21 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/2495406591' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-05-09T06:43:21.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:21 smithi079 ceph-mon[82381]: pgmap v316: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:21.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:21 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/2495406591' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-05-09T06:43:21.758 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-09T06:43:21.770 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-09T06:43:21.770 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:43:21.770 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:43:21.790 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-09T06:43:21.791 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:43:21.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-09T06:43:22.162 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:23.499 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:23 smithi062 ceph-mon[109590]: pgmap v317: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:23.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:23 smithi079 ceph-mon[82381]: pgmap v317: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:23.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.722+0000 7fe99d9a3700 1 -- 172.21.15.62:0/1912399542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998103780 msgr2=0x7fe9980fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:23.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.722+0000 7fe99d9a3700 1 --2- 172.21.15.62:0/1912399542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998103780 0x7fe9980fcdf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe980004940 tx=0x7fe980009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:23.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.722+0000 7fe99d9a3700 1 -- 172.21.15.62:0/1912399542 shutdown_connections 2024-05-09T06:43:23.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.722+0000 7fe99d9a3700 1 --2- 172.21.15.62:0/1912399542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998103780 0x7fe9980fcdf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:23.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.722+0000 7fe99d9a3700 1 --2- 172.21.15.62:0/1912399542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe998102de0 0x7fe9981031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:23.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.722+0000 7fe99d9a3700 1 -- 172.21.15.62:0/1912399542 >> 172.21.15.62:0/1912399542 conn(0x7fe9980f8990 msgr2=0x7fe9980fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:23.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.722+0000 7fe99d9a3700 1 -- 172.21.15.62:0/1912399542 shutdown_connections 2024-05-09T06:43:23.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.722+0000 7fe99d9a3700 1 -- 172.21.15.62:0/1912399542 wait complete. 2024-05-09T06:43:23.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe99d9a3700 1 Processor -- start 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe99d9a3700 1 -- start start 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe99d9a3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998102de0 0x7fe998113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe99d9a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe998103780 0x7fe998113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe99d9a3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981144e0 con 0x7fe998102de0 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe99d9a3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99810dae0 con 0x7fe998103780 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe996ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998102de0 0x7fe998113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe996ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998102de0 0x7fe998113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39444/0 (socket says 172.21.15.62:39444) 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.723+0000 7fe996ffd700 1 -- 172.21.15.62:0/3264324326 learned_addr learned my addr 172.21.15.62:0/3264324326 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe9967fc700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe998103780 0x7fe998113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe996ffd700 1 -- 172.21.15.62:0/3264324326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe998103780 msgr2=0x7fe998113e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe996ffd700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe998103780 0x7fe998113e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:23.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe996ffd700 1 -- 172.21.15.62:0/3264324326 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980005040 con 0x7fe998102de0 2024-05-09T06:43:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe9967fc700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe998103780 0x7fe998113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:43:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe996ffd700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998102de0 0x7fe998113950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe988001d80 tx=0x7fe988009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe98f7fe700 1 -- 172.21.15.62:0/3264324326 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe988007d10 con 0x7fe998102de0 2024-05-09T06:43:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe98f7fe700 1 -- 172.21.15.62:0/3264324326 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe988007e70 con 0x7fe998102de0 2024-05-09T06:43:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99810ddc0 con 0x7fe998102de0 2024-05-09T06:43:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe98f7fe700 1 -- 172.21.15.62:0/3264324326 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe988014640 con 0x7fe998102de0 2024-05-09T06:43:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.724+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99810e380 con 0x7fe998102de0 2024-05-09T06:43:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.725+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9980fe530 con 0x7fe998102de0 2024-05-09T06:43:23.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.726+0000 7fe98f7fe700 1 -- 172.21.15.62:0/3264324326 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fe98800e960 con 0x7fe998102de0 2024-05-09T06:43:23.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.726+0000 7fe98f7fe700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe984078990 0x7fe98407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:23.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.726+0000 7fe98f7fe700 1 -- 172.21.15.62:0/3264324326 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fe98809a700 con 0x7fe998102de0 2024-05-09T06:43:23.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.726+0000 7fe9967fc700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe984078990 0x7fe98407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:23.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.727+0000 7fe9967fc700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe984078990 0x7fe98407ae40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe98000b3b0 tx=0x7fe980009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:23.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.731+0000 7fe98f7fe700 1 -- 172.21.15.62:0/3264324326 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fe988062200 con 0x7fe998102de0 2024-05-09T06:43:23.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.960+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe998109ec0 con 0x7fe998102de0 2024-05-09T06:43:23.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.960+0000 7fe98f7fe700 1 -- 172.21.15.62:0/3264324326 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v94) v1 ==== 81+0+2539 (secure 0 0 0) 0x7fe988061ba0 con 0x7fe998102de0 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6827/1887614093 2024-05-10T06:40:08.678562+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6825/331990842 2024-05-10T06:39:46.036846+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6824/331990842 2024-05-10T06:39:46.036846+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6829/490880971 2024-05-10T06:39:21.945504+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/2116890721 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1289942620 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/2116890721 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3355200013 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1346317374 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:23.941 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6829/2392096050 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/2849696799 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3025063198 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6828/490880971 2024-05-10T06:39:21.945504+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/3998880457 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6826/1887614093 2024-05-10T06:40:08.678562+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/626723007 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/942541084 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/4286057884 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/942541084 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6828/2392096050 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3034144881 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:23.942 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/849368193 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3826088130 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1261250966 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1042226830 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/995524261 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/671073453 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/851126602 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1371502517 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3864372487 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/21732303 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/3998880457 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/21732303 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:23.943 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6827/2962760421 2024-05-10T06:38:58.860052+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6826/2962760421 2024-05-10T06:38:58.860052+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3892499258 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/1879045212 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1725791497 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3633776630 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1184012656 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1180742032 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3842467719 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:23.944 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/4286057884 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe984078990 msgr2=0x7fe98407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe984078990 0x7fe98407ae40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe98000b3b0 tx=0x7fe980009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998102de0 msgr2=0x7fe998113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998102de0 0x7fe998113950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe988001d80 tx=0x7fe988009ec0 comp rx=0 tx=0).stop 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 shutdown_connections 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7fe984078990 0x7fe98407ae40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe998102de0 0x7fe998113950 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 --2- 172.21.15.62:0/3264324326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe998103780 0x7fe998113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:23.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 >> 172.21.15.62:0/3264324326 conn(0x7fe9980f8990 msgr2=0x7fe9980f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 shutdown_connections 2024-05-09T06:43:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:23.963+0000 7fe99d9a3700 1 -- 172.21.15.62:0/3264324326 wait complete. 2024-05-09T06:43:23.946 INFO:teuthology.orchestra.run.smithi062.stderr:listed 43 entries 2024-05-09T06:43:24.578 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:24 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3264324326' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:43:24.578 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:24 smithi062 ceph-mon[109590]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:24.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:24 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3264324326' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:43:24.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:24 smithi079 ceph-mon[82381]: from='mgr.34104 172.21.15.62:0/2460254842' entity='mgr.smithi062.juuasl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:24.603 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T06:43:24.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:24.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-09T06:43:24.633 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:43:24.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:24.633 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T06:43:24.711 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:43:24.711 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:43:24.732 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-05-09T06:43:24.732 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:43:24.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-09T06:43:25.062 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/mon.smithi062/config 2024-05-09T06:43:25.484 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:25 smithi062 ceph-mon[109590]: pgmap v318: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:25.492 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:25 smithi079 ceph-mon[82381]: pgmap v318: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.772+0000 7f432db42700 1 -- 172.21.15.62:0/1568464319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 msgr2=0x7f43281031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.772+0000 7f432db42700 1 --2- 172.21.15.62:0/1568464319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 0x7f43281031c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4318004940 tx=0x7f4318009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.772+0000 7f432db42700 1 -- 172.21.15.62:0/1568464319 shutdown_connections 2024-05-09T06:43:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.772+0000 7f432db42700 1 --2- 172.21.15.62:0/1568464319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4328103790 0x7f43280fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.772+0000 7f432db42700 1 --2- 172.21.15.62:0/1568464319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 0x7f43281031c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.772+0000 7f432db42700 1 -- 172.21.15.62:0/1568464319 >> 172.21.15.62:0/1568464319 conn(0x7f43280f8980 msgr2=0x7f43280fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.772+0000 7f432db42700 1 -- 172.21.15.62:0/1568464319 shutdown_connections 2024-05-09T06:43:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.772+0000 7f432db42700 1 -- 172.21.15.62:0/1568464319 wait complete. 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.773+0000 7f432db42700 1 Processor -- start 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.773+0000 7f432db42700 1 -- start start 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.773+0000 7f432db42700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 0x7f4328070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.773+0000 7f432db42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4328103790 0x7f43280707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.773+0000 7f432db42700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328070d30 con 0x7f4328102df0 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.773+0000 7f432db42700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328070e70 con 0x7f4328103790 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.773+0000 7f43277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 0x7f4328070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f43277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 0x7f4328070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39450/0 (socket says 172.21.15.62:39450) 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f43277fe700 1 -- 172.21.15.62:0/3812489030 learned_addr learned my addr 172.21.15.62:0/3812489030 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f4326ffd700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4328103790 0x7f43280707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f43277fe700 1 -- 172.21.15.62:0/3812489030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4328103790 msgr2=0x7f43280707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f43277fe700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4328103790 0x7f43280707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f43277fe700 1 -- 172.21.15.62:0/3812489030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318005040 con 0x7f4328102df0 2024-05-09T06:43:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f43277fe700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 0x7f4328070260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f431800b3b0 tx=0x7f4318009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f431ffff700 1 -- 172.21.15.62:0/3812489030 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431800e040 con 0x7f4328102df0 2024-05-09T06:43:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f431ffff700 1 -- 172.21.15.62:0/3812489030 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f431800bbc0 con 0x7f4328102df0 2024-05-09T06:43:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43280710c0 con 0x7f4328102df0 2024-05-09T06:43:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f431ffff700 1 -- 172.21.15.62:0/3812489030 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431801c3f0 con 0x7f4328102df0 2024-05-09T06:43:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.774+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432811a330 con 0x7f4328102df0 2024-05-09T06:43:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.775+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4328100100 con 0x7f4328102df0 2024-05-09T06:43:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.776+0000 7f431ffff700 1 -- 172.21.15.62:0/3812489030 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 39) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f431800bd30 con 0x7f4328102df0 2024-05-09T06:43:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.777+0000 7f431ffff700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4314078990 0x7f431407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.777+0000 7f431ffff700 1 -- 172.21.15.62:0/3812489030 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f431809bbc0 con 0x7f4328102df0 2024-05-09T06:43:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.777+0000 7f4326ffd700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4314078990 0x7f431407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.777+0000 7f4326ffd700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4314078990 0x7f431407ae40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4310009fd0 tx=0x7f4310009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:26.781+0000 7f431ffff700 1 -- 172.21.15.62:0/3812489030 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f4318063610 con 0x7f4328102df0 2024-05-09T06:43:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.011+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f43280fe540 con 0x7f4328102df0 2024-05-09T06:43:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.012+0000 7f431ffff700 1 -- 172.21.15.62:0/3812489030 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v94) v1 ==== 81+0+2539 (secure 0 0 0) 0x7f4318062fb0 con 0x7f4328102df0 2024-05-09T06:43:26.993 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6827/1887614093 2024-05-10T06:40:08.678562+0000 2024-05-09T06:43:26.993 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6825/331990842 2024-05-10T06:39:46.036846+0000 2024-05-09T06:43:26.993 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6824/331990842 2024-05-10T06:39:46.036846+0000 2024-05-09T06:43:26.993 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6829/490880971 2024-05-10T06:39:21.945504+0000 2024-05-09T06:43:26.993 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/2116890721 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1289942620 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/2116890721 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3355200013 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1346317374 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6829/2392096050 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/2849696799 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3025063198 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6828/490880971 2024-05-10T06:39:21.945504+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/3998880457 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6826/1887614093 2024-05-10T06:40:08.678562+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/626723007 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/942541084 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/4286057884 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/942541084 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:6828/2392096050 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3034144881 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/849368193 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:26.995 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3826088130 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:26.996 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1261250966 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:26.996 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1042226830 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:26.996 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/995524261 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:26.996 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/671073453 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:26.996 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/851126602 2024-05-10T06:21:00.610342+0000 2024-05-09T06:43:26.996 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1371502517 2024-05-10T06:22:29.031235+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3864372487 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/21732303 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/3998880457 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/21732303 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6827/2962760421 2024-05-10T06:38:58.860052+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6826/2962760421 2024-05-10T06:38:58.860052+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/3892499258 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.79:0/1879045212 2024-05-10T06:31:19.921997+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1725791497 2024-05-10T06:29:49.776754+0000 2024-05-09T06:43:26.997 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3633776630 2024-05-10T06:20:29.771562+0000 2024-05-09T06:43:26.998 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1184012656 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:26.998 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1180742032 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:26.998 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3842467719 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:26.998 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/4286057884 2024-05-10T06:34:23.941532+0000 2024-05-09T06:43:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4314078990 msgr2=0x7f431407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4314078990 0x7f431407ae40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4310009fd0 tx=0x7f4310009f20 comp rx=0 tx=0).stop 2024-05-09T06:43:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 msgr2=0x7f4328070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 0x7f4328070260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f431800b3b0 tx=0x7f4318009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 shutdown_connections 2024-05-09T06:43:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:6800/669341028,v1:172.21.15.62:6801/669341028] conn(0x7f4314078990 0x7f431407ae40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4328102df0 0x7f4328070260 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 --2- 172.21.15.62:0/3812489030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4328103790 0x7f43280707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 >> 172.21.15.62:0/3812489030 conn(0x7f43280f8980 msgr2=0x7f43280facd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 shutdown_connections 2024-05-09T06:43:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-09T06:43:27.014+0000 7f432db42700 1 -- 172.21.15.62:0/3812489030 wait complete. 2024-05-09T06:43:27.000 INFO:teuthology.orchestra.run.smithi062.stderr:listed 43 entries 2024-05-09T06:43:27.409 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:27 smithi062 ceph-mon[109590]: pgmap v319: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:27.410 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:27 smithi062 ceph-mon[109590]: from='client.? 172.21.15.62:0/3812489030' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:43:27.581 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-09T06:43:27.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:27.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-09T06:43:27.590 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:27 smithi079 ceph-mon[82381]: pgmap v319: 65 pgs: 65 active+clean; 195 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:27.590 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:27 smithi079 ceph-mon[82381]: from='client.? 172.21.15.62:0/3812489030' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:43:27.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-05-09T06:43:27.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:27.616 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-09T06:43:27.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:27.754 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-09T06:43:27.773 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T06:43:27.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:27.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T06:43:27.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:27.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-05-09T06:43:27.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:27.945 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-05-09T06:43:27.964 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-09T06:43:27.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:27.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T06:43:28.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:28.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-05-09T06:43:28.137 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-09T06:43:28.148 INFO:tasks.cephadm:Teardown begin 2024-05-09T06:43:28.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:43:28.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:43:28.207 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-09T06:43:28.207 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:43:28.240 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:43:28.264 INFO:tasks.cephadm:Stopping all daemons... 2024-05-09T06:43:28.265 INFO:tasks.cephadm.mon.smithi062:Stopping mon.smithi062... 2024-05-09T06:43:28.265 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062 2024-05-09T06:43:28.616 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:28 smithi062 systemd[1]: Stopping Ceph mon.smithi062 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:43:28.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:28 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[109586]: 2024-05-09T06:43:28.636+0000 7fc8d726b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi062 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:43:28.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:28 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062[109586]: 2024-05-09T06:43:28.636+0000 7fc8d726b700 -1 mon.smithi062@0(leader) e3 *** Got Signal Terminated *** 2024-05-09T06:43:28.910 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:28 smithi062 podman[152975]: 2024-05-09 06:43:28.65795831 +0000 UTC m=+0.157284048 container died e633b5f5dc2db18ac1ffceb1a74333ad1f6e1fb430b20429b8df1a9c004a1381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, ceph=True, GIT_BRANCH=HEAD) 2024-05-09T06:43:29.292 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:29 smithi062 podman[152975]: 2024-05-09 06:43:29.062475332 +0000 UTC m=+0.561801059 container cleanup e633b5f5dc2db18ac1ffceb1a74333ad1f6e1fb430b20429b8df1a9c004a1381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-09T06:43:29.292 INFO:journalctl@ceph.mon.smithi062.smithi062.stdout:May 09 06:43:29 smithi062 bash[152975]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi062 2024-05-09T06:43:29.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi062.service' 2024-05-09T06:43:29.481 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:43:29.481 INFO:tasks.cephadm.mon.smithi062:Stopped mon.smithi062 2024-05-09T06:43:29.482 INFO:tasks.cephadm.mon.smithi079:Stopping mon.smithi079... 2024-05-09T06:43:29.482 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi079 2024-05-09T06:43:29.781 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:29 smithi079 systemd[1]: Stopping Ceph mon.smithi079 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:43:30.039 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:29 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079[82377]: 2024-05-09T06:43:29.800+0000 7f3e13d6f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi079 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:43:30.039 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:29 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079[82377]: 2024-05-09T06:43:29.800+0000 7f3e13d6f700 -1 mon.smithi079@1(peon) e3 *** Got Signal Terminated *** 2024-05-09T06:43:30.039 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:29 smithi079 podman[113678]: 2024-05-09 06:43:29.811790877 +0000 UTC m=+0.122550906 container died bf2cbd432c7c4f20a738bfec595fafa4a20670ace1f836abc24535daffa8c78d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, io.buildah.version=1.33.5, ceph=True) 2024-05-09T06:43:30.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:30 smithi079 podman[113678]: 2024-05-09 06:43:30.234660056 +0000 UTC m=+0.545420083 container cleanup bf2cbd432c7c4f20a738bfec595fafa4a20670ace1f836abc24535daffa8c78d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T06:43:30.341 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:May 09 06:43:30 smithi079 bash[113678]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-mon-smithi079 2024-05-09T06:43:30.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@mon.smithi079.service' 2024-05-09T06:43:30.679 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:43:30.679 INFO:tasks.cephadm.mon.smithi079:Stopped mon.smithi079 2024-05-09T06:43:30.679 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-09T06:43:30.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.0 2024-05-09T06:43:30.988 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:30 smithi062 systemd[1]: Stopping Ceph osd.0 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:43:31.410 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:31 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[121238]: 2024-05-09T06:43:31.008+0000 7fd4cbce3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:43:31.410 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:31 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[121238]: 2024-05-09T06:43:31.008+0000 7fd4cbce3700 -1 osd.0 94 *** Got signal Terminated *** 2024-05-09T06:43:31.410 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:31 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0[121238]: 2024-05-09T06:43:31.008+0000 7fd4cbce3700 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:43:36.856 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:36 smithi062 podman[153107]: 2024-05-09 06:43:36.574275845 +0000 UTC m=+5.671677000 container died c4cee88020d39c22bc1fb2a280a45f08a8ec89f14d41d3a8bd31a662e5d81985 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T06:43:37.159 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:36 smithi062 podman[153107]: 2024-05-09 06:43:36.958877183 +0000 UTC m=+6.056278367 container cleanup c4cee88020d39c22bc1fb2a280a45f08a8ec89f14d41d3a8bd31a662e5d81985 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:43:37.160 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:36 smithi062 bash[153107]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0 2024-05-09T06:43:37.571 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:37 smithi062 podman[153123]: 2024-05-09 06:43:37.218631255 +0000 UTC m=+0.642866996 container remove c4cee88020d39c22bc1fb2a280a45f08a8ec89f14d41d3a8bd31a662e5d81985 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:43:37.910 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:37 smithi062 podman[153215]: 2024-05-09 06:43:37.49556585 +0000 UTC m=+0.019155803 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:43:37.910 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:37 smithi062 podman[153215]: 2024-05-09 06:43:37.62824711 +0000 UTC m=+0.151837048 container create 31b33a67db6b922885ab6bc6118840edb62b64268c3f4c8a4c69bd17ca356c24 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=main-720f8e9, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:43:37.910 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:37 smithi062 podman[153215]: 2024-05-09 06:43:37.830819148 +0000 UTC m=+0.354409097 container init 31b33a67db6b922885ab6bc6118840edb62b64268c3f4c8a4c69bd17ca356c24 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-09T06:43:37.910 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:37 smithi062 podman[153215]: 2024-05-09 06:43:37.834697954 +0000 UTC m=+0.358287893 container start 31b33a67db6b922885ab6bc6118840edb62b64268c3f4c8a4c69bd17ca356c24 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-09T06:43:38.405 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:37 smithi062 podman[153215]: 2024-05-09 06:43:37.960342936 +0000 UTC m=+0.483932899 container attach 31b33a67db6b922885ab6bc6118840edb62b64268c3f4c8a4c69bd17ca356c24 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-09T06:43:38.405 INFO:journalctl@ceph.osd.0.smithi062.stdout:May 09 06:43:38 smithi062 podman[153215]: 2024-05-09 06:43:38.139671952 +0000 UTC m=+0.663261890 container died 31b33a67db6b922885ab6bc6118840edb62b64268c3f4c8a4c69bd17ca356c24 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-05-09T06:43:38.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.0.service' 2024-05-09T06:43:38.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:43:38.747 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-09T06:43:38.747 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-09T06:43:38.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.1 2024-05-09T06:43:39.109 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:38 smithi062 systemd[1]: Stopping Ceph osd.1 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:43:39.393 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:39 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[126880]: 2024-05-09T06:43:39.129+0000 7fb067cb2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:43:39.393 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:39 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[126880]: 2024-05-09T06:43:39.129+0000 7fb067cb2700 -1 osd.1 94 *** Got signal Terminated *** 2024-05-09T06:43:39.393 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:39 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1[126880]: 2024-05-09T06:43:39.129+0000 7fb067cb2700 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:43:44.785 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:44 smithi062 podman[153331]: 2024-05-09 06:43:44.524860995 +0000 UTC m=+5.524993698 container died 85c00585e2e69d4e66e2ac7817fa57cc95ff32603b4e4a2115761d7b6b2f8cf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-09T06:43:45.159 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:44 smithi062 podman[153331]: 2024-05-09 06:43:44.887824864 +0000 UTC m=+5.887957567 container cleanup 85c00585e2e69d4e66e2ac7817fa57cc95ff32603b4e4a2115761d7b6b2f8cf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:43:45.159 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:44 smithi062 bash[153331]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1 2024-05-09T06:43:45.409 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:45 smithi062 podman[153350]: 2024-05-09 06:43:45.180907861 +0000 UTC m=+0.655186648 container remove 85c00585e2e69d4e66e2ac7817fa57cc95ff32603b4e4a2115761d7b6b2f8cf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:43:45.804 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:45 smithi062 podman[153443]: 2024-05-09 06:43:45.432737333 +0000 UTC m=+0.018962214 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:43:45.805 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:45 smithi062 podman[153443]: 2024-05-09 06:43:45.548391057 +0000 UTC m=+0.134615918 container create c7c20d6541a4af6c70ccb713cd535f069ba8227353d49c7bfd1c72bc4f29a2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-05-09T06:43:45.805 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:45 smithi062 podman[153443]: 2024-05-09 06:43:45.742447907 +0000 UTC m=+0.328672777 container init c7c20d6541a4af6c70ccb713cd535f069ba8227353d49c7bfd1c72bc4f29a2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-09T06:43:45.805 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:45 smithi062 podman[153443]: 2024-05-09 06:43:45.745945015 +0000 UTC m=+0.332169885 container start c7c20d6541a4af6c70ccb713cd535f069ba8227353d49c7bfd1c72bc4f29a2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, RELEASE=main-720f8e9, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:43:45.805 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:45 smithi062 podman[153443]: 2024-05-09 06:43:45.825801727 +0000 UTC m=+0.412026601 container attach c7c20d6541a4af6c70ccb713cd535f069ba8227353d49c7bfd1c72bc4f29a2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-720f8e9, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-09T06:43:46.160 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:46 smithi062 podman[153443]: 2024-05-09 06:43:46.054223855 +0000 UTC m=+0.640448719 container died c7c20d6541a4af6c70ccb713cd535f069ba8227353d49c7bfd1c72bc4f29a2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-09T06:43:46.567 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:46 smithi062 podman[153469]: 2024-05-09 06:43:46.571075353 +0000 UTC m=+0.511007001 container remove c7c20d6541a4af6c70ccb713cd535f069ba8227353d49c7bfd1c72bc4f29a2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:43:46.567 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:46 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.1.service: Deactivated successfully. 2024-05-09T06:43:46.567 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:46 smithi062 systemd[1]: Stopped Ceph osd.1 for f8b094b6-0dcb-11ef-bc97-c7b262605968. 2024-05-09T06:43:46.567 INFO:journalctl@ceph.osd.1.smithi062.stdout:May 09 06:43:46 smithi062 systemd[1]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.1.service: Consumed 10.877s CPU time. 2024-05-09T06:43:46.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.1.service' 2024-05-09T06:43:46.610 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:43:46.611 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-09T06:43:46.611 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-09T06:43:46.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.2 2024-05-09T06:43:46.910 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:46 smithi062 systemd[1]: Stopping Ceph osd.2 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:43:47.410 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:46 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[132527]: 2024-05-09T06:43:46.990+0000 7f669d1f8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:43:47.410 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:46 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[132527]: 2024-05-09T06:43:46.990+0000 7f669d1f8700 -1 osd.2 94 *** Got signal Terminated *** 2024-05-09T06:43:47.410 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:46 smithi062 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2[132527]: 2024-05-09T06:43:46.990+0000 7f669d1f8700 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:43:52.654 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:52 smithi062 podman[153548]: 2024-05-09 06:43:52.404596182 +0000 UTC m=+5.535940391 container died 89acd3b9ad6892ce5544e93bd80b9fd599f4bb8e8b640eeb4f0bfbd9f61cbcde (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T06:43:52.910 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:52 smithi062 podman[153548]: 2024-05-09 06:43:52.774358767 +0000 UTC m=+5.905702982 container cleanup 89acd3b9ad6892ce5544e93bd80b9fd599f4bb8e8b640eeb4f0bfbd9f61cbcde (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-09T06:43:52.910 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:52 smithi062 bash[153548]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2 2024-05-09T06:43:53.345 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:53 smithi062 podman[153570]: 2024-05-09 06:43:53.034045278 +0000 UTC m=+0.627505939 container remove 89acd3b9ad6892ce5544e93bd80b9fd599f4bb8e8b640eeb4f0bfbd9f61cbcde (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9) 2024-05-09T06:43:53.660 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:53 smithi062 podman[153666]: 2024-05-09 06:43:53.269936707 +0000 UTC m=+0.018542222 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:43:53.660 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:53 smithi062 podman[153666]: 2024-05-09 06:43:53.376869989 +0000 UTC m=+0.125475503 container create cfca3d74f9b582fdfd208e47d8f3452ec40717ffc552f4bab05bb7b1ec7da4bf (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-09T06:43:53.660 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:53 smithi062 podman[153666]: 2024-05-09 06:43:53.604242804 +0000 UTC m=+0.352848332 container init cfca3d74f9b582fdfd208e47d8f3452ec40717ffc552f4bab05bb7b1ec7da4bf (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-09T06:43:53.660 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:53 smithi062 podman[153666]: 2024-05-09 06:43:53.608103396 +0000 UTC m=+0.356708916 container start cfca3d74f9b582fdfd208e47d8f3452ec40717ffc552f4bab05bb7b1ec7da4bf (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:43:54.160 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:53 smithi062 podman[153666]: 2024-05-09 06:43:53.73781125 +0000 UTC m=+0.486416777 container attach cfca3d74f9b582fdfd208e47d8f3452ec40717ffc552f4bab05bb7b1ec7da4bf (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-09T06:43:54.160 INFO:journalctl@ceph.osd.2.smithi062.stdout:May 09 06:43:53 smithi062 podman[153666]: 2024-05-09 06:43:53.912268018 +0000 UTC m=+0.660873541 container died cfca3d74f9b582fdfd208e47d8f3452ec40717ffc552f4bab05bb7b1ec7da4bf (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-09T06:43:54.481 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.2.service' 2024-05-09T06:43:54.522 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:43:54.522 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-09T06:43:54.522 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-09T06:43:54.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.3 2024-05-09T06:43:54.816 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:43:54 smithi079 systemd[1]: Stopping Ceph osd.3 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:43:55.091 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:43:54 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[91316]: 2024-05-09T06:43:54.836+0000 7f1cd4bab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:43:55.091 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:43:54 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[91316]: 2024-05-09T06:43:54.836+0000 7f1cd4bab700 -1 osd.3 94 *** Got signal Terminated *** 2024-05-09T06:43:55.091 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:43:54 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3[91316]: 2024-05-09T06:43:54.836+0000 7f1cd4bab700 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:43:59.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:43:59 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:43:59.056+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:43:59.991 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:43:59 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:43:59.657+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:00.290 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:00 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:00.012+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:00.557 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:00 smithi079 podman[113811]: 2024-05-09 06:44:00.311210712 +0000 UTC m=+5.572527681 container died 8d7a05b6e02c86205430e77d845aa9a651863d8e7ebbbc9aebcb634421e3b58c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:44:00.841 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:00 smithi079 podman[113811]: 2024-05-09 06:44:00.744414821 +0000 UTC m=+6.005731829 container cleanup 8d7a05b6e02c86205430e77d845aa9a651863d8e7ebbbc9aebcb634421e3b58c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9) 2024-05-09T06:44:00.841 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:00 smithi079 bash[113811]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3 2024-05-09T06:44:00.841 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:00 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:00.655+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:01.341 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:00 smithi079 podman[113843]: 2024-05-09 06:44:00.946140537 +0000 UTC m=+0.634144219 container remove 8d7a05b6e02c86205430e77d845aa9a651863d8e7ebbbc9aebcb634421e3b58c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T06:44:01.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:01 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:01.027+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:01.606 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:01 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:01.613+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:01.607 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:01 smithi079 podman[113932]: 2024-05-09 06:44:01.371991208 +0000 UTC m=+0.113528541 container create 8e129170e3b77a7735fa845a90fb217e6c61f343e959c1cabdf78b332de40e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:44:01.607 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:01 smithi079 podman[113932]: 2024-05-09 06:44:01.276654624 +0000 UTC m=+0.018191928 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:01.913 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:01 smithi079 podman[113932]: 2024-05-09 06:44:01.625401284 +0000 UTC m=+0.366938578 container init 8e129170e3b77a7735fa845a90fb217e6c61f343e959c1cabdf78b332de40e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, io.buildah.version=1.33.5) 2024-05-09T06:44:01.913 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:01 smithi079 podman[113932]: 2024-05-09 06:44:01.629378169 +0000 UTC m=+0.370915466 container start 8e129170e3b77a7735fa845a90fb217e6c61f343e959c1cabdf78b332de40e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-09T06:44:01.913 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:01 smithi079 podman[113932]: 2024-05-09 06:44:01.708101567 +0000 UTC m=+0.449638885 container attach 8e129170e3b77a7735fa845a90fb217e6c61f343e959c1cabdf78b332de40e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=) 2024-05-09T06:44:02.206 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:02 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:02.039+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:02.206 INFO:journalctl@ceph.osd.3.smithi079.stdout:May 09 06:44:01 smithi079 podman[113932]: 2024-05-09 06:44:01.934394933 +0000 UTC m=+0.675932224 container died 8e129170e3b77a7735fa845a90fb217e6c61f343e959c1cabdf78b332de40e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS) 2024-05-09T06:44:02.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.3.service' 2024-05-09T06:44:02.541 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:02.541 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-09T06:44:02.541 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-09T06:44:02.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.4 2024-05-09T06:44:02.841 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:02 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:02.583+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:02.841 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:02 smithi079 systemd[1]: Stopping Ceph osd.4 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:44:03.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:03 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:03.024+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:03.341 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:02 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:02.897+0000 7f428a507700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:03.341 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:02 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:02.897+0000 7f428a507700 -1 osd.4 94 *** Got signal Terminated *** 2024-05-09T06:44:03.341 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:02 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:02.897+0000 7f428a507700 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:44:04.019 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:03 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:03.616+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:04.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:04 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:04.040+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:05.058 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:04 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:04.641+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:05.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:05 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:05.078+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:05.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:05 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:05.078+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:06.073 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:05 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:05.620+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:06.073 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:05 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:05.620+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:39.202399+0000 front 2024-05-09T06:43:39.202442+0000 (oldest deadline 2024-05-09T06:44:05.102515+0000) 2024-05-09T06:44:06.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:06 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:06.094+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:06.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:06 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:06.094+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:07.085 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:06 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:06.636+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:07.086 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:06 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:06.636+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:39.202399+0000 front 2024-05-09T06:43:39.202442+0000 (oldest deadline 2024-05-09T06:44:05.102515+0000) 2024-05-09T06:44:07.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:07 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:07.106+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:07.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:07 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:07.106+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:07.841 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:07 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:07.607+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:35.701898+0000 front 2024-05-09T06:43:35.701990+0000 (oldest deadline 2024-05-09T06:43:59.201935+0000) 2024-05-09T06:44:07.841 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:07 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4[96144]: 2024-05-09T06:44:07.607+0000 7f4282af3700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:39.202399+0000 front 2024-05-09T06:43:39.202442+0000 (oldest deadline 2024-05-09T06:44:05.102515+0000) 2024-05-09T06:44:08.371 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:08 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:08.117+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:08.371 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:08 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:08.117+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:08.626 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:08 smithi079 podman[114037]: 2024-05-09 06:44:08.393007215 +0000 UTC m=+5.604292156 container died 874246927b692c1440631be3f89b0b66756bd48a83bda58214ed0026ab114505 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5) 2024-05-09T06:44:08.910 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:08 smithi079 podman[114037]: 2024-05-09 06:44:08.721712528 +0000 UTC m=+5.932997476 container cleanup 874246927b692c1440631be3f89b0b66756bd48a83bda58214ed0026ab114505 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-09T06:44:08.910 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:08 smithi079 bash[114037]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4 2024-05-09T06:44:09.327 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:08 smithi079 podman[114054]: 2024-05-09 06:44:08.931404292 +0000 UTC m=+0.531860600 container remove 874246927b692c1440631be3f89b0b66756bd48a83bda58214ed0026ab114505 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:44:09.327 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:09 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:09.078+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:09.327 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:09 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:09.078+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:09.591 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:09 smithi079 podman[114144]: 2024-05-09 06:44:09.25156666 +0000 UTC m=+0.017816944 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:09.591 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:09 smithi079 podman[114144]: 2024-05-09 06:44:09.370047543 +0000 UTC m=+0.136297824 container create b23754b31428df0e3740b7938f5c1d631300ed490b611d162da47c690d9f509e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-05-09T06:44:09.591 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:09 smithi079 podman[114144]: 2024-05-09 06:44:09.593092765 +0000 UTC m=+0.359343047 container init b23754b31428df0e3740b7938f5c1d631300ed490b611d162da47c690d9f509e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9) 2024-05-09T06:44:09.591 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:09 smithi079 podman[114144]: 2024-05-09 06:44:09.596449223 +0000 UTC m=+0.362699509 container start b23754b31428df0e3740b7938f5c1d631300ed490b611d162da47c690d9f509e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:44:10.074 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:09 smithi079 podman[114144]: 2024-05-09 06:44:09.701482543 +0000 UTC m=+0.467732836 container attach b23754b31428df0e3740b7938f5c1d631300ed490b611d162da47c690d9f509e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:44:10.074 INFO:journalctl@ceph.osd.4.smithi079.stdout:May 09 06:44:09 smithi079 podman[114144]: 2024-05-09 06:44:09.891849734 +0000 UTC m=+0.658100016 container died b23754b31428df0e3740b7938f5c1d631300ed490b611d162da47c690d9f509e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-09T06:44:10.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:10 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:10.094+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:10.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:10 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:10.094+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:10.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.4.service' 2024-05-09T06:44:10.457 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:10.458 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-09T06:44:10.458 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-09T06:44:10.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.5 2024-05-09T06:44:10.795 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:10 smithi079 systemd[1]: Stopping Ceph osd.5 for f8b094b6-0dcb-11ef-bc97-c7b262605968... 2024-05-09T06:44:10.796 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:10 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:10.816+0000 7fb0df65d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:10.796 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:10 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:10.816+0000 7fb0df65d700 -1 osd.5 94 *** Got signal Terminated *** 2024-05-09T06:44:10.796 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:10 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:10.816+0000 7fb0df65d700 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:44:11.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:11.100+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:11.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:11 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:11.100+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:12.591 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:12 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:12.147+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:12.591 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:12 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:12.147+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:13.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:13 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:13.106+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:13.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:13 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:13.106+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:14.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:14 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:14.101+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:14.341 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:14 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:14.101+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:15.591 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:15 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:15.139+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-05-09T06:43:33.622925+0000 front 2024-05-09T06:43:33.622993+0000 (oldest deadline 2024-05-09T06:43:58.322753+0000) 2024-05-09T06:44:15.591 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:15 smithi079 ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5[101153]: 2024-05-09T06:44:15.139+0000 7fb0dbc51700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.62:6814 osd.1 since back 2024-05-09T06:43:40.023510+0000 front 2024-05-09T06:43:40.023545+0000 (oldest deadline 2024-05-09T06:44:04.723368+0000) 2024-05-09T06:44:16.510 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:16 smithi079 podman[114251]: 2024-05-09 06:44:16.238170277 +0000 UTC m=+5.533383150 container died 486b85997c378ee7a845f2e2b8a29a2bb4feb4fe9afcad20a664eab896543a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-720f8e9) 2024-05-09T06:44:16.511 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:16 smithi079 podman[114251]: 2024-05-09 06:44:16.531964121 +0000 UTC m=+5.827176996 container cleanup 486b85997c378ee7a845f2e2b8a29a2bb4feb4fe9afcad20a664eab896543a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-09T06:44:16.841 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:16 smithi079 bash[114251]: ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5 2024-05-09T06:44:16.841 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:16 smithi079 podman[114270]: 2024-05-09 06:44:16.749752072 +0000 UTC m=+0.507850347 container remove 486b85997c378ee7a845f2e2b8a29a2bb4feb4fe9afcad20a664eab896543a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0) 2024-05-09T06:44:17.306 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:17 smithi079 podman[114364]: 2024-05-09 06:44:17.058896783 +0000 UTC m=+0.096670634 container create 8d53f20e399ef95cc26d41ed8cd1cceb8422cb2fdf9886f0d4f9d286c7c2962c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-720f8e9, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-09T06:44:17.306 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:17 smithi079 podman[114364]: 2024-05-09 06:44:16.980131921 +0000 UTC m=+0.017905729 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:17.306 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:17 smithi079 podman[114364]: 2024-05-09 06:44:17.252847459 +0000 UTC m=+0.290621257 container init 8d53f20e399ef95cc26d41ed8cd1cceb8422cb2fdf9886f0d4f9d286c7c2962c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9) 2024-05-09T06:44:17.306 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:17 smithi079 podman[114364]: 2024-05-09 06:44:17.256524069 +0000 UTC m=+0.294297870 container start 8d53f20e399ef95cc26d41ed8cd1cceb8422cb2fdf9886f0d4f9d286c7c2962c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS) 2024-05-09T06:44:17.307 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:17 smithi079 podman[114364]: 2024-05-09 06:44:17.32762319 +0000 UTC m=+0.365396999 container attach 8d53f20e399ef95cc26d41ed8cd1cceb8422cb2fdf9886f0d4f9d286c7c2962c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=) 2024-05-09T06:44:17.591 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:17 smithi079 podman[114364]: 2024-05-09 06:44:17.553128961 +0000 UTC m=+0.590902748 container died 8d53f20e399ef95cc26d41ed8cd1cceb8422cb2fdf9886f0d4f9d286c7c2962c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=main-720f8e9) 2024-05-09T06:44:18.135 INFO:journalctl@ceph.osd.5.smithi079.stdout:May 09 06:44:18 smithi079 podman[114390]: 2024-05-09 06:44:18.147672633 +0000 UTC m=+0.588701954 container remove 8d53f20e399ef95cc26d41ed8cd1cceb8422cb2fdf9886f0d4f9d286c7c2962c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, ceph=True, org.label-schema.build-date=20240507) 2024-05-09T06:44:18.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8b094b6-0dcb-11ef-bc97-c7b262605968@osd.5.service' 2024-05-09T06:44:18.179 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:18.179 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-09T06:44:18.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T06:44:41.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T06:44:56.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:44:56.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:44:56.206 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-09T06:44:56.208 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439/remote/smithi062/crash 2024-05-09T06:44:56.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/crash -- . 2024-05-09T06:44:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:tar: /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T06:44:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:tar: Error is not recoverable: exiting now 2024-05-09T06:44:56.249 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439/remote/smithi079/crash 2024-05-09T06:44:56.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/crash -- . 2024-05-09T06:44:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T06:44:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2024-05-09T06:44:56.275 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-09T06:44:56.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-09T06:44:56.332 INFO:tasks.cephadm:Compressing logs... 2024-05-09T06:44:56.332 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T06:44:56.375 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T06:44:56.399 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T06:44:56.399 INFO:teuthology.orchestra.run.smithi079.stderr:: No such file or directory 2024-05-09T06:44:56.399 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.log 2024-05-09T06:44:56.404 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T06:44:56.404 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-09T06:44:56.404 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.log: /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.5.log: /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mon.smithi079.log 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mgr.smithi079.genyri.log 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mon.smithi079.log: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mgr.smithi079.genyri.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi079.qwqgdo.log 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.cephadm.log: 87.6% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi079.pdxygz.log 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi079.qwqgdo.log: 85.5% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T06:44:56.405 INFO:teuthology.orchestra.run.smithi079.stderr: 91.3% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T06:44:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T06:44:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:: No such file or directory 2024-05-09T06:44:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mgr.smithi062.juuasl.log 2024-05-09T06:44:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.log 2024-05-09T06:44:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mgr.smithi062.juuasl.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-09T06:44:56.408 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T06:44:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mon.smithi062.log 2024-05-09T06:44:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.2.log: /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-09T06:44:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mon.smithi062.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-09T06:44:56.409 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.1.log: 87.6% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T06:44:56.409 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T06:44:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi062.etsgzx.log 2024-05-09T06:44:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T06:44:56.423 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi062.etsgzx.log: gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T06:44:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.cephadm.log: 85.6%gzip -5 --verbose -- /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi062.bwemju.log 2024-05-09T06:44:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-volume.log: -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T06:44:56.437 INFO:teuthology.orchestra.run.smithi062.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T06:44:56.438 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi079.pdxygz.log: /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T06:44:56.454 INFO:teuthology.orchestra.run.smithi079.stderr: 89.7% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mgr.smithi079.genyri.log.gz 2024-05-09T06:44:56.482 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi062.bwemju.log: 91.1% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T06:44:56.708 INFO:teuthology.orchestra.run.smithi079.stderr: 92.5% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mon.smithi079.log.gz 2024-05-09T06:44:56.821 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mgr.smithi062.juuasl.log.gz 2024-05-09T06:44:57.554 INFO:teuthology.orchestra.run.smithi062.stderr: 90.5% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mon.smithi062.log.gz 2024-05-09T06:45:01.741 INFO:teuthology.orchestra.run.smithi079.stderr: 94.9% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi079.qwqgdo.log.gz 2024-05-09T06:45:02.368 INFO:teuthology.orchestra.run.smithi079.stderr: 93.5% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-09T06:45:02.412 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-09T06:45:02.520 INFO:teuthology.orchestra.run.smithi079.stderr: 93.4% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-09T06:45:02.693 INFO:teuthology.orchestra.run.smithi062.stderr: 93.1% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-09T06:45:02.872 INFO:teuthology.orchestra.run.smithi079.stderr: 93.4% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-09T06:45:03.387 INFO:teuthology.orchestra.run.smithi079.stderr: 94.9% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi079.pdxygz.log.gz 2024-05-09T06:45:03.390 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-05-09T06:45:03.390 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m7.000s 2024-05-09T06:45:03.390 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m30.220s 2024-05-09T06:45:03.390 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m1.017s 2024-05-09T06:45:03.854 INFO:teuthology.orchestra.run.smithi062.stderr: 94.9% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi062.bwemju.log.gz 2024-05-09T06:45:04.355 INFO:teuthology.orchestra.run.smithi062.stderr: 92.8% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-09T06:46:36.215 INFO:teuthology.orchestra.run.smithi062.stderr: 92.8% -- replaced with /var/log/ceph/f8b094b6-0dcb-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi062.etsgzx.log.gz 2024-05-09T06:46:36.216 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-05-09T06:46:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:real 1m39.828s 2024-05-09T06:46:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:user 2m5.249s 2024-05-09T06:46:36.216 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m3.600s 2024-05-09T06:46:36.217 INFO:tasks.cephadm:Archiving logs... 2024-05-09T06:46:36.217 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439/remote/smithi062/log 2024-05-09T06:46:36.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:46:54.258 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439/remote/smithi079/log 2024-05-09T06:46:54.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:46:58.190 INFO:tasks.cephadm:Removing cluster... 2024-05-09T06:46:58.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 --force 2024-05-09T06:46:58.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f8b094b6-0dcb-11ef-bc97-c7b262605968 --force 2024-05-09T06:46:59.341 INFO:tasks.cephadm:Removing cephadm ... 2024-05-09T06:46:59.341 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T06:46:59.358 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T06:46:59.375 INFO:tasks.cephadm:Teardown complete 2024-05-09T06:46:59.375 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T06:46:59.386 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T06:46:59.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:46:59.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:46:59.483 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T06:46:59.494 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T06:46:59.494 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:46:59.497 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:46:59.511 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:46:59.511 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:46:59.517 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:46:59.517 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-05-09T06:46:59.517 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 48 +1190us[+1497us] +/- 39ms 2024-05-09T06:46:59.517 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -1078us[ -771us] +/- 62ms 2024-05-09T06:46:59.517 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -955us[ -647us] +/- 81ms 2024-05-09T06:46:59.517 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:46:59.517 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:46:59.517 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-05-09T06:46:59.518 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 51 +1198us[+1209us] +/- 39ms 2024-05-09T06:46:59.518 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -1101us[-1090us] +/- 62ms 2024-05-09T06:46:59.518 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -962us[ -951us] +/- 81ms 2024-05-09T06:46:59.518 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:46:59.518 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T06:46:59.530 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T06:46:59.531 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T06:46:59.542 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T06:46:59.642 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T06:46:59.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:46:59.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:46:59.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:46:59.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:46:59.774 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T06:46:59.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T06:46:59.797 INFO:teuthology.task.internal:Duration was 2114.390515 seconds 2024-05-09T06:46:59.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T06:46:59.809 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T06:46:59.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:46:59.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:46:59.849 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:46:59.853 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:47:00.199 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T06:47:00.199 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-05-09T06:47:00.200 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:47:00.263 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-05-09T06:47:00.263 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:47:00.286 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T06:47:00.286 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:47:00.305 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:47:00.353 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T06:47:00.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:47:00.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:47:01.063 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T06:47:01.076 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T06:47:01.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:47:01.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:47:01.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T06:47:01.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:47:01.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:47:01.167 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-05-09T06:47:01.192 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-05-09T06:47:01.206 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:47:01.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:47:01.240 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:47:01.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:47:01.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T06:47:01.273 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T06:47:01.274 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439/remote/smithi062 2024-05-09T06:47:01.274 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:47:01.338 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699439/remote/smithi079 2024-05-09T06:47:01.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:47:01.376 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T06:47:01.376 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:47:01.378 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:47:01.425 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T06:47:01.437 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T06:47:01.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T06:47:01.450 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T06:47:01.450 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:47:01.452 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:47:01.465 INFO:teuthology.orchestra.run.smithi062.stdout: 265585 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:47 /home/ubuntu/cephtest 2024-05-09T06:47:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:47 /home/ubuntu/cephtest 2024-05-09T06:47:01.481 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T06:47:01.493 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T06:47:01.622 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2114.390514612198 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T06:47:01.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T06:47:01.709 INFO:teuthology.run:pass